WO2021256240A1 - ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 - Google Patents

ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 Download PDF

Info

Publication number
WO2021256240A1
WO2021256240A1 PCT/JP2021/020830 JP2021020830W WO2021256240A1 WO 2021256240 A1 WO2021256240 A1 WO 2021256240A1 JP 2021020830 W JP2021020830 W JP 2021020830W WO 2021256240 A1 WO2021256240 A1 WO 2021256240A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
image
terminal
facility
visitor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/020830
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
浩平 金澤
晃 浪口
陽平 水谷
雄也 木元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Solution Innovators Ltd
Original Assignee
NEC Solution Innovators Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Solution Innovators Ltd filed Critical NEC Solution Innovators Ltd
Priority to JP2022532473A priority Critical patent/JP7393054B2/ja
Publication of WO2021256240A1 publication Critical patent/WO2021256240A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for

Definitions

  • the present invention relates to a guide device, a guide system, a guide method, a program, and a recording medium.
  • Patent Document 1 a technique for promoting a product or the like using AR (Augmented Reality) technology has been proposed (for example, Patent Document 1).
  • the present invention in a large facility of an exhibition hall or the like, it is possible to display information by AR on the terminal screen of the user (visitor) in an easy-to-understand manner, and to operate the screen of the terminal of the user (visitor).
  • the purpose is to provide a guide device and a guide method that do not interfere with the above.
  • the guide device of the present invention includes image capture information acquisition unit, virtual information generation unit, map information management unit, visitor terminal information acquisition unit, and image information output unit.
  • the image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
  • the virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management unit manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition unit acquires the position information of the terminal and the orientation information of the terminal.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
  • the virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other.
  • the image information output unit superimposes the facility position image on the position corresponding to the image of the facility in the captured image, provides a window unit, and displays the facility detailed information image on the window unit.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management unit manages the position information of the terminal and the orientation information of the terminal on the map.
  • the image information output unit is a device capable of controlling the order of screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map. ..
  • the guide method of the present invention Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, and image information output process.
  • image pickup information acquisition step an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management process manages the facility location information in association with the map of the specific area.
  • the location information of the visitor's terminal and the orientation information of the visitor's terminal are acquired.
  • the image information output step a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other.
  • the image information output step in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management process manages the position information of the terminal and the orientation information of the terminal on the map.
  • the image information output step is a method capable of controlling the order of screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map. ..
  • information by AR can be displayed on the terminal in an easy-to-understand manner for the user, and the user's operation on the terminal screen is not hindered.
  • FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment
  • FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment
  • FIG. 2 is a block diagram showing an example of the hardware configuration of the apparatus of the first embodiment.
  • FIG. 3 is a flowchart showing an example of processing in the apparatus of the first embodiment.
  • FIG. 4 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 5 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 6 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment
  • FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment.
  • FIG. 2 is a block diagram
  • FIG. 7 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 8 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 9 is a schematic diagram showing an example of the hierarchical structure of the facility detailed information image.
  • FIG. 10 is a schematic diagram showing an example of a single swipe and a multi-swipe.
  • the "visitor” means a person who comes within a specific area, and is also referred to as a user. Visitors can also be rephrased as visitors, visitors, and the like.
  • FIG. 1A is a block diagram showing a configuration of an example of a guide device 10 of the present embodiment
  • FIG. 1B is a schematic showing a configuration of an example of a guide system including the guide device 10 of the present embodiment. It is a figure.
  • the apparatus 10 includes an image pickup information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and a terminal screen operation. It includes an information acquisition unit 16, a specific area information acquisition unit 17, and a visitor information acquisition unit 18.
  • the terminal screen operation information acquisition unit 16, the specific area information acquisition unit 17, and the visitor information acquisition unit 18 have an arbitrary configuration and may not be included in the present device 10. The guide system will be described later.
  • the device 10 may be, for example, one device including the above-mentioned parts, or may be a device in which the above-mentioned parts can be connected via the communication network 30. Further, the present device 10 can be connected to an external device described later via the communication line network 30.
  • the communication network 30 is not particularly limited, and a known network can be used, and may be wired or wireless, for example. Examples of the communication line network 30 include an Internet line, WWW (World Wide Web), a telephone line, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Traveler Network), and the like. Examples of wireless communication include WiFi (Wireless Fidelity), Bluetooth (registered trademark) and the like.
  • the wireless communication may be either a form in which each device directly communicates (Ad Hoc communication) or an indirect communication via an access point.
  • the apparatus 10 may be incorporated in the server as a system, for example. Further, the apparatus 10 is, for example, a personal computer (PC, for example, a desktop type, a notebook type), a terminal (for example, a smartphone, a mobile phone, a glasses type, a watch type, or the like) wearable terminal on which the program of the present invention is installed. ) Etc. may be used.
  • FIG. 2 illustrates a block diagram of the hardware configuration of the present device 10.
  • the apparatus 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, a display device 106, a communication device 107, and the like. Each part of the apparatus 10 is connected to each other via a bus 103 by each interface (I / F).
  • I / F interface
  • the central processing unit (also referred to as a central processing unit or a central processing unit) 101 is responsible for controlling the entire device 10.
  • the program of the present invention and other programs are executed by the central processing unit 101, and various information is read and written.
  • the central arithmetic processing device 101 includes an image pickup information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and terminal screen operation information. It functions as an acquisition unit 16, a specific area information acquisition unit 17, and a visitor information acquisition unit 18.
  • the bus 103 can also be connected to, for example, an external device.
  • the external device include an external storage device (external database, etc.), a printer, and the like.
  • the device 10 can be connected to an external network (communication network) by, for example, a communication device 107 connected to the bus 103, and can also be connected to another device via the external network.
  • the memory 102 may be, for example, a main memory (main storage device).
  • main memory main storage device
  • the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104 described later, and the central processing unit 101 reads the memory. Receives data from 102 and executes the program.
  • the main memory is, for example, a RAM (random access memory).
  • the memory 102 may be, for example, a ROM (read-only memory).
  • the storage device 104 is also referred to as a so-called auxiliary storage device with respect to the main memory (main storage device), for example.
  • the storage device 104 stores an operation program including the program of the present invention.
  • the storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium.
  • the recording medium is not particularly limited, and may be an internal type or an external type, and examples thereof include HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, and memory card. Be done.
  • the storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and a drive are integrated, and a solid state drive (SSD).
  • HDD hard disk drive
  • SSD solid state drive
  • the memory 102 and the storage device 104 can also store user log information and information acquired from an external database (not shown).
  • the device 10 further includes, for example, an input device 105 and a display device 106.
  • the input device 105 is, for example, a touch panel, a keyboard, a mouse, or the like.
  • Examples of the display device 106 include an LED display, a liquid crystal display, and the like.
  • the guide method of the present embodiment is carried out as follows, for example, by using the guide device 10 of FIG.
  • the guide method of the present embodiment is not limited to the use of the guide device 10 of FIG.
  • the image pickup information acquisition unit 11 acquires an image captured by a terminal of a visitor in a specific area (S1).
  • the specific area is not particularly limited and may be indoors or outdoors.
  • the indoors include, for example, exhibition halls, event halls, department stores, schools such as universities, and the like.
  • the terminal of the visitor is not particularly limited, and is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type, and the like.
  • the captured image may be, for example, a still image or a moving image.
  • the acquisition is performed, for example, via the communication network 30.
  • the virtual information generation unit 12 generates a virtual image related to the specific area (S2).
  • the generated virtual image includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a position image of the facility and a detailed information image of the facility, and the position image of the facility and the detailed information image of the facility are associated with each other.
  • the location image of the facility is also referred to as a facility location image
  • the detailed information image of the facility is also referred to as a facility detailed information image.
  • the facility detailed information image is, for example, an image having a hierarchical structure of one layer or two or more layers.
  • the position image is, for example, an image based on the facility position information.
  • the detailed information image is, for example, an image based on the detailed information of the facility.
  • One facility detailed information image may be associated with one facility position image, or two facility detailed information images may be associated with one.
  • the facility position image and the facility detailed information image may be stored in the memory 102 or the storage device 104 in advance, or may be acquired from an external database via the communication network 30. Further, as will be described later, the facility position image and the facility detailed information image may be generated by the virtual information generation unit 12.
  • the facility is not particularly limited as long as it is installed in the specific area. Specifically, for example, there are exhibition booths, shops, tenants, classrooms, examination rooms, and the like.
  • the map information management unit 13 manages the facility location information in association with the map of the specific area (S3).
  • the facility location information is, for example, information indicating the location of the facility, and specifically, the location of an exhibition booth, a tenant, a classroom, or the like is indicated.
  • the visitor terminal information acquisition unit 14 acquires the position information of the terminal and the orientation information of the terminal (S4).
  • the position information and orientation information of the terminal are, for example, information in which the position and orientation (direction) of the terminal are specified by a position code or a direction mark arranged in the specific area.
  • the position code may also serve as, for example, the direction mark.
  • the position code and the direction mark include, for example, a QR code (registered trademark), an AR marker, a barcode, a chameleon code (registered trademark), and the like.
  • the position information of the terminal and the orientation information of the terminal may be information specified by using a known technique.
  • the image information output unit 15 outputs a composite image in which the virtual image is superimposed on the captured image (S5).
  • the output may be executed, for example, via the communication network 30.
  • the image information output unit 15 superimposes the facility position image on the position corresponding to the image of the facility in the captured image, provides a window unit, and displays the facility detailed information image on the window unit.
  • the composite image is output to the visitor terminal.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the window unit can display, for example, the facility detailed information image on a screen in which an image for each layer can be transitioned.
  • the map information management unit 13 manages the position information of the terminal and the orientation information of the terminal on the map (S6).
  • the image information output unit 15 controls the order of the screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map (S7). End (END).
  • the image information output unit 15 may specify the front direction of the visitor, for example, based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • the order of the screens to be transitioned and displayed in the window portion may be, for example, the order of the facilities arranged in the left-right direction in the front direction.
  • the terminal screen operation information acquisition unit 16 may acquire the screen operation information of the terminal before the step (S7) (S8).
  • the screen operation information is, for example, information related to the operation of the visitor, specifically, a swipe operation on the screen (terminal screen) of the terminal, a line-of-sight detection, a blink detection, a voice instruction, and a voice instruction of the terminal. A tap operation on the screen, a combination of two or more of these, and the like.
  • the image information output unit 15 transitions the screen of the window unit according to the screen operation information.
  • the step (S8) may be performed before the step (S7), and may be processed in parallel with the step (S6) after the step (S5) as shown in FIG.
  • the window unit can display the facility detailed information image on a screen in which images for each layer can be transitioned
  • the visitor can display the facility detailed information image with one finger.
  • the screen of the terminal is swiped, for example, the screen of the window unit changes for each layer.
  • the screen of the window portion changes for each facility detailed information image. Specifically, it will be described later.
  • the specific area information acquisition unit 17 may acquire detailed facility information regarding the facility in the specific area (S9).
  • the step (S9) may be processed in parallel with the step (S1), for example, as shown in FIG.
  • the acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105.
  • the facility detailed information is, for example, information about an exhibition booth or the like, and more specifically, information such as a company name, company introduction information, products and services, and the like.
  • the virtual information generation unit 12 generates, for example, the facility detailed information image based on the facility detailed information. Further, the virtual information generation unit 12 may generate the facility position image based on the facility position information.
  • the visitor information acquisition unit 18 may acquire information about the visitor (S10).
  • the step (S10) may be processed in parallel with the step (S1), for example, as shown in FIG.
  • the acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105.
  • the information about the visitors is, for example, the attributes of the visitors (gender, age, occupation), the purpose of the visit (inspection, business negotiations, etc.), the exhibition booth (area) of interest, and the like.
  • the image information output unit 15 outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the virtual image includes recommendation information, schedule information, exhibition booth information, and the like.
  • the recommendation information is, for example, information recommended to the visitor based on the information about the visitor (for example, a recommended event, a recommended exhibition booth, etc.).
  • the schedule information is, for example, information indicating the schedule of an event to be held in the specific area. Examples of the event include demonstrations and seminars.
  • the event may be an event promoted by the organizer or an event promoted by the exhibitor.
  • the exhibition booth information is, for example, company name, company introduction information, information on products and services, and the like.
  • the composite image is displayed on the screen (display) of the terminal 20.
  • the facility position images are, for example, pin images 4a to 4c showing the positions of exhibition booths.
  • identification information may be added to each of the pin images 4a to 4c.
  • the identification information is, for example, a number, a character, a symbol, and a combination of two or more thereof.
  • the pin images 4a to 4c are arranged at positions based on the facility position information, for example.
  • the window portion may be arranged at the lower part of the composite image, for example, as shown in FIG. 4, but the present invention is not limited to this.
  • the window unit transitions and displays a plurality of the facility detailed information images. In FIG. 4, a facility detailed information image of company A (A Corp.) is displayed in the window section (Window).
  • the order of the screens to be transitioned and displayed in the window section will be explained.
  • the upper part of FIG. 5 shows the front direction 2 of each facility (booth) in the specific area and user 1 (terminal 20).
  • the lower part of FIG. 5 shows an example of a group of terminals 20 and facility detailed information images.
  • the facility detailed information image B is displayed on the terminal 20.
  • the order of the screens to be transitioned and displayed in the window section is as follows: user 1 uses facility detailed information images A to C corresponding to exhibition booths (pin images) A to C, which are the group closest to the position of the terminal 20.
  • the exhibition booths (pin images) "near G1" and “near G2”, which are the group “near G” that is the second closest to the position of the terminal 20, are supported.
  • Detailed facility information image “Near G1” and “Near G2” are arranged in the order of facilities (booths) arranged in the left-right direction in the front direction 2 of the user 1.
  • the order of the screens to be transitioned and displayed in the window section will be further described.
  • the exhibition booths (pin images) B, A, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booths B and A are in the window portion.
  • the facility detailed information image is displayed in this order.
  • the exhibition booths (pin images) A, B, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth is in the window portion.
  • the facility detailed information image is displayed in the order of A, B, and C.
  • the exhibition booths (pin images) C, A, and B are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth C is in the window portion. , A, B, and the facility detailed information image is displayed in this order.
  • the front-back and left-right directions of the exhibition booth change depending on the position and direction of the user 1 (terminal 20).
  • the image information output unit 15 identifies the front direction 2 of the user 1 based on the position information of the terminal 20 and the orientation information of the terminal 20, and displays the facility details according to the front direction 2 of the specified user 1.
  • the order of the information images changes. Further, as shown in FIG.
  • the pin image (facility position image) corresponding to the facility detailed information image is linked and selected. It may be in a state.
  • the selected state is, for example, a state indicating that the user has selected a pin image.
  • the pin image (A) is in the selected state
  • the pin image (B) is in the selected state
  • the pin image (C) is in the selected state.
  • An example is shown in which the image (C) is in the selected state.
  • FIG. 9 shows an example of the hierarchical structure of the facility detailed information image.
  • the facility detailed information image has facility detailed information images (a1) to (a3) in the lower layer of the facility detailed information image (a), and the facility is in the lower layer of the facility detailed information image (a3).
  • the facility detailed information image (a) is an image based on the facility detailed information indicating the company name.
  • the facility detailed information image (a1) is an image based on the facility detailed information showing the company introduction
  • the facility detailed information image (a2) is an image based on the facility detailed information showing the greetings of the representative and the like, and the facility detailed information.
  • the image (a3) is an image based on detailed facility information showing products, services, and the like.
  • the facility detailed information images (a3-1) to (a3-3) are images based on the facility detailed information showing each of the product A, the product B, and the product C.
  • FIG. 10 shows an example of a single swipe and a multi-swipe.
  • FIG. 10A when the user swipes the screen of the terminal 20 from left to right (also referred to as a single swipe) with one finger, for example, the displayed facility detailed information image (a).
  • the facility detailed information image (a1) which is the lower layer, is displayed on the terminal 20.
  • the order of the facility detailed information images (a1) to (a3) is not particularly limited, and can be arbitrarily set by the exhibitor, for example.
  • FIG. 10B when the user swipes the screen of the terminal 20 from left to right (also referred to as multi-swipe) with two or more fingers, for example, the displayed facility detailed information is displayed.
  • the other facility detailed information image (b) that is not the lower layer of the image (a) is displayed on the terminal 20. That is, the terminal 20 skips (does not display) the facility detailed information images (a1) to (a3) and the facility detailed information images (a3-1) to (a3-3), and displays the facility detailed information image (b). indicate.
  • the direction of the swipe is an example and is not limited thereto. The swipe direction may be, for example, swiped from right to left, from top to bottom, from bottom to top, and the like.
  • FIG. 1B is a schematic diagram showing the configuration of an example of the guide system of the present embodiment.
  • the guide system of the present embodiment includes the guide device 10 according to any one of the first to third embodiments, and the terminal 20.
  • the terminal 20 is the terminal of a visitor in the specific area.
  • the guide device 10 and the terminal 20 can communicate with each other via the communication network 30.
  • the guide system is also referred to as a guide system device.
  • the guide system of the present embodiment may further include the exhibitor's terminal, for example.
  • the exhibitor's terminal is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type.
  • the guide device 10 and the exhibitor's terminal can communicate with each other via, for example, a communication network 30.
  • the program of the present embodiment is a program for causing a computer to execute each step of the method of the present invention as a procedure.
  • "procedure” may be read as "processing”.
  • the program of the present embodiment may be recorded on a computer-readable recording medium, for example.
  • the recording medium is, for example, a non-transitory computer-readable storage medium.
  • the recording medium is not particularly limited, and examples thereof include a read-only memory (ROM), a hard disk (HD), and an optical disk.
  • Appendix 1 Includes image capture information acquisition unit, virtual information generation unit, map information management unit, visitor terminal information acquisition unit, and image information output unit.
  • the image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
  • the virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management unit manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition unit acquires the position information of the terminal and the orientation information of the terminal.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
  • the virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other.
  • the image information output unit superimposes the facility position image on the position corresponding to the image of the facility in the captured image, provides a window unit, and displays the facility detailed information image on the window unit.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management unit manages the position information of the terminal and the orientation information of the terminal on the map.
  • the image information output unit can control the order of screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • Guide device (Appendix 2)
  • the image information output unit identifies the front direction of the visitor based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • the guide device according to Appendix 1, wherein the order of the screens displayed by transitioning in the window unit in the image information output unit is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • the guide device according to Appendix 1 or 2, wherein the window unit can display the facility detailed information image on a screen in which an image for each layer can be changed.
  • Appendix 4 In addition, it includes a terminal screen operation information acquisition unit.
  • the terminal screen operation information acquisition unit acquires the screen operation information of the terminal, and obtains the screen operation information of the terminal.
  • the guide device according to any one of Supplementary note 1 to 3, wherein the image information output unit transitions the screen of the window unit according to the screen operation information.
  • the screen operation information is information related to a swipe operation on the screen of the terminal by the operation of the visitor.
  • the guide device according to Appendix 4.
  • the guide device is the guide device described in Appendix 3, and is the guide device.
  • the guide device includes a specific area information acquisition section.
  • the specific area information acquisition unit acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
  • the guide device according to any one of Supplementary note 1 to 6, wherein the virtual information generation unit generates the facility detailed information image based on the facility detailed information.
  • the visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the guide device according to any one of Supplementary note 1 to 7. (Appendix 9) Including guide device and terminal
  • the guide device is the guide device according to any one of Supplementary Provisions 1 to 8.
  • the terminal is the terminal of the visitor, The guide device and the terminal can communicate with each other via a communication network.
  • Guide system. (Appendix 10) Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, and image information output process.
  • an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management process manages the facility location information in association with the map of the specific area.
  • the location information of the visitor's terminal and the orientation information of the visitor's terminal are acquired.
  • the image information output step a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other.
  • the image information output step in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management process manages the position information of the terminal and the orientation information of the terminal on the map.
  • the image information output step it is possible to control the order of the screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • Guide method. (Appendix 11)
  • the image information output step identifies the front direction of the visitor based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • the guide method according to Appendix 10 wherein the order of the screens transitioned and displayed in the window portion in the image information output step is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • Appendix 13 In addition, it includes a terminal screen operation information acquisition process. In the terminal screen operation information acquisition process, the screen operation information of the terminal is acquired, and the terminal screen operation information is acquired.
  • the screen operation information is information related to a swipe operation on the screen of the terminal by the operation of the visitor.
  • the guide method described in Appendix 13. (Appendix 15) The guide method is the guide method described in Appendix 12. When a visitor swipes the screen of the terminal with one finger, the screen of the window section changes for each layer. When a visitor swipes the screen of the terminal with two or more fingers, the screen of the window portion changes for each facility detailed information image.
  • the guide method described in Appendix 14. (Appendix 16) In addition, it includes a specific area information acquisition process.
  • the specific area information acquisition step acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
  • the guide method according to any one of Supplementary note 10 to 15, wherein the virtual information generation step generates the facility detailed information image based on the facility detailed information.
  • (Appendix 17) In addition, it includes a visitor information acquisition process.
  • the visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
  • the image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the guide method according to any one of Supplementary Provisions 10 to 16.
  • (Appendix 18) A program for causing a computer to perform a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, and an image information output procedure; In the image pickup information acquisition procedure, an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
  • the map information management procedure manages the facility location information in association with the map of the specific area.
  • the location information of the visitor's terminal and the orientation information of the visitor's terminal are acquired.
  • the image information output procedure a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation procedure includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other.
  • the image information output procedure in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the position information of the terminal and the orientation information of the terminal are managed on the map.
  • the image information output procedure it is possible to control the order of the screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • the front direction of the visitor is specified based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • the program according to Appendix 18, wherein the order of the screens transitioned and displayed in the window portion in the image information output procedure is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • (Appendix 21) In addition, including the terminal screen operation information acquisition procedure, In the terminal screen operation information acquisition procedure, the screen operation information of the terminal is acquired, and the screen operation information is acquired.
  • the program according to any one of Supplementary note 18 to 20, wherein the image information output procedure changes the screen of the window unit according to the screen operation information.
  • the screen operation information is information related to a swipe operation on the screen of the terminal by the operation of the visitor. The program described in Appendix 21.
  • the program is the program described in Appendix 20.
  • the screen of the window section changes for each layer.
  • the screen of the window portion changes for each facility detailed information image.
  • the program described in Appendix 22. (Appendix 24)
  • the specific area information acquisition procedure acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
  • the program according to any one of Supplementary note 18 to 23, wherein the virtual information generation procedure generates the facility detailed information image based on the facility detailed information.
  • the visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor.
  • the image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • Appendix 26 A computer-readable recording medium recording the program according to any one of Supplementary Notes 18 to 25.
  • the present invention in a large facility of an exhibition hall or the like, it is possible to display information by AR on the screen of the user's terminal in an easy-to-understand manner, and the operation of the screen of the user's terminal is not hindered. Therefore, according to the present invention, it is useful in various fields to which AR technology can be applied.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
PCT/JP2021/020830 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 Ceased WO2021256240A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022532473A JP7393054B2 (ja) 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-102759 2020-06-15
JP2020102759 2020-06-15

Publications (1)

Publication Number Publication Date
WO2021256240A1 true WO2021256240A1 (ja) 2021-12-23

Family

ID=79267910

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/020830 Ceased WO2021256240A1 (ja) 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体

Country Status (2)

Country Link
JP (1) JP7393054B2 (https=)
WO (1) WO2021256240A1 (https=)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011166589A (ja) * 2010-02-12 2011-08-25 Aplix Corp 携帯端末および情報提示方法
JP2013545975A (ja) * 2010-10-29 2013-12-26 コア ワイヤレス ライセンシング エス．アー．エール．エル． 位置オフセット情報を決定する方法および装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011166589A (ja) * 2010-02-12 2011-08-25 Aplix Corp 携帯端末および情報提示方法
JP2013545975A (ja) * 2010-10-29 2013-12-26 コア ワイヤレス ライセンシング エス．アー．エール．エル． 位置オフセット情報を決定する方法および装置

Also Published As

Publication number Publication date
JPWO2021256240A1 (https=) 2021-12-23
JP7393054B2 (ja) 2023-12-06

Similar Documents

Publication Publication Date Title
Krase et al. On the spatial semiotics of vernacular landscapes in global cities
Whittingham Geosemiotics←→ social geography: Preschool places and school (ed) spaces
JP6300113B2 (ja) 情報表示システム及び情報表示端末
US20160162593A1 (en) Information communication method and information communication apparatus
JP2015230512A (ja) ユーザインタフェース画面作成支援システム
Stähli et al. Evaluation of pedestrian navigation in smart cities
Loureiro The use of augmented reality to expand the experience of museum visitors
JP7294735B2 (ja) ナビゲーション装置、ナビゲーションシステム、ナビゲーション方法、プログラム、及び、記録媒体
JP7376191B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
Zhou et al. Lights, headset, tablet, action: Exploring the use of hybrid user interfaces for immersive situated analytics
JP7393054B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
JP7332197B2 (ja) 情報共有装置、イベント支援システム、情報共有方法、及びイベント支援システムの生産方法
JP7355467B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
Jewell et al. Enabling technology
JP7483995B1 (ja) 通信ネットワークを介したサービスの提供を支援する方法、プログラム及びサーバ
Schmalfuß-Schwarz et al. Supporting independent travelling for people with visual impairments in buildings by harmonizing maps on embossed paper and pin-matrix devices for accessible info-points
Bin Noon et al. Concerns regarding the accessibility of self-service interactive devices for people with disabilities
Yamini Krishna The neo-liberal city and cinema: Deccani films
US20240127270A1 (en) Demand level calculation apparatus, event support system, demand level calculation method, and event support system production method
US20240127294A1 (en) Advertisement information generation apparatus, event support system, advertisement information generation method, and event support system production method
US20220366451A1 (en) Display apparatus, event support system, display method, and event support system production method
JP7736291B2 (ja) 画像処理装置、画像処理システム装置、画像処理方法、プログラム及び記録媒体
JP7459020B2 (ja) 情報処理装置、情報処理方法及び情報処理プログラム
de Aguiar et al. Evaluation of communIT, a large-scale, cyber-physical artifact supporting diverse subgroups building community
Liu Information Visualisation Interfaces for Large-display Multi-device Co-located Synchronous Collaboration

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21826403

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022532473

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21826403

Country of ref document: EP

Kind code of ref document: A1