WO2021256242A1 - ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 - Google Patents

ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 Download PDF

Info

Publication number
WO2021256242A1
WO2021256242A1 PCT/JP2021/020832 JP2021020832W WO2021256242A1 WO 2021256242 A1 WO2021256242 A1 WO 2021256242A1 JP 2021020832 W JP2021020832 W JP 2021020832W WO 2021256242 A1 WO2021256242 A1 WO 2021256242A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
information
terminal
visitor
facility
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/020832
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
晃 浪口
浩平 金澤
陽平 水谷
雄也 木元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Solution Innovators Ltd
Original Assignee
NEC Solution Innovators Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Solution Innovators Ltd filed Critical NEC Solution Innovators Ltd
Priority to JP2022532475A priority Critical patent/JP7355467B2/ja
Publication of WO2021256242A1 publication Critical patent/WO2021256242A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the present invention relates to a guide device, a guide system, a guide method, a program, and a recording medium.
  • Patent Document 1 a technique for promoting a product or the like using AR (Augmented Reality) technology has been proposed (for example, Patent Document 1).
  • the present invention in a large facility of an exhibition hall or the like, it is possible to display information by AR on the terminal screen of a user (visitor) in an easy-to-understand manner, and the AR image is easy to see and the terminal screen is easy to operate.
  • the purpose is to provide a guide device and a guide method.
  • the guide device of the present invention includes imaging information acquisition unit, virtual information generation unit, map information management unit, visitor terminal information acquisition unit, image information output unit, and terminal screen control unit.
  • the image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
  • the virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management unit manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
  • the virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays an image displaying the facility detailed information image on the window unit.
  • the map information management unit calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility position information.
  • the terminal screen control unit Based on the calculated distance, the terminal screen control unit generates at least one image of an integrated image in which the facility position images of a plurality of the facilities are integrated and an integrated image in which the integrated images are unintegrated.
  • the image information output unit is a device that outputs at least one of the integrated image and the integrated release image to the terminal of the visitor.
  • the guide system of the present invention is The guide device is the guide device of the present invention.
  • the terminal is the terminal of the visitor,
  • the guide device and the terminal are systems capable of communicating via a communication network.
  • the guide method of the present invention Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, and terminal screen control process.
  • image pickup information acquisition step an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management process manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output step a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and the facility detailed information image, and the facility position image and the facility detailed information image are linked to each other for each facility.
  • the image information output step in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and an image for displaying the facility detailed information image is displayed on the window portion.
  • the map information management step calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility position information.
  • the terminal screen control step generates at least one image of an integrated image in which the facility position images of a plurality of the facilities are integrated and an integrated image in which the integrated images are unintegrated, based on the calculated distance.
  • the image information output step is a method of outputting at least one of the integrated image and the integrated release image to the terminal of the visitor.
  • the program of the present invention This is a program for causing a computer to execute a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, an image information output procedure, and a terminal screen control procedure.
  • a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, an image information output procedure, and a terminal screen control procedure.
  • an imaging information acquisition procedure an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
  • the map information management procedure manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition procedure acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output procedure a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation procedure includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and the facility detailed information image, and the facility position image and the facility detailed information image are linked to each other for each facility.
  • the image information output procedure in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and an image for displaying the facility detailed information image is displayed on the window portion.
  • the map information management procedure calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility location information.
  • the terminal screen control procedure generates at least one image of an integrated image in which the facility position images of a plurality of the facilities are integrated and an integrated image in which the integrated images are deintegrated, based on the calculated distance.
  • the image information output procedure outputs at least one of the integrated image and the integrated release image to the visitor's terminal.
  • the recording medium of the present invention is a computer-readable recording medium on which the program of the present invention is recorded.
  • information by AR can be displayed on the terminal of a user (visitor) in an easy-to-understand manner, the AR image becomes easy to see, and the operation of the terminal screen becomes easy.
  • FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment
  • FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment
  • FIG. 2 is a block diagram showing an example of the hardware configuration of the apparatus of the first embodiment.
  • FIG. 3 is a flowchart showing an example of processing in the apparatus of the first embodiment.
  • FIG. 4 is a schematic diagram showing an example of an image displayed on the screen of the terminal.
  • FIG. 5 is a schematic diagram showing an example of the relationship between the reference distance and the area to be integrated.
  • FIG. 6 is a schematic diagram showing an example of an image displayed on the screen of the terminal.
  • FIG. 7 is a block diagram showing a configuration of an example of the device of the second embodiment.
  • FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment
  • FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment.
  • FIG. 2 is
  • FIG. 8 is a flowchart showing an example of processing in the apparatus of the second embodiment.
  • FIG. 9 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 10 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 11 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 12 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 13 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 14 is a schematic diagram showing an example of the hierarchical structure of the facility detailed information image.
  • FIG. 15 is a schematic diagram showing an example of a single swipe and a multi-swipe.
  • the "visitor” means a person who comes within a specific area, and is also referred to as a user. Visitors can also be rephrased as visitors, visitors, and the like.
  • FIG. 1A is a block diagram showing a configuration of an example of a guide device 10 of the present embodiment
  • FIG. 1B is a schematic showing a configuration of an example of a guide system including the guide device 10 of the present embodiment. It is a figure.
  • the apparatus 10 includes an image pickup information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and a terminal screen control.
  • a unit 16 and a terminal selection information acquisition unit 17 are included.
  • the terminal selection information acquisition unit 17 has an arbitrary configuration and may not be included in the apparatus 10. The guide system will be described later.
  • the device 10 may be, for example, one device including the above-mentioned parts, or may be a device in which the above-mentioned parts can be connected via the communication network 30. Further, the present device 10 can be connected to an external device described later via the communication line network 30.
  • the communication network 30 is not particularly limited, and a known network can be used, and may be wired or wireless, for example. Examples of the communication line network 30 include an Internet line, WWW (World Wide Web), a telephone line, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Traveler Network), and the like. Examples of wireless communication include WiFi (Wireless Fidelity), Bluetooth (registered trademark) and the like.
  • the wireless communication may be either a form in which each device directly communicates (Ad Hoc communication) or an indirect communication via an access point.
  • the apparatus 10 may be incorporated in the server as a system, for example. Further, the apparatus 10 is, for example, a personal computer (PC, for example, a desktop type, a notebook type), a terminal (for example, a smartphone, a mobile phone, a glasses type, a watch type, or the like) wearable terminal on which the program of the present invention is installed. ) Etc. may be used.
  • FIG. 2 illustrates a block diagram of the hardware configuration of the present device 10.
  • the apparatus 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, a display device 106, a communication device 107, and the like. Each part of the apparatus 10 is connected to each other via a bus 103 by each interface (I / F).
  • I / F interface
  • the central processing unit 101 is responsible for overall control of the device 10.
  • the program of the present invention and other programs are executed by the central processing unit 101, and various information is read and written.
  • the central arithmetic processing device 101 includes an image pickup information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and a terminal screen control unit. It functions as 16 and the terminal selection information acquisition unit 17.
  • the bus 103 can also be connected to, for example, an external device.
  • the external device include an external storage device (external database, etc.), a printer, and the like.
  • the apparatus 10 can be connected to an external network (communication network 30) by, for example, a communication device 107 connected to the bus 103, and can also be connected to another apparatus via the external network.
  • the memory 102 may be, for example, a main memory (main storage device).
  • main memory main storage device
  • the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104 described later, and the central processing unit 101 reads the memory. Receives data from 102 and executes the program.
  • the main memory is, for example, a RAM (random access memory).
  • the memory 102 may be, for example, a ROM (read-only memory).
  • the storage device 104 is also referred to as a so-called auxiliary storage device with respect to the main memory (main storage device), for example.
  • the storage device 104 stores an operation program including the program of the present invention.
  • the storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium.
  • the recording medium is not particularly limited, and may be an internal type or an external type, and examples thereof include HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, and memory card. Be done.
  • the storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and a drive are integrated, and a solid state drive (SSD).
  • HDD hard disk drive
  • SSD solid state drive
  • the memory 102 and the storage device 104 can also store user log information and information acquired from an external database (not shown).
  • the device 10 further includes, for example, an input device 105 and a display device 106.
  • the input device 105 is, for example, a touch panel, a keyboard, a mouse, or the like.
  • Examples of the display device 106 include an LED display, a liquid crystal display, and the like.
  • the guide method of the present embodiment is carried out as follows, for example, by using the guide device 10 of FIG. 1 or FIG.
  • the guide method of the present embodiment is not limited to the use of the guide device 10 of FIG. 1 or 2.
  • the image pickup information acquisition unit 11 acquires an image captured by a terminal of a visitor in a specific area (S1).
  • the specific area is not particularly limited and may be indoors or outdoors.
  • the indoors include, for example, exhibition halls, event halls, department stores, schools such as universities, and the like.
  • the terminal of the visitor is not particularly limited, and is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type, and the like.
  • the captured image may be, for example, a still image or a moving image.
  • the acquisition is performed, for example, via the communication network 30.
  • the virtual information generation unit 12 generates a virtual image related to the specific area (S2).
  • the generated virtual image includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a position image of the facility and a detailed information image of the facility, and the position image of the facility and the detailed information image of the facility are associated with each other for each facility.
  • the location image of the facility is also referred to as a facility location image
  • the detailed information image of the facility is also referred to as a facility detailed information image.
  • the facility detailed information image is, for example, an image having a hierarchical structure of one layer or two or more layers.
  • the position image is, for example, an image based on the facility position information.
  • the detailed information image is, for example, an image based on the detailed information of the facility.
  • One facility detailed information image may be associated with one facility position image, or two facility detailed information images may be associated with one.
  • the facility position image and the facility detailed information image may be stored in the memory 102 or the storage device 104 in advance, or may be acquired from an external database via the communication network 30. Further, as will be described later, the facility position image and the facility detailed information image may be generated by the virtual information generation unit 12.
  • the facility is not particularly limited as long as it is installed in the specific area. Specifically, for example, there are exhibition booths, shops, tenants, classrooms, examination rooms, and the like.
  • the map information management unit 13 manages the facility location information in association with the map of the specific area (S3).
  • the facility location information is, for example, information indicating a location within the facility, and specifically, the location of an exhibition booth, a tenant, a classroom, or the like is indicated.
  • the visitor terminal information acquisition unit 14 acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal (S4).
  • the terminal of the visitor is also referred to as a visitor terminal or a terminal.
  • the position information and orientation information of the terminal are, for example, information in which the position and orientation (direction) of the terminal are specified by a position code or a direction mark arranged in the specific area.
  • the position code may also serve as, for example, the direction mark.
  • the position code and the direction mark include, for example, a QR code (registered trademark), an AR marker, a barcode, a chameleon code (registered trademark), and the like.
  • the position information of the terminal and the orientation information of the terminal may be information specified by using a known technique.
  • the image information output unit 15 outputs a composite image in which the virtual image is superimposed on the captured image (S5).
  • the output may be executed, for example, via the communication network 30.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output unit 15 superimposes the facility position image on the position corresponding to the image of the facility in the captured image, provides a window unit, and displays the facility detailed information image on the window unit.
  • the image is output to the terminal (visitor's terminal).
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the window unit can display, for example, the facility detailed information image on a screen in which an image for each layer can be transitioned.
  • the window portion will be described later.
  • the map information management unit 13 calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility position information (S6).
  • the distance is calculated, for example, by referring to the position information of the visitor terminal and the facility position information on the map and converting from the respective position information, the distance between the visitor terminal and the facility. Can be calculated.
  • the terminal screen control unit 16 may generate at least one of the integrated image and the integrated release image based on, for example, a predetermined reference distance.
  • the reference distance is a terminal and a facility that serve as a reference when deciding whether to generate the integrated image by integrating a plurality of the facility position images or to release the integration of the integrated images to generate the unintegrated image. It is a distance between them, and for example, any distance can be set.
  • the reference distance may be, for example, a reference distance of two or more steps depending on the position of the facility from the visitor terminal.
  • the terminal screen control unit 16 integrates or unintegrates the facility position image step by step according to, for example, the steps of the reference distance of two or more steps.
  • the steps are not particularly limited, and examples thereof include two steps, three steps, and four steps.
  • the terminal screen control unit 16 may specify an area unit to be integrated on the map according to the reference distances of the two or more stages.
  • the image information output unit 15 outputs at least one of the integrated image and the integrated release image to the terminal of the visitor (S8), and ends the process (END).
  • the terminal selection information acquisition unit 17 selects the facility position image selected from the plurality of facility position images corresponding to the plurality of facilities. Information may be acquired (terminal selection information acquisition process).
  • the window unit displays the facility detailed information image associated with the selected facility location information based on the selection information.
  • the terminal selection information acquisition step can be executed at any timing, for example, after the S5 step shown in FIG.
  • the terminal screen control unit 16 cancels the integration of the integrated image in which the facility position images of the plurality of the facilities are integrated and the integration of the integrated images based on the distance between the terminal and the facility. Generates at least one of the unintegrated images. Therefore, for example, in a large facility such as an exhibition hall, it is possible to display information by AR on the terminal screen of a visitor in an easy-to-understand manner. This makes it easier for visitors to see the AR image, which makes it easier to operate the terminal screen.
  • the composite image is displayed on the screen (display) of the terminal 20.
  • the facility position image is, for example, pin images 4 (4a to 4c) showing the position of an exhibition booth.
  • identification information may be attached to each of the pin images 4.
  • the identification information is, for example, a number, a character, a symbol, and a combination of two or more thereof.
  • the pin image 4 on the composite image is arranged at a position based on the facility position information.
  • FIG. 5 shows a region in which the reference distance has three stages of (1) short distance, (2) medium distance, and (3) long distance, and the short distance is centered on the terminal and has a radius of less than 15 m.
  • each numerical value of the reference distance is an example, and the present invention is not limited thereto. As shown in FIG.
  • the pin 4 corresponding to each exhibition booth is generated as the unintegrated image 4A.
  • the area corresponding to the middle-distance is divided into eight equal parts, and for a plurality of exhibition booths located in each area, pin 4 is used.
  • the area corresponding to the long distance is divided into four equal parts, and the pin for the plurality of exhibition booths located in each area.
  • the number of divisions of each area at medium distance and long distance is an example, and is not limited thereto.
  • FIG. 6 shows an example of a terminal displaying the unintegrated image 4A, the medium-distance integrated image 4B, and the long-distance integrated image 4C.
  • an exhibition booth having a short distance from the terminal can determine a more accurate position.
  • Exhibition booths that are far from the terminal can be easily viewed and operated.
  • the pin size becomes smaller as the object moves away from the position of the terminal, which makes it difficult to visually recognize and operate.
  • the present invention since at least one of the integrated image and the integrated release image is generated and displayed based on the reference distance, information by AR can be easily understood on the terminal screen of a visitor in a large facility such as an exhibition hall. It is possible to display. This makes it easier for visitors to see the AR image, which makes it easier to operate the terminal screen.
  • the guide device 10A of the present embodiment further includes a terminal screen operation information acquisition unit 18, a specific area information acquisition unit 19, and a specific area information acquisition unit 19. Includes the visitor information acquisition unit 21.
  • the central processing unit 101 replaces the configuration of the guide device 10 shown in FIG. The same applies except that the guide device 10A shown in FIG. 7 is provided.
  • the guide method of the present embodiment is carried out as follows, for example, by using the guide device 10A of FIG.
  • the guide method of the present embodiment is not limited to the use of the guide device 10A of FIG. 7.
  • (S1) to (S8) are executed in the same manner as in (S1) to (S8) shown in FIG. 3 of the first embodiment.
  • the terminal screen operation information acquisition unit 18 acquires operation information for the screen of the terminal (S9).
  • the operation information is, for example, information related to the visitor operation, specifically, a swipe operation on the screen (terminal screen) of the terminal, line-of-sight detection, blink detection, voice instruction, and tap on the terminal screen. The operation and a combination of two or more of these may be used.
  • the image information output unit 15 transitions the screen of the window unit according to the operation information.
  • the image information output unit 15 controls the order of the screens to be transitioned and displayed in the window unit based on the position information of the terminal and the orientation information of the terminal managed on the map (S10). End the process (END).
  • the image information output unit 15 may specify the front direction of the visitor, for example, based on the position information of the terminal and the orientation information of the terminal managed on the map.
  • the order of the screens to be transitioned and displayed in the window portion is, for example, the order of the facilities arranged in the left-right direction in the front direction.
  • the window unit can display the facility detailed information image on a screen in which images for each layer can be transitioned
  • the visitor can display the facility detailed information image with one finger.
  • the screen of the terminal terminal screen
  • the screen of the window portion changes for each layer.
  • the visitor swipes the terminal screen with two or more fingers for example, the screen of the window portion changes for each facility detailed information image. Specifically, it will be described later.
  • the specific area information acquisition unit 19 may acquire detailed facility information regarding the facility in the specific area (S11).
  • the step (S11) may be processed in parallel with the step (S1), for example, as shown in FIG.
  • the acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105.
  • the facility detailed information is, for example, information about an exhibition booth or the like, and more specifically, information such as a company name, company introduction information, products and services, and the like.
  • the virtual information generation unit 12 generates, for example, the facility detailed information image based on the facility detailed information. Further, the virtual information generation unit 12 may generate the facility position image based on the facility position information.
  • the visitor information acquisition unit 21 may acquire information about the visitor (S12).
  • the step (S12) may be processed in parallel with the step (S1), for example, as shown in FIG.
  • the acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105.
  • the information about the visitors is, for example, the attributes of the visitors (gender, age, occupation), the purpose of the visit (inspection, business negotiations, etc.), the exhibition booth (area) of interest, and the like.
  • the image information output unit 15 outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the virtual image includes recommendation information, schedule information, exhibition booth information, and the like.
  • the recommendation information is, for example, information recommended to the visitor based on the information about the visitor (for example, a recommended event, a recommended exhibition booth, etc.).
  • the schedule information is, for example, information indicating the schedule of an event to be held in the specific area. Examples of the event include demonstrations and seminars.
  • the event may be an event promoted by the organizer or an event promoted by the exhibitor.
  • the exhibition booth information is, for example, company name, company introduction information, information on products and services, and the like.
  • the composite image is displayed on the screen (display) of the terminal 20.
  • the facility position images are, for example, pin images 4a to 4c showing the positions of exhibition booths.
  • identification information may be added to each of the pin images 4a to 4c.
  • the identification information is, for example, the same as described above.
  • the pin images 4a to 4c are arranged at positions based on the facility position information, for example.
  • the window portion may be arranged at the lower part of the composite image, for example, as shown in FIG. 9, but the window portion is merely an example and is not limited thereto.
  • the window unit transitions and displays a plurality of the facility detailed information images.
  • a facility detailed information image of company A A Corp.
  • Window window section
  • the order of the screens to be transitioned and displayed in the window section will be explained.
  • the upper part of FIG. 10 shows the front direction 2 of each facility (booth) in the specific area and the user 1 (terminal 20).
  • the lower part of FIG. 10 shows an example of a group of terminal 20 and facility detailed information images.
  • the facility detailed information image B is displayed on the terminal 20.
  • the order of the screens to be transitioned and displayed in the window section is as follows: user 1 uses facility detailed information images A to C corresponding to exhibition booths (pin images) A to C, which are the group closest to the position of the terminal 20.
  • the exhibition booths (pin images) "near G1" and “near G2”, which are the group “near G” that is the second closest to the position of the terminal 20, are supported.
  • Detailed facility information image “Near G1” and “Near G2” are arranged in the order of facilities (booths) arranged in the left-right direction in the front direction 2 of the user 1.
  • the order of the screens to be transitioned and displayed in the window section will be further described.
  • the exhibition booths (pin images) B, A, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booths B and A are in the window portion.
  • the facility detailed information image is displayed in this order.
  • the exhibition booth is in the window portion.
  • the facility detailed information image is displayed in the order of A, B, and C.
  • the exhibition booths (pin images) C, A, and B are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth C is in the window portion. , A, B, and the facility detailed information image is displayed in this order.
  • the front-back and left-right directions of the exhibition booth change depending on the position and direction of the user 1 (terminal 20).
  • the image information output unit 15 identifies the front direction 2 of the user 1 based on the position information of the terminal 20 and the orientation information of the terminal 20, and displays the facility details according to the front direction 2 of the specified user 1.
  • the order of the information images changes. Further, as shown in FIG.
  • the pin image (facility position image) corresponding to the facility detailed information image is linked and selected. It may be in a state.
  • the selected state is, for example, information indicating that the user 1 has selected a pin image.
  • the pin image (A) is in the selected state
  • the pin image (B) is in the selected state
  • the pin image (C) is in the selected state.
  • FIG. 14 shows an example of the hierarchical structure of the facility detailed information image.
  • the facility detailed information image has the facility detailed information images (a1) to (a3) in the lower layer of the facility detailed information image (a), and the facility is in the lower layer of the facility detailed information image (a3).
  • the facility detailed information image (a) is an image based on the facility detailed information indicating the company name.
  • the facility detailed information image (a1) is an image based on the facility detailed information showing the company introduction
  • the facility detailed information image (a2) is an image based on the facility detailed information showing the greetings of the representative and the like, and the facility detailed information.
  • the image (a3) is an image based on detailed facility information showing products, services, and the like.
  • the facility detailed information images (a3-1) to (a3-3) are images based on the facility detailed information showing each of the product A, the product B, and the product C.
  • FIG. 15 shows an example of a single swipe and a multi-swipe.
  • FIG. 15A when the user swipes the screen of the terminal 20 from left to right (also referred to as a single swipe) with one finger, for example, the displayed facility detailed information image (a).
  • the facility detailed information image (a1) which is the lower layer, is displayed on the terminal 20.
  • the order of the facility detailed information images (a1) to (a3) is not particularly limited, and can be arbitrarily set by the exhibitor, for example.
  • FIG. 15B when the user swipes the screen of the terminal 20 from left to right (also referred to as multi-swipe) with two or more fingers, for example, the displayed facility detailed information is displayed.
  • the other facility detailed information image (b) that is not the lower layer of the image (a) is displayed on the terminal 20. That is, the terminal 20 skips (does not display) the facility detailed information images (a1) to (a3) and the facility detailed information images (a3-1) to (a3-3), and displays the facility detailed information image (b). indicate.
  • the direction of the swipe is an example and is not limited thereto. The swipe direction may be, for example, swiped from right to left, from top to bottom, from bottom to top, and the like.
  • FIG. 1B is a schematic diagram showing the configuration of an example of the guide system of the present embodiment.
  • the guide system of the present embodiment includes the guide device 10 according to any one of the first to third embodiments, and the terminal 20.
  • the terminal 20 is the terminal of a visitor in the specific area.
  • the guide device 10 and the terminal 20 can communicate with each other via the communication network 30.
  • the guide system is also referred to as a guide system device.
  • the guide system of the present embodiment may further include the exhibitor's terminal, for example.
  • the exhibitor's terminal is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type.
  • the guide device 10 and the exhibitor's terminal can communicate with each other via, for example, a communication network 30.
  • the program of the present embodiment is a program for causing a computer to execute each step of the method of the present invention as a procedure.
  • "procedure” may be read as "processing”.
  • the program of the present embodiment may be recorded on a computer-readable recording medium, for example.
  • the recording medium is, for example, a non-transitory computer-readable storage medium.
  • the recording medium is not particularly limited, and examples thereof include a read-only memory (ROM), a hard disk (HD), and an optical disk.
  • Appendix 1 Includes imaging information acquisition unit, virtual information generation unit, map information management unit, visitor terminal information acquisition unit, image information output unit, and terminal screen control unit.
  • the image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
  • the virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management unit manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
  • the virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays an image displaying the facility detailed information image on the window unit.
  • the map information management unit calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility position information.
  • the terminal screen control unit Based on the calculated distance, the terminal screen control unit generates at least one image of an integrated image in which the facility position images of a plurality of the facilities are integrated and an integrated image in which the integrated images are unintegrated.
  • the image information output unit outputs at least one of the integrated image and the unintegrated image to the visitor's terminal.
  • Guide device. (Appendix 2)
  • the terminal screen control unit generates at least one of the integrated image and the integrated release image based on a predetermined reference distance.
  • the reference distance is a reference distance of two or more steps according to the position of the facility from the terminal of the visitor.
  • the facility position images are integrated or unintegrated step by step according to the two or more reference distance stages.
  • the guide device according to Appendix 2. (Appendix 4) On the map, the area unit to be integrated is defined according to the reference distance of the two or more steps.
  • the guide device according to Appendix 3. (Appendix 5)
  • it includes a terminal selection information acquisition unit.
  • the terminal selection information acquisition unit acquires selection information regarding the facility position image selected from the plurality of facility position images corresponding to the plurality of facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the guide device according to any one of Supplementary note 1 to 4. (Appendix 6)
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management unit manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
  • the image information output unit can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide device according to any one of Supplementary Provisions 1 to 5. (Appendix 7)
  • the image information output unit identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide device according to Appendix 6, wherein the order of the screens displayed by transitioning in the window unit in the image information output unit is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • (Appendix 9) In addition, it includes a terminal screen operation information acquisition unit.
  • the terminal screen operation information acquisition unit acquires operation information for the screen of the visitor's terminal, and obtains operation information.
  • the guide device according to any one of Supplementary note 6 to 8, wherein the image information output unit transitions the screen of the window unit according to the operation information.
  • the specific area information acquisition unit acquires information about the specific area and obtains information about the specific area.
  • the virtual information generation unit generates a virtual image related to the specific area based on the information about the specific area.
  • the guide device according to any one of Supplementary note 1 to 9.
  • the visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the guide device according to any one of Supplementary note 1 to 10. (Appendix 12) Including guide device and terminal
  • the guide device is the guide device according to any one of Supplementary note 1 to 11.
  • the terminal is the terminal of the visitor,
  • the guide device and the terminal can communicate with each other via a communication network. Guide system.
  • Imaging information acquisition process includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, and terminal screen control process.
  • image pickup information acquisition step an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management process manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • image information output step a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and the facility detailed information image, and the facility position image and the facility detailed information image are linked to each other for each facility.
  • the image information output step in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and an image for displaying the facility detailed information image is displayed on the window portion.
  • the map information management step calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility position information.
  • the terminal screen control step generates at least one image of an integrated image in which the facility position images of a plurality of the facilities are integrated and an integrated image in which the integrated images are unintegrated, based on the calculated distance.
  • the image information output step outputs at least one of the integrated image and the integrated release image to the visitor's terminal.
  • Guide method. (Appendix 14)
  • the terminal screen control step generates at least one of the integrated image and the integrated release image based on a predetermined reference distance.
  • the reference distance is a reference distance of two or more steps depending on the position of the facility from the terminal of the visitor.
  • the facility position images are integrated or unintegrated step by step according to the two or more reference distance stages.
  • the guide method described in Appendix 14. On the map, the area unit to be integrated is defined according to the reference distance of the two or more steps.
  • the guide method according to Appendix 15. (Appendix 17) In addition, it includes a terminal selection information acquisition process.
  • the terminal selection information acquisition step acquires selection information regarding the facility position image selected from the plurality of facility position images corresponding to the plurality of facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the guide method according to any one of Supplementary Notes 13 to 16.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management process manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
  • the image information output process can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide method according to any one of Supplementary Provisions 13 to 17. (Appendix 19)
  • the image information output process identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide method according to Appendix 18, wherein the order of the screens transitioned and displayed in the window portion in the image information output step is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • the guide method according to Appendix 18 or 19, wherein the window portion can display the facility detailed information image on a screen in which an image for each layer can be changed.
  • Appendix 21 In addition, it includes a terminal screen operation information acquisition process. In the terminal screen operation information acquisition process, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
  • the guide method according to any one of the appendices 18 to 20, wherein the image information output step is a transition of the screen of the window portion by the operation information.
  • it includes a specific area information acquisition process In addition, it includes a specific area information acquisition process. The specific area information acquisition process acquires information about the specific area and obtains information.
  • the virtual information generation step generates a virtual image related to the specific area based on the information about the specific area.
  • the guide method according to any one of Supplementary Notes 13 to 21. (Appendix 23) In addition, it includes a visitor information acquisition process.
  • the visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
  • the image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the guide method according to any one of Supplementary Notes 13 to 22.
  • Appendix 24 A program for causing a computer to execute a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, an image information output procedure, and a terminal screen control procedure;
  • image pickup information acquisition procedure an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
  • the map information management procedure manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition procedure acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output procedure a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation procedure includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and the facility detailed information image, and the facility position image and the facility detailed information image are linked to each other for each facility.
  • the image information output procedure in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and an image for displaying the facility detailed information image is displayed on the window portion.
  • the map information management procedure calculates the distance between the visitor's terminal and the facility on the map based on the position information of the visitor's terminal and the facility location information.
  • the terminal screen control procedure generates at least one image of an integrated image in which the facility position images of a plurality of the facilities are integrated and an integrated image in which the integrated images are deintegrated, based on the calculated distance.
  • the image information output procedure outputs at least one of the integrated image and the integrated release image to the visitor's terminal.
  • the terminal screen control procedure generates at least one of the integrated image and the unintegrated image based on a predetermined reference distance.
  • the reference distance is a reference distance of two or more steps depending on the position of the facility from the terminal of the visitor.
  • the facility position images are integrated or unintegrated step by step according to the two or more reference distance stages.
  • the terminal selection information acquisition procedure acquires selection information regarding the facility position image selected from the plurality of facility position images corresponding to the plurality of facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management procedure manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
  • the image information output procedure can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the program according to any one of Supplementary Provisions 24 to 28. (Appendix 30)
  • the image information output procedure identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the program according to Appendix 29, wherein the order of the screens to be displayed by transitioning in the window portion in the image information output procedure is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • (Appendix 32) In addition, including the terminal screen operation information acquisition procedure, In the terminal screen operation information acquisition procedure, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
  • the specific area information acquisition procedure acquires information about the specific area and obtains information.
  • the virtual information generation procedure generates a virtual image related to the specific area based on the information about the specific area.
  • the program according to any one of Supplementary Provisions 24 to 32. (Appendix 34)
  • the visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor.
  • the image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • Appendix 35 A computer-readable recording medium recording the program according to any one of Supplementary Provisions 24 to 34.
  • information by AR can be displayed on the terminal of a user (visitor) in an easy-to-understand manner, the AR image becomes easy to see, and the operation of the terminal screen becomes easy. Therefore, according to the present invention, it is useful in various fields to which AR technology can be applied.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Automation & Control Theory (AREA)
  • Navigation (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/JP2021/020832 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 Ceased WO2021256242A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022532475A JP7355467B2 (ja) 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020102761 2020-06-15
JP2020-102761 2020-06-15

Publications (1)

Publication Number Publication Date
WO2021256242A1 true WO2021256242A1 (ja) 2021-12-23

Family

ID=79267914

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/020832 Ceased WO2021256242A1 (ja) 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体

Country Status (2)

Country Link
JP (1) JP7355467B2 (https=)
WO (1) WO2021256242A1 (https=)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012198668A (ja) * 2011-03-18 2012-10-18 Ns Solutions Corp 情報処理装置、拡張現実感提供方法、及びプログラム
JP2012242202A (ja) * 2011-05-18 2012-12-10 Alpine Electronics Inc 車載システム
JP2013218597A (ja) * 2012-04-11 2013-10-24 Sony Corp 情報処理装置、表示制御方法及びプログラム
WO2016017253A1 (ja) * 2014-08-01 2016-02-04 ソニー株式会社 情報処理装置、および情報処理方法、並びにプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012198668A (ja) * 2011-03-18 2012-10-18 Ns Solutions Corp 情報処理装置、拡張現実感提供方法、及びプログラム
JP2012242202A (ja) * 2011-05-18 2012-12-10 Alpine Electronics Inc 車載システム
JP2013218597A (ja) * 2012-04-11 2013-10-24 Sony Corp 情報処理装置、表示制御方法及びプログラム
WO2016017253A1 (ja) * 2014-08-01 2016-02-04 ソニー株式会社 情報処理装置、および情報処理方法、並びにプログラム

Also Published As

Publication number Publication date
JPWO2021256242A1 (https=) 2021-12-23
JP7355467B2 (ja) 2023-10-03

Similar Documents

Publication Publication Date Title
Krase et al. On the spatial semiotics of vernacular landscapes in global cities
Ohm et al. Displaying landmarks and the user’s surroundings in indoor pedestrian navigation systems
Stähli et al. Evaluation of pedestrian navigation in smart cities
JP7294735B2 (ja) ナビゲーション装置、ナビゲーションシステム、ナビゲーション方法、プログラム、及び、記録媒体
JP7376191B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
Wang et al. A user-centered taxonomy for specifying mixed reality systems for aec industry
Zhou et al. Lights, headset, tablet, action: Exploring the use of hybrid user interfaces for immersive situated analytics
JP7332197B2 (ja) 情報共有装置、イベント支援システム、情報共有方法、及びイベント支援システムの生産方法
JP7355467B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
JP2021093088A (ja) 処理装置、処理方法、および処理プログラム
JP7393054B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
JP7287710B2 (ja) 需要度算出装置、イベント支援システム、需要度算出方法、及びイベント支援システムの生産方法
Craig et al. A vision for pervasive information visualisation to support passenger navigation in public metro networks
US20220366451A1 (en) Display apparatus, event support system, display method, and event support system production method
US20240127294A1 (en) Advertisement information generation apparatus, event support system, advertisement information generation method, and event support system production method
Singh et al. Finding the way: enhancing user experience through effective signages at crowded railway stations in India
JP7736291B2 (ja) 画像処理装置、画像処理システム装置、画像処理方法、プログラム及び記録媒体
Yamini Krishna The neo-liberal city and cinema: Deccani films
Lee et al. Indoor wayfinding using interactive map
KR20180076188A (ko) 마커와 음성인식을 이용한 증강현실 구현 방법
JP7459020B2 (ja) 情報処理装置、情報処理方法及び情報処理プログラム
JP7533615B2 (ja) 表示制御装置、表示制御方法、及びプログラム
KR102744632B1 (ko) 가상 공간에 대한 협업 방법 및 협업 시스템
JP2023150584A (ja) 位置情報マップ作成装置、現在位置特定装置、位置情報マップ生産方法、現在位置特定方法、及びプログラム
JP2012212374A (ja) 情報処理装置及び情報処理方法、並びにプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21827120

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022532475

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21827120

Country of ref document: EP

Kind code of ref document: A1