WO2022049615A1 - Information processing system, information processing method, and computer program - Google Patents

Information processing system, information processing method, and computer program Download PDF

Info

Publication number
WO2022049615A1
WO2022049615A1 PCT/JP2020/032990 JP2020032990W WO2022049615A1 WO 2022049615 A1 WO2022049615 A1 WO 2022049615A1 JP 2020032990 W JP2020032990 W JP 2020032990W WO 2022049615 A1 WO2022049615 A1 WO 2022049615A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
information processing
information
unit
processing system
Prior art date
Application number
PCT/JP2020/032990
Other languages
French (fr)
Japanese (ja)
Inventor
健太郎 山本
Original Assignee
株式会社ネイン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ネイン filed Critical 株式会社ネイン
Priority to PCT/JP2020/032990 priority Critical patent/WO2022049615A1/en
Publication of WO2022049615A1 publication Critical patent/WO2022049615A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B29/00Maps; Plans; Charts; Diagrams, e.g. route diagram
    • G09B29/10Map spot or coordinate position indicators; Map reading aids

Definitions

  • the present invention also relates to an information processing system, an information processing method and a computer program.
  • Patent Document 1 describes a technology related to a service that provides a panoramic photograph of a landscape along a road.
  • panoramic photographs are taken while driving on the roadway with a car equipped with an omnidirectional camera, and at the same time, the shooting position is recorded by the built-in GPS function.
  • the shooting position recorded together with the panoramic photograph is acquired by the GPS function, and it is meaningless if the GPS function is not installed or the GPS function is not functioning normally in the first place. There is a problem that there is no such thing.
  • the service provided by the above technology is updated infrequently, and the scenery confirmed in advance may differ from the scenery when actually visiting the site, and the guidance may be inaccurate.
  • an object of the present disclosure is to provide technical improvements that solve or alleviate at least some of the problems of the prior art described above.
  • One of the more specific objects of the present disclosure is to provide an information processing system, an information processing method and a computer program capable of estimating a user's position without using a GPS function.
  • the information processing system in the present disclosure is an information processing system including a device that can be worn or possessed by the user and an information processing device that can be connected to the device, and the information processing device is around the user transmitted from the device.
  • An acquisition unit that acquires environmental information
  • an analysis unit that analyzes the environmental information acquired by the acquisition unit
  • an estimation unit that estimates the position of the user who wears or possesses the device based on the results analyzed by the analysis unit. It is characterized by having.
  • the environmental information is information about the buildings around the user, and the information processing system can further have a generation unit that generates a map around the user based on the result analyzed by the analysis unit.
  • the information processing device is a server device that can be connected to a plurality of devices of the same type or different types that can be worn or possessed by a plurality of users in different places, or user terminals of a plurality of users via the Internet, and the acquisition unit is , Acquires the environment information around multiple users transmitted from multiple devices, the analysis unit analyzes the environment information around multiple users acquired by the acquisition unit, and the generation unit analyzes it by the analysis unit.
  • a wide area map can be generated by generating and synthesizing maps around a plurality of users based on the results obtained.
  • the estimation unit and the generation unit can estimate the position of the user and generate a map around the user by using the SLAM (Simultaneous Localization and Mapping) method.
  • SLAM Simultaneous Localization and Mapping
  • the device has a sensor unit for acquiring environmental information around the user, and the sensor unit acquires the distance to an obstacle around the user two-dimensionally or three-dimensionally as environmental information. Can be done.
  • the device has a sensor unit that acquires environmental information around the user, and the sensor unit can acquire an captured image by imaging the surroundings of the user as environmental information.
  • the information processing device can further have a guide output unit that outputs a guide for acquiring information necessary for estimating the position of the user to the user's device.
  • the environmental information is information about the celestial body that can be visually recognized by the user, and the analysis unit and the estimation unit can analyze the environmental information by using the celestial measurement method and estimate the position of the user.
  • the information processing method in the present disclosure is an information processing method in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device, and is one or a plurality of processors included in the information processing system.
  • the device is attached or mounted based on the acquisition step of acquiring the environment information around the user transmitted from the device, the analysis step of analyzing the environment information acquired in the acquisition step, and the result analyzed in the analysis step. It is characterized by executing an estimation step for estimating the position of the possessing user.
  • the computer program in the present disclosure is a computer program executed in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device, and is one or a plurality of computer programs included in the information processing system.
  • the device is attached to the processor based on the acquisition function that acquires the environment information around the user transmitted from the device, the analysis function that analyzes the environment information acquired by the acquisition function, and the result analyzed by the analysis function. Alternatively, it is characterized by realizing an estimation function for estimating the position of the possessing user.
  • the present disclosure it is possible to provide technical improvements that solve or alleviate at least a part of the above-mentioned problems of the prior art. According to one embodiment of the present disclosure, it is possible to provide an information processing system, an information processing method, and a computer program capable of estimating a user's position without using a GPS function.
  • the information processing system 100 includes a device 200 and an information processing device 400 that can be connected to the device 200.
  • FIG. 1 shows an example in which the device 200 is connected to the information processing device 400 via the user terminal 300
  • the device 200 may be directly connected to the information processing device 400.
  • the device 200 is not particularly limited as long as it is a device that can be worn or possessed by the user, but as an example, an earphone-type device that can be worn by the user on the ear or head (hereinafter referred to as “earphone”).
  • earphone an earphone-type device that can be worn by the user on the ear or head
  • Wearable devices such as eyeglass-type devices that can be worn by the user on the head (hereinafter referred to as "smart glasses”) and watch-type devices that can be worn by the user on the wrist (hereinafter referred to as "smart watches”). Be done.
  • These wearable devices 200 can be connected to the user terminal 300 using short-range wireless communication technology such as Bluetooth (registered trademark).
  • the wearable device 200 may be directly connected to the information processing device 400 via a wireless LAN or mobile data communication.
  • the device 200 may be, for example, a device that can be possessed by a user such as a smartphone or a tablet. At this time, the user terminal 300 assuming a smartphone does not have to be included in this system.
  • the information processing device 400 can be a server that provides information or processing results in response to a request from the device 200 or the user terminal 300.
  • the information processing device 400 may be the user terminal 300 itself connected to the device 200.
  • the information processing device 400 includes a processor 401, a memory 402, a storage 403, an input / output interface (input / output I / F) 404, and a communication interface (communication I / F) 405.
  • the components are connected to each other via bus B.
  • the information processing apparatus 400 can realize the functions and methods described in the present embodiment by the cooperation of the processor 401, the memory 402, the storage 403, the input / output I / F 404, and the communication I / F 405. can.
  • the processor 401 executes a function and / or a method realized by a code or an instruction contained in a program stored in the storage 403.
  • the processor 401 is, for example, a central processing unit (CPU), an MPU (MicroProcessingUnit), a GPU (GraphicsProcessingUnit), a microprocessor (microprocessor), a processor core (processorcore), a multiprocessor, an ASIC (Application-). Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc. are included, and each is implemented by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), etc. Each process disclosed in the form may be realized.
  • circuits may be realized by one or a plurality of integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit.
  • LSI may be referred to as VLSI, super LSI, ultra LSI, or the like depending on the degree of integration.
  • the memory 402 temporarily stores the program loaded from the storage 403 and provides a work area to the processor 401. Various data generated while the processor 401 is executing the program are also temporarily stored in the memory 402.
  • the memory 402 includes, for example, a RAM (RandomAccessMemory), a ROM (ReadOnlyMemory), and the like.
  • the storage 403 stores the program.
  • the storage 403 includes, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, and the like.
  • the communication I / F405 is implemented as hardware such as a network adapter, communication software, and a combination thereof, and transmits / receives various data via the network 300.
  • the communication may be executed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be executed.
  • the communication I / F 405 executes communication with another information processing device via the network 300.
  • the communication I / F 405 transmits various data to other information processing devices according to instructions from the processor 401. Further, the communication I / F 405 receives various data transmitted from other information processing devices and transmits them to the processor 401.
  • the input / output I / F 404 includes an input device for inputting various operations to the information processing device 400 and an output device for outputting the processing result processed by the information processing device 400.
  • the input / output I / F 404 may be integrated with the input device and the output device, or may be separated into the input device and the output device.
  • the input device is realized by any one of all kinds of devices capable of receiving an input from a user and transmitting information related to the input to the processor 401, or a combination thereof.
  • the input device includes, for example, a hardware key such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).
  • the output device outputs the processing result processed by the processor 401.
  • the output device includes, for example, a touch panel, a speaker, and the like.
  • the device 200 and the user terminal 300 can also be configured with the same hardware configuration as in FIG. 2, except for special cases.
  • the information processing apparatus 400 has an acquisition unit 410, an analysis unit 420, and an estimation unit 430.
  • the acquisition unit 410 acquires the environment information around the user transmitted from the device 200.
  • Environmental information can be information about buildings around the user or information about celestial bodies that can be seen by the user. Details will be described later.
  • the environmental information can be information acquired by various sensors of the device 200.
  • the device 200 includes a monocular camera, a stereo camera, an infrared depth sensor, an ultrasonic sensor, a millimeter wave radar sensor, a LiDAR (light detection and ranging), and the like as sensors.
  • the environmental information includes at least the posture information of the user obtained by the posture sensor of the device 200, in addition to the information acquired by the sensor.
  • the analysis unit 420 analyzes the environmental information acquired by the acquisition unit 410.
  • the analysis unit 420 is at least one from the information acquired from the sensor of the device 200, such as a monocular camera, a stereo camera, an infrared depth sensor, an ultrasonic sensor, a millimeter wave radar sensor, and LiDAR (light detection and ranging). Analyze the shape of the object.
  • the objects referred to here are buildings, signs, roads, trees, people, etc. around the user.
  • the building mentioned here includes not only the entire building but also the internal walls, pillars, ticket gates, vending machines, and other installations. That is, the environmental information includes not only the environment around the user who is outdoors but also the environment around the user who is indoors or underground.
  • the analysis unit 420 identifies what the object is from the shape of the object. Specifically, the analysis unit 420 acquires at least information regarding the position. Information regarding the position of such an object may be acquired from a map database stored in advance in a predetermined storage device.
  • the map database manages the shape of the object and its position information in association with each other.
  • the shape of the object includes the shape of the entire appearance of the building, the shape of the appearance of a part of the building, the shape of a part of the inside of the building, and the like.
  • the shape of the wall when forming a straight line, the shape of the wall when forming a corner or a curve, and the like are included.
  • the analysis unit 420 analyzes the distance between the user and the object from the information acquired by the sensor.
  • the analysis unit 420 obtains information on the position of the object, the distance between the user and the object, and the posture information of the user by analyzing the environmental information acquired by the acquisition unit 410. be able to.
  • the estimation unit 430 estimates the position of the user who wears or possesses the device 200 based on the result analyzed by the analysis unit 420.
  • the position of the user is estimated based on the information regarding the position of the object obtained from the analysis unit 420, the distance between the user and the object, and the posture information of the user. Specifically, since the position of the object is specified, the position of the user can be estimated based on the posture information of the user and the distance between the object.
  • the position of the user should be estimated based on the posture information of the user and the distance between the objects by using the positions of other identifiable objects. Can be done.
  • the position of the user can be estimated without using the GPS function.
  • the transmission of the environmental information from the device 200 to the acquisition unit 410 can be performed at intervals close to real time, or can be performed at a specific timing.
  • the specific timing is, for example, a timing in which a feature point is included in the environmental information acquired by the sensor of the device 200 or the posture information of the user.
  • the case where the feature points are included in the environmental information is, for example, when the user is walking in the building and the shape of the object is recognized as a corner (turning corner). Therefore, it is necessary to set such a shape in advance as a feature point.
  • the estimation unit estimates the position assuming that the user is traveling straight ahead.
  • the amount of communication can be reduced and the burden of analysis processing can be reduced.
  • the acquisition of environmental information by the sensor can be performed at a specific timing when the user's posture information includes feature points.
  • the feature point in this case is when the user is recognized as turning a corner. Therefore, it is necessary to set such a shape in advance as a feature point.
  • the amount of communication can be reduced and the burden of analysis processing can be reduced.
  • the environmental information can be information about the buildings around the user.
  • the information processing system 100 further has a generation unit 440 as shown in FIG.
  • the generation unit 440 generates a map around the user based on the result analyzed by the analysis unit 420.
  • the map around the user is the map database described above. That is, the map database contains at least information about the shape of the building.
  • the information regarding the shape of the building includes the information obtained by analyzing the information acquired from the sensor of the device 200 and the information provided by the manager of the building or the like.
  • the other object is specified and not specified.
  • the building that should be in the position of one object is identified.
  • the information about the shape of the building already included in the map database is different from the information obtained by analyzing the information acquired from the sensor of the device 200.
  • the case where the information about the shape of the building already contained in the map database is different from the information obtained by analyzing the information acquired from the sensor of the device 200 is, for example, when the building is missing or rebuilt. For example.
  • the generation unit 440 can update the map database based on the information acquired from the sensor of the device 200.
  • the map database can be realized by such a configuration. You can get closer to the state.
  • the map database may include information on the location of the building.
  • the information regarding the position of the building includes those obtained by the GPS function included in the device 200 or the user terminal 300, and those provided by the manager of the building and the like.
  • the map database generated in this way can be used in wearable devices such as smart glasses as three-dimensional map information.
  • GPS function is not essential, not only maps related to buildings on the road but also detailed maps inside buildings and underground maps can be easily generated.
  • the information processing apparatus 400 in the present disclosure connects a plurality of devices of the same type or different types that can be worn or possessed by a plurality of users at different locations, or user terminals of a plurality of users and the Internet. It can be a server device that can be connected via.
  • the acquisition unit 410 acquires the environment information around the plurality of users transmitted from the plurality of devices.
  • the analysis unit 420 analyzes the environment information around the plurality of users acquired by the acquisition unit 410.
  • the generation unit 440 generates a wide-area map by generating and synthesizing maps around a plurality of users based on the results analyzed by the analysis unit 420.
  • the information processing apparatus 400 collects more information than the information provided by a single user, and it becomes possible to generate a map in a wider area.
  • the estimation unit 430 and the generation unit 440 can estimate the position of the user and generate a map around the user by using the SLAM (Simultaneous Localization and Mapping) method.
  • SLAM Simultaneous Localization and Mapping
  • the estimation unit 430 has data that models a point cloud data feature having an image acquired from the device 200 in advance, object information detected from the image, and distance information acquired from the sensor unit described later. The location is estimated from similar features by comparing with the features of any or more of the above obtained from the device.
  • the learning model may be on either the server or the device 200 side.
  • the network load increases and the response performance drops.
  • the feature amount extraction on the device 200 side only the data necessary for feature comparison can be transmitted to the server, and the search performance can be improved.
  • the range for searching for features can be narrowed down and the search performance can be improved.
  • a known technique may be used for self-position estimation and environmental map creation using the SLAM method.
  • the device 200 has a sensor unit for acquiring environmental information around the user, and the sensor unit acquires the distance to an obstacle around the user two-dimensionally or three-dimensionally as environmental information. can do.
  • the sensor unit can be an infrared depth sensor, an ultrasonic sensor, a millimeter wave radar sensor, or a LiDAR (light detection and ranging).
  • the device 200 has a sensor unit that acquires environmental information around the user, and the sensor unit can acquire an captured image by imaging the surroundings of the user as environmental information.
  • the sensor unit can be, for example, a monocular camera or a stereo camera.
  • the information processing apparatus 400 in the present disclosure can further have a guide output unit 450.
  • the guide output unit 450 outputs a guide for acquiring the information necessary for estimating the user's position to the user's device 200.
  • a guide is output to the user's device 200 so that the information of the other object can be acquired. be able to.
  • a voice guide such as "Look at the building on the right for ⁇ seconds" or "Please go forward ⁇ " can be output from the speaker.
  • a character guide such as "Look at the building on the right for ⁇ seconds" or "Please go forward ⁇ " can be output to the display unit.
  • the environmental information can be information about celestial bodies that can be visually recognized by the user.
  • the analysis unit 420 and the estimation unit 430 analyze the environmental information using the celestial method and estimate the user's position.
  • Such a celestial method measures the user's position by measuring the angle between the celestial body (sun, moon, planet, star) captured by the camera of the user's device 200 (smart glasses in this case) and the horizon (viewing horizon). Can be estimated.
  • a known technique can be used for estimating the user's position using such a celestial method.
  • the environmental information may include personal information about people around the user.
  • the generation unit 440 generates a map around the user including the person information.
  • the information processing apparatus 400 is further connected to the information processing apparatus 400 and transmits a map around the user to another user's device associated with the user or the information processing terminal of the other user. It can have a transmitter 460.
  • the map including person information is, for example, a map in a conference room. Such a map contains information about the existence of a person and the positional relationship with the user.
  • Such a map can give a user who wears the device 200 and participates in a conference remotely as if he / she is in the conference room and actually participates in the conference.
  • a seat in the conference room is assigned to the remote-participating user, and the remarks of the participant to the right of the seat can be output from the device 200 of the remote-participating user so as to be heard from the right side. ..
  • the information processing method in the present disclosure is an information processing method in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device. It is characterized in that one or a plurality of processors included in the system execute the acquisition step S410, the analysis step S420, and the estimation step S430.
  • the acquisition step S410 acquires the environment information around the user transmitted from the device.
  • the acquisition step S410 can be executed by the acquisition unit 410 described above.
  • the details of the acquisition unit 410 are as described above.
  • Analysis step S420 analyzes the environmental information acquired in acquisition step S410. Such analysis step S420 can be executed by the analysis unit 420 described above. The details of the analysis unit 420 are as described above.
  • the estimation step S430 estimates the position of the user who wears or possesses the device based on the result analyzed in the analysis step S420. Such estimation step S430 can be executed by the estimation unit 430 described above. The details of the estimation unit 430 are as described above.
  • the position of the user can be estimated without using the GPS function.
  • the computer program in the present disclosure is a computer program executed in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device, and is one or a plurality of computer programs included in the information processing system. It is characterized in that the processor realizes an acquisition function, an analysis function, and an estimation function.
  • the acquisition function acquires the environment information around the user sent from the device.
  • the analysis function analyzes the environmental information acquired by the acquisition function.
  • the estimation function estimates the position of the user who wears or owns the device based on the result analyzed by the analysis function.
  • the above function can be realized by the acquisition circuit 1410, the analysis circuit 1420, and the estimation circuit 1430 shown in FIG. It is assumed that the acquisition circuit 1410, the analysis circuit 1420, and the estimation circuit 1430 are realized by the acquisition unit 410, the analysis unit 420, and the estimation unit 430 described above, respectively. The details of each part are as described above.
  • an information processing device such as a computer or a mobile phone can be preferably used.
  • Such an information processing device stores a program describing processing contents that realize each function of the server device or the terminal device according to the embodiment in the storage unit of the information processing device, and the CPU of the information processing device stores the program. This can be achieved by reading and executing.
  • the method described in the embodiment includes, for example, a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), as a program that can be executed by a computer (computer). It can be stored in a recording medium such as a semiconductor memory (ROM, RAM, flash memory, etc.), and can also be transmitted and distributed by a communication medium.
  • the program stored on the medium side also includes a setting program for configuring the software means (including not only the execution program but also the table and the data structure) to be executed by the computer in the computer.
  • a computer that realizes this device reads a program recorded on a recording medium, constructs software means by a setting program in some cases, and executes the above-mentioned processing by controlling the operation by the software means.
  • the recording medium referred to in the present specification is not limited to distribution, and includes storage media such as magnetic disks and semiconductor memories provided in devices connected inside a computer or via a network.
  • the storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
  • Information processing system 100 Information processing system 200 Device 300 User terminal 400 Information processing device 410 Acquisition unit 420 Analysis unit 430 Estimate unit 440 Generation unit 450 Guide output unit 460 Transmission unit

Abstract

[Problem] To provide an information processing system, information processing method, and computer program that make it possible to estimate the position of a user without using a GPS function. [Solution] The information processing system according to this disclosure is characterized by comprising a device that can be worn or held by a user and an information processing apparatus that can connect to the device, and in that the information processing apparatus comprises an acquisition unit for acquiring environment information about the surroundings of the user, the information having been transmitted from the device, an analysis unit for analyzing the environment information acquired by the acquisition unit, and an estimation unit for estimating the position of the user wearing or holding the device on the basis of the result of the analysis by the analysis unit.

Description

情報処理システム、情報処理方法およびコンピュータプログラムInformation processing systems, information processing methods and computer programs
 また、本発明は、情報処理システム、情報処理方法およびコンピュータプログラムに関する。 The present invention also relates to an information processing system, an information processing method and a computer program.
 近年、自身が携帯するGPS(グローバル・ポジショニング・システム)機能を有するデバイスを確認すれば、自分の現在位置を知ることができる。 In recent years, if you check the device that has the GPS (Global Positioning System) function that you carry, you can know your current position.
 特許文献1には、道路沿いの風景をパノラマ写真で提供するサービスに関する技術が記載されている。 Patent Document 1 describes a technology related to a service that provides a panoramic photograph of a landscape along a road.
 かかる技術において、パノラマ写真は、全天球カメラを搭載した自動車等で車道を走行しながら撮影され、同時に、搭載されているGPS機能により撮影位置が記録される。 In this technology, panoramic photographs are taken while driving on the roadway with a car equipped with an omnidirectional camera, and at the same time, the shooting position is recorded by the built-in GPS function.
特表2013-534656号公報Special Table 2013-534656 Gazette
 しかしながら、上記技術においてパノラマ写真とともに記録される撮影位置はGPS機能により取得されるものであって、そもそもGPS機能を搭載していない、あるいは、GPS機能が正常に機能していない状態では意味をなさないという問題がある。 However, in the above technology, the shooting position recorded together with the panoramic photograph is acquired by the GPS function, and it is meaningless if the GPS function is not installed or the GPS function is not functioning normally in the first place. There is a problem that there is no such thing.
 また、上記技術により提供されるサービスは更新頻度が低く、事前に確認した風景と、実際に現地に行った際の風景とが異なり案内が不正確となるおそれがある。 In addition, the service provided by the above technology is updated infrequently, and the scenery confirmed in advance may differ from the scenery when actually visiting the site, and the guidance may be inaccurate.
 そのため、本開示の目的は、上述した従来技術の問題の少なくとも一部を解決又は緩和する技術的な改善を提供することである。本開示のより具体的な目的の一つは、GPS機能を用いなくともユーザの位置を推定することが可能な情報処理システム、情報処理方法およびコンピュータプログラムを提供することである。 Therefore, an object of the present disclosure is to provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. One of the more specific objects of the present disclosure is to provide an information processing system, an information processing method and a computer program capable of estimating a user's position without using a GPS function.
 本開示における情報処理システムは、ユーザが装着または所持可能なデバイスと、デバイスと接続可能な情報処理装置とを備える情報処理システムであって、情報処理装置は、デバイスから送信されたユーザの周囲の環境情報を取得する取得部と、取得部により取得された環境情報を解析する解析部と、解析部により解析された結果に基づいて、デバイスを装着または所持するユーザの位置を推定する推定部とを有することを特徴とする。 The information processing system in the present disclosure is an information processing system including a device that can be worn or possessed by the user and an information processing device that can be connected to the device, and the information processing device is around the user transmitted from the device. An acquisition unit that acquires environmental information, an analysis unit that analyzes the environmental information acquired by the acquisition unit, and an estimation unit that estimates the position of the user who wears or possesses the device based on the results analyzed by the analysis unit. It is characterized by having.
 環境情報は、ユーザの周囲の建造物に関する情報であり、情報処理システムは、さらに、解析部により解析された結果に基づいて、ユーザの周囲の地図を生成する生成部を有することができる。 The environmental information is information about the buildings around the user, and the information processing system can further have a generation unit that generates a map around the user based on the result analyzed by the analysis unit.
 情報処理装置は、異なる場所にいる複数のユーザが装着または所持可能な同種または異種の複数のデバイス、または、複数のユーザのユーザ端末とインターネットを介して接続可能なサーバ装置であり、取得部は、複数のデバイスから送信された複数のユーザの周囲の環境情報を取得し、解析部は、取得部により取得された複数のユーザの周囲の環境情報を解析し、生成部は、解析部により解析された結果に基づいて、複数のユーザの周囲の地図を生成して合成することにより広域な地図を生成することができる。 The information processing device is a server device that can be connected to a plurality of devices of the same type or different types that can be worn or possessed by a plurality of users in different places, or user terminals of a plurality of users via the Internet, and the acquisition unit is , Acquires the environment information around multiple users transmitted from multiple devices, the analysis unit analyzes the environment information around multiple users acquired by the acquisition unit, and the generation unit analyzes it by the analysis unit. A wide area map can be generated by generating and synthesizing maps around a plurality of users based on the results obtained.
 推定部および生成部は、SLAM(Simultaneous Localization and Mapping)手法を用いて、ユーザの位置を推定し、かつ、ユーザの周囲の地図を生成することができる。 The estimation unit and the generation unit can estimate the position of the user and generate a map around the user by using the SLAM (Simultaneous Localization and Mapping) method.
 デバイスは、ユーザの周囲の環境情報を取得するためのセンサ部を有し、センサ部は、環境情報として、ユーザの周囲にある障害物までの距離を二次元的または三次元的に取得することができる。 The device has a sensor unit for acquiring environmental information around the user, and the sensor unit acquires the distance to an obstacle around the user two-dimensionally or three-dimensionally as environmental information. Can be done.
 デバイスは、ユーザの周囲の環境情報を取得するセンサ部を有し、センサ部は、環境情報として、ユーザの周囲を撮像することにより撮像画像を取得することができる。 The device has a sensor unit that acquires environmental information around the user, and the sensor unit can acquire an captured image by imaging the surroundings of the user as environmental information.
 情報処理装置は、さらに、ユーザのデバイスに対し、ユーザの位置を推定するのに必要な情報を取得するためのガイドを出力するガイド出力部を有することができる。 The information processing device can further have a guide output unit that outputs a guide for acquiring information necessary for estimating the position of the user to the user's device.
 環境情報は、ユーザが視認可能な天体に関する情報であり、解析部および推定部は、天測手法を用いて環境情報を解析し、かつ、ユーザの位置を推定することができる。 The environmental information is information about the celestial body that can be visually recognized by the user, and the analysis unit and the estimation unit can analyze the environmental information by using the celestial measurement method and estimate the position of the user.
 本開示における情報処理方法は、ユーザが装着または所持可能なデバイスと、デバイスと接続可能な情報処理装置とを備える情報処理システムにおける情報処理方法であって、情報処理システムが備える一又は複数のプロセッサに、デバイスから送信されたユーザの周囲の環境情報を取得する取得ステップと、取得ステップにおいて取得された環境情報を解析する解析ステップと、解析ステップにおいて解析された結果に基づいて、デバイスを装着または所持するユーザの位置を推定する推定ステップとを実行させることを特徴とする。 The information processing method in the present disclosure is an information processing method in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device, and is one or a plurality of processors included in the information processing system. In addition, the device is attached or mounted based on the acquisition step of acquiring the environment information around the user transmitted from the device, the analysis step of analyzing the environment information acquired in the acquisition step, and the result analyzed in the analysis step. It is characterized by executing an estimation step for estimating the position of the possessing user.
 本開示におけるコンピュータプログラムは、ユーザが装着または所持可能なデバイスと、デバイスと接続可能な情報処理装置とを備える情報処理システムにおいて実行されるコンピュータプログラムであって、情報処理システムが備える一又は複数のプロセッサに、デバイスから送信されたユーザの周囲の環境情報を取得する取得機能と、取得機能により取得された環境情報を解析する解析機能と、解析機能により解析された結果に基づいて、デバイスを装着または所持するユーザの位置を推定する推定機能とを実現させることを特徴とする。 The computer program in the present disclosure is a computer program executed in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device, and is one or a plurality of computer programs included in the information processing system. The device is attached to the processor based on the acquisition function that acquires the environment information around the user transmitted from the device, the analysis function that analyzes the environment information acquired by the acquisition function, and the result analyzed by the analysis function. Alternatively, it is characterized by realizing an estimation function for estimating the position of the possessing user.
 本開示によれば、上述した従来技術の問題の少なくとも一部を解決又は緩和する技術的な改善を提供することができる。本開示の一実施形態によれば、GPS機能を用いなくともユーザの位置を推定することが可能な情報処理システム、情報処理方法およびコンピュータプログラムを提供することができる。 According to the present disclosure, it is possible to provide technical improvements that solve or alleviate at least a part of the above-mentioned problems of the prior art. According to one embodiment of the present disclosure, it is possible to provide an information processing system, an information processing method, and a computer program capable of estimating a user's position without using a GPS function.
本開示における情報処理システムの一例を示すシステム構成図である。It is a system block diagram which shows an example of the information processing system in this disclosure. 本開示における情報処理装置のハードウェア構成の一例を示す構成図である。It is a block diagram which shows an example of the hardware configuration of the information processing apparatus in this disclosure. 本開示における情報処理装置の機能構成の一例を示す機能構成図である。It is a functional block diagram which shows an example of the functional block of the information processing apparatus in this disclosure. 本開示における情報処理装置の機能構成の他の例を示す機能構成図である。It is a functional block diagram which shows the other example of the functional block of the information processing apparatus in this disclosure. 本開示における情報処理システムの他の例を示すシステム構成図である。It is a system block diagram which shows the other example of the information processing system in this disclosure. 本開示における情報処理方法のフローの一例を示すフロー図である。It is a flow diagram which shows an example of the flow of the information processing method in this disclosure. 本開示におけるコンピュータプログラムの機能を実現するための回路構成の一例を示す回路構成図である。It is a circuit block diagram which shows an example of the circuit structure for realizing the function of the computer program in this disclosure.
 初めに、本開示の実施形態に係る情報処理システムの実施形態について図面を参照しながら説明を行う。 First, an embodiment of the information processing system according to the embodiment of the present disclosure will be described with reference to the drawings.
 <システム構成>
 図1に一例として示されるように、本開示の実施形態に係る情報処理システム100は、デバイス200と、デバイス200と接続可能な情報処理装置400とを備える。
<System configuration>
As shown as an example in FIG. 1, the information processing system 100 according to the embodiment of the present disclosure includes a device 200 and an information processing device 400 that can be connected to the device 200.
 なお、図1ではデバイス200がユーザ端末300を介して情報処理装置400と接続される例を示しているが、デバイス200が直接情報処理装置400と接続されるものとしてもよい。 Although FIG. 1 shows an example in which the device 200 is connected to the information processing device 400 via the user terminal 300, the device 200 may be directly connected to the information processing device 400.
 デバイス200は、ユーザが装着または所持可能なデバイスであれば特に限定されるものではないが、一例として、ユーザが耳部または頭部に装着可能なイヤホン型デバイス(以下、「イヤホン」という。)、ユーザが頭部に装着可能な眼鏡型デバイス(以下、「スマートグラス」という。)、ユーザが腕部に装着可能な時計型デバイス(以下、「スマートウォッチ」という。)などのウェアラブルデバイスが挙げられる。 The device 200 is not particularly limited as long as it is a device that can be worn or possessed by the user, but as an example, an earphone-type device that can be worn by the user on the ear or head (hereinafter referred to as “earphone”). , Wearable devices such as eyeglass-type devices that can be worn by the user on the head (hereinafter referred to as "smart glasses") and watch-type devices that can be worn by the user on the wrist (hereinafter referred to as "smart watches"). Be done.
 これらウェアラブルデバイス200は、ユーザ端末300とBluetooth(登録商標)などの近距離無線通信技術を用いて接続されることができる。 These wearable devices 200 can be connected to the user terminal 300 using short-range wireless communication technology such as Bluetooth (registered trademark).
 あるいは、ウェアラブルデバイス200は、無線LANやモバイルデータ通信を介して情報処理装置400に直接接続されてもよい。 Alternatively, the wearable device 200 may be directly connected to the information processing device 400 via a wireless LAN or mobile data communication.
 またデバイス200は、一例として、スマートフォンやタブレットなどのユーザが所持可能なデバイスであってもよい。このとき、スマートフォンを想定する上記ユーザ端末300は、本システムに含まれなくてもよい。 Further, the device 200 may be, for example, a device that can be possessed by a user such as a smartphone or a tablet. At this time, the user terminal 300 assuming a smartphone does not have to be included in this system.
 情報処理装置400は、デバイス200またはユーザ端末300からの要求に対して情報または処理結果を提供するサーバとすることができる。 The information processing device 400 can be a server that provides information or processing results in response to a request from the device 200 or the user terminal 300.
 あるいは、情報処理装置400は、デバイス200と接続されるユーザ端末300そのものであってもよい。 Alternatively, the information processing device 400 may be the user terminal 300 itself connected to the device 200.
<ハードウェア構成>
 ここで、図2を用いて、情報処理システム100に含まれる情報処理装置400のハードウェア構成について説明する。情報処理装置400は、プロセッサ401と、メモリ402と、ストレージ403と、入出力インターフェース(入出力I/F)404と、通信インターフェース(通信I/F)405とを含む。各構成要素は、バスBを介して相互に接続される。
<Hardware configuration>
Here, the hardware configuration of the information processing apparatus 400 included in the information processing system 100 will be described with reference to FIG. The information processing device 400 includes a processor 401, a memory 402, a storage 403, an input / output interface (input / output I / F) 404, and a communication interface (communication I / F) 405. The components are connected to each other via bus B.
 情報処理装置400は、プロセッサ401と、メモリ402と、ストレージ403と、入出力I/F404と、通信I/F405との協働により、本実施形態に記載される機能、方法を実現することができる。 The information processing apparatus 400 can realize the functions and methods described in the present embodiment by the cooperation of the processor 401, the memory 402, the storage 403, the input / output I / F 404, and the communication I / F 405. can.
 プロセッサ401は、ストレージ403に記憶されるプログラムに含まれるコード又は命令によって実現する機能、及び/又は、方法を実行する。プロセッサ401は、例えば、中央処理装置(CPU)、MPU(Micro Processing Unit)、GPU(Graphics Processing Unit)、マイクロプロセッサ(microprocessor)、プロセッサコア(processor core)、マルチプロセッサ(multiprocessor)、ASIC(Application-Specific Integrated Circuit)、FPGA(Field Programmable Gate Array)等を含み、集積回路(IC(Integrated Circuit)チップ、LSI(Large Scale Integration))等に形成された論理回路(ハードウェア)や専用回路によって各実施形態に開示される各処理を実現してもよい。また、これらの回路は、1又は複数の集積回路により実現されてよく、各実施形態に示す複数の処理を1つの集積回路により実現されることとしてもよい。また、LSIは、集積度の違いにより、VLSI、スーパーLSI、ウルトラLSI等と呼称されることもある。 The processor 401 executes a function and / or a method realized by a code or an instruction contained in a program stored in the storage 403. The processor 401 is, for example, a central processing unit (CPU), an MPU (MicroProcessingUnit), a GPU (GraphicsProcessingUnit), a microprocessor (microprocessor), a processor core (processorcore), a multiprocessor, an ASIC (Application-). Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc. are included, and each is implemented by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), etc. Each process disclosed in the form may be realized. Further, these circuits may be realized by one or a plurality of integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. In addition, LSI may be referred to as VLSI, super LSI, ultra LSI, or the like depending on the degree of integration.
 メモリ402は、ストレージ403からロードしたプログラムを一時的に記憶し、プロセッサ401に対して作業領域を提供する。メモリ402には、プロセッサ401がプログラムを実行している間に生成される各種データも一時的に格納される。メモリ402は、例えば、RAM(Random Access Memory)、ROM(Read Only Memory)等を含む。 The memory 402 temporarily stores the program loaded from the storage 403 and provides a work area to the processor 401. Various data generated while the processor 401 is executing the program are also temporarily stored in the memory 402. The memory 402 includes, for example, a RAM (RandomAccessMemory), a ROM (ReadOnlyMemory), and the like.
 ストレージ403は、プログラムを記憶する。ストレージ403は、例えば、HDD(Hard Disk Drive)、SSD(Solid State Drive)、フラッシュメモリ等を含む。 The storage 403 stores the program. The storage 403 includes, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, and the like.
 通信I/F405は、ネットワークアダプタ等のハードウェアや通信用ソフトウェア、及びこれらの組み合わせとして実装され、ネットワーク300を介して各種データの送受信を行う。当該通信は、有線、無線のいずれで実行されてもよく、互いの通信が実行できるのであれば、どのような通信プロトコルを用いてもよい。通信I/F405は、ネットワーク300を介して、他の情報処理装置との通信を実行する。通信I/F405は、各種データをプロセッサ401からの指示に従って、他の情報処理装置に送信する。また、通信I/F405は、他の情報処理装置から送信された各種データを受信し、プロセッサ401に伝達する。 The communication I / F405 is implemented as hardware such as a network adapter, communication software, and a combination thereof, and transmits / receives various data via the network 300. The communication may be executed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be executed. The communication I / F 405 executes communication with another information processing device via the network 300. The communication I / F 405 transmits various data to other information processing devices according to instructions from the processor 401. Further, the communication I / F 405 receives various data transmitted from other information processing devices and transmits them to the processor 401.
 入出力I/F404は、情報処理装置400に対する各種操作を入力する入力装置、及び、情報処理装置400で処理された処理結果を出力する出力装置を含む。入出力I/F404は、入力装置と出力装置が一体化していてもよいし、入力装置と出力装置とに分離していてもよい。 The input / output I / F 404 includes an input device for inputting various operations to the information processing device 400 and an output device for outputting the processing result processed by the information processing device 400. The input / output I / F 404 may be integrated with the input device and the output device, or may be separated into the input device and the output device.
 入力装置は、ユーザからの入力を受け付けて、当該入力に係る情報をプロセッサ401に伝達できる全ての種類の装置のいずれか、又は、その組み合わせにより実現される。入力装置は、例えば、タッチパネル、タッチディスプレイ、キーボード等のハードウェアキーや、マウス等のポインティングデバイス、カメラ(画像を介した操作入力)、マイク(音声による操作入力)を含む。 The input device is realized by any one of all kinds of devices capable of receiving an input from a user and transmitting information related to the input to the processor 401, or a combination thereof. The input device includes, for example, a hardware key such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).
 出力装置は、プロセッサ401で処理された処理結果を出力する。出力装置は、例えば、タッチパネル、スピーカ等を含む。なお、デバイス200およびユーザ端末300についても特筆すべき場合を除き、図2と同様のハードウェア構成で構成されることができる。 The output device outputs the processing result processed by the processor 401. The output device includes, for example, a touch panel, a speaker, and the like. The device 200 and the user terminal 300 can also be configured with the same hardware configuration as in FIG. 2, except for special cases.
 <機能構成>
 そして、上記情報処理装置400は、図3に示されるように、取得部410と、解析部420と、推定部430とを有する。
<Functional configuration>
Then, as shown in FIG. 3, the information processing apparatus 400 has an acquisition unit 410, an analysis unit 420, and an estimation unit 430.
 取得部410は、デバイス200から送信されたユーザの周囲の環境情報を取得する。 The acquisition unit 410 acquires the environment information around the user transmitted from the device 200.
 環境情報は、ユーザの周囲の建物に関する情報、または、ユーザが視認可能な天体に関する情報とすることができる。詳細については後述する。 Environmental information can be information about buildings around the user or information about celestial bodies that can be seen by the user. Details will be described later.
 また、環境情報は、デバイス200が有する各種センサにより取得される情報とすることができる。 Further, the environmental information can be information acquired by various sensors of the device 200.
 一例として、デバイス200は、センサとして単眼カメラ、ステレオカメラ,赤外線デプスセンサ、超音波センサ、ミリ波レーダセンサ、LiDAR(light detection and ranging)等を備える。 As an example, the device 200 includes a monocular camera, a stereo camera, an infrared depth sensor, an ultrasonic sensor, a millimeter wave radar sensor, a LiDAR (light detection and ranging), and the like as sensors.
 なお、環境情報は、上記センサにより取得される情報に加えて、少なくとも、デバイス200が有する姿勢センサにより得られたユーザの姿勢情報を含むものとする。 The environmental information includes at least the posture information of the user obtained by the posture sensor of the device 200, in addition to the information acquired by the sensor.
 解析部420は、取得部410により取得された環境情報を解析する。 The analysis unit 420 analyzes the environmental information acquired by the acquisition unit 410.
 一例として、解析部420は、デバイス200のセンサである単眼カメラ、ステレオカメラ,赤外線デプスセンサ、超音波センサ、ミリ波レーダセンサ、LiDAR(light detection and ranging)等から取得された情報から、少なくとも一の対象物の形状を解析する。ここでいう対象物は、ユーザの周囲の建造物、標識、道路、樹木や人物などである。 As an example, the analysis unit 420 is at least one from the information acquired from the sensor of the device 200, such as a monocular camera, a stereo camera, an infrared depth sensor, an ultrasonic sensor, a millimeter wave radar sensor, and LiDAR (light detection and ranging). Analyze the shape of the object. The objects referred to here are buildings, signs, roads, trees, people, etc. around the user.
 ここでいう建造物には、建造物には、建物全体のみならず、内部の壁、柱、改札機、自動販売機などの設置物なども含むものとする。すなわち、環境情報は、屋外にいるユーザの周囲の環境のみならず、屋内や地下空間にいるユーザの周囲の環境に関する情報が含まれるものとする。 The building mentioned here includes not only the entire building but also the internal walls, pillars, ticket gates, vending machines, and other installations. That is, the environmental information includes not only the environment around the user who is outdoors but also the environment around the user who is indoors or underground.
 そして、解析部420は、対象物の形状から対象物が何であるかを特定する。具体的には、解析部420は、少なくとも位置に関する情報を取得する。かかる対象物の位置に関する情報は、所定の記憶装置に予め記憶されている地図データベースから取得してもよい。 Then, the analysis unit 420 identifies what the object is from the shape of the object. Specifically, the analysis unit 420 acquires at least information regarding the position. Information regarding the position of such an object may be acquired from a map database stored in advance in a predetermined storage device.
 地図データベースには、対象物の形状およびその位置情報が対応付けて管理される。なお、対象物の形状には、対象物が建物等の場合には、建物の全体の外観の形状、建物の一部の外観の形状、建物内部の一部の形状などが含まれ、対象物が壁等の場合には、直線を構成する際の壁の形状、角やカーブを構成する際の壁の形状などが含まれる。 The map database manages the shape of the object and its position information in association with each other. When the object is a building or the like, the shape of the object includes the shape of the entire appearance of the building, the shape of the appearance of a part of the building, the shape of a part of the inside of the building, and the like. In the case of a wall or the like, the shape of the wall when forming a straight line, the shape of the wall when forming a corner or a curve, and the like are included.
 また、解析部420は、センサにより取得された情報から、ユーザと対象物との間の距離を解析する。 Further, the analysis unit 420 analyzes the distance between the user and the object from the information acquired by the sensor.
 以上、一例として、解析部420は、取得部410により取得された環境情報を解析することにより、対象物の位置に関する情報、ユーザと対象物との間の距離、および、ユーザの姿勢情報を得ることができる。 As described above, as an example, the analysis unit 420 obtains information on the position of the object, the distance between the user and the object, and the posture information of the user by analyzing the environmental information acquired by the acquisition unit 410. be able to.
 そして、推定部430は、解析部420により解析された結果に基づいて、デバイス200を装着または所持するユーザの位置を推定する。 Then, the estimation unit 430 estimates the position of the user who wears or possesses the device 200 based on the result analyzed by the analysis unit 420.
 具体的には、解析部420から得られた対象物の位置に関する情報、ユーザと対象物との間の距離、および、ユーザの姿勢情報に基づいて、ユーザの位置を推定する。具体的には、対象物の位置が特定されていることから、ユーザの姿勢情報と対象物との間の距離とに基づいてユーザの位置を推定することができる。 Specifically, the position of the user is estimated based on the information regarding the position of the object obtained from the analysis unit 420, the distance between the user and the object, and the posture information of the user. Specifically, since the position of the object is specified, the position of the user can be estimated based on the posture information of the user and the distance between the object.
 なお、一の対象物が特定されない場合には、特定可能な他の対象物の位置を利用して、ユーザの姿勢情報と対象物との間の距離とに基づいてユーザの位置を推定することができる。 If one object is not specified, the position of the user should be estimated based on the posture information of the user and the distance between the objects by using the positions of other identifiable objects. Can be done.
 以上の構成によれば、上述した従来技術の問題の少なくとも一部を解決又は緩和する技術的な改善を提供することができる。本開示の上記実施形態によれば、GPS機能を用いなくともユーザの位置を推定することができる。 According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the above-mentioned problems of the prior art. According to the above embodiment of the present disclosure, the position of the user can be estimated without using the GPS function.
 なお、デバイス200から取得部410への環境情報の送信は、リアルタイムに近い間隔で行うこともできるし、特定のタイミングで行うものとすることもできる。 Note that the transmission of the environmental information from the device 200 to the acquisition unit 410 can be performed at intervals close to real time, or can be performed at a specific timing.
 特定のタイミングとは、例えば、デバイス200が有するセンサが取得した環境情報またはユーザの姿勢情報に特徴点が含まれたタイミングなどである。 The specific timing is, for example, a timing in which a feature point is included in the environmental information acquired by the sensor of the device 200 or the posture information of the user.
 環境情報に特徴点が含まれる場合とは、一例としてユーザが建物内を歩いている場合には、対象物の形状が角(曲がり角)と認識された場合などである。よって、かかる形状を特徴点として予め設定しておく必要がある。 The case where the feature points are included in the environmental information is, for example, when the user is walking in the building and the shape of the object is recognized as a corner (turning corner). Therefore, it is necessary to set such a shape in advance as a feature point.
 一方、環境情報に特徴点が含まれない場合には、推定部は、ユーザは直進して進行しているものとして位置を推定する。 On the other hand, if the environmental information does not include the feature points, the estimation unit estimates the position assuming that the user is traveling straight ahead.
 このような構成とすることで、通信量を低減できるとともに解析処理の負担も低減することができる。 With such a configuration, the amount of communication can be reduced and the burden of analysis processing can be reduced.
 また、センサによる環境情報の取得も、ユーザの姿勢情報に特徴点が含まれた特定のタイミングで行うことができる。この場合の特徴点は、ユーザが角を曲がっていると認識された場合などである。よって、かかる形状を特徴点として予め設定しておく必要がある。 Also, the acquisition of environmental information by the sensor can be performed at a specific timing when the user's posture information includes feature points. The feature point in this case is when the user is recognized as turning a corner. Therefore, it is necessary to set such a shape in advance as a feature point.
 このような構成とすることで、通信量を低減できるとともに解析処理の負担も低減することができる。 With such a configuration, the amount of communication can be reduced and the burden of analysis processing can be reduced.
 なお、予測されたユーザ位置と推定されたユーザ位置とにずれが生じた場合であっても、特徴点を通過する度に補正を行うことでかかる事象を改善することができる。 Even if there is a discrepancy between the predicted user position and the estimated user position, such an event can be improved by making corrections each time the feature point is passed.
 上述したとおり、環境情報は、ユーザの周囲の建造物に関する情報とすることができる。 As mentioned above, the environmental information can be information about the buildings around the user.
 このとき、情報処理システム100は、図4に示されるように、さらに、生成部440を有する。 At this time, the information processing system 100 further has a generation unit 440 as shown in FIG.
 生成部440は、解析部420により解析された結果に基づいて、ユーザの周囲の地図を生成する。 The generation unit 440 generates a map around the user based on the result analyzed by the analysis unit 420.
 ユーザの周囲の地図とは、上述した地図データベースである。すなわち、地図データベースには、少なくとも建造物の形状に関する情報が含まれる。建造物の形状に関する情報は、デバイス200のセンサから取得された情報を解析して得られるもの、および、建造物の管理者等から提供されるものを含む。 The map around the user is the map database described above. That is, the map database contains at least information about the shape of the building. The information regarding the shape of the building includes the information obtained by analyzing the information acquired from the sensor of the device 200 and the information provided by the manager of the building or the like.
 上述したように、一の対象物が特定されず、特定可能な他の対象物の位置を利用してユーザの位置を推定する場合、他の対象物が特定されることで、特定されなかった一の対象物の位置にあるべき建造物が特定される。 As described above, when one object is not specified and the position of the user is estimated by using the position of another identifiable object, the other object is specified and not specified. The building that should be in the position of one object is identified.
 このとき、既に地図データベースに含まれる建造物の形状に関する情報が、デバイス200のセンサから取得された情報を解析して得られるものと異なるという状態が生じる。 At this time, the information about the shape of the building already included in the map database is different from the information obtained by analyzing the information acquired from the sensor of the device 200.
 既に地図データベースに含まれる建造物の形状に関する情報が、デバイス200のセンサから取得された情報を解析して得られるものと異なる場合とは、例えば、建造物が無くなっている場合や建て替えられている場合などである。 The case where the information about the shape of the building already contained in the map database is different from the information obtained by analyzing the information acquired from the sensor of the device 200 is, for example, when the building is missing or rebuilt. For example.
 この場合、生成部440は、当該地図データベースをデバイス200のセンサから取得された情報に基づいて更新することができる。 In this case, the generation unit 440 can update the map database based on the information acquired from the sensor of the device 200.
 デバイス200のセンサから取得された情報を解析して得られる建造物の形状に関する情報は、その場にいるユーザから提供されるリアルタイムの有益なデータであることから、かかる構成により地図データベースは現実の状態に近付けることができる。 Since the information about the shape of the building obtained by analyzing the information acquired from the sensor of the device 200 is useful real-time data provided by the user on the spot, the map database can be realized by such a configuration. You can get closer to the state.
 なお、地図データベースには、建造物の位置に関する情報が含まれてもよい。建造物の位置に関する情報は、デバイス200またはユーザ端末300が備えるGPS機能により得られるもの、および、建造物の管理者等から提供されるものを含む。 The map database may include information on the location of the building. The information regarding the position of the building includes those obtained by the GPS function included in the device 200 or the user terminal 300, and those provided by the manager of the building and the like.
 このようにして生成された地図データベースは、3次元の地図情報としてスマートグラスなどのウェアラブルデバイスにおいて活用されることができる。 The map database generated in this way can be used in wearable devices such as smart glasses as three-dimensional map information.
 また、GPS機能が必須ではないことから、道路上の建造物に関する地図だけではなく、建物内の細かな地図や地下の地図なども容易に生成することができる。 Also, since the GPS function is not essential, not only maps related to buildings on the road but also detailed maps inside buildings and underground maps can be easily generated.
 また、本開示における情報処理装置400は、図5に示すように、異なる場所にいる複数のユーザが装着または所持可能な同種または異種の複数のデバイス、または、複数のユーザのユーザ端末とインターネットを介して接続可能なサーバ装置とすることができる。 Further, as shown in FIG. 5, the information processing apparatus 400 in the present disclosure connects a plurality of devices of the same type or different types that can be worn or possessed by a plurality of users at different locations, or user terminals of a plurality of users and the Internet. It can be a server device that can be connected via.
 このとき、取得部410は、複数のデバイスから送信された複数のユーザの周囲の環境情報を取得する。 At this time, the acquisition unit 410 acquires the environment information around the plurality of users transmitted from the plurality of devices.
 解析部420は、取得部410により取得された複数のユーザの周囲の環境情報を解析する。 The analysis unit 420 analyzes the environment information around the plurality of users acquired by the acquisition unit 410.
 生成部440は、解析部420により解析された結果に基づいて、複数のユーザの周囲の地図を生成して合成することにより広域な地図を生成する。 The generation unit 440 generates a wide-area map by generating and synthesizing maps around a plurality of users based on the results analyzed by the analysis unit 420.
 かかる構成によれば、情報処理装置400には単独のユーザにより提供される情報よりも多くの情報が集まることになり、より広域な地図の生成が可能になる。 According to such a configuration, the information processing apparatus 400 collects more information than the information provided by a single user, and it becomes possible to generate a map in a wider area.
 上記推定部430および生成部440は、SLAM(Simultaneous Localization and Mapping)手法を用いて、ユーザの位置を推定し、かつ、ユーザの周囲の地図を生成することができる。 The estimation unit 430 and the generation unit 440 can estimate the position of the user and generate a map around the user by using the SLAM (Simultaneous Localization and Mapping) method.
 推定部430は、予めデバイス200から取得した画像、画像から検出された物体情報、後述するセンサ部から取得した距離情報を持つ点群データ特徴をモデル化したデータを持つ。デバイスから得られた上記のいずれかまたは複数組み合わせの特徴と比較し、類似した特徴から場所を推定する。 The estimation unit 430 has data that models a point cloud data feature having an image acquired from the device 200 in advance, object information detected from the image, and distance information acquired from the sensor unit described later. The location is estimated from similar features by comparing with the features of any or more of the above obtained from the device.
 学習モデルはサーバ、デバイス200側のいずれにあってもよい。一方で画像や点群データをすべてネットワークを通じてサーバに送信することで、ネットワーク負荷が上がり、レスポンスパフォーマンスが落ちる。デバイス200側で特徴量抽出を処理することで、特徴比較に必要なデータのみをサーバに送信し、検索パフォーマンスを向上することができる。 The learning model may be on either the server or the device 200 side. On the other hand, by sending all images and point cloud data to the server via the network, the network load increases and the response performance drops. By processing the feature amount extraction on the device 200 side, only the data necessary for feature comparison can be transmitted to the server, and the search performance can be improved.
 さらに、GPSによっておおよその位置を推定することで、特徴を探す範囲を絞り込むことができ、検索パフォーマンスを向上させることができる。 Furthermore, by estimating the approximate position by GPS, the range for searching for features can be narrowed down and the search performance can be improved.
 かかるSLAM手法を用いた自己位置推定と環境地図作成については既知の技術を用いてもよい。 A known technique may be used for self-position estimation and environmental map creation using the SLAM method.
 デバイス200は、ユーザの周囲の環境情報を取得するためのセンサ部を有するが、当該センサ部は、環境情報として、ユーザの周囲にある障害物までの距離を二次元的または三次元的に取得することができる。 The device 200 has a sensor unit for acquiring environmental information around the user, and the sensor unit acquires the distance to an obstacle around the user two-dimensionally or three-dimensionally as environmental information. can do.
 上記センサ部は、一例として、赤外線デプスセンサ、超音波センサ、ミリ波レーダセンサ、LiDAR(light detection and ranging)とすることができる。 As an example, the sensor unit can be an infrared depth sensor, an ultrasonic sensor, a millimeter wave radar sensor, or a LiDAR (light detection and ranging).
 デバイス200は、ユーザの周囲の環境情報を取得するセンサ部を有するが、当該センサ部は、環境情報として、ユーザの周囲を撮像することにより撮像画像を取得することができる。 The device 200 has a sensor unit that acquires environmental information around the user, and the sensor unit can acquire an captured image by imaging the surroundings of the user as environmental information.
 上記センサ部は、一例として、単眼カメラまたはステレオカメラとすることができる。 The sensor unit can be, for example, a monocular camera or a stereo camera.
 また、本開示における情報処理装置400は、さらに、ガイド出力部450を有することができる。 Further, the information processing apparatus 400 in the present disclosure can further have a guide output unit 450.
 ガイド出力部450は、ユーザのデバイス200に対し、ユーザの位置を推定するのに必要な情報を取得するためのガイドを出力する。 The guide output unit 450 outputs a guide for acquiring the information necessary for estimating the user's position to the user's device 200.
 上述したように、一の対象物が特定されない場合や、必要な情報が不足している場合などにおいて、他の対象物の情報が取得されるよう、ユーザのデバイス200に対してガイドを出力することができる。 As described above, when one object is not specified or necessary information is insufficient, a guide is output to the user's device 200 so that the information of the other object can be acquired. be able to.
 例えば、デバイス200がイヤホンである場合には、「右の建物を〇秒見てください」「〇歩前に進んでください」といった音声ガイドをスピーカから出力することができる。 For example, if the device 200 is an earphone, a voice guide such as "Look at the building on the right for 〇 seconds" or "Please go forward 〇" can be output from the speaker.
 また、デバイス200がスマートグラスである場合には、「右の建物を〇秒見てください」「〇歩前に進んでください」といった文字ガイドを表示部に出力することができる。 If the device 200 is a smart glass, a character guide such as "Look at the building on the right for 〇 seconds" or "Please go forward 〇" can be output to the display unit.
 また、環境情報は、ユーザが視認可能な天体に関する情報とすることができる。 In addition, the environmental information can be information about celestial bodies that can be visually recognized by the user.
 このとき、解析部420および推定部430は、天測手法を用いて環境情報を解析し、かつ、ユーザの位置を推定する。 At this time, the analysis unit 420 and the estimation unit 430 analyze the environmental information using the celestial method and estimate the user's position.
 かかる天測手法は、ユーザのデバイス200(この場合はスマートグラス)のカメラにより撮像された天体(太陽、月、惑星、恒星)と、水平線(視地平)の角度を計測することによりユーザの位置を推定することができる。かかる天測手法を用いたユーザの位置の推定については既知の技術を用いることができる。 Such a celestial method measures the user's position by measuring the angle between the celestial body (sun, moon, planet, star) captured by the camera of the user's device 200 (smart glasses in this case) and the horizon (viewing horizon). Can be estimated. A known technique can be used for estimating the user's position using such a celestial method.
 また、環境情報には、ユーザの周囲の人物に関する人物情報が含まれていてもよい。 Further, the environmental information may include personal information about people around the user.
 このとき、生成部440は、人物情報を含むユーザの周囲の地図を生成する。 At this time, the generation unit 440 generates a map around the user including the person information.
 そして、情報処理装置400は、さらに、当該情報処理装置400に接続され、ユーザに関連付けられた他のユーザのデバイスまたは当該他のユーザの情報処理端末に対して、ユーザの周囲の地図を送信する送信部460を有することができる。 Then, the information processing apparatus 400 is further connected to the information processing apparatus 400 and transmits a map around the user to another user's device associated with the user or the information processing terminal of the other user. It can have a transmitter 460.
 人物情報を含む地図とは、例えば会議室内の地図である。かかる地図には、人物の存在およびユーザとの位置関係に関する情報が含まれる。 The map including person information is, for example, a map in a conference room. Such a map contains information about the existence of a person and the positional relationship with the user.
 かかる地図は、デバイス200を装着して遠隔で会議に参加するユーザに対し、あたかもその会議室にいて実際に参加しているような没入感を与えることができる。 Such a map can give a user who wears the device 200 and participates in a conference remotely as if he / she is in the conference room and actually participates in the conference.
 例えば、遠隔参加のユーザに対しても会議室内の座席が割り当てられ、当該座席の右隣の参加者の発言は、右側から聞こえるように遠隔参加のユーザのデバイス200から出力させたりすることができる。 For example, a seat in the conference room is assigned to the remote-participating user, and the remarks of the participant to the right of the seat can be output from the device 200 of the remote-participating user so as to be heard from the right side. ..
 続いて、本開示における情報処理方法の実施形態について図面を参照しながら説明する。 Subsequently, an embodiment of the information processing method in the present disclosure will be described with reference to the drawings.
 本開示における情報処理方法は、図6に示されるように、ユーザが装着または所持可能なデバイスと、デバイスと接続可能な情報処理装置とを備える情報処理システムにおける情報処理方法であって、情報処理システムが備える一又は複数のプロセッサに、取得ステップS410と、解析ステップS420と、推定ステップS430とを実行させることを特徴とする。 As shown in FIG. 6, the information processing method in the present disclosure is an information processing method in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device. It is characterized in that one or a plurality of processors included in the system execute the acquisition step S410, the analysis step S420, and the estimation step S430.
 取得ステップS410は、デバイスから送信されたユーザの周囲の環境情報を取得する。かかる取得ステップS410は、上述した取得部410により実行されることができる。取得部410の詳細については上述したとおりである。 The acquisition step S410 acquires the environment information around the user transmitted from the device. The acquisition step S410 can be executed by the acquisition unit 410 described above. The details of the acquisition unit 410 are as described above.
 解析ステップS420は、取得ステップS410において取得された環境情報を解析する。かかる解析ステップS420は、上述した解析部420により実行されることができる。解析部420の詳細については上述したとおりである。 Analysis step S420 analyzes the environmental information acquired in acquisition step S410. Such analysis step S420 can be executed by the analysis unit 420 described above. The details of the analysis unit 420 are as described above.
 推定ステップS430は、解析ステップS420において解析された結果に基づいて、デバイスを装着または所持するユーザの位置を推定する。かかる推定ステップS430は、上述した推定部430により実行されることができる。推定部430の詳細については上述したとおりである。 The estimation step S430 estimates the position of the user who wears or possesses the device based on the result analyzed in the analysis step S420. Such estimation step S430 can be executed by the estimation unit 430 described above. The details of the estimation unit 430 are as described above.
 以上の構成によれば、上述した従来技術の問題の少なくとも一部を解決又は緩和する技術的な改善を提供することができる。本開示の上記実施形態によれば、GPS機能を用いなくともユーザの位置を推定することができる。 According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the above-mentioned problems of the prior art. According to the above embodiment of the present disclosure, the position of the user can be estimated without using the GPS function.
 最後に、本開示におけるコンピュータプログラムの実施形態について図面を参照しながら説明する。 Finally, the embodiment of the computer program in the present disclosure will be described with reference to the drawings.
 本開示におけるコンピュータプログラムは、ユーザが装着または所持可能なデバイスと、デバイスと接続可能な情報処理装置とを備える情報処理システムにおいて実行されるコンピュータプログラムであって、情報処理システムが備える一又は複数のプロセッサに、取得機能と、解析機能と、推定機能とを実現させることを特徴とする。 The computer program in the present disclosure is a computer program executed in an information processing system including a device that can be worn or possessed by a user and an information processing device that can be connected to the device, and is one or a plurality of computer programs included in the information processing system. It is characterized in that the processor realizes an acquisition function, an analysis function, and an estimation function.
 取得機能は、デバイスから送信されたユーザの周囲の環境情報を取得する。 The acquisition function acquires the environment information around the user sent from the device.
 解析機能は、取得機能により取得された環境情報を解析する。 The analysis function analyzes the environmental information acquired by the acquisition function.
 推定機能は、解析機能により解析された結果に基づいて、デバイスを装着または所持するユーザの位置を推定する。 The estimation function estimates the position of the user who wears or owns the device based on the result analyzed by the analysis function.
 上記機能は、図7に示す取得回路1410、解析回路1420、推定回路1430により実現されることができる。取得回路1410、解析回路1420、推定回路1430は、それぞれ上述した取得部410、解析部420、推定部430により実現されるものとする。各部の詳細については上述したとおりである。 The above function can be realized by the acquisition circuit 1410, the analysis circuit 1420, and the estimation circuit 1430 shown in FIG. It is assumed that the acquisition circuit 1410, the analysis circuit 1420, and the estimation circuit 1430 are realized by the acquisition unit 410, the analysis unit 420, and the estimation unit 430 described above, respectively. The details of each part are as described above.
 また、上述した実施形態に係るサーバ装置又は端末装置として機能させるために、コンピュータ又は携帯電話などの情報処理装置を好適に用いることができる。このような情報処理装置は、実施形態に係るサーバ装置又は端末装置の各機能を実現する処理内容を記述したプログラムを、情報処理装置の記憶部に格納し、情報処理装置のCPUによって当該プログラムを読み出して実行させることによって実現可能である。 Further, in order to function as the server device or terminal device according to the above-described embodiment, an information processing device such as a computer or a mobile phone can be preferably used. Such an information processing device stores a program describing processing contents that realize each function of the server device or the terminal device according to the embodiment in the storage unit of the information processing device, and the CPU of the information processing device stores the program. This can be achieved by reading and executing.
 本発明のいくつかの実施形態を説明したが、これらの実施形態は、例として提示したものであり、発明の範囲を限定することは意図していない。これら新規な実施形態は、その他の様々な形態で実施されることが可能であり、発明の要旨を逸脱しない範囲で、種々の省略、置き換え、変更を行うことができる。これら実施形態やその変形は、発明の範囲や要旨に含まれるとともに、特許請求の範囲に記載された発明とその均等の範囲に含まれる。 Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof.
 また、実施形態に記載した手法は、計算機(コンピュータ)に実行させることができるプログラムとして、例えば磁気ディスク(フロッピー(登録商標)ディスク、ハードディスク等)、光ディスク(CD-ROM、DVD、MO等)、半導体メモリ(ROM、RAM、フラッシュメモリ等)等の記録媒体に格納し、また通信媒体により伝送して頒布することもできる。なお、媒体側に格納されるプログラムには、計算機に実行させるソフトウェア手段(実行プログラムのみならずテーブルやデータ構造も含む)を計算機内に構成させる設定プログラムをも含む。本装置を実現する計算機は、記録媒体に記録されたプログラムを読み込み、また場合により設定プログラムによりソフトウェア手段を構築し、このソフトウェア手段によって動作が制御されることにより上述した処理を実行する。なお、本明細書でいう記録媒体は、頒布用に限らず、計算機内部あるいはネットワークを介して接続される機器に設けられた磁気ディスクや半導体メモリ等の記憶媒体を含むものである。記憶部は、例えば主記憶装置、補助記憶装置、又はキャッシュメモリとして機能してもよい。 Further, the method described in the embodiment includes, for example, a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), as a program that can be executed by a computer (computer). It can be stored in a recording medium such as a semiconductor memory (ROM, RAM, flash memory, etc.), and can also be transmitted and distributed by a communication medium. The program stored on the medium side also includes a setting program for configuring the software means (including not only the execution program but also the table and the data structure) to be executed by the computer in the computer. A computer that realizes this device reads a program recorded on a recording medium, constructs software means by a setting program in some cases, and executes the above-mentioned processing by controlling the operation by the software means. The recording medium referred to in the present specification is not limited to distribution, and includes storage media such as magnetic disks and semiconductor memories provided in devices connected inside a computer or via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
 100 情報処理システム
 200 デバイス
 300 ユーザ端末
 400 情報処理装置
 410 取得部
 420 解析部
 430 推定部
 440 生成部
 450 ガイド出力部
 460 送信部
100 Information processing system 200 Device 300 User terminal 400 Information processing device 410 Acquisition unit 420 Analysis unit 430 Estimate unit 440 Generation unit 450 Guide output unit 460 Transmission unit

Claims (10)

  1.  ユーザが装着または所持可能なデバイスと、
     前記デバイスと接続可能な情報処理装置と、
    を備える情報処理システムであって、
     前記情報処理装置は、
      前記デバイスから送信された前記ユーザの周囲の環境情報を取得する取得部と、
      前記取得部により取得された前記環境情報を解析する解析部と、
      前記解析部により解析された結果に基づいて、前記デバイスを装着または所持する前記ユーザの位置を推定する推定部と
    を有する情報処理システム。
    Devices that users can wear or carry, and
    An information processing device that can be connected to the device and
    It is an information processing system equipped with
    The information processing device is
    An acquisition unit that acquires environmental information around the user transmitted from the device, and
    An analysis unit that analyzes the environmental information acquired by the acquisition unit, and an analysis unit.
    An information processing system including an estimation unit that estimates the position of the user who wears or possesses the device based on the result analyzed by the analysis unit.
  2.  前記環境情報は、前記ユーザの周囲の建造物に関する情報であり、
     前記情報処理システムは、さらに、
     前記解析部により解析された結果に基づいて、前記ユーザの周囲の地図を生成する生成部を有する請求項1に記載の情報処理システム。
    The environmental information is information about buildings around the user, and is
    The information processing system further
    The information processing system according to claim 1, further comprising a generation unit that generates a map around the user based on the result analyzed by the analysis unit.
  3.  前記情報処理装置は、異なる場所にいる複数のユーザが装着または所持可能な同種または異種の複数のデバイス、または、前記複数のユーザのユーザ端末とインターネットを介して接続可能なサーバ装置であり、
     前記取得部は、前記複数のデバイスから送信された前記複数のユーザの周囲の環境情報を取得し、
     前記解析部は、前記取得部により取得された前記複数のユーザの周囲の環境情報を解析し、
     前記生成部は、前記解析部により解析された結果に基づいて、前記複数のユーザの周囲の地図を生成して合成することにより広域な地図を生成することを特徴とする請求項2に記載の情報処理システム。
    The information processing device is a server device capable of connecting to a plurality of devices of the same type or different types that can be worn or possessed by a plurality of users in different locations, or user terminals of the plurality of users via the Internet.
    The acquisition unit acquires environmental information around the plurality of users transmitted from the plurality of devices, and acquires the environment information around the plurality of users.
    The analysis unit analyzes the environment information around the plurality of users acquired by the acquisition unit, and analyzes the environment information around the plurality of users.
    The second aspect of claim 2, wherein the generation unit generates a wide-area map by generating and synthesizing a map around the plurality of users based on the result analyzed by the analysis unit. Information processing system.
  4.  前記推定部および前記生成部は、SLAM(Simultaneous Localization and Mapping)手法を用いて、前記ユーザの位置を推定し、かつ、前記ユーザの周囲の地図を生成することを特徴とする請求項2または3に記載の情報処理システム。 Claim 2 or 3 characterized in that the estimation unit and the generation unit estimate the position of the user by using a SLAM (Simultaneous Localization and Mapping) method and generate a map around the user. Information processing system described in.
  5.  前記デバイスは、前記ユーザの周囲の環境情報を取得するためのセンサ部を有し、
     前記センサ部は、前記環境情報として、前記ユーザの周囲にある障害物までの距離を二次元的または三次元的に取得することを特徴とする請求項1から4のいずれか一項に記載の情報処理システム。
    The device has a sensor unit for acquiring environmental information around the user.
    The one according to any one of claims 1 to 4, wherein the sensor unit acquires the distance to an obstacle around the user two-dimensionally or three-dimensionally as the environmental information. Information processing system.
  6.  前記デバイスは、前記ユーザの周囲の環境情報を取得するセンサ部を有し、
     前記センサ部は、前記環境情報として、前記ユーザの周囲を撮像することにより撮像画像を取得することを特徴とする請求項1から4のいずれか一項に記載の情報処理システム。
    The device has a sensor unit that acquires environmental information around the user.
    The information processing system according to any one of claims 1 to 4, wherein the sensor unit acquires an captured image by imaging the surroundings of the user as the environmental information.
  7.  前記情報処理装置は、さらに、
     前記ユーザの前記デバイスに対し、前記ユーザの位置を推定するのに必要な情報を取得するためのガイドを出力するガイド出力部を有することを特徴とする請求項1から6のいずれか一項に記載の情報処理システム。
    The information processing device further
    The invention according to any one of claims 1 to 6, wherein the device of the user has a guide output unit for outputting a guide for acquiring information necessary for estimating the position of the user. The information processing system described.
  8.  前記環境情報は、前記ユーザが視認可能な天体に関する情報であり、
     前記解析部および前記推定部は、天測手法を用いて前記環境情報を解析し、かつ、前記ユーザの位置を推定することを特徴とする請求項1に記載の情報処理システム。
    The environmental information is information about a celestial body that can be visually recognized by the user.
    The information processing system according to claim 1, wherein the analysis unit and the estimation unit analyze the environmental information by using a celestial method and estimate the position of the user.
  9.  ユーザが装着または所持可能なデバイスと、
     前記デバイスと接続可能な情報処理装置と、
    を備える情報処理システムにおける情報処理方法であって、
     前記情報処理システムが備える一又は複数のプロセッサに、
     前記デバイスから送信された前記ユーザの周囲の環境情報を取得する取得ステップと、
     前記取得ステップにおいて取得された前記環境情報を解析する解析ステップと、
     前記解析ステップにおいて解析された結果に基づいて、前記デバイスを装着または所持する前記ユーザの位置を推定する推定ステップと
    を実行させる情報処理方法。
    Devices that users can wear or carry, and
    An information processing device that can be connected to the device and
    It is an information processing method in an information processing system equipped with
    For one or more processors included in the information processing system
    The acquisition step of acquiring the environment information around the user transmitted from the device, and
    An analysis step for analyzing the environmental information acquired in the acquisition step, and
    An information processing method for executing an estimation step of estimating the position of the user who wears or possesses the device based on the result analyzed in the analysis step.
  10.  ユーザが装着または所持可能なデバイスと、
     前記デバイスと接続可能な情報処理装置と、
    を備える情報処理システムにおいて実行されるコンピュータプログラムであって、
     前記情報処理システムが備える一又は複数のプロセッサに、
     前記デバイスから送信された前記ユーザの周囲の環境情報を取得する取得機能と、
     前記取得機能により取得された前記環境情報を解析する解析機能と、
     前記解析機能により解析された結果に基づいて、前記デバイスを装着または所持する前記ユーザの位置を推定する推定機能と
    を実現させるコンピュータプログラム。
    Devices that users can wear or carry, and
    An information processing device that can be connected to the device and
    A computer program that is executed in an information processing system
    For one or more processors included in the information processing system
    An acquisition function for acquiring environment information around the user transmitted from the device, and
    An analysis function that analyzes the environmental information acquired by the acquisition function, and
    A computer program that realizes an estimation function that estimates the position of the user who wears or possesses the device based on the result analyzed by the analysis function.
PCT/JP2020/032990 2020-09-01 2020-09-01 Information processing system, information processing method, and computer program WO2022049615A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/032990 WO2022049615A1 (en) 2020-09-01 2020-09-01 Information processing system, information processing method, and computer program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/032990 WO2022049615A1 (en) 2020-09-01 2020-09-01 Information processing system, information processing method, and computer program

Publications (1)

Publication Number Publication Date
WO2022049615A1 true WO2022049615A1 (en) 2022-03-10

Family

ID=80491662

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/032990 WO2022049615A1 (en) 2020-09-01 2020-09-01 Information processing system, information processing method, and computer program

Country Status (1)

Country Link
WO (1) WO2022049615A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016500885A (en) * 2012-10-31 2016-01-14 クアルコム,インコーポレイテッド System and method for merging multiple maps for computer vision based tracking
WO2017061388A1 (en) * 2015-10-09 2017-04-13 ソニー株式会社 Information processing device, position and/or orientation estimating method, and computer program
WO2019230098A1 (en) * 2018-05-30 2019-12-05 クラリオン株式会社 Information processing device
JP2020098114A (en) * 2018-12-17 2020-06-25 カシオ計算機株式会社 Self-position estimation device, self-position estimation method, and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016500885A (en) * 2012-10-31 2016-01-14 クアルコム,インコーポレイテッド System and method for merging multiple maps for computer vision based tracking
WO2017061388A1 (en) * 2015-10-09 2017-04-13 ソニー株式会社 Information processing device, position and/or orientation estimating method, and computer program
WO2019230098A1 (en) * 2018-05-30 2019-12-05 クラリオン株式会社 Information processing device
JP2020098114A (en) * 2018-12-17 2020-06-25 カシオ計算機株式会社 Self-position estimation device, self-position estimation method, and program

Similar Documents

Publication Publication Date Title
Kuriakose et al. Tools and technologies for blind and visually impaired navigation support: a review
US10511878B2 (en) System and method for providing content in autonomous vehicles based on perception dynamically determined at real-time
US8972174B2 (en) Method for providing navigation information, machine-readable storage medium, mobile terminal, and server
CN106993181B (en) More VR/AR equipment collaboration systems and Synergistic method
KR101960140B1 (en) System and method for providing augmented virtual reality content in autonomous vehicles
US8588464B2 (en) Assisting a vision-impaired user with navigation based on a 3D captured image stream
US8933931B2 (en) Distributed asynchronous localization and mapping for augmented reality
CN109658435A (en) The unmanned plane cloud for capturing and creating for video
US8526677B1 (en) Stereoscopic camera with haptic feedback for object and location detection
US11725958B2 (en) Route guidance and proximity awareness system
CN110033783A (en) The elimination and amplification based on context of acoustic signal in acoustic enviroment
US11454502B2 (en) Map feature identification using motion data and surfel data
EP3798986A1 (en) Location aware visual markers
US11270513B2 (en) System and method for attaching applications and interactions to static objects
US20200404447A1 (en) Location-based application activation
WO2022049615A1 (en) Information processing system, information processing method, and computer program
US20200334909A1 (en) Methods for guiding a user when performing a three dimensional scan and related mobile devices and computer program products
Isazade Advancement in navigation technologies and their potential for the visually impaired: a comprehensive review
JP6523353B2 (en) Terminal device and program
KR20200004135A (en) Method for providing model house virtual image based on augmented reality
JP7072311B1 (en) Movement route generation method and program of moving object, management server, management system
Hojjat Enhanced navigation systems in gps denied environments for visually impaired people: A survey
Hojjat Indoor navigation systems for blind people
KR20160023368A (en) Method for two-way communication between internet of things devices and user devices, the internet of things devices and user devices thereof
Sain Portable Monitoring and navigation Control system for helping visually impaired people

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20952355

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20952355

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP

NENP Non-entry into the national phase

Ref country code: JP