WO2014098033A1 - Dispositif portable d'aide au déplacement - Google Patents

Dispositif portable d'aide au déplacement Download PDF

Info

Publication number
WO2014098033A1
WO2014098033A1 PCT/JP2013/083633 JP2013083633W WO2014098033A1 WO 2014098033 A1 WO2014098033 A1 WO 2014098033A1 JP 2013083633 W JP2013083633 W JP 2013083633W WO 2014098033 A1 WO2014098033 A1 WO 2014098033A1
Authority
WO
WIPO (PCT)
Prior art keywords
guide
user
display
moving speed
heart rate
Prior art date
Application number
PCT/JP2013/083633
Other languages
English (en)
Japanese (ja)
Inventor
岩田治幸
Original Assignee
Iwata Haruyuki
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2012275188A external-priority patent/JP5346115B6/ja
Application filed by Iwata Haruyuki filed Critical Iwata Haruyuki
Publication of WO2014098033A1 publication Critical patent/WO2014098033A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1112—Global tracking of patients, e.g. by using GPS
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/005—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 with correlation of navigation data from several sources, e.g. map or contour matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4866—Evaluating metabolism
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813—Specially adapted to be attached to a specific body part
    • A61B5/6814—Head

Definitions

  • the present invention is an augmented reality (AR) that can be used as a pacemaker or a portable navigation system in a walking exercise.
  • AR augmented reality
  • the present invention relates to a portable mobility support device using Augmented Reality) technology.
  • the movement in this invention shall include the movement by use of a bicycle etc. besides the movement by walking (walking, jogging, etc.).
  • fat burning effect by aerobic exercise is considered to be very effective not only for diet but also for health promotion. This is because oxygen taken into the blood by aerobic exercise promotes fat burning. Moreover, it is because a virtuous cycle of further burning fat is generated by increasing muscles by continuous exercise and increasing basal metabolism.
  • aerobic exercise such as jogging and swimming, but walking is particularly popular because it can be easily tackled.
  • walking there is a risk of traffic accidents due to oversight of signals when crossing a pedestrian crossing.
  • elderly people suffer from a decline in their ability to detect danger, such as a reduction in their visual acuity, so the need for a technology that can support their movement is increasing as the population ages rapidly.
  • Patent Document 1 describes a technology related to an information communication terminal such as a mobile phone and a biological information system that can measure biological information such as a heart rate.
  • biological information that cannot be measured by the information communication terminal can be stored and managed in the information communication terminal.
  • Patent Document 2 relates to a portable biological information monitor, and in particular, a portable biological information monitor using a blood flow meter that measures information related to blood flow in a target biological tissue using scattered light from the biological tissue. The technology about is described.
  • Patent Document 3 describes a technique related to a motion measurement device that is of a wristwatch type and can measure exercise intensity and heart rate while worn on an arm. This technique measures a heart rate based on an electrocardiogram by a pair of electrodes, and the same principle can be applied to a portable terminal.
  • Patent Document 4 describes a technology related to a portable navigation system that can be carried, and in particular, a technology that provides information that can contribute to health promotion.
  • calorie consumption calculated from the heart rate can be associated with map data and displayed for each section of the road, and as a result, outdoor fitness activities can be supported more enjoyably and effectively.
  • "Which area on the map contributed to calorie consumption, how hard it was” was displayed, and was used to evaluate calorie consumption due to exercise afterwards.
  • it displays a map and does not use augmented reality technology as in the present invention.
  • Patent Document 5 describes a technique related to an annotation display system and method that can change the amount of annotation information displayed on a mobile terminal in accordance with the moving speed of the mobile terminal.
  • the amount of annotation information is changed according to the moving speed of the mobile terminal, but guides such as electronic pets and virtual persons are not displayed.
  • the present invention is a technique for changing the amount of annotation information, and the present invention of following or guiding a user by moving a guide is characterized by the technical idea of the invention (the problem to be solved, (Solution, effect).
  • Patent Document 6 includes a mobile terminal device such as a mobile phone and a route search server, and is started by the route search server.
  • the present invention relates to a navigation system that searches for an optimum guide route from a place to a destination and displays a current position and a guide route on a map on a display unit of the mobile terminal device, and provides a route guide, and in particular, a mobile terminal device.
  • a route search server for a pedestrian navigation system a technique related to a navigation system is described in which an average speed is obtained from a pedestrian walking history and automatically set as a pedestrian walking speed.
  • This technology is designed to automatically set the “walking speed” as the route search condition setting.
  • the user can adjust his / her movement speed while intuitively recognizing his / her movement speed. It wasn't a technique to make it.
  • the average speed is obtained based on the user's past walking history (log) stored in the server, and the user's walking speed is automatically set. There wasn't.
  • the guide route is displayed on the mobile terminal, and guides such as an electronic pet and a virtual person are not displayed on the mobile terminal using augmented reality technology.
  • Patent Document 7 describes a technique relating to a disaster prevention information providing system and a disaster prevention information distribution server that use augmented reality technology.
  • This technology displays disaster information and AR tags that indicate evacuation routes, and was able to provide appropriate disaster prevention information in real time to users in a small area. It is displayed with an AR tag with an arrow, and displays a guide such as an electronic pet or a virtual person. Furthermore, this guide is displayed away or close according to the user's heart rate or moving speed.
  • the present invention which allows the user to intuitively recognize the evacuation route and the optimum moving speed, is different in the characteristics of the technical idea of the invention (problems to be solved, solution means, and effects).
  • Japanese Patent No. 4119862 Japanese Patent No. 4658705 Japanese Patent No. 4822208 JP 2007-292505 A JP 2011-123807 A Japanese Patent No. 4776716 JP 2011-186681 A
  • the present invention solves the problems of the prior art, and guides the user such as an electronic pet or a virtual person using augmented reality technology, so that aerobic exercise can be enjoyed during normal times. It is an object of the present invention to provide a portable movement support apparatus that functions as a pacemaker for continuing the movement and functions as a portable navigation system for evacuation guidance when a disaster occurs.
  • a portable movement support apparatus is a portable terminal including a camera (smart phone (multifunction mobile phone) / mobile phone / PHS, tablet terminal, video transmission (Video See-Through) head-mounted display devices, portable game consoles, etc.), augmented reality (AR: Using Augmented Reality) technology, a guide (electronic pet, virtual person, etc.) for leading the user is displayed on the display of the mobile device superimposed on the image (still image or moving image) captured by the camera Display means for changing and a changing means for changing the size and position for displaying the guide, and the user can intuitively recognize his / her moving speed by moving so as to follow the guide.
  • the feature is that it can be adjusted.
  • the user can perceive as if the guide exists in the real space.
  • the position in the real space where the guide looks as if it exists is defined as “assumed position”, and the moving speed in the real space where it appears as if the guide is moving is defined as “assumed moving speed”. To do.
  • the portable terminal used in the present invention includes a display capable of displaying an image (still image or moving image) taken by a camera.
  • This display is not limited to displays such as smartphones and tablet devices, but video transmission (Video This includes displays that are worn on the head or glasses, such as See-Through) head-mounted displays. In other words, any display can be used as long as it can use augmented reality technology.
  • the user can move using a bicycle or the like, and can use it not only for walking but also for cycling and the like.
  • the guide is a virtual person, it is desirable to move it using a bicycle or the like as in the case of the user.
  • an electronic pet it is desirable to model an animal having the necessary exercise ability.
  • the guide may be a virtual animal, a real animal such as a dog, or an imaginary character.
  • the display means displays a guide such as an electronic pet or a virtual person for leading the user on the display of the portable terminal.
  • Guides can be generated in a variety of ways, from simple icons that imitate characters such as electronic pets and virtual characters, to three-dimensional computer graphics animations that enhance reality.
  • the augmented reality technique in the present invention is not a technique using markers or a technique using feature points extracted by image processing.
  • the changing means changes the size and position of the guide displayed according to biological information such as the user's heart rate or the moving speed or moving pace of the user.
  • the guide When changing according to biometric information such as the user's heart rate, for example, when the heart rate is high and the exercise load is large, the guide should be enlarged so that the position close to the user becomes the assumed position of the guide.
  • biometric information such as the user's heart rate
  • the guide When displayed at the bottom, when the heart rate is low and the exercise load is small, the guide is displayed small at the top of the display so that the position far from the user is the assumed position of the guide.
  • biological information such as blood pressure and body temperature may be used.
  • a heart rate monitor or the like for measuring the heart rate may be integrated with the portable terminal, or may be externally attached to the portable terminal, built in a wristwatch, or worn on the chest with a band, and the portable terminal. May be connected using a cable, a power-saving short-range wireless technology, or the like. Moreover, the pulse of a head can also be measured by integrating with a head-mounted display or a head-up display.
  • the user's heart rate suitable for aerobic exercise is set as the target heart rate.
  • the guide is displayed small on the top so that the position far from the user becomes the assumed position of the guide.
  • the guide is displayed largely at the center or at the bottom so that the position close to the user is the assumed position of the guide. This allows the user's heart rate to follow the guide to be maintained in the vicinity of the target heart rate.
  • the movement speed can be adjusted more intuitively than when walking while watching the heart rate displayed on a wristwatch type heart rate monitor or the like.
  • the present invention visualizes the invisible internal state such as heart rate as a number, and differs from general biofeedback that uses it for training, as a concrete presence that becomes the target of the user
  • the user's guide is presented in front of the user, the assumed position of the guide is changed according to the user's heart rate, and the user can follow the guide so that the user's heart rate can be controlled. It also has the technical significance of providing a new method.
  • the size and position of the guide display are changed according to the movement speed and movement pace of the user, for example, when the movement speed of the user is high and the exercise load is large, the position close to the user becomes the assumed position of the guide. In this way, the guide is displayed at the center or at the bottom of the display. On the contrary, when the movement speed of the user is slow and the exercise load is small, the guide is displayed small on the upper part of the display so that the position far from the user becomes the assumed position of the guide.
  • the movement speed and pace of the user is determined by GPS (Global Positioning System) or pedometer. When traveling by bicycle, this can also be detected from the number of rotations of the wheel.
  • the user can intuitively recognize whether the guide is faster or slower than the guide based on the size and position of the guide, and the user can follow his / her movement to move his / her own movement.
  • the load can be adjusted.
  • various expression methods can be added, such as slowing or moving the guide foot.
  • optical transmission Optical See-Trough head mounted display (HMD) Head-Mounted Display
  • HUD head-up display
  • HMD Optical See-Trough head mounted display
  • HUD head-up display
  • Video transparency Unlike the head-mounted display of See-Through), there is no worry that the field of view will be blocked by system trouble.
  • the portable movement support apparatus is an optical see-through head mount display (HMD: Head-Mounted Display (HUD) Head-Up Display), augmented reality (AR: Augmented Reality) technology, a display means for displaying a guide such as an electronic pet or a virtual person for guiding the user in superposition on the real space, and a change means for changing the size and position for displaying the guide
  • HMD Head-Mounted Display
  • AR Augmented Reality
  • the optical transmission type head-mounted display and head-up display can be configured in the form of glasses or goggles. It doesn't matter.
  • the display means is an electronic pet or virtual person for leading a user similar to the portable movement support apparatus according to claim 1 by superimposing the display means on a real space visible through an optically transmissive head-mounted display or head-up display. Etc. Guide is displayed.
  • the changing means for changing the size and position for displaying the guide the same means as the portable movement support apparatus according to claim 1 is employed.
  • the user can see the real space with the naked eye and can move more safely because there is no fear that the field of view is blocked by the system trouble. Moreover, since both hands become hands-free, the user can move using a bicycle or the like, and can also be used in cycling or the like.
  • the guide when the guide is displayed on the display regardless of the position / posture / orientation of the camera, it is displayed at an assumed position that cannot originally exist. It may end up. For example, when the camera is pointed at the sky, the guide may be displayed as if it is floating in the air, or when the camera is pointed at the river, the guide may be displayed as if it is present on the water. Therefore, in order to solve this problem and display a more realistic feeling as if the guide exists in the real space, first, a reasonable position where the assumed position of the guide in the real space can exist. After determining the position, it is necessary to determine the size and position that would be seen if the guide was taken in the position, posture, and orientation of the camera.
  • the portable movement support apparatus is a portable terminal such as a smartphone provided with a camera, and is augmented reality (AR: Augmented Reality) display means for displaying a guide such as an electronic pet or a virtual person for leading the user on the display of the mobile terminal superimposed on the image taken by the camera; A positional relationship between the user's position and the assumed position of the guide in the real space; a user movement speed detecting means for detecting a moving speed; a guide moving speed determining means for determining an assumed movement speed of the guide in the real space; And changing means for changing the size and position for displaying the guide, so that the user can intuitively recognize and adjust his / her moving speed by moving so as to follow the guide. It is characterized by doing so.
  • AR Augmented Reality
  • the augmented reality technology used in the portable movement support apparatus according to claim 3 is not a technology using markers or a technology using feature points extracted by image processing. This technology uses position information obtained by sensors such as Positioning System.
  • user movement speed detection means for detecting the user's movement speed includes a method of automatically detecting from the user's step count measured using a mobile terminal such as a smartphone with a pedometer function, an acceleration sensor, a geomagnetic sensor, and a gyroscope.
  • a method using various sensors such as a sensor, a method using GPS positioning, and the like can be used.
  • the guide moving speed determining means for determining the assumed moving speed in the real space of the guide the simplest method is a method in which the user can manually set in advance.
  • the user may be able to select and set the speed by operating the touch panel or the like, or the movement speed for each section on the movement route may be set as a movement plan in advance.
  • the assumed moving speed of the guide can be automatically determined based on biological information such as the user's heart rate.
  • the assumed exercise speed of the guide is reduced to reduce the exercise load of the user following the guide It can be so.
  • the assumed movement speed of the guide is increased so that the exercise load of the user following the guide can be weighted.
  • biological information such as blood pressure, body temperature, and respiratory rate.
  • the guide movement speed is slowed down to follow the guide.
  • the user's exercise load can be reduced.
  • the assumed movement speed of the guide is increased so that the exercise load of the user following the guide can be weighted.
  • the assumed moving speed of the guide can be increased or decreased based on terrain data such as a slope. For example, since the exercise load is large on an uphill, the exercise load on the user following the guide can be reduced by reducing the assumed movement speed of the guide. On the contrary, since the exercise load is small on the downhill, the exercise load of the user following the guide can be weighted by increasing the assumed moving speed of the guide.
  • the heart rate monitor may be integrated with the mobile terminal, or it may be externally attached to the mobile terminal, built into the wristwatch, or worn on the chest with a band, and connected to the mobile terminal with a cable or power-saving short distance. You may connect using radio
  • the user's heart rate suitable for aerobic exercise is set as the target heart rate.
  • the assumed moving speed of the guide is increased, and when it is larger, the assumed moving speed of the guide is decreased. This allows the user's heart rate to follow the guide to be maintained in the vicinity of the target heart rate.
  • the movement speed can be adjusted more intuitively than when walking while looking at a wristwatch type heart rate monitor.
  • the moving speed can be adjusted while confirming that the distance between the user and the guide is getting closer or closer. Instead, it can be adjusted to approach the target heart rate gently.
  • the present invention visualizes the invisible internal state such as heart rate as a number, and differs from general biofeedback that uses it for training, as a concrete presence that becomes the target of the user
  • the guide of the user is presented in front of the user, the assumed moving speed of the guide is changed according to the user's heart rate, and the user can follow the guide so that the user's heart rate can be controlled. It also has the technical significance of providing a new method of feedback.
  • the present invention when a disaster occurs, for example, by maximizing the assumed movement speed of the guide with respect to the approach of the tsunami, or by increasing or decreasing the assumed movement speed of the guide according to the physical condition of the user, Since it can support the user to move quickly and safely, it can also help to ensure safety of life and body.
  • the changing unit changes the size and position of the guide displayed based on the position / posture / azimuth of the mobile terminal and the assumed position of the guide in the real space.
  • the position of the mobile terminal is detected by using GPS.
  • the attitude of the mobile terminal is detected by using an acceleration sensor or a gyro sensor.
  • the orientation of the portable terminal is detected by using a geomagnetic sensor. Further, the accuracy can be improved by combining with an acceleration sensor. Furthermore, since the geomagnetic sensor may be affected by the surrounding magnetic field, it is conceivable to use a gyro sensor in combination.
  • the assumed position of the guide can also be determined by adding a distance obtained by integrating the assumed moving speed with time, using the initial position of the guide as a base point.
  • the initial position of the guide is set at or near the user's start position.
  • the traveling direction of the guide is made to coincide with the traveling direction of the user. When used as a portable navigation system to be described later, the traveling direction of the guide is set to a direction along the searched movement route.
  • the assumed position of the guide may be determined based on the difference between the movement speed of the user and the assumed movement speed of the guide.
  • various methods are conceivable as long as the method can intuitively recognize whether the own moving speed is faster or slower than the assumed moving speed of the guide.
  • the means for displaying the guide in the direction in which the user proceeds is as described above.
  • the guide when the guide functions as a navigator, the guide is displayed in the direction in which the user should travel along the route searched by the navigation system.
  • the size and position of the guide are changed.
  • the display means the same means as the portable movement support apparatus according to claim 1 is employed.
  • optical transmission Optical See-Trough head mounted display (HMD) Head-Mounted Display
  • HUD head-up display
  • HMD Optical See-Trough head mounted display
  • HUD head-up display
  • Video transparency Unlike the head-mounted display of See-Through), there is no worry that the field of view will be blocked by system trouble.
  • the portable movement support device is an optical see-through head mount display (HMD: Head-Mounted Display (HUD) Head-Up Display), augmented reality (AR: Augmented Reality) technology, a display means for displaying a guide such as an electronic pet or a virtual person for guiding the user in superposition on the real space, and a user movement speed detection means for detecting the movement speed of the user
  • the guide moving speed determining means for determining the assumed moving speed of the guide in the real space, and the size and position of the guide based on the positional relationship between the position of the user and the assumed position of the guide in the real space.
  • a changing means for changing the speed of the user so that the user can intuitively recognize and adjust his / her moving speed by moving so as to follow the guide.
  • the augmented reality technology in the present invention is not a technology using markers or a technology using feature points extracted by image processing.
  • This technology uses position information obtained by sensors such as Positioning System.
  • Optical See-Trough head-mounted display HMD: Head-Mounted Display (HUD: Head-Up Display)
  • Display the same device as the portable movement support apparatus according to claim 2 is adopted.
  • display means the same means as the portable movement support apparatus according to claim 2 is adopted.
  • user movement speed detection means, the guide movement speed determination means, and the change means the same means as the portable movement support device according to claim 3 is adopted.
  • the various sensors are integrated with the head-mounted display or the head-up display, or are separately carried and connected to the system by a cable or a power-saving short-range wireless technology.
  • the distance between the guide and the user can be intuitively recognized from the size and position of the guide, but for example, if the user's moving speed is slow, the guide will be far away from the shooting range of the camera. It is assumed that it will end up. In addition, when the traveling direction is changed along the guidance route, it is assumed that the camera is out of the shooting range. Furthermore, it is desirable to be able to recognize the own moving speed more intuitively for the purpose of more efficient aerobic training.
  • the portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein the display means displays a guide, and the user and the guide are displayed.
  • a lead slack amount determining means for displaying a lead to be connected and determining a slack amount of the lead based on a positional relationship between the position of the user and an assumed position in the real space of the guide; By moving while following the guide while observing the amount of looseness of the lead, the movement speed of the self can be intuitively recognized and adjusted.
  • the display means for displaying the lead connecting the user and the guide on the display of the portable terminal deforms the three-dimensional computer graphics model of the lead in real time from a method of preparing several shape models according to the slackness of the lead. Various methods can be considered.
  • the lead slack amount determining means for determining the lead slack amount can be determined by calculating the positional relationship between the user and the guide. In addition, it can also be determined by taking into consideration the lead material and stretchability. Furthermore, if you give a sense of being pulled by the guide using the vibration function by the vibration motor described later, or if you visually express the elasticity by changing the thickness of the lead etc., it will be more realistic. Can be increased.
  • the user can move while visually recognizing the moving speed of the user by looking at the amount of looseness of the lead.
  • the direction in which the guide exists can be roughly estimated using the lead.
  • the guide can be displayed again on the display of the mobile terminal by redirecting the camera of the mobile terminal in the estimated direction.
  • the lead connecting the user and a guide such as an electronic pet is displayed, and there is no guide in the shooting range of the camera and the guide is not displayed on the display, one end of the lead is always visible from the user side.
  • the distance between the user and the guide can be roughly estimated based on vibrations caused by the vibration function, lead thickness, and the like.
  • One end of the user side of the lead can be displayed as extending from the hand when a portable terminal such as a smartphone is held in the hand.
  • a portable terminal such as a smartphone
  • a controller which is located at the user's hand
  • the lead can be displayed as extending from the user's hand, or can be displayed as extending from a fixed point in the air immediately before the user.
  • a marker-type augmented reality technique can be used to recognize the position of the user with the marker and to display a lead connecting the guide and the guide on the head-mounted display. Then, by directing the mobile terminal in the direction in which the lead extends, the guide easily enters the shooting range of the camera and is displayed on the display.
  • the portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein the object in the image photographed by the camera is recognized and recognized.
  • the guide is responsive to an object so that the voice and movement of the guide change. It is assumed that the portable movement support apparatus according to claim 6 is provided with a camera.
  • Image recognition is performed by first correcting noise removal, edge enhancement, enlargement / reduction, rotation, etc. on the captured digital image, extracting the features, and then performing pattern matching with the standard pattern on the extracted feature patterns. Do. In order to make the guide react to a moving object, it is effective to perform feature extraction using a difference image between frames.
  • guides such as electronic pets and virtual people can display the situation where they are interested in the flowers on the roadside and stop, and users can also walk while enjoying the surrounding scenery and seasonal changes. It becomes like this.
  • a portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, further comprising a heart rate monitor, wherein the change means measures the user with the heart rate monitor.
  • the size and position of the guide display can be changed according to the heart rate.
  • the heart rate monitor not only one integrated with a mobile terminal such as a smartphone but also one built in a wristband or a band attached to the chest can be used. In this case, it is assumed that the system is connected to the system by a cable or power-saving short-range wireless technology. Also, the heart rate monitor can be held separately, and any form can be used as long as it can measure the heart rate and transmit the measurement result to the system. In the case of a head-mounted display or a head-up display, the pulse of the head can be measured by a heart rate meter (pulse meter) configured integrally therewith.
  • a heart rate meter pulse meter
  • an optically transmissive head-mounted display or a head-up display the user can move while looking forward, so that he or she can notice a person or a car located in front.
  • a mobile terminal such as a smartphone
  • there is no danger of obstructing the field of view because an actual image is displayed on the display by augmented reality technology.
  • a person or a car located in front cannot be noticed, resulting in danger.
  • a portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein an object detection sensor such as an infrared sensor, an ultrasonic sensor, or a millimeter wave radar sensor is used.
  • the object detection sensor detects a person or a car positioned in front of the user, and a guide reacts to the detected person or the car so that the voice or movement of the guide changes.
  • the user can see a real image projected by augmented reality technology, so that the traffic signal at the pedestrian crossing can be identified.
  • augmented reality technology a real image projected by augmented reality technology
  • the portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein the estimated position of the guide is matched with the map information, or a traffic signal or the like.
  • the guide is temporarily stopped in front of a pedestrian crossing by image recognition.
  • the necessity of the temporary stop is determined by comparing the assumed position in the real space of the guide with the map information. At this time, the guide stops before the pedestrian crossing with sufficient time to alert the user. When a virtual person is displayed as a guide, the user can move his hand sideways as if to stop the user. Furthermore, if the vibration function of the portable terminal is used in combination, it is possible to call attention more effectively.
  • Image recognition recognizes that the traffic signal for pedestrians has stopped, recognizes the traffic of cars and the presence of roads. Moreover, the collation accuracy with map information can also be improved. Furthermore, it is possible to identify the fact that the traffic signal for pedestrians is in the advanced state by image recognition, and to prompt the start after the temporary stop. However, there is a risk of misrecognition, so it is desirable to always set a temporary stop before crossing the road.
  • the guide In addition to being able to move forward while looking forward with augmented reality technology without being blocked by the mobile device, the guide pauses in front of the pedestrian crossing to alert and stop the user. So it will help prevent accidents when crossing the road.
  • a portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein other data communication such as infrared communication or short-range wireless communication is used.
  • Information on the assumed position information of the guide leading the user in the real space, information on the form of the guide, and the like are acquired, and the guide leading the other user can be displayed.
  • Information about the guide leading the other user is acquired and displayed on the display of the user's portable movement support apparatus as if it exists at the assumed position in the real space.
  • Information regarding the assumed position of the guide in the real space and the type / form / direction of the guide is shared with the other users.
  • the users of the portable movement support apparatus can share information about the guide that leads them and communicate via the augmented reality space.
  • the enjoyment of a walking exercise or the like that tends to be monotonous can be increased.
  • the portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, and acquires information related to an evacuation route at the time of disaster using data communication.
  • the guide can guide the user according to the information on the evacuation route.
  • the evacuation route searches for the route by the navigation system or acquires the latest information by data communication. Then, a guide is displayed to guide and guide the user along the evacuation route. The guide is moved as fast as possible in consideration of the moving speed and exercise load of the user.
  • the latest evacuation route can be evacuated at an optimum speed.
  • the portable movement support apparatus is characterized in that, in the portable movement support apparatus according to claim 5, the voice and movement of the guide change according to the amount of looseness of the lead. To do.
  • the voice or movement of the guide is changed only when the lead is in tension, or is changed stepwise according to the degree of tension of the lead.
  • the portable movement support apparatus is the portable movement support apparatus according to claim 5, wherein the vibration motor is used to allow the user to recognize the state where the lead is in tension.
  • the vibration of the vibration motor is made to vibrate only when the lead is in tension, or is changed stepwise depending on the degree of tension of the lead.
  • a portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, comprising stereo headphones or earphones, and the user's voice is guided by a stereo sound.
  • the user can intuitively recognize the direction of the assumed position of the guide in the real space.
  • a bone conduction speaker or a super directional speaker is used as a stereo headphone or earphone so that the surrounding sound can be heard simultaneously.
  • these speakers can be provided in the frame part to be put on the ear.
  • the voice of the guide is generated electronically.
  • the camera can be easily pointed in the direction in which the voice of the guide can be heard, that is, in the direction of the assumed position of the guide.
  • a portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein the guide position in advance is compared with map information in advance. The guide is able to guide the user to the specified destination.
  • the assumed moving speed of the guide that guides the user along the searched route is presented in real time and intuitively.
  • the assumed travel speed of the guide is determined based on the travel speed of the user, biological information such as the user's heart rate, the road gradient at the current position of the user, the travel plan, and the like.
  • the portable movement support apparatus is the portable movement support apparatus according to any one of claims 1 to 4, wherein the changing means guides according to a user's calorie intake and exercise amount. The size and position of the display can be changed.
  • the user directly inputs the daily calorie value or by shooting the actual meal eaten by the camera and processing the image, The calorie intake is calculated automatically. And the daily calorie intake is accumulated and stored, and when the calorie intake is excessive, the assumed position of the guide in the portable movement support device according to claim 1 or 2 is farther than usual. Thus, the assumed movement speed of the guide in the portable movement support apparatus according to claim 3 or 4 is increased. On the other hand, when the calorie intake is small, the assumed position of the guide in the portable movement support apparatus according to claim 1 or 2 is set closer to the normal position, and according to claim 3 or claim 4. The assumed movement speed of the guide in the portable movement support apparatus is reduced.
  • the user inputs the daily exercise amount directly by operating a touch panel or the like, or automatically detects the number of steps and the amount of exercise that the user has walked by commuting. And these daily exercise amounts are accumulated and stored, and when exercise is insufficient, the assumed position of the guide in the portable movement support device according to claim 1 or 2 is made farther than usual, The assumed movement speed of the guide in the portable movement support apparatus according to claim 3 or 4 is increased. On the other hand, when the amount of exercise is sufficient, the assumed position of the guide in the portable movement support apparatus according to claim 1 or 2 is set closer than usual, and claim 3 or claim 4 is provided. The assumed movement speed of the guide in the portable movement support apparatus described in (1) is reduced.
  • the portable movement support apparatus according to claim 17 is the portable movement support apparatus according to any one of claims 1 to 4, wherein the body shape of the guide changes according to the calorie intake and exercise amount of the user. It was made to do.
  • the user's caloric intake and exercise amount are obtained by the same method as in the sixteenth aspect.
  • To change the body shape of the guide it is possible to perform complicated calculations based on the actual caloric intake and exercise amount of the actual animal, but the simplest method is proportional to the caloric intake. It is a method of making it fat little by little, and making it thin gradually in proportion to the amount of exercise.
  • the body shape of the electronic pet reflects the daily amount of meals and exercise of the user.
  • the user By looking at the body shape of the electronic pet, the user has an opportunity to review their lifestyles objectively. You will be able to pay attention to excessive calories and exercise.
  • a program is necessary to execute a series of processes necessary for the mobile movement support apparatus.
  • the program according to claim 18 is executed on an augmented reality (AR: AR) in a mobile terminal such as a smartphone provided with a camera.
  • AR Augmented Reality
  • the computer For causing the computer to execute change processing for changing the size and position to be displayed so that the user can intuitively recognize and adjust his / her movement speed by moving so as to follow the guide. It is a program.
  • the program according to claim 19 is an optical transmission (Optical transmission).
  • Optical transmission See-Trough head mounted display (HMD) Head-Mounted Display (HUD) Augmented reality (AR) on a terminal that is made up of Head-Up Display Using Augmented Reality) technology, display processing for displaying guides such as electronic pets and virtual people to guide the user overlaid in real space, and change processing for changing the size and position for displaying the guides
  • HMD head mounted display
  • HUD Head-Mounted Display
  • AR Augmented reality
  • This is a program for causing a computer to execute so that the user can intuitively recognize and adjust his / her moving speed by moving so as to follow the guide.
  • the program according to claim 20 is an augmented reality (AR: AR) in a portable terminal such as a smartphone provided with a camera.
  • Augmented Reality a display process for displaying a guide such as an electronic pet or a virtual person for leading the user on the display of the mobile terminal superimposed on the image captured by the camera; Positional relationship between the user movement speed detection process for detecting the movement speed, the guide movement speed determination process for determining the assumed movement speed of the guide in the real space, and the position of the user and the assumed position of the guide in the real space
  • the user can intuitively recognize and adjust his / her movement speed by moving the change process for changing the size and position of the guide so as to follow the guide.
  • the program according to claim 21 is an optical transmission (Optical transmission).
  • the guide that guides and guides the user can intuitively inform the user of danger at an intersection or the like, which can contribute to traffic safety. In particular, it is effective in preventing signal oversight due to a reduction in visual acuity such as the elderly.
  • FIG. 1 is a block diagram illustrating an example of a hardware configuration of a portable movement support apparatus.
  • FIG. 2 is an explanatory diagram showing an example of display of a guide (a virtual person at a short distance).
  • FIG. 3 is an explanatory diagram illustrating an example of display of a guide (a virtual person at a long distance).
  • FIG. 4 is an explanatory diagram showing an example of a display of a guide (an electronic pet stopped before crossing a pedestrian crossing).
  • FIG. 5 is an explanatory diagram illustrating an example of display of a guide (electronic pet crossing a pedestrian crossing).
  • FIG. 6 is an explanatory diagram showing an example of a display in a state where the lead connecting the guide (electronic pet walking on the sidewalk) is loose.
  • FIG. 1 is a block diagram illustrating an example of a hardware configuration of a portable movement support apparatus.
  • FIG. 2 is an explanatory diagram showing an example of display of a guide (a virtual person at a short distance).
  • FIG. 7 is an explanatory diagram showing an example of a display in a state where the lead connecting the guide (electronic pet walking on the sidewalk) is in tension.
  • FIG. 8 is an explanatory diagram showing an example of a display in a state where the lead connecting the guide (electronic pet walking on the sidewalk) is pulled and extended.
  • FIG. 9 is an explanatory diagram illustrating an example of a state where the guide (electronic pet walking on the sidewalk) is out of the shooting range of the camera and is no longer displayed on the display.
  • FIG. 10 is an explanatory diagram illustrating an example of a state where a guide (an electronic pet walking on a sidewalk) is displayed again by changing the direction of the camera depending on the lead.
  • FIG. 11 is an explanatory diagram illustrating an example of a state in which a guide (an electronic pet walking on a sidewalk) reacts to a flower blooming on a roadside.
  • FIG. 12 is an explanatory diagram showing an example of a state in which the guide (electronic pet walking on the sidewalk) is reacting to the guide (electronic pet) leading other users.
  • FIG. 13 is an explanatory diagram showing an example of display of a guide (a virtual person at a short distance) when an optical transmission type head mounted display is used.
  • FIG. 14 is a flowchart illustrating an example of a processing procedure executed on the portable movement support apparatus.
  • FIG. 1 is a block diagram schematically illustrating an example of the most basic hardware configuration of the portable movement support apparatus.
  • the CPU 7 loads and executes a control program stored in a ROM (Read-Only Memory) 4 using a RAM (Random-Access Memory) 5 as a work area.
  • User interface (User Interface) 1 is composed of a touch panel, a remote control switch, a voice recognition device, and the like, and is used for initial setting, activation / termination, and the like of the application.
  • a camera (Camera) 2 is a digital system, and a guide such as a virtual person or an electronic pet is superimposed on a real image captured by the camera (Camera) 2 and displayed on a display 6 using augmented reality technology.
  • an optically transmissive head-mounted display or head-up display is used as in the portable movement support apparatus according to claim 2 or 4
  • a guide such as a virtual person or an electronic pet is provided in the user's field of view.
  • the images are superimposed and displayed on the display 6.
  • the position is detected by the GPS 3, and the acceleration sensor (Accelerometer) 10 and the gyro sensor (Gyro
  • the posture is detected by a sensor 11 and a magnetic sensor (magnetic) Field sensor) 12 detects the orientation.
  • the storage 8 stores data related to guides such as virtual persons and electronic pets, data related to standard patterns used for image recognition, map data, and the like. It is also possible to save the route searched by the navigation system, the data related to the moved route, and the like.
  • Heart rate (Heart rate monitor) 9 is used to determine the assumed position of the guide. When the user's heart rate is higher than the target heart rate, the guide is displayed closer, and when it is lower, the guide is displayed far away. . As a result, when the guide is displayed far away, the user raises the walking pace to catch up with the guide, and as a result, the heart rate increases. On the contrary, when the guide is displayed in front of you, the heart rate decreases as a result of lowering the walking pace without hitting it.
  • the user's heart rate can be adjusted in the vicinity of the target heart rate.
  • the heart rate monitor 9 is used to determine the assumed movement speed, and the user If the heart rate of the guide is higher than the target heart rate, the assumed moving speed of the guide is decelerated, and if it is lower, the assumed moving speed of the guide is accelerated.
  • FIG. 1 shows an example of the most basic hardware configuration.
  • a data communication network like the portable movement support apparatus according to claim 10 or 11
  • a network interface is used.
  • Add necessary configuration such as. Data communication makes it possible to share information about guides with other users.
  • FIG. 2 is an explanatory diagram illustrating an example of a display of a guide (virtual person) at a short distance.
  • a guide virtual person at a short distance
  • FIG. 2 is an explanatory diagram illustrating an example of a display of a guide (virtual person) at a short distance.
  • the smartphone 13 provided with a camera
  • an image is captured by the camera on the display 14 of the smartphone 13 using augmented reality technology.
  • a state is shown in which a guide (virtual person at a short distance) 16 representing a virtual person leading the user 15 is displayed superimposed on a real image in front of the user 15.
  • the guide is stopped in front of the pedestrian crossing by comparing the assumed position with the map information and recognizing the image when the traffic signal for pedestrian is stopped.
  • an automobile that travels is detected by an object detection sensor such as an infrared sensor, an ultrasonic sensor, or a millimeter wave radar sensor, and a voice reacts to the detected automobile so that voice and movement change.
  • the display means of the present invention uses the former.
  • the guide guides the user along the movement path in advance, and the guide leads the user along the movement direction selected by the user without setting the movement path in advance. There is.
  • the position of the guide is determined based on the position of the user. Specifically, when the user's moving speed is delayed compared to the assumed moving speed of the guide, the guide is displayed as if it is at a long distance, and when it is moving, the guide is displayed at a short distance. Display as it exists. This display method is intuitive and easy to understand, and is effective in walking when deciding a movement route in advance and evacuation guidance at the time of disaster.
  • the traveling direction of the user 15 is detected by a method of averaging the directions detected by combining the geomagnetic sensor and the acceleration sensor, a method of obtaining the direction from the coordinates of two points measured by GPS, or a method of combining these methods. .
  • the moving speed of the user 15 is detected using the GPS 3 or the acceleration sensor 10.
  • position information of the user 15 that can be determined by the GPS 3 mounted on the smartphone 13 is used.
  • the moving speed is detected by locating the self-position of the user 15 at two points at a certain time interval by the GPS 3 and dividing the distance between the two points by the certain time.
  • the pedometer function of the smartphone 13 is used to multiply the step number of the user 15 obtained by the installed acceleration sensor by the step length of the user 15 input in advance. By detecting the moving speed. In order to improve the detection accuracy, it is conceivable to use the gyro sensor 11 in combination.
  • a method of setting a speed programmed in advance or a method of setting a speed determined based on the heart rate of the user 15 or the like is used. Specifically, a method of setting a constant speed in advance, a method of automatically determining from a gradient distribution on a moving path using map information, a method of increasing or decreasing the moving speed of the user 15 according to the heart rate, or The assumed moving speed of the guide is determined by a method combining them.
  • the changing means for changing the size and position of the guide 16 changes the size and position at which the guide 16 is displayed based on the position / posture / orientation of the mobile terminal 13 and the assumed position of the guide 16 in the real space.
  • the position of the mobile terminal 13 is detected by using GPS.
  • the posture of the mobile terminal 13 is detected by using an acceleration sensor or a gyro sensor.
  • the orientation of the mobile terminal 13 is detected by using a geomagnetic sensor. Further, the accuracy can be improved by combining with an acceleration sensor. Furthermore, since the geomagnetic sensor may be affected by the surrounding magnetic field, it is conceivable to use a gyro sensor in combination.
  • the assumed position of the guide 16 is determined by adding the distance obtained by time integration of the assumed movement speed with the initial position of the guide as a base point.
  • the initial guide position is set to the user's start position.
  • the traveling direction of the guide is set along the searched movement route.
  • FIG. 3 is an explanatory diagram showing an example of the display of a guide (a virtual person at a long distance).
  • the guide resumes moving forward after the traffic signal changes to advance, and before the pedestrian crossing.
  • the assumed movement speed of the guide is increased, and as a result, the guide is displayed so as to exist at a position away from the user.
  • the size and position for displaying the guide (virtual person at a long distance) 17 are determined based on the position / posture / azimuth of the mobile terminal 13 and the assumed position of the guide (virtual person at a long distance) 17 in the real space.
  • FIG. 4 is an explanatory diagram showing an example of the display of a guide (an electronic pet stopped before crossing a pedestrian crossing), and a user 15 together with a guide (an electronic pet stopped before a crosswalk) 18. And a lead 19 (a slack state) 19 connecting the guide 18 (an electronic pet stopped before crossing the pedestrian crossing) 18 is displayed.
  • a lead 19 (a slack state) 19 connecting the guide 18 (an electronic pet stopped before crossing the pedestrian crossing) 18 is displayed.
  • One end on the user side of the lead (sagging state) 19 is in the center of the lowermost part of the display 14 and is displayed as if extending from the hand of the user 15 holding the mobile terminal.
  • FIG. 5 is an explanatory view showing an example of a display of a guide (an electronic pet crossing a pedestrian crossing). Following the state of FIG. To increase the user's heart rate, which was low due to being stopped before the sidewalk, the guide's estimated speed of movement increases, and as a result, the guide appears to be far away from the user .
  • the lead (tensioned state) 21 connecting the user 15 and the guide (electronic pet crossing the pedestrian crossing) 20 is displayed thinly in a straight line or the like, as if the guide is tensioned by pulling the user 15. indicate. At this time, if the vibration function of the portable terminal 13 is used, the user 15 can experience the tension state of the lead in a tactile sense.
  • the direction in which the guide is present can be roughly estimated by using the lead even when the guide is out of the shooting range of the camera.
  • the display of a series of states in which the guide can be displayed again on the display of the portable terminal by redirecting the camera in the estimated direction will be described.
  • FIG. 6 is an explanatory view showing an example of a display in which the lead connecting the guide (electronic pet walking on the sidewalk) is slack, and the moving speed of the user 15 is the guide (electronic pet walking on the sidewalk). 22 is the same or faster than the assumed moving speed.
  • FIG. 7 is an explanatory diagram showing an example of a display in a state where the lead connecting the guide (electronic pet walking on the sidewalk) is in tension, and the assumed moving speed of the guide (electronic pet walking on the sidewalk) 22
  • the guide has moved away from the user due to the increase in the speed or the movement speed of the user has decreased, and the lead (strained state) 21 is in tension.
  • FIG. 8 is an explanatory view showing an example of a display in which the lead connecting the guide (electronic pet walking on the sidewalk) is pulled and extended, and further, the lead (pulling) is pulled by moving the guide away from the user.
  • the lead connecting the guide electroactive polymer
  • the lead (pulling) is pulled by moving the guide away from the user.
  • Part of the head of the guide 22 (electronic pet walking on the sidewalk) 22 is out of the shooting range of the camera and cannot be displayed on the display 14.
  • FIG. 9 is an explanatory view showing an example of a state in which the guide (electronic pet walking on the sidewalk) is out of the shooting range of the camera and is no longer displayed on the display.
  • the guide display out of the shooting range of the camera
  • Electronic pet 24 that is no longer displayed on the display 14 can no longer be displayed on the display 14.
  • the lead a state in which the lead is pulled to the left front and a part is not displayed on the display
  • 25 one end on the user side is fixed to the center of the lowermost part of the display 14, so It can be estimated that it exists.
  • FIG. 10 is an explanatory diagram illustrating an example of a state where a guide (an electronic pet walking on a sidewalk) is displayed again by changing the direction of the camera depending on the lead.
  • the guide (electronic pet that has been displayed again on the display) 26 is connected to the user 15 by a lead (a state in which the entire display is again displayed on the display) 27 and can guide the user 15 in a direction to proceed. .
  • FIG. 11 is an explanatory diagram illustrating an example of a state in which a guide (an electronic pet walking on a sidewalk) reacts to a flower blooming on a roadside.
  • a flower 28 on the roadside photographed by the camera is recognized as an image, and a preprogrammed action 29 (electronic pet reacting to the flower blooming on the roadside) 29 is performed.
  • the position of the recognition target in the real space can be estimated from the position / posture / orientation of the mobile terminal. This makes it possible to express a more realistic operation based on the positional relationship between the estimated position of the recognition target and the assumed position of the guide.
  • a guide 29 an electronic pet reacting to a flower blooming on the roadside
  • a guide 29 can approach the flower 28 blooming on the roadside and express an action of smelling the nose.
  • FIG. 12 is an explanatory diagram showing an example of a state in which the guide (electronic pet walking on the sidewalk) is reacting to the guide (electronic pet) leading other users.
  • data communication such as infrared communication or short-range wireless communication
  • information on the guide (electronic pet) 31 leading other users 30 is acquired, as if it exists at the assumed position in the real space, It is displayed on the display 14 of the portable movement support apparatus of the user 15.
  • the guide the electron reacting to the guide (electronic pet) leading other users
  • the operation of the pet) 32 can be displayed.
  • FIG. 13 is an explanatory diagram showing an example of the display of the guide (virtual person at a short distance) 16 when the optical transmission type head-mounted display 33 is used. Glasses with a pulse meter. It also has various sensors built-in. A guide (a virtual person at a short distance) 16 is displayed as if it actually exists, superimposed on the real world seen through the glasses. The pulse of the user's head is measured, and the guide 16 is moved away when it is lower than the target heart rate, and is approached when it is higher. When the user follows the guide 16 and walks, the user's exercise load changes, and the heart rate (pulse rate) approaches the target heart rate.
  • the user's exercise load changes, and the heart rate (pulse rate) approaches the target heart rate.
  • the GPS when the GPS is provided, the user's own position is measured, and the guide is estimated based on the assumed position of the guide estimated based on the measured position, and the position / posture / orientation of the optical transmission type head-mounted display 33.
  • the size and position for displaying 16 can be determined. As a result, it is possible to prevent the guide from being displayed at a position where it cannot exist in the air or on the water, so that more realistic display is possible.
  • FIG. 14 is a flowchart illustrating an example of a basic processing flow of the portable movement support apparatus.
  • the position (at the user's initial position and the initial assumed position of the guide is in the vicinity thereof), posture, and orientation are detected (S1).
  • the position / size and the like for displaying the guide on the display are determined (S2), and the guide is displayed on the display so as to be superimposed on the actual image (S3).
  • the position and moving speed of the user are detected (S4).
  • the user's heart rate (H) is detected (S5).
  • H> target heart rate is determined (S6). If the result of S6 is YES, the assumed moving speed of the guide is decreased (S7). If the result of S6 is NO, the assumed moving speed of the guide is increased. (S8).
  • the estimated position of the guide is calculated and changed by using a value obtained by integrating the estimated moving speed of the guide with time (S9).
  • the guide moves in a direction along the searched route.
  • the position / posture / orientation of the mobile terminal is detected (S10), and the position / size, etc., for displaying the guide is changed based on the positional relationship between the user's position and the assumed position of the guide (S11).
  • the guide is redisplayed on the display so as to be superimposed on the video (real space) (S12).
  • AR augmented reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Theoretical Computer Science (AREA)
  • Remote Sensing (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physiology (AREA)
  • Cardiology (AREA)
  • Software Systems (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Automation & Control Theory (AREA)
  • Dentistry (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

Dispositif portable d'aide au déplacement fonctionnant comme un régulateur d'allure pour la marche ou un système portable de navigation en affichant un guide servant à orienter et à guider un utilisateur sur un affichage à l'aide d'une technologie de réalité augmentée (AR). Un terminal portable tel qu'un ordiphone ou un terminal composé d'un afficheur facial du type à transmission optique, etc., comporte: un moyen d'affichage servant à afficher un guide tel qu'un animal électronique de compagnie tout en superposant le guide à un espace réel à l'aide d'une technologie de réalité augmentée; un moyen de détection de la vitesse de déplacement de l'utilisateur; un moyen de détermination de la vitesse de déplacement du guide servant à déterminer la vitesse de déplacement supposée du guide en fonction d'un rythme cardiaque, etc.; et un moyen de modification servant à modifier la taille d'affichage et la position du guide, rendant ainsi possible l'identification et l'adaptation par l'utilisateur de sa propre vitesse de déplacement en suivant le guide.
PCT/JP2013/083633 2012-12-17 2013-12-16 Dispositif portable d'aide au déplacement WO2014098033A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012275188A JP5346115B6 (ja) 2012-12-17 携帯型移動支援装置
JP2012-275188 2012-12-17

Publications (1)

Publication Number Publication Date
WO2014098033A1 true WO2014098033A1 (fr) 2014-06-26

Family

ID=49764870

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/083633 WO2014098033A1 (fr) 2012-12-17 2013-12-16 Dispositif portable d'aide au déplacement

Country Status (1)

Country Link
WO (1) WO2014098033A1 (fr)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331681A (zh) * 2016-08-22 2017-01-11 石惠卿 一种头戴显示器的图像显示方法
WO2017094313A1 (fr) * 2015-12-02 2017-06-08 シャープ株式会社 Dispositif, procédé et programme de génération d'image vidéo
EP3213673A1 (fr) * 2016-03-01 2017-09-06 Shanghai Xiaoyi Technology Co., Ltd. Lunette de sport intelligente
JP2018051138A (ja) * 2016-09-30 2018-04-05 オムロン株式会社 運動インストラクション装置、システム、方法およびプログラム
CN109300270A (zh) * 2018-11-21 2019-02-01 重庆由创机电科技有限公司 智能楼宇综合逃生指引系统及其控制方法
JP2019197499A (ja) * 2018-05-11 2019-11-14 株式会社スクウェア・エニックス プログラム、記録媒体、拡張現実感提示装置及び拡張現実感提示方法
JP2020095735A (ja) * 2020-02-25 2020-06-18 株式会社スクウェア・エニックス プログラム、記録媒体、拡張現実感提示装置及び拡張現実感提示方法
JPWO2020255992A1 (fr) * 2019-06-18 2020-12-24
CN112146649A (zh) * 2020-09-23 2020-12-29 北京市商汤科技开发有限公司 Ar场景下的导航方法、装置、计算机设备及存储介质
CN113434038A (zh) * 2021-05-31 2021-09-24 广东工业大学 基于增强现实的视障儿童定向行走训练辅助系统的控制方法
WO2022196199A1 (fr) * 2021-03-16 2022-09-22 ソニーグループ株式会社 Dispositif de traitement d'informations, procédé de traitement d'informations et programme
WO2023282049A1 (fr) * 2021-07-07 2023-01-12 ソニーグループ株式会社 Dispositif de traitement d'informations, procédé de traitement d'informations, système de traitement d'informations, programme d'ordinateur et support d'enregistrement
US11854130B2 (en) 2014-01-24 2023-12-26 Interdigital Vc Holdings, Inc. Methods, apparatus, systems, devices, and computer program products for augmenting reality in connection with real world places

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH114820A (ja) * 1997-06-18 1999-01-12 Ee D K:Kk 健康管理装置
JP2001141495A (ja) * 1999-11-10 2001-05-25 Matsushita Electric Ind Co Ltd ナビゲーション装置
JP2005127995A (ja) * 2003-09-30 2005-05-19 Mazda Motor Corp 経路誘導装置、経路誘導方法及び経路誘導プログラム
WO2012090325A1 (fr) * 2010-12-28 2012-07-05 トヨタ自動車株式会社 Appareil de navigation
JP2012155654A (ja) * 2011-01-28 2012-08-16 Sony Corp 情報処理装置、報知方法及びプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH114820A (ja) * 1997-06-18 1999-01-12 Ee D K:Kk 健康管理装置
JP2001141495A (ja) * 1999-11-10 2001-05-25 Matsushita Electric Ind Co Ltd ナビゲーション装置
JP2005127995A (ja) * 2003-09-30 2005-05-19 Mazda Motor Corp 経路誘導装置、経路誘導方法及び経路誘導プログラム
WO2012090325A1 (fr) * 2010-12-28 2012-07-05 トヨタ自動車株式会社 Appareil de navigation
JP2012155654A (ja) * 2011-01-28 2012-08-16 Sony Corp 情報処理装置、報知方法及びプログラム

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11854130B2 (en) 2014-01-24 2023-12-26 Interdigital Vc Holdings, Inc. Methods, apparatus, systems, devices, and computer program products for augmenting reality in connection with real world places
WO2017094313A1 (fr) * 2015-12-02 2017-06-08 シャープ株式会社 Dispositif, procédé et programme de génération d'image vidéo
EP3213673A1 (fr) * 2016-03-01 2017-09-06 Shanghai Xiaoyi Technology Co., Ltd. Lunette de sport intelligente
CN106331681A (zh) * 2016-08-22 2017-01-11 石惠卿 一种头戴显示器的图像显示方法
JP2018051138A (ja) * 2016-09-30 2018-04-05 オムロン株式会社 運動インストラクション装置、システム、方法およびプログラム
CN112106114A (zh) * 2018-05-11 2020-12-18 史克威尔·艾尼克斯有限公司 程序、记录介质、增强现实感呈现装置及增强现实感呈现方法
JP2019197499A (ja) * 2018-05-11 2019-11-14 株式会社スクウェア・エニックス プログラム、記録媒体、拡張現実感提示装置及び拡張現実感提示方法
WO2019216419A1 (fr) * 2018-05-11 2019-11-14 株式会社スクウェア・エニックス Programme, support d'enregistrement, dispositif de présentation de réalité augmentée et procédé de présentation de réalité augmentée
CN109300270A (zh) * 2018-11-21 2019-02-01 重庆由创机电科技有限公司 智能楼宇综合逃生指引系统及其控制方法
JPWO2020255992A1 (fr) * 2019-06-18 2020-12-24
EP3989192A4 (fr) * 2019-06-18 2022-08-10 NEC Corporation Système de guidage d'évacuation, dispositif de guidage d'évacuation, procédé de guidage d'évacuation et programme de guidage d'évacuation
JP7384202B2 (ja) 2019-06-18 2023-11-21 日本電気株式会社 避難誘導システム、避難誘導装置、避難誘導方法及び避難誘導プログラム
JP7090116B2 (ja) 2020-02-25 2022-06-23 株式会社スクウェア・エニックス プログラム、記録媒体、拡張現実感提示装置及び拡張現実感提示方法
JP2020095735A (ja) * 2020-02-25 2020-06-18 株式会社スクウェア・エニックス プログラム、記録媒体、拡張現実感提示装置及び拡張現実感提示方法
CN112146649A (zh) * 2020-09-23 2020-12-29 北京市商汤科技开发有限公司 Ar场景下的导航方法、装置、计算机设备及存储介质
WO2022196199A1 (fr) * 2021-03-16 2022-09-22 ソニーグループ株式会社 Dispositif de traitement d'informations, procédé de traitement d'informations et programme
CN113434038A (zh) * 2021-05-31 2021-09-24 广东工业大学 基于增强现实的视障儿童定向行走训练辅助系统的控制方法
WO2023282049A1 (fr) * 2021-07-07 2023-01-12 ソニーグループ株式会社 Dispositif de traitement d'informations, procédé de traitement d'informations, système de traitement d'informations, programme d'ordinateur et support d'enregistrement

Also Published As

Publication number Publication date
JP5346115B1 (ja) 2013-11-20
JP2014120006A (ja) 2014-06-30

Similar Documents

Publication Publication Date Title
WO2014098033A1 (fr) Dispositif portable d'aide au déplacement
US10725556B2 (en) Wearable glasses and method of providing content using the same
US11748959B2 (en) Device for simulating a virtual fitness partner and methods for use therewith
CN106502388B (zh) 一种互动式运动方法及头戴式智能设备
CN108428473B (zh) 基于装置确定的信息改变运动路线
JP6764879B2 (ja) ナビゲーション装置および方法
US11037532B2 (en) Information processing apparatus and information processing method
CN112204640B (zh) 针对视觉受损者的辅助设备
US20180356636A1 (en) Information processing apparatus, information processing method, and program
Marshall et al. Interaction in motion: designing truly mobile interaction
EP3723391A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
KR20160016540A (ko) 웨어러블 글래스 및 웨어러블 글래스의 컨텐트 제공 방법
US20170352226A1 (en) Information processing device, information processing method, and program
Chatterjee et al. Classification of wearable computing: A survey of electronic assistive technology and future design
US10636261B2 (en) Intuitive tactile devices, systems and methods
JPWO2017043101A1 (ja) 情報処理装置、情報処理方法及びプログラム
EP3007088A1 (fr) Modification d'un plan d'exercice
EP3254121B1 (fr) Dispositif à force de décalage de centre de gravité
JP2015153102A (ja) 耳装着型装置、耳装着型装置セット、サーバ、プログラムおよび情報提供システム
JP6500139B1 (ja) 視覚支援装置
JP2003134510A (ja) 画像情報配信システム
WO2018092486A1 (fr) Programme, procédé et dispositif de traitement d'informations
EP2409736A1 (fr) Procédé pour le fonctionnement d'un dispositif d'entraînement
JP5346115B6 (ja) 携帯型移動支援装置
JP2014120006A6 (ja) 携帯型移動支援装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13864205

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13864205

Country of ref document: EP

Kind code of ref document: A1