WO2019198064A3 - A feedback based assistive system and method for visually impaired persons - Google Patents

A feedback based assistive system and method for visually impaired persons Download PDF

Info

Publication number
WO2019198064A3
WO2019198064A3 PCT/IB2019/056833 IB2019056833W WO2019198064A3 WO 2019198064 A3 WO2019198064 A3 WO 2019198064A3 IB 2019056833 W IB2019056833 W IB 2019056833W WO 2019198064 A3 WO2019198064 A3 WO 2019198064A3
Authority
WO
WIPO (PCT)
Prior art keywords
visually impaired
obstacle
impaired persons
user
feedback based
Prior art date
Application number
PCT/IB2019/056833
Other languages
French (fr)
Other versions
WO2019198064A2 (en
Inventor
Dr. Rahee WALAMBE
Mr. Majeed KHAN
Mr. Mihir KAVISHWAR
Mr. Jaydeep PATIDAR
Mr. Parth CHUGH
Original Assignee
Symbiosis International (Deemed) University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Symbiosis International (Deemed) University filed Critical Symbiosis International (Deemed) University
Publication of WO2019198064A2 publication Critical patent/WO2019198064A2/en
Publication of WO2019198064A3 publication Critical patent/WO2019198064A3/en

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/007—Teaching or communicating with blind persons using both tactile and audible presentation of the information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24143—Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes

Abstract

The present invention relates to a feedback system (100) and method (500) for visually impaired persons. The system (100) comprises an image capturing means (201) mounted on an eyewear (101), proximity sensors (107), a processor (106), audio feedbacks (103,104) and vibration motors (105) mounted on a wearable garment (102) worn by the user. During navigation, the presence of an obstacle in the path of a user is captured via image capturing means (201) and the distance of such obstacle is captured by the proximity sensors (107). The processor (106) processes the inputs using deep learning and depth map mechanism to notify the user about an obstacle via audio feedbacks (103, 104) and vibration motors (105).
PCT/IB2019/056833 2019-07-11 2019-08-12 A feedback based assistive system and method for visually impaired persons WO2019198064A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN201921027908 2019-07-11
IN201921027908 2019-07-11

Publications (2)

Publication Number Publication Date
WO2019198064A2 WO2019198064A2 (en) 2019-10-17
WO2019198064A3 true WO2019198064A3 (en) 2019-12-19

Family

ID=68164870

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2019/056833 WO2019198064A2 (en) 2019-07-11 2019-08-12 A feedback based assistive system and method for visually impaired persons

Country Status (1)

Country Link
WO (1) WO2019198064A2 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150294597A1 (en) * 2012-10-23 2015-10-15 New York University Somatosensory feedback wearable object
KR20180033484A (en) * 2018-03-23 2018-04-03 선문대학교 산학협력단 Wearable information providing device for blind

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150294597A1 (en) * 2012-10-23 2015-10-15 New York University Somatosensory feedback wearable object
KR20180033484A (en) * 2018-03-23 2018-04-03 선문대학교 산학협력단 Wearable information providing device for blind

Also Published As

Publication number Publication date
WO2019198064A2 (en) 2019-10-17

Similar Documents

Publication Publication Date Title
US11112261B2 (en) Navigation methods and apparatus for the visually impaired
Scheggi et al. A remote guidance system for blind and visually impaired people via vibrotactile haptic feedback
KR101646503B1 (en) Device, system and method for informing about 3D obstacle or information for blind person
US9613505B2 (en) Object detection and localized extremity guidance
EP1661543A4 (en) Wearable action-assist device, and method and program for controlling wearable action-assist device
CN105721983A (en) Hearing device with image capture capabilities
WO2014106085A1 (en) Wearable navigation assistance for the vision-impaired
Bharathi et al. Effective navigation for visually impaired by wearable obstacle avoidance system
KR101421046B1 (en) Glasses and control method thereof
WO2020122485A3 (en) Robot system for providing medical assistance service and method therefor
JP2016067855A (en) Walking guide device for sight disabled person
Li et al. Assisting blind people to avoid obstacles: An wearable obstacle stereo feedback system based on 3D detection
US10775794B2 (en) Following system for mobile robot to follow moving object
Patel et al. Smartphone-based obstacle detection for visually impaired people
JP7403783B2 (en) Behavior support device for visually impaired people
CN107544669B (en) Pseudo-force device
JP2006035381A (en) Control equipment for mobile robot
KR20210068970A (en) System for providing navigation service for visually impaired person
WO2019198064A3 (en) A feedback based assistive system and method for visually impaired persons
WO2017105746A1 (en) Fan-driven force device
Al-Shehabi et al. An obstacle detection and guidance system for mobility of visually impaired in unfamiliar indoor environments
CN107783639A (en) Virtual reality leisure learning system
Chaudhary et al. State of art on wearable device to assist visually impaired person navigation in outdoor environment
CN114125677A (en) Hearing device adapted for orientation
WO2021101460A1 (en) Navigational assistance system with auditory augmented reality for visually impaired persons

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19786041

Country of ref document: EP

Kind code of ref document: A2