AU2020101563A4 - An artificial intelligence based system to assist blind person - Google Patents

An artificial intelligence based system to assist blind person Download PDF

Info

Publication number
AU2020101563A4
AU2020101563A4 AU2020101563A AU2020101563A AU2020101563A4 AU 2020101563 A4 AU2020101563 A4 AU 2020101563A4 AU 2020101563 A AU2020101563 A AU 2020101563A AU 2020101563 A AU2020101563 A AU 2020101563A AU 2020101563 A4 AU2020101563 A4 AU 2020101563A4
Authority
AU
Australia
Prior art keywords
artificial intelligence
person
based system
image
intelligence based
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2020101563A
Inventor
Raja Sarath Kumar Boddu
Anoop Kumar Chaturvedi
K.Sree Divya
Kamal Gulati
Agarala Jyothsna
Pravin R. Kshirsagar
K.Manoj Kumar
N.Phani Kumar
G. Rajeswarappa
A. Revathi
K. Santhi
Vishal Sathawane
Srinivasulu Sirisala
Maditham Vikram
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Boddu Raja Sarath Kumar Dr
Chaturvedi Anoop Kumar Dr
Divya KSree Mrs
Jyothsna Agarala Mrs
Revathi A Mrs
Santhi K Mrs
Original Assignee
Boddu Raja Sarath Kumar Dr
Chaturvedi Anoop Kumar Dr
Divya K Sree Mrs
Jyothsna Agarala Mrs
Revathi A Mrs
Santhi K Mrs
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Boddu Raja Sarath Kumar Dr, Chaturvedi Anoop Kumar Dr, Divya K Sree Mrs, Jyothsna Agarala Mrs, Revathi A Mrs, Santhi K Mrs filed Critical Boddu Raja Sarath Kumar Dr
Priority to AU2020101563A priority Critical patent/AU2020101563A4/en
Application granted granted Critical
Publication of AU2020101563A4 publication Critical patent/AU2020101563A4/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00—Appliances for aiding patients or disabled persons to walk about
    • A61H3/06—Walking aids for blind persons
    • A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00—Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08—Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/46—Indirect determination of position data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72475—User interfaces specially adapted for cordless or mobile telephones specially adapted for disabled users
    • H04M1/72481—User interfaces specially adapted for cordless or mobile telephones specially adapted for disabled users for visually impaired users
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497—Means for monitoring or calibrating
    • G01S2007/4975—Means for monitoring or calibrating of sensor obstruction by, e.g. dirt- or ice-coating, e.g. by reflection measurement on front-screen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Signal Processing (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Human Computer Interaction (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Engineering & Computer Science (AREA)
  • Epidemiology (AREA)
  • Pain & Pain Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Rehabilitation Therapy (AREA)
  • Multimedia (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Rehabilitation Tools (AREA)

Abstract

The present invention relates to an artificial intelligence based system to assist blind person. Through present disclosures provides a handheld device in which ultrasonic sensors (101) along with motor are configured to measure the distance between the person and obstacle. The embedded motor (107) with sensors (101) helps in rotating to 360 degrees as obstacles at any point could be detected. And adapted camera (102) detects and captures the object which is in front of the person and artificial intelligence and machine learning based algorithms are designed to classify the image and detect the same. Once the image is classified, the image is processed and converted to speech signals which alert the blind people through earphones. Following invention described in detail with the help of figure 1 of sheet 1 which shows the block diagram of the proposed system. 1/2 101 100 102 105 108 106 107 Figure 1

Description

1/2
101
100
102 105
108 106 107
Figure 1
AN ARTIFICIAL INTELLIGENCE BASED SYSTEM TO ASSIST BLIND PERSON
Technical field of invention:
The present invention in general relates to the field of electronics and product engineering and more particularly to an artificial intelligence based system for identification of objects to assist blind person.
Background of the invention:
The most important part of human physiology is vision. It is because the information human beings get from the nearby surroundings is through vision. The statistics by various health organizations estimate that most of the people in world are with visual impairment, 39 billion of which are blind. There are many with low vision. Therefore the need for assistive devices for navigation and orientation has increased.
The traditional and oldest mobility aids for persons with visual problems are the walking cane and trained dogs. Guide dogs are also used but they are not trustworthy. Although these tools are very popular, they cannot provide the blind with all information and features for safe mobility, which are available to people with sight. The most important drawbacks of these aids are necessary skills and training period, range of motion and small information that they convey.
There have been an invention of lot of Electronic Travel Aids and they have been implemented to help the blind navigate independently and safely. Many high-level technological solutions have been introduced recently to help blind persons navigate independently. GPS is the system that is used to identify the current location of a person. While such systems are suitable for navigation in outdoor as they require the need for line of sight access to satellite but they also require additional components to improve on the resolution and proximity detection to prevent collision of the blind persons with other objects and protect them from danger. However in comparison to other technologies, many blind guidance systems use ultrasound because of it is not prone to the environmental noise. Also this technology is relatively less expensive, and also ultrasound emitters and detectors are light enough to be used without the need for complex circuitry.
So much research has been carried out for developing a better navigation system in order to create a better and independent way of living for the blinds. Thus few available and existing assistive devices are found such as- EP2760410A1 discloses venucane: an electronic travel aid for visually impaired and blind people, US20130113601A1 discloses obstacle detection for visually impaired persons, EP2395495A2 discloses hand-held navigation aid for individuals with visual impairment, US7039522B2 discloses system for guiding visually impaired pedestrian using auditory cues, W02016086438AI discloses head-mounted multimedia terminal auxiliary viewing system for visually impaired person, CN104306139A discloses blind people going out voice assisting tactile stick system based on RFID and navigation method of blind people going out voice assisting tactile stick system, W02011104589AI discloses virtual walking stick for assisting blind people, W02008015375AI discloses assistance device for blind and partially sighted people.
Nevertheless, previous research has provided several solutions to overcome the problems of visually impaired persons (VIPs) and give them more independence, but these solutions have not completely addressed safety measures when VIPs arewalking by themselves.
Therefore to overcome the limitations of the existing system there is need to develop an improved and efficient assistive system for visually impaired person. Hence the present invention provides an artificial intelligence based system to assist blind person.
Objective of the invention
An objective of the present invention is to attempt to overcome the problems of the prior art and provide an artificial intelligence based system to assist blind person.
In a preferred embodiment, the present invention provides a sensor based system for identification of objectsto assist blind person.
It is therefore an object of the invention to provide a system in handheld deviceto measure the distance between the person and obstacle.
These and other objects and characteristics of the present invention will become apparent from the further disclosure to be made in the detailed description given below.
Summary of the invention:
Accordingly following invention provides an artificial intelligence based system to assist blind person. The proposed invention provides a system to assist blind people. Herein the ultrasonic sensors (101) are employed to find the distance between the person and obstacle. The ultrasonic sensors (101) are equipped with a motor (107) such that it could be rotated to 360 degrees as obstacles at any point could be detected. A built-in camera (102) detects and captures the object which is in front of the person and artificial intelligence and machine learning based approach are designed to classify the image and detect the same. Once the image is classified and detected, the image is processed and converted to speech signal which alerts blind people through earphones. The preferred embodiment comprises of microcontroller, ultrasonic sensor, camera, power supply, display, buzzer, vibrating motor, relay driver and rotation motor.
Brief description of drawing:
This invention is described by way of example with reference to the following drawing where,
Figure 1 of sheet 1 shows the block diagram of the proposed system. Where, 100 denotes microcontroller, 101 denotes ultrasonic sensor, 102 denotes camera, 103 denotes power supply, 104 denotes buzzer, 105 denotes start,
106 denotes relay driver, 107 denotes 1800 rotation motor, 108 denotes vibration motor.
Figure 2 of sheet 2 shows the circuit diagram of the proposed system. Where, 101 denotes ultrasonic sensor, 102 denotes camera, 103 denotes power supply, 104 denotes buzzer, 105 denotes start, 107 denotes 180° rotation motor, 108 denotes vibration motor, 109 denotes virtual terminal,
In order that the manner in which the above-cited and other advantages and objects of the invention are obtained, a more particular description of the invention briefly described above will be referred, which are illustrated in the appended drawing. Understanding that these drawing depict only typical embodiment of the invention and therefore not to be considered limiting on its scope, the invention will be described with additional specificity and details through the use of the accompanying drawing.
Detailed description of the invention:
While the invention has been described and illustrated with reference to certain particular embodiments thereof, those skilled in the art will appreciate that various adaptations, changes, modifications, substitutions, deletions, or additions of procedures and protocols may be made without departing from the spirit and scope of the invention.
The present invention relates to an artificial intelligence based system to assist blind person. The proposed invention provides a system to be utilized in blind assistive handheld device in which ultrasonic sensors (101) along with motor (107) are configured to measure the distance between the person and obstacle.
In the preferred embodiment the ultrasonic sensors (101) are employed to find the distance between the person and obstacle. Further the ultrasonic sensors (101) are equipped with a motor (107) such that it helps in rotating to 360 degrees as obstacles at any point could be detected. A built-in camera (102) connected with virtual terminal (109) detects and captures the object which is in front of the person and artificial intelligence and machine learning based approach are designed to classify the image and detect the same. Once the image is classified and detected; the image is processed and converted to speech signals which alerts blind people through earphones.
Herein the system arduino microcontroller (100) is embedded which control the system and connected with buzzer (104), ultrasonic sensor (101), camera (102) and relay driver (106).
And said relay driver (106) further operate vibration motor (108) and 180 rotation motor (107). The power supply (103) is provided to the microcontroller (100) for operation of the invented system.
For initialing the operation user have to start (105) the system through which circuit is turned on, thereafter system check all side object then if any object found camera (102) will verify the image and gives voice output accordingly through buzzer (104). Also vibrator motor (108) starts and creates vibration for alerting the user about the objects or obstacles.
The many features and advantages of the invention are apparent from the detailed specification, and thus, it is intended by the appended claims to cover all such features and advantages of the invention which fall within the true spirit and scope of the invention. Further, since numerous modifications and variations will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.

Claims (4)

Editorial Note 2020101563 There is only one page of the claim THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS:
1. An artificial intelligence based system to assist blind person as handheld device, characterized in that;
a ultrasonic sensors (101) along with 1800 rotation motor (107) adapted to measure the distance between the person and obstacle;
a built-in camera (102) connected with virtual terminal (109) adapted to detects and captures the object which is in front of the user;
and artificial intelligence and machine learning based approach configured to classify the image and detection, thereafter the image is processed and converted to speech signals which alerts blind people.
2. The artificial intelligence based system to assist blind person as claimed in claim 1 wherein an arduino microcontroller (100) is embedded which control the system and connected with buzzer (104), ultrasonic sensor (101), camera (102) and relay driver (106).
3. The artificial intelligence based system to assist blind person as claimed in claim 1 wherein a vibration motor (108) and the 180° rotation motor (107) is adapted which operated through relay driver (109).
4. The artificial intelligence based system to assist blind person as claimed in claim 1 wherein the power supply (103) is provided to the microcontroller (100) for operation.
AU2020101563A 2020-07-29 2020-07-29 An artificial intelligence based system to assist blind person Ceased AU2020101563A4 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2020101563A AU2020101563A4 (en) 2020-07-29 2020-07-29 An artificial intelligence based system to assist blind person

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
AU2020101563A AU2020101563A4 (en) 2020-07-29 2020-07-29 An artificial intelligence based system to assist blind person

Publications (1)

Publication Number Publication Date
AU2020101563A4 true AU2020101563A4 (en) 2020-09-10

Family

ID=72333695

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2020101563A Ceased AU2020101563A4 (en) 2020-07-29 2020-07-29 An artificial intelligence based system to assist blind person

Country Status (1)

Country Link
AU (1) AU2020101563A4 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020006971A1 (en) 2020-11-13 2022-05-19 Alexander Bayer Camera-based assistance system with artificial intelligence for blind people

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020006971A1 (en) 2020-11-13 2022-05-19 Alexander Bayer Camera-based assistance system with artificial intelligence for blind people
EP4000579A1 (en) 2020-11-13 2022-05-25 Alexander Bayer Camera-based assistance system with artificial intelligence for the blind

Similar Documents

Publication Publication Date Title
WO2018156549A1 (en) Personal navigation system
KR20150097043A (en) Smart System for a person who is visually impaired using eyeglasses with camera and a cane with control module
Subbiah et al. Smart cane for visually impaired based on IOT
KN et al. Braille assistance system for visually impaired, blind & deaf-mute people in indoor & outdoor application
Chinchole et al. Artificial intelligence and sensors based assistive system for the visually impaired people
Goel et al. Mushrooming trends and technologies to aid visually impaired people
Siddhartha et al. An electronic smart jacket for the navigation of visually impaired society
Aravinth WiFi and Bluetooth based smart stick for guiding blind people
AU2020101563A4 (en) An artificial intelligence based system to assist blind person
Hakim et al. Navigation system for visually impaired people based on RGB-D camera and ultrasonic sensor
Wei et al. A new vision and navigation research for a guide-dog robot system in urban system
Chaccour et al. Multisensor guided walker for visually impaired elderly people
Nandyal et al. Smart Glasses for Visually Impaired Person
Al-Shehabi et al. An obstacle detection and guidance system for mobility of visually impaired in unfamiliar indoor environments
Bolla et al. Object Detection in Computer Vision Using Machine Learning Algorithm For Visually Impaired People
Dilli et al. Smart blind stick using node mcu with voice alert
Shaikh et al. Smart Helmet for Visually Impaired
Chiranjevulu et al. Intelligent walking stick for blind people using Arduino
Muhammad et al. Design of Intelligent Stick Based on Microcontroller with GPS using speech IC
Baskar et al. An Indoor Obstacle Detector to Assist the Visually Impaired Person on Real-Time with a Navigator
Udayagini et al. Smart Cane For Blind People
Prathipa et al. Ultrasonic waist-belt for visually impaired person
Walvekar et al. Blind Hurdle Stick: Android Integrated Voice Based Intimation via GPS with Panic Alert System
Saisubramanyam et al. IOT Based Smart Walking Stick for Blind or Old Aged People with GPS Tracking Location
Kannan et al. Iot based smart stick used for visually impaired people by using image processing

Legal Events

Date Code Title Description
FGI Letters patent sealed or granted (innovation patent)
MK22 Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry