CN113191333A - Blind guiding method, system and blind guiding equipment based on artificial intelligence - Google Patents
Blind guiding method, system and blind guiding equipment based on artificial intelligence Download PDFInfo
- Publication number
- CN113191333A CN113191333A CN202110595949.0A CN202110595949A CN113191333A CN 113191333 A CN113191333 A CN 113191333A CN 202110595949 A CN202110595949 A CN 202110595949A CN 113191333 A CN113191333 A CN 113191333A
- Authority
- CN
- China
- Prior art keywords
- image
- vision
- module
- neural network
- blind
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 18
- 208000029257 vision disease Diseases 0.000 claims abstract description 20
- 238000003062 neural network model Methods 0.000 claims abstract description 7
- 238000013528 artificial neural network Methods 0.000 claims description 16
- 238000013527 convolutional neural network Methods 0.000 claims description 10
- 230000004888 barrier function Effects 0.000 claims description 6
- 230000001771 impaired effect Effects 0.000 claims description 4
- 206010047571 Visual impairment Diseases 0.000 claims description 2
- 238000005259 measurement Methods 0.000 claims description 2
- 230000004393 visual impairment Effects 0.000 claims description 2
- 230000004044 response Effects 0.000 abstract description 2
- 238000005457 optimization Methods 0.000 description 7
- 230000001012 protector Effects 0.000 description 4
- 241001166076 Diapheromera femorata Species 0.000 description 1
- 241000283070 Equus zebra Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
- G01S13/06—Systems determining position data of a target
- G01S13/08—Systems for measuring distance only
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B3/00—Audible signalling systems; Audible personal calling systems
- G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Radar, Positioning & Navigation (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Remote Sensing (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Multimedia (AREA)
- Electromagnetism (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a blind guiding method, a blind guiding system and blind guiding equipment based on artificial intelligence, which comprise the following steps: s1, collecting an image in front of the person with the vision disorder; s2, sending the collected images into a trained neural network model, and acquiring an image recognition result; and S3, sending the image recognition result to the vision-impaired person in an audio mode. The invention also provides a blind guiding system based on artificial intelligence, which comprises an image acquisition module, an image processing module, a radar early warning module and an information issuing module. The invention can identify common obstacles such as pedestrians, vehicles and the like in front of the vision-impaired person by carrying out image acquisition and analysis on the blind road where the vision-impaired person travels based on artificial intelligence, and transmits the identification result to the vision-impaired person in an audio mode, so that the vision-impaired person can make an avoidance response in time.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a blind guiding method and system based on artificial intelligence and a blind guiding arm protector.
Background
The vision disorder person can have great inconvenience on going on a journey, present stage is to the vision disorder person, the blind road is the necessary selection of their trip, and the trip still mainly relies on traditional blind guide rod to visit the way, but the phenomenon that the blind road is occupied now is rare, seriously influenced the trip of vision disorder person, still can cause certain potential danger for their trip, and when the vision disorder person went to the crossing, can't know the signal of traffic lights, therefore traditional blind guide rod has satisfied the demand that the vision disorder person has not.
Disclosure of Invention
The invention aims to overcome the defects, provides a blind guiding method based on artificial intelligence, is used for helping vision-impaired people to walk in public places more safely, also provides a system for realizing the method, and also provides a blind guiding arm protector comprising the system.
The technical scheme adopted by the invention is as follows:
a blind guiding method based on artificial intelligence comprises the following steps:
s1, collecting an image in front of the person with the vision disorder;
s2, sending the collected images into a trained neural network model, and acquiring an image recognition result;
and S3, sending the image recognition result to the vision-impaired person in an audio mode.
As a further optimization of the method of the present invention, in step S1 of the present invention, an image in front of the visually impaired person is captured by a video recording device, and the camera used by the video recording device is a wide-angle camera.
As a further optimization of the method of the present invention, in step S2 of the present invention, the neural network model is a neural network combining a convolutional neural network for identifying the occurrence of an obstacle in the acquired image and an LSTM neural network for performing trajectory tracking on a dynamic obstacle occurring in the acquired image.
As a further optimization of the method, the method collects the images and simultaneously measures the distance by the radar, and if the distance of the front obstacle detected by the radar distance measurement is set, the vision-impaired person is reminded in the form of audio.
As a further optimization of the method of the present invention, in step S3 of the present invention, an audio message is communicated to the visually impaired by means of a wireless bluetooth headset.
The invention also provides a blind guiding system based on artificial intelligence, which comprises an image acquisition module, an image processing module, a radar early warning module and an information issuing module, wherein:
the image acquisition module is used for acquiring a real-time image in front of the person with visual impairment;
the image processing module is used for processing the acquired real-time image and identifying that the barrier in front has a passing condition;
the radar early warning module is used for detecting an obstacle in front of the vision-impaired person, and sending an alarm to the vision-impaired person;
the information issuing module is used for acquiring the processing results of the image processing module and the train sending early warning module and transmitting the processing results to the vision-impaired person in an audio mode.
As the further optimization of the system, the image acquisition module adopts video equipment, and the adopted camera is a wide-angle camera.
As a further optimization of the system of the present invention, the image processing module of the present invention is a neural network combining a convolutional neural network for identifying the occurrence of an obstacle in the acquired image and an LSTM neural network for performing trajectory tracking on a dynamic obstacle occurring in the acquired image.
As a further optimization of the system, the information issuing module comprises a Bluetooth connecting module, and the Bluetooth connecting module transmits audio information to the vision-impaired person by connecting a Bluetooth earphone.
The invention also provides artificial intelligence-based blind guiding equipment, which comprises a processor, a memory and the blind guiding system, wherein the blind guiding system can be executed by the processor.
The invention has the following advantages:
1. the method is based on artificial intelligence to carry out image acquisition and analysis on the blind road where the vision disorder person travels, can identify common obstacles such as pedestrians, vehicles and the like in front of the vision disorder person, and transmits the identification result to the vision disorder person in an audio mode, so that the vision disorder person can make an avoidance response in time;
2. according to the invention, the Bluetooth connection module is used for carrying out voice reminding on the vision-impaired person by connecting the Bluetooth earphone, so that not only is an accident situation caused by wiring avoided, but also a better reminding effect is achieved on the vision-impaired person.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
The invention is further described below with reference to the accompanying drawings:
FIG. 1 is a schematic diagram of the structure of the system of the present invention.
Detailed Description
The present invention is further described in the following with reference to the drawings and the specific embodiments so that those skilled in the art can better understand the present invention and can implement the present invention, but the embodiments are not to be construed as limiting the present invention, and the embodiments and the technical features of the embodiments can be combined with each other without conflict.
It is to be understood that the terms first, second, and the like in the description of the embodiments of the invention are used for distinguishing between the descriptions and not necessarily for describing a sequential or chronological order. The "plurality" in the embodiment of the present invention means two or more.
The term "and/or" in the embodiment of the present invention is only an association relationship describing an associated object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, B exists alone, and A and B exist at the same time. In addition, the character "/" herein generally indicates that the former and latter associated objects are in an "or" relationship.
The embodiment provides a blind guiding method based on artificial intelligence, which comprises the following steps:
s1, collecting an image in front of the person with the vision disorder;
in the embodiment, the image in front of the person with vision disorder is collected through the video recording equipment, and the camera adopted by the video recording equipment is a wide-angle camera which can shoot a larger visual angle and can early warn the barrier in a more-occurring range in front of the person with vision disorder;
s2, sending the collected images into a trained neural network model, and acquiring an image recognition result;
in step S2, the neural network model is a neural network that combines a convolutional neural network and an LSTM neural network, the convolutional neural network is used to identify the occurrence of an obstacle in the acquired image, and the LSTM neural network is used to track and determine the position of a dynamic obstacle that appears in the acquired image;
when the convolutional neural network and the LSTM neural network are trained, the training contents mainly comprise the identification of obstacles such as pedestrians, bikes, bicycles and the like, the identification of signal lamps, the identification of zebra stripes and the like, and whether the action track of the front moving obstacle threatens a vision obstacle or not is judged through track tracking;
and S3, sending the image recognition result to the vision-impaired person in an audio mode. In order to avoid the influence of the wire harness, the embodiment communicates the audio message with the vision-impaired person in a wireless Bluetooth headset manner.
This embodiment passes through radar range finding when gathering the image, if the barrier in the place ahead that radar range finding detected when setting for the distance, reminds visual disorder person with the mode of audio frequency through wireless bluetooth's mode equally.
This embodiment still provides a blind guide system based on artificial intelligence, including image acquisition module, image processing module, radar early warning module and information issue the module, wherein:
the image acquisition module is used for acquiring a real-time image in front of the person with vision disorder, and a wide-angle camera is adopted as a camera of the image acquisition module, so that the barrier in a larger range in front of the person with vision disorder can be acquired;
the image processing module is used for processing the acquired real-time image and identifying whether the barrier in front has a passing condition or not;
the image processing module in this embodiment is a neural network combining a convolutional neural network and an LSTM neural network, the convolutional neural network is used to identify the occurrence of an obstacle in the acquired image, and the LSTM neural network is used to track the occurrence of a dynamic obstacle in the acquired image;
the radar early warning module is used for detecting an obstacle in front of the vision-impaired person, and sending an alarm to the vision-impaired person;
the information issuing module is used for acquiring the processing results of the image processing module and the train sending early warning module and transmitting the processing results to the vision-impaired person in an audio mode. The information issuing module comprises a Bluetooth connecting module, and the Bluetooth connecting module transmits audio information to the vision-impaired person by connecting a Bluetooth earphone.
The embodiment also provides an artificial intelligence based blind guiding device, which comprises a processor, a memory and the blind guiding system, wherein the blind guiding system can be executed by the processor. The blind guiding equipment can be set as equipment such as a blind guiding walking stick, a blind guiding arm protector, a blind guiding shoulder protector, blind guiding glasses and a blind guiding hat.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (10)
1. A blind guiding method based on artificial intelligence is characterized in that: the method comprises the following steps:
s1, collecting an image in front of the person with the vision disorder;
s2, sending the collected images into a trained neural network model, and acquiring an image recognition result;
and S3, sending the image recognition result to the vision-impaired person in an audio mode.
2. Blind guiding method according to claim 1, characterized in that:
in step S1, an image in front of the visually impaired person is captured by a video recording device, and a camera used by the video recording device is a wide-angle camera.
3. Blind guiding method according to claim 2, characterized in that:
in step S2, the neural network model is a neural network that combines a convolutional neural network for identifying the occurrence of an obstacle in the acquired image and an LSTM neural network for performing trajectory tracking on a dynamic obstacle that occurs in the acquired image.
4. The blind guiding method according to claim 3, characterized in that:
the image is collected and the distance is measured by the radar, and if the distance is set for the obstacle in front of the image detected by the radar distance measurement, the vision-impaired person is reminded in an audio form.
5. Blind guiding method according to claim 1, characterized in that:
in step S3, an audio message is communicated to the visually impaired by way of a wireless bluetooth headset.
6. The utility model provides a blind system of leading based on artificial intelligence which characterized in that: including image acquisition module, image processing module, radar early warning module and information issue module, wherein:
the image acquisition module is used for acquiring a real-time image in front of the person with visual impairment;
the image processing module is used for processing the acquired real-time image and identifying that the barrier in front has a passing condition;
the radar early warning module is used for detecting an obstacle in front of the vision-impaired person, and sending an alarm to the vision-impaired person;
the information issuing module is used for acquiring the processing results of the image processing module and the train sending early warning module and transmitting the processing results to the vision-impaired person in an audio mode.
7. The blind guidance system of claim 6 wherein: the image acquisition module adopts video recording equipment, and the camera that adopts is wide angle camera.
8. The blind guidance system of claim 7 wherein: the image processing module is a neural network combining a convolutional neural network and an LSTM neural network, the convolutional neural network is used for identifying the occurrence of obstacles in the acquired image, and the LSTM neural network is used for tracking the track of the dynamic obstacles in the acquired image.
9. The blind guidance system of claim 8 wherein: the information issuing module comprises a Bluetooth connecting module, and the Bluetooth connecting module transmits audio information to the vision-impaired person by connecting a Bluetooth earphone.
10. The utility model provides a blind equipment of leading based on artificial intelligence which characterized in that: comprising a processor, a memory and a blind guiding system according to claims 6-9, said blind guiding system being executable by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110595949.0A CN113191333A (en) | 2021-05-29 | 2021-05-29 | Blind guiding method, system and blind guiding equipment based on artificial intelligence |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110595949.0A CN113191333A (en) | 2021-05-29 | 2021-05-29 | Blind guiding method, system and blind guiding equipment based on artificial intelligence |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113191333A true CN113191333A (en) | 2021-07-30 |
Family
ID=76986353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110595949.0A Pending CN113191333A (en) | 2021-05-29 | 2021-05-29 | Blind guiding method, system and blind guiding equipment based on artificial intelligence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113191333A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113917452A (en) * | 2021-09-30 | 2022-01-11 | 北京理工大学 | Blind road detection device and method combining vision and radar |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN208366352U (en) * | 2018-05-17 | 2019-01-11 | 中兴健康科技有限公司 | A kind of guide equipment |
| CN110559127A (en) * | 2019-08-27 | 2019-12-13 | 上海交通大学 | intelligent blind assisting system and method based on auditory sense and tactile sense guide |
| CN210078040U (en) * | 2019-02-28 | 2020-02-18 | 上海工程技术大学 | Intelligent blind guiding device |
| CN111437157A (en) * | 2020-06-16 | 2020-07-24 | 深圳市品罗创新实业有限公司 | Intelligent wearable communication equipment and use method thereof |
-
2021
- 2021-05-29 CN CN202110595949.0A patent/CN113191333A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN208366352U (en) * | 2018-05-17 | 2019-01-11 | 中兴健康科技有限公司 | A kind of guide equipment |
| CN210078040U (en) * | 2019-02-28 | 2020-02-18 | 上海工程技术大学 | Intelligent blind guiding device |
| CN110559127A (en) * | 2019-08-27 | 2019-12-13 | 上海交通大学 | intelligent blind assisting system and method based on auditory sense and tactile sense guide |
| CN111437157A (en) * | 2020-06-16 | 2020-07-24 | 深圳市品罗创新实业有限公司 | Intelligent wearable communication equipment and use method thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113917452A (en) * | 2021-09-30 | 2022-01-11 | 北京理工大学 | Blind road detection device and method combining vision and radar |
| CN113917452B (en) * | 2021-09-30 | 2022-05-24 | 北京理工大学 | Blind road detection device and method combining vision and radar |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111223302B (en) | External coordinate real-time three-dimensional road condition auxiliary device for mobile carrier and system | |
| CN111164967B (en) | Image processing apparatus and image processing method | |
| JP7355151B2 (en) | Information processing device, information processing method, program | |
| CN106128140B (en) | Car networking environment down train services active perception system and method | |
| CN105167967B (en) | A kind of blind-guiding method and system | |
| WO2018058958A1 (en) | Road vehicle traffic alarm system and method therefor | |
| KR102453627B1 (en) | Deep Learning based Traffic Flow Analysis Method and System | |
| US10369995B2 (en) | Information processing device, information processing method, control device for vehicle, and control method for vehicle | |
| Saiprasert et al. | Driver behaviour profiling using smartphone sensory data in a V2I environment | |
| JPWO2014013985A1 (en) | Driving support system and driving support method | |
| CN114333330B (en) | Intersection event detection system based on road side edge holographic sensing | |
| CN108639108B (en) | Locomotive operation safety protection system | |
| CN113140132B (en) | Pedestrian anti-collision early warning system and method based on 5G V2X mobile intelligent terminal | |
| EP4187524A1 (en) | Alert device, alert method, and alert program | |
| CN112200044B (en) | Abnormal behavior detection method and device and electronic equipment | |
| CN110796862B (en) | Highway traffic condition detection system and method based on artificial intelligence | |
| CN104299400A (en) | Vehicle environment monitoring system | |
| CN116030662B (en) | Intelligent safety detection system and method based on big data | |
| CN107452219A (en) | Choosing lane accessory system and its execution method | |
| JP7331728B2 (en) | Driver state estimation device | |
| CN116798222A (en) | Method, system and device for detecting visibility of expressway and intelligently inducing visibility of expressway | |
| JP2024019588A (en) | Map data generation device | |
| CN113191333A (en) | Blind guiding method, system and blind guiding equipment based on artificial intelligence | |
| CN106043125A (en) | Intelligent visible path navigation method | |
| CN207037930U (en) | A kind of traffic lights intelligent identifying system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210730 |
|
| RJ01 | Rejection of invention patent application after publication |