CN113208883A - Multi-functional intelligent blind-guiding walking stick based on machine vision - Google Patents
Multi-functional intelligent blind-guiding walking stick based on machine vision Download PDFInfo
- Publication number
- CN113208883A CN113208883A CN202110640462.XA CN202110640462A CN113208883A CN 113208883 A CN113208883 A CN 113208883A CN 202110640462 A CN202110640462 A CN 202110640462A CN 113208883 A CN113208883 A CN 113208883A
- Authority
- CN
- China
- Prior art keywords
- module
- walking stick
- ultrasonic
- obstacle
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 241001166076 Diapheromera femorata Species 0.000 title claims abstract description 79
- 238000000034 method Methods 0.000 claims description 4
- 238000010801 machine learning Methods 0.000 claims description 3
- 230000007613 environmental effect Effects 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 6
- 230000004888 barrier function Effects 0.000 description 6
- 241000253999 Phasmatodea Species 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000002592 echocardiography Methods 0.000 description 3
- 238000002604 ultrasonography Methods 0.000 description 3
- 241000282472 Canis lupus familiaris Species 0.000 description 2
- 240000007651 Rubus glaucus Species 0.000 description 2
- 235000011034 Rubus glaucus Nutrition 0.000 description 2
- 235000009122 Rubus idaeus Nutrition 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 208000029257 vision disease Diseases 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/068—Sticks for blind persons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/02—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
- G01S15/06—Systems determining the position data of a target
- G01S15/08—Systems for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/38—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
- G01S19/39—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
- G01S19/42—Determining position
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B3/00—Audible signalling systems; Audible personal calling systems
- G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/005—Traffic control systems for road vehicles including pedestrian guidance indicator
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Public Health (AREA)
- Life Sciences & Earth Sciences (AREA)
- Veterinary Medicine (AREA)
- General Health & Medical Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Rehabilitation Therapy (AREA)
- Physical Education & Sports Medicine (AREA)
- Epidemiology (AREA)
- Pain & Pain Management (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Electromagnetism (AREA)
- Traffic Control Systems (AREA)
- Rehabilitation Tools (AREA)
Abstract
The invention discloses a multifunctional intelligent blind-guiding walking stick based on machine vision, which comprises a walking stick body, wherein a first ultrasonic module, a second ultrasonic module, a third ultrasonic module, a camera module, a voice broadcasting module and a processor are arranged on the walking stick body, and the first ultrasonic module, the second ultrasonic module and the third ultrasonic module are respectively used for detecting the distance from an obstacle in front of the walking stick, on the left side and on the right side to the walking stick; the camera module is used for acquiring an environment image in real time; the processor is used for inputting the environment image collected by the camera module into the traffic light identification model and outputting a traffic light identification result; the distance between the obstacle and the walking stick is compared with a preset safety distance to obtain an obstacle avoidance result; and the voice broadcasting module is also used for controlling the voice broadcasting module to carry out voice navigation reminding according to the traffic light recognition result and the obstacle avoidance result. The safety of the blind guiding function is greatly improved, the blind can be guided to safely carry out social activities, and the safety of the blind is maintained.
Description
Technical Field
The invention relates to the technical field of travel appliances for blind people, in particular to a multifunctional intelligent blind guiding walking stick based on machine vision.
Background
As a special group, the blind people are seriously limited in range of activity due to the visual disorder, mainly by touch sense and hearing, and can also see and promote a plurality of blind people articles in the market to improve the self-care ability of the blind people, but the blind people can encounter a plurality of difficulties which cannot be imagined by common people in life. Most blind people rely on the trained guide dog to walk for navigation, so that the blind people can be safely guided to carry out basic social activities, but the activities of the blind people are limited due to the fear and the rejection of the public places to dogs and the prohibition of carrying pets in partial areas; the existing guide walking sticks are non-intelligent walking sticks generally, and when the guide walking sticks are used, the guide walking sticks still need to experience and judge the external environment by means of self experiences, so that the traveling efficiency of the blind is greatly reduced.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides the multifunctional intelligent blind guiding walking stick based on machine vision, which greatly improves the safety in the aspect of blind guiding function, can guide the blind to perform social activities safely and maintain the life safety of the blind.
In order to solve the technical problems, the invention is realized by the following technical scheme:
a multifunctional intelligent blind guiding walking stick based on machine vision comprises a walking stick body, wherein a first ultrasonic module, a second ultrasonic module, a third ultrasonic module, a camera module, a voice broadcast module and a processor are arranged on the walking stick body, and the first ultrasonic module, the second ultrasonic module, the third ultrasonic module, the voice broadcast module and the camera module are respectively connected with the processor;
the first ultrasonic module is used for detecting the distance between an obstacle in front of the walking stick and the walking stick;
the second ultrasonic module is used for detecting the distance between an obstacle on the left of the walking stick and the walking stick;
the third ultrasonic module is used for detecting the distance between an obstacle on the right of the walking stick and the walking stick;
the camera module is used for acquiring an environment image in real time;
the processor is used for inputting the environment image acquired by the camera module into a traffic light identification model and outputting a traffic light identification result; the distance between the obstacle and the walking stick detected by the first ultrasonic module, the second ultrasonic module and the third ultrasonic module is compared with a preset safety distance to obtain an obstacle avoidance result; and the voice broadcasting module is also used for controlling the voice broadcasting module to carry out voice navigation reminding according to the traffic light identification result and the obstacle avoidance result.
Further, the comparing the distance between the obstacle detected by the first ultrasonic module, the second ultrasonic module and the third ultrasonic module and the walking stick with a preset safety distance to obtain an obstacle avoidance result specifically includes:
and when the distance between the obstacle and the walking stick is less than the preset safety distance, the obstacle needs to be avoided.
Further, according to the traffic light recognition result and keep away barrier result control the voice broadcast module carries out voice navigation and reminds, specifically include:
when the traffic light identification result is a red light, performing advancing stopping reminding;
when the traffic light identification result is a green light and the distance between the obstacle and the walking stick is smaller than a preset safety distance, stopping advancing reminding is carried out;
and when the traffic light recognition result is a green light and the distance between the obstacle and the walking stick is not less than the preset safety distance, carrying out normal forward reminding.
Further, the traffic light identification model is constructed in the following way:
acquiring a plurality of training data sets, and inputting the training data sets into a machine learning model to obtain a traffic light identification model capable of outputting a traffic light identification result; the training data sets comprise a red light training data set and a green light training data set, the red light training data set comprises an environment photo and a label for identifying that the environment photo contains a red light, and the green light training data set comprises an environment photo and a label for identifying that the environment photo contains a green light.
Furthermore, a GPS positioning module is also arranged on the walking stick body and is connected with the processor;
the GPS positioning module is used for acquiring the position information of the walking stick body; the processor is also configured to store positional information of the cane body.
Furthermore, a Bluetooth module is arranged on the walking stick body and connected with the processor;
the Bluetooth module is used for sending the voice navigation reminding information to Bluetooth terminal equipment.
Furthermore, a Wi-Fi module is further arranged on the walking stick body and used for sending the environment images collected by the camera module in real time to the processor.
Furthermore, a power module is further arranged on the walking stick body and used for supplying power to the first ultrasonic module, the second ultrasonic module, the third ultrasonic module, the camera module, the voice broadcast module and the processor.
Furthermore, a switch module is further arranged on the walking stick body and used for controlling the on-off of the power supply module.
Furthermore, the blind guiding walking stick is also matched with a wireless charging seat.
Compared with the prior art, the invention has at least the following beneficial effects: the invention provides a multifunctional intelligent blind-guiding walking stick based on machine vision, which judges and avoids real-time obstacles by dynamically and continuously ranging three ultrasonic modules in different directions, compares the distance between the obstacles detected by a first ultrasonic module, a second ultrasonic module and a third ultrasonic module and the walking stick with a preset safety distance to obtain an obstacle-avoiding result, and assists a blind person in avoiding dynamic and static obstacles. The camera module is used for acquiring real-time environment image information, the acquired environment image information is input into the traffic light identification model, a traffic light identification result is output, and the voice broadcasting module is controlled to carry out voice navigation reminding according to the traffic light identification result and the obstacle avoidance result. When the red light and the green light are identified as red light, the advancing stopping reminding is carried out; when the red and green light identification result is a green light and the distance between the obstacle and the walking stick is smaller than a preset safety distance, stopping advancing reminding is carried out; and when the red and green light recognition result is a green light and the distance between the obstacle and the walking stick is not less than the preset safety distance, carrying out normal forward reminding. The safety of the blind guiding function of the invention is greatly improved, the blind can be guided to perform social activities safely, and the life safety of the blind can be maintained.
Furthermore, the multifunctional intelligent blind guiding walking stick based on machine vision is provided with the Bluetooth module, the Bluetooth module sends voice navigation reminding information to Bluetooth terminal equipment, such as a Bluetooth headset worn by a blind person, and the voice navigation reminding information is warned through the Bluetooth module and the language broadcast module, so that the situation that the voice broadcast module is not ideal in an outside noisy environment is avoided.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a multifunctional intelligent blind guiding walking stick based on machine vision;
fig. 2 is a schematic view of the working principle of the multifunctional intelligent blind guiding walking stick based on machine vision.
In fig. 1: 1-a first ultrasound module; 2-a second ultrasound module; 3-a third ultrasound module; 4-a camera module; 5-voice broadcasting module; 6-GPS positioning module; 7-a Bluetooth module; an 8-Wi-Fi module; 9-a power supply module; 10-a switch module; 11-wireless charging stand.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As a specific embodiment of the present invention, with reference to fig. 1 and 2, a multifunctional intelligent blind guiding walking stick based on machine vision includes a walking stick body, on which a first ultrasonic module 1, a second ultrasonic module 2, a third ultrasonic module 3, a camera module 4, a voice broadcast module 5 and a processor are arranged, and the first ultrasonic module 1, the second ultrasonic module 2, the third ultrasonic module 3, the voice broadcast module 5 and the camera module 4 are respectively connected to the processor.
First ultrasonic wave module 1 is used for surveying the distance of stick place ahead barrier apart from stick, and specifically speaking, through the N sound waves of first ultrasonic wave module 1 transmission front that stick place ahead set up, when the sound wave meets preceding barrier after, return for first ultrasonic wave module 1 to record the round trip time T of every sound wave1iThe travel distance L of each ultrasonic wave1i＝(T1iX V)/2, V is the speed of the ultrasonic wave in the air, thereby measuring a data set L of ultrasonic wave echoes1n＝{L1i,T1i}i＝1,NAnd i is a natural number.
The second ultrasonic module 2 is used for detecting the distance between an obstacle on the left side of the walking stick and the walking stick, specifically, the second ultrasonic module 2 arranged on the left side of the walking stick emits N sound waves to the left side, when the sound waves meet the obstacle on the left side, the sound waves return to the second ultrasonic module 2, and the round-trip time T of each sound wave is recorded2iThe travel distance L of each ultrasonic wave2i＝(T2iX V)/2, V is the speed of the ultrasonic wave in the air, thereby measuring a data set L of ultrasonic wave echoes2n＝{L2i,T2i}i＝1,NAnd i is a natural number.
Third ultrasonic module 3 is used for surveying the distance of the right-hand barrier of stick apart from the stick, and specifically speaking, N sound waves are launched to the right side through third ultrasonic module 3 of the right-hand setting of stick, and after the sound wave met the right-hand barrier, return and give third ultrasonic module 3 to the round trip time T of note every sound wave3iThe travel distance L of each ultrasonic wave3i＝(T3iX V)/2, V is the speed of the ultrasonic wave in the air, thereby measuring a data set L of ultrasonic wave echoes3n＝{L3i,T3i}i＝1,NAnd i is a natural number.
The processor is used for comparing the distance between the obstacles detected by the first ultrasonic module 1, the second ultrasonic module 2 and the third ultrasonic module 3 and the walking stick with the preset safety distanceAnd obtaining an obstacle avoidance result, specifically, when the distance between the obstacle and the walking stick is less than the preset safe distance, the obstacle is required to be avoided. That is, the cane determines the distance to the front, left and right in real time as L1n、L2nAnd L3nWhen the middle distance is smaller than the preset safety distance, the voice broadcasting module 5 warns, and an obstacle needs to be avoided.
The camera module 4 is used for collecting the environment image in real time, that is, the camera module 4 collects the environment condition information around the blind person. Preferably, the walking stick body is further provided with a Wi-Fi module 8, and the Wi-Fi module 8 is used for sending the environment image acquired by the camera module in real time to the processor.
The processor is also used for inputting the environment image collected by the camera module 4 into the traffic light identification model and outputting the traffic light identification result, specifically, the processor intercepts the obtained environment condition information into each frame of picture, then inputs each frame of picture into the traffic light identification model and outputs the traffic light identification result, and the invention can also realize the navigation function of passing through the traffic lights of the crossroads.
As a preferred embodiment, the traffic light identification model is constructed as follows:
acquiring a plurality of training data sets, and inputting the training data sets into a machine learning model to obtain a traffic light identification model capable of outputting a traffic light identification result; wherein, a plurality of training data sets include red light training data set and green light training data set, and red light training data set includes the environment photo and the label that this environment photo of sign contains the red light, and green light training data set includes the environment photo and the label that this environment photo of sign contains the green light.
The treater still is used for carrying out voice navigation according to traffic lights discernment result and keep away barrier result control voice broadcast module and remind, specifically includes:
when the red light and the green light are identified as red light, the condition of no traffic is judged, the forward moving is stopped for reminding, and the blind waits in place;
when the red and green light identification result is a green light and the distance between the obstacle and the walking stick is smaller than a preset safety distance, stopping advancing reminding is carried out;
and when the red and green light recognition result is a green light and the distance between the obstacle and the walking stick is not less than the preset safety distance, carrying out normal forward reminding.
Preferably, the traffic light identification model can also identify a traffic light time signal, namely, digital information of the number of seconds of the traffic light is identified, then the number of seconds of the green light is compared with a preset passable time threshold, and if the fact that the length of the green light cannot enable the blind to pass through the intersection is judged, the blind stops advancing and is reminded.
Preferably, the processor selected for use in the present invention is a raspberry pi processor.
As a preferred embodiment of the invention, the walking stick body is also provided with a GPS positioning module 6, and the GPS positioning module 6 is connected with the processor; the GPS positioning module 6 is used for acquiring the position information of the walking stick body and sending the acquired position information of the walking stick body to the processor, the processor is also used for storing the position information of the walking stick body, and meanwhile, the processor sends the position information of the walking stick body to other mobile terminals. If the blind person gets lost, the family members of the blind person can search through the positioning information of the GPS positioning module 6.
Preferably, a trip path may be preset in the processor, and when the positioning information of the GPS positioning module 6 deviates from the preset trip path, the processor controls the voice broadcasting module 5 to perform voice prompt.
As a preferred embodiment of the invention, the walking stick body is also provided with a bluetooth module 7, and the bluetooth module 7 is connected with the processor; the Bluetooth module 7 is used for sending the voice navigation reminding information to the Bluetooth terminal equipment. For example, the bluetooth terminal device is a bluetooth headset worn by the blind, the bluetooth module 7 sends the voice navigation reminding information to the bluetooth headset, and after the voice reminding of the language broadcasting module 5 cannot be heard by the blind in a noisy environment, the bluetooth headset can be used for reminding. In the process that the blind person uses the intelligent blind guiding walking stick, the current environment condition is not required to be judged by feeling or experience, and the judgment is only required to be made according to the information fed back by the blind guiding walking stick, so that the safety of the weak people in the walking process can be improved, and the running speed and the running range are accelerated.
As a preferred embodiment of the present invention, the walking stick body is further provided with a power module 9 and a switch module 10, wherein the power module 9 is used for supplying power to the first ultrasonic module 1, the second ultrasonic module 2, the third ultrasonic module 3, the camera module 4, the voice broadcast module 5, the GPS positioning module 6, the bluetooth module 7, the Wi-Fi module 8, the switch module 10 and the processor. The switch module 10 is used for controlling the on/off of the power supply module. When the power supply is stopped, the power supply module 9 is timely disconnected by using the switch module 10 to achieve a power saving mode, so that resources are saved.
Preferably, as shown in fig. 1, the blind guiding walking stick of the present invention is further equipped with a wireless charging seat 11, and a wireless charging connector is disposed at the bottom of the walking stick body and is used for charging the power module 9 in cooperation with the wireless charging seat 11.
In one embodiment, the blind guiding walking stick can automatically run according to the running mode preset by the raspberry pi processor only by manually pressing the function key, and only the Bluetooth module part in the device needs to be manually triggered for connection.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A multifunctional intelligent blind-guiding walking stick based on machine vision is characterized by comprising a walking stick body, wherein a first ultrasonic module, a second ultrasonic module, a third ultrasonic module, a camera module, a voice broadcasting module and a processor are arranged on the walking stick body, and the first ultrasonic module, the second ultrasonic module, the third ultrasonic module, the voice broadcasting module and the camera module are respectively connected with the processor;
the first ultrasonic module is used for detecting the distance between an obstacle in front of the walking stick and the walking stick;
the second ultrasonic module is used for detecting the distance between an obstacle on the left of the walking stick and the walking stick;
the third ultrasonic module is used for detecting the distance between an obstacle on the right of the walking stick and the walking stick;
the camera module is used for acquiring an environment image in real time;
the processor is used for inputting the environment image acquired by the camera module into a traffic light identification model and outputting a traffic light identification result; the distance between the obstacle and the walking stick detected by the first ultrasonic module, the second ultrasonic module and the third ultrasonic module is compared with a preset safety distance to obtain an obstacle avoidance result; and the voice broadcasting module is also used for controlling the voice broadcasting module to carry out voice navigation reminding according to the traffic light identification result and the obstacle avoidance result.
2. The multifunctional intelligent machine vision-based blind-guiding cane as claimed in claim 1, wherein the comparing of the distance between the obstacle detected by the first ultrasonic module, the second ultrasonic module and the third ultrasonic module and the cane with a preset safety distance to obtain an obstacle avoidance result specifically comprises:
and when the distance between the obstacle and the walking stick is less than the preset safety distance, the obstacle needs to be avoided.
3. The multifunctional intelligent blind guiding walking stick based on machine vision as claimed in claim 2, wherein the voice broadcasting module is controlled to perform voice navigation reminding according to the traffic light recognition result and the obstacle avoidance result, and the method specifically comprises the following steps:
when the traffic light identification result is a red light, performing advancing stopping reminding;
when the traffic light identification result is a green light and the distance between the obstacle and the walking stick is smaller than a preset safety distance, stopping advancing reminding is carried out;
and when the traffic light recognition result is a green light and the distance between the obstacle and the walking stick is not less than the preset safety distance, carrying out normal forward reminding.
4. The multifunctional intelligent machine vision-based blind guiding cane as claimed in claim 1, wherein the traffic light recognition model is constructed by the following method:
acquiring a plurality of training data sets, and inputting the training data sets into a machine learning model to obtain a traffic light identification model capable of outputting a traffic light identification result; the training data sets comprise a red light training data set and a green light training data set, the red light training data set comprises an environment photo and a label for identifying that the environment photo contains a red light, and the green light training data set comprises an environment photo and a label for identifying that the environment photo contains a green light.
5. The multifunctional intelligent machine vision-based blind-guiding walking stick according to claim 1, characterized in that a GPS positioning module is further arranged on the walking stick body, and the GPS positioning module is connected with the processor;
the GPS positioning module is used for acquiring the position information of the walking stick body; the processor is also configured to store positional information of the cane body.
6. The multifunctional intelligent machine vision-based blind-guiding walking stick according to claim 1, characterized in that a Bluetooth module is further arranged on the walking stick body, and the Bluetooth module is connected with the processor;
the Bluetooth module is used for sending the voice navigation reminding information to Bluetooth terminal equipment.
7. The multifunctional intelligent machine vision-based blind-guiding cane as claimed in claim 1, wherein a Wi-Fi module is further disposed on the cane body, and the Wi-Fi module is configured to send the environmental image collected by the camera module in real time to the processor.
8. The multifunctional intelligent machine vision-based blind-guiding cane of claim 1, wherein a power module is further disposed on the cane body, and the power module is configured to supply power to the first ultrasonic module, the second ultrasonic module, the third ultrasonic module, the camera module, the voice broadcast module, and the processor.
9. The multifunctional intelligent machine vision-based blind guiding cane as claimed in claim 8, wherein a switch module is further arranged on the cane body and used for controlling the on-off of the power supply module.
10. The multifunctional intelligent machine vision-based blind-guiding cane as claimed in claim 8, wherein the blind-guiding cane is further equipped with a wireless charging base.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110640462.XA CN113208883A (en) | 2021-06-08 | 2021-06-08 | Multi-functional intelligent blind-guiding walking stick based on machine vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110640462.XA CN113208883A (en) | 2021-06-08 | 2021-06-08 | Multi-functional intelligent blind-guiding walking stick based on machine vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113208883A true CN113208883A (en) | 2021-08-06 |
Family
ID=77083247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110640462.XA Pending CN113208883A (en) | 2021-06-08 | 2021-06-08 | Multi-functional intelligent blind-guiding walking stick based on machine vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113208883A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113975109A (en) * | 2021-10-19 | 2022-01-28 | 苏州炳旭工业产品设计有限公司 | Intelligent visual impairment identification method and application |
| KR102476742B1 (en) * | 2022-07-29 | 2022-12-14 | 충북대학교 산학협력단 | Walking stick for the visually impaired that can detect pedestrian traffic lights and obstacles |
| CN116158950A (en) * | 2023-03-01 | 2023-05-26 | 中航华东光电（上海）有限公司 | Intelligent navigation system with voice reminding function |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203139050U (en) * | 2013-03-19 | 2013-08-21 | 浙江理工大学 | Multifunctional intelligent blind-guide walking stick |
| CN205094948U (en) * | 2015-09-04 | 2016-03-23 | 吉安伊斯德纳科技有限公司 | Blind stick is led to intelligence vision |
| KR101708144B1 (en) * | 2016-01-12 | 2017-02-17 | 한국해양대학교 산학협력단 | Braille Block Pattern Recognition System Equipped Stick for The Visually Handicappde Person |
| CN207575415U (en) * | 2017-03-14 | 2018-07-06 | 南京信息工程大学 | A kind of intelligent blind-guiding crutch |
| CN208598763U (en) * | 2017-07-27 | 2019-03-15 | 西南大学 | A kind of blind person's multifunctional stick |
| CN209048611U (en) * | 2017-12-10 | 2019-07-02 | 吴得佑 | The walking stick for having obstacle detection and intelligent navigation |
| CN110575371A (en) * | 2019-10-22 | 2019-12-17 | 大连民族大学 | intelligent blind-guiding walking stick and control method |
| CN213157517U (en) * | 2020-07-31 | 2021-05-11 | 陕西科技大学 | Intelligent visual identification blind-guiding walking stick based on Internet of things |
-
2021
- 2021-06-08 CN CN202110640462.XA patent/CN113208883A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203139050U (en) * | 2013-03-19 | 2013-08-21 | 浙江理工大学 | Multifunctional intelligent blind-guide walking stick |
| CN205094948U (en) * | 2015-09-04 | 2016-03-23 | 吉安伊斯德纳科技有限公司 | Blind stick is led to intelligence vision |
| KR101708144B1 (en) * | 2016-01-12 | 2017-02-17 | 한국해양대학교 산학협력단 | Braille Block Pattern Recognition System Equipped Stick for The Visually Handicappde Person |
| CN207575415U (en) * | 2017-03-14 | 2018-07-06 | 南京信息工程大学 | A kind of intelligent blind-guiding crutch |
| CN208598763U (en) * | 2017-07-27 | 2019-03-15 | 西南大学 | A kind of blind person's multifunctional stick |
| CN209048611U (en) * | 2017-12-10 | 2019-07-02 | 吴得佑 | The walking stick for having obstacle detection and intelligent navigation |
| CN110575371A (en) * | 2019-10-22 | 2019-12-17 | 大连民族大学 | intelligent blind-guiding walking stick and control method |
| CN213157517U (en) * | 2020-07-31 | 2021-05-11 | 陕西科技大学 | Intelligent visual identification blind-guiding walking stick based on Internet of things |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113975109A (en) * | 2021-10-19 | 2022-01-28 | 苏州炳旭工业产品设计有限公司 | Intelligent visual impairment identification method and application |
| KR102476742B1 (en) * | 2022-07-29 | 2022-12-14 | 충북대학교 산학협력단 | Walking stick for the visually impaired that can detect pedestrian traffic lights and obstacles |
| CN116158950A (en) * | 2023-03-01 | 2023-05-26 | 中航华东光电（上海）有限公司 | Intelligent navigation system with voice reminding function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113208883A (en) | Multi-functional intelligent blind-guiding walking stick based on machine vision | |
| CN106859929B (en) | A kind of Multifunctional blind person guiding instrument based on binocular vision | |
| CN107168320B (en) | Tour guide service robot | |
| US20150379896A1 (en) | Intelligent eyewear and control method thereof | |
| Islam et al. | Automated walking guide to enhance the mobility of visually impaired people | |
| CN205094948U (en) | Blind stick is led to intelligence vision | |
| CN111035542A (en) | Intelligent blind guiding system based on image recognition | |
| CN106214436A (en) | A kind of intelligent blind guiding system based on mobile phone terminal and blind-guiding method thereof | |
| Patel et al. | Multisensor-based object detection in indoor environment for visually impaired people | |
| CN111643324A (en) | Intelligent glasses for blind people | |
| US10062302B2 (en) | Vision-assist systems for orientation and mobility training | |
| KR20150097043A (en) | Smart System for a person who is visually impaired using eyeglasses with camera and a cane with control module | |
| Alwi et al. | Survey on outdoor navigation system needs for blind people | |
| WO2023061927A1 (en) | Method for notifying a visually impaired user of the presence of object and/or obstacle | |
| Ilag et al. | Design review of Smart Stick for the Blind Equipped with Obstacle Detection and Identification using Artificial Intelligence | |
| Zahir et al. | Implementing and testing an ultrasonic sensor based mobility aid for a visually impaired person | |
| Manjari et al. | CREATION: Computational constRained travEl aid for objecT detection in outdoor eNvironment | |
| JP6500139B1 (en) | Visual support device | |
| Hossain et al. | State of the art review on walking support system for visually impaired people | |
| Srinivas et al. | A new method for recognition and obstacle detection for visually challenged using smart glasses powered with Raspberry Pi | |
| CN114533503B (en) | Glasses system for intelligent blind-assisting travel and interaction method | |
| Shaikh et al. | Smart Helmet for Visually Impaired | |
| Ahmed et al. | An interactive device for ambient awareness on sidewalk for visually impaired | |
| CN112263448A (en) | Blind guiding equipment and blind guiding method | |
| Prathipa et al. | Ultrasonic waist-belt for visually impaired person |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210806 |