CN112353652A - Intelligent blind guiding system - Google Patents
Intelligent blind guiding system Download PDFInfo
- Publication number
- CN112353652A CN112353652A CN202011149210.9A CN202011149210A CN112353652A CN 112353652 A CN112353652 A CN 112353652A CN 202011149210 A CN202011149210 A CN 202011149210A CN 112353652 A CN112353652 A CN 112353652A
- Authority
- CN
- China
- Prior art keywords
- control system
- android
- blind
- central control
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/068—Sticks for blind persons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
- A61H2003/063—Walking aids for blind persons with electronic detecting or guiding means with tactile perception
Abstract
The invention belongs to the technical field of blind guiding and image recognition, and particularly relates to an intelligent blind guiding system which comprises a central control system, an image recognition system and an android control system; the central control system and the image recognition system are arranged on the intelligent blind guiding stick of the blind person, and the android control system is stored on the mobile phone of the blind person family; the central control system receives and controls various modules by utilizing the ARM chip, and interacts with the image recognition system and the android control system to realize corresponding functions; the image recognition system mainly acquires environment and road condition data through a camera, recognizes the data by using an algorithm and returns a final result to the central control system; the android control system realizes the instruction of the family to the blind guiding stick through the interaction with the central control system, or the blind guiding stick transmits the real-time information of the blind to the family. The system of the invention makes the blind guiding stick more intelligent and makes the blind go out more safely.
Description
Technical Field
The invention belongs to the technical field of blind guiding and image recognition, and particularly relates to an intelligent blind guiding system.
Background
At home, about more than 500 million blind people account for 18 percent of the total blind people all over the world, and how to safely go out becomes the biggest problem in the life of the blind people. At present, most blind people mainly rely on blind guiding sticks, blind guiding dogs and other blind guiding facilities. The traditional blind guiding stick mainly judges the road condition of a small range in front by knocking the ground by a wooden stick, can only be used for judging a very limited distance and can only judge obstacles on the ground or with lower height
In recent years, with the development of electronic technology, some new blind guiding stick processing schemes appear in the market, and a novel module and a microprocessor are added, so that the blind guiding stick becomes more intelligent. However, the blind guiding stick mainly based on ultrasonic ranging can only detect a sector area in front, can only simply monitor the high-altitude obstacle in front, and cannot achieve accuracy, which is not enough for the blind to ensure safety.
Disclosure of Invention
The invention aims to provide a blind guiding system based on an artificial intelligence embedded chip, so that the obstacle in front of a blind person can be judged more accurately, and family members can also provide help for the blind person, so that the blind person can go out more safely, and the problems that the blind person is difficult to go out and is unsafe to go out at present are solved.
The invention provides a blind guiding system based on an artificial intelligent embedded chip, which comprises: the system comprises a central control system, an image recognition system and an android control system; the central control system and the image recognition system are arranged on an intelligent blind guiding stick of the blind person, and the android control system is stored on a mobile phone of a blind person family; wherein:
the central control system receives and controls various modules by utilizing the ARM chip and realizes corresponding functions by interacting with the image recognition system and the android control system;
the image recognition system mainly acquires environment and road condition data through a camera, recognizes the data by using an algorithm and returns a final result to the central control system;
the android control system can realize that the family gives the instruction of the blind guiding stick through the interaction with the central control system, and can also enable the blind guiding stick to transmit the real-time information of the blind to the family.
Further, the central control system comprises an ultrasonic module, a positioning module, a voice module, a six-axis acceleration module, a WIFI module, a vibration module and a microprocessor; wherein:
the ultrasonic module is used for sending and receiving ultrasonic signals, obtaining distance information and transmitting the distance information to the central control system; the distance information here is a high level indicating the time for the ultrasonic wave to return, and the microprocessor knows the ultrasonic wave running time by capturing the length of the high level and multiplies it by the sound velocity to obtain the distance.
And the positioning module is used for positioning through the GPS and sending positioning information to the microprocessor through the serial port.
The voice module is connected with the microprocessor through a serial port, receives the command of the microprocessor and broadcasts different voices according to different commands.
And the six-axis acceleration module is used for monitoring six-axis information of the blind guiding stick and transmitting the six-axis information to the microprocessor through the serial port.
And the WIFI module is used for the mutual communication between the central control system and the android control system.
The vibration module acquires road condition information through different vibration frequencies and reminds the blind people of the current road condition.
The microprocessor is the core of the central control system, and has the main functions of integrating the data of each module and utilizing the data to complete the required functions; the method comprises the following steps: judging a barrier in front by using the monitored ultrasonic distance, alarming by using a voice module, and reminding the blind by using a vibration module; judging whether the blind person falls down or not by using the monitored six-axis information, and sending help seeking information to an android system by using a WIFI module; if the android terminal requests to check the position information, the microprocessor sends the detected GPS position information to the android system through the WIFI module.
The microprocessor is a singlechip with ARM as an inner core.
Further, the image recognition system comprises a reading system, a recognition system, a communication system and a control system.
The reading system collects the actual scene by using the camera and continuously transmits the data to the control system.
And the identification system identifies the acquired image, finds out the barrier and outputs the barrier to the control system.
And the communication system transmits the information of the control system to the central control system through the serial port.
The control system is developed in a Linux environment, can efficiently train and identify images, and then transmits the monitored obstacle information to the central control system through a serial port.
Further, the android control system comprises an early warning function, a positioning function and a communication function; wherein:
the android control system is mainly used for providing APP for families, and the families can use android mobile phones for installation.
The communication function can enable the android system to receive the position information and the alarm information transmitted by the central control system in real time, and can also send instructions, such as voice prompt, to the android system according to the requirements of a user.
The early warning function is to display the warning information by receiving the warning information transmitted by the central control system in real time and using the pop-up window and vibration of the mobile phone.
The positioning function is that a request is sent to the central control system through the android control system, the central control system returns own position information to the android system, and the android system can display the position information of the blind on a screen.
Further, deep learning is used for recognition in an image recognition system.
According to the blind guiding system, on the basis of a conventional intelligent blind guiding stick, a plurality of ultrasonic waves are used for ranging, so that a processor can process more comprehensive environmental information; judging whether the person falls down by using a six-axis accelerator; in order to ensure accurate judgment of road conditions, a latest artificial intelligence embedded chip is added in the system, and the chip can be used for identifying images in front of the blind and judging obstacles.
The intelligent blind guiding stick has the advantages that the functions are added to the intelligent blind guiding stick, and meanwhile, the blind person can automatically or actively send out help to the family when encountering some dangers or ineffectiveness, so that the invention also provides an android APP used by the family, the family can know the safety of the blind person at any time, and the position of the blind person can be obtained through the GPS.
The system of the invention makes the blind guiding stick more intelligent and makes the blind go out more safely.
Drawings
Fig. 1 is a basic schematic block diagram of an intelligent blind guiding system provided by the invention.
Fig. 2 is a basic schematic block diagram of the central control system provided by the present invention.
Fig. 3 is a basic block diagram of an image recognition system provided by the present invention.
FIG. 4 is a basic functional block diagram of an android control system provided by the present invention.
Fig. 5 is a basic flow chart of the intelligent blind guiding system provided by the invention.
Detailed Description
The technical solution of the present invention will be further described with reference to the following specific embodiments and accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses an embedded intelligent blind guiding system, which comprises a central control system, an image recognition system and an android control system, and is shown in the attached figures 1-5. The central control system and the image recognition system are positioned on an intelligent blind guiding stick of the blind; and the android control system is arranged on a mobile phone of a blind person family and is connected into the whole system through WIFI. The central control system comprises various modules and a microprocessor, and mainly utilizes an ARM chip to receive and control the various modules and interacts with the image recognition system and the android control system to realize corresponding functions. Firstly, comprehensively analyzing the front environment through the result of image recognition and the result of monitoring by the ultrasonic module, and then reminding the blind person of a barrier in front through the voice module and the vibration module; meanwhile, when the blind person walks, the information of the blind person guiding stick is monitored at any time by using the six-axis sensor, whether the blind person falls down is judged, and alarm information is sent to an android control system through the WIFI module if the blind person falls down; when a position request of the android system is received, the position information obtained by the GPS module can be sent to the android control system through the WIFI module. The image recognition system mainly shoots the scene picture in real time through the camera, puts the shot picture into a model trained in advance, and sends the finally judged barrier information to the central control system through the serial port. The android control system is mainly used for family members of the blind, is mainly used for monitoring alarm information transmitted by the central control system in real time, and can be switched to an inquiry interface to check the position of the blind if the family members want to check the position of the blind, and then the android control system can receive the GPS position of the blind from the central processing system. Therefore, when the blind person goes out, various barriers can be avoided, and when the blind person encounters danger, the family can provide help in time.
Further, the central control system includes: the device comprises an ultrasonic module, a positioning module, a voice module, a six-axis acceleration module, a WIFI module, a vibration module and a microprocessor.
The ultrasonic module is used for sending and receiving ultrasonic signals and can return distance information. When the microprocessor wants to obtain whether an obstacle exists in front of the ultrasonic module, the microprocessor sends a pulse to the ultrasonic module, the ultrasonic module starts to emit ultrasonic waves and sets the pin high, and when the returned ultrasonic waves are received, the pin is set low. Therefore, the time for the microprocessor to start detecting the high level of the pin after a pulse is sent to the ultrasonic module can obtain the round-trip time of the ultrasonic wave, and then the round-trip time is divided by two and multiplied by the sound velocity to obtain the distance of the obstacle in front of the ultrasonic wave.
The positioning module carries out positioning through a GPS, and after initialization is completed, the module can automatically receive GPS positioning information including longitude and latitude and UTC time and finally sends the information to the microprocessor through a serial port.
The voice module prestores a plurality of sections of voices, is connected with the microprocessor through the serial port, and can control the voice module to broadcast different information through the serial port when the microprocessor needs voice broadcast information.
The six-axis acceleration module transmits six-axis information of the blind guiding stick to the microprocessor through the serial port. The instantaneous deviation of the triaxial acceleration of the robot is calculated, whether the robot is abnormal or not is judged according to the square root of the angular velocity, and whether the robot falls or not is comprehensively analyzed according to the image and the obstacle information.
The WIFI module is used for enabling the central control system and the android control system to communicate with each other.
The vibration module reminds the blind people of different road conditions through different vibration frequencies. We can set different duty cycles to represent different information, the closer the obstacle is, the higher the duty cycle, the larger the amplitude of the vibration.
The microprocessor is the core of the central control system, uses an ARM series processor, and the main function is to integrate the data of each module and use them to complete the required functions, such as: the method comprises the steps of judging a barrier in front by utilizing a monitored ultrasonic distance, alarming by utilizing a voice module and reminding the blind by utilizing a vibration module; judging whether the blind person falls down or not by using the monitored six-axis information, and sending help seeking information to an android system by using a WIFI module; if the android terminal requests to check the position information, the microprocessor sends the detected GPS position information to the android system through the WIFI module;
further, the image recognition system can be classified into an image reading system, a recognition system, a communication system, and a control system.
The reading system is mainly used for collecting the actual scene by the calling camera in the early stage and continuously transmitting data to the control system.
And identifying the acquired image, finding out the barrier and outputting the barrier to the control system.
The communication system transmits the information of the control system to the central control system through the serial port.
The device used by the control system is Jetson Nano, comprises a latest artificial intelligent embedded chip, is developed in a Linux environment, can train and identify images efficiently, and before the control system is used, a common barrier and a background of the common barrier are firstly input into a frame of a deep learning model for training to obtain a model with high accuracy. After the model is trained, data read by the camera in real time are led into the model, the model can automatically obtain information of the obstacle, and then the obstacle information output by the model is transmitted to a central control system through a serial port, wherein the information comprises the distance, the size, the height and the type of the obstacle.
Further, the android control system comprises an early warning function, a positioning function and a communication function.
The android control system mainly provides APP for family use, and the family can be installed and used by using an android mobile phone. At ordinary times, software can run at the background, normal use of the mobile phone is not hindered, when the blind person encounters danger, the APP can automatically pop up information, and the family can open the inquiry function to inquire the position information of the blind person, so that help can be provided for the blind person in time.
The communication function can enable the android system to receive the position information and the alarm information transmitted by the central control system in real time, and can also send instructions, such as voice prompt, to the android system according to the requirements of a user.
The early warning function displays the warning information by receiving the warning information transmitted by the central control system in real time and using the pop-up window and vibration of the mobile phone.
The positioning function sends a request to the central control system through the android control system, the central control system returns own position information to the android system, and the android system can display the position information of the blind on a screen.
Claims (5)
1. An intelligent blind guiding system, comprising: the system comprises a central control system, an image recognition system and an android control system; the central control system and the image recognition system are arranged on an intelligent blind guiding stick of the blind person, and the android control system is stored on a mobile phone of a blind person family; wherein:
the central control system receives and controls various modules by utilizing the ARM chip and realizes corresponding functions by interacting with the image recognition system and the android control system;
the image recognition system mainly acquires environment and road condition data through a camera, recognizes the data by using an algorithm and returns a final result to the central control system;
the android control system realizes the instruction of the family to the blind guiding stick through the interaction with the central control system, or the blind guiding stick transmits the real-time information of the blind to the family.
2. The intelligent blind guiding system of claim 1, wherein the central control system comprises an ultrasonic module, a positioning module, a voice module, a six-axis acceleration module, a WIFI module, a vibration module and a microprocessor; wherein:
the ultrasonic module is used for sending and receiving ultrasonic signals, obtaining distance information and transmitting the distance information to the central control system; the distance information is a high level which indicates the time of transmitting and returning the ultrasonic wave, and the microprocessor acquires the running time of the ultrasonic wave by capturing the length of the high level and multiplies the running time by the sound velocity to obtain the distance;
the positioning module is used for positioning through a GPS and sending positioning information to the microprocessor through a serial port;
the voice module is connected with the microprocessor through a serial port, receives commands of the microprocessor and broadcasts different voices according to different commands;
the six-axis acceleration module is used for monitoring six-axis information of the blind guiding stick and transmitting the six-axis information to the microprocessor through the serial port;
the WIFI module is used for the mutual communication between the central control system and the android control system;
the vibration module acquires road condition information through different vibration frequencies and reminds the blind of the current road condition;
the microprocessor has the main functions of integrating data of all modules and utilizing the data to complete required functions; the method comprises the following steps: judging a barrier in front by using the monitored ultrasonic distance, alarming by using a voice module, and reminding the blind by using a vibration module; judging whether the blind person falls down or not by using the monitored six-axis information, and sending help seeking information to an android system by using a WIFI module; if the android terminal requests to check the position information, the microprocessor sends the detected GPS position information to the android system through the WIFI module;
the microprocessor is a singlechip with ARM as an inner core.
3. The intelligent blind guiding system as claimed in claim 2, wherein the image recognition system comprises a reading system, a recognition system, a communication system and a control system; wherein:
the reading system acquires an actual scene by using the camera and continuously transmits data to the control system;
the identification system identifies the acquired image, finds out the barrier and outputs the barrier to the control system;
the communication system transmits the information of the control system to the central control system through a serial port;
the control system uses Jetson Nano which comprises a latest artificial intelligent embedded chip, is developed in a Linux environment, is used for efficiently training and identifying images, and then transmits monitored obstacle information to the central control system through a serial port.
4. The intelligent blind guiding system according to claim 3, wherein the android control system comprises an early warning function, a positioning function and a communication function; wherein:
the android control system is mainly an APP provided for the family of the blind to use, and the family can be installed and used by using an android mobile phone;
the communication function is that the android system receives the position information and the alarm information transmitted by the central control system in real time, and sends an instruction to the android system according to the requirement of a user;
the early warning function is to display the warning information by receiving the warning information transmitted by the central control system in real time and using the pop-up window and vibration of the mobile phone;
the positioning function is that a request is sent to the central control system through the android control system, the central control system returns own position information to the android system, and the android system can display the position information of the blind on a screen.
5. The intelligent blind guiding system of claim 4, wherein the image recognition system uses deep learning for recognition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011149210.9A CN112353652A (en) | 2020-10-23 | 2020-10-23 | Intelligent blind guiding system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011149210.9A CN112353652A (en) | 2020-10-23 | 2020-10-23 | Intelligent blind guiding system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112353652A true CN112353652A (en) | 2021-02-12 |
Family
ID=74511998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011149210.9A Pending CN112353652A (en) | 2020-10-23 | 2020-10-23 | Intelligent blind guiding system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112353652A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115376279A (en) * | 2022-08-17 | 2022-11-22 | 山东浪潮科学研究院有限公司 | Low-power consumption intelligent auxiliary system based on tinyML |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015143203A1 (en) * | 2014-03-19 | 2015-09-24 | Schepens Eye Research Institute | Active confocal imaging systems and methods for visual prostheses |
| CN105232295A (en) * | 2015-10-16 | 2016-01-13 | 北京机械设备研究所 | Intelligent guiding system for obstacle avoidance |
| CN108309708A (en) * | 2018-01-23 | 2018-07-24 | 李思霈 | Blind-man crutch |
| CN109646258A (en) * | 2019-02-26 | 2019-04-19 | 西南科技大学 | A kind of blind-guiding stick, blind guiding system and blind-guiding method |
-
2020
- 2020-10-23 CN CN202011149210.9A patent/CN112353652A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015143203A1 (en) * | 2014-03-19 | 2015-09-24 | Schepens Eye Research Institute | Active confocal imaging systems and methods for visual prostheses |
| CN105232295A (en) * | 2015-10-16 | 2016-01-13 | 北京机械设备研究所 | Intelligent guiding system for obstacle avoidance |
| CN108309708A (en) * | 2018-01-23 | 2018-07-24 | 李思霈 | Blind-man crutch |
| CN109646258A (en) * | 2019-02-26 | 2019-04-19 | 西南科技大学 | A kind of blind-guiding stick, blind guiding system and blind-guiding method |
Non-Patent Citations (1)
| Title |
|---|
| 沈金鑫等: "《创客教育丛书 Arduino探究实验》", 30 September 2017, 北京航空航天大学出版社 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115376279A (en) * | 2022-08-17 | 2022-11-22 | 山东浪潮科学研究院有限公司 | Low-power consumption intelligent auxiliary system based on tinyML |
| WO2024036958A1 (en) * | 2022-08-17 | 2024-02-22 | 山东浪潮科学研究院有限公司 | Tinyml-based low-power-consumption intelligent assistance system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10826646B2 (en) | System and method for triggering an alarm during a sensor jamming attack | |
| CN201127606Y (en) | Portable system for testing fall of human body | |
| CN106214436A (en) | A kind of intelligent blind guiding system based on mobile phone terminal and blind-guiding method thereof | |
| US20060129308A1 (en) | Management and navigation system for the blind | |
| KR101218257B1 (en) | Method for detecting invasion of wild animal using radar and system thereof | |
| CN103839373A (en) | Sudden abnormal event intelligent identification alarm device and system | |
| CN104822042A (en) | Camera-based pedestrian safety detection method and device | |
| CN106383518A (en) | Multi-sensor tunnel robot obstacle avoidance control system and method | |
| CN103366565A (en) | Method and system of detecting pedestrian running red light based on Kinect | |
| CN102830676A (en) | Remote agricultural supervisory system based on wireless network and intelligent monitoring vehicle | |
| CN103909826A (en) | Optimization method for collaboratively sensing violation behavior of drivers | |
| CN107274003A (en) | A kind of wisdom fire-fighting management system and its control method | |
| US11717231B2 (en) | Ultrasound analytics for actionable information | |
| CN102915618A (en) | Safety monitoring method applicable to school buses and system thereof | |
| WO2022142973A1 (en) | Robot protection system and method | |
| CN108597186A (en) | A kind of drowning alarming method and wearable device based on user behavior | |
| CN102125742A (en) | Digital firefighting fire scene rescue system | |
| CN205486608U (en) | Fire disaster alarm system | |
| KR101950093B1 (en) | Fire disaster early warning system using beacon | |
| CN106265003A (en) | A kind of smart electronics blind-guide brick and using method thereof | |
| CN112353652A (en) | Intelligent blind guiding system | |
| CN202694517U (en) | Fall alarm instrument | |
| KR101147212B1 (en) | An apparatus, system and method for personal security using circumstance recognition | |
| CN109568093A (en) | A kind of walking safety integrated management system and method | |
| CN110675522A (en) | Multipurpose electronic security inspection system based on unmanned aerial vehicle technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210212 |