CN114029966A - Barrier-free communication action system for blind persons in area - Google Patents
Barrier-free communication action system for blind persons in area Download PDFInfo
- Publication number
- CN114029966A CN114029966A CN202111140432.9A CN202111140432A CN114029966A CN 114029966 A CN114029966 A CN 114029966A CN 202111140432 A CN202111140432 A CN 202111140432A CN 114029966 A CN114029966 A CN 114029966A
- Authority
- CN
- China
- Prior art keywords
- blind
- robot
- module
- area
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 15
- 230000009471 action Effects 0.000 title claims abstract description 12
- 230000000007 visual effect Effects 0.000 claims abstract description 13
- 230000003993 interaction Effects 0.000 claims abstract description 10
- 238000001514 detection method Methods 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000002265 prevention Effects 0.000 claims description 3
- 238000010276 construction Methods 0.000 description 4
- 239000003795 chemical substances by application Substances 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- RWSOTUBLDIXVET-UHFFFAOYSA-N Dihydrogen sulfide Chemical compound S RWSOTUBLDIXVET-UHFFFAOYSA-N 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000011065 in-situ storage Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/008—Manipulators for service tasks
Abstract
The present invention relates to: a barrier-free communication action system for blind persons in an area is characterized in that: the blind person positioning system comprises a robot, a blind person positioning tag and a space positioning tag, wherein the robot positions the blind person through the blind person positioning tag, and the space positioning tag marks the space position; the robot is internally provided with a super computer, a voice interaction module, an autonomous navigation module, a face recognition module and a visual tracking image detection module, wherein the super computer acquires information of each module and controls an execution device of each module to act. The invention has the following advantages: the barrier-free communication action system for the blind in the area can determine who the blind is, determine the position of the blind, and automatically find the blind to carry out close-fitting guiding service by the robot, thereby providing safe passing service for the blind and carrying out paid service for illiterates who cannot see the way at all.
Description
Technical Field
The invention relates to the technical field of barrier-free facilities, in particular to a barrier-free communication action system for blind persons in an area.
Background
In daily life, because the blind person cannot visually acquire and sense environmental information like normal people, the difficulty and inconvenience of daily life are caused to the special crowd, electronic display screens are generally arranged in hospitals, large supermarkets, airports and other places to navigate customers, but the blind person cannot confirm own direction and route by looking at a mobile terminal screen.
The barrier-free facility construction is a mark of the country and social civilization, the country highly pays attention to the barrier-free environment construction, and the barrier-free environment construction is well-entrenched and hard to mission. The important function of information barrier-free environment construction on vulnerable groups such as the disabled is highlighted in the epidemic situation period, and the disabled cannot be out of service in the information era.
Disclosure of Invention
The invention aims to solve the technical problem and provide a barrier-free communication action system for the blind in an area, which is convenient for providing barrier-free communication service for the blind.
In order to solve the technical problems, the technical scheme provided by the invention is as follows: a barrier-free communication action system for blind persons in an area is characterized in that: the blind person positioning system comprises a robot, a blind person positioning tag and a space positioning tag, wherein the robot positions the blind person through the blind person positioning tag, and the space positioning tag marks the space position; the robot is internally provided with a super computer, a voice interaction module, an autonomous navigation module, a face recognition module and a visual tracking image detection module, wherein the super computer acquires information of each module and controls an execution device of each module to act.
Furthermore, a visual touch screen display module is further arranged in the robot and used for customizing certain business contents.
Furthermore, the voice interaction module comprises a voice collector, a voice player and a memory, wherein the voice collector collects the voice instruction of the blind person, the voice instruction is analyzed and judged by the super computer to be answered, the voice instruction is played by the voice player to customize and input relevant questions and answers, the memory stores a large amount of voice conversations, and the background voice database stores a large amount of voice conversations to answer simple questions.
Furthermore, the autonomous navigation module comprises a laser radar, an ultrasonic sensor, a gyroscope and a falling prevention device, the obstacles are mutually combined and identified in the moving process of the robot, the blind person can be safely and accurately brought to a specified position, space positioning labels are arranged at the specified position, and a map is correspondingly recorded in a background.
Furthermore, the face recognition module comprises a camera, and the camera collects face information of the blind, uploads the face information to the background face database and is used for tracking the blind and recognizing and confirming the blind next time.
Further, the visual tracking image detection module carries out visual tracking according to actual conditions, the robot keeps a certain distance and walks together with the human, and interaction is continued when the human needs; and move left and right according to the left and right movement of the person; and the video monitoring is carried out in real time by combining with a camera in the face recognition module.
Furthermore, the robots can be arranged in a plurality according to needs, and all the robots are interconnected.
Further, the blind person positioning label can be a mobile phone card or a special positioning chip.
The invention has the following advantages: the barrier-free communication action system for the blind in the area can determine who the blind is, determine the position of the blind, and automatically find the blind to carry out close-fitting guiding service by the robot, thereby providing safe passing service for the blind and carrying out paid service for illiterates who cannot see the way at all.
Drawings
FIG. 1 is a diagram of an activity area distribution of an unobstructed communication action system for blind persons in an area according to the present invention.
FIG. 2 is a system flowchart of an obstacle-free communication action system for blind people in an area according to the present invention.
FIG. 3 is a system block diagram of the barrier-free communication mobile system for blind persons in a region for a hospital according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to examples.
A barrier-free communication action system for blind persons in an area comprises a robot, a blind person positioning tag and a space positioning tag, wherein the robot positions the blind persons through the blind person positioning tag, and the space positioning tag marks the space positions; the robot is internally provided with a super computer, a voice interaction module, an autonomous navigation module, a face recognition module and a visual tracking image detection module, wherein the super computer acquires information of each module and controls an execution device of each module to act.
And a visual touch screen display module is also arranged in the robot and used for customizing certain service contents.
The voice interaction module comprises a voice collector, a voice player and a memory, wherein the voice collector collects voice instructions of the blind, the voice instructions are analyzed and judged by the super computer to be answered, the instructions are played by the voice player, relevant questions and answers can be input in a customized mode, the instructions are stored by the memory, a background voice database stores a large number of voice conversations, and simple questions can be answered.
The autonomous navigation module comprises a laser radar, an ultrasonic sensor, a gyroscope and a falling prevention device, and is used for mutually combining and identifying barriers in the moving process of the robot, so that the blind can be safely and accurately brought to a specified position, space positioning tags are arranged at the specified position, a map is correspondingly recorded in the background, (an all-dimensional map is manufactured according to the space positioning tags, and the space positioning tags are electronic tags).
The face recognition module comprises a camera, and the camera collects face information of the blind, uploads the face information to the background face database and is used for tracking the blind and recognizing and confirming the blind next time.
The visual tracking image detection module carries out visual tracking according to actual conditions, the robot keeps a certain distance, walks together with the human body, and continues to carry out interaction when the human body needs; and move left and right according to the left and right movement of the person; and the video monitoring is carried out in real time by combining with a camera in the face recognition module.
The robot can set up a plurality ofly as required, and interconnect between each robot.
The blind person positioning label can be a special positioning chip or a mobile phone card.
Example 1
The blind person positioning label is a special positioning chip, and the chip can be made into a bracelet, a chest card or the like, so that articles can be conveniently identified.
The method is characterized in that a special positioning chip is adopted, the face of the blind person needs to be input before the blind person enters a gate, the positioning chip is configured, and the positioning chip needs to be returned after the blind person is used, wherein the two steps are respectively called an early-stage manual service step and a later-stage positioning chip returning step.
Example 2
The blind person positioning tag is a mobile phone card: when the blind people transact the mobile phone card, the blind people's mobile phone card is marked by adopting a special mobile phone card or in the cloud.
When the mobile phone card is used as the blind person positioning label, early-stage manual service is not needed, and the blind person positioning label is returned with a later-stage positioning chip.
Example 3
And paid services can be provided for illiterates who can not see the road at all, similar to the embodiment 1, payment is carried out before entering a gate, face entry is carried out, a positioning chip is configured, and the positioning chip needs to be returned after use.
When the method is implemented, the steps are as follows: 1. early-stage manual service; 2. the method comprises the following steps: the blind/illiterate enters the gate, the robot walks to the side of the robot according to the information of the positioning chip to recognize the face of the robot, and after the recognition is successful, the robot calls the call by voice; 3. and (3) guiding: the blind or the illiterate speaks a place to be visited or items to be handled, a super computer in the robot carries out analysis and judgment, then the robot is controlled to move to lead the blind or the illiterate to reach the corresponding place, and the blind or the illiterate is led to return to a gate after handling the agency; 4. returning to a rest area: and returning to the rest area to wait for the next task.
The method comprises the steps of guiding, selecting a leg running agent, standing the blind/illiterate in situ or being guided to a rest area by a robot, assisting the robot to agent, finding the blind/illiterate through the blind positioning label position after the agent is finished, and determining a service object through face recognition after the blind/illiterate reaches the blind position.
The blind/illiterate can have conversation and communication with the robot in the service process.
The invention can be used in hospitals, airports, large supermarkets and the like, and the hospitals:
providing a service with a road for the blind; help the blind to get the medicine; the blind person is taken to a ward; carrying the blind person to test; the blind person is carried to a toilet; according to the positioning of the blind and the face, the robot can run back by legs and can also find the blind to continue to serve until the blind leaves the hospital, and the robot returns to a rest area and waits for the next blind to come to serve. The system can also serve illiterate people who cannot see the road at all and carry out paid service.
Airport:
providing a service with a road for the blind; the blind person can change the ticket; the blind person can pass security inspection; a waiting area for the blind is provided; the blind person is carried to a toilet; go to a supermarket or restaurant with the blind; the blind people are sent out of the airport; the system can also serve illiterate blindness which can not see the road at all, and carry out paid service.
Although the invention has been described in detail hereinabove with respect to a general description and specific embodiments thereof, it will be apparent to those skilled in the art that modifications or improvements may be made thereto based on the invention. Accordingly, such modifications and improvements are intended to be within the scope of the invention as claimed.
Claims (8)
1. A barrier-free communication action system for blind persons in an area is characterized in that: the blind person positioning system comprises a robot, a blind person positioning tag and a space positioning tag, wherein the robot positions the blind person through the blind person positioning tag, and the space positioning tag marks the space position; the robot is internally provided with a super computer, a voice interaction module, an autonomous navigation module, a face recognition module and a visual tracking image detection module, wherein the super computer acquires information of each module and controls an execution device of each module to act.
2. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: and a visual touch screen display module is also arranged in the robot and used for customizing certain service contents.
3. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: the voice interaction module comprises a voice collector, a voice player and a memory, wherein the voice collector collects voice instructions of the blind, the voice instructions are analyzed and judged by the super computer to be answered, the instructions are played by the voice player, relevant questions and answers can be input in a customized mode, the instructions are stored by the memory, a background voice database stores a large number of voice conversations, and simple questions can be answered.
4. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: the autonomous navigation module comprises a laser radar, an ultrasonic sensor, a gyroscope and a falling prevention device, and is used for identifying obstacles in a moving process of the robot in a mutual combination manner, bringing the blind to a specified position safely and accurately, setting space positioning labels at the specified position, and correspondingly recording a map in a background.
5. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: the face recognition module comprises a camera, and the camera collects face information of the blind, uploads the face information to the background face database and is used for tracking the blind and recognizing and confirming the blind next time.
6. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: the visual tracking image detection module carries out visual tracking according to actual conditions, the robot keeps a certain distance, walks together with the human body, and continues to carry out interaction when the human body needs; and move left and right according to the left and right movement of the person; and the video monitoring is carried out in real time by combining with a camera in the face recognition module.
7. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: the robot can set up a plurality ofly as required, and interconnect between each robot.
8. The system of claim 1 for blind people to communicate without obstruction in an area, wherein: the blind person positioning label can be a mobile phone card or a special positioning chip.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111140432.9A CN114029966A (en) | 2021-09-28 | 2021-09-28 | Barrier-free communication action system for blind persons in area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111140432.9A CN114029966A (en) | 2021-09-28 | 2021-09-28 | Barrier-free communication action system for blind persons in area |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114029966A true CN114029966A (en) | 2022-02-11 |
Family
ID=80140296
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111140432.9A Pending CN114029966A (en) | 2021-09-28 | 2021-09-28 | Barrier-free communication action system for blind persons in area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114029966A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101073531A (en) * | 2007-04-19 | 2007-11-21 | 上海交通大学 | System for guiding blind in exhibition |
| CN103126862A (en) * | 2013-02-04 | 2013-06-05 | 江苏科技大学 | Outdoor blind guiding robot based on global position system (GPS), general packet radio service (GPRS) and radio frequency identification devices (RFID) and navigational positioning method |
| WO2016086441A1 (en) * | 2014-12-04 | 2016-06-09 | 上海交通大学 | Indoor positioning system for totally blind population |
| CN107773395A (en) * | 2016-08-24 | 2018-03-09 | 南京乐朋电子科技有限公司 | Glasses for guiding blind based on automatic station-keeping system |
| CN108527379A (en) * | 2018-03-29 | 2018-09-14 | 上海理工大学 | A kind of station service for blind readers robot |
| CN108555922A (en) * | 2018-03-29 | 2018-09-21 | 上海理工大学 | A kind of airport service for blind readers robot |
| WO2019232806A1 (en) * | 2018-06-08 | 2019-12-12 | 珊口（深圳）智能科技有限公司 | Navigation method, navigation system, mobile control system, and mobile robot |
| CN113370225A (en) * | 2021-05-31 | 2021-09-10 | 山东新一代信息产业技术研究院有限公司 | Blind person guiding service robot system |
-
2021
- 2021-09-28 CN CN202111140432.9A patent/CN114029966A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101073531A (en) * | 2007-04-19 | 2007-11-21 | 上海交通大学 | System for guiding blind in exhibition |
| CN103126862A (en) * | 2013-02-04 | 2013-06-05 | 江苏科技大学 | Outdoor blind guiding robot based on global position system (GPS), general packet radio service (GPRS) and radio frequency identification devices (RFID) and navigational positioning method |
| WO2016086441A1 (en) * | 2014-12-04 | 2016-06-09 | 上海交通大学 | Indoor positioning system for totally blind population |
| CN107773395A (en) * | 2016-08-24 | 2018-03-09 | 南京乐朋电子科技有限公司 | Glasses for guiding blind based on automatic station-keeping system |
| CN108527379A (en) * | 2018-03-29 | 2018-09-14 | 上海理工大学 | A kind of station service for blind readers robot |
| CN108555922A (en) * | 2018-03-29 | 2018-09-21 | 上海理工大学 | A kind of airport service for blind readers robot |
| WO2019232806A1 (en) * | 2018-06-08 | 2019-12-12 | 珊口（深圳）智能科技有限公司 | Navigation method, navigation system, mobile control system, and mobile robot |
| CN113370225A (en) * | 2021-05-31 | 2021-09-10 | 山东新一代信息产业技术研究院有限公司 | Blind person guiding service robot system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Sato et al. | NavCog3 in the wild: Large-scale blind indoor navigation assistant with semantic features | |
| Triebel et al. | Spencer: A socially aware service robot for passenger guidance and help in busy airports | |
| Ganz et al. | INSIGHT: RFID and Bluetooth enabled automated space for the blind and visually impaired | |
| Doering et al. | User-centered design and evaluation of a mobile shopping robot | |
| US8594935B2 (en) | Systems, methods, and software for providing wayfinding orientation and wayfinding data to blind travelers | |
| Yang et al. | Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments | |
| US6477463B2 (en) | Multiple node navigation and routing system for a domain to be user navigated | |
| US20070252695A1 (en) | Systems And Methods For Locating Hospital Assets | |
| Giudice et al. | Evaluation of an accessible, real-time, and infrastructure-free indoor navigation system by users who are blind in the mall of america | |
| Lee et al. | Opportunities for human-AI collaboration in remote sighted assistance | |
| KR102143549B1 (en) | System for health pilot and method thereof | |
| JP2007048132A (en) | Visitor guidance system for large-scale facility, such as airport | |
| Duarte et al. | Information and assisted navigation system for blind people | |
| Alnafessah et al. | Developing an ultra wideband indoor navigation system for visually impaired people | |
| Hersh | Mobility technologies for blind, partially sighted and deafblind people: Design issues | |
| Kim et al. | Mobile applications for assisting mobility for the visually impaired using IoT infrastructure | |
| JP2021179802A (en) | Boarding/alighting support guidance system | |
| Theodorou et al. | Gaining insight for the design, development, deployment and distribution of assistive navigation systems for blind and visually impaired people through a detailed user requirements elicitation | |
| Macik et al. | Smartphoneless context-aware indoor navigation | |
| Zahabi et al. | Design of navigation applications for people with disabilities: A review of literature and guideline formulation | |
| Mau et al. | BlindAid: An electronic travel aid for the blind | |
| CN114029966A (en) | Barrier-free communication action system for blind persons in area | |
| Fixova et al. | In-hospital navigation system for people with limited orientation | |
| JP2004024305A (en) | Autonomous driving type support device, and program | |
| US20220254481A1 (en) | System and method for customized augmented reality navigation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240111 Address after: Room 503, 5th Floor, Building 3, No. 38 Linfeng Second Road, Haidian District, Beijing, 100000 Applicant after: Yuanyu Internet (Beijing) Technology Co.,Ltd. Address before: 503B, building 3, yard 38, Linfeng 2nd Road, Greenland Central Plaza, Sujiatuo Town, Haidian District, Beijing 100095 Applicant before: Beijing Xianyu Technology Co.,Ltd. |