CN112120898A - Intelligent blind guiding system with binocular vision - Google Patents
Intelligent blind guiding system with binocular vision Download PDFInfo
- Publication number
- CN112120898A CN112120898A CN202010858962.6A CN202010858962A CN112120898A CN 112120898 A CN112120898 A CN 112120898A CN 202010858962 A CN202010858962 A CN 202010858962A CN 112120898 A CN112120898 A CN 112120898A
- Authority
- CN
- China
- Prior art keywords
- binocular vision
- binocular
- blind guiding
- main controller
- guiding system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 claims abstract description 29
- 238000005516 engineering process Methods 0.000 claims abstract description 6
- 230000005236 sound signal Effects 0.000 claims abstract description 4
- 238000001514 detection method Methods 0.000 claims description 4
- HPTJABJPZMULFH-UHFFFAOYSA-N 12-[(Cyclohexylcarbamoyl)amino]dodecanoic acid Chemical group OC(=O)CCCCCCCCCCCNC(=O)NC1CCCCC1 HPTJABJPZMULFH-UHFFFAOYSA-N 0.000 claims description 3
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 claims description 3
- 230000002431 foraging effect Effects 0.000 claims description 3
- 229910001416 lithium ion Inorganic materials 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 238000003466 welding Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 abstract description 4
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/1604—Head
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/165—Wearable interfaces
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
Abstract
The invention relates to an intelligent binocular vision blind guiding system which comprises binocular vision glasses and a safety protection helmet, wherein the binocular vision glasses comprise binocular cameras and speakers, the safety protection helmet comprises a power supply, a main controller, a GPS module and an alarm circuit, the binocular vision glasses send image information collected by the binocular cameras on two glasses lenses to the safety protection helmet through cables between the binocular vision glasses and the safety protection helmet, the main controller of the safety protection helmet receives signals and correspondingly processes the signals, the processed results are transmitted to the speakers of the binocular vision glasses through the cables, and the speakers convert electric signals transmitted back by the cables into sound signals to be read out, so that blind guiding is performed. According to the technical scheme, the latest binocular vision technology is applied to the field of intelligent blind guiding, the pressure of a blind guiding dog is greatly reduced, the blind guiding dog is convenient to carry, and a safe and convenient trip mode is provided for the blind.
Description
Technical Field
The invention belongs to the technical field of wearable intelligent guidance, and relates to a binocular vision intelligent blind guiding system.
Background
The blind people are the weak group of the whole society, and due to the lack of vision, the blind people can encounter a lot of inconveniences in real life, for example, the blind people do not have the sense of direction, are easy to lose the direction, are easy to be knocked down by the pedestrians in hurry, and are easy to be knocked by the cars flying on the roads. Although many measures are taken in the market for the situation, such as a blind stick, a guide dog and the like, the training process of one guide dog is as long as 18 months, the comprehensive cost is $ 2.5 to $ 3 ten thousand, and the training process not only takes a lot of time, but also is expensive. Some intelligent blind guiding systems gradually appear in the market at present, but the intelligent blind guiding systems are generally realized by using the mature ultrasonic technology, although some intelligent blind guiding systems also use machine vision, and utilize an image processing module, the intelligent blind guiding systems are generally monocular, and human is binocular vision, and the same object is observed by two eyes from different angles, so that a monocular vision device cannot simulate the processing of human eyes on image information.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides an intelligent binocular vision blind guiding system which comprises binocular vision glasses and a safety helmet, wherein the binocular vision glasses comprise binocular cameras and loudspeakers, the safety helmet comprises a power supply, a main controller, a GPS module and an alarm circuit, the binocular vision glasses send image information acquired by the binocular cameras on two glasses lenses to the safety helmet through cables between the binocular vision glasses and the safety helmet, the main controller of the safety helmet receives signals and correspondingly processes the signals, then the processed results are transmitted to the loudspeakers of the binocular vision glasses through the cables, and the loudspeakers convert electric signals transmitted back by the cables into sound signals to be read out, so that blind guiding is performed.
According to the binocular vision intelligent blind guiding system, the main controller is used for receiving the images transmitted by the binocular cameras, then image processing, image recognition and image matching are carried out through the internal CPU, and obstacle detection, pedestrian detection and vehicle matching are further completed, so that the recognition information is transmitted to the blind through the loudspeaker.
According to the binocular vision intelligent blind guiding system, the GPS module and the alarm circuit of the main controller are supplemented, the main controller is integrated with a China mobile NB-IOT Internet of things module, information can be transmitted by using data traffic GPRS, a network of a specific hospital is connected in advance, when the safety protection helmet is severely impacted, the alarm circuit is started, the network of the hospital is connected through the NB-IOT Internet of things module, and meanwhile GPS information is sent to the network.
According to the binocular vision intelligent blind guiding system, the binocular camera is a MYNT EYE S model small-foraging binocular camera of Smart technologies, Inc.
According to the binocular vision intelligent blind guiding system, the MYNT EYE S model small-foraging binocular camera has 1504 × 480/600 high frame number resolution, 150-degree visual field identification angle, identification depth of 1-20m and 120mm base line length, and an interface between the helmet and the camera is a USB data transmission interface.
The binocular vision intelligent blind guiding system according to the present invention, wherein the speakers employ YDR27-2 model headphone speakers of wu jin yue electro-acoustic equipment ltd.
According to the binocular vision intelligent blind guiding system, a three-layer structure is arranged at the top of the safety protection helmet, the first layer structure is a safety protection structure of the helmet, the second layer is a power supply placing room, and the third layer is a main controller placing room.
The binocular vision intelligent blind guiding system is characterized in that the safety helmet is red.
According to the binocular vision intelligent blind guiding system, the power supply is a lithium ion battery, and can be charged and discharged to provide electric quantity required by operation for the whole system.
According to the binocular vision intelligent blind guiding system, the main controller is an embedded platform TX1 of NVIDIA company, a GPU with 256 built-in CUDA cores, a 64-bit ARM, a 4GB memory, a 16GB flash memory, a built-in Bluetooth module, a wireless module, a USB interface and a gigabit Ethernet card.
According to the binocular vision intelligent blind guiding system, the binocular camera is connected with the binocular vision glasses through the threaded fastener, and the loudspeaker is fixed on the binocular vision glasses through welding.
According to the binocular vision intelligent blind guiding system, the small foraging binocular camera is connected with the main controller through a USB interface, or is connected with the main controller through a gigabit network port; the loudspeaker is connected with the main controller through an audio cable; the power supply is connected with the main controller through a power line; the GPS module and the alarm circuit are connected with the main controller through a USB interface.
The invention has the beneficial effects that:
according to the technical scheme, the latest binocular vision technology is applied to the field of intelligent blind guiding, the pressure of a blind guiding dog is greatly reduced, the blind guiding dog is convenient to carry, and a safe and convenient trip mode is provided for the blind.
Drawings
FIG. 1 is a schematic structural diagram of an intelligent binocular vision blind guiding system of the present invention;
FIG. 2 is a side view of the binocular intelligent blind guiding system of the present invention;
fig. 3 is a three-dimensional perspective view of the binocular vision intelligent blind guiding system of the present invention.
Detailed Description
The invention will be further illustrated with reference to the following specific examples. It should be understood that the examples are only for illustrating the present invention and are not intended to limit the scope of the present invention. In addition, it should be understood that various changes or modifications can be made by those skilled in the art after reading the disclosure of the present invention, and such equivalents also fall within the scope of the invention.
The invention provides an intelligent binocular vision blind guiding system which comprises binocular vision glasses 102 and a safety protection helmet 101, wherein the binocular vision glasses 102 are composed of a binocular camera 201 and a loudspeaker 202, and the safety protection helmet 101 is composed of a power supply 204, a main controller 205, a GPS module and an alarm circuit.
As shown in fig. 1, the binocular vision glasses 102 transmit image information collected by the two cameras 201 on the glasses to the safety helmet 101 through the cable 203 between the binocular vision glasses and the safety helmet, the main controller 205 of the safety helmet 101 receives the signal and performs corresponding processing, the processing result is transmitted to the speaker 202 of the binocular vision glasses 102 through the cable 203, and the speaker 202 converts the electric signal transmitted back by the cable 203 into a sound signal to be read out, so as to guide blind people.
Preferably, binocular camera 201 adopts MYNT EYE S model small foraging binocular camera of smart technology ltd, and this camera has 1504 × 480/600 high frame number resolution, 150 visual field identification angle, 1-20 m' S identification depth and 120mm baseline length, can realize the scope wider, and the shooting of picture quality is more clear for binocular vision intelligence leads blind system precision is higher, and the response is more rapid.
Preferably, the speaker 202 is a model YDR27-2 headphone speaker of wu-jin yue electroacoustic equipment ltd, which has a small size and high sensitivity and is convenient for the blind to use.
Preferably, the binocular camera 201 is connected to the binocular vision glasses 102 by a threaded fastener, and the speaker 202 is fixed to the binocular vision glasses 102 by welding.
Preferably, the top of the safety helmet 101 has a three-layer structure, the first layer structure is a safety protection structure of the helmet and provides necessary protection for the head of the blind; the second layer is a power supply placing room for storing a power supply 204 for providing the whole set of system for working; the third layer is a master controller room for storing the master controllers 205 of the whole system.
Preferably, the safety helmet is red, so that the safety helmet can attract attention of others and reduce accidents.
Preferably, the power source 204 is a lithium ion battery, which can be charged and discharged to provide the whole system with the electric quantity required for operation.
Preferably, the main controller is an embedded platform TX1 of NVIDIA corporation, a GPU with 256 built-in CUDA cores, a 64-bit ARM, a 4GB memory, a 16GB flash memory, a built-in bluetooth module, a wireless module, a USB interface, and a gigabit ethernet card.
The GPS module and the alarm circuit of the main controller supplement each other, the main controller integrates an NB-IOT Internet of things module of China mobile, information can be transmitted by using data flow GPRS, a network of a specific hospital is connected in advance, when the safety protection helmet is severely impacted, the alarm circuit is started, the network of the hospital is connected through the NB-IOT Internet of things module, and meanwhile GPS information is sent to the network.
Preferably, the binocular camera 201 may be connected to the main controller 205 through a USB interface, or connected to the main controller 205 through a gigabit network port; the speaker 202 is connected to the main controller 205 through an audio line; the power supply 204 is connected with the main controller 205 through a power line; the GPS module and the alarm circuit are connected to the main controller 205 through a USB interface.
The embodiments of the present invention have been described above. However, the present invention is not limited to the above embodiment. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (12)
1. The utility model provides a blind system is led to intelligence of binocular vision, its characterized in that, includes binocular vision glasses and safety helmet, binocular vision glasses comprises binocular camera and speaker, the safety helmet comprises power, main control unit, GPS module and alarm circuit, image information that binocular vision glasses gathered the binocular camera on two lenses sends through the cable between binocular vision glasses and the safety helmet and gives the safety helmet, safety helmet's main control unit received signal to corresponding processing back, will handle the result and pass through the speaker that the cable passes to binocular vision glasses, the speaker will the signal of telecommunication that the cable passed back is converted into sound signal and reads out, carries out the blind person with this and leads blind person.
2. The binocular vision intelligent blind guiding system of claim 1, wherein the main controller is configured to receive the images transmitted by the binocular cameras, and then perform image processing, image recognition and image matching through an internal CPU, thereby completing obstacle detection, pedestrian detection and vehicle matching, and transmitting the recognition information to the blind through a speaker.
3. The binocular vision intelligent blind guiding system of claim 2, wherein the GPS module is supplemented with an alarm circuit of a main controller, and the main controller is integrated with a china mobile NB-IOT internet of things module, can transmit information using data traffic GPRS, and connects a network of a specific hospital in advance, and when the safety helmet is severely impacted, the alarm circuit is activated, connects the network of the hospital through the NB-IOT internet of things module, and simultaneously transmits GPS information to the network.
4. The binocular vision intelligent blind guiding system of claim 3, wherein the binocular camera is a MYNT EYE S model foraging binocular camera of smart technologies ltd.
5. The binocular vision intelligent blind guiding system of claim 4, wherein the camera is a MYNT EYE S model Mini-foraging binocular camera with 1504 × 480/600 high frame number resolution, 150 ° visual field recognition angle, recognition depth of 1-20m and 120mm base length, and the interface with the safety helmet is a USB data transmission interface.
6. The binocular vision intelligent blind guiding system of claim 5, wherein the speakers are model YDR27-2 headphone speakers of wu jingyou electro-acoustic equipment ltd.
7. The binocular vision intelligent blind guiding system of claim 6, wherein the top of the safety helmet has a three-layer structure, the first layer is a safety protection structure of the helmet, the second layer is a power supply placing room, and the third layer is a main controller placing room.
8. The binocular-vision intelligent blind guiding system of claim 7, wherein the safety helmet is red.
9. The binocular vision intelligent blind guiding system according to claim 8, wherein the power supply is a lithium ion battery which can be charged and discharged to provide the electric quantity required by the operation of the whole system.
10. The binocular vision intelligent blind guiding system of claim 9, wherein the main controller is an embedded platform TX1 of NVIDIA corporation, a GPU with 256 built-in CUDA cores, a 64-bit ARM, a 4GB memory, a 16GB flash memory, a built-in bluetooth module, a wireless module, a USB interface and a gigabit ethernet card.
11. The binocular vision intelligent blind guiding system of claim 10, wherein the binocular camera is connected with binocular vision glasses through a threaded fastener, and the speakers are fixed on the binocular vision glasses through welding.
12. The binocular vision intelligent blind guiding system of claim 11, wherein the mini-foraging binocular camera is connected with the main controller through a USB interface, or is connected with the main controller through a gigabit network port; the loudspeaker is connected with the main controller through an audio cable; the power supply is connected with the main controller through a power line; the GPS module and the alarm circuit are connected with the main controller through a USB interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010858962.6A CN112120898A (en) | 2020-08-24 | 2020-08-24 | Intelligent blind guiding system with binocular vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010858962.6A CN112120898A (en) | 2020-08-24 | 2020-08-24 | Intelligent blind guiding system with binocular vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112120898A true CN112120898A (en) | 2020-12-25 |
Family
ID=73847432
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010858962.6A Pending CN112120898A (en) | 2020-08-24 | 2020-08-24 | Intelligent blind guiding system with binocular vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112120898A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113377097A (en) * | 2021-01-25 | 2021-09-10 | 杭州易享优智能科技有限公司 | Path planning and obstacle avoidance method for blind person guide |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203105763U (en) * | 2013-03-18 | 2013-08-07 | 孙大伟 | Direction-guiding helmet |
| EP3141234A1 (en) * | 2014-05-09 | 2017-03-15 | BOE Technology Group Co., Ltd. | Spectacles for blind person |
| CN109381329A (en) * | 2018-12-18 | 2019-02-26 | 成都理工大学 | A kind of intelligent blind-guiding helmet and its operation method |
| CN110236895A (en) * | 2019-05-10 | 2019-09-17 | 苏州米特希赛尔人工智能有限公司 | AI blind men navigation spectacles |
| CN209405201U (en) * | 2018-07-11 | 2019-09-20 | 福建（泉州）哈工大工程技术研究院 | A kind of intelligent apparatus of assisting blind navigation |
| CN110638615A (en) * | 2019-10-17 | 2020-01-03 | 南京工程学院 | Intelligent navigation helmet for blind people to go out |
-
2020
- 2020-08-24 CN CN202010858962.6A patent/CN112120898A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203105763U (en) * | 2013-03-18 | 2013-08-07 | 孙大伟 | Direction-guiding helmet |
| EP3141234A1 (en) * | 2014-05-09 | 2017-03-15 | BOE Technology Group Co., Ltd. | Spectacles for blind person |
| CN209405201U (en) * | 2018-07-11 | 2019-09-20 | 福建（泉州）哈工大工程技术研究院 | A kind of intelligent apparatus of assisting blind navigation |
| CN109381329A (en) * | 2018-12-18 | 2019-02-26 | 成都理工大学 | A kind of intelligent blind-guiding helmet and its operation method |
| CN110236895A (en) * | 2019-05-10 | 2019-09-17 | 苏州米特希赛尔人工智能有限公司 | AI blind men navigation spectacles |
| CN110638615A (en) * | 2019-10-17 | 2020-01-03 | 南京工程学院 | Intelligent navigation helmet for blind people to go out |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113377097A (en) * | 2021-01-25 | 2021-09-10 | 杭州易享优智能科技有限公司 | Path planning and obstacle avoidance method for blind person guide |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106859929A (en) | A kind of Multifunctional blind person guiding instrument based on binocular vision | |
| CN104983511A (en) | Voice-helping intelligent glasses system aiming at totally-blind visual handicapped | |
| CN104000709A (en) | Glasses for blind people | |
| CN206039075U (en) | Intelligence translation glasses | |
| CN108169927A (en) | A kind of glasses for guiding blind based on binocular stereo vision | |
| CN205994698U (en) | A kind of intelligent helmet and intelligent guidance system | |
| CN109199808B (en) | Intelligent walking stick for blind based on computer vision | |
| CN204972147U (en) | Blind person navigation based on kinect | |
| CN111643324A (en) | Intelligent glasses for blind people | |
| CN106652505B (en) | A kind of dysopia pedestrian's street crossing guidance system based on intelligent glasses | |
| CN102835964A (en) | Glasses for acquiring fatigue driving physiological signal transmitted via Bluetooth | |
| CN211209824U (en) | Intelligent security monitoring system for community | |
| CN109471263A (en) | A kind of Gait Recognition intelligent glasses | |
| CN107450575A (en) | Flight control system and there is its aircraft | |
| CN106817577B (en) | One kind is based on RGB-D cameras and stereosonic visually impaired people's barrier early warning glasses | |
| CN112120898A (en) | Intelligent blind guiding system with binocular vision | |
| CN106937909A (en) | A kind of intelligent assisting blind glasses system | |
| TW201629924A (en) | Visual assistant system and wearable device having the same | |
| CN210776078U (en) | Real-time navigation bluetooth glasses | |
| CN210078040U (en) | Intelligent blind guiding device | |
| CN211095815U (en) | Multifunctional intelligent blind guiding system for glasses | |
| CN204515275U (en) | Post-positioned pick-up head formula rear-view eyeglass | |
| CN206549026U (en) | Fire-fighting remote measuring and controlling system | |
| CN209899996U (en) | Blind guiding system based on video communication | |
| CN212723535U (en) | Individual glasses and individual system for intelligent operation and maintenance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201225 |