CN114569416A - Blind guiding system and method - Google Patents
Blind guiding system and method Download PDFInfo
- Publication number
- CN114569416A CN114569416A CN202011384573.0A CN202011384573A CN114569416A CN 114569416 A CN114569416 A CN 114569416A CN 202011384573 A CN202011384573 A CN 202011384573A CN 114569416 A CN114569416 A CN 114569416A
- Authority
- CN
- China
- Prior art keywords
- blind
- blind guiding
- module
- user
- wearable device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000002452 interceptive effect Effects 0.000 claims abstract description 26
- 238000004891 communication Methods 0.000 claims abstract description 13
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims abstract description 6
- 241001166076 Diapheromera femorata Species 0.000 claims description 10
- 239000011521 glass Substances 0.000 claims description 9
- 238000001514 detection method Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 16
- 230000006870 function Effects 0.000 description 12
- 241000282472 Canis lupus familiaris Species 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 6
- 230000004888 barrier function Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000001771 impaired effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 206010047571 Visual impairment Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000002950 deficient Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011897 real-time detection Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241000253999 Phasmatodea Species 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000013215 result calculation Methods 0.000 description 1
- 210000001202 rhombencephalon Anatomy 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
- 208000029257 vision disease Diseases 0.000 description 1
- 230000004393 visual impairment Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/068—Sticks for blind persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
- G08B21/0208—Combination with audio or video communication, e.g. combination with "baby phone" function
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0277—Communication between units on a local network, e.g. Bluetooth, piconet, zigbee, Wireless Personal Area Networks [WPAN]
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/165—Wearable interfaces
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Child & Adolescent Psychology (AREA)
- Animal Behavior & Ethology (AREA)
- Emergency Management (AREA)
- Rehabilitation Therapy (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Physical Education & Sports Medicine (AREA)
- Multimedia (AREA)
- Pain & Pain Management (AREA)
- Business, Economics & Management (AREA)
- Life Sciences & Earth Sciences (AREA)
- Epidemiology (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Rehabilitation Tools (AREA)
- Traffic Control Systems (AREA)
Abstract
The embodiment of the application provides a blind guiding system and a blind guiding method, wherein the system comprises a handheld device and a wearable device, wherein the handheld device is provided with a button module for sending an interactive instruction to the wearable device; the wearable device comprises a camera module, a wireless communication module, a processor and a voice broadcasting module; the camera module is used for acquiring real-time information of surrounding objects; the wireless communication module is used for receiving the interaction instruction sent by the handheld device; the processor is used for analyzing and processing the real-time information and the interactive instruction to obtain blind guiding suggestion information and sending the blind guiding suggestion information to the voice broadcasting module; the voice broadcasting module is used for receiving the blind guiding suggestion information and broadcasting the blind guiding suggestion information. According to the example blind guiding system and method provided by the application, blind guiding suggestions based on surrounding real-time information can be provided according to the interactive commands of the user.
Description
Technical Field
The present application relates to blind guiding technologies, and in particular, to a blind guiding system and method.
Background
For the crowd with visual disturbance, the traveling problem is always the biggest trouble of the crowd, in order to facilitate the traveling of a user, a blind road is arranged on an urban road, the user determines a walking route according to the touch of feet, a path detecting walking stick is used for obstacle detection under the general condition, obviously, the environment information which can be fed back by the path detecting walking stick is limited, the collision phenomenon occurs at the moment, and the life is seriously possibly threatened.
In the existing blind guiding scheme, a blind guiding dog is mainly used for assisting in going out, and some blind guiding walking sticks based on the modern information technology are also provided. The blind guiding dog is used for assisting in traveling, so that a user group is difficult to cover in a large area. The blind guiding walking stick realizes outdoor blind guiding walking of a user, navigation is carried out based on position information and road condition information of satellite positioning, the actual road condition is more complex, the user can possibly meet the road condition that whether the user can pass or not can not be determined, and the scheme in the prior art can not provide blind guiding suggestions according to the interaction requirements of the user.
Therefore, how to provide a blind guiding system capable of providing navigation suggestions based on real-time surrounding information according to user interaction commands is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The embodiment of the application provides a blind guiding system, which can provide a blind guiding suggestion based on surrounding real-time information according to an interactive command of a user, and can also give the user a reliable use feeling.
In a first aspect, an embodiment of the present application provides a blind guiding system, where the system includes: a handheld device and a wearable device; the handheld device is provided with a button module used for sending an interaction instruction to the wearable device;
the wearable device comprises a camera module, a wireless communication module, a processor and a voice broadcasting module;
the camera module is used for acquiring real-time information of surrounding objects;
the wireless communication module is used for receiving an interactive instruction sent by the handheld equipment;
the processor is used for analyzing and processing the real-time information and the interactive instruction to obtain a blind guiding suggestion and sending the blind guiding suggestion to the voice broadcasting module;
the voice broadcasting module is used for receiving the blind guiding suggestion and broadcasting.
Further, the camera module includes: an AI camera and a TOF camera;
the AI camera is used for identifying a shot object; the TOF camera is used to detect the distance of surrounding objects.
Further, the wearing equipment still includes: the voice recognition module is used for receiving a voice instruction sent by a user and recognizing the voice instruction to obtain a voice recognition result; the processor determines blind guiding suggestions according to the voice recognition result.
Further, the wearing equipment still includes: the human body posture sensing module is used for sensing the body posture information of the user; the processor determines blind guiding suggestions according to the body posture information.
Further, the wearing equipment still includes: and the positioning navigation module is used for providing blind guiding information through a satellite positioning system.
Further, the handheld device further comprises: and the Bluetooth module is used for sending an interaction instruction to the wearable device through Bluetooth.
Further, the button module includes: the blind guiding suggestion button is used for controlling the blind guiding system to broadcast the blind guiding suggestion;
and the voice switch button is used for starting a voice function so that a user can control the blind guiding system through voice.
Further, the blind guiding suggestion button includes: a forward direction blind guiding button, a left turn direction blind guiding button and a right turn direction blind guiding button.
Further, still include: the power supply device comprises a first power supply module used for supplying power to the handheld device and a second power supply module used for supplying power to the wearable device.
Further, the handheld device includes a cane; the wearable device comprises glasses.
In a second aspect, an embodiment of the present application provides a blind guiding method, where the method includes:
the wearable device receives an interactive instruction sent by the handheld device;
the wearable device controls the camera module to acquire real-time information of surrounding objects according to the interactive instruction;
the wearable device obtains blind guiding suggestion information according to the real-time information;
the wearable device broadcasts the blind guiding suggestion information through the loudspeaker module.
Further, the wearing equipment receives the interactive instruction that handheld device sent, includes:
the wearable device receives the interactive instruction sent by the handheld device in a wireless communication mode.
The blind guiding system and the blind guiding method provided by the embodiment of the application can provide the blind guiding suggestion based on the surrounding real-time information according to the interactive command of the user, provide guarantee for the traveling safety of the user, and greatly improve the safety of the user.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a blind guiding system provided in an embodiment of the present application;
fig. 2 is a schematic diagram of a working process of a blind guiding system according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a handheld device in a blind guiding system according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a wearable device in a blind guiding system provided in an embodiment of the present application;
fig. 5 is a schematic view illustrating a process of determining a surrounding object by a blind guiding system according to an embodiment of the present application;
fig. 6 is a schematic view of a detection area of a wearable device in a blind guiding system according to an embodiment of the present application;
fig. 7 is a schematic flowchart of a blind guiding method according to an embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are merely illustrative of, and not restrictive on, the present application. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Visual impairment has a serious impact on the quality of human life. The problem of traveling has been one of the important problems troubling users or people with impaired vision due to lack of vision. How to provide an effective blind guiding system or method has always been the focus of attention in society, for this reason, the urban road is provided with blind roads, and users determine walking routes by the touch of feet; usually, the user is assisted by the pathfinding stick to perform obstacle detection, and obviously, the environmental information which can be fed back by the pathfinding stick is limited.
Through the auxiliary trip of the guide dog, a person is required to be capable of receiving the guide dog and live together with the guide dog, and the problem that the individual difference of the person and the number of the guide dogs are limited (the guide dog needs professional training and needs to intervene in the life of a user) is considered, so that the large-area coverage of a user group is difficult.
Through current guide's stick, guide supplementary trip of blind robot, mainly rely on locating information to navigate to the user, send pronunciation warning to the user through the earphone, still be provided with distance sensor on some equipment, devices such as radar survey the barrier, to the user, there are motion and static object in the environment of body department, there is the sound state condition of can changing over at any time also, the condition on the current road of result that leads to the unable accurate reaction of result of surveying, for example, a certain user walks on the blind road, if the blind road has the bicycle to drive over or the blind road accounts for this moment, the user can't judge whether can go forward safely, if vehicle driver does not notice user's trend, come too late to make a response, lead to taking place accident.
Therefore, there is a need for a blind guiding system or method that can provide blind guiding suggestions based on real-time surrounding information according to user interaction commands.
In order to solve the prior art problems, the embodiment of the application provides a blind guiding system and a blind guiding method, a vision-deficient user can actively interact with the blind guiding system to obtain a blind guiding suggestion based on surrounding real-time information, and walks according to the suggestion, so that the traveling safety of the vision-deficient user is guaranteed, and the safety of the user is improved.
First, a blind guiding system provided in the embodiments of the present application will be described below.
Fig. 1 is a schematic structural diagram of a blind guiding system according to an embodiment of the present application. As shown in fig. 1, the system may include: handheld device 100 and wearable device 200;
the handheld device 100 is provided with a button module 110 for sending an interactive instruction to the wearable device 200;
the wearable device 200 includes a camera module 210, a wireless communication module 220, a processor 230, and a voice broadcast module 240;
the camera module 210 is used for collecting real-time information of surrounding objects; the wireless communication module 220 is used for receiving an interaction instruction sent by the handheld device; the processor 230 is configured to analyze and process the real-time information and the interactive instruction to obtain a blind guiding suggestion and send the blind guiding suggestion to the voice broadcasting module 240; the voice broadcasting module 240 is used for receiving the blind guiding suggestion and broadcasting.
The blind guiding system provided by the embodiment combines the handheld device and the wearable device, and a user sends an interactive instruction to the wearable device through a button module arranged on the handheld device; the wearable device analyzes and processes surrounding real-time information, road conditions, navigation information and the like according to the interactive instruction to obtain blind guiding suggestions (information) corresponding to the interactive instruction, and then broadcasts the blind guiding suggestions (information) through the voice broadcasting module.
In this embodiment, the handheld device may be a cane, which continues the traditional way of sensing the environment for visually impaired users; through the information interaction between the handheld device, the head-mounted device and the user, the user can intervene in the system, the system provides effective blind guiding suggestions, obstacle reminding, navigation information and the like, the safety of the user can be guaranteed, and the psychological safety of the user can be provided.
In an embodiment of the present application, the camera module 210 may include: AI camera and TOF (Time-of-flight) camera;
the AI camera is used for identifying shot objects or objects, and the TOF camera is used for detecting data such as distances of the objects; for example: the roadside generally has afforestation trees, and the branch is unsettled state, and the stick of exploring the way can't be visited, discerns the branch through the AI camera, and the TOF camera carries out the distance detection simultaneously, and wearing equipment wears overhead, can shoot the region that is close people's eye can observe, and the distance of TOF camera feedback is less than a definite value and is indicateed promptly.
In the embodiment, the AI camera is combined with the TOF camera, so that the identity attribute (mainly the identity attribute refers to what the object is) of the object around the user and the distance between the object and the user can be directly told, and compared with detection means such as a distance sensor and a radar, the information which can be intuitively judged by the user is given; for example: the user has a person in motion in front of the user, the real-time detection result is that the distance is 2 meters … … 2.5.5 meters … … 3 meters … … 2.2.2 meters … … 1.8.8 meters … … 0.9.9 meters … …, if the distance sensor detects that the distance is an object distance in front, then the user is informed of the distance data, and the user needs to judge what the object is, and the user can make correct response under the condition of knowing the surrounding objects through the information provided by the embodiment.
In an embodiment of the present application, the wearable device 200 may further include a voice recognition module 250, configured to receive a voice instruction sent by the user, and recognize the voice instruction to obtain a voice recognition result; processor 230 determines the blind guiding suggestion according to the speech recognition result.
When the user wakes up and turns on the voice control function through the above steps, the voice recognition module 250 receives the voice command of the user, recognizes the voice command to obtain a voice recognition result, and sends the voice recognition result to the processor 230; for example: the user turns on the voice function and gives a voice control instruction by speaking: when the user goes to the nearest bus stop, the voice recognition module 250 recognizes the voice control command, and sends the recognition result to the processor 230, and the navigation information is obtained by the analysis and processing of the processor, and is finally transmitted to the user through the voice broadcast module.
As with the handheld device shown in fig. 3, the button module 110 may include a voice switch button, a left turn button, and a right turn button. The voice switch button can be used for enabling the blind guiding system to switch on a voice control function; the left turn button and the right turn button can be respectively used for interacting with the blind guiding system when a user turns left or turns right to obtain blind guiding suggestions.
Referring to fig. 2, in the working process of the blind guiding system shown in fig. 2, in the present embodiment, a user can perform voice control on the blind guiding system by pressing the voice switch button of the button module 110 to turn on the voice control function. When the user need turn right, can press the button that turns right, handheld device sends this instruction that turns right for wearing equipment through the bluetooth mode to obtain the blind guide suggestion.
In the embodiment, the user can conveniently and effectively control the blind guiding system by a voice recognition mode, and the interaction between the user and the blind guiding system is enhanced. Besides, in the embodiment of the application, a Braille input module can be arranged on the handheld device, and the accuracy of the command is ensured by combining multiple input modes.
In an embodiment of the present application, the wearable device 200 may further include a human body posture sensing module 260 for sensing the body posture information of the user; the processor determines the blind guiding suggestion according to the body posture information.
In this embodiment, the human posture sensing module 260 can also sense the body posture of the user, such as forward, stop, and turn, so that the blind guiding system can provide accurate blind guiding information.
In an embodiment of the present application, the wearable device 200 may further include a positioning navigation module 270 for providing the blind guiding information through a satellite positioning system, for example, providing navigation information, road information, and the like through a beidou positioning system.
In one embodiment of the present application, the button module 110 of the handheld device 100 may include a voice switch button 111 and a blind guide suggestion button 112.
And the voice switch button 111 is used for starting a voice function so that a user can control the blind guiding system through voice.
Blind guidance suggestion buttons 112 may include: the blind guiding system comprises a forward direction blind guiding button, a left turning direction blind guiding button and a right turning direction blind guiding button so that the blind guiding system provides blind guiding information in the corresponding direction.
The blind guiding system provided by an embodiment of the present application may further include a first power module 113 for supplying power to the handheld device 100 and a second power module 270 for supplying power to the wearable device 200.
The first power module 113 and the second power module 270 may be batteries built in the corresponding devices, may be external power sources, or may be in a form of 'built-in + external'.
In the blind guiding system provided by one embodiment of the application, the handheld device can be a walking stick; the wearable device may be glasses; referring to fig. 2 to fig. 6, fig. 2 is a schematic diagram of a working process of the blind guiding system according to the present embodiment; FIG. 3 is a schematic diagram of the structure of the handheld device (cane) provided by the present embodiment; fig. 4 is a schematic view of the wearing device (glasses) provided in the present embodiment; fig. 5 is a schematic view illustrating a process of determining a surrounding object by the blind guiding system according to this embodiment; fig. 6 is a schematic diagram of a detection area of a wearable device in the blind guiding system provided in this embodiment.
As shown in fig. 2, during the operation of the blind guiding system, a user can start the voice control function through the voice switch button, and then provide route information to the user through the voice-controlled positioning navigation module, and the route information is played near the ears of the blind through the speaker; simultaneously, through anterior AI camera and TOF camera and the TOF camera of left and right sides, to the blind person suggestion walking route the place ahead object attribute and distance to report through the speaker. Wherein, the handheld device can communicate with the Rough Han dynasty device through Bluetooth. The blind guiding system based on the working process enables a user to intervene the system, carries out interactive control on the system, provides effective blind guiding suggestions, obstacle reminding and navigation information and the like for the system, and guarantees the traveling safety of the user.
The handheld device (cane) shown in fig. 3, which retains the appearance and function of the traditional pathfinding cane, is provided with a button module in the holding part, and the side of the holding part is provided with a left-turn and right-turn signal transmitting button; the user starts the corresponding function through the button arranged on the button module to carry out interactive control.
As shown in fig. 4, the wearable device (glasses) has a similar appearance to glasses, and a blind user (hereinafter, the user is referred to as blind or visually impaired) generally wears sunglasses, and the appearance and wearing of the wearable device are similar to sunglasses and are easily accepted by the user; the wearing mode is the same as that of the glasses, and the glasses comprise: the front portion is provided with AI camera and TOF camera respectively, and both sides all are provided with the TOF camera, are being close to hangers department and are being provided with the speaker (voice broadcast module promptly), built-in treater and signal transceiver module, are provided with power connection in hangers department and are used for external power supply, span bridge of the nose department and connect through cavity connecting portion. The loudspeaker is arranged at the joint of the hanging ear and the equipment main body, namely, the loudspeaker is positioned near the ear, and compared with the earphone, the loudspeaker can almost neglect the shielding of the environmental sound, because the loudspeaker is close to the ear, the volume of the loudspeaker does not need to be set too high, and other pedestrians cannot be influenced; the user walks on the blind road along the route of the navigation prompt, namely, the walking mode which is used conventionally for a long time is adopted, so that the system is easy to be accepted by the user.
The system comprises an AI camera, a TOF camera, a front AI camera, a front TOF camera and a front TOF camera, wherein the AI camera and the front TOF camera are used for detecting a front environment and compensating a detection blind area of a route detection walking stick, green trees are generally arranged on a roadside, branches are in a suspended state and cannot be detected by the route detection walking stick, the AI camera is used for identifying the branches, the TOF camera is used for detecting distances, wearing equipment is worn on the head and can shoot an area which is close to a human eye and can be observed, and prompt is carried out when the distance fed back by the TOF camera is smaller than a certain value (the effective detection distance of the TOF camera is generally about 5 meters);
the AI camera is combined with the TOF camera, so that the identity attribute (the identity attribute mainly refers to what the object is) of the object and the distance between the object and the user can be directly informed to the user, and compared with detection means such as a distance sensor and a radar, the information which can be visually judged by the user is given to the user; for example, the following steps are carried out: the user has a person in motion in front, the real-time detection result is that the distance is 2 meters … … 2.5.5 meters … … 3 meters … … 2.2.2 meters … … 1.8.8 meters … … 0.9.9 meters … …, if the distance sensor detects that the distance is an object in front, then the user is informed of the distance data, the user needs to judge what the object is, the information provided by the system comprises the person in front and the distance information, and the user can make a correct response under the condition of knowing the object.
Fig. 5 is a schematic diagram of a process for judging surrounding objects by the blind guiding system; by taking a user with an effective monitoring distance of the TOF camera of 5 meters and a height of 1.7 meters as a reference, the user holds a route-exploring stick with a length of 1.3 meters, generally, the walking speed of the route-exploring stick is 0.6-1 meter per second, when the TOF camera detects that an obstacle (the obstacle mentioned here has no specific object and can be a person or any object) exists at 5 meters, the distance from the route-exploring stick to the obstacle of the user is about 3.75 meters, and under the condition that the stick can detect (the stick is mainly used for detecting the obstacle near the ground), the user can detect the obstacle through the route-exploring stick after 3.75 seconds, but at the moment, the obstacle cannot be judged to be a moving person, a vehicle or a stationary object, further judgment is needed, meanwhile, preparation for reminding the user of avoiding the obstacle needs to be made, and the voice reminding of the user needs 0.5-0.8 seconds, because the user is sensitive to the voice information and can quickly respond after hearing the voice, in order to ensure the reliability of the response, 0.5-1 second of time is reserved as the response time of the user, that is, the system has 1.95 seconds of time to judge the obstacle, and at this time, the movement state of the obstacle is determined according to the walking speed of the user and the distance change between the user and the obstacle, and the characteristics are as follows:
in the formula, SpFor calculating the distance, V, between the user and the obstacle1Is the walking speed of the user, t is the time, StThe measured distance between the user and the barrier;
when S ispAnd StWhen the time length is equal everywhere, the system judges that the obstacle is a static object (the moving object here can be a person), and broadcasts an obstacle avoidance reminder when t is 1.95;
when S istIf the data is invalid data, namely the data exceeds the detection distance, the system judges that the barrier is a moving object and does not influence the user, and ignores the information;
when S istIs valid data, and StGreater than SpWhen the system judges that the obstacle is a moving object, it is easy to understand that the moving speed of the obstacle is less than that of the user, the distance between the obstacle and the user is gradually shortened, and the limit distance is 1.25 meters, namely the distance of the obstacle detected by the path-exploring stick is StWhen the length is equal to 2.25 m, broadcasting a speed reduction prompt or broadcasting an obstacle avoidance prompt;
when S istIs valid data, and StLess than SpWhen the system judges that the barrier is a moving object, it is easy to understand that the barrier moves towards the moving direction of the user, and once the system detects StLess than SpWhen the obstacle is far away from the user, the user is reminded to continue walking.
Further, a light-emitting device can be arranged on the wearable device, and when the situation occurs, the object is reminded in a light flashing mode, and a user is noticed.
After the broadcasting steering reminding, a user clicks a steering button on the walking stick according to the blind road steering node information fed back by the pathfinding walking stick, a steering request is sent to the wearable equipment end for interaction, the processor acquires the detection information of the corresponding side TOF camera, and whether the broadcasting can steer is reported.
Fig. 6 is a schematic diagram of a detection area of a wearable device in a blind guiding system;
the user walking turns to and has very big potential safety hazard, normal people when the transform route of walking, the condition around can be swept to the excessive light of canthus, can audio-visual judgement whether accord with the condition, prudent people can turn round even and observe the road conditions, and let the people have these custom mainly because the bicycle on road, the electric motor car often with pedestrian's public road, often have the bicycle, the condition that the electric motor car ran over from the side fast, even the people of running all can cause the threat to the user, so trade turns to or transform the route and has the potential safety hazard, the TOF camera of side can detect near the object of side.
When the direction needs to be turned, a user can stand on the original place, the TOF camera detects the distance between the side environment object and the user, and when the distances are all a certain value, no moving object exists in the detection range of the TOF camera, namely, the broadcast can be directly turned;
because the moving speed of vehicles such as bicycle, electric motor car is very fast, and the time of passing through in the effective monitoring range of TOF camera is short, and the user turns round and uses the combination of anterior AI camera and TOF camera to go on further judgement (refer to the place ahead object and report the tactics), and when turning round, the detection area of side TOF camera becomes the side rear, and the moving speed through apart from the testing result calculation object represents to be:
V2＝(S2-S1)/tx(formula 2)
Wherein, V2As the speed of movement of the object, S1Is t1Detected distance value of time, S2Is t2Detected distance value at time, txIs t1Time t2The duration of the time;
when V is2When the walking speed of the pedestrian is higher than that of the pedestrian (the walking speed of the normal person is generally 1.1-1.5 meters per second), the broadcasting stops steering until the object leaves the detection range;
when V is2When the walking speed of the pedestrian is less than or equal to the walking speed of the pedestrian and the distance between the user and the broadcasting station is more than 2 meters, the broadcasting station can directly turn;
further, be provided with illuminator in the wearing equipment side, when the user need turn to, remind the object, notice the user through the mode of corresponding side light scintillation.
The wearable device of the system is characterized by further comprising an external power supply part, wherein the power supply part can be worn on a human body in a mode of being bound by a waistband and the like, or is directly arranged in a pocket and is connected into a power supply interface through a wire;
furthermore, the tail end of the hanging lug is provided with an elastic rope which is sleeved at the hindbrain and used for stabilizing the wearing equipment;
furthermore, a buckle is arranged at the power supply connector, a bayonet is arranged at the corresponding wire connector, and the buckle and the bayonet are matched for use to stabilize the connection relation, so that the power line is prevented from falling off in the movement process;
furthermore, the probe rod part can be folded to facilitate storage;
furthermore, all cameras are designed to be embedded and protected by transparent materials;
further, the blind guiding system can also comprise a speed sensor for detecting the walking speed of the user;
the blind guiding system provided by the embodiment combines living habits of blind users, the button module (comprising the steering button which can be actively intervened by the user) is additionally arranged on the pathfinding walking stick, and meanwhile wearing equipment is provided, so that the wearing equipment is set to be in a form similar to glasses in consideration of the habit of wearing sunglasses of most blind users, and the blind users can easily accept the blind users. Wearing equipment has fused AI camera and TOF camera, carries out obstacle identification when carrying out the obstacle distance and detecting, combines to report the tactics and provides more reliable information report for the user, promotes user's safe impression. Set up the speaker near hangers department, carry out voice broadcast under the condition of not shielding environment sound, can let accurate receipt prompt information of user not influence pedestrian on every side again.
The blind guiding system provided by the embodiment realizes that a user can actively interact and control with the system, improves the accuracy of judgment strategies such as steering and the like, and simultaneously gives reliable use experience to the user.
Referring to fig. 7, fig. 7 is a schematic flowchart illustrating a blind guiding method according to an embodiment of the present application. The blind guiding method provided by the embodiment comprises the following steps:
s1: the wearable device receives an interactive instruction sent by the handheld device;
s2: the wearable equipment controls the camera module to acquire real-time information of surrounding objects according to the interactive instruction;
s3: the wearable device obtains blind guiding suggestion information according to the real-time information;
s3: the wearable device broadcasts the blind guiding suggestion information through a loudspeaker module.
Further, data transmission can be carried out between the wearable device and the handheld device in a wireless communication mode, including but not limited to bluetooth, infrared, wireless Near Field Communication (NFC) and the like.
The blind guiding system and method provided by the embodiment of the application can provide the blind guiding suggestion based on the surrounding real-time information according to the interactive command of the user, provide guarantee for the trip safety of the user, and greatly improve the safety of the user
It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps, after comprehending the spirit of the present application.
The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic Circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information.
It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed at the same time.
Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of systems, methods according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware for performing the specified functions or acts, or combinations of special purpose hardware and computer instructions.
As described above, only the specific embodiments of the present application are provided, and it can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.
Claims (12)
1. A blind guidance system, comprising: a handheld device and a wearable device;
the handheld device is provided with a button module used for sending an interaction instruction to the wearable device;
the wearable device comprises a camera module, a wireless communication module, a processor and a voice broadcasting module;
the camera module is used for acquiring real-time information of surrounding objects;
the wireless communication module is used for receiving the interaction instruction sent by the handheld device;
the processor is used for analyzing and processing the real-time information and the interactive instruction to obtain a blind guiding suggestion and sending the blind guiding suggestion to the voice broadcasting module;
the voice broadcasting module is used for receiving the blind guiding suggestion and broadcasting the blind guiding suggestion.
2. The blind guide system of claim 1 wherein the camera module comprises: an AI camera and a TOF camera;
the AI camera is used for identifying a shot object;
the TOF camera is used for detecting the distance of surrounding objects.
3. The blind guide system of claim 1 wherein the wearable device further comprises:
the voice recognition module is used for receiving a voice instruction sent by a user and recognizing the voice instruction to obtain a voice recognition result;
the processor determines the blind guiding suggestion according to the voice recognition result.
4. The blind guide system of claim 1 wherein the wearable device further comprises:
the human body posture sensing module is used for sensing the body posture information of the user;
the processor determines the blind guiding suggestion according to the body posture information.
5. The blind guide system of claim 1 wherein the wearable device further comprises:
and the positioning navigation module is used for providing the blind guiding information through a satellite positioning system.
6. The blind guide system of claim 1 wherein the handheld device further comprises:
and the Bluetooth module is used for sending the interaction instruction to the wearable device through Bluetooth.
7. The blind guide system of claim 1 wherein the button module comprises:
the blind guiding suggestion button is used for controlling the blind guiding system to broadcast the blind guiding suggestion;
and the voice switch button is used for starting a voice function so that a user can control the blind guiding system through voice.
8. The blind guidance system of claim 7 wherein the blind guidance advice button comprises:
a forward direction blind guiding button, a left turn direction blind guiding button and a right turn direction blind guiding button.
9. The blind guide system of any one of claims 1-7, further comprising: the first power supply module is used for supplying power to the handheld device and the second power supply module is used for supplying power to the wearing device.
10. The blind guidance system of any one of claims 1-7 wherein the handheld device comprises a walking stick; the wearable device comprises glasses.
11. A method of guiding blind, the method comprising:
the wearable device receives an interactive instruction sent by the handheld device;
the wearable equipment controls the camera module to acquire real-time information of surrounding objects according to the interactive instruction;
the wearable device obtains blind guiding suggestion information according to the real-time information;
the wearable device broadcasts the blind guiding suggestion information through a loudspeaker module.
12. The blind guiding method of claim 11, wherein the wearable device receives the interactive instruction sent by the handheld device, and the method comprises:
the wearable device receives the interactive instruction sent by the handheld device in a wireless communication mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011384573.0A CN114569416B (en) | 2020-12-01 | 2020-12-01 | Blind guiding system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011384573.0A CN114569416B (en) | 2020-12-01 | 2020-12-01 | Blind guiding system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114569416A true CN114569416A (en) | 2022-06-03 |
| CN114569416B CN114569416B (en) | 2024-03-12 |
Family
ID=81768785
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011384573.0A Active CN114569416B (en) | 2020-12-01 | 2020-12-01 | Blind guiding system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114569416B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101860986A (en) * | 2010-04-26 | 2010-10-13 | 宇龙计算机通信科技(深圳)有限公司 | Method, mobile terminal and server for monitoring user safety |
| CN103327151A (en) * | 2013-07-17 | 2013-09-25 | 上海华勤通讯技术有限公司 | Infrared blind guide device and method as well as mobile phone |
| CN104771296A (en) * | 2014-06-16 | 2015-07-15 | 刘洋 | Roadblock detecting and reminding system for blindmen |
| CN106618980A (en) * | 2016-11-05 | 2017-05-10 | 深圳市前海安测信息技术有限公司 | Wearable intelligent blind guiding system |
| US20170261334A1 (en) * | 2016-03-11 | 2017-09-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Auto adjust communication |
| KR20180093753A (en) * | 2017-02-14 | 2018-08-22 | 숭실대학교산학협력단 | A stick for the blind |
| DE102017207782A1 (en) * | 2017-05-09 | 2018-11-15 | Helmut-Schmidt-Universität Universität der Bundeswehr Hamburg | Facilitate entry into vehicles for the blind and visually impaired |
| CN108836770A (en) * | 2018-06-29 | 2018-11-20 | 合肥思博特软件开发有限公司 | Real Time Obstacle Avoiding optimization guide monitoring method and system under a kind of actual traffic environment |
| CN109044755A (en) * | 2018-07-18 | 2018-12-21 | 钟祥博谦信息科技有限公司 | A kind of intelligent blind guiding system, device and method |
| CN109394484A (en) * | 2018-12-04 | 2019-03-01 | 徐州思迈德智能装备有限公司 | A kind of crutch for blind intelligent guidance system |
| CN110944329A (en) * | 2019-11-28 | 2020-03-31 | 楚天龙股份有限公司 | Information processing method, terminal and server |
| CN111753279A (en) * | 2020-05-13 | 2020-10-09 | 广州多益网络股份有限公司 | Click verification method and device and computer equipment |
| CN111930127A (en) * | 2020-09-02 | 2020-11-13 | 广州赛特智能科技有限公司 | Robot obstacle identification and obstacle avoidance method |
-
2020
- 2020-12-01 CN CN202011384573.0A patent/CN114569416B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101860986A (en) * | 2010-04-26 | 2010-10-13 | 宇龙计算机通信科技(深圳)有限公司 | Method, mobile terminal and server for monitoring user safety |
| CN103327151A (en) * | 2013-07-17 | 2013-09-25 | 上海华勤通讯技术有限公司 | Infrared blind guide device and method as well as mobile phone |
| CN104771296A (en) * | 2014-06-16 | 2015-07-15 | 刘洋 | Roadblock detecting and reminding system for blindmen |
| US20170261334A1 (en) * | 2016-03-11 | 2017-09-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Auto adjust communication |
| CN106618980A (en) * | 2016-11-05 | 2017-05-10 | 深圳市前海安测信息技术有限公司 | Wearable intelligent blind guiding system |
| KR20180093753A (en) * | 2017-02-14 | 2018-08-22 | 숭실대학교산학협력단 | A stick for the blind |
| DE102017207782A1 (en) * | 2017-05-09 | 2018-11-15 | Helmut-Schmidt-Universität Universität der Bundeswehr Hamburg | Facilitate entry into vehicles for the blind and visually impaired |
| CN108836770A (en) * | 2018-06-29 | 2018-11-20 | 合肥思博特软件开发有限公司 | Real Time Obstacle Avoiding optimization guide monitoring method and system under a kind of actual traffic environment |
| CN109044755A (en) * | 2018-07-18 | 2018-12-21 | 钟祥博谦信息科技有限公司 | A kind of intelligent blind guiding system, device and method |
| CN109394484A (en) * | 2018-12-04 | 2019-03-01 | 徐州思迈德智能装备有限公司 | A kind of crutch for blind intelligent guidance system |
| CN110944329A (en) * | 2019-11-28 | 2020-03-31 | 楚天龙股份有限公司 | Information processing method, terminal and server |
| CN111753279A (en) * | 2020-05-13 | 2020-10-09 | 广州多益网络股份有限公司 | Click verification method and device and computer equipment |
| CN111930127A (en) * | 2020-09-02 | 2020-11-13 | 广州赛特智能科技有限公司 | Robot obstacle identification and obstacle avoidance method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114569416B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107336710B (en) | Drive consciousness estimating device | |
| US7908060B2 (en) | Method and system for blind spot identification and warning utilizing portable and wearable devices | |
| CN107539126B (en) | Wearable device and vehicle for communicating with wearable device | |
| CN110892351A (en) | Vehicle control device and vehicle control method | |
| KR20160085370A (en) | Vision aiding method and apparatus integrated with a camera module and a light sensor | |
| CN109646258A (en) | A kind of blind-guiding stick, blind guiding system and blind-guiding method | |
| CN104367447A (en) | Auxiliary walking system and method | |
| CN110522617A (en) | Blind person's wisdom glasses | |
| CN109223346B (en) | Voice-controlled navigation wheelchair for blind people and control method thereof | |
| JP2018188029A (en) | Stop intention determination device and stop intention determination method | |
| KR20120127830A (en) | User interface method for terminal of vehicle and apparatus tererof | |
| WO2018150676A1 (en) | Driving switching assist device, and driving switching assist method | |
| WO2018150677A1 (en) | Driving switching assist device, and driving switching assist method | |
| CN114569416A (en) | Blind guiding system and method | |
| CN204969670U (en) | Intelligence helmet system and vehicle safety protection system | |
| KR101655820B1 (en) | Time of arrival notice system and there of method using smart glasses | |
| KR102313973B1 (en) | Walking aid system for the visually impaired | |
| CN207889892U (en) | A kind of auxiliary driving device, system and a kind of riding cycle | |
| CN113679576A (en) | Bracelet obstacle avoidance navigation system and method for assisting blind person in going out | |
| CN211461092U (en) | Wearable blind guiding system | |
| KR102279982B1 (en) | Walking stick for blind person | |
| CN113492864A (en) | Driving support device and data collection system | |
| CN217448373U (en) | Blind person box with automatic tracing system | |
| CN213608013U (en) | Intelligent voice blind guiding instrument based on Internet of things and image recognition | |
| CN214910147U (en) | Intelligent blind guiding auxiliary device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |