WO2016086440A1

WO2016086440A1 - Wearable guiding device for the blind

Info

Publication number: WO2016086440A1
Application number: PCT/CN2014/093532
Authority: WO
Inventors: 杨小康; 翟广涛; 李铎; 闵雄阔
Original assignee: 上海交通大学
Priority date: 2014-12-04
Filing date: 2014-12-11
Publication date: 2016-06-09
Also published as: CN104473717A

Abstract

Provided is a wearable guiding device for the blind. The device comprises: plural components arranged and connected to a system, and a headset eyewear holder facilitating wearing by a user; a sensor for detecting a surrounding; an image gathering device for recording surrounding images; a voice module for voice interaction; an information outputting device for alerting related information to a wearer; and a data processing center for overall control of the system. The system described can acquire an actual scene omnidirectionally and in real time, detect a surroundings omnidirectionally via the sensor, and transmit analyzed data to a remote monitoring device via wireless transmission, thus realizing guiding for a blind person and remote monitoring.

Description

Wearable boot device for blind people

Technical field

The present invention relates to the field of wearable guiding technology, and in particular to a wearable guiding device for a blind population.

Background technique

Blind people are those who suffer from diseases or accidental injuries that cause blindness or blindness. Blind people are divided into congenital blind people and acquired blind people. According to estimates by the World Health Organization, there are between 40 million and 45 million blind people worldwide. Among the more than 83 million disabled people in China, there are 12.33 million visually handicapped persons and 5 million blind people. It is one of the countries with the largest number of blind people in the world. How to solve their normal learning, work and life issues has become the focus of social attention.

Visual impairment is caused by innate or acquired causes of partial or total loss of function of the visual system, so that it is impossible to accurately identify external things. According to the relevant regulations, visual failure is less than 0.3, or visual field is within 20 °. According to the degree of obstacles, visual impairment can be divided into two categories: the visual acuity of the two eyes is less than 0.3 above 0.03 or the visual field is less than 20°; the visual acuity of the two eyes is less than 0.03 for total blindness. People with amblyopia can usually use vision for daily life, but there are certain obstacles in visual observation. Generally, optical aids or special magnification equipment are needed to observe things.

The difficulties encountered by the blind population are much greater than those of other visually impaired patients. The blind population cannot rely on vision for daily life at all, and usually only adopt alternative methods for daily life. For example, haptic aids, hearing aids, and other types of assistive devices are used in place of vision. Most information barrier technologies and devices can be applied to the entire blind population. Almost all visually impaired people can compensate for the quality of life and participate in social life through assistive devices. However, the second sample survey showed that only 7.97% of the visually impaired persons in China were assisted with services; 14.49% of the cities and 5.82% of the rural areas.

The wearable guiding device refers to an auxiliary device that can improve various situations in a complicated environment even if visual information is not accepted by detection and data analysis of the wearer's surrounding environment. Due to the particularity of the blind population, the wearable guiding device for the blind population should belong to the non-visual visual aid, making full use of functions other than vision, such as hearing and touch, to compensate for the defects of visual function and improve the quality of life of the visually impaired. Auxiliary devices involve all aspects of life, work, study, and entertainment for people with visual impairments. For example: for everyday use Blind mobile phones and telephones, vocal clocks for life; blind canes and blind roads for travel; Braille for reading and communication, dot display devices, audio books, various screen reading software, etc.

In summary, the wearable guiding device for the blind population is of great significance to the life and work of the blind population. The existing types of wearable guiding devices have the characteristics of single function and poor expandability, and are not in compliance with the principles of ease of use, application, simplicity, portability, and scalability.

Summary of the invention

Aiming at the defects in the prior art, the object of the present invention is to provide a wearable guiding device for a blind population, which can collect real-life scenes in real time, process the collected images and transmit the images through wireless transmission. Give remote monitoring equipment for remote monitoring purposes. At the same time, the system includes various sensors to monitor the surrounding conditions, and transmits signals to the wearer with sound, touch and the like to achieve the function of full blind guidance.

To achieve the above objective, the present invention provides a wearable guiding device for a blind population, comprising:

Head-mounted eyeglass holder for mounting and connecting the various components of the system and for easy wearing by the user;

An image capture device is disposed on the headset for recording peripheral images (including depth information);

a plurality of sensors for detecting external information and the state of the device and transmitting the signal to the data processing center;

A voice module for voice interaction, the device informs the wearer of the information by means of voice, and the wearer can convey the command to the device in a voice manner;

An information output device for reminding the wearer of relevant information, such as voice reminder, pressure sensing, temperature sensing, vibration sensing, etc.;

The data processing center is used for overall control of the system, including image acquisition, wireless transmission of the image acquisition device, acceptance, processing, analysis, and transmission of the sensor data; wherein the image and sound transmission are implemented by the transmission module. The transmission module collects images from the image acquisition device in real time while collecting sounds around the wearer and transmitting them remotely.

Preferably, the image capturing device collects the front side of the wearer or collects in various angles; if it is collected from all angles of view, the image is spliced in a data processing center to form a panoramic view. Maps, or without splicing, store the images of each view separately.

Preferably, the ranging sensor and the infrared sensor are in one-to-one correspondence with the image capturing device, and are aligned at the same angle for detecting peripheral information; the ranging sensor and the infrared sensor are also collected on the front side of the wearer, or All aspects of the collection are collected; if it is collected from all angles of view, the distance image and the infrared image of the omnidirectional view are separately imaged in the data processing center to form a distance panorama and an infrared panorama, or no splicing, The distance images of the respective viewing angles are stored separately from the infrared images.

Preferably, the voice module for voice interaction is bidirectional, the device can monitor the wearer's instructions, and the device can also send relevant information to the wearer as needed.

Preferably, the information output device, if the object is approaching the wearer by analyzing the distance image and the infrared image, issues a prompt and indicates a direction to remind the wearer to pay attention to safety, and the information output device includes a pressure sensor and / or temperature sensor, these two sensors can achieve the same effect by stimulating the wearer respectively. In addition, the device can also guide the wearer by means of vibration sensing.

Preferably, the transmission module collects images from the image acquisition device in real time and simultaneously collects sounds around the wearer and transmits them to the guardian via wireless wifi and Bluetooth signals, and performs image transmission and/or voice between the guardian and the device wearer. Interaction to achieve remote monitoring purposes.

Compared with the prior art, the present invention has the following beneficial effects:

The invention is a wearable device, which has the advantages of simple portability, easy expansion, and the like, and can be used by all blind people in daily life; meanwhile, a data processing center is adopted, which can have other functions of the smart device; further, the present invention discloses The hardware can be used as a wearable auxiliary device platform for all blind people. For different types and different levels of functional requirements, the surrounding monitoring methods can be designed in a targeted manner to achieve real-time monitoring. At the same time, for different users' needs, signals can be output in different ways (sound, pressure, temperature, vibration, etc.) to remind the user of the surrounding situation.

DRAWINGS

Other features, objects, and advantages of the present invention will become apparent from the Detailed Description of Description

1 is a schematic structural view of a preferred embodiment of the present invention;

2 is a block diagram showing the working principle of a preferred embodiment of the present invention;

In the figure: 1 is a head-mounted glasses holder, 2 is a signal output device, 3 is an optical camera and an infrared camera surrounding one week, 4 is a left and right eyeglasses; 5 is a data processing center.

detailed description

The invention will now be described in detail in connection with specific embodiments. The following examples are intended to further understand the invention, but are not intended to limit the invention in any way. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the inventive concept. These are all within the scope of protection of the present invention.

FIG. 1 is a schematic structural diagram of a guiding device for a blind population according to a preferred embodiment of the present invention. In the figure: the head-mounted glasses holder 1, the information output device is a sound, pressure, temperature signal output device 2, the image acquisition device is a round-around optical camera and an infrared camera 3, the left and right eyeglass lenses 4; 5 is a data processing center, wherein :

The headgear support 1 is used for installing, connecting and fixing various components of the system, and is convenient for the user to wear;

The sound, pressure, and temperature signal output device 2 is configured to output a signal to remind or prompt the user; the microphone is used to transmit the user's voice command to the data processing center, and the data processing center can analyze and understand the system. Have some control.

The surrounding optical camera and the infrared camera 3 are used for real-time monitoring of surrounding conditions and transmitting the recorded information to the data processing center;

The data processing center 5 receives the image data from the optical camera and the infrared camera 3, and performs algorithm processing. If a dangerous object or an object that is rapidly approaching is detected, the sound, pressure, and temperature signal output device 2 prompts for use. The algorithm used therein is selected according to different requirements. These algorithms may be either prior art or innovative algorithms, and the algorithm itself is not the focus and improvement of the present invention. The data processing center 5 includes a voice module and a transmission module. The voice module is used for voice interaction between the device and the wearer, while the transmission module is used for voice and image transmission between the wearer and the remote guardian.

In this embodiment, the image capturing device (the optical camera surrounding the circumference and the infrared camera 3) are disposed in the front, rear, left and right directions of the bracket to supervise various aspects. Of course, in other embodiments it is also possible to monitor only the required angles.

In this embodiment, the plurality of sensors may include, but are not limited to, at least one of an infrared sensor, a ranging sensor, a temperature sensor, a pressure sensor, a gyroscope, an accelerometer, and the like. The ranging sensor and the infrared sensor are used to detect external information, which will be used to analyze the surrounding environment; a gyroscope accelerometer or the like is used to detect the current state information of the wearable guiding device. More preferably, the sensor is also provided in all directions of the bracket to supervise the situation in all directions.

In this embodiment, the information output device may be integrated in the data processing center, or may be separated into independent modules, and may also be connected to the data processing center by means of wiring. After receiving the information of the data processing center, the information is transmitted to the wearer of the device in different ways (voice, pressure, temperature, vibration, etc.). For example, the controllable pressure transmission device, the controllable temperature transmission device, etc., provide corresponding information to the wearer through changes in pressure and temperature.

In this embodiment, the voice module is integrated in the data processing center. Of course, in other embodiments, the method may be independent of the data processing center. The data processing center analyzes the distance image and the infrared image, and the adopted algorithm adjusts according to different environments and different needs. The voice module has a microphone and a speaker. Through the microphone, the user can select and set some functions of the system; through the speaker, the device can communicate the situation and related information to the wearer through the speaker or the earphone.

In this embodiment, the transmission module is integrated in the data processing center, and the transmission mode may have various options, such as using wifi, Bluetooth, and the like. The guardian and the device wearer can see each other through image transmission in real time, or can perform real-time conversation through voice transmission. The voice module is two-way, the device can monitor the wearer's instructions, and the device will send relevant information to the wearer as needed.

The main function of the system described in this embodiment is to provide guidance for the blind population. The system can not only monitor various environments, but also enable the patient to understand the surrounding environment even if he cannot see it. The data processing center can design different environmental monitoring programs in a targeted manner, so that patients can protect themselves in various environments and understand the surrounding conditions; the data processing center can also image signals, voice signals and necessary information. It is sent to the remote monitoring terminal by means of wireless transmission, so that the guardian can monitor the user of the system in real time through remote means.

The system of the invention can collect real-life scenes in real time, utilizes sensors to comprehensively detect the surrounding environment, and wirelessly transmits the analyzed data to the remote monitoring device to achieve the functions of guiding blindness and remote monitoring.

The specific embodiments of the present invention have been described above. It is to be understood that the invention is not limited to the specific embodiments described above, and various modifications and changes may be made by those skilled in the art without departing from the scope of the invention.

Claims

A wearable guiding device for a blind population, comprising:

Head-mounted eyeglass holder for mounting and connecting the various components of the system and for easy wearing by the user;

An image acquisition device is disposed on the head mounted frame for recording a peripheral picture;

a plurality of sensors for detecting external information and the state of the device and transmitting the signal to the data processing center;

A voice module for voice interaction, the device informs the wearer of the information by means of voice, and the wearer can convey the command to the device in a voice manner;

An information output device for reminding the wearer of relevant information, the output signal is from a data processing center;

The data processing center is used for overall control of the system, including image acquisition, wireless transmission of the image acquisition device, acceptance, processing, analysis, and transmission of the sensor data; wherein the image and sound transmission are implemented by the transmission module. The transmission module collects images from the image acquisition device in real time while collecting sounds around the wearer and transmitting them.
The wearable guiding device for a blind person according to claim 1, wherein the image collecting device collects the front side of the wearer or collects in various angles; The angle of view is collected, and the image of the omnidirectional view is spliced in the data processing center to form a panoramic image, or the splicing is not performed, and the images of the respective viewing angles are separately stored.
The wearable guiding device for a blind person according to claim 2, wherein the distance measuring sensor and the infrared sensor are in one-to-one correspondence with the image capturing device, and are aligned at the same angle for Detecting peripheral information; the distance measuring sensor and the infrared sensor are also collected on the front side of the wearer, or are collected in all directions; if it is collected from all angles of view, the distance image and infrared image of the omnidirectional view are in the data processing center. The image is spliced separately to form a distance panorama and an infrared panorama, or the splicing is not performed, and the distance image of each angle of view and the infrared image are separately stored.
The wearable guiding device for a blind person according to any one of claims 1 to 3, wherein the device state information includes at least one of direction information, location information, and angle information. With this information, the wearable guiding device infers the movement state of the wearer's head and displays the corresponding picture.
A wearable guiding device for a blind population according to any one of claims 1-3, wherein the voice module for voice interaction is bidirectional, and the device can monitor the wearer's instructions. At the same time, the device can also send relevant information to the wearer as needed.
A wearable guiding device for a blind population according to any one of claims 1 to 3, characterized in that the information output device for reminding the wearer of relevant information, if passing the distance image and the infrared image The analysis found that an object is approaching the wearer, issuing a prompt and indicating the direction to remind the wearer to pay attention to safety. At the same time, the information output device includes a pressure sensor and/or a temperature sensor, which can respectively stimulate the wearer. To achieve the same effect, in addition, the device can also guide the wearer by means of vibration sensing.
The wearable guiding device for a blind population according to any one of claims 1-3, wherein the data processing center analyzes the distance image and the infrared image, and the adopted algorithm is different according to the environment. Make different adjustments accordingly.
A wearable guiding device for a blind population according to any one of claims 1 to 3, wherein the transmission module collects images from the image capturing device in real time while collecting sounds around the wearer and wirelessly The wifi and Bluetooth signals are transmitted to the guardian remotely, and the image transmission and/or voice interaction between the guardian and the device wearer is performed to achieve the purpose of remote monitoring.