WO2016086440A1 - 针对全盲人群的可穿戴式引导设备 - Google Patents

针对全盲人群的可穿戴式引导设备 Download PDF

Info

Publication number
WO2016086440A1
WO2016086440A1 PCT/CN2014/093532 CN2014093532W WO2016086440A1 WO 2016086440 A1 WO2016086440 A1 WO 2016086440A1 CN 2014093532 W CN2014093532 W CN 2014093532W WO 2016086440 A1 WO2016086440 A1 WO 2016086440A1
Authority
WO
WIPO (PCT)
Prior art keywords
wearer
image
information
blind
data processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/093532
Other languages
English (en)
French (fr)
Inventor
杨小康
翟广涛
李铎
闵雄阔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiao Tong University
Original Assignee
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiao Tong University filed Critical Shanghai Jiao Tong University
Publication of WO2016086440A1 publication Critical patent/WO2016086440A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00—Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08—Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00—Appliances for aiding patients or disabled persons to walk about
    • A61H3/06—Walking aids for blind persons

Definitions

  • the present invention relates to the field of wearable guiding technology, and in particular to a wearable guiding device for a blind population.
  • Blind people are those who suffer from diseases or accidental injuries that cause blindness or blindness. Blind people are divided into congenital blind people and acquired blind people. According to estimates by the World Health Organization, there are between 40 million and 45 million blind people worldwide. Among the more than 83 million disabled people in China, there are 12.33 million visually handicapped persons and 5 million blind people. It is one of the countries with the largest number of blind people in the world. How to solve their normal learning, work and life issues has become the focus of social attention.
  • Visual impairment is caused by innate or acquired causes of partial or total loss of function of the visual system, so that it is impossible to accurately identify external things.
  • visual failure is less than 0.3, or visual field is within 20 °.
  • visual impairment can be divided into two categories: the visual acuity of the two eyes is less than 0.3 above 0.03 or the visual field is less than 20°; the visual acuity of the two eyes is less than 0.03 for total blindness.
  • People with amblyopia can usually use vision for daily life, but there are certain obstacles in visual observation. Generally, optical aids or special magnification equipment are needed to observe things.
  • the difficulties encountered by the blind population are much greater than those of other visually impaired patients.
  • the blind population cannot rely on vision for daily life at all, and usually only adopt alternative methods for daily life.
  • haptic aids, hearing aids, and other types of assistive devices are used in place of vision.
  • Most information barrier technologies and devices can be applied to the entire blind population. Almost all visually impaired people can compensate for the quality of life and participate in social life through assistive devices.
  • the second sample survey showed that only 7.97% of the visually impaired persons in China were assisted with services; 14.49% of the cities and 5.82% of the rural areas.
  • the wearable guiding device refers to an auxiliary device that can improve various situations in a complicated environment even if visual information is not accepted by detection and data analysis of the wearer's surrounding environment. Due to the particularity of the blind population, the wearable guiding device for the blind population should belong to the non-visual visual aid, making full use of functions other than vision, such as hearing and touch, to compensate for the defects of visual function and improve the quality of life of the visually impaired.
  • Auxiliary devices involve all aspects of life, work, study, and entertainment for people with visual impairments. For example: for everyday use Blind mobile phones and telephones, vocal clocks for life; blind canes and blind roads for travel; Braille for reading and communication, dot display devices, audio books, various screen reading software, etc.
  • the wearable guiding device for the blind population is of great significance to the life and work of the blind population.
  • the existing types of wearable guiding devices have the characteristics of single function and poor expandability, and are not in compliance with the principles of ease of use, application, simplicity, portability, and scalability.
  • the object of the present invention is to provide a wearable guiding device for a blind population, which can collect real-life scenes in real time, process the collected images and transmit the images through wireless transmission.
  • a wearable guiding device for a blind population, which can collect real-life scenes in real time, process the collected images and transmit the images through wireless transmission.
  • the system includes various sensors to monitor the surrounding conditions, and transmits signals to the wearer with sound, touch and the like to achieve the function of full blind guidance.
  • the present invention provides a wearable guiding device for a blind population, comprising:
  • Head-mounted eyeglass holder for mounting and connecting the various components of the system and for easy wearing by the user;
  • An image capture device is disposed on the headset for recording peripheral images (including depth information);
  • a plurality of sensors for detecting external information and the state of the device and transmitting the signal to the data processing center;
  • a voice module for voice interaction the device informs the wearer of the information by means of voice, and the wearer can convey the command to the device in a voice manner;
  • An information output device for reminding the wearer of relevant information such as voice reminder, pressure sensing, temperature sensing, vibration sensing, etc.
  • the data processing center is used for overall control of the system, including image acquisition, wireless transmission of the image acquisition device, acceptance, processing, analysis, and transmission of the sensor data; wherein the image and sound transmission are implemented by the transmission module.
  • the transmission module collects images from the image acquisition device in real time while collecting sounds around the wearer and transmitting them remotely.
  • the image capturing device collects the front side of the wearer or collects in various angles; if it is collected from all angles of view, the image is spliced in a data processing center to form a panoramic view. Maps, or without splicing, store the images of each view separately.
  • the ranging sensor and the infrared sensor are in one-to-one correspondence with the image capturing device, and are aligned at the same angle for detecting peripheral information; the ranging sensor and the infrared sensor are also collected on the front side of the wearer, or All aspects of the collection are collected; if it is collected from all angles of view, the distance image and the infrared image of the omnidirectional view are separately imaged in the data processing center to form a distance panorama and an infrared panorama, or no splicing, The distance images of the respective viewing angles are stored separately from the infrared images.
  • the voice module for voice interaction is bidirectional, the device can monitor the wearer's instructions, and the device can also send relevant information to the wearer as needed.
  • the information output device if the object is approaching the wearer by analyzing the distance image and the infrared image, issues a prompt and indicates a direction to remind the wearer to pay attention to safety, and the information output device includes a pressure sensor and / or temperature sensor, these two sensors can achieve the same effect by stimulating the wearer respectively.
  • the device can also guide the wearer by means of vibration sensing.
  • the transmission module collects images from the image acquisition device in real time and simultaneously collects sounds around the wearer and transmits them to the guardian via wireless wifi and Bluetooth signals, and performs image transmission and/or voice between the guardian and the device wearer. Interaction to achieve remote monitoring purposes.
  • the present invention has the following beneficial effects:
  • the invention is a wearable device, which has the advantages of simple portability, easy expansion, and the like, and can be used by all blind people in daily life; meanwhile, a data processing center is adopted, which can have other functions of the smart device; further, the present invention discloses
  • the hardware can be used as a wearable auxiliary device platform for all blind people.
  • the surrounding monitoring methods can be designed in a targeted manner to achieve real-time monitoring.
  • signals can be output in different ways (sound, pressure, temperature, vibration, etc.) to remind the user of the surrounding situation.
  • FIG. 1 is a schematic structural view of a preferred embodiment of the present invention.
  • FIG. 2 is a block diagram showing the working principle of a preferred embodiment of the present invention.
  • 1 is a head-mounted glasses holder
  • 2 is a signal output device
  • 3 is an optical camera and an infrared camera surrounding one week
  • 4 is a left and right eyeglasses
  • 5 is a data processing center.
  • FIG. 1 is a schematic structural diagram of a guiding device for a blind population according to a preferred embodiment of the present invention.
  • the head-mounted glasses holder 1 the information output device is a sound, pressure, temperature signal output device 2
  • the image acquisition device is a round-around optical camera and an infrared camera 3
  • the left and right eyeglass lenses 4 5
  • 5 is a data processing center, wherein :
  • the headgear support 1 is used for installing, connecting and fixing various components of the system, and is convenient for the user to wear;
  • the sound, pressure, and temperature signal output device 2 is configured to output a signal to remind or prompt the user; the microphone is used to transmit the user's voice command to the data processing center, and the data processing center can analyze and understand the system. Have some control.
  • the surrounding optical camera and the infrared camera 3 are used for real-time monitoring of surrounding conditions and transmitting the recorded information to the data processing center;
  • a plurality of sensors for detecting external information and the state of the device and transmitting the signal to the data processing center;
  • the data processing center 5 receives the image data from the optical camera and the infrared camera 3, and performs algorithm processing. If a dangerous object or an object that is rapidly approaching is detected, the sound, pressure, and temperature signal output device 2 prompts for use.
  • the algorithm used therein is selected according to different requirements. These algorithms may be either prior art or innovative algorithms, and the algorithm itself is not the focus and improvement of the present invention.
  • the data processing center 5 includes a voice module and a transmission module.
  • the voice module is used for voice interaction between the device and the wearer, while the transmission module is used for voice and image transmission between the wearer and the remote guardian.
  • the image capturing device (the optical camera surrounding the circumference and the infrared camera 3) are disposed in the front, rear, left and right directions of the bracket to supervise various aspects.
  • the image capturing device the optical camera surrounding the circumference and the infrared camera 3
  • the bracket are disposed in the front, rear, left and right directions of the bracket to supervise various aspects.
  • the plurality of sensors may include, but are not limited to, at least one of an infrared sensor, a ranging sensor, a temperature sensor, a pressure sensor, a gyroscope, an accelerometer, and the like.
  • the ranging sensor and the infrared sensor are used to detect external information, which will be used to analyze the surrounding environment; a gyroscope accelerometer or the like is used to detect the current state information of the wearable guiding device. More preferably, the sensor is also provided in all directions of the bracket to supervise the situation in all directions.
  • the information output device may be integrated in the data processing center, or may be separated into independent modules, and may also be connected to the data processing center by means of wiring.
  • the information After receiving the information of the data processing center, the information is transmitted to the wearer of the device in different ways (voice, pressure, temperature, vibration, etc.).
  • the controllable pressure transmission device, the controllable temperature transmission device, etc. provide corresponding information to the wearer through changes in pressure and temperature.
  • the voice module is integrated in the data processing center.
  • the method may be independent of the data processing center.
  • the data processing center analyzes the distance image and the infrared image, and the adopted algorithm adjusts according to different environments and different needs.
  • the voice module has a microphone and a speaker. Through the microphone, the user can select and set some functions of the system; through the speaker, the device can communicate the situation and related information to the wearer through the speaker or the earphone.
  • the transmission module is integrated in the data processing center, and the transmission mode may have various options, such as using wifi, Bluetooth, and the like.
  • the guardian and the device wearer can see each other through image transmission in real time, or can perform real-time conversation through voice transmission.
  • the voice module is two-way, the device can monitor the wearer's instructions, and the device will send relevant information to the wearer as needed.
  • the main function of the system described in this embodiment is to provide guidance for the blind population.
  • the system can not only monitor various environments, but also enable the patient to understand the surrounding environment even if he cannot see it.
  • the data processing center can design different environmental monitoring programs in a targeted manner, so that patients can protect themselves in various environments and understand the surrounding conditions; the data processing center can also image signals, voice signals and necessary information. It is sent to the remote monitoring terminal by means of wireless transmission, so that the guardian can monitor the user of the system in real time through remote means.
  • the system of the invention can collect real-life scenes in real time, utilizes sensors to comprehensively detect the surrounding environment, and wirelessly transmits the analyzed data to the remote monitoring device to achieve the functions of guiding blindness and remote monitoring.

Landscapes

  • Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Rehabilitation Therapy (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Pain & Pain Management (AREA)
  • Epidemiology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Alarm Systems (AREA)
  • Emergency Alarm Devices (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

本发明提供了一种针对全盲人群的可穿戴式引导设备，包括用于安装及连接该系统的各个部件以及方便用户佩戴的头戴式眼镜支架；用于检测周边环境的传感器；用于记录周边画面的图像采集设备；用于语音交互的语音模块；用于提醒佩戴者相关信息的信息输出装置；以及用于系统的总体控制的数据处理中心。本发明所述系统能够实时地全方位采集现实场景，利用传感器全方位检测周边环境，将分析后的数据经过无线传输给远程监护设备，达到导盲、远程监护的功能。

Description

针对全盲人群的可穿戴式引导设备 技术领域
本发明涉及可穿戴式引导技术领域，具体地，涉及一种针对全盲人群的可穿戴式引导设备。
背景技术
盲人就是眼睛患有疾病或受到意外伤害而导致双目失明或单目失明的人，盲人分为先天盲人与后天盲人之分。根据世界卫生组织的估计，全世界有盲人4000万到4500万。我国8300多万残疾人中，视力残疾人1233万，盲人约500万，是世界上盲人人口最多的国家之一。如何解决他们正常学习、工作和生活问题成为社会关注的焦点。
视觉障碍是由于先天或者后天原因致使视觉系统部分或全部丧失功能,以致无法对外界事物进行准确辨识。依据相关规定，视觉未达0.3，或视野在20°以内者即为视觉障碍。根据障碍程度不同，视觉障碍可以分为两类:两眼视力测定值在0.03以上未达0.3或其视野在20°以内为弱视；两眼视力测定值未达0.03为全盲。弱视人群通常可以利用视觉进行日常生活，但是在视物方面有一定障碍，一般需要借助光学辅助设备或特殊放大设备来观察事物。
全盲人群所遇到的困难比其他视觉障碍患者人群遇到的困难大得多，全盲人群完全不能依赖视觉进行日常生活，通常只能采取替代方式进行日常生活。例如，利用触觉辅助设备、听觉辅助设备和其它类型辅助设备来替代视觉。大多数信息无障碍技术和设备都可以应用于全盲人群。几乎所有的视力残疾人都可以通过辅助器具补偿功能，不同程度地提高生活质量，参与社会生活。然而，第二次抽样调查显示，我国的视力残疾人中获得辅助器具服务的仅占7.97％；其中城市14.49％，农村5.82％。
可穿戴引导设备是指可以通过对于穿戴者周围环境的检测与数据分析提高其在复杂环境中的即使是不接受视觉信息的情况下依然能够应对各种情况的辅助设备。由于全盲人群的特殊性，针对全盲人群的可穿戴引导设备应当属于非视觉助视器，充分利用视觉以外的功能，如听觉、触觉等功能来弥补视觉功能的缺陷从而提高视障者生存质量的辅助器具，涉及到视觉障碍者生活、工作、学习、娱乐等的方方面面。例如：用于日常 生活的盲用手机和电话、发声钟表；用于出行的盲杖、盲道；用于学习交流的盲文、点显器、有声读物、各种读屏软件等。
综上所述，针对全盲人群的可穿戴引导设备对于全盲人群的生活、工作有重要意义。现有的种类繁杂的可穿戴引导设备具有功能单一、可扩展性差等特点，不符合易用、适用、简单便携、可扩展等原则。
发明内容
针对现有技术中的缺陷，本发明的目的是提供一种针对全盲人群的可穿戴引导设备，该系统可实时地采集现实场景，对采集到的图像进行处理并通过无线传输的方式将画面传输给远程监护设备，以达到远程监护的目的。同时，系统中包含各种传感器用以监视周围情况，并且以声音、触觉等信号传输给佩戴者，以实现全盲引导的功能。
为实现以上目的，本发明提供一种针对全盲人群的可穿戴引导设备，包括：
头戴式眼镜支架，用于安装及连接系统的各个部件以及方便用户佩戴；
图像采集设备，设置在头戴式眼镜支架上，用于记录周边画面(包含深度信息)；
多个传感器，用于检测外部信息和设备所处状态并将信号传输给数据处理中心；
用于语音交互的语音模块，设备用语音的方式告知佩戴者信息，同时佩戴者能以语音的方式对设备传达指令；
用于提醒佩戴者相关信息的信息输出装置，比如语音提醒、压力传感、温度传感、震动传感等方式；
数据处理中心，所述数据处理中心用于系统的总体控制，包括图像采集设备的图像的采集、无线传输，传感器数据的接受、处理、分析、传输；其中的图像和声音传输通过传输模块实现，该传输模块实时地从图像采集设备采集图像同时采集佩戴者周围的声音并远程传输。
优选的，所述图像采集设备是对穿戴者正面进行采集，或是全方位各个视角进行采集；如果是全方位各个视角进行采集，在数据处理中心将全方位视角的图像进行图像拼接，形成全景图，或者不进行拼接，将各个视角的图像分别存放。
优选的，所述测距传感器与红外传感器，与所述图像采集设备一一对应，对准相同的角度，用于检测周边信息；测距传感器与红外传感器同样对穿戴者正面进行采集，或是全方位各个视角进行采集；如果是全方位各个视角进行采集，在数据处理中心将全方位视角的距离图像与红外图像分别进行图像拼接，形成距离全景图与红外全景图，或不进行拼接，将各个视角的距离图像与红外图像分别存放。
优选的，所述用于语音交互的语音模块是双向的，设备既能监听佩戴者的指令，同时设备也能根据需要向佩戴者发出相关信息。
优选的，所述信息输出装置，如果通过对距离图像与红外图像的分析发现，有物体正在接近佩戴者的，发出提示并指明方向，提醒佩戴者注意安全，同时，信息输出装置包含压力传感器和/或温度传感器，这两种传感器可以分别通过对佩戴者进行刺激，达到同样的效果，此外，利用震动传感的方式，设备也可以对佩戴者进行方向指引。
优选的，所述传输模块实时地从图像采集设备采集图像同时采集佩戴者周围的声音并通过无线wifi、蓝牙信号远程传输给监护者，监护者与设备佩戴者之间进行图像传输和/或语音交互，从而达到远程监护的目的。
与现有技术相比，本发明具有如下的有益效果：
本发明为可穿戴式设备，具有简单便携、易扩展等优点，可以让全盲人群在日常生活中使用；同时，采用了数据处理中心，可以拥有智能设备的其他功能；此外，本发明所公开的硬件可以作为一个全盲人群的可穿戴辅助器具平台，对于不同类型及不同程度的功能需求，可以针对性地设计配套的周围情况监测方法，达到实时监护的目的。同时对于不同使用者的需求，可以针对性地以不同的方式(声音、压力、温度、震动等)输出信号，用于提醒使用者周围的情况。
附图说明
通过阅读参照以下附图对非限制性实施例所作的详细描述，本发明的其它特征、目的和优点将会变得更明显：
图1为本发明一较优实施例的结构示意图；
图2为本发明一较优实施例的工作原理框图；
图中：1为头戴式眼镜支架，2为信号输出装置，3为环绕一周的光学摄像头以及红外摄像头，4为左右眼镜片；5为数据处理中心。
具体实施方式
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明，但不以任何形式限制本发明。应当指出的是，对本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变形和改进。这些都属于本发明的保护范围。
如图1所示，为本发明一较优实施例的针对全盲人群的的引导设备结构示意图， 图中：头戴式眼镜支架1，信息输出装置为声音、压力、温度信号输出装置2，图像采集设备为环绕一周的光学摄像头以及红外摄像头3，左右眼镜片4；5为数据处理中心，其中：
所述的头戴式眼镜支架1用于安装、连接和固定系统的各个部件，以及方便用户佩戴；
所述的声音、压力、温度信号输出装置2，用于输出信号以提醒或提示使用者；麦克风用来将使用者的语音命令传输给数据处理中心，经过数据处理中心的分析理解，能够对系统有所控制。
所述的环绕一周的光学摄像头以及红外摄像头3，用于实时监督周围的情况，并且将记录的信息传输给数据处理中心；
多个传感器，用于检测外部信息和设备所处状态并将信号传输给数据处理中心；
所述的数据处理中心5，接收到来自光学摄像头以及红外摄像头3的图像数据后，进行算法处理，如果检测到危险物体或者正在快速接近的物体，通过声音、压力、温度信号输出装置2提示使用者；其中使用到的算法根据需求不同而选择，这些算法可以是现有技术，也可以是创新的算法，算法本身不属于本发明的重点和改进。数据处理中心5中包含语音模块和传输模块。语音模块用于设备与佩戴者之间的语音交互，而传输模块用于佩戴者与远程监护者之间的语音与图像传输。
本实施例中，所述图像采集设备(环绕一周的光学摄像头以及红外摄像头3)在支架的前后左右方向都设置，以监督各方面的情况。当然，在其他实施例中也可以只对于需要的角度进行监控。
本实施例中，所述多个传感器可以包括但不限于红外传感器、测距传感器、温度传感器、压力传感器、陀螺仪，加速度计等至少一种。测距传感器与红外传感器用于检测外部信息，这些信息将用于分析周边环境；陀螺仪加速度计等用于检测可穿戴引导设备当前状态信息。更优选的，传感器也在支架的各个方向都有设置，用以监督各个方向的情况。
本实施例中，所述信息输出装置可以集成在数据处理中心中，也可以成为独立的模块分离出来，还可以用接线的方式与数据处理中心连接。在接收数据处理中心的信息后，分别通过不同的方式(语音、压力、温度、震动等)传递给设备的佩戴者。比如，可控压力传输装置，可控温度传输装置等，通过压力、温度的变化，向佩戴者提供对应的信息。
本实施例中，所述语音模块集成在数据处理中心中，当然，在其他实施例中也可以采用独立于数据处理中心的方式存在。所述数据处理中心对距离图像与红外图像进行分析，采用的算法根据环境不同，需求不同而做出相应的调整。语音模块中有麦克风和扬声器，通过麦克风，用户可以以此对系统的部分功能进行选择、设定；通过扬声器，本设备可以讲监测到的情况以及相关信息通过扬声器或耳机传达给佩戴者。
本实施例中，所述传输模块集成在数据处理中心中，传输方式可以有多种选择，比如用wifi、蓝牙等方式。监护者与设备佩戴者可以实时地通过图像传输看到对方，也可以通过语音传输进行实时交谈。语音模块是双向的，设备既可以监听佩戴者的指令，同时设备也会根据需要向佩戴者发出相关信息。
本实施例所述系统的主要功能是为全盲人群提供引导，该系统不仅可以对各种环境进行监测，让患者即使在看不到的情况下，依然能够对周围的环境有所了解，而且在数据处理中心中可以针对地设计出不同的环境监测的程序，让患者各种各样的环境中都能够保护自身安全，了解周围状况；数据处理中心还可以将图像信号、语音信号与必要的信息通过无线传输的方式发送给远程监护终端，使得监护人可以通过远程的方式实时监护本系统的使用者。
本发明所述系统能够实时地全方位采集现实场景，利用传感器全方位检测周边环境，将分析后的数据经过无线传输给远程监护设备，达到导盲、远程监护的功能。
以上对本发明的具体实施例进行了描述。需要理解的是，本发明并不局限于上述特定实施方式，本领域技术人员可以在权利要求的范围内做出各种变形或修改，这并不影响本发明的实质内容。

Claims (8)

  1. 一种针对全盲人群的可穿戴式引导设备，其特征在于，包括：
    头戴式眼镜支架，用于安装及连接系统的各个部件以及方便用户佩戴；
    图像采集设备，设置在头戴式眼镜支架上，用于记录周边画面；
    多个传感器，用于检测外部信息和设备所处状态并将信号传输给数据处理中心；
    用于语音交互的语音模块，设备用语音的方式告知佩戴者信息，同时佩戴者能以语音的方式对设备传达指令；
    用于提醒佩戴者相关信息的信息输出装置，所输出的信号来自数据处理中心；
    数据处理中心，所述数据处理中心用于系统的总体控制，包括图像采集设备的图像的采集、无线传输，传感器数据的接受、处理、分析、传输；其中的图像和声音传输通过传输模块实现，该传输模块实时地从图像采集设备采集图像同时采集佩戴者周围的声音并传输。
  2. 根据权利要求1所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述图像采集设备是对穿戴者正面进行采集，或是全方位各个视角进行采集；如果是全方位各个视角进行采集，在数据处理中心将全方位视角的图像进行图像拼接，形成全景图，或者不进行拼接，将各个视角的图像分别存放。
  3. 根据权利要求2所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述测距传感器与红外传感器，与所述图像采集设备一一对应，对准相同的角度，用于检测周边信息；测距传感器与红外传感器同样对穿戴者正面进行采集，或是全方位各个视角进行采集；如果是全方位各个视角进行采集，在数据处理中心将全方位视角的距离图像与红外图像分别进行图像拼接，形成距离全景图与红外全景图，或不进行拼接，将各个视角的距离图像与红外图像分别存放。
  4. 根据权利要求1-3任一项所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述设备状态信息，至包括方向信息、位置信息、角度信息中至少一种，利用这些信息，可穿戴引导设备推测出佩戴者头部的运动状态，进而显示相应的画面。
  5. 根据权利要求1-3任一项所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述用于语音交互的语音模块是双向的，设备既能监听佩戴者的指令，同时设备也能根据需要向佩戴者发出相关信息。
  6. 根据权利要求1-3任一项所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述用于提醒佩戴者相关信息的信息输出装置，如果通过对距离图像与红外图像的分析发现，有物体正在接近佩戴者的，发出提示并指明方向，提醒佩戴者注意安全，同时，信息输出装置包含压力传感器和/或温度传感器，这两种传感器可以分别通过对佩戴者进行刺激，达到同样的效果，此外，利用震动传感的方式，设备也可以对佩戴者进行方向指引。
  7. 根据权利要求1-3任一项所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述数据处理中心对距离图像与红外图像进行分析，采用的算法根据环境不同，需求不同而做出相应的调整。
  8. 根据权利要求1-3任一项所述的一种针对全盲人群的可穿戴式引导设备，其特征在于，所述传输模块实时地从图像采集设备采集图像同时采集佩戴者周围的声音并通过无线wifi、蓝牙信号远程传输给监护者，监护者与设备佩戴者之间进行图像传输和/或语音交互，从而达到远程监护的目的。
PCT/CN2014/093532 2014-12-04 2014-12-11 针对全盲人群的可穿戴式引导设备 Ceased WO2016086440A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410736802.9A CN104473717A (zh) 2014-12-04 2014-12-04 针对全盲人群的可穿戴式引导设备
CN201410736802.9 2014-12-04

Publications (1)

Publication Number Publication Date
WO2016086440A1 true WO2016086440A1 (zh) 2016-06-09

Family

ID=52748424

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/093532 Ceased WO2016086440A1 (zh) 2014-12-04 2014-12-11 针对全盲人群的可穿戴式引导设备

Country Status (2)

Country Link
CN (1) CN104473717A (zh)
WO (1) WO2016086440A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106726043A (zh) * 2016-12-26 2017-05-31 中国人民解放军第五三中心医院 脊柱损伤康复训练及防护服
CN108852620A (zh) * 2018-01-19 2018-11-23 郭磊 智能颈戴设备及其控制方法
CN111643324A (zh) * 2020-07-13 2020-09-11 江苏中科智能制造研究院有限公司 一种智能盲人眼镜
US10909372B2 (en) 2018-05-28 2021-02-02 Microsoft Technology Licensing, Llc Assistive device for the visually-impaired
WO2022043995A1 (en) 2020-08-28 2022-03-03 Anatoli Rapoport Head-mounted guide unit for blind people
CN114246766A (zh) * 2021-12-22 2022-03-29 北京科技大学 基于多段式气囊交互导航的智能助盲头箍及配置方法

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104983511A (zh) * 2015-05-18 2015-10-21 上海交通大学 针对全盲视觉障碍者的语音帮助智能眼镜系统
WO2017120907A1 (zh) * 2016-01-15 2017-07-20 赵政荣 进行游戏时的提醒方法和头戴虚拟设备
CN105708663A (zh) * 2016-01-20 2016-06-29 深圳视觉龙智能传感器有限公司 一种盲人导引装置
CN206214373U (zh) * 2016-03-07 2017-06-06 维看公司 用于向盲人提供视觉信息的物体检测、分析及提示系统
CN105912988B (zh) * 2016-03-31 2020-01-10 宇龙计算机通信科技(深圳)有限公司 一种环境变化提醒方法、系统与头戴式vr设备
US9823477B1 (en) * 2016-05-02 2017-11-21 Futurewei Technologies, Inc. Head mounted display content capture and sharing
CN106249866B (zh) * 2016-05-12 2018-11-13 温州职业技术学院 视觉辅助眼镜及其图像识别方法
CN106074099A (zh) * 2016-06-13 2016-11-09 李彤轩 盲人专用智能引导系统
CN106231556A (zh) * 2016-08-04 2016-12-14 国家电网公司 一种用于电力检修的人员安全定位和导航装置
WO2018098819A1 (zh) * 2016-12-02 2018-06-07 深圳前海达闼云端智能科技有限公司 一种导盲设备和方法
CN106999336A (zh) * 2016-12-26 2017-08-01 深圳前海达闼云端智能科技有限公司 导盲的方法和装置以及导盲设备
WO2018119586A1 (zh) * 2016-12-26 2018-07-05 深圳前海达闼云端智能科技有限公司 导盲的方法和装置以及导盲设备
CN115357748B (zh) * 2017-01-17 2025-10-21 腾讯科技（上海）有限公司 头戴式装置
CN106843491A (zh) * 2017-02-04 2017-06-13 上海肇观电子科技有限公司 带增强现实的智能设备及电子设备
CN110730939A (zh) * 2017-11-29 2020-01-24 深圳市柔宇科技有限公司 用于头戴式显示器上的信息提示方法、装置和设备
CN109077901A (zh) * 2018-06-26 2018-12-25 北京化工大学 一种符合人体工学的可穿戴式助盲机器人机构
CN109085926A (zh) * 2018-08-21 2018-12-25 华东师范大学 一种多模态成像与多感知交融的增强现实系统及其应用
CN109359581A (zh) * 2018-10-15 2019-02-19 成都快眼科技有限公司 一种基于智能眼镜的人脸注册方法
CN110489005B (zh) * 2019-06-28 2022-12-27 浙江工业大学 具有触摸定位功能的二维点显器及其二维触点驱动方法
CN110448435B (zh) * 2019-07-15 2021-07-16 联想(北京)有限公司 一种提示方法及受控运动设备
CN111449841A (zh) * 2020-04-02 2020-07-28 上海海洋大学 一种假体视觉下障碍物语音提示仿真装置
CN113705278A (zh) * 2020-05-20 2021-11-26 深圳市看见智能科技有限公司 用于智能眼镜的人体行为识别系统及方法
CN111832567B (zh) * 2020-05-22 2022-06-10 浙江大学 一种盲人友好的书本文字阅读检测交互方法
CN113116686A (zh) * 2021-04-27 2021-07-16 尹崇亮 一种盲人用提醒器
CN115472039B (zh) * 2021-06-10 2024-03-01 上海博泰悦臻网络技术服务有限公司 信息处理方法及相关产品
CN114185426A (zh) * 2021-10-28 2022-03-15 安徽工程大学 一种指尖穿戴式双通道交互装置
CN114363826A (zh) * 2021-12-22 2022-04-15 长沙智能驾驶研究院有限公司 一种信息提示方法、装置、设备及可读存储介质
CN114338619A (zh) * 2021-12-29 2022-04-12 鲁春宝 一种售后维修用远程视频支持装置
CN117001715A (zh) * 2023-08-30 2023-11-07 哈尔滨工业大学 一种面向视觉功能障碍者的智能辅助系统及方法
CN119326589A (zh) * 2024-09-29 2025-01-21 同济大学 一种针对全盲或半盲人群的智能穿戴头带
CN119385753B (zh) * 2024-10-29 2025-09-30 深圳职业技术大学 基于视触跨模态感知的盲人导航方法、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101498845A (zh) * 2009-01-14 2009-08-05 长春大学 智能盲人导航眼镜
CN101797197A (zh) * 2009-11-23 2010-08-11 常州达奇信息科技有限公司 便携式盲人自主导航系统
CN202179671U (zh) * 2011-07-22 2012-04-04 张殿礼 智能导盲眼镜
CN103720576A (zh) * 2013-11-27 2014-04-16 山东科技大学 一种盲人导航眼镜
CN104127301A (zh) * 2014-07-15 2014-11-05 深圳先进技术研究院 导盲智能眼镜及其导盲方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001221649A (ja) * 2000-02-07 2001-08-17 Mitsubishi Electric Corp 歩行者誘導システム
DE10041085C2 (de) * 2000-08-22 2003-04-30 Fujitsu Siemens Computers Gmbh Tragbares Orientierungssystem
TW584997B (en) * 2002-07-29 2004-04-21 Jiun-Bei Chang Execution method and device of portable guidance and security system
AU2003280835A1 (en) * 2003-11-17 2004-06-06 Satoru Kaneko Ultrasonic sight assisting device
CN100418498C (zh) * 2005-11-25 2008-09-17 上海电气自动化设计研究所有限公司 导盲器
WO2013067513A1 (en) * 2011-11-04 2013-05-10 Massachusetts Eye & Ear Infirmary Contextual image stabilization
CN102973395B (zh) * 2012-11-30 2015-04-08 中国舰船研究设计中心 一种多功能智能导盲方法、处理器及其装置
CN103976854A (zh) * 2014-05-15 2014-08-13 深圳市卡卓无线信息技术有限公司 一种盲人智能眼镜
CN104021548A (zh) * 2014-05-16 2014-09-03 中国科学院西安光学精密机械研究所 一种获取场景4d信息的方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101498845A (zh) * 2009-01-14 2009-08-05 长春大学 智能盲人导航眼镜
CN101797197A (zh) * 2009-11-23 2010-08-11 常州达奇信息科技有限公司 便携式盲人自主导航系统
CN202179671U (zh) * 2011-07-22 2012-04-04 张殿礼 智能导盲眼镜
CN103720576A (zh) * 2013-11-27 2014-04-16 山东科技大学 一种盲人导航眼镜
CN104127301A (zh) * 2014-07-15 2014-11-05 深圳先进技术研究院 导盲智能眼镜及其导盲方法

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106726043A (zh) * 2016-12-26 2017-05-31 中国人民解放军第五三中心医院 脊柱损伤康复训练及防护服
CN108852620A (zh) * 2018-01-19 2018-11-23 郭磊 智能颈戴设备及其控制方法
US10909372B2 (en) 2018-05-28 2021-02-02 Microsoft Technology Licensing, Llc Assistive device for the visually-impaired
CN111643324A (zh) * 2020-07-13 2020-09-11 江苏中科智能制造研究院有限公司 一种智能盲人眼镜
WO2022043995A1 (en) 2020-08-28 2022-03-03 Anatoli Rapoport Head-mounted guide unit for blind people
CN114246766A (zh) * 2021-12-22 2022-03-29 北京科技大学 基于多段式气囊交互导航的智能助盲头箍及配置方法

Also Published As

Publication number Publication date
CN104473717A (zh) 2015-04-01

Similar Documents

Publication Publication Date Title
WO2016086440A1 (zh) 针对全盲人群的可穿戴式引导设备
CN104306102B (zh) 针对视觉障碍患者的头戴式视觉辅助系统
US8744113B1 (en) Communication eyewear assembly with zone of safety capability
CN104427960B (zh) 自适应视觉辅助装置
WO2016086441A1 (zh) 针对全盲人群的室内定位系统
US8902303B2 (en) Apparatus connectable to glasses
KR101885473B1 (ko) 시각 장애인 보조용 스마트 글래스
US20130250078A1 (en) Visual aid
KR101467529B1 (ko) 착용형 정보 제공 시스템
KR20090105531A (ko) 카메라센서로 찍은 문서 이미지를 시각장애인에게 음성으로알려주는 방법 및 장치
US11327317B2 (en) Information processing apparatus and information processing method
KR102047988B1 (ko) 시력 취약계층을 위한 시력 보조장치와 원격관리장치 및 시력 보조방법
EP4011093B1 (en) Ear-plug assembly for hear-through audio systems
KR20090036183A (ko) 카메라센서로 찍은 문서 이미지를 시각장애인에게 음성으로알려주는 방법 및 장치
JP6528263B2 (ja) ヘッドマウントディスプレイ
JP2020154569A (ja) 表示装置、表示制御方法、及び表示システム
KR20190136144A (ko) 시각 장애인용 스마트 기기
JP2017191546A (ja) 医療用ヘッドマウントディスプレイ、医療用ヘッドマウントディスプレイのプログラムおよび医療用ヘッドマウントディスプレイの制御方法
CN104090385A (zh) 一种防作弊用智能眼镜
WO2016086438A1 (zh) 针对视觉障碍患者的头戴式多媒体终端辅助观看系统
CN106842565A (zh) 一种分离式可穿戴智能视觉增强设备
US11816886B1 (en) Apparatus, system, and method for machine perception
KR101230341B1 (ko) 시각 지원 보조 시스템 및 방법
KR20210066339A (ko) 시야 보조 장치, 방법, 컴퓨터 판독 가능한 기록 매체 및 컴퓨터 프로그램
Vítek et al. New possibilities for blind people navigation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14907488

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14907488

Country of ref document: EP

Kind code of ref document: A1