WO2016086441A1 - 针对全盲人群的室内定位系统 - Google Patents

针对全盲人群的室内定位系统 Download PDF

Info

Publication number
WO2016086441A1
WO2016086441A1 PCT/CN2014/093533 CN2014093533W WO2016086441A1 WO 2016086441 A1 WO2016086441 A1 WO 2016086441A1 CN 2014093533 W CN2014093533 W CN 2014093533W WO 2016086441 A1 WO2016086441 A1 WO 2016086441A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
blind
positioning
guiding device
wearable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/093533
Other languages
English (en)
French (fr)
Inventor
杨小康
翟广涛
李铎
闵雄阔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiao Tong University
Original Assignee
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiao Tong University filed Critical Shanghai Jiao Tong University
Publication of WO2016086441A1 publication Critical patent/WO2016086441A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception

Definitions

  • the invention relates to the technical field of blind indoor positioning, and in particular to an indoor positioning system for a blind population.
  • Blind people are those who suffer from diseases or accidental injuries that cause blindness or blindness. Blind people are divided into congenital blind people and acquired blind people. According to estimates by the World Health Organization, there are between 40 million and 45 million blind people worldwide. Among the more than 83 million disabled people in China, there are 12.33 million visually handicapped persons and 5 million blind people. It is one of the countries with the largest number of blind people in the world. How to solve their normal learning, work and life issues has become the focus of social attention.
  • Visual impairment is caused by innate or acquired causes of partial or total loss of function of the visual system, so that it is impossible to accurately identify external things.
  • visual failure is less than 0.3, or visual field is within 20 °.
  • visual impairment can be divided into two categories: the visual acuity of the two eyes is less than 0.3 above 0.03 or the visual field is less than 20°; the visual acuity of the two eyes is less than 0.03 for total blindness.
  • People with amblyopia can usually use vision for daily life, but there are certain obstacles in visual observation. Generally, optical aids or special magnification equipment are needed to observe things.
  • the blind population cannot rely on vision for daily life at all, and usually can only take an alternative approach to daily life.
  • haptic aids, hearing aids, and other types of assistive devices are used in place of vision.
  • Most information barrier technologies and devices can be applied to the entire blind population. Almost all visually impaired people can compensate for the quality of life and participate in social life through assistive devices.
  • the second sample survey showed that only 7.97% of the visually impaired persons in China were assisted with services; 14.49% of the cities and 5.82% of the rural areas.
  • the wearable guiding device refers to an auxiliary device that can improve various situations in a complicated environment even if visual information is not accepted by detection and data analysis of the wearer's surrounding environment. Due to the particularity of the blind population, the wearable guiding device for the blind population should belong to the non-visual visual aid, making full use of functions other than vision, such as hearing and touch, to compensate for the defects of visual function and improve the quality of life of the visually impaired.
  • Auxiliary equipment involves all aspects of life, work, study, entertainment, etc. of the blind population. For example: for daily life Live blind mobile phones and telephones, vocal clocks; blind canes and blind roads for travel; Braille for reading and communication, dot display, audio books, various screen reading software, etc.
  • the indoor positioning system for the blind is very difficult to implement. Due to the introduction of the wearable guiding device, we hope to make an indoor positioning system for the blind population.
  • the indoor positioning system for the blind population is of great significance to the life and work of the blind population.
  • the existing variety of indoor positioning systems are not suitable for the special group of blind people.
  • For the blind it does not conform to the principles of ease of use, application, simple portability, and scalability.
  • the object of the present invention is to provide an indoor positioning system for a blind population, which can collect real-life scenes in real time, analyze the scenes, extract information hidden by the positioning tags, and provide voice reminders. Signals such as pressure sensing reminder, vibration sensing reminder, temperature sensing reminder, etc. are transmitted to the blind to achieve indoor positioning.
  • the wearable guiding device includes various sensors for monitoring the surrounding conditions, and transmitting signals to the wearer with sound, touch and the like to realize the function of full blind guidance.
  • the present invention provides an indoor positioning system for a blind population, comprising: a wearable guiding device and a positioning tag containing a series of specific information, the wearable guiding device detecting a positioning tag distributed throughout the room and extracting The specific information contained in the positioning tag is transmitted and transmitted to the blind person, thereby realizing the function of indoor positioning and guiding.
  • the wearable guiding device comprises:
  • Head-mounted eyeglass holder for mounting and connecting the various components of the system and for easy wearing by the user;
  • An image acquisition device is disposed on the head mounted frame for recording a peripheral picture
  • a warning reminding device for reminding the blind the device is controlled by a data processing center;
  • An interaction module that helps the wearer interact with the wearable boot device
  • a plurality of sensors for detecting external information and the state of the glasses and transmitting the signals to the data processing center;
  • a data processing center for overall control of the system, including image acquisition and processing of the image acquisition device, and acceptance and processing of the sensor data; wherein the image processing is implemented by an image processing module, the image processing module is real-time
  • the image is collected from the image acquisition device, and the collected image is processed. After analyzing the scene, the hidden information of the positioning tag is extracted and transmitted to the wearer to achieve the effect of indoor positioning.
  • the image collecting device collects the front side of the wearer or collects the various angles of the wearer in all directions; if the image is collected in all directions, the image is spliced in the data processing center.
  • the panoramas are formed, or the images of the respective angles of view are separately stored without splicing.
  • the warning reminding device uses one or more of a voice reminder, a pressure sensing reminder, a vibration sensing reminder, and a temperature sensing reminding method to perform reminding.
  • the sensor collects and detects the external information and the state of the glasses. If the object is approaching the wearer by analyzing the distance image and the infrared image, the warning reminding device issues a prompt and indicates the direction to remind the wearer to pay attention. Safety, at the same time, the pressure sensor is used to stimulate the wearer to achieve the same effect.
  • the data processing center detects, by using an algorithm in the image processing module, whether the image contains a positioning tag disposed in a certain place, and extracts information therein, and according to the information, the data processing center passes the voice reminder and pressure At least one of the sensing reminder, the vibration sensing reminder, or the temperature sensing reminding mode informs the wearable guiding device wearer.
  • the interaction module wherein the manner in which the wearable guiding device interacts with the wearer includes one or more of voice, motion recognition, and vibration sensing.
  • the positioning tag is disposed at each position in a specific scene according to the need, and the wearable guiding device captures an image through the image capturing device, detects the positioning tag through the data processing center, and extracts the specific component included in the positioning tag. information.
  • the invention also provides a method for identifying a positioning tag of an indoor positioning system for a blind population, the method comprising the following steps:
  • Initial entry In the initial entry process, the wearer of the wearable guiding device reaches the position suitable for detecting the positioning label under the guidance of the device, and then performs detection;
  • Prompt link When entering, the device prompts to send out, prompting to start detection; the prompt can be voice reminder, pressure sensing reminder, vibration sensing reminder, temperature sensing reminder, etc. or a combination of some of them;
  • the wearable guiding device After the input is successful, the wearable guiding device performs image recognition and information extraction on the image. After successfully extracting the information in the positioning tag, the wearable guiding device issues a prompt, and then starts the guiding process.
  • the positioning tag form can be various, and is not limited to a certain form.
  • the form of the positioning tag exists in the form of an image, in which case an image capturing device on the wearable guiding device needs to be used for identification; or the positioning tag exists in the form of a circuit or an approach communication device.
  • the wearable guiding device uses the sensor to detect; or, in a special environment, the positioning tag is hidden by technical means, so that people cannot see its existence, but can be detected by the wearable guiding device. .
  • the present invention has the following beneficial effects:
  • the present invention is an indoor positioning system for blind people.
  • Wearable devices that are simple, portable, easy to expand, etc.
  • the advantage is that the blind population can be used in daily life; the recognition processing algorithm is used to detect the positioning label and extract the information; the signal is output in different ways (sound, pressure, temperature, vibration, etc.) for reminding the wearer around the situation.
  • the camera By using the camera to detect the information in the positioning tag, the function of indoor positioning of the blind person can be realized.
  • FIG. 1 is a schematic view showing the working principle of a preferred embodiment of the present invention.
  • FIG. 2 is a schematic structural view of a preferred embodiment of the present invention.
  • 1 is a head-mounted glasses holder
  • 2 is a warning reminder device
  • 3 is an optical camera and an infrared camera surrounding one week
  • 4 is a left and right eyeglasses
  • 5 is a data processing center.
  • FIG. 1 it is a schematic diagram of the working principle of the indoor positioning system for the blind population, including a wearable guiding device, a positioning label containing a series of specific information, and the wearable guiding device detects the positioning label distributed throughout the room, and is wearable and guided.
  • the device detects the positioning tag and extracts the specific information contained in the positioning tag, and transmits information to the blind person through voice reminder, pressure sensing reminder, vibration sensing reminder, temperature sensing reminder, etc., thereby realizing the function of indoor positioning and guiding.
  • the so-called specific information means that the information stored in the positioning tag is stored by an algorithm in order to facilitate indoor positioning.
  • This information includes location information, direction information, function information, and the like.
  • the algorithm for storing the information on the positioning tag is related to the existence form of the positioning tag. For example, if it is an image tag, the image encryption algorithm or the two-dimensional code encoding may be used to store the related information. Accordingly, the algorithm used in the extraction of this information corresponds to the encryption algorithm.
  • FIG. 2 is a schematic structural diagram of a wearable guiding device for a blind population according to a preferred embodiment of the present invention.
  • the head glasses holders 1 and 2 are warning reminding devices, and the image capturing device is a one-week optical device.
  • the camera and the infrared camera 3, the left and right eyeglasses 4; 5 are data processing centers (interaction modules), wherein:
  • the headgear support 1 is used for mounting, connecting and fixing various components of the system, and is convenient for the user to wear wore;
  • the warning reminding device 2 is configured to output a signal to remind or prompt the wearer; the microphone is used to transmit the voice command of the wearer to the system, and the system can be controlled by the analysis and understanding of the system.
  • the surrounding optical camera and the infrared camera 3 are used for real-time monitoring of surrounding conditions and transmitting the recorded information to the data processing center;
  • the sensors are disposed in all directions of the bracket to supervise various directions. Case;
  • the left and right eyeglass lenses 4 are used to block blind glasses; in other embodiments, they may also be omitted;
  • the data processing center 5 is used for overall control of the system, including image acquisition and processing of the camera 3, and acceptance and processing of sensor data; wherein the image processing is implemented by an image processing module, and the image processing module
  • the image is acquired from the camera 3 in real time, and the acquired image is processed.
  • the hidden information of the positioning tag is extracted, and at least one of the voice reminder, the pressure sensing reminder, the vibration sensing reminder, and the temperature sensing reminder is transmitted to the wearer to achieve the indoor positioning effect.
  • the data processing center 5 after receiving the image data from the camera 3, performs processing, and if the dangerous object or the object that is rapidly approaching is detected, the wearer is prompted by the warning reminding device 2;
  • the algorithms used are adaptively adapted to the needs.
  • the interaction module is integrated in the data processing center 5, and the wearable guiding device can communicate with the wearer in a plurality of interactive manners, and the interaction manner of the wearable guiding device can be freely selected according to needs. In other embodiments, the interaction modules can also be set separately.
  • the interaction module wherein the wearable guiding device can interact with the user in a variety of ways, including voice, motion recognition, and vibration sensing.
  • the image acquisition device may be an ordinary camera or other device such as an infrared sensor.
  • the specific settings are based on actual needs and usage environment.
  • the image capturing device may only collect the front side of the wearer, or may collect all the angles of view.
  • an optical camera that surrounds the circumference and the infrared camera 3 are used;
  • the images of the omnidirectional view can be spliced to form a panoramic image, or the images of the respective viewing angles can be separately stored without splicing.
  • the positioning tag form can be various and is not limited to a certain form. Positioning tags are placed at various locations in a particular scene as needed.
  • the positioning tag can be in the form of an image or a chip or a wireless circuit. The specific setting depends on the actual needs and the use environment, and its appearance does not affect its substantive role.
  • the positioning tag may be in the form of an image, in which case a camera on the wearable guiding device is required for identification.
  • the positioning tag can also be in the form of a circuit or an incoming communication device, in which case the wearable guiding device utilizes other sensors therein for detection.
  • the positioning tag can also be hidden by certain technical means. People can't see it, but it can be detected by the wearable guiding device, for example, the positioning tag is hidden, but the surface temperature is guaranteed.
  • the distribution contains certain information, so this special positioning tag can be detected by the infrared sensor.
  • the wearable guiding device needs to meet certain requirements when identifying the positioning tag, and the wearable guiding device first uses some algorithms to detect the position of the positioning tag, and then uses a voice reminder, a pressure sensing reminder, a vibration sensing reminder, The sensing method such as temperature sensing reminds the wearer to reach the designated position and then recognizes it to improve the accuracy of information extraction.
  • the method for identifying the positioning tag includes the following steps:
  • Initial entry In the initial entry process, the wearer of the wearable guiding device reaches the position suitable for detecting the positioning label under the guidance of the device, and then performs detection;
  • Prompt link When entering, the device prompts to send out, prompting to start detection; the prompt can be voice reminder, pressure sensing reminder, vibration sensing reminder, temperature sensing reminder, etc. or a combination of some of them;
  • the wearable guiding device After the input is successful, the wearable guiding device performs image recognition and information extraction on the image. After successfully extracting the information in the positioning tag, the wearable guiding device issues a prompt, and then starts the guiding process.
  • the main function of the system described in this embodiment is to perform indoor positioning and guidance for the blind population.
  • the system can not only monitor various environments, but also enable patients to understand the surrounding environment even if they cannot see it.
  • different environmental monitoring programs can be designed, so that patients can protect themselves in various environments and understand the surrounding conditions; the data processing center uses various detection algorithms to analyze the positioning tags. Information and communicate to the wearer. Thereby achieving the function of indoor positioning.

Landscapes

  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Alarm Systems (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

本发明提供了一种针对全盲人群的室内定位系统,包括:可穿戴的引导设备和含有一系列特定信息的定位标签,可穿戴引导设备检测遍布于室内各处的定位标签并且提取出定位标签中含有的特定信息,并将信息传递给盲人,从而实现室内定位与引导的功能。可穿戴引导设备包括头戴式眼镜支架;用于检测外部环境的图像采集设备;用于提醒的装置;以及数据处理中心。本发明能够让盲人通过可穿戴引导设备观察外部环境,检测到特定的定位标签后,通过分析,提取出定位标签中的信息,通过语音、压力传感、温度传感等方式将相应的信息转达给盲人,可穿戴引导设备可以与盲人进行交互,进而帮助盲人在特定的环境中定位。

Description

针对全盲人群的室内定位系统 技术领域
本发明涉及盲人室内定位技术领域,具体地,涉及一种针对全盲人群的室内定位系统。
背景技术
盲人就是眼睛患有疾病或受到意外伤害而导致双目失明或单目失明的人,盲人分为先天盲人与后天盲人之分。根据世界卫生组织的估计,全世界有盲人4000万到4500万。我国8300多万残疾人中,视力残疾人1233万,盲人约500万,是世界上盲人人口最多的国家之一。如何解决他们正常学习、工作和生活问题成为社会关注的焦点。
视觉障碍是由于先天或者后天原因致使视觉系统部分或全部丧失功能,以致无法对外界事物进行准确辨识。依据相关规定,视觉未达0.3,或视野在20°以内者即为视觉障碍。根据障碍程度不同,视觉障碍可以分为两类:两眼视力测定值在0.03以上未达0.3或其视野在20°以内为弱视;两眼视力测定值未达0.03为全盲。弱视人群通常可以利用视觉进行日常生活,但是在视物方面有一定障碍,一般需要借助光学辅助设备或特殊放大设备来观察事物。
全盲人群完全不能依赖视觉进行日常生活,通常只能采取替代方式进行日常生活。例如,利用触觉辅助设备、听觉辅助设备和其它类型辅助设备来替代视觉。大多数信息无障碍技术和设备都可以应用于全盲人群。几乎所有的视力残疾人都可以通过辅助器具补偿功能,不同程度地提高生活质量,参与社会生活。然而,第二次抽样调查显示,我国的视力残疾人中获得辅助器具服务的仅占7.97%;其中城市14.49%,农村5.82%。
可穿戴引导设备是指可以通过对于穿戴者周围环境的检测与数据分析提高其在复杂环境中的即使是不接受视觉信息的情况下依然能够应对各种情况的辅助设备。由于全盲人群的特殊性,针对全盲人群的可穿戴引导设备应当属于非视觉助视器,充分利用视觉以外的功能,如听觉、触觉等功能来弥补视觉功能的缺陷从而提高视障者生存质量的辅助器具,涉及到全盲人群生活、工作、学习、娱乐等的方方面面。例如:用于日常生 活的盲用手机和电话、发声钟表;用于出行的盲杖、盲道;用于学习交流的盲文、点显器、有声读物、各种读屏软件等。
由于盲人的特殊性,针对盲人的室内定位系统实现起来非常困难,由于可穿戴引导设备的引入,使得我们有希望做出一个针对全盲人群的室内定位系统。
综上所述,针对全盲人群的室内定位系统对于全盲人群的生活、工作有重要意义。现有的种类繁杂的室内定位系统不适用与盲人这个特殊的群体,对于盲人来说,不符合易用、适用、简单便携、可扩展等原则。
发明内容
针对现有技术中的缺陷,本发明的目的是提供一种针对全盲人群的室内定位系统,该系统可实时地采集现实场景,经过对场景的分析,提取定位标签隐藏的信息,并且通过语音提醒、压力传感提醒、震动传感提醒、温度传感提醒等信号方式传递给盲人,达到室内定位的效果。同时,可穿戴引导设备中包含各种传感器用以监视周围情况,并且以声音、触觉等信号传输给佩戴者,以实现全盲引导的功能。
为实现以上目的,本发明提供一种针对全盲人群的室内定位系统,包括:可穿戴的引导设备和含有一系列特定信息的定位标签,可穿戴引导设备检测遍布于室内各处的定位标签并且提取出定位标签中含有的特定信息,并将信息传递给盲人,从而实现室内定位与引导的功能。
优选的,所述的可穿戴引导设备,包括:
头戴式眼镜支架,用于安装及连接系统的各个部件以及方便用户佩戴;
图像采集设备,设置在头戴式眼镜支架上,用于记录周边画面;
用于提醒盲人的警示提醒装置,该装置通过数据处理中心进行控制;
帮助穿戴者与可穿戴引导设备交互的交互模块;
多个传感器,用于检测外部信息和眼镜所处状态并将信号传输给数据处理中心;
数据处理中心,所述数据处理中心用于系统的总体控制,包括图像采集设备的图像的采集、处理,传感器数据的接受和处理;其中的图像处理通过图像处理模块实现,该图像处理模块实时地从图像采集设备采集图像,并对采集的图像进行处理,经过对场景的分析,提取定位标签隐藏的信息并传递给穿戴者,达到室内定位的效果。
进一步的,所述图像采集设备是对穿戴者正面进行采集,或者对穿戴者全方位各个视角进行采集;如果是全方位各个视角进行采集,在数据处理中心将全方位视角的图像进行图像拼接,形成全景图,或者不进行拼接,将各个视角的图像分别存放。
进一步的,所述警示提醒装置采用语音提醒、压力传感提醒、震动传感提醒、温度传感提醒方式中的一种或多种进行提醒。
进一步的,所述传感器采集检测外部信息和眼镜所处状态,如果通过对距离图像与红外图像的分析发现有物体正在接近佩戴者的,所述警示提醒装置发出提示并指明方向,提醒佩戴者注意安全,同时,采用压力传感器对佩戴者进行触觉刺激,达到同样的效果。
进一步的,所述数据处理中心通过图像处理模块中的算法检测出图像中是否含有在某些地方安置好的定位标签,并且提取出其中的信息,根据这些信息,数据处理中心通过语音提醒、压力传感提醒、震动传感提醒或温度传感提醒方式中至少一种告知可穿戴引导设备穿戴者。
进一步的,所述的交互模块,其中可穿戴引导设备与穿戴者的交互方式包括语音、动作识别、震动感应方式中一种或多种。
进一步的,所述定位标签根据需要安置在特定场景中的各个位置,可穿戴引导设备通过图像采集设备捕获图像,经过所述数据处理中心处理检测到定位标签,并且提取出定位标签中含有的特定信息。
本发明还提供一种所述的针对全盲人群的室内定位系统的定位标签的识别方法,所述方法包括以下几个步骤:
初始录入环节:在初始录入环节中,可穿戴引导设备的穿戴者在设备的引导下到达适合检测定位标签的位置,然后进行检测;
提示环节:录入时,设备有提示发出,提示开始检测;所述提示可以是语音提醒、压力传感提醒、震动传感提醒、温度传感提醒等方式或其中某几种方式的结合;
检测环节:录入成功后,可穿戴引导设备对图像进行图像识别与信息提取,在成功提取出定位标签中的信息后,可穿戴引导设备发出提示,接着开始引导的过程。
优选的,所述定位标签形式可以有各种各样,不限定于某种形式。比如:所述定位标签的形式以图像的形式存在,这种情况下,需要用到可穿戴引导设备上的图像采集设备进行识别;或者,所述定位标签以电路或者进场通信装置的形式存在,这种情况下,可穿戴引导设备利用传感器进行检测;或者,在特殊环境中,所述定位标签通过技术手段进行隐藏,使人们看不到它的存在,但能通过可穿戴引导设备检测到。
与现有技术相比,本发明具有如下的有益效果:
本发明为针对盲人的室内定位系统。利用可穿戴式设备,具有简单便携、易扩展等 优点,可以让全盲人群在日常生活中使用;利用识别处理算法,检测定位标签并且提取信息;以不同的方式(声音、压力、温度、震动等)输出信号,用于提醒穿戴者周围的情况。利用摄像头检测定位标签中的信息,可以实现盲人室内定位的功能。
附图说明
通过阅读参照以下附图对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:
图1为本发明一较优实施例的工作原理示意图;
图2为本发明一较优实施例的结构示意图;
图中:1为头戴式眼镜支架,2为警示提醒装置,3为环绕一周的光学摄像头以及红外摄像头,4为左右眼镜片;5为数据处理中心。
具体实施方式
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进。这些都属于本发明的保护范围。
如图1所示,为针对全盲人群的室内定位系统工作原理示意图,包括可穿戴引导设备、含有一系列特定信息的定位标签,可穿戴引导设备检测遍布于室内各处的定位标签,可穿戴引导设备检测到定位标签并且提取出定位标签中含有的特定信息,通过语音提醒、压力传感提醒、震动传感提醒、温度传感提醒等方式向盲人传递信息,从而实现室内定位与引导的功能。
所谓的特定信息是指,为了便于室内定位,利用算法存放在定位标签中的信息。这些信息包括位置信息、方向信息、功能信息等等。信息存放于定位标签的算法与定位标签的存在形式有关,例如,如果是图像标签,那么可以利用图像加密算法,或者二维码编码等方式存放相关信息。相应地,在提取这些信息的环节所用到的算法,与加密算法相对应。
如图2所示,为本发明一较优实施例的针对全盲人群的可穿戴引导设备结构示意图,图中:头戴式眼镜支架1,2为警示提醒装置,图像采集设备为环绕一周的光学摄像头以及红外摄像头3,左右眼镜片4;5为数据处理中心(交互模块),其中:
所述的头戴式眼镜支架1用于安装、连接和固定系统的各个部件,以及方便用户佩 戴;
所述的警示提醒装置2,用于输出信号以提醒或提示穿戴者;用麦克风来将穿戴者的语音命令传输给系统,经过系统的分析理解,能够对系统有所控制。
所述的环绕一周的光学摄像头以及红外摄像头3,用于实时监督周围的情况,并且将记录的信息传输给数据处理中心;
多个传感器,用于检测外部信息和眼镜所处状态并将信号传输给数据处理中心,包括红外传感器、距离传感器等,本实施例中传感器在支架的各个方向都有设置,用以监督各个方向的情况;
所述的左右眼镜片4用于遮挡盲人眼镜;在其他实施例中也可以省略;
所述数据处理中心5,所述数据处理中心用于系统的总体控制,包括摄像头3的图像的采集、处理,传感器数据的接受和处理;其中的图像处理通过图像处理模块实现,该图像处理模块实时地从摄像头3采集图像,并对采集的图像进行处理。经过对场景的分析,提取定位标签隐藏的信息,并且通过语音提醒、压力传感提醒、震动传感提醒、温度传感提醒等方式中至少一种传递给穿戴者,达到室内定位的效果。
作为一个优选实施方式,所述的数据处理中心5,接收到来自摄像头3的图像数据后,进行处理,如果检测到危险物体或者正在快速接近的物体,通过警示提醒装置2提示穿戴者;其中,使用到的算法根据需求不同而进行适应性的更改。交互模块集成在数据处理中心5中,可以采用多种交互方式让可穿戴引导设备与穿戴者进行交流,可穿戴引导设备的交互方式可以根据需要自由选择。在其他实施例中,交互模块也可以独立分开设置。
所述交互模块,其中可穿戴引导设备与使用者的交互方式可以多种多样,包括语音、动作识别、震动感应等方式。
所述图像采集设备可以使普通摄像头,也可以是红外传感器等其他设备。具体设定按照实际需求与使用环境而定。
所述图像采集设备可以只是对穿戴者正面进行采集,也可以是全方位各个视角进行采集,本实施例中是采用了环绕一周的光学摄像头以及红外摄像头3;如果是全方位各个视角进行采集,在数据处理中心可以将全方位视角的图像进行图像拼接,形成全景图,也可以不进行拼接,将各个视角的图像分别存放。
所述定位标签形式可以有各种各样,不限定于某种形式。定位标签根据需要安置在特定场景中的各个位置。定位标签可以是图像的形式,也可以是芯片或是无线电路的形 式,具体设定按照实际需求与使用环境而定,其外观并不影响其实质作用。特别的,定位标签可以图像的形式存在,这种情况下,需要用到可穿戴引导设备上的摄像头进行识别。定位标签也可以以电路或者进场通信装置的形式存在,这种情况下,可穿戴引导设备利用其中的其他传感器进行检测。在特殊环境中,定位标签也可以通过一定的技术手段进行隐藏,是人们看不到它的存在,但是可以通过可穿戴引导设备检测到,比如,将定位标签隐藏起来,但是保证其表面温度的分布中含有一定的信息,那么通过红外传感器,就能够探测到这种特殊的定位标签。
所述可穿戴引导设备在识别定位标签时识别距离与角度需要满足一定的要求,可穿戴引导设备先利用一些算法检测定位标签的位置,然后通过语音提醒、压力传感提醒、震动传感提醒、温度传感提醒等传感方式,引导佩戴者到达指定位置,然后进行识别,以提高信息提取的准确率。
进一步的,上述的针对全盲人群的室内定位系统,其定位标签的识别方法包括以下几个步骤:
初始录入环节:在初始录入环节中,可穿戴引导设备的穿戴者在设备的引导下到达适合检测定位标签的位置,然后进行检测;
提示环节:录入时,设备有提示发出,提示开始检测;所述提示可以是语音提醒、压力传感提醒、震动传感提醒、温度传感提醒等方式或其中某几种方式的结合;
检测环节:录入成功后,可穿戴引导设备对图像进行图像识别与信息提取,在成功提取出定位标签中的信息后,可穿戴引导设备发出提示,接着开始引导的过程。
本实施例所述系统的主要功能是为全盲人群进行室内定位与引导,该系统不仅可以对各种环境进行监测,让患者即使在看不到的情况下,依然能够对周围的环境有所了解,而且在数据处理中心中可以针对地设计出不同的环境监测的程序,让患者各种各样的环境中都能够保护自身安全,了解周围状况;数据处理中心利用各种检测算法分析定位标签中的信息,并且传达给穿戴者。从而实现室内定位的功能。
以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变形或修改,这并不影响本发明的实质内容。

Claims (10)

  1. 一种针对全盲人群的室内定位系统,其特征在于,包括:可穿戴的引导设备和含有一系列特定信息的定位标签,可穿戴引导设备检测遍布于室内各处的定位标签并且提取出定位标签中含有的特定信息,并将信息传递给盲人,从而实现室内定位与引导的功能。
  2. 根据权利要求1所述的针对全盲人群的室内定位系统,其特征在于,所述的可穿戴引导设备,包括:
    头戴式眼镜支架,用于安装及连接系统的各个部件以及方便用户佩戴;
    图像采集设备,设置在头戴式眼镜支架上,用于记录周边画面;
    用于提醒盲人的警示提醒装置,该装置通过数据处理中心进行控制;
    帮助穿戴者与可穿戴引导设备交互的交互模块;
    多个传感器,用于检测外部信息和眼镜所处状态并将信号传输给数据处理中心;
    数据处理中心,所述数据处理中心用于系统的总体控制,包括图像采集设备的图像的采集、处理,传感器数据的接受和处理;其中的图像处理通过图像处理模块实现,该图像处理模块实时地从图像采集设备采集图像,并对采集的图像进行处理,经过对场景的分析,提取定位标签隐藏的信息并传递给穿戴者,达到室内定位的效果。
  3. 根据权利要求2所述的针对全盲人群的室内定位系统,其特征在于,所述图像采集设备是对穿戴者正面进行采集,或者对穿戴者全方位各个视角进行采集;如果是全方位各个视角进行采集,在数据处理中心将全方位视角的图像进行图像拼接,形成全景图,或者不进行拼接,将各个视角的图像分别存放。
  4. 根据权利要求2所述的针对全盲人群的室内定位系统,其特征在于,所述警示提醒装置采用语音提醒、压力传感提醒、震动传感提醒、温度传感提醒方式中的一种或多种进行提醒。
  5. 根据权利要求4所述的针对全盲人群的室内定位系统,其特征在于,所述传感器采集检测外部信息和眼镜所处状态,如果通过对距离图像与红外图像的分析发现有物体正在接近佩戴者的,所述警示提醒装置将发出提示并指明方向,提醒佩戴者注意安全,同时,采用压力传感器对佩戴者进行触觉刺激,达到同样的效果。
  6. 根据权利要求2-5任一项所述的针对全盲人群的室内定位系统,其特征在于,所述数据处理中心通过图像处理模块中的算法检测出图像中是否含有在某些地方安置 好的定位标签,并且提取出其中的信息,根据这些信息,数据处理中心通过语音提醒、压力传感提醒、震动传感提醒或温度传感提醒方式中至少一种告知可穿戴引导设备穿戴者。
  7. 根据权利要求2-5任一项所述的针对全盲人群的室内定位系统,其特征在于,所述的交互模块,其中可穿戴引导设备与穿戴者的交互方式包括语音、动作识别、震动感应方式中一种或多种。
  8. 根据权利要求2-5任一项所述的针对全盲人群的室内定位系统,其特征在于,所述定位标签根据需要安置在特定场景中的各个位置,可穿戴引导设备通过图像采集设备捕获图像,经过所述数据处理中心处理检测到定位标签,并且提取出定位标签中含有的特定信息。
  9. 一种权利要求1-8任一项所述的针对全盲人群的室内定位系统的定位标签的识别方法,其特征在于,所述定位标签的识别包括以下几个步骤:
    初始录入环节:在初始录入环节中,可穿戴引导设备的穿戴者在设备的引导下到达适合检测定位标签的位置,然后进行检测;
    提示环节:录入时,设备有提示发出,提示开始检测;
    检测环节:录入成功后,可穿戴引导设备对图像进行图像识别与信息提取,在成功提取出定位标签中的信息后,可穿戴引导设备发出提示,接着开始引导的过程。
  10. 根据权利要求9所述的定位标签的识别方法,其特征在于,所述定位标签的形式以图像的形式存在时,可穿戴引导设备用图像采集设备进行定位标签识别;或者,所述定位标签以电路或者进场通信装置的形式存在,可穿戴引导设备利用传感器进行定位标签检测;或者,在特殊环境中,所述定位标签通过技术手段进行隐藏,使人们看不到它的存在,但能通过可穿戴引导设备检测到。
PCT/CN2014/093533 2014-12-04 2014-12-11 针对全盲人群的室内定位系统 Ceased WO2016086441A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410738271.7 2014-12-04
CN201410738271.7A CN104535059A (zh) 2014-12-04 2014-12-04 针对全盲人群的室内定位系统

Publications (1)

Publication Number Publication Date
WO2016086441A1 true WO2016086441A1 (zh) 2016-06-09

Family

ID=52850634

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/093533 Ceased WO2016086441A1 (zh) 2014-12-04 2014-12-11 针对全盲人群的室内定位系统

Country Status (2)

Country Link
CN (1) CN104535059A (zh)
WO (1) WO2016086441A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113377097A (zh) * 2021-01-25 2021-09-10 杭州易享优智能科技有限公司 一种用于视障人士导盲的路径规划与避障方法
CN113433837A (zh) * 2021-06-15 2021-09-24 浙江水利水电学院 一种基于vr的室内设计方法及系统
CN114029966A (zh) * 2021-09-28 2022-02-11 北京仙宇科技有限公司 一种区域内盲人无障碍沟通行动系统
CN114869708A (zh) * 2022-05-20 2022-08-09 哈尔滨理工大学 一种便捷式智能助盲马甲

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105250119B (zh) * 2015-11-16 2017-11-10 深圳前海达闼云端智能科技有限公司 一种导盲方法、装置及设备
CN105748265B (zh) * 2016-05-23 2021-01-22 京东方科技集团股份有限公司 一种导航装置及方法
CN108733213B (zh) * 2018-05-15 2019-04-16 清华大学 一种基于热觉的柔性盲人图像交互系统及其识别方法
CN108875714A (zh) * 2018-08-16 2018-11-23 东北大学秦皇岛分校 帮助盲人寻找物品的系统及方法
TWI699198B (zh) * 2019-08-21 2020-07-21 亞東技術學院 視障者智能輔助系統
CN114049553A (zh) * 2021-11-02 2022-02-15 北京科技大学顺德研究生院 一种离线盲人视觉辅助方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101474020A (zh) * 2009-01-08 2009-07-08 上海交通大学 基于条形码标识的盲人超市导购方法和装置
CN102798388A (zh) * 2012-06-20 2012-11-28 上海交通大学 基于dsp的盲人超市购物辅助装置
US20120327203A1 (en) * 2011-06-21 2012-12-27 Samsung Electronics Co., Ltd. Apparatus and method for providing guiding service in portable terminal
CN103191006A (zh) * 2013-03-26 2013-07-10 北京美尔斯通科技发展股份有限公司 一种室内无线全方位定位导盲系统
CN103841174A (zh) * 2012-11-26 2014-06-04 董兰兰 基于摄影与声音提示的盲人导路系统
CN104127301A (zh) * 2014-07-15 2014-11-05 深圳先进技术研究院 导盲智能眼镜及其导盲方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003203297A (ja) * 2002-01-08 2003-07-18 Space Tag Inc 障害物情報伝達システム
DE20205183U1 (de) * 2002-04-03 2002-07-25 RTB GmbH & Co. KG, 33175 Bad Lippspringe Orientierungs- und Hinderniswarn-Einrichtung für Blinde und Sehbehinderte
TWI287102B (en) * 2005-12-05 2007-09-21 Mitac Int Corp Method and apparatus for walk guidance
TW200840556A (en) * 2007-04-04 2008-10-16 Mitac Int Corp Blind-guiding device to report the omnibearing condition of road
CN102973395B (zh) * 2012-11-30 2015-04-08 中国舰船研究设计中心 一种多功能智能导盲方法、处理器及其装置
CN103925918A (zh) * 2013-01-16 2014-07-16 杨奎军 一种定位方法、装置及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101474020A (zh) * 2009-01-08 2009-07-08 上海交通大学 基于条形码标识的盲人超市导购方法和装置
US20120327203A1 (en) * 2011-06-21 2012-12-27 Samsung Electronics Co., Ltd. Apparatus and method for providing guiding service in portable terminal
CN102798388A (zh) * 2012-06-20 2012-11-28 上海交通大学 基于dsp的盲人超市购物辅助装置
CN103841174A (zh) * 2012-11-26 2014-06-04 董兰兰 基于摄影与声音提示的盲人导路系统
CN103191006A (zh) * 2013-03-26 2013-07-10 北京美尔斯通科技发展股份有限公司 一种室内无线全方位定位导盲系统
CN104127301A (zh) * 2014-07-15 2014-11-05 深圳先进技术研究院 导盲智能眼镜及其导盲方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113377097A (zh) * 2021-01-25 2021-09-10 杭州易享优智能科技有限公司 一种用于视障人士导盲的路径规划与避障方法
CN113433837A (zh) * 2021-06-15 2021-09-24 浙江水利水电学院 一种基于vr的室内设计方法及系统
CN113433837B (zh) * 2021-06-15 2023-03-21 浙江水利水电学院 一种基于vr的室内设计方法及系统
CN114029966A (zh) * 2021-09-28 2022-02-11 北京仙宇科技有限公司 一种区域内盲人无障碍沟通行动系统
CN114869708A (zh) * 2022-05-20 2022-08-09 哈尔滨理工大学 一种便捷式智能助盲马甲

Also Published As

Publication number Publication date
CN104535059A (zh) 2015-04-22

Similar Documents

Publication Publication Date Title
WO2016086441A1 (zh) 针对全盲人群的室内定位系统
WO2016086440A1 (zh) 针对全盲人群的可穿戴式引导设备
CN103646587B (zh) 一种智能眼镜及其控制方法
US10341545B2 (en) Wearable apparatus with wide viewing angle image sensor
US8902303B2 (en) Apparatus connectable to glasses
US8744113B1 (en) Communication eyewear assembly with zone of safety capability
WO2016054860A1 (zh) 针对视觉障碍患者的头戴式视觉辅助系统
KR102047988B1 (ko) 시력 취약계층을 위한 시력 보조장치와 원격관리장치 및 시력 보조방법
CN107087431A8 (zh) 用于辨别眼睛信号和连续生物识别的系统和方法
KR102242681B1 (ko) 스마트 웨어러블 디바이스, 이를 사용한 3차원 얼굴과 공간 정보 인식 방법 및 시스템
US10867527B2 (en) Process and wearable device equipped with stereoscopic vision for helping the user
KR20090105531A (ko) 카메라센서로 찍은 문서 이미지를 시각장애인에게 음성으로알려주는 방법 및 장치
CN108014002A (zh) 自适应视觉辅助装置
WO2020020022A1 (zh) 视觉识别方法及其系统
KR20090036183A (ko) 카메라센서로 찍은 문서 이미지를 시각장애인에게 음성으로알려주는 방법 및 장치
EP3701408A1 (en) Wearable camera systems and methods for authenticating identity
CN106526863A (zh) 一种眼镜
CN109015706A (zh) 电缆隧道巡检机器人头盔式虚拟控制终端
WO2016086438A1 (zh) 针对视觉障碍患者的头戴式多媒体终端辅助观看系统
KR101982848B1 (ko) 분리형 웨어러블 디바이스 및 제어장치로 구성된 시력 취약계층용 시력 보조장치
KR101230341B1 (ko) 시각 지원 보조 시스템 및 방법
KR102525485B1 (ko) 시각장애인을 위한 본인인증 웨어러블 디바이스
CN105450979A (zh) 一种用于帮助人后视的显示系统及方法
KR20150146078A (ko) 언어학습 및 저시력 보조를 위한 문자인식 기능을 갖는 스마트 안경 및 그 스마트 안경을 이용한 문자 인식방법
BR102020004742A2 (pt) Sistema e método para assistência de portadores de deficiência visual

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14907459

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14907459

Country of ref document: EP

Kind code of ref document: A1