WO2016086437A1 - 针对色盲患者的头戴式辅助驾驶系统 - Google Patents

针对色盲患者的头戴式辅助驾驶系统 Download PDF

Info

Publication number
WO2016086437A1
WO2016086437A1 PCT/CN2014/093528 CN2014093528W WO2016086437A1 WO 2016086437 A1 WO2016086437 A1 WO 2016086437A1 CN 2014093528 W CN2014093528 W CN 2014093528W WO 2016086437 A1 WO2016086437 A1 WO 2016086437A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
image
display
head
display panel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/093528
Other languages
English (en)
French (fr)
Inventor
杨小康
翟广涛
闵雄阔
李铎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiao Tong University
Original Assignee
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiao Tong University filed Critical Shanghai Jiao Tong University
Publication of WO2016086437A1 publication Critical patent/WO2016086437A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals

Definitions

  • the present invention relates to the field of visual aid technology, and in particular to a head mounted assist driving system for color blind patients.
  • Color blindness also known as "color vision recognition disorder” refers to a defect that cannot correctly perceive the difference between some or all of the colors.
  • the cause of color blindness is usually related to heredity, but the occurrence of partial color blindness is related to damage to the eyes, optic nerve or brain, and may also be caused by exposure to specific chemicals. After discovering that he was a color-blind person, British chemist John Dalton published the first scientific monograph on the unusual facts about color vision in 1798.
  • the red-green blind population accounts for about 8% of the global male population and the female population is about 0.5%. About 6% of the population is trichromatic (color weak), about 2% of the population is dichromatic (color blind), and very few are monochromatic (full color blind). Due to the lack of color-blind color discrimination, it brings a lot of inconvenience to patients' work and life. They also have many restrictions on their careers and career choices. They also affect their ability to correctly experience the colorful reality of the world and block their access. The channel of information. Color-blind patients are not suitable for work characterized by color, such as aircraft, ships, car driving and art, chemistry, medicine, etc.
  • the reason why the eyes can recognize the color is because there are three kinds of vertebral cells that can distinguish colors in the eyes, which are L-cone cells most sensitive to long wavelength (535-575 nm), and most sensitive to medium wavelength (500-550 nm). Cone cells, the most sensitive S cone cells for short wavelengths (400-450 nm). The different wavelengths of light stimulate the retina to cause different degrees of excitement for the three cones. By determining the ratio of signals from different types of cones, the brain can determine what color we are seeing. Therefore, human color perception is the combined effect of three cones of different degrees of excitement in the brain. When cones are damaged or underdeveloped, color blindness may occur.
  • color blind correction Because most color blindness is due to genetic reasons, the treatment of color blindness is very difficult. Therefore, most of them are studied from the perspective of color blind correction, that is, the effect of color blindness on patients is reduced in a certain way. There are many different methods for color blind correction, such as wearing color blind glasses, acupressure, magnetic therapy, electrotherapy, and color blind image processing.
  • color-blind correcting mirror is based on the principle of complementary color topology, which is specially coated on the lens soil to produce a cut-off wavelength. It can transmit to long wavelengths and reflect to short wavelengths. Color blind patients wear colored blind glasses, can be in one To a certain extent, the original unrecognizable pattern is changed to be correctly recognized, and the effect of correcting the color vision disorder is achieved. In fact, this method simply filters out the color and does not achieve a good correction.
  • color blind patients are often unable to drive because of their limited ability to distinguish colors, which greatly affects the normal life of color blind patients.
  • Chinese utility model patent application number: 201220576188.0 discloses a color blind driving assistance system, which comprises an image collecting device, a microprocessor and an audio output device arranged on a motor vehicle, wherein the microprocessors respectively
  • the image acquisition device is connected to the audio output device.
  • the color blind driving assistance system collects traffic information through the image collecting device, analyzes and processes the microprocessor, and gives a color blind driver traffic light prompt through the audio output device, so that the color blind driver can also safely and normally drive the vehicle.
  • the image acquisition device used in the technology is installed on a motor vehicle, and is not convenient to use. When the traffic condition is relatively complicated, occlusion, misjudgment, etc. are easily caused, and the system is unstable.
  • the system provided by the present invention is a wearable device, and the image is collected in a first-person perspective, which is consistent with the image seen by the human eye; in addition, the system can be used for any other than assisted driving.
  • the scene plays a role in assisting the color blindness in real life.
  • an object of the present invention is to provide a head-mounted assist driving system for color blind patients, which can collect real-life scenes in real time, and process the collected images to be more acceptable to color-blind patients.
  • the present invention provides a head-mounted assist driving system for a color blind patient, comprising:
  • Head-mounted eyeglass holder for mounting and connecting the various components of the system and for easy wearing by the user;
  • An image capture device disposed on the headset holder
  • a voice control module is disposed on the headset for implementing voice control
  • sensors such as infrared sensors, accelerometers, gyroscopes, etc., are used to detect external information and the state of the glasses and transmit the signals to the data processing center;
  • a data processing center for overall control of the system, including image acquisition, processing and display panel display of the image acquisition device, implementation of voice control, acceptance and processing of sensor data; image processing through image
  • the processing module realizes that the image processing module collects images from the image acquisition device in real time, and processes the image by using image processing and machine vision algorithms, and displays the processed image in real-time in a form more acceptable to color blind patients;
  • the color blind patient realizes the calibration of the traffic indicator, and/or the detection of the patient's fatigue state, traffic condition, driving state, prompts, and achieves the purpose of assisting vision in driving and daily life.
  • the display of the system is a binocular display or a monocular display;
  • the image acquisition device is a dual channel acquisition or a single channel acquisition; if it is a single eye or a single channel, the display panel and the image acquisition device only need one way.
  • the display panel and the image capturing device are two channels, that is, the display panel includes:
  • a left eye display panel embedded in the left eyeglass frame of the head mounted frame for displaying a left eye image
  • a right eye display panel embedded in the right eyeglass frame of the head mounted glasses for displaying the right eye image
  • the two-way image acquisition device is composed of two miniature cameras and is distributed on the left and right sides of the head-mounted glasses holder.
  • the display mode of the system is a projection type or a non-projection type; if a projection type display is adopted, the system further comprises a projection device, and the projection device is projected on the display panel to form a virtual image at a certain distance in front of the human eye;
  • the projection device is one way or two channels; if the non-projection display mode is adopted, the image is directly displayed on the screen of the display panel.
  • the display panel of the non-projection display mode may be a high-definition liquid crystal display or an LED dot matrix display, and the selection of the display is adjusted according to the actual situation of the patient's patient.
  • the image formed on the display panel is superimposed with the real scene to achieve a visual improvement effect.
  • the display of the system may be either binocular or monocular; the image acquisition device may be dual channel acquisition or single channel acquisition.
  • the two-way image acquisition device separately collects the real scenes seen by the left and right eyes at the perspective of the human eye, and performs real-time projection onto the left and right display panels after being processed by the data processing center.
  • the data processing module can realize a plurality of functions, and firstly, the color resolution enhancement processing can be performed for different color blind patients, and the display is more acceptable in a color blind patient, thereby achieving the purpose of enhancing vision.
  • the color resolution enhancement processing which may be color conversion or color calibration, performs different color conversion or calibration for different types of color blind patients, so that color blind patients can distinguish colors that cannot be distinguished.
  • the data processing module can implement detection and color calibration of traffic lights designed for color blind patients under driving conditions, and detection and prompting of at least one of patient fatigue state, traffic condition, and driving state.
  • the patient fatigue state detection is mainly achieved by collecting data collection of various types of sensors such as an accelerometer and a gyroscope, and then converting various physical data into physiological data.
  • sensors such as an accelerometer and a gyroscope
  • the driving state detection is also realized by collecting data acquisition and processing of a sensor such as an accelerometer or a gyroscope.
  • a sensor such as an accelerometer or a gyroscope.
  • the system realizes the detection of the patient's fatigue state, and after the pedestrian, the vehicle, and the driving condition are detected, the color control patient may perform a dangerous condition prompting through the voice control module.
  • the present invention has the following beneficial effects:
  • the invention is a wearable device, which has the advantages of simple and portable, easy to expand, and the like, can not only enable color blind patients to use in daily life, but also provide auxiliary functions for driving state of color blind patients; meanwhile, an intelligent controller is used, except for visual aids.
  • an intelligent controller is used, except for visual aids.
  • other functions of the smart device can also be possessed; in addition, the hardware disclosed in the present invention can be used as a color-blind patient auxiliary device platform, and can be designed and matched for different types and degrees of color blindness.
  • the program achieves the purpose of assisting and enhancing vision and assisting driving.
  • FIG. 1 is a schematic structural view of a preferred embodiment of the present invention.
  • FIG. 2 is a block diagram showing the working principle of a preferred embodiment of the present invention.
  • FIG. 3 is an effect diagram of red-green blinding as an example of the present invention; wherein: (a) is a picture of a real scene captured by a camera, and (b) is a picture after image processing (color conversion and calibration). picture of.
  • 1 is a head-mounted glasses holder
  • 2 is a left-eye glasses lens
  • 3 is a left-eye display panel
  • 4 is a left-eye projection device
  • 5 is a right-eye glasses lens
  • 6 is a right-eye display panel
  • 7 is a right-eye display panel
  • Projection device, 8 is a two-way image acquisition device
  • 9 is a data processing center
  • 10 is a real scene picture collected by the two-way image acquisition device
  • 11 is a picture after being processed and projected
  • 12 is a sensor
  • 13 is a voice control module .
  • FIG. 1 is a schematic structural diagram of a head-mounted visual aid system for a visually impaired patient according to a preferred embodiment of the present invention, in which: a head-mounted glasses holder 1, a left-eye glasses lens 2, and a left-eye display panel 3 a left-eye projection device 4, a right-eye lens 5, a right-eye display panel 6, a right-eye projection device 7, a two-way image capture device 8, a data processing center 9, a sensor 12, and a voice control module 13, wherein:
  • the headgear support 1 is used for installing, connecting and fixing various components of the system, and is convenient for the user to wear;
  • the left eye lens 2 and the right eye lens 5 are used to respectively fix the left eye display panel 3 and the right eye display panel 6, and the left eye lens 2 and the right eye lens 5 are transparent. In addition to the screen displayed by the projection, the user can also see the real scene through the lens;
  • the left-eye display panel 3 and the right-eye display panel 6 are embedded in a transparent spectacle lens at a certain angle and distance if the projection display mode is adopted, and the display panel is also transmissive.
  • the virtual image displayed by the projection and the display scene seen through the lens are superimposed; if the non-projection display mode is adopted, the displayed image is a real image;
  • the left-eye projection device 4 and the right-eye projection device 7 cooperate with the left-eye display panel 3 and the right-eye display panel 6, respectively, and project images to the left-eye display panel 3 and the right-eye display panel 6, respectively.
  • a virtual image is formed in front of the human eye;
  • the two-way image capturing device 8 is two cameras, and two cameras are respectively mounted on the left and right sides of the head-mounted glasses holder 1, and the real scenes seen by the left and right eyes can be separately collected in the perspective of the human eye in real time. Transfer to the data processing center 9, processed by the data processing center 9, and then projected to the left eye display panel 3 and the right eye in real time. On the display panel 6, a virtual scene is formed; in addition, since the two-way image acquisition device 8 performs two-way image acquisition from the perspective of the human eye, and the collected left and right eye images are processed and respectively projected to the left eye display. The panel 3 and the right eye display panel 6 are displayed, so the virtual scene seen by the human eye is a 3D scene;
  • the data processing center 9 is used for overall control of the system, image acquisition, processing and projection display; the data processing center 9 is used for overall control of the system and driving of each module.
  • the data processing center 9 may be an existing processing data processing device on the market, such as a smart phone, a portable computer, or the like, or may be a self-developed data processing terminal, where the image processing algorithm is required according to the requirements. Different functions have different settings.
  • the data processing center 9 can have other functions of the smart device in addition to the image correction and calibration tasks for color blind patients.
  • the data processing center 9 may be connected to the glasses through a data line, or may be directly connected to the glasses in a wireless manner.
  • the senor 12 is configured to detect external information and the state of the glasses and transmit the signal to the data processing center; the sensor 12 includes various sensors such as an infrared sensor, an accelerometer, and a gyroscope, and each of them collects The data is passed to the data processing center 9, and the image processing module uses the data for analysis by image processing and machine vision algorithms.
  • the infrared sensor is used for collecting infrared signals for possible nighttime field of view detection or for obstacle distance detection; the accelerometer and the gyroscope respectively collect acceleration and angle of the glasses in various directions. By analyzing the data collected by these sensors, the data processing center can process the images to be displayed accordingly.
  • the voice control module 13 is used for voice collection and playback, thereby implementing voice control.
  • the main function of the system described in this embodiment is to provide a visual aid and driving assistance system for color blind patients.
  • the system can not only have different visual correction effects for different color blindness, but also enable patients to rely on the aid of the instrument to improve vision in life.
  • the system is optimized for driving color-blind patients under driving conditions, and realizes traffic indicator detection, calibration, and detection and prompting of patient fatigue state, traffic condition, driving state, and the purpose of assisting color-blind patients to drive.
  • the system of the present embodiment further includes an image processing module designed for a visually impaired patient.
  • the module collects images in real time from the two-way image acquisition device 8 and transmits them to the data processing center 9 to process the collected images by using the image processing module.
  • the corresponding image processing and machine vision algorithms are not available to the patient.
  • the color of the distinction is detected and calibrated, and the more acceptable image of the visually impaired patient is projected and displayed, and one of the traffic light detection, color calibration, patient fatigue state, traffic condition, driving state detection, and prompt is realized.
  • Traffic indicator detection, color calibration, traffic condition detection and prompting are implemented by related machine vision algorithms, and the detection results can be prompted by the voice control module;
  • the patient's fatigue state is detected by data acquisition of various types of sensors such as accelerometers and gyroscopes of the system, and then various types of physical data processing are converted into physiological data.
  • sensors such as accelerometers and gyroscopes of the system
  • Driving state detection is also realized by collecting data acquisition and processing of various types of sensors such as accelerometers and gyroscopes.
  • FIG. 2 it is a block diagram of a working principle of a system according to an embodiment of the present invention.
  • the workflow includes the following steps:
  • This part mainly collects various types of signals in real-life scenarios, mainly in the following three aspects:
  • the external information and the state of the glasses are detected by various types of sensors 12 and transmitted to the data processing center; various sensors including infrared sensors, accelerometers, gyroscopes, etc., each transmitting the collected data to the data processing center 9 ;
  • the voice control module 13 performs voice collection on the color blind patient, and transmits the voice signal to the data processing center 9 to implement voice control;
  • the two cameras of the two-way image acquisition device 8 are completed, and the left and right cameras respectively collect images of the real scene from the perspective of the human eye, and the real scene image 10 collected by the camera is transmitted to the data processing center in the form of a video stream. ;
  • This part deals with the data collected in the above three aspects, which is completed by the data processing center 9 of the system.
  • sensing signals different types of sensing signals detected from sensor 12 are processed differently for different purposes.
  • infrared sensors it can be used for possible night vision detection or obstacle distance detection.
  • the driver is prompted when the distance is too close.
  • accelerometers and gyroscopes the acceleration of the glasses in each direction is collected.
  • the angle which leads to the current driving situation, can be used for information feedback when driving unsafely.
  • the fatigue state of color-blind patients can be detected by accelerometers and gyroscopes to avoid fatigue driving.
  • the data processing center can process the corresponding images and provide corresponding feedback;
  • the data processing center 9 processes and understands the language of the color blind patient collected from the voice control module 13, and performs corresponding processing on the voice command of the patient;
  • the data processing center 9 performs specific processing on the image collected from the two-way image capturing device 8, such as: color correction, traffic indicator detection, color calibration, traffic conditions (pedestrian and vehicle) detection, etc.; Image processing and machine vision related algorithms are needed; the system has high performance requirements for related image processing algorithms, and it is required to meet real-time requirements. Therefore, real-time problems must be considered when designing image processing algorithms.
  • the image processing algorithm may use the prior art, or an algorithm that is innovative in order to adapt to the visual aid system.
  • the images collected by the two-way image acquisition device 8 are processed in real time and then transmitted to the left-eye display panel 3 and the right-eye display panel 6 respectively;
  • This part mainly provides information feedback in both voice and image forms.
  • the feedback is mainly performed in the form of voice, and the voice feedback is implemented by the voice control module 13;
  • the display mode of the system of the present invention may be a projection type or a non-projection type. If a projection display is used, wherein the left and right eye projection devices are respectively projected on the left and right display panels 3, 6, a virtual image is formed at a certain distance in front of the human eye; if a non-projection display mode is adopted, the real image is formed, but A convex lens is added between the glasses and the left and right display panels 3, 6 to make the image clearer.
  • the display panel of the non-projection display can be a high-definition liquid crystal display or an LED dot matrix display, and the selection of the display can be adjusted according to the actual condition of the patient's patient. This does not affect the substance of the system. specific:
  • the right eye screen is respectively projected to the left and right eye display panels 3, 6, so that the screen seen by the user from the left and right eye display panels 3, 6 is an image processed by image processing and machine vision related algorithms;
  • the display is completed by the left and right display panels 3 and 6, and the left and right eye display panels 3 and 6 respectively display the color blind image corrected and the left and right eye images transmitted by the data processing center 9 to make the user
  • the screens seen from the left and right display panels 3, 6 are images processed by image processing and machine vision related algorithms.
  • FIG. 3 it is an effect diagram of red-green blindness, wherein: (a) is a realistic scene picture 10 collected by a two-way image acquisition device, and (b) is subjected to image processing (color conversion and calibration). ) The picture 11 displayed after the projection.
  • the present invention is a wearable device, which has the advantages of simple portability, easy expansion, and the like, and can be used for color blind patients in daily life, and can provide auxiliary functions for color blind patient driving states;
  • the intelligent controller is used, in addition to the visual aid and the driving assistance function, it can also have other functions of the smart device; in addition, the hardware disclosed by the present invention can be used as a color blind patient assisting device platform for different types and degrees of color blindness.
  • the matching image processing program can be designed in a targeted manner to achieve the purpose of assisting and enhancing vision and assisting driving.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种针对色盲患者的头戴式辅助驾驶系统，包括：用于安装连接系统各个部件以及方便用户佩戴的头戴式眼镜支架（1）；用于显示图像的显示面板（3,6）；以人眼视角采集图像的图像采集设备（8）；用于语音控制的语音模块（13）；用于检测外部环境及眼镜状态的各类传感器（12）；用于该系统的总体控制的数据处理中心（9）；数据处理中心（9）配套有针对色盲患者设计的图像色彩分辨力增强程序、针对色盲患者在驾驶状态下设计的交通指示灯标定，交通状况、患者疲劳状态及驾驶状态检测等程序。该系统能够实时地采集现实场景，将采集到的图像进行色彩转换或标定后显示，并能进行交通状况、患者疲劳状态及驾驶状态检测，在驾驶及日常生活中达到辅助视觉的目的。

Description

针对色盲患者的头戴式辅助驾驶系统 技术领域
本发明涉及视觉辅助技术领域，具体地，涉及一种针对色盲患者的头戴式辅助驾驶系统。
背景技术
色盲亦称“色觉辨认障碍”，是指无法正确感知部分或全部颜色间区别的缺陷。色盲发生的原因通常与遗传有关，但部分色盲的发生与眼、视神经或脑部的损伤有关，也可由于接触特定化学物质引起。英国化学家约翰·道尔顿在发现自己是色盲者后，于1798年出版了第一部论述此问题的科学专著《关于色彩视觉的离奇事实》。
红绿色盲人口占全球男性人口约8％，女性人口约0.5％。其中约6％人口为三色视觉(色弱)，约2％人口为二色视觉(色盲)，极少数为单色视觉(全色盲)。由于色盲辨色能力的缺失，给患者的工作、生活带来很多的不便，在升学、择业上也受到不少限制，同时也影响了他们正确感受五彩缤纷的现实一世界的能力，阻塞了他们获取信息的渠道。色盲患者不适合从事以颜色为示标的工作，如:飞机、轮船、汽车驾驶和美术、化学、医药等工作。
眼睛之所以能辨识颜色，是由于眼睛存在三种能辨色的椎状细胞，分别为对长波长(535—575nm)最敏感的L锥细胞，对中波长(500—550nm)最敏感的M锥细胞，对短波长(400—450nm)最敏感的S锥细胞。不同波长的光线刺激视网膜会引起三种视锥细胞不同程度的兴奋，通过确定来自不同类型锥细胞信号的比率，大脑就能确定我们看到的物体是什么颜色。因此，人的色觉是三种锥细胞各自不同程度兴奋在大脑中的综合效应。而当视锥细胞受到损伤或发育不全时，就有可能造成色盲。
因为大多数色盲是由于遗传原因，色盲的治疗口前是非常困难的，因此大多从色盲校正的角度进行研究，即通过一定的方式减小色盲给患者带来的影响。色盲的矫正有多种不同的方法，如配戴色盲眼镜、穴位按摩、磁疗、电疗、色盲图像处理等方法。
色盲矫正镜的原理，是根据补色拓扑学原理，在镜片土进行特殊镀膜，产生截止波长的作用，对长波长者可透射，对短波长者发生反射。色盲患者戴上色盲眼镜，可在一 定程度上使原来辨认不清的图案变为能正确辨认，达到矫正色觉障碍的效果。实际上，这种方式只是对色彩进行简单的滤除，并不能达到很好矫正的目的。
采用穴位按摩、磁疗、电疗等方法是选择能疏通经络、调节肾水、荣卫神目的穴位，以达到提高色觉功能的目的，但目前还没有充分的证据能表明其治疗的有效性。
此外，随着基因工程的发展，有人设想从神经生物学的角度，利用人类胚胎千细胞进行临床组织移植。这或许是一条治疗色觉异常的有效途径，但尚在概念阶段。
从图像处理的角度对色盲及色盲矫正进行研究，也有部分成果。在色盲模型方面，根据三种锥细胞的视觉原理，提出了视觉的三通道模型，很多学者相应地建立了对色盲患者视觉进行研究的模型件。这些模型都是从视觉的三通道入手建立的，具有一定的相通性。现阶段利用这些模型研究色盲、色弱治疗或矫正的方法有很多，但均处于理论研究阶段。
综上所述，现有的针对色盲患者的矫正方法如戴色盲眼镜、穴位按摩、磁疗、电疗等各有弊端，从图像处理的角度进行色盲矫正是一个可行的方向，但是现阶段尚处于理论研究阶段，没有易用、适用、简单便携、可扩展的色盲矫正系统。
此外，由于现阶段的道路交通系统中有大量的各种颜色的交通指示灯，由于色盲患者辨别色彩的能力有限，色盲患者通常无法进行驾驶，这极大地影响了色盲患者的正常生活。
中国实用新型专利申请号：201220576188.0，该实用新型公开了一种色盲驾驶辅助系统，包括设置在机动车上的图像采集装置、微处理器以及音频输出装置，其中，所述微处理器分别与所述图像采集装置和音频输出装置相连。所述色盲驾驶辅助系统通过图像采集装置收集交通信息，微处理器分析以及处理，并通过音频输出装置给予色盲驾驶员交通信号灯提示，使得色盲驾驶员也能够安全正常地驾驶交通工具。该技术所用图像采集装置设置在机动车上，使用不太方便，当交通状况比较复杂时，容易发生遮挡、误判等，使得该系统工作不稳定。与该技术相比，本发明所提供的系统为可穿戴设备，以第一人称的视角采集图像，与人眼所看到的图像一致；此外，除了辅助驾驶外，本系统还可以用于任意其它场景，在现实生活中对色盲起到辅助视觉的作用。
发明内容
针对现有技术中的缺陷，本发明的目的是提供一种针对色盲患者的头戴式辅助驾驶系统，该系统能够实时地采集现实场景，对采集到的图像进行处理，以色盲患者更能接受的方式显示；并针对色盲患者在驾驶状态下进行优化设计，实现交通指示灯标定， 患者疲劳状态、交通状况、驾驶状态的检测及提示等，在驾驶及日常生活中达到辅助视觉的目的。
为实现以上目的，本发明提供一种针对色盲患者的头戴式辅助驾驶系统，包括：
头戴式眼镜支架，用于安装及连接系统的各个部件以及方便用户佩戴；
显示面板，嵌入在头戴式眼镜支架的镜框上，用于显示图像；
图像采集设备，设置在头戴式眼镜支架上；
语音控制模块，设置在头戴式眼镜支架上，用于实现语音控制；
多种传感器，如包括红外传感器、加速度计、陀螺仪等，用于检测外部信息和眼镜所处状态并将信号传输给数据处理中心；
数据处理中心，所述数据处理中心用于系统的总体控制，包括图像采集设备的图像的采集、处理及显示面板的显示，语音控制的实现，传感器数据的接受和处理；其中的图像处理通过图像处理模块实现，该图像处理模块实时地从图像采集设备采集图像，并利用图像处理及机器视觉算法对图像进行处理，将处理后的图像以色盲患者更能接受的形式进行实时显示；此外，针对色盲患者在驾驶状态下，实现交通指示灯标定，和/或患者疲劳状态、交通状况、驾驶状态的检测、提示，在驾驶及日常生活中达到辅助视觉的目的。
优选地，所述系统的显示是双眼显示或单眼显示；所述图像采集设备是双通道采集或单通道采集；如果是单眼、单通道，所述显示面板、图像采集设备都只需要一路。
进一步的，如果是双眼、双通道，所述显示面板、图像采集设备则为左右两路，即：所述显示面板包括：
左眼显示面板，嵌入在头戴式眼镜支架的左眼镜框上，用于显示左眼图像；
右眼显示面板，嵌入在头戴式眼镜支架的右眼镜框上，用于显示右眼图像；
所述双路图像采集设备，由两个微型摄像头组成，分布在头戴式眼镜支架的左右两侧。
优选地，所述系统的显示方式为投影式或非投影式；如果采用投影式显示，所述系统还包括投影装置，投影装置投影在显示面板上，在人眼前方一定距离形成虚拟的图像；所述投影装置为一路或者左右两路；如果采用非投影式显示方式，图像直接显示在显示面板的屏幕上。
更优选地，所述非投影式显示方式的显示面板可以是高清液晶显示屏，也可以是LED点阵显示器，显示器的选择根据患者的病患实际情况来调整。
更优选地，如果采用投影式显示方式显示面板采用可穿透式，投影在显示面板上形成的图像与现实场景叠加达到视觉改善的效果。
优选地，所述系统的显示可以是双眼也可以是单眼；图像采集设备可以是双通道采集也可以是单通道采集。
优选地，所述的双路图像采集设备以人眼的视角分别采集左、右眼看到的现实场景，经过所述数据处理中心处理后实时地投影到所述左、右显示面板上。
所述的数据处理模块可以实现多种功能，首先可以实现针对不同色盲患者，进行色彩分辨力增强处理，以色盲患者更能接受的方式显示，从而达到增强视觉的目的。
优选地，所述的色彩分辨力增强处理，可以是色彩转换，也可以是色彩标定，针对不同类型的色盲患者进行不同的色彩转换或标定，从而能让色盲患者区分原本无法区分的颜色。
所述的数据处理模块可以实现针对色盲患者在驾驶状态下设计的交通指示灯检测及颜色标定，以及患者疲劳状态、交通状况、驾驶状态至少一种的检测及提示。
优选地，所述的患者疲劳状态检测主要通过采集加速度计、陀螺仪等种类传感器的数据采集，然后将各类物理数据转化为生理数据实现。
优选地，所述的驾驶状态检测也是通过采集加速度计、陀螺仪等种类传感器的数据采集及处理实现。
优选地，所述系统实现患者疲劳状态检测，行人、车辆、驾驶状况检测后，可以通过语音控制模块对色盲患者进行危险状况提示等。
与现有技术相比，本发明具有如下的有益效果：
本发明为可穿戴式设备，具有简单便携、易扩展等优点，既可以让色盲患者在日常生活中使用，又可以针对色盲患者驾驶状态提供辅助功能；同时，采用了智能控制器，除了视觉辅助及驾驶辅助功能外，还可以拥有智能设备的其他功能；此外，本发明所公开的硬件可以作为一个色盲患者辅助器具平台，对于不同类型及不同程度的色盲，可以针对性地设计配套的图像处理程序，达到辅助与增强视觉及辅助驾驶的目的。
附图说明
通过阅读参照以下附图对非限制性实施例所作的详细描述，本发明的其它特征、目的和优点将会变得更明显：
图1为本发明一较优实施例的结构示意图；
图2为本发明一较优实施例的工作原理框图；
图3为本发明一实施例以红绿色盲为例的效果图；其中：图(a)为摄像头采集到的现实场景图片，图(b)为经过图像处理(颜色转换及标定)后投影显示的图片。
图中：1为头戴式眼镜支架，2为左眼眼镜镜片，3为左眼显示面板，4为左眼投影装置；5为右眼眼镜镜片，6为右眼显示面板，7为右眼投影装置，8为双路图像采集设备，9为数据处理中心，10为双路图像采集设备采集到的现实场景图片，11为经过处理后投影显示的图片，12为传感器，13为语音控制模块。
具体实施方式
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明，但不以任何形式限制本发明。应当指出的是，对本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变形和改进。这些都属于本发明的保护范围。
如图1所示，为本发明一较优实施例的针对视觉障碍患者的头戴式视觉辅助系统结构示意图，图中：头戴式眼镜支架1、左眼眼镜镜片2、左眼显示面板3、左眼投影装置4、右眼眼镜镜片5、右眼显示面板6、右眼投影装置7、双路图像采集设备8、数据处理中心9、传感器12、语音控制模块13，其中：
所述的头戴式眼镜支架1用于安装、连接和固定系统的各个部件，以及方便用户佩戴；
所述的左眼眼镜镜片2和所述的右眼眼镜镜片5用于分别固定左眼显示面板3和右眼显示面板6，左眼眼镜镜片2和右眼眼镜镜片5为可穿透式的，用户除了可以看到投影显示的画面之外还可以透过镜片看到现实场景；
所述的左眼显示面板3和所述的右眼显示面板6，如果采用投射显示方式，投影设备以一定的角度和距离嵌入在透明的眼镜镜片中，该显示面板也是可穿透式的，投影显示的虚拟图像和透过镜片看到的显示场景是叠加的；如果采用非投影显示方式，显示的图像为实像；
所述的左眼投影装置4和所述的右眼投影装置7分别与左眼显示面板3和右眼显示面板6相配合，分别向左眼显示面板3和右眼显示面板6投影图像，在人眼前方形成一幅虚拟图像；
所述的双路图像采集设备8是两个摄像头，两个摄像头分别安装于头戴式眼镜支架1的左右两侧，可以实时地以人眼的视角分别采集左、右眼看到的现实场景并传输给数据处理中心9，经过数据处理中心9处理后再实时地分别投影到左眼显示面板3和右眼 显示面板6上，形成虚拟的场景；此外，由于双路图像采集设备8是以人眼的视角进行双路的图像采集，而且采集到的左、右眼画面经过处理后分别投影到左眼显示面板3和右眼显示面板6进行显示，所以人眼看到的虚拟场景是3D场景；
所述的数据处理中心9用于系统的总体控制，图像的采集、处理及投影显示；数据处理中心9用于系统的总体控制及各个模块的驱动。
本实施例中，所述的数据处理中心9可以是市面上现有的处理数据处理设备，比如智能手机、便携电脑等，也可以是自行开发的数据处理终端，其中的图像处理算法根据所需功能不同而有不同的设定。比如数据处理中心9除了针对色盲患者的图像矫正和标定任务外，还可以有智能设备所具备的其他功能。
本实施例中，所述的数据处理中心9可以通过数据线与眼镜连接，也可以直接以无线方式与眼镜连接。
本实施例中，所述的传感器12用于检测外部信息和眼镜所处状态并将信号传输给数据处理中心；传感器12包括红外传感器、加速度计、陀螺仪等各种传感器，它们各自将采集到的数据传给数据处理中心9，图像处理模块通过图像处理及机器视觉算法利用这些数据进行分析。其中，红外传感器用于采集红外信号，以用于可能的夜间视野探测、或者用于障碍物距离检测；加速度计和陀螺仪分别采集眼镜的各个方向加速度以及角度。通过分析这些传感器采集的数据，数据处理中心可以对将要显示的图像做出相应的处理。
本实施例中，所述的语音控制模块13用于语音采集及播放，从而实现语音控制。
本实施例所述系统的主要功能是为色盲患者提供一个视觉辅助及驾驶辅助的系统，该系统不仅可以对不同的色盲有不同的视觉矫正效果，让患者在生活中依靠该仪器的辅助提高视觉，而且该系统针对色盲患者在驾驶状态下进行了优化设计，实现交通指示灯检测、标定，以及患者疲劳状态、交通状况、驾驶状态的检测及提示，以达到辅助色盲患者驾驶的目的。
本实施例所述系统除了以上所述的实体部件外，还包含配套的针对视觉障碍患者设计的图像处理模块。本模块从双路图像采集设备8实时地采集图像，传输到数据处理中心9后利用图像处理模块对采集的图像进行处理，针对不同的色盲患者，利用相应的图像处理及机器视觉算法对患者无法区分的颜色进行检测、标定，再将更加直观的视觉障碍患者更能接受的图像进行投影显示，实现交通指示灯检测、颜色标定、患者疲劳状态、交通状况、驾驶状态的检测、提示中的一种或者多种功能，从而达到辅助驾驶的目的。 具体的：
针对不同类型的色盲患者，进行不同的颜色检测，将患者无法区分的颜色通过颜色转换改变为患者能区分的颜色或者进行颜色标定，增加患者的颜色分辨能力；
交通指示灯检测、颜色标定、交通状况检测及提示通过相关的机器视觉算法实现，检测结果可以通过语音控制模块对患者进行提示；
患者疲劳状态检测通过系统的加速度计、陀螺仪等种类传感器的数据采集，然后将各类物理数据处理转化为生理数据实现。
驾驶状态检测也通过采集加速度计、陀螺仪等种类传感器的数据采集及处理实现。
如图2所示，为本发明一实施例系统的工作原理框图，工作流程包括如下步骤：
一、信号采集
该部分主要采集现实场景中的各种类型信号，主要有以下三方面：
由各种类型传感器12检测外部信息和眼镜所处状态并将信号传输给数据处理中心；包括红外传感器、加速度计、陀螺仪等各种传感器，它们各自将采集到的数据传给数据处理中心9；
由语音控制模块13对色盲患者进行语音采集，并将语音信号传给数据处理中心9，以便实现语音控制；
由双路图像采集设备8的两个摄像头完成，左、右两路摄像头分别以人眼的视角采集现实场景的图像，摄像头采集到的现实场景图片10以视频流的形式传输至数据处理中心9；
二、信号处理
该部分对以上三方面采集到的数据进行处理，该部分由系统的数据处理中心9完成。
对于传感信号，从传感器12检测到的不同类型传感信号进行不同的处理实现不同的用途。对于红外传感器，可用于可能的夜间视野探测、或者障碍物距离检测，在驾驶过程中，当车距过于接近时对驾驶者进行提示；对于加速度计和陀螺仪，分别采集眼镜的各个方向加速度以及角度，从而得出当前的驾驶状况，当进行不安全驾驶时可以进行信息反馈，另外，还可以通过加速度计和陀螺仪对色盲患者的疲劳状态进行检测，以免疲劳驾驶。通过分析这些传感器采集的数据，数据处理中心可以对将要显示的图像做出相应的处理并进行相应的反馈；
对于语音信号，数据处理中心9对从语音控制模块13采集到的色盲患者的语言进行加工理解，并对患者的语音命令进行相应的处理；
对于图像信号，数据处理中心9对从双路图像采集设备8采集到的图像进行特定的处理，如：颜色校正，交通指示灯检测、颜色标定，交通状况(行人及车辆)检测等；该步骤中需要利用图像处理及机器视觉相关算法；本系统对相关的图像处理算法性能要求较高，要求能够达到实时性的要求，所以在进行图像处理算法设计时要考虑到实时性的问题，不能采用复杂度过高、无法满足实时要求的算法；如果有一些较为复杂的算法也要针对本系统做出相应的简化或者创新，以使算法更好地配合本系统。图像处理的算法可以采用现有技术，也可以采用为了适应本视觉辅助系统而创新的算法。对双路图像采集设备8采集到的图像实时地进行处理，再分别传输至左眼显示面板3和右眼显示面板6；
三、信息反馈
该部分主要以语音和图像两种形式进行信息反馈。
对于色盲患者的疲劳状态，交通状况及驾驶状态等信息，主要以语音的形式进行反馈，语音反馈通过语音控制模块13实现；
对于颜色矫正、标定，交通指示灯检测、颜色标定等，主要通过投影显示(对于透射式显示方法)或利用显示屏显示(对于非投射式显示方式)实现。
本发明系统的显示方式可以是投影式，也可以是非投影式。如果采用投影式显示，其中左右眼投影装置分别投影在左右显示面板3、6上，在人眼前方一定距离形成虚拟的图像；如果采用非投影式显示方式，其形成的是实像，但是需要在眼镜与左右显示面板3、6中间加入凸透镜使成像更清晰。非投射式显示的显示面板可以是高清液晶显示屏，也可以是LED点阵显示器，显示器的选择可以根据患者的病患实际情况来调整。这并不影响本系统的实质。具体的：
1)投影显示(对于透射式显示方法)
该部分由左、右眼投影装置4、7和左、右眼显示面板3、6完成，左、右眼投影装置4、7将数据处理中心9传输过来的经过色盲图像校正、标定后的左、右眼画面分别投影至左、右眼显示面板3、6，使用户从左、右眼显示面板3、6上看到的画面是利用图像处理及机器视觉相关算法处理后的图像；
2)利用显示屏显示(对于非投射式显示方式)
该部分由左、右显示面板3、6显示画面完成，左、右眼显示面板3、6将数据处理中心9传输过来的经过色盲图像校正、标定后的左、右眼画面分别显示，使用户从左、右显示面板3、6上看到的画面是利用图像处理及机器视觉相关算法处理后的图像。
如图3所示，为以红绿色盲为例的效果图，其中：图(a)为双路图像采集设备采集到的现实场景图片10，图(b)为经过图像处理(颜色转换及标定)后投影显示的图片11。
与传统的视觉障碍辅助器具相比，本发明为可穿戴式设备，具有简单便携、易扩展等优点，既可以让色盲患者在日常生活中使用，又可以针对色盲患者驾驶状态提供辅助功能；同时，采用了智能控制器，除了视觉辅助及驾驶辅助功能外，还可以拥有智能设备的其他功能；此外，本发明所公开的硬件可以作为一个色盲患者辅助器具平台，对于不同类型及不同程度的色盲，可以针对性地设计配套的图像处理程序，达到辅助与增强视觉及辅助驾驶的目的。
以上对本发明的具体实施例进行了描述。需要理解的是，本发明并不局限于上述特定实施方式，本领域技术人员可以在权利要求的范围内做出各种变形或修改，这并不影响本发明的实质内容。

Claims (13)

  1. 一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，包括：
    头戴式眼镜支架，用于安装及连接系统的各个部件以及方便用户佩戴；
    显示面板，嵌入在头戴式眼镜支架的镜框上，用于显示图像；
    图像采集设备，设置在头戴式眼镜支架上；
    语音控制模块，设置在头戴式眼镜支架上，用于实现语音控制；
    多种传感器，用于检测外部信息和眼镜所处状态并将信号传输给数据处理中心；
    数据处理中心，所述数据处理中心用于系统的总体控制，包括图像采集设备的图像的采集、处理及显示面板的显示，语音控制的实现，传感器数据的接受和处理；其中的图像处理通过图像处理模块实现，该图像处理模块实时地从图像采集设备采集图像，并利用图像处理及机器视觉算法对图像进行处理，将处理后的图像以色盲患者更能接受的形式进行实时显示；针对色盲患者在驾驶状态下，实现交通指示灯标定和/或患者疲劳状态、交通状况、驾驶状态的检测、提示，在驾驶及日常生活中达到辅助视觉的目的。
  2. 根据权利要求1所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述系统的显示是双眼显示或单眼显示；所述图像采集设备是双通道采集或单通道采集；如果是单眼、单通道，所述显示面板、图像采集设备都只需要一路。
  3. 根据权利要求2所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，如果是双眼、双通道，所述显示面板、图像采集设备则为左右两路，即：所述显示面板包括：
    左眼显示面板，嵌入在头戴式眼镜支架的左眼镜框上，用于显示左眼图像；
    右眼显示面板，嵌入在头戴式眼镜支架的右眼镜框上，用于显示右眼图像；
    所述双路图像采集设备，由两个微型摄像头组成，分布在头戴式眼镜支架的左右两侧。
  4. 根据权利要求1所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述系统的显示方式为投影式或非投影式；
    如果采用投影式显示，所述系统还包括投影装置，投影装置投影在显示面板上，在人眼前方一定距离形成虚拟的图像；所述投影装置为一路或者左右两路；
    如果采用非投影式显示方式，图像直接显示在显示面板的屏幕上。
  5. 根据权利要求4所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于， 如果采用非投影式显示方式，进一步在眼睛与显示面板中间加入凸透镜以使成像更加清晰。
  6. 根据权利要求5所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述非投影式显示方式的显示面板是高清液晶显示屏，或是LED点阵显示器。
  7. 根据权利要求4所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述的显示面板采用可穿透式，投影在显示面板上形成的图像与现实场景叠加达到视觉改善的效果。
  8. 根据权利要求3所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述的双路图像采集设备以人眼的视角分别采集左、右眼看到的现实场景，经过所述数据处理中心处理后实时地投影到所述左、右显示面板上。
  9. 根据权利要求1所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述语音控制模块实现语音采集及播放。
  10. 根据权利要求1-9任一项所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述的图像处理模块针对不同色盲患者，进行色彩分辨力增强处理，以色盲患者更能接受的方式显示，从而达到增强视觉的目的。
  11. 根据权利要求10所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述的色彩分辨力增强处理，是色彩转换，或是色彩标定，针对不同类型的色盲患者进行不同的色彩转换或标定，从而能让色盲患者区分原本无法区分的颜色。
  12. 根据权利要求1-9任一项所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述的图像处理模块实现针对色盲患者在驾驶状态下设计的交通指示灯检测及颜色标定，以及患者疲劳状态、交通状况、驾驶状态至少一种的检测及提示。
  13. 根据权利要求12所述的一种针对色盲患者的头戴式辅助驾驶系统，其特征在于，所述的患者疲劳状态检测通过采集多种类传感器的数据采集，然后将各类物理数据转化为生理数据实现；所述的驾驶状态检测通过采集各种类传感器的数据采集，进行处理实现。
PCT/CN2014/093528 2014-12-04 2014-12-11 针对色盲患者的头戴式辅助驾驶系统 Ceased WO2016086437A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410736822.6 2014-12-04
CN201410736822.6A CN104485008A (zh) 2014-12-04 2014-12-04 针对色盲患者的头戴式辅助驾驶系统

Publications (1)

Publication Number Publication Date
WO2016086437A1 true WO2016086437A1 (zh) 2016-06-09

Family

ID=52759548

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/093528 Ceased WO2016086437A1 (zh) 2014-12-04 2014-12-11 针对色盲患者的头戴式辅助驾驶系统

Country Status (2)

Country Link
CN (1) CN104485008A (zh)
WO (1) WO2016086437A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10536678B2 (en) 2017-11-27 2020-01-14 International Business Machines Corporation Optimized computer display rendering for user vision conditions
CN111352238A (zh) * 2018-12-20 2020-06-30 淮北幻境智能科技有限公司 一种色盲矫正方法及装置

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106550280A (zh) * 2015-09-17 2017-03-29 中兴通讯股份有限公司 图像显示方法及装置
CN105959526B (zh) * 2016-06-22 2022-01-11 贵州万臻时代通讯技术有限公司 一种用于颜色识别的眼镜及系统
CN106843491A (zh) * 2017-02-04 2017-06-13 上海肇观电子科技有限公司 带增强现实的智能设备及电子设备
CN108322719A (zh) 2018-02-12 2018-07-24 京东方科技集团股份有限公司 抬头显示系统及抬头显示方法、行驶装置
CN109087485B (zh) * 2018-08-30 2021-06-08 Oppo广东移动通信有限公司 驾驶提醒方法、装置、智能眼镜及存储介质
CN109460698A (zh) * 2018-08-31 2019-03-12 北京目瞳科技有限公司 一种智能头戴设备及基于其的安全检测方法
CN109671267A (zh) * 2018-11-26 2019-04-23 王星雨 一种智能色盲驾驶辅助穿戴设备的电路系统
CN109584584A (zh) * 2018-11-26 2019-04-05 王星雨 一种智能色盲驾驶辅助穿戴设备
CN109670445B (zh) * 2018-12-19 2023-04-07 宜视智能科技（苏州）有限公司 低视力助视智能眼镜系统
CN110584590A (zh) * 2019-08-16 2019-12-20 中国农业大学 一种基于增强现实技术的色觉辨识障碍辅助眼镜
CN110646953B (zh) * 2019-09-18 2020-09-22 江苏科技大学 一种头戴式色盲患者用辅助驾驶装置
CN111311516A (zh) * 2020-02-17 2020-06-19 北京百度网讯科技有限公司 图像显示方法和装置
CN113247015A (zh) * 2021-06-30 2021-08-13 厦门元馨智能科技有限公司 一种基于体感操作一体眼镜的车辆驾驶辅助系统及其方法
CN114005261B (zh) * 2021-10-16 2023-04-18 温州医科大学附属眼视光医院 一种基于智能感应的红绿灯提醒仪
CN114299455A (zh) * 2021-12-20 2022-04-08 歌尔光学科技有限公司 基于头戴显示设备的红绿灯识别方法、装置及设备
CN115431874B (zh) * 2022-09-06 2025-03-11 东风汽车集团股份有限公司 一种基于vig的车辆辅助驾驶控制系统及方法
CN117058749B (zh) * 2023-08-17 2024-06-07 深圳市华弘智谷科技有限公司 一种多摄像头透视方法、装置、智能眼镜及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101783964A (zh) * 2010-03-18 2010-07-21 上海乐毅信息科技有限公司 基于图像识别技术的色盲或色弱者辅助驾驶系统
CN102117546A (zh) * 2011-03-10 2011-07-06 上海交通大学 车载交通信号灯辅助装置
CN103458838A (zh) * 2011-02-24 2013-12-18 埃西斯创新有限公司 视觉受损人员使用的光学装置

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201060334Y (zh) * 2007-01-26 2008-05-14 深圳大学 防瞌睡眼镜
JP2009192448A (ja) * 2008-02-18 2009-08-27 Tama Art Univ 情報表示装置及び情報提供システム
US8159751B2 (en) * 2009-04-05 2012-04-17 Miguel Marques Martins Apparatus for head mounted image display
CN103185963A (zh) * 2013-03-29 2013-07-03 南京智真电子科技有限公司 多功能车辆辅助驾驶眼镜
CN203405630U (zh) * 2013-07-10 2014-01-22 北京汽车股份有限公司 车载多媒体眼镜、车载多媒体系统及车辆
CN104090366A (zh) * 2014-07-23 2014-10-08 占舒婷 一种汽车驾驶眼镜

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101783964A (zh) * 2010-03-18 2010-07-21 上海乐毅信息科技有限公司 基于图像识别技术的色盲或色弱者辅助驾驶系统
CN103458838A (zh) * 2011-02-24 2013-12-18 埃西斯创新有限公司 视觉受损人员使用的光学装置
CN102117546A (zh) * 2011-03-10 2011-07-06 上海交通大学 车载交通信号灯辅助装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10536678B2 (en) 2017-11-27 2020-01-14 International Business Machines Corporation Optimized computer display rendering for user vision conditions
US11044449B2 (en) 2017-11-27 2021-06-22 International Business Machines Corporation Optimized computer display rendering for user vision conditions
CN111352238A (zh) * 2018-12-20 2020-06-30 淮北幻境智能科技有限公司 一种色盲矫正方法及装置

Also Published As

Publication number Publication date
CN104485008A (zh) 2015-04-01

Similar Documents

Publication Publication Date Title
WO2016086437A1 (zh) 针对色盲患者的头戴式辅助驾驶系统
CN104306102B (zh) 针对视觉障碍患者的头戴式视觉辅助系统
EP3195192B1 (en) Method and system for detecting obstacles for a visual prosthesis
JP2024539329A (ja) 表示機器のための位置合わせ方法及び位置合わせ装置、車載表示システム
KR101885473B1 (ko) 시각 장애인 보조용 스마트 글래스
CN108563023B (zh) 增强现实处理方法、系统、控制设备和增强现实设备
CN110708533B (zh) 基于增强现实的视觉辅助方法及智能穿戴设备
WO2023272453A1 (zh) 视线校准方法及装置、设备、计算机可读存储介质、系统、车辆
US20150279022A1 (en) Visualization of Spatial and Other Relationships
CN104618710B (zh) 基于增强光场显示的视觉缺陷校正系统
CN109044363A (zh) 基于头部姿态和眼动的驾驶员疲劳检测方法
JP2015194884A (ja) 運転者監視システム
KR20230029782A (ko) 시각적 지원
KR101948778B1 (ko) 클라우드 연동형 시기능 강화 웨어러블 디바이스
CN108985291B (zh) 一种基于单摄像头的双眼追踪系统
US11200713B2 (en) Systems and methods for enhancing vision
JP2017191546A (ja) 医療用ヘッドマウントディスプレイ、医療用ヘッドマウントディスプレイのプログラムおよび医療用ヘッドマウントディスプレイの制御方法
CN108140362A (zh) 显示方法、装置、电子设备和计算机程序产品
JP2017189498A (ja) 医療用ヘッドマウントディスプレイ、医療用ヘッドマウントディスプレイのプログラムおよび医療用ヘッドマウントディスプレイの制御方法
WO2016086438A1 (zh) 针对视觉障碍患者的头戴式多媒体终端辅助观看系统
EP4049716B1 (en) Artificial retina system based on augmented reality
CN110316064B (zh) 一种车辆盲区显示系统
WO2023244267A1 (en) Systems and methods for human gait analysis, real-time feedback and rehabilitation using an extended-reality device
JP2003287708A (ja) 視覚拡張装置および表示システム
CN111796684A (zh) 一种物体标记的显示方法及仿生眼镜

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14907617

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.10.2017)

122 Ep: pct application non-entry in european phase

Ref document number: 14907617

Country of ref document: EP

Kind code of ref document: A1