CN100586403C - Visual sense prosthesis image processing device and method - Google Patents

Visual sense prosthesis image processing device and method Download PDF

Info

Publication number
CN100586403C
CN100586403C CN 200810034286 CN200810034286A CN100586403C CN 100586403 C CN100586403 C CN 100586403C CN 200810034286 CN200810034286 CN 200810034286 CN 200810034286 A CN200810034286 A CN 200810034286A CN 100586403 C CN100586403 C CN 100586403C
Authority
CN
China
Prior art keywords
image
information
processing
module
circuit
Prior art date
Application number
CN 200810034286
Other languages
Chinese (zh)
Other versions
CN101239008A (en
Inventor
任秋实
柴新禹
田宇坤
冀 赵
瑛 赵
Original Assignee
上海交通大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海交通大学 filed Critical 上海交通大学
Priority to CN 200810034286 priority Critical patent/CN100586403C/en
Publication of CN101239008A publication Critical patent/CN101239008A/en
Application granted granted Critical
Publication of CN100586403C publication Critical patent/CN100586403C/en

Links

Abstract

The invention relates to a visual false body image processing device and the method, belonging to the field of biological engineering. In the invention, an image collecting module is a CMOS digital image sensor which converts the obtained image information into digital mode; a wireless transmission module is responsible for the communication of the image collecting module and the image processingmodule, then transmits the image information collected by the image collecting module to the image processing module; the image processing module has an image information precorrection to the obtainedimage to improve the image quality, having image information simplifying, strengthening or coding treatment to transform the obtained image information into the pulse encouraging mode accepted by thevisual system to provide for an internal stimulation module, and providing the function of self regulation for users. The method is showed as follows: firstly executing image pretreatment, then through an image complexity judgment, the image is divided into three kinds and the corresponding treatment procedure is adopted. The invention resolves the prior disadvantage to be applied in all types ofvisual false body.

Description

视觉假体图像处理装置及方法 Visual prosthesis image processing apparatus and method

技术领域 FIELD

本发明涉及一种生物医学工程技术领域的装置及方法,具体涉及一种视觉假体图像处理装置及方法。 The present invention relates to apparatus and method for the technical field of biomedical engineering, particularly to a visual prosthesis image processing apparatus and method. 背景技术 Background technique

目前很多国家的科技人员在研究采用视觉假体的方法来修复盲人的视觉功能。 At present scientific and technical personnel in many countries of the method in the study of visual prosthesis to repair the blind visual function. 视觉假体是一种利用电刺激视觉神经系统恢复盲人视力的人造器官,主要包括以下过程:将获取的外部图像信息的光信号转换为电信号;将获取的图像信息进行图像处理,并转换为相应的剌激模式;将能量与信号传输给植入体内的刺激器及其微电极阵列,微电极阵列刺激视觉通路上的神经细胞来产生光幻视。 A visual prosthesis using electrical stimulation of the nervous system to restore the visual acuity blind artificial organs, including the following process: converting an external optical signal acquired image information into an electric signal; acquired image information subjected to image processing, and is converted to appropriate stimulation pattern; the energy of the signal transmission to the implantable stimulator and microelectrode array vivo microelectrode arrays stimulate nerve cells in the visual pathway to produce phosphenes. 无论是视网膜刺激视觉假体、视皮层刺激视觉假体、还是视神经刺激视觉假体,都需要包含视觉图像处理系统。 Both stimulate retinal visual prosthesis, stimulate the visual cortex visual prosthesis, or optic nerve stimulation visual prosthesis, comprising require vision image processing system. 视觉假体由体外与体内两部分组成:体外部分主要完成图像信息获取,然后经过一系列的图像处理以及图像编码转换为视觉系统可以接受的刺激模式,然后通过有线或射频传输将处理好的图像信息传送到体内刺激器;体内部分主要负责刺激信号的接收及产生微电流驱动剌激电极阵列。 Visual prosthesis in vivo and in vitro consists of two parts: the main part vitro completion of the image information acquisition, then through a series of image processing and an image encoding system is converted to an acceptable visual stimulation pattern, a wired or radio frequency transmission and then sends the processed image by information to the stimulator in vivo; body portion mainly responsible for receiving and generating micro-current stimulation signal for driving the array of stimulation electrodes.

摄取图像的传感器和图像处理器构成了视觉假体的前端图像处理系统,它们的作用是将输入的图像信息转换为可进行电刺激的脉冲信息。 An image pickup sensor and an image processor image processing system constituting a front end of the visual prosthesis, their role is to input image information converted into electrical stimulation pulse information. 图像信息需要经过图像简化、图像增强、边缘提取、图像编码等处理,转换为视觉神经系统能够接受的刺激模式,然后再送到剌激电极阵列激发出视幻觉,使部分视觉能够得以修复。 Simplified image information need to go through the image, image enhancement, edge detection, image processing such as encoding, is converted to the nervous system can accept the visual stimulation pattern, stimulation of the electrode array and then to stimulate visual hallucinations, so that part is visually be repaired. 因此,视觉假体图像处理系统是人工视觉假体中不可缺少的组成部分。 Thus, the visual prosthesis of the image processing system is an integral part of the prosthesis of artificial vision.

经对现有技术的文献检索发现,美国发明专利公开号为US20020095193A1, 公开日为2002年7月18日,该专利自述为"含有增强接收与电极剌激部分的视觉假体",它先通过一个CCD图像传感器采集外部图像信息,然后将采集到的原始图像进行像素简化、图像编码得到简化的易于传输的图像信息,然后通过无线射频技术传入体内的剌激电极阵列产生电剌激。 Literature search of the prior art was found, U.S. Patent Publication No. US20020095193A1, publication date July 18, 2002, which patent is readme "containing reinforcing visual prosthesis stimulation electrode receiving portion", through which first a CCD image sensor capture an external image information, and the acquisition of raw image pixels to be simplified, simplified image information obtained by coding an image easily transmitted, and then generates electrical stimulating afferent stimulation electrode array in the body by radio frequency technology. 其不足在于:(1)采用CCD传感器作为图像采集装置,CCD传感器很难把驱动电路、信号处理电路与成像阵列单片集成,系统由多芯片组成,其体积较CMOS传感器大,隐蔽性较差,应用在视觉假体中不利于美观和便捷;(2) CCD传感器为被动式采集,必须外加电压让每个像素中的电荷移动至传输通道,而这个外加电压通常需要12-18V,因此CCD 还必须有更精密的电源线路设计和耐压强度,高驱动电压使CCD的耗电量远高于CM0S传感器;(3)该专利中缺乏图像预校正功能,图像质量不利于后端的处理; Its shortcomings in that: (1) using a CCD sensor as the image pickup apparatus, the CCD sensor driving circuit is difficult, and a signal processing circuit monolithically integrated imaging array, a multi-chip system, whose volume than the large CMOS sensor, poor concealment application of the visual prosthesis does not contributes to the beauty and convenience; (2) CCD sensor is a passive collection, voltage must be applied so that the movement of each pixel in the charge to the transmission path, and this applied voltage typically requires 12-18V, the CCD further there must be more sophisticated circuit design and power compressive strength, high driving voltage so that the power consumption is much higher than the CCD sensor CM0S; (3) the lack of image pre-Patent correction function, the image quality is not conducive to the rear end of the handle;

(4)没有考虑到视觉假体植入者的自我调节功能;(5)没有系统完善的图像处理策略。 (4) does not take into account the self-regulatory function of the visual prosthesis implant recipients; (5) there is no perfect system, image processing strategy.

发明内容 SUMMARY

本发明针对现有技术的不足,提供一种视觉假体图像处理装置及方法,使其解决上述的不足,应用于所有类型(视网膜刺激型、视皮层刺激型、视神经剌激型)视觉假体。 The present invention addresses deficiencies in the prior art, to provide a visual prosthesis image processing apparatus and method, so as to solve the above deficiencies, applicable to all types (type of retinal stimulation, stimulus type visual cortex, the optic nerve stimulation model) visual prosthesis .

本发明是通过以下技术方案实现的- The present invention is achieved by the following technical solutions -

本发明所涉及的视觉假体图像处理装置,包括图像釆集模块、无线传输模块和图像处理模块。 Visual prosthesis image processing apparatus according to the present invention, comprising an image collection module Bian, wireless transmission module and an image processing module. 这三个模块依次连接,其中: These three modules are connected in sequence, wherein:

所述图像采集模块是一个CMOS数字图像传感器,它将获取的图像信息转换成数字模式; The image acquisition module is a digital CMOS image sensor, which converts the acquired image information into digital mode;

所述无线传输模块负责图像采集模块与图像处理模块的通讯,它将图像采集模块采集到的图像信息传输到图像处理模块; The wireless transmission module is responsible for communication with the image acquisition module of the image processing module, the module will capture the image captured image information to the image processing module;

所述图像处理模块对获取的图像进行图像信息预校正,改善图像质量,然后采用视频数字信号处理芯片进行图像信息简化、增强、编码处理,使获取的图像信息转化为视觉系统能接受的脉冲激励模式以提供给体内剌激模块,并通过高级精简指令集微处理器来控制图像处理模块中图像信息的传输,通过手动调节电路为用户提供了自我调节的功能,使用户自行调节图像的亮度、对比度以及图像编码码率。 Excitation pulse the image processing module of the image acquired pre-corrected image information, image quality is improved, and digital video signal processing chip using the image information reduction, enhancement, coding processing, information acquired image into the visual system can accept vivo stimulation pattern to be provided to the module, and controls the transmission of the image information of an image processing module, by manually adjusting circuit provides a self-regulating function for the user, so the user adjusts brightness of the image itself is advanced reduced instruction set microprocessor, contrast and image coding rate. 图像处理模块改善现有技术,采用了视频数字信号处理芯片进行图像信息的处理,它的运算能力足够完成一系列的视觉图像处理算法,而且可以空出一部分资源完成其它功能的控制。 The image processing module to improve the prior art, using a digital video signal processing chip for processing image information, its computing power sufficient to complete a series of visual image processing algorithms, and frees resources to complete a portion of the control other functions.

所述图像处理模块包括视频数字信号处理芯片(DSP)、高级精简指令集微处理器(ARM)、同步动态存储器(SDRAM)、闪速存储器(FLASH)、专用信息存储器、 校正处理电路、手动调节电路、电源管理装置。 The video image processing module comprises a digital signal processing chip (DSP), an advanced reduced instruction set microprocessor (the ARM), synchronous dynamic memory (SDRAM), flash memory (FLASH), private information memory, the correction processing circuit, manual adjustment circuit, the power management device. 视频数字信号处理芯片对同歩动态存储器中的图像信息进行简化、增强、编码处理,经信息简化、图像增强处理后的图像信息存放在动态同步存储器中,经编码处理后的图像编码信息存放在专用信息存储器中;高级精简指令集微处理器与数字信号处理芯片相互连接并通讯,并与同步动态存储器、图像校正处理电路、手动调节电路、数据发送接口、 数据接收接口连接,负责控制信息的传输以及调控图像校正处理电路、手动调节电路;校正处理电路对同步动态存储器中存放的原始图像信息进行图像校正,从而改善图像质量;手动调节电路与高级精简指令集微处理器相连接,对图像的亮度、对比度以及图像编码码率进行调节。 Digital video signal processing chip of the image information with ho dynamic memory is simplified, enhanced encoding process by the information reduction, image enhancement, image information processing is stored in a dynamic synchronous memory, the encoded image information encoding process is stored in specific information in memory; advanced RISC microprocessor and a digital signal processing chip are connected to each other and communicate with the synchronous dynamic memory and image correction processing circuit, manual adjustment circuit, a data transmission interface, the data receiving interface is responsible for control information regulation and transfer the image correction processing circuit, manual adjustment circuit; correction processing circuit of the original image information stored in the memory synchronous dynamic image correction, thereby improving the image quality; manual adjustment circuit advanced RISC microprocessor is connected, on the image brightness, contrast, and an image encoding bit rate adjustment. 电源管理装置为视频数字信号处理芯片、 高级精简指令集微处理器、图像校正处理电路、手动调节电路提供相应的工作电压。 A power management device is a digital video signal processing chip, Advanced RISC microprocessors, image correction processing circuit, manual adjustment circuitry to provide the appropriate operating voltage.

所述视频数字信号处理芯片读取专用信息存储器中的从体内电极刺激模块反馈回来的信息,并进行调整;读取专用信息存储器中的经过校正处理电路处理好的图像校正信息,调整前端图像采集模块的控制参数;接受手动调节电路的调节信号并进行处理;与高级精简指令集微处理器相互连接并通讯,高级精简指令集微处理器控制图像信息输入输出视频数字信号处理芯片。 The digital video signal processing chip dedicated read information from the feedback information in the memory module back electrode stimulation in vivo, and adjust; read specific information after the correction processing circuit in the Handled memory image correction information, to adjust the front-end image capture the control parameters of a module; manual adjustment signal conditioning circuit receiving and processing; advanced RISC microprocessor with connected and communicate with each other, advanced RISC microprocessor controls the image information input-output digital video signal processing chip.

所述高级精简指令集微处理器,与数字信号处理芯片相互连接并通讯,并与 The Advanced RISC microprocessor, connected to communicate with each other and with a digital signal processing chip, and with

同步动态存储器、图像校正处理电路、手动调节电路、数据发送接口、数据接收 Synchronous dynamic memory, image correction processing circuit, manual adjustment circuit, a data transmission interface, data is received

接口连接,高级精简指令集微处理器负责控制存储在专用信息存储器中的图像编 Interface, Advanced RISC microprocessor is responsible for controlling image encoding specific information stored in memory

码信息通过数据发送接口传输到后面的射频传输模块从而传向体内的电极刺激 Code information transmitted via the data interface to transfer back to the RF transmission module thus transmitted into the body of the electrode stimulation

模块,以及控制后端电极剌激器模块反馈回来的信息通过数据接收接口输入图像处理模块存放到专用信息存储器内供数字信号处理芯片读取,并起到控制校正处 Module, and a control electrode stimulation rear module information fed back is stored in the digital signal processing chip for reading the specific information received through the data memory interface input image processing module, and functions as a correction control at

理电路、响应手动调节电路从而进行调控的作用。 Processing circuit, in response to manual adjustment circuit to perform the role of regulation.

所述同步动态存储器,与视频数字信号处理芯片、高级精简指令集微处理器、 校正处理电路连接,用来存储图像采集模块获取的图像信息以及经过视频数字信号处理芯片图像简化、图像增强处理后的图像信息。 After the synchronous dynamic memory, the digital video signal processing chip, advanced reduced instruction set microprocessor, the correction processing circuit, for storing image information acquired by image acquisition module and a digital video signal through a simplified image processing chip, image enhancement the image information.

所述闪速存储器,与视频数字信号处理芯片连接,存储用于人工视觉假体图像处理策略的程序以及视频数字信号处理芯片对图像传感器、手动调节电路、校正处理电路的控制程序。 The flash memory, connected to the video digital signal processing chip, for storing prosthetic artificial vision image processing program, and a policy digital video signal processing chip image sensor, manual adjustment circuit, the correction processing circuit of the control program.

所述专用信息存储器,按照地址的不同存储不同信息,分别为经校正处理电路修正后的图像信息、经视频数字信号处理芯片处理后的图像编码信息、体内刺激电极的反馈信息。 The private information memory, stored in different addresses of different information, namely image information corrected by the correction processing circuit, the encoded image information after the digital video signal processing chip processing, feedback vivo stimulation electrodes.

所述校正处理电路,连接专用信息存储器、高级精简指令集微处理器、同步动态存储器,起到改善图像质量的作用,它对同步动态存储器中存放的原始图像信息进行图像校正,校正后的图像信息参数存储到专用信息存储器内供数字信号处理芯片读取,高级精简指令集微处理器调用同步动态存储器中存放的原始图像信息输入校正处理电路,校正处理电路对其进行图像校正,修正后的图像参数输入专用信息存储器,视频数字信号处理芯片将专用信息存储器中存放的校正后的图像参数信息和同步动态存储器中存放的原始图像信息进行比较,如果存在差异,视频数字信号处理芯片与图像传感器通讯,调整图像采集模块的采集参数, 并控制图像传感器重新采集图像信息。 The correction processing circuit, connection-specific information storage, advanced RISC microprocessor, a synchronous dynamic memory, play a role in improving image quality, it synchronous dynamic memory the original image information stored in image correction, a corrected image parameter information stored in the information memory for a dedicated digital signal processing chip reading, invoke advanced RISC microprocessor synchronous dynamic memory the original image information stored in the input correction processing circuit, the correction circuit is subjected to image correction processing, the correction the image parameter input specific information memory, digital video signal processing chip dedicated original image information of image parameter information and the synchronous dynamic memory the correction information memory stored in the store are compared, if the difference exists, the video digital signal processing chip and the image sensor communication, acquisition parameters to adjust the image acquisition module, and controls the image sensor image information acquired again.

所述的手动调节电路接收用户的手动调节的指令,手动调节包括对图像亮度、对比度以及图像编码码率的调节,手动调节电路与高级精简指令集微处理器相连接,外设按钮输入调节信息进入手动调节电路,手动调节电路处理后将调节信号输送给高级精简指令集微处理器,高级精简指令集微处理器与视频数字信号处理芯片通信使视频数字信号处理芯片按照调节信号对图像进行调节。 Instruction manual adjustment of the manual adjustment circuit receives the user manually adjusting comprises adjusting the image brightness, contrast, and an image encoding bit rate, and the manual adjusting circuit Advanced RISC microprocessor is connected to the peripheral button input adjustment information after entering the manual adjustment circuit, manual adjustment signal is supplied to the adjustment circuit for processing advanced RISC microprocessor, advanced RISC microprocessors in conjunction with a communication digital video signal processing chip to make digital video signal processing chip to the image signal is adjusted in accordance with adjustment .

本发明所涉及的视觉假体图像处理方法,具体为:先将获取的图像经过图像预处理过程来去除噪声,增强对比度,从而改善图像质量。 The image processing method of the visual prosthesis of the present invention, specifically: first image acquired after the image pre-processing to remove noise, enhance the contrast, thereby improving image quality. 经过图像预处理以后, 进行图像复杂度判断,根据图像的复杂度将图像分为三类:简单图像、中等复杂图像、复杂图像。 After subsequent image preprocessing, image complexity is determined, according to the complexity of the image of the image into three categories: a simple image, an image moderately complex, complex images.

对于简单图像,先直接将图像进行像素简化,简化所要求的像素数,然后将图像二值化,最后进行图像信息提取得出结果。 For simple images, the first image pixel directly simplified, the number of pixels required simplified, and the binarized image, the image information extracting finally the outcome.

对于中等复杂图像,先进行第一次像素简化,其次将图像二值化,并进行图像信息提取,然后进行图像修复,最后进行第二次像素简化,达到要求像素数, 得到处理结果。 For moderately complex images, for the first time to simplify the pixels, followed by the binarized image, and extracting the image information and an image repair, and finally to simplify the second sub-pixel to achieve the required number of pixels, the processing result obtained.

对于复杂图像,使用图像中目标的定位与局部细化,对任意给定坐标的某些区域进行数字放大,在给定像素的情况下提高对图像局部特性的识别。 For complex images, using the image of the target location and locally refined, for any digitally amplifying a certain region of the given coordinates, to improve the recognition of local characteristics of the image in the case where a given pixel.

本发明相对于已有的方案的优势在于:1、根据图像的复杂度将获取的图像进行分类,并应用不同的图像处理策略进行图像处理。 Advantages of the embodiment of the present invention has with respect to: 1, classified according to the degree of image complexity of the acquired image, and apply different image processing image processing strategy. 2、选用了合适的芯片、器件,初步开发了适合于所有类型人工视觉假体的图像处理系统硬件,为视觉假体的产业化提供了前提。 2, choose the right chip, device, initially developed for all types of artificial vision prostheses Image Processing System, provides the premise for the industrialization of the visual prosthesis. 3、采用了CMOS数字图像传感器作为图像采集装置,它与DSP等其它器件易于连接通讯,并且功耗低,尺寸小。 3, using a digital CMOS image sensor as an image pickup apparatus, it is easy to connect to other devices such as a DSP communication, and low power consumption, small size. 4、选用了专用的视频信号处理芯片作为视觉图像处理模块的主芯片,它提供丰富的用于多媒体处理的视频处理接口,运算能力足够完成一系列的视觉图像处理算法。 4, the selection of specific video signal processing chip as the master chip vision image processing module, which provides a wealth of video processing interface for multimedia computing power sufficient to complete a series of processing visual image processing algorithms. 5、将图像采集模块的图像传感器通过无线传输模块与图像处理模块中的DSP连接通讯,减少了系统中的连接线。 5, the image sensor image acquisition module connected to DSP via the communication module and the wireless transmission of the image processing module, reducing the cable system. 6、图像处理模块中应用ARM, ARM控制校正处理电路、手动调节电路、并实现图像信息的输入输出功能。 6, the image processing application module ARM, ARM control correction processing circuit, manual adjustment circuit, and to achieve image information input and output functions. 7、通过校正处理电路对输入图像处理模块的图像信息进行校正,去除噪声,增强图像的对比度,改善获取的原始图像的图像质量。 7, image information is corrected by the input image processing module correction processing circuit to remove noise, enhance the contrast of images, improving the image quality of the original image acquired. 8、增加手动调节电路,用户可以对图像的亮度、对比度进行调解,并对码率进行调解。 8, increasing the manual adjustment circuit, the user can mediate in the image brightness, contrast, and mediation rate.

本发明的系统,实现简单,功能完备,可用于视觉假体图像处理的研究开发, 为人工视觉假体的产业化奠定了基础。 The system of the present invention is simple and fully functional, can be used for research and development of visual prostheses image processing, laid the foundation for the industrialization of artificial vision prostheses.

附图说明 BRIEF DESCRIPTION

图l是本发明装置与体外系统的连接图图2是本发明的图像处理装置的结构框图图3是本发明方法流程图具体实施方式 Figure l is a view of the connection device and the extracorporeal system of the invention FIG 2 is a block diagram of an image processing apparatus according to the present invention 3 is a flowchart of a method according to the present invention DETAILED DESCRIPTION

下面结合附图对本发明的实施例作详细说明:本实施例在以本发明技术方案为前提下进行实施,给出了详细的实施方式和具体的操作过程,但本发明的保护范围不限于下述的实施例。 DRAWINGS Embodiments of the present invention will be described in detail: In the present embodiments of the present invention is a technical premise, given the specific operation and detailed embodiments, but the scope of the present invention is not limited to the Example embodiments described below.

如图1所示,首先通过图像釆集模块获取外部图像信息,获取后的图像信息通过无线传输模块输入图像处理模块,在图像处理模块中通过DSP进行图像信息的简化、分割、增强、编码等处理,处理后的图像信息输出图像处理模块并通过射频传输模块传送到体内电极刺激模块。 As shown, a first acquired by the image collection module preclude external image information, image information acquired by the input image processing module is a wireless transmission module, a simplified image information through the image processing DSP module, segmentation, enhancement, coding, etc. processing, the processed image information of the output image processing module and transmitted to the body through the radio frequency transmission modules electrode stimulation module.

如图2所示,本发明中的图像采集模块是一个CMOS数字图像传感器,CMOS 图像传感器的最大优势在于与DSP等其它器件的亲和性,较容易地做成单芯片系统,并且功耗较低。 2, the image acquisition module of the present invention is a digital CMOS image sensor, the CMOS image sensor is the greatest advantage in that the affinity with other devices such as a DSP, relatively easily formed as the single-chip system, and power than low.

所述的CMOS图像传感器(可以釆用OV6650或者性能参数与其相类似的图像传感器)尺寸小,适合于便携应用,采用先进的运算法则消除固定模式噪声,减少托尾效应。 The CMOS image sensor (OV6650 or may preclude the use of the performance parameters of an image sensor similar thereto) small size, suitable for portable applications, the use of advanced algorithms to eliminate fixed pattern noise, tail-reducing effect. CMOS图像传感器通过无线传输模块与图像处理模块中的DSP通信, 采集到的图像信息通过无线模块输入图像处理模块,以规定的格式存放到SDRAM 中,然后由DSP进行图像信息简化、增强、编码等处理。 The CMOS image sensor through the wireless transmitting module and the image processing module in a DSP communication, captured image information input image processing module via the wireless module, in a predetermined format stored in the SDRAM, followed by the DSP image information reduction, enhancement, coding, etc. deal with.

如图2所示,本发明中的无线传输模块负责图像采集模块与图像处理模块的通讯,将图像采集模块采集到的图像信息传输到图像处理模块。 As shown, the wireless communication transmission module of the present invention is responsible for image acquisition module and the image processing module, the second image acquisition module transmitting the image information to the image processing module. 无线传输模块采用成熟的蓝牙无线技术。 Wireless transmission module mature Bluetooth wireless technology.

如图2所示,本发明中的图像处理模块包括数字信号处理芯片(DSP)、高级精简指令集微处理器(ARM)、同步动态存储器(SDRAM)、闪速存储器(FLASH)、 专用信息存储器、校正处理电路、手动调节电路、数据发送接口、数据接收接口、 电源管理装置。 As shown, in the present invention is an image processing module 2 comprises a digital signal processing chip (DSP), an advanced reduced instruction set microprocessor (the ARM), synchronous dynamic memory (SDRAM), flash memory (FLASH), specific information memory , correction processing circuit, manual adjustment circuit, a data transmission interface, data reception interface, a power management device.

DSP接收采集模块采集到的原始的图像信息并将其存放在SDRAM中,ARM控制校正处理电路对SDRAM中存放的原始信息进行校正,修正所需图像信息的参数,将这些参数存储在专用信息存储器的校正信息部分,DSP控制调整前端图像采集模块控制参数,重新采集合适的图像信息并存放到SDRAM中;DSP读取存放在SDRAM 中的数字图像信号进行图像简化、增强、编码等处理,将经过图像简化、增强处理后的图像信息存放在SDRAM中,将经过图像压縮编码处理后的图像编码信息存放在专用信息存储器中;A賜控制专用信息存储器中的图像编码信息输入到射频传输模块以及从电极刺激模块反馈回的信息存放到专用信息存储器中,并将其输入到DSP中;手动调节电路与ARM相连接,它接收用户的手动调节的指令,并将调节信号输送给ARM, ARM与DSP通信使DSP按照调节信号对图像进行调节。 DSP acquisition module receiving the original image information and store it in the SDRAM, the ARM control correction processing circuit SDRAM stored original information is corrected, the correction parameters required for the image information, these parameters are stored in the private information memory correction information section, the front end of the DSP to adjust the control parameters of the image acquisition control module, re-collect and place the appropriate image information in SDRAM; the DSP is stored in the SDRAM read digital image signal to an image simplification, enhancement, coding process, after the simplified image, the image enhancement processing information stored in the SDRAM, the encoded image information through the image compression coding process is stored in the private information memory; a given encoded image information specific control information in the memory is input to the RF transmission module and feedback from the back electrode stimulation module specific information stored in the information memory, and input to the DSP; manual adjustment circuit is connected with the ARM, which receives the user instruction manual adjustment, and adjustment signal supplied to ARM, the ARM DSP DSP communication so adjusted as adjusting the image signal.

所述的数字信号处理芯片(DSP)是视觉假体中图像处理模块的主芯片,采用TI公司的专用视频数字信号处理芯片TMS320DM642, TMS320DM642提供丰富的用于多媒体处理的视频处理接口,主频达到600MHz,其运算能力足够完成一系列的视觉图像处理算法,而且可以空出一部分资源完成其它功能的控制。 Said digital signal processing chip (DSP) chip, the main processing module of the image visual prosthesis, using TI dedicated video digital signal processing chip TMS320DM642, TMS320DM642 provides rich multimedia processing for video processing interface, speeds up 600MHz, computing power sufficient to complete a series of visual image processing algorithms, and frees resources to complete a portion of the control other functions. DSP与前端的CMOS图像传感器通讯,与图像处理模块中的ARM、 FLASH、 SDRAM、专用信息存储器连接。 A DSP and a communications front end CMOS image sensor, the image processing module is connected to the ARM, FLASH, SDRAM, private information memory. 前端图像采集模块的CMOS图像传感器通过无线传输模块将获取的数字图像信号输入图像处理模块,存放在SDRAM中;DSP读取存放在SDRAM中的数字图像信号进行图像简化、增强、编码等处理,将经过图像简化、增强处理后的图像信息存放在SDR細中,将经过图像压縮编码处理后的图像编码信息存放在专用信息存储器的编码信息存储部分;DSP读取专用信息存储器中的从体内电极刺激模块反馈回来的信息,并进行相应调整;DSP读取专用信息存储器中的经过校正处理电路处理好的图像校正信息,调整前端图像采集模块的控制参数;DSP接受手动调节电路的调节信号并进行相应的处理;DSP与ARM相互连接并通讯,ARM控制图像信息输入输出DSP。 CMOS image sensor image acquisition module through a front end of a wireless transmission module acquires the input image digital image signal processing module, stored in the SDRAM; the DSP is stored in the SDRAM read digital image signal to an image simplification, enhancement, coding process, the after simplified image, the image enhancement processing information stored in the SDR fine, the encoded image information through the image compression coding process encoded information stored in the specific information storage section of memory; the DSP reads from the electrode body in the specific information memory stimulation module fed back information, and adjust accordingly; read through the DSP specific information correction processing circuit in the Handled memory image correction information, a control parameter adjustment of the front end of the image acquisition module; the DSP receiving a manual adjustment signal conditioning circuit and corresponding processing; ARM connection with the DSP and communicate with each other, the image information input-output control ARM DSP. 图像处理模块的DSP需要3.3V和+1.4V的工作电压,由图像处理模块中的电源装置提供。 DSP image processing module needs as + 1.4V and 3.3V operating voltage, provided by the image processing module in the power supply device.

所述的高级精简指令集微处理器(ARM)采用raiLIPS公司的LPC2214FBD144 芯片,其工作主频最高可以达到60MHz,具有片内PLL,可实现自定义的倍频/分频能力。 The Advanced RISC Microprocessor (ARM) employ raiLIPS's LPC2214FBD144 chip, the operating frequency can be up to 60MHz, with the PLL chip, frequency multiplication can be customized / division capability. ARM主要具有控制图像信息的输入输出通讯功能,并起到控制校正处理电路、响应手动调节电路从而进行调控的作用。 ARM having a main function of controlling input and output of image information communication, and functions to control the correction processing circuit, in response to manual adjustment circuit to perform the role of regulation. ARM与DSP相互连接并通讯,并与SDRAM、图像校正处理电路、手动调节电路、数据发送接口、数据接收接口连接。 ARM and DSP are interconnected and communicate with SDRAM, image correction processing circuit, manual adjustment circuit, a data transmission interface, the data receiving interface. ARM控制校正处理电路对SDRAM中存放的原始信息进行校正,修正所需图像信息的参数,将这些参数存储在专用信息存储器的校正信息部分,以备DSP控制调整前端图像采集模块控制参数;ARM将手动调节电路发出的调节指令输入DSP,使DSP 做出相应的处理;ARM控制专用信息存储器中存放的经DSP处理好的图像编码信息通过数据发送接口输入到射频传输模块;ARM控制通过数据接收接口接收到的从电极刺激模块反馈回的信息存放到专用信息存储器的电极信息部分中,并将其输入到DSP中。 ARM control correction processing circuit SDRAM stored original information is corrected, the correction parameters required for the image information, these parameters are stored in the correction information memory section specific information to prepare DSP control to adjust the front end image acquisition module control parameter; the ARM manually modulating circuit issues an instruction input DSP, the DSP to make the appropriate treatment; the ARM DSP-specific control information stored in the memory Handled interface input encoded image information sent to the RF module via the data transmission; the ARM control data received via the interface feedback from the electrode stimulation module back to the electrode to store the received information in the memory section specific information, and input to the DSP. ARM需要+1.8V的工作电压,由图像处理模块中的电源装置提供。 ARM + 1.8V operating voltage is required, image processing module provided by the power supply device.

所述的同步动态存储器(SDRAM)与DSP、 ARM、校正处理电路连接,主要用来存储图像采集模块获取的图像信息以及经过DSP图像简化、图像增强处理后的图像信息。 The synchronous dynamic memory (SDRAM) with DSP, the ARM, the correction processing circuit, the image information is mainly used to store the acquired image acquisition module as well as simplified through DSP image, the image enhancement processing image information. SDRAM容量为20Mb,按照1秒存储24幅图像,每幅图像10万像素,l像素8比特计算,SDRAM的容量足以满足人工视觉假体的图像存储要求。 20Mb of SDRAM is, according to one second image memory 24, 100,000 pixels per image, l 8-bit pixel calculation, SDRAM image storage capacity sufficient to meet the requirements of artificial vision prosthesis.

所述的闪速存储器(FLASH)与DSP连接,主要存储用于人工视觉假体图像处理策略的程序以及DSP对图像传感器、手动调节电路、校正处理电路等部分的控制程序。 The flash memory (FLASH) is connected with the DSP is mainly used for storing visual prosthesis artificial image processing program and a policy control program to the DSP image sensor, manual adjustment circuit, the correction processing circuit portion.

所述的专用信息存储器按照地址的不同存储不同的信息,分别为经校正处理电路修正后的图像信息、经DSP处理后的图像编码信息、体内刺激电极的反馈信息以及其他信息。 The private information memory in a different memory address different information are image information corrected by the correction processing circuit, the image information encoded by the DSP processing, in vivo, and other feedback information stimulation electrodes. 所述的校正处理电路对SDRAM中存放的原始图像信息进行图像校正(去除噪声、增强对比度),起到改善图像质量的作用。 Correction processing circuit according to the original image information stored in the SDRAM performs image correction (to remove noise, enhance the contrast), play a role in improving image quality. 校正处理电路连接专用信息存储器、ARM、 SDRAM。 Specific information correction processing circuit connected to the memory, ARM, SDRAM. ARM调用SDRAM中存放的原始图像信息输入校正处理电路,校正处理电路对其进行图像校正,修正后的图像参数输入专用信息存储器,DSP将专用信息存储器中存放的校正后的图像参数信息和SDRAM中存放的原始图像信息进行比较,如果存在差异,DSP与图像传感器通讯,调整图像采集模块的采集参数, 并控制图像传感器重新采集图像信息。 ARM call SDRAM original image information stored in the input correction processing circuit, the correction circuit is subjected to image correction processing, the correction parameters inputted image information dedicated memory, DSP, dedicated to the corrected image information stored in the parameter information stored in the SDRAM and storing the original image information is compared, if there is a difference, the DSP communication with the image sensor, to adjust the image acquisition parameters acquisition module, and controls the image sensor image information acquired again.

所述的手动调节电路接收用户的手动调节的指令,手动调节包括对图像亮度、对比度以及图像编码码率的调节,手动调节电路与ARM相连接,外设按钮输入调节信息进入手动调节电路,手动调节电路处理后将调节信号输送给ARM, ARM 与DSP通信使DSP按照调节信号对图像进行调节。 Instruction manual adjustment of the manual adjustment circuit receives the user manually adjusting comprises adjusting the image brightness, contrast, and an image encoding bit rate, and the manual adjusting circuit is connected to ARM, peripheral button input adjustment information entered manually adjusting circuit, manual after adjusting the processing circuit sends a signal to adjust the ARM, ARM and DSP DSP communication enable adjustment signal in accordance with the image adjustment.

所述的数据发送接口和数据接收接口作为图像信息传输的通道,DSP处理好的图像编码信息通过数据发送接口从图像处理模块发送到射频传输模块;从电极剌激模块反馈回的信息通过数据发送接口接收输入图像处理模块的专用信息存储器。 The data transmission interface and reception interface data as image information transmission path, DSP processing good image encoding information transmitted from the image processing module is the interface to transmit data via radio frequency transmission modules; from the electrodes to stimulate the fed back information transmission module through the data interface-specific information memory receiving an input image processing module.

所述的提供电压的电源管理装置为DSP提供+1. 4V的电压,为工/0提供+3. 3V的电压,为ARM提供+1.8V的电压。 Said power management means supplies a voltage to provide a voltage DSP +1. 4V and a voltage +3. 3V to work / 0, a voltage of + 1.8V ARM.

如图3所示,图像处理流程如下:先通过一个图像采集器来获取外界场景的图像信息,对所得到的原始图像进行图像预处理,图像预处理是对获取的原始图像进行初级的处理,主要目的是改善极端情况下的图像质量,保证信息提取的效果。 As shown in FIG 3, the image processing flow is as follows: first acquiring image information to the outside world scene through a frame grabber, an original image was subjected to image preprocessing, image preprocessing is performed original primary image acquisition process, the main purpose is to improve the image quality under extreme circumstances, to ensure that the effect of the extracted information. 图像预处理过程用中值滤波的方法去除噪声、用直方图均衡化的方法增强图像对比度,并通过优化硬件寄存器而实现光照度调整。 Image preprocessing median filtering method for removing noise, image contrast enhancement using histogram equalization method, and the light adjustment is achieved by optimizing the hardware registers. 经过图像预处理以后,进行图像复杂度判断,根据图像的复杂度将图像分为三类:简单图像、中等复杂图像、复杂图像。 After subsequent image preprocessing, image complexity is determined, according to the complexity of the image of the image into three categories: a simple image, an image moderately complex, complex images. 图像复杂度分类的标准为:定义简单图像为单一背景中的单一物体,比如常见的生活用品,采用MIG复杂度算法计算得简单图像的复杂度值小于0.4;定义中等复杂图像为人的轮廓,简单生活场景以及少于3个简单物体的组 Of the classification of the image complex criteria: the definition of a simple image to a single background single object, such as common household items, using an MIG complexity of the algorithm to be simple complexity value image is less than 0.4; defining moderately complex image of a person profile, simple life scenes and less than three sets of simple objects

合,采用MIG复杂度算法计算得中等复杂图像的复杂度值大于0.4小于0.6;定义复杂图像为复杂生活场景以及多于3个物体的组合,采用MIG复杂度算法计算得复杂图像的复杂度值大于0.6。 Together, using an MIG algorithm complexity moderate complexity calculated image complexity value greater than 0.4 less than 0.6; is defined as a complex image scene complexities of life, and combinations of more than three objects, using calculated values ​​of image complexity complexity algorithm complexity MIG greater than 0.6. 对三类不同的图像采取不同的图像处理策略。 Adopt different strategies for image processing of three different images.

对于简单图像,先直接将图像进行像素简化,简化到所要求的像素数,然后将图像二值化,最后进行图像信息提取得出结果。 For simple images, the first image pixel directly simplification, reduced to the required number of pixels, and the binarized image, the image information extracting finally the outcome. 对于中等复杂图像,先进行第一次像素简化,其次将图像二值化,并进行图像信息提取,然后进行图像修复, 最后进行第二次像素简化,达到要求像素数,得到处理结果。 For moderately complex images, for the first time to simplify the pixels, followed by the binarized image, and extracting the image information and an image repair, and finally to simplify the second sub-pixel to achieve the required number of pixels, the processing result obtained. 对于复杂图像,使用图像中目标的定位与局部细化这种思想,对任意给定坐标的某些区域进行数字放大,有利于在给定像素的情况下提高对图像局部特性的识别。 Positioning complex images, using the object in the image and local refinement of this idea, certain areas of the coordinates of any given digital zoom, help to improve the identification of the local characteristics of the image in the case where a given pixel. 本发明详细地提出了对简单图像和中等复杂图像的不同处理流程。 The present invention proposes a different process flow of medium simple and complex images the image detail.

所述的针对简单图像,其处理方法具体是:先将经过图像复杂度判断分类后的简单图像进行像素简化,直接像素简化到所要求的像素水平,然后将简化过的图像通过最大类间距阈值化的方法来产生二值图像,从而减少后续图像处理算法的计算复杂度,再对图像进行信息提取,信息提取时采用四方向的边缘提取算法, 最后得到处理结果,这种图像处理策略的计算复杂度很低。 The simple image for which processing method is specifically: first determines the complexity of the image through a simple image after pixel classification simplification, the pixel directly reduced to the desired level of pixels, then the maximum image through simplified class distance threshold a method of generating a binary image, thereby reducing the computational complexity of subsequent image processing algorithms, and then extracts the image information, when the four-direction information extracting an edge extraction algorithm, to give the final processing result, such image processing strategy calculation low complexity. 像素简化这一过程是基于人工视觉假体有限的刺激电极数以及射频传输的速率的考虑,图像在最终被送到电极之前,必须得到最大的简化,像素简化是其中的一个必要过程。 The process is simplified pixel artificial visual prosthesis limited rate stimulation electrode and the number of radio frequency transmission based on consideration, before the final image is supplied to the electrodes, the maximum must be simplified, a pixel which is necessary to simplify the process.

所述的针对中等复杂图像,其处理方法具体是:先将经过图像复杂度判断后的中等复杂图像进行初次像素简化,然后将初次像素简化过的图像通过最大类间距阈值化的方法来产生二值图像,并进行信息提取,信息提取时采用四方向的边缘提取算法;再对信息提取后的图像进行图像修补,这一过程是为较复杂的图像而设的,主要是运用膨胀、腐蚀形态学图像处理方法;最后将形态学处理后的图像进行再次像素简化,使图像的像素简化到所要求的像素水平,得到最终结果。 The medium for the complex image processing method which is specifically: after the first image is moderately complex image complexity is determined for the initial pixel simplified, and the first pixel image through simplified by generating two largest class distance thresholding method a four-direction-value image, and information extraction, the edge information extraction extraction algorithm; then the image information extracting an image patch, the process is more complex set of images, mainly the use of expansion, corrosion configuration image processing method; Finally, the image pixels morphological processing again simplified, simplification of the pixel image the pixel to the desired level to obtain a final result.

所述的针对复杂图像,其处理方法具体是:先将图像内所关注的区域作为目标进行定位,然后对所定位的图像进行图像细化,主要通过数字放大的方法,从而将复杂图像转换成中等复杂图像,再采取针对中等复杂图像图像处理策略进行图像处理,得到最终结果。 The complex image for which processing method is specifically: the first image region of interest as a target position, then the image of the located image thinning, primarily through digital amplification method, so that the complex image into moderately complex image, and then take a moderately complex image processing for image processing strategy, to get the final result.

本发明系统实现简单,功能完备,可用于视觉假体图像处理的研究开发,为人工视觉假体的产业化奠定了基础。 The inventive system simple, fully functional, can be used for research and development of visual prostheses image processing, laid the foundation for the industrialization of artificial vision prostheses.

Claims (10)

1、一种视觉假体图像处理装置,包括图像采集模块、无线传输模块和图像处理模块,这三个模块依次连接,其特征在于: 所述图像采集模块是一个CMOS数字图像传感器,该CMOS数字图像传感器将获取的图像信息转换成数字模式; 所述无线传输模块负责图像采集模块与图像处理模块的通讯,该无线传输模块将图像采集模块采集到的图像信息传输到图像处理模块; 所述图像处理模块对获取的图像进行图像信息预校正,改善图像质量,然后采用视频数字信号处理芯片进行图像信息简化、增强、编码处理,使获取的图像信息转化为视觉系统能接受的脉冲激励模式以提供给体内刺激模块,并通过高级精简指令集微处理器来控制图像处理模块中图像信息的传输,通过手动调节电路为用户提供自我调节的功能,使用户自行调节图像的亮度、对比度以及图像编码码 1, a visual prosthetic image processing apparatus includes an image acquisition module, a wireless transmission module and an image processing module, which is in turn connected to three modules, wherein: said image acquisition module is a digital CMOS image sensor, the CMOS digital the image sensor converts the acquired image information into digital mode; wireless transmission module is responsible for the communication image acquisition module and the image processing module, the wireless transmission module to the image acquisition module of the image information to the image processing module; the image pulsed excitation mode processing module of the image acquisition of the image information of the pre-correction, to improve image quality, and then using digital video signal processing chip image information reduction, enhancement, coding processing, the image information acquired into the visual system acceptable to provide for in vivo stimulation module, to control the transmission of image information and image processing module, by manually adjusting the circuit to provide a self-regulating function of the user so that the user adjust itself brightness, contrast and image encoded code advanced reduced instruction set microprocessor .
2、 根据权利要求1所述的视觉假体图像处理装置,其特征是,所述图像处理模块包括视频数字信号处理芯片、高级精简指令集微处理器、同步动态存储器、 闪速存储器、专用信息存储器、校正处理电路、手动调节电路、电源管理装置,其中:视频数字信号处理芯片对同步动态存储器中的图像信息进行简化、增强、 编码处理,经信息简化、图像增强处理后的图像信息存放在同步动态存储器中, 经编码处理后的图像编码信息存放在专用信息存储器中;高级精简指令集微处理器与视频数字信号处理芯片相互连接并通讯,并与同步动态存储器、校正处理电路、手动调节电路、数据发送接口、数据接收接口连接,负责控制信息的传输以及调控校正处理电路、手动调节电路;校正处理电路对同歩动态存储器中存放的原始图像信息进行图像校正,改善图像质量 2. The visual prosthesis of the image processing apparatus as claimed in claim 1, wherein the image processing module comprises a digital video signal processing chip, Advanced RISC microprocessor, a synchronous dynamic memory, flash memory, specific information a memory, the correction processing circuit, manual adjustment circuit, a power management apparatus, wherein: the digital video signal processing chip of the image information synchronous dynamic memory is simplified, enhanced encoding process, the information reduction, image enhancement, image information processing is stored in synchronous dynamic memory, the encoded image coding process information is stored in the private information memory; advanced RISC microprocessor with the digital video signal processing chip are connected to each other and the communication, and the synchronous dynamic memory, the correction processing circuit, manual adjustment circuit, a data transmission interface, the data receiving interface is responsible for the regulation of transmission of control information and correction processing circuit, manual adjustment circuit; correction processing circuit of the original image information stored in the same memory ho dynamic image correction, image quality is improved 手动调节电路与高级精简指令集微处理器相连接,对图像的亮度、对比度以及图像编码码率进行调节;电源管理装置为视频数字信号处理芯片、高级精简指令集微处理器、校正处理电路、手动调节电路提供工作电压。 Manually adjusting circuit Advanced RISC microprocessor and connected, brightness, contrast image and an image encoding bit rate is adjusted; power management device is a digital video signal processing chip, Advanced RISC microprocessor, a correction processing circuit, manually operating voltage regulating circuit.
3、 根据权利要求2所述的视觉假体图像处理装置,其特征是,所述视频数字信号处理芯片读取专用信息存储器中的从体内电极刺激模块反馈回来的信息,并进行调整;读取专用信息存储器中的经过校正处理电路处理好的图像校正信息,调整前端图像采集模块的控制参数;接受手动调节电路的调节信号并进行处理;与高级精简指令集微处理器相互连接并通讯,高级精简指令集微处理器控制图像信息输入输出视频数字信号处理芯片。 3, visual prosthesis of the image processing apparatus according to claim 2, characterized in that said digital video signal processing chip dedicated read information from the feedback information in the memory module back electrode stimulation in vivo, and adjusted; reading specific information memory processing circuit good corrected image correction information, a control parameter adjustment of the front end of the image acquisition module; manual adjustment signal conditioning circuit receiving and processing; advanced RISC microprocessor and connected to each other and communication, advanced RISC microprocessor controls the image information input-output digital video signal processing chip.
4、 根据权利要求2或3所述的视觉假体图像处理装置,其特征是,所述高级精简指令集微处理器,与数字信号处理芯片相互连接并通讯,并与同步动态存储器、校正处理电路、手动调节电路、数据发送接口、数据接收接口连接,高级精简指令集微处理器负责控制存储在专用信息存储器中的图像编码信息通过数据发送接口传输到后面的射频传输模块从而传向体内的电极刺激模块,以及控制后端电极刺激器模块反馈回来的信息通过数据接收接口输入图像处理模块存放到专用信息存储器内供视频数字信号处理芯片读取,并起到控制校正处理电路、 响应手动调节电路从而进行调控的作用。 4. The visual prosthesis of claim 2 or the image processing apparatus according to claim 3, characterized in that, the advanced reduced instruction set microprocessor, connected to communicate with each other and with a digital signal processing chip, and the synchronous dynamic memory, the correction processing circuit, manual adjustment circuit, a data transmission interface, the data receiving interface, advanced RISC microprocessor responsible for controlling image encoding information stored in the private information memory interface transfer to a subsequent radio frequency transmission module thus transmitted via the data transmission into the body electrode stimulation module, and the rear end of the control information fed back electrode stimulator module receives data through an input interface to the image processing module specific information stored in the memory for reading the video digital signal processing chip, and controls the correction processing circuit functions, in response to manual adjustment circuit acts so regulated.
5、 根据权利要求2所述的视觉假体图像处理装置,其特征是,所述同步动态存储器,与视频数字信号处理芯片、高级精简指令集微处理器、校正处理电路连接,用来存储图像采集模块获取的图像信息以及经过视频数字信号处理芯片图像简化、图像增强处理后的图像信息;所述闪速存储器,与视频数字信号处理芯片连接,存储用于人工视觉假体图像处理策略的程序以及视频数字信号处理芯片对CMOS数字图像传感器、手动调节电路、校正处理电路的控制程序;所述专用信息存储器,按照地址的不同存储不同信息,分别为经校正处理电路修正后的图像信息、经视频数字信号处理芯片处理后的图像编码信息、体内刺激电极的反馈信息。 5. The visual prosthesis of claim image processing apparatus according to claim 2, wherein said synchronous dynamic memory, the digital video signal processing chip, advanced reduced instruction set microprocessor, the correction processing circuit, for storing the image acquisition module acquires image information and digital video signal through a simplified image processing chip, image enhancement image information processing; the flash memory chip is connected to the digital video signal, storing the prosthesis artificial vision image processing policy program and digital video signal processing chip for digital CMOS image sensor, manual adjustment circuit, the correction processing circuit of the control program; the specific information memory, different information is stored in different addresses, respectively, the image information corrected by the correction processing circuit by encoding the video image information after processing a digital signal processing chip, feedback vivo stimulation electrodes.
6、 根据权利要求2所述的视觉假体图像处理装置,其特征是,所述校正处理电路,连接专用信息存储器、高级精简指令集微处理器、同步动态存储器,起到改善图像质量的作用,它对同步动态存储器中存放的原始图像信息进行图像校正,校正后的图像信息参数存储到专用信息存储器内供视频数字信号处理芯片读取,高级精简指令集微处理器调用同步动态存储器中存放的原始图像信息输入校正处理电路,校正处理电路对其进行图像校正,修正后的图像参数输入专用信息存储器,视频数字信号处理芯片将专用信息存储器中存放的校正后的图像参数信息和同步动态存储器中存放的原始图像信息进行比较,如果存在差异,视频数字信号处理芯片与图像传感器通讯,调整图像采集模块的采集参数,并控制图像传感器重新采集图像信息;所述的手动调节电路接 6, visual prosthesis according to claim image processing apparatus according to claim 2, wherein the correction processing circuit, connected to the private information memory, Advanced RISC microprocessor, a synchronous dynamic memory, functions of improving image quality , its original image information stored in the memory synchronous dynamic image correction, the corrected image information stored in the parameter storage for digital video signal processing chip to read the specific information memory, advanced RISC microprocessor calls synchronous dynamic memory the original image information input correction processing circuit, the correction circuit is subjected to image correction processing, the image correction parameter information memory dedicated input, the digital video signal processing chip dedicated image correction parameter information stored in the memory information and synchronization dynamic memory stored original image information is compared, if there is a difference, the digital video signal processing chip communication with the image sensor, to adjust the image acquisition parameters acquisition module, controls the image sensor and image information acquired again; the regulating circuit connected manually 用户的手动调节的指令,手动调节包括对图像亮度、对比度以及图像编码码率的调节,手动调节电路与高级精简指令集微处理器相连接,外设按钮输入调节信息进入手动调节电路,手动调节电路处理后将调节信号输送给高级精简指令集微处理器,高级精简指令集微处理器与视频数字信号处理芯片通信使视频数字信号处理芯片按照调节信号对图像进行调节。 User's instruction manual adjustment, manual adjustment comprises adjusting the image brightness, contrast, and an image encoding bit rate, and the manual adjusting circuit Advanced RISC microprocessor is connected to the peripheral button input adjustment information into the manual adjustment circuit, manual adjustment after adjusting circuit for processing the signal supplied to the advanced RISC microprocessor, advanced RISC microprocessors in conjunction with a communication digital video signal processing chip to make digital video signal processing chip to be adjusted as the image signal adjustment.
7、 一种视觉假体图像处理方法,其特征在于,先将获取的图像经过图像预处理过程来去除噪声,增强对比度,从而改善图像质量,经过图像预处理以后, 进行图像复杂度判断,根据图像的复杂度将图像分为三类:简单图像、中等复杂图像、复杂图像-对于简单图像,先直接将图像进行像素简化,简化所要求的像素数,然后将图像二值化,最后进行图像信息提取得出结果;对于中等复杂图像,先进行第一次像素简化,其次将图像二值化,并进行图像信息提取,然后进行图像修复,最后进行第二次像素简化,达到要求像素数, 得到处理结果;对于复杂图像,使用图像中目标的定位与局部细化,对任意给定坐标的某些区域进行数字放大,在给定像素的情况下提高对图像局部特性的识别。 7, the image processing method of the visual prosthesis, characterized in that the first image acquired after the image pre-processing to remove noise, enhance the contrast, thereby improving the image quality after the image after preprocessing, image complexity is determined according to complexity of the picture image is divided into three categories: a simple image, an image moderately complex, a complex image - for simple images, the first image pixel directly simplified, the number of pixels required simplified, and the binarized image, the final image information extraction results obtained; for medium complexity image, to pixels for the first time a simplified, followed by the binarized image, and extracting the image information and an image repair, and finally to simplify the second sub-pixel, the number of pixels to meet the requirements, obtain a processing result; complex image, using the image of the target location and locally refined, certain areas of the coordinates of any given digital zoom, an image recognition to improve local properties in the case where a given pixel.
8、 根据权利要求7所述的视觉假体图像处理方法,其特征是,所述的针对简单图像,其处理方法具体是:先将经过图像复杂度判断分类后的简单图像进行像素简化,直接像素简化到所要求的像素水平,然后将简化过的图像通过最大类间距阈值化的方法来产生二值图像,从而减少后续图像处理算法的计算复杂度, 再对图像进行信息提取,信息提取时采用四方向的边缘提取算法,最后得到处理结果,这种图像处理策略的计算复杂度很低,像素简化这一过程是基于人工视觉假体有限的刺激电极数以及射频传输的速率的考虑,图像在最终被送到电极之前,必须得到最大的简化,像素简化是其中的一个必要过程。 8, visual prosthesis according to claim image processing method according to claim 7, characterized in that, for the simple image processing method which specifically is: first determines the complexity of the image through a simple image after pixel classification simplified, direct when the pixel reduced to the pixel level required, then a simplified through image to produce a binary image by the maximum class distance thresholding method, thereby reducing the computational complexity of subsequent image processing algorithms, and then the image information extraction, the information extraction a four-direction edge extraction algorithm, to give the final processing result, such image processing strategy calculation complexity is very low, the process is simplified pixel artificial visual prosthesis limited rate stimulation electrode and the number of radio frequency transmission based on consideration, the image before being sent to the final electrode, the maximum must be simplified, a pixel which is necessary to simplify the process.
9、 根据权利要求7所述的视觉假体图像处理方法,其特征是,所述的针对中等复杂图像,其处理方法具体是:先将经过图像复杂度判断后的中等复杂图像进行初次像素简化,然后将初次像素简化过的图像通过最大类间距阈值化的方法来产生二值图像,并进行信息提取,信息提取时采用四方向的边缘提取算法;再对信息提取后的图像进行图像修补,这一过程是为较复杂的图像而设的,是运用膨胀、腐蚀形态学图像处理方法;最后将形态学处理后的图像进行再次像素简化, 使图像的像素简化到所要求的像素水平,得到最终结果。 9, the visual prosthesis according to claim image processing method according to claim 7, characterized in that said complex medium for image processing method which is specifically: after the first image is moderately complex image complexity is determined for the initial pixel simplified , then the first pixel simplified through the image produced by the maximum class distance thresholding method of binary image, and information extraction, four-direction when the information extracting an edge extraction algorithm; and then the image information extract an image patch, this process is more complex set of images, is the use of expansion, corrosion morphological image processing method; Finally, the image pixels morphological processing again simplified, the pixel image is reduced to the desired level of the pixel, to give Final Results.
10、根据权利要求7所述的视觉假体图像处理方法,其特征是,所述的针对复杂图像,其处理方法具体是:先将图像内所关注的区域作为目标进行定位,然后对所定位的图像进行图像细化,通过数字放大的方法,从而将复杂图像转换成中等复杂图像,再采取针对中等复杂图像图像处理策略进行图像处理,得到最终结果。 10, visual prosthesis according to claim image processing method according to claim 7, wherein said complex images for which specific processing method is: first region of interest within the image as the target position, then the located image thinning the image by digital amplification method, thereby converting the image into a complex medium complexity image, then performs image processing to take moderately complex image processing strategy, the final result.
CN 200810034286 2008-03-06 2008-03-06 Visual sense prosthesis image processing device and method CN100586403C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200810034286 CN100586403C (en) 2008-03-06 2008-03-06 Visual sense prosthesis image processing device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200810034286 CN100586403C (en) 2008-03-06 2008-03-06 Visual sense prosthesis image processing device and method

Publications (2)

Publication Number Publication Date
CN101239008A CN101239008A (en) 2008-08-13
CN100586403C true CN100586403C (en) 2010-02-03

Family

ID=39931030

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200810034286 CN100586403C (en) 2008-03-06 2008-03-06 Visual sense prosthesis image processing device and method

Country Status (1)

Country Link
CN (1) CN100586403C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI451863B (en) * 2010-11-06 2014-09-11 Nat Univ Tsing Hua Retina stimulation apparatus and a manufacturing method thereof

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2013113921A (en) 2010-08-31 2014-10-10 Корнелл Юнивёрсити Prosthesis retina
AU2011220367B2 (en) 2010-02-26 2016-05-12 Cornell University Retina prosthesis
CN101879348A (en) * 2010-06-18 2010-11-10 中国人民解放军第三军医大学第一附属医院 Visual function restoration system based on external electrical stimulation by endocranium
US9302103B1 (en) 2010-09-10 2016-04-05 Cornell University Neurological prosthesis
US9547804B2 (en) 2011-08-25 2017-01-17 Cornell University Retinal encoder for machine vision
CN102813999B (en) * 2012-08-10 2015-06-17 上海交通大学 Visual prosthesis wireless transmission system with self-adaptive power regulation function and visual prosthesis wireless transmission method
CN104825248B (en) * 2015-05-25 2016-09-28 浙江诺尔康神经电子科技股份有限公司 An artificial retina system
CN106385536A (en) * 2016-09-19 2017-02-08 清华大学 Binocular image collection method and system for visual prosthesis
CN106137532B (en) * 2016-09-19 2019-01-25 清华大学 A kind of image processing method
CN109224291A (en) * 2017-12-29 2019-01-18 深圳硅基仿生科技有限公司 The image processing method and device and retina stimulator of retina stimulator

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1895188A (en) 2006-06-22 2007-01-17 上海交通大学 Intra-ocular camera head for visual prosthesis
CN1961850A (en) 2006-12-07 2007-05-16 上海交通大学 Implantable vision prosthesis
CN101017535A (en) 2007-03-08 2007-08-15 上海交通大学 Implementation method of retina encoder using space time filter

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1895188A (en) 2006-06-22 2007-01-17 上海交通大学 Intra-ocular camera head for visual prosthesis
CN1961850A (en) 2006-12-07 2007-05-16 上海交通大学 Implantable vision prosthesis
CN101017535A (en) 2007-03-08 2007-08-15 上海交通大学 Implementation method of retina encoder using space time filter

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
视觉假体的发展与研究. 李莹辉,吴开杰,柴新禹,任秋实.中国医学物理学杂志,第24卷第5期. 2007

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI451863B (en) * 2010-11-06 2014-09-11 Nat Univ Tsing Hua Retina stimulation apparatus and a manufacturing method thereof

Also Published As

Publication number Publication date
CN101239008A (en) 2008-08-13

Similar Documents

Publication Publication Date Title
AU785210B2 (en) Totally implantable hearing system
KR101356358B1 (en) Computer-implemented method and apparatus for biometric authentication based on images of an eye
US6993200B2 (en) System and method for effectively rendering high dynamic range images
JP4574249B2 (en) The image processing apparatus and method, a program, an imaging apparatus
DE69931761T3 (en) visual prosthesis
EP1145734B1 (en) At least partially implantable system for the rehabilitation of a hearing disorder
US20110202111A1 (en) Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
JP4136666B2 (en) Artificial eye system
US7962221B2 (en) Pixel re-mapping for visual prosthesis
DE10031832C2 (en) Hearing aid for rehabilitation of a hearing disorder
US7242985B1 (en) Outer hair cell stimulation model for the use by an intra—cochlear implant
CN1787012A (en) Method,apparatua and computer program for processing image
DE60125716T2 (en) Cochlear implant system with the external ear einsetzbarem part
CA2222741A1 (en) Multi-phasic microphotodiode retinal implant and adaptive imaging retinal stimulation system
WO2002064205A3 (en) Multi-electrode apparatus and method for treatment of congestive heart failure
CN1422596A (en) Eye position detection method and apparatus thereof
US8428740B2 (en) Retinal prosthesis techniques
US10303970B2 (en) Retinal encoder for machine vision
DE10018361C2 (en) At least partially implantable cochlear implant system for rehabilitation of a hearing disorder
DE102005032989A1 (en) Extraocular Epiretinal implant
US9907969B2 (en) Retinal prosthesis with an external power source
EP2706957B1 (en) Retinal prosthesis
DE10015421A1 (en) Partially or fully implantable hearing system for correcting hearing disorders has a unit for electromagnetic stimulation of the middle or inner ear and direct electrical stimulation of the inner ear.
CA2639889A1 (en) Charge-integrating retinal prosthesis and method
EP1648156A3 (en) Adaptive contrast enhancement

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model
CF01