CN102813574B - Visual prosthesis image acquisition device on basis of eye tracking - Google Patents
Visual prosthesis image acquisition device on basis of eye tracking Download PDFInfo
- Publication number
- CN102813574B CN102813574B CN201210275805.8A CN201210275805A CN102813574B CN 102813574 B CN102813574 B CN 102813574B CN 201210275805 A CN201210275805 A CN 201210275805A CN 102813574 B CN102813574 B CN 102813574B
- Authority
- CN
- China
- Prior art keywords
- eye movement
- photographic head
- eyeball
- processing module
- collecting device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a visual prosthesis image acquisition device which comprises an eye movement acquiring and processing module, a camera and a rotating cradle head. The eye movement acquiring and processing module is used for acquiring an eye movement signal of an eyeball and sending a control signal according to the signal to control the rotation of the rotating cradle head so as to ensure the camera fixed on the rotating cradle head to turn to the rotation direction of the eyeball and acquire an image in the direction, wherein the eye movement acquiring and processing module comprises an eye movement camera for shooting a video of movement of a pupil of the eyeball and an eye movement video receiving and processing unit for receiving the video and acquiring the rotation direction of the eyeball by the video. According to the invention, by acquiring the rotation direction of the eyeball in real time so as to control the rotating cradle head to drive the camera to turn to the direct and acquire the image in the direction, the biomimetics on human vision and eye movement functions is well implemented, so that a user acquires the prosthesis visual experience closer to the normal vision.
Description
Technical field
The present invention relates to biomedical engineering field, relate in particular to a kind of image collecting device for vision prosthesis based on eye-tracking.
Background technology
Vision prosthesis is a kind of implanted medical electronic apparatus, can recover to a certain extent the blind patient's of severe vision.It utilizes most of blind patients often to only have the part generation pathological changes of pathways for vision, and the 26S Proteasome Structure and Function of remainder nervous tissue intact feature still, intact position to pathways for vision applies specific artificial electrical stimulation, carry out excitatory cell, the effect of simulating nature photostimulation, allows user produce visual experience.Vision prosthesis system generally includes the microelectrode array that is positioned at the external image collecting device of user (being generally minisize pick-up head), image processing apparatus, electricity irritation code device and implants user body (being generally visual system), by the external image information that image collecting device is obtained, process, encode, and by microelectrode array, visual system is stimulated, thereby the visual cortex at user produces vision, allows user recover lost eyesight.
Usually, the visual angle of the field range of normal person's uniocular vision is approximately 60 °, lower 75 °, outer 95 ° and interior 60 °, 135 ° * 155 ° (height * field range of field range wide), and the visual angle of the field range of stereopsis vision can reach 135 ° * 190 ° especially.In addition, normal person's visual focus in field range corresponding to macular area, approximately 20 ° * 20 °, visual angle now.If there is within sweep of the eye other event arousing attention, normal person can make Rotation of eyeball by controlling eye muscle, makes this attention region drop on macular area within sweep of the eye corresponding.
At present, the photographic head angular field of view for image acquisition in vision prosthesis only has 40 ° * 40 ° left and right, much smaller than the field range of normal person's uniocular vision.Therefore if photographic head is fixed on the mirror holder that user wears, user need obtain the different images of noting region by rotation head or health, and this has increased the use burden of user.Visible, the vision prosthesis of prior art is not realized bionical to human eye vision and eye movement function well, can not make full use of human eye by eye movement the physiological characteristics to target fast search, location.
Blind patient's eye muscle and the nerve of control eye muscle of considering retinopathy are probably intact, and implant the nerve that vision prosthesis can not damage eye muscle and control eye muscle, so patient still has the oculogyral ability of controlling.Rotation due to human eye has concertedness in addition, and two can turn to target to note region simultaneously, so even the nerve of eye muscle and control eye muscle is caused to certain damage in the process of implantation vision prosthesis, opposite side eyeball still has intact eye movement ability.
Therefore, those skilled in the art is devoted to develop a kind of image collecting device of vision prosthesis, and the eye movement signal based on user is realized the positioning acquisition to target image.
Summary of the invention
Because the above-mentioned defect of prior art, technical problem to be solved by this invention is to provide a kind of image collecting device of vision prosthesis, by gathering the eye movement signal of user, the photographic head of controlling image collecting device turns to the direction of target, gathers target image.
For achieving the above object, the invention provides a kind of image collecting device of vision prosthesis, it is characterized in that, comprise eye movement signals collecting and processing module, photographic head and rotary platform; Described eye movement signals collecting and processing module gather the eye movement signal of eyeball, according to the rotation direction of eyeball described in described eye movement signal acquisition, and send control signal to control the rotation of described rotary platform, make to be fixed on the image that described photographic head on described rotary platform turns to the described rotation direction of described eyeball and gathers described rotation direction.
Further, eye movement signals collecting and processing module comprise eye movement photographic head and eye movement video reception and processing unit; The process that described eye movement signals collecting and processing module gather the described eye movement signal of described eyeball is the video that described eye movement photographic head is taken the pupil of described eyeball; Described eye movement signals collecting and processing module are the described video of described eye movement video reception and the processing unit described pupil that receives described eyeball by the described rotation direction of eyeball described in described video acquisition according to the process of the described rotation direction of eyeball described in described eye movement signal acquisition.
Further, described eye movement signals collecting and processing module also comprise that LED unit is to throw light on to described pupil.
Further, described LED unit comprises at least one LED, and the luminous intensity of described LED unit is not less than 400mcd.
Further, described eye movement signals collecting and processing module and described rotary platform are fixed on glasses; Described eye movement photographic head is arranged on an eyeglass of described glasses, and described eye movement video reception and processing unit are arranged on the leg of spectacles of described glasses, described leg of spectacles and described eyeglass homonymy or not homonymy; Described rotary platform is arranged on described nosepiece frame.
Further, on described glasses, be also provided with power supply with to described eye movement signals collecting and processing module and the power supply of described photographic head.
Further, described glasses are sunglasses.
Further, the external diameter of described eye movement photographic head is not more than 8mm and described eye movement photographic head possesses micro-focal length shoot function.
The operating lag of the described control signal that further, the described rotation of described rotary platform is sent for described eye movement signals collecting and processing module is in millisecond magnitude.
Further, the external diameter of described photographic head is not more than 12mm, and the visual angle of described photographic head is not less than 30 °, and the frame per second of described photographic head is not less than 24fps.
In better embodiment of the present invention, the image collecting device of vision prosthesis of the present invention is arranged on the sunglasses that blind patient wears, and comprises eye movement signals collecting and processing module, photographic head and rotary platform.Photographic head is fixed on rotary platform, and rotary platform is arranged on the nose-bridge frame of sunglasses, and photographic head outward.Eye movement signals collecting and processing module comprise eye movement photographic head, LED unit, eye movement video reception and processing unit and data wire.Eye movement photographic head and LED unit are arranged on an eyeglass of sunglasses, and eye movement photographic head is towards interior.During use, blind patient wears this sunglasses, and after power-on, the image collecting device of vision prosthesis of the present invention starts working.Eye movement photographic head is enabled micro-focal length shoot function, and the video of the movement of this pupil is also taken in the pupil position of the eyeball of the user of automatically focusing.Eye movement photographic head sends eye movement video reception and processing unit the video of taking in real time by data wire, eye movement video reception and processing unit are analyzed this video, from the situation of movement of pupil, obtain the rotation direction of eyeball and send corresponding control signal to rotary platform.Rotary platform rotates after receiving this control signal, drives photographic head to turn to together this direction.Photographic head just can collect the image of this direction thus.
As can be seen here, the image collecting device of vision prosthesis of the present invention drives photographic head to turn to the party always to gather the image of this direction by the oculogyral direction of Real-time Obtaining and then control rotary platform, make photographic head can obtain more wide than fixed shooting of the prior art first watch, close to the field range of human eye, and can make full use of human eye by eye movement the physiological characteristics to target fast search, location, realize well bionical to human eye vision and eye movement function, make user obtain the prosthese visual experience that more approaches normal vision.What the present invention adopted is the acquisition method of the eye movement signal of non-intrusion type, can obtain rapidly and accurately the eye movement signal of user.The light portable of image collecting device of vision prosthesis of the present invention, can make user obtain good experience.
Below with reference to accompanying drawing, the technique effect of design of the present invention, concrete structure and generation is described further, to understand fully object of the present invention, feature and effect.
Accompanying drawing explanation
Fig. 1 is the structural representation of the image collecting device of vision prosthesis of the present invention.
Fig. 2 is the eye movement photographic head of image collecting device of the vision prosthesis shown in Fig. 1 and the structural representation of the amplification of LED cell mesh.
Fig. 3 is the photographic head of image collecting device of the vision prosthesis shown in Fig. 1 and the structural representation of the amplification of rotary platform part.
The specific embodiment
As Figure 1-3, in one embodiment of the invention, the image collecting device of vision prosthesis of the present invention is arranged on the sunglasses that blind patient wears, and comprises eye movement signals collecting and processing module, photographic head 20 and rotary platform 30.Wherein, photographic head 20 is fixed on rotary platform 30, and rotary platform 30 is arranged on the nose-bridge frame 53 of sunglasses.Photographic head 20 is (towards the direction of leaving the patient who wears these sunglasses) outward, and rotary platform 30 receives the concurrent life of control signal of being sent by eye movement signals collecting and processing module and rotates accordingly, and it will drive photographic head 20 to rotate together while rotating.
Eye movement signals collecting and processing module comprise eye movement photographic head 11, LED unit 12, eye movement video reception and processing unit 13 and data wire 14.Wherein, eye movement photographic head 11 and LED unit 12 are arranged on an eyeglass 51 of sunglasses, and eye movement photographic head 11 can make the video of movement of the pupil of its eyeball that collects the user of wearing these sunglasses towards interior (towards the direction of wearing the patient of these sunglasses) and the position of eye movement photographic head 11 on eyeglass 51.Can be by beat a plurality of holes on eyeglass 51, use securing member or binding agent eye movement photographic head 11 and LED unit 12 to be fixed on the position in these holes and realize eye movement photographic head 11 and LED unit 12 fixing on eyeglass 51.Preferably, eye movement photographic head 11 is arranged on eyeglass 51 places, centre position.It is other that LED unit 12 is arranged on eye movement photographic head 11, with the position of in needs, eye movement photographic head 11 being taken, throws light on.In the present embodiment, LED unit 12 is arrays that 6 LED form, and this array is evenly distributed on eyeglass 51 around eye movement photographic head 11.In other embodiments of the invention, LED unit 12 can be also single LED, or the array of a plurality of LED formation.Eye movement video reception and processing unit 13 are arranged on the earpiece 52 of sunglasses, and the video of the movement of the pupil that photographic head 11 collects is sent to eye movement video reception and processing unit 13 processed by data wire 14.In the present embodiment, earpiece 52 and eyeglass 51 homonymy (right sides of sunglasses as shown in Figure 1, 2) in these sunglasses, but in other embodiments of the invention, also can make to be provided with the earpiece of eye movement video reception and processing unit 13 and the not homonymy of the eyeglass of eye movement photographic head 11 and LED unit 12 in sunglasses is installed, as long as data wire is set suitably, to realize the video of the movement of the pupil that photographic head 11 is collected, being sent to eye movement video reception and processing unit 13.
On earpiece 52, be also provided with power supply 40, with the eye movement photographic head 11 to eye movement signals collecting and processing module, LED unit 12, eye movement video reception and processing unit 13 and photographic head 20 power supplies.
In the present embodiment, the external diameter of photographic head 20 is not more than 12mm, and the visual angle of photographic head 20 is not less than 30 °, and the frame per second of photographic head 20 is not less than 24fps.The external diameter of eye movement photographic head 11 is not more than 8mm, and eye movement photographic head 11 possesses micro-focal length shoot function.The luminous intensity of LED unit 12 is not less than 400mcd.Rotary platform 30 is rotary platforms of various dimensions, its rotate dimension be not less than left 45 °, be to the right not less than 45 °, be upwards not less than 30 °, be not less than 30 ° downwards, its receive the corresponding rotation that occurs after the control signal that eye movement signals collecting and processing module send for the operating lag of this control signal in millisecond magnitude.
When using the image collecting device of vision prosthesis of the present invention, blind patient wears the sunglasses of the image collecting device that is provided with vision prosthesis of the present invention, and after power-on 40, the image collecting device of vision prosthesis of the present invention starts working.Eye movement photographic head 11 is enabled micro-focal length shoot function, automatically focusing is to the pupil position of the eyeball of eyeglass 51 corresponding user, the automatic focusing of eye movement photographic head 11 of the present embodiment is as shown in Figure 1, 2 to the pupil position of the right eye of user, then take the video of the movement of this pupil, gather the mobile message of this pupil to obtain the eye movement signal of this eyeball.
Eye movement photographic head 11 sends eye movement video reception and processing unit 12 the video of the movement of the pupil of taking in real time by data wire 14.Eye movement video reception and processing unit 12 comprise microprocessor, so that the video receiving is analyzed, from the rotation direction of the mobile information acquisition eyeball of pupil.Eye movement video reception and processing unit 12 can judge ambient brightness, in the situation that ambient brightness is darker, eye movement video reception and processing unit 12 send control signal and throw light on to open the shooting position (being pupil) of the 12 pairs of eye movement photographic head 11 in LED unit to LED unit 12 by data wire 14; In the good situation of ambient brightness, do not need to open LED unit 12.
Eye movement video reception and processing unit 12 are determined the rotation direction of photographic head 20 and send corresponding control signal to rotary platform 30 according to the rotation direction of the eyeball obtaining, rotary platform 30 rotates after receiving this control signal, drives photographic head 20 to turn to together this direction.Photographic head 20 just can gather the image of this direction like this, then this image is sent to the image processing apparatus of vision prosthesis, makes user produce the prosthese vision about this image.
More than describe preferred embodiment of the present invention in detail.Should be appreciated that those of ordinary skill in the art just can design according to the present invention make many modifications and variations without creative work.Therefore, all those skilled in the art, all should be in the determined protection domain by claims under this invention's idea on the basis of existing technology by the available technical scheme of logical analysis, reasoning, or a limited experiment.
Claims (9)
1. an image collecting device for vision prosthesis, is characterized in that, comprises eye movement signals collecting and processing module, photographic head and rotary platform; Described eye movement signals collecting and processing module gather the eye movement signal of eyeball, according to the rotation direction of eyeball described in described eye movement signal acquisition, and send control signal to control the rotation of described rotary platform, make to be fixed on the image that described photographic head on described rotary platform turns to the described rotation direction of described eyeball and gathers described rotation direction;
Described eye movement signals collecting and processing module comprise eye movement photographic head and eye movement video reception and processing unit; The process that described eye movement signals collecting and processing module gather the described eye movement signal of described eyeball is the video that described eye movement photographic head is taken the pupil of described eyeball; Described eye movement signals collecting and processing module are the described video of described eye movement video reception and the processing unit described pupil that receives described eyeball by the described rotation direction of eyeball described in described video acquisition according to the process of the described rotation direction of eyeball described in described eye movement signal acquisition.
2. the image collecting device of vision prosthesis as claimed in claim 1, wherein said eye movement signals collecting and processing module also comprise that LED unit is to throw light on to described pupil.
3. the image collecting device of vision prosthesis as claimed in claim 2, wherein said LED unit comprises at least one LED, the luminous intensity of described LED unit is not less than 400mcd.
4. the image collecting device of the vision prosthesis as described in any one in claim 1 to 3, wherein said eye movement signals collecting and processing module and described rotary platform are fixed on glasses; Described eye movement photographic head is arranged on an eyeglass of described glasses, and described eye movement video reception and processing unit are arranged on the leg of spectacles of described glasses, described leg of spectacles and described eyeglass homonymy or not homonymy; Described rotary platform is arranged on described nosepiece frame.
5. the image collecting device of vision prosthesis as claimed in claim 4, is also provided with power supply with to described eye movement signals collecting and processing module and the power supply of described photographic head on wherein said glasses.
6. the image collecting device of vision prosthesis as claimed in claim 5, wherein said glasses are sunglasses.
7. the image collecting device of vision prosthesis as claimed in claim 6, the external diameter of wherein said eye movement photographic head is not more than 8mm and described eye movement photographic head possesses micro-focal length shoot function.
8. the image collecting device of vision prosthesis as claimed in claim 7, the operating lag of the described control signal that the described rotation of wherein said rotary platform is sent for described eye movement signals collecting and processing module is in millisecond magnitude.
9. the image collecting device of vision prosthesis as claimed in claim 8, the external diameter of wherein said photographic head is not more than 12mm, and the visual angle of described photographic head is not less than 30 °, and the frame per second of described photographic head is not less than 24fps.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210275805.8A CN102813574B (en) | 2012-08-03 | 2012-08-03 | Visual prosthesis image acquisition device on basis of eye tracking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210275805.8A CN102813574B (en) | 2012-08-03 | 2012-08-03 | Visual prosthesis image acquisition device on basis of eye tracking |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102813574A CN102813574A (en) | 2012-12-12 |
| CN102813574B true CN102813574B (en) | 2014-09-10 |
Family
ID=47298268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210275805.8A Active CN102813574B (en) | 2012-08-03 | 2012-08-03 | Visual prosthesis image acquisition device on basis of eye tracking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102813574B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105141331B (en) * | 2012-12-22 | 2019-08-27 | 华为技术有限公司 | A kind of spectacle type communication device, system and method |
| CN103903279B (en) * | 2014-03-21 | 2017-07-25 | 上海大学 | Parallel Tracking System and method for based on bionic binocular vision airborne platform |
| CN104036668A (en) * | 2014-05-15 | 2014-09-10 | 北海市鑫业智能科技有限公司 | Intelligent automobile simulating driving device |
| EP3373856B1 (en) * | 2015-11-13 | 2022-07-06 | Christopherson, Tim | Movable ocular prosthetic |
| CN105554384B (en) * | 2015-12-17 | 2019-03-19 | 上海青橙实业有限公司 | Wearable device and image pickup method |
| CN105496643B (en) * | 2016-01-18 | 2017-05-31 | 戴国群 | Acquired blindness patient visual recovers lost eyesight intelligent object wearing device and its manufacture method |
| CN110913810B (en) * | 2017-07-18 | 2022-06-17 | 极视科技(海南)有限公司 | Method for acquiring and processing artificial eye image |
| WO2019014848A1 (en) * | 2017-07-18 | 2019-01-24 | 辛特科技有限公司 | System for use in image acquisition and processing by artificial eye |
| CN109995986A (en) * | 2017-12-29 | 2019-07-09 | 北京亮亮视野科技有限公司 | Control the mobile method of intelligent glasses shooting visual angle |
| CN109498259B (en) * | 2018-11-09 | 2021-10-22 | 联想(北京)有限公司 | Treatment equipment |
| FR3089785B1 (en) * | 2018-12-17 | 2020-11-20 | Pierre Briand | Medical device to aid the perception of the environment for blind or visually impaired users |
| CN109808711B (en) * | 2018-12-25 | 2020-07-07 | 南京师范大学 | Automatic driving vehicle control method and system, automatic driving vehicle and visual prosthesis |
| CN109602587A (en) * | 2019-01-31 | 2019-04-12 | 河南云睛视光科技有限公司 | A kind of intelligent multi-function view light instrument for training |
| CN109846635B (en) * | 2019-02-20 | 2021-01-08 | 浙江强脑科技有限公司 | Nursing bed system based on glasses and brain-computer interface |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102309366A (en) * | 2011-07-21 | 2012-01-11 | 山东科技大学 | Control system and control method for controlling upper prosthesis to move by using eye movement signals |
| CN102547123A (en) * | 2012-01-05 | 2012-07-04 | 天津师范大学 | Self-adapting sightline tracking system and method based on face recognition technology |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005072667A1 (en) * | 2004-01-29 | 2005-08-11 | Konica Minolta Photo Imaging, Inc. | Vision auxiliary display unit |
-
2012
- 2012-08-03 CN CN201210275805.8A patent/CN102813574B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102309366A (en) * | 2011-07-21 | 2012-01-11 | 山东科技大学 | Control system and control method for controlling upper prosthesis to move by using eye movement signals |
| CN102547123A (en) * | 2012-01-05 | 2012-07-04 | 天津师范大学 | Self-adapting sightline tracking system and method based on face recognition technology |
Non-Patent Citations (2)
| Title |
|---|
| 基于Camshift算法的眼动跟踪系统的实现;黄春瑞等;《中国医疗器械杂志》;20090430;第33卷(第4期);第239-242页 * |
| 黄春瑞等.基于Camshift算法的眼动跟踪系统的实现.《中国医疗器械杂志》.2009,第33卷(第4期),第239-242页. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102813574A (en) | 2012-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102813574B (en) | Visual prosthesis image acquisition device on basis of eye tracking | |
| Hornig et al. | Pixium vision: first clinical results and innovative developments | |
| Stronks et al. | The functional performance of the Argus II retinal prosthesis | |
| JP5214447B2 (en) | Extraocular retina graft | |
| JP4136666B2 (en) | Artificial eye system | |
| Dowling | Current and future prospects for optoelectronic retinal prostheses | |
| Maghami et al. | Visual prostheses: The enabling technology to give sight to the blind | |
| US8265764B2 (en) | Artificial vision system | |
| Nowik et al. | Bionic eye review–An update | |
| CN107007255A (en) | Electronic type ophthalmic lens with sleep monitor | |
| CN106233328A (en) | For improving, improve or strengthen equipment and the method for vision | |
| CN103576336A (en) | Neuromuscular sensing for variable-optic electronic ophthalmic lens | |
| Benav et al. | Restoration of useful vision up to letter recognition capabilities using subretinal microphotodiodes | |
| Wang et al. | Optoelectronic devices for vision restoration | |
| Palanker et al. | Restoring sight with retinal prostheses | |
| EP2853937B1 (en) | Goggle-like mobile apparatus and method for recording images of a pupil of a person | |
| US10292579B2 (en) | Method and apparatus for fitting a visual prosthesis using electrically evoked electroretinograms | |
| CN107582022A (en) | A kind of canthus film detecting device and detection method based on mobile phone | |
| Banerjee et al. | Bionic eye-a review | |
| FR3089785A1 (en) | Medical device to aid in the perception of the environment for blind or visually impaired users | |
| Yoon et al. | Argus ii prosthetic vision | |
| Kurt et al. | Systematic Review of Novel Advances in Epiretinal and Subretinal Prosthesis | |
| CN105608426A (en) | Forest musk deer iris collection method | |
| CN106713882A (en) | Photostimulation visual restoration device and photostimulation visual imaging method | |
| Abu-Faraj et al. | A prototype retinal prosthesis for visual stimulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |