EP2012733B1 - Process and device for apportioning therapeutic vision stimuli - Google Patents
Process and device for apportioning therapeutic vision stimuli Download PDFInfo
- Publication number
- EP2012733B1 EP2012733B1 EP07759016.4A EP07759016A EP2012733B1 EP 2012733 B1 EP2012733 B1 EP 2012733B1 EP 07759016 A EP07759016 A EP 07759016A EP 2012733 B1 EP2012733 B1 EP 2012733B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- stimuli
- zone
- visual field
- human
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
- 238000000034 method Methods 0.000 title description 11
- 230000008569 process Effects 0.000 title description 3
- 230000001225 therapeutic effect Effects 0.000 title 1
- 230000000007 visual effect Effects 0.000 claims description 87
- 230000004044 response Effects 0.000 claims description 29
- 238000002560 therapeutic procedure Methods 0.000 claims description 26
- 230000007704 transition Effects 0.000 claims description 16
- 230000002207 retinal effect Effects 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 5
- 230000002093 peripheral effect Effects 0.000 claims description 4
- 230000000638 stimulation Effects 0.000 description 8
- 230000006872 improvement Effects 0.000 description 6
- 210000001525 retina Anatomy 0.000 description 6
- 210000002569 neuron Anatomy 0.000 description 5
- 230000004936 stimulating effect Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 210000004027 cell Anatomy 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 230000001537 neural effect Effects 0.000 description 3
- 206010064930 age-related macular degeneration Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000006735 deficit Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 208000002780 macular degeneration Diseases 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000004043 responsiveness Effects 0.000 description 2
- 210000000225 synapse Anatomy 0.000 description 2
- 230000008685 targeting Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 208000010412 Glaucoma Diseases 0.000 description 1
- 206010021403 Illusion Diseases 0.000 description 1
- 206010057430 Retinal injury Diseases 0.000 description 1
- 208000030886 Traumatic Brain injury Diseases 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000001054 cortical effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007971 neurological deficit Effects 0.000 description 1
- 210000001328 optic nerve Anatomy 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000007115 recruitment Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000009529 traumatic brain injury Effects 0.000 description 1
- 238000002645 vision therapy Methods 0.000 description 1
- 210000000857 visual cortex Anatomy 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H5/00—Exercisers for the eyes
Definitions
- the present invention relates to focused vision therapy and, in particular, to selectively apportioning light stimulation to different areas of a patient's visual field.
- Stimulating the vision system of human subjects with vision impairment may improve their visual performance.
- presenting visual stimuli to areas of a human's visual system may allow improvement in the user's vision.
- NovaVision of Boca Raton, FI, produces VRTTM (Visual Restoration Therapy) devices for effecting optical stimulation of defined locations of a patient's retina.
- VRTTM Visual Restoration Therapy
- a finite number of stimulation events are available. Therefore, these stimulation events should be judiciously directed to the particular visual field regions for which treatment is desired.
- VRT may be used to treat neurological deficits of the visual system of a patient. Such deficits may result from retinal damage, damage to the optic nerve, damage to the visual cortex, such as may occur due to stroke or traumatic brain injury. For example, age related macular degeneration (AMD) may be treated with VRT.
- AMD age related macular degeneration
- DE 9305147 pertains to a training device for the treatment of patients suffering from perceptual disturbances.
- US 5,539,482 relates to glaucoma testing using non-linear systems identification techniques.
- the system includes a display that has an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy.
- the system also includes an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions of the visual field.
- the system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions a greater share of stimuli to those the visual field regions nearer the center of the visual field.
- the actuator may present a fixation stimulus to the human.
- the system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli.
- the system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field.
- the retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance from the center of the human's visual field by selecting larger stimuli to target peripheral visual field regions and smaller subsets to target central visual field regions.
- a system for treating the visual system of a patient includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field.
- the system also includes an actuator for actuating display elements according to the apportionment of the apportioner.
- the apportioner apportions by using a campimetric representation of the visual field to define at least a primary zone, a secondary zone, and a remainder zone, the remainder zone comprising that portion of the visual field that is outside of the other defined zones.
- the system may include software and/or hardware for presenting a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone.
- the system may include software and/or hardware for presenting, over the course of therapy, a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone, and a greater number of stimuli to the secondary zone than to the remainder zone.
- the number of stimuli presented to the remainder zone may be non-zero.
- the system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli.
- the system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field.
- the retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance.
- the system may include software and/or hardware for using the record of the human's response to the stimuli to redefine one of the primary zone and the secondary zone.
- the system may usea change in the response with time for.a given visual field location to redefine one of the primary zone and the secondary zone.
- the zone may be automatically redefined.
- a system for treating the visual system of a patient includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field.
- the system also includes an actuator for actuating display elements according to the apportionment of the apportioner.
- the apportioner apportions by using a campimetric representation of the visual field to define at a transition zone bordered by a blind zone and an intact zone and apportion stimuli to the transition zone with a bias toward the central visual field.
- the system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to update the transition zone, for updating the transition zone using a change in the response with time for a given visual field location, and for automatically redefining the transition zone.
- an “actuator” shall mean any device capable of switching array elements so as to illuminate the retina of a patient with a given pattern and distribution of stimuli
- aspects of the present invention may solve the problems outlined above by apportioning or rationing stimuli over a course of VRT so as to optimize stimulation to obtain more significant clinical outcomes when using limited amounts of light stimuli.
- a patient will receive a finite number of stimuli. For example, a patient may receive 500-600 stimuli in a 20 to 30 minute VRT session.
- a therapist may desire to stimulate multiple visual field zones (e.g., both functionally important central areas and ARVs).
- a tradeoff must be made between the number of stimuli directed at a given zone and areal coverage.
- Illustrative embodiments of the present invention may solve some of these or other problems by dividing a therapy area into regions and applying different stimuli densities to each region. Unless otherwise indicated, the operations of the VRT systems described below may be fully automatic in the sense that the therapist need not intervene during a therapy session or even a multi-session course of therapy.
- Fig. 1 shows a flow chart in accordance with an embodiment of the invention.
- the flow chart represents a method that may be embodied in a VRT apparatus or software module for use with a VRT apparatus.
- a patient is situated in front of a display and instructed to fixate upon a fixation point or stimulus.
- the display may be a computer driven CRT, LCD, OLED, DLP, plasma display, or other such display including a head mounted display (e.g., goggles or helmet).
- the display has associated hardware for actuating subsets of individual elements of the display from a set (e.g. pixels or subsets of pixels) in order to target a specific area of the patient's retina and neuronal components of their visual field with a patterned illumination.
- the patterned illumination may be a single pixel, a contiguous subset of pixels that project a particular shape, or even a discontiguous subset of pixels.
- Targeting of the illumination pattern upon the retina may be accomplished by applying a specified offset from a point upon which the patient is instructed to fixate (i.e. a fixation point).
- a campimetric representation of the patient's visual field (a "visual field map") is obtained (step 110).
- the representation may be manifested as a multi-dimensional data set or visual field map, either as an array in computer memory, or expressed graphically.
- the campimetric representation may be the result of a previous VRT session or other campimetric activity.
- the campimetric representation may contain, as a function of position relative to the a fixation point, or in an array corresponding to pixels on a VRT display, response times, fraction of correct responses, or other data related to the sensitivity of the patient's visual field neurons to light stimuli.
- the map can be generated through subsequent steps in the process, such a those listed below.
- the campimetric representation is then used to assign the potential for a given neuron or visual field area to respond to VRT (step 120). For example, depending on the type of therapy chosen by the therapist, regions of the visual field that are partially responding, or are in a transition zone between a blind zone and an intact (i.e., seeing) zone may be indicative of a high recovery potential. Scores may be assigned based on potential. In an another example, a visual field location corresponding to a pixel element of a VRT may be assigned a low score if bounded on all sides by nonresponsive locations (i.e., blind regions), or bounded on all sides by intact regions, whereas locations bounded by both blind and intact locations, or one or more partially responding locations, may be awarded a higher scores.
- Trending data i.e. improvements or decreases in patient responses in a given visual field areas may also be used to assign priorities; e.g., stimuli may be better invested in those areas showing an improvement with time.
- the result of step 120 may be used as a priority map, which may be used to distribute (i.e., apportion) stimuli among multiple locations.
- points are awarded to each element in a two dimensional array of VRT pixel locations as follows:
- additional factors may be used to assign priorities (step 130).
- additional factors include therapist intervention, or application of additional biases, which may be arrived at by using physiological or statistical factors.
- a physiological bias is included that favors more central visual field regions over more peripheral regions so as to create a stimulus distribution that effects presentation of a larger fraction of the administered stimuli to more central regions.
- result may be desirable because more central regions of the visual field (e.g., the center 3-5°) have more neuronal synapses and are thus critical in certain key activities such as reading.
- the stimuli distribution can be tuned to match approximately the number of neuronal synapses at a given location (i.e. the cortical magnification factor) by using population-derived visual field structures, or maps of the individual patient's visual field.
- Stimuli are apportioned to the patient based on the assigned priorities by actuating the individual actuable light-emitting elements of a display device to target a specified region of the patient's visual field.
- Various techniques are available to apportion the stimuli, including:
- a patient response may be recorded; e.g., the by detection of a button actuation by the patient. Response times may also be recorded.
- Patient responses may be used to update the visual field map "in real time," i.e., prior to completion of a therapy session or course of therapy.
- the loop is closed by returning to step 110 and repeating the loop for the duration of therapy (step 160).
- derivative aspects of the patient response including temporal improvements of the patient response accuracy, response time, or threshold intensity required for a patient to see a stimulus may be utilized in setting priorities and assigning the apportioning distribution. Alternately, the loop may be closed by returning to step 140.
- the effectiveness of stimulus allocation is improved by varying the size of a stimulus according to the selected visual field location targeted by the stimulus. Because visual field resolution decreases with distance from the center of the visual field in a known way, stimulation of various neurons can be accomplished with different stimulus sizes (e.g., by altering the number of adjacent elements actuated). This approach may result in improved economies of stimulation allocation.
- a computerized VRT apparatus may use an algorithm that randomly distributes stimuli, but avoids repetitive stimulation in the same location; using larger stimuli in peripheral regions of the visual field will result in a bias in favor of the central visual field. The larger stimuli are sized so as to illuminate a larger area of the patient's retina.
- Fig. 2 shows a visual field map of a patient. Because the map would be generated using a VRT device, it is pixelated according to an array of actuable light emitting elements associated with a VRT apparatus. A fixation point 210 is used as a reference.
- the map has been divided into four zones: a primary zone 230, a secondary zone 220, a tertiary zone 240, and remainder zone 250 (the area not defined as one of the other zones). Although shown as continuous zones, the zones may also be discontinuous.
- the zones may be defined automatically or manually according to campimetric data.
- a given, finite number of stimuli are apportioned among two or more zones. For example, 80% of the stimuli may be apportioned to the primary zone 230 and 20% to the secondary zone. Alternately, some fraction may be reserved for the tertiary zone, higher order zones, the remainder zone, or combinations thereof.
- the transition zone is defined as the primary zone and receives the majority of the stimuli, e.g., 70%. The remaining stimuli are presented to a border region secondary zone.
- the transition zone may be either continuous or discontinuous.
- the border region may be sized to extend beyond the transition zone into both blind and intact zones by a certain amount. For example, approximately two visual field cells on either side of the transition zone may be targeted.
- the patient response record may be used, periodically or continuously, to update the transition zone definition.
- a central visual field bias may also be applied to the transition zone.
- vision is more intensely stimulated in a given zone, yet patient response is tracked by stimulating outside the given zone with fewer stimuli, and optionally, at a lower frequency (i.e., stimuli per unit time) in order to track patient response across a larger visual field region or the entire visual field.
- a lower frequency i.e., stimuli per unit time
- the various cells in the visual field are reconnoitered for potential recruitment into the set of locations receiving the more intense or frequent therapy. For example, in this way, a cell may be discovered to be exhibiting a recovery trend and the therapy regimen is adjusted accordingly (either automatically, or manually)
- Figs. 3-7 show a VRT process according to an embodiment of the present invention.
- Fig 3 shows, in map format, a campimetric representation of a patient's visual field obtained using a VRT apparatus.
- a transition zone is defined by non-contiguous high-potential regions 330, portions of which lie within an intact zone 320, a blind zone 310, or adjacent both the intact and blind zones.
- Fig. 4 shows a border region 410 and a central field region 420 that may be used in assigning stimulus apportioning priorities. Accordingly, as shown in Fig. 5 , multiple zones may be created.
- a primary zone 510 is apportioned 70% of the stimuli
- a secondary zone 520 is apportioned 20% of the stimuli
- a noncontiguous tertiary zone 530 is apportioned 10% of the stimuli.
- Fig. 6 shows how, after a course of VRT treatment with the so-apportioned stimuli, the zones may be redefined to reflect changes in the patient's responsiveness (improvement or deterioration).
- Fig. 7 shows how a particular map element corresponding to a particular neuron may indicate improvement in responsiveness of the particular neuron over a course of stimulative therapy.
- zones may be defined and redefined automatically.
- tools may be provided to a therapist to define zones manually.
- zones may be drawn on a computer screen so as to overlay a visual representation of the visual field (e.g., a campimetric map).
- a visual representation of the visual field e.g., a campimetric map.
- circles or ovals may be drawn to demark a zone for preferential stimulus apportionment.
- the disclosed methods for stimulative therapy may be implemented as a computer program product for use with a computer system.
- Such implementations may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium.
- the medium may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques).
- the series of computer instructions embodies all or part of the functionality previously described herein with respect to the system. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems.
- Such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies.
- a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web).
- some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware. Still other embodiments of the invention are implemented as entirely hardware, or entirely software (e.g ., a computer program product).
Landscapes
- Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Epidemiology (AREA)
- Pain & Pain Management (AREA)
- Physical Education & Sports Medicine (AREA)
- Rehabilitation Therapy (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Radiation-Therapy Devices (AREA)
- Rehabilitation Tools (AREA)
Description
- The present invention relates to focused vision therapy and, in particular, to selectively apportioning light stimulation to different areas of a patient's visual field.
- Stimulating the vision system of human subjects with vision impairment may improve their visual performance. For example, as documented in
US Patent No 6,464,356 , andUS Published Patent Application No. 2005/0213033 , presenting visual stimuli to areas of a human's visual system may allow improvement in the user's vision. NovaVision, of Boca Raton, FI, produces VRT™ (Visual Restoration Therapy) devices for effecting optical stimulation of defined locations of a patient's retina. During a course of VRT, a finite number of stimulation events are available. Therefore, these stimulation events should be judiciously directed to the particular visual field regions for which treatment is desired. - VRT may be used to treat neurological deficits of the visual system of a patient. Such deficits may result from retinal damage, damage to the optic nerve, damage to the visual cortex, such as may occur due to stroke or traumatic brain injury. For example, age related macular degeneration (AMD) may be treated with VRT.
-
DE 9305147 pertains to a training device for the treatment of patients suffering from perceptual disturbances. -
US 5,539,482 relates to glaucoma testing using non-linear systems identification techniques. - In an embodiment of the invention as claimed, there is a system for treating the visual system of a patient. The system includes a display that has an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy. The system also includes an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions of the visual field. The system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions a greater share of stimuli to those the visual field regions nearer the center of the visual field.
- Various related embodiments are provided including optional or additional features. The actuator may present a fixation stimulus to the human. The system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli. The system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field. The retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance from the center of the human's visual field by selecting larger stimuli to target peripheral visual field regions and smaller subsets to target central visual field regions.
- In a further embodiment of the invention, there is a system for treating the visual system of a patient. The system includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field. The system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions by using a campimetric representation of the visual field to define at least a primary zone, a secondary zone, and a remainder zone, the remainder zone comprising that portion of the visual field that is outside of the other defined zones.
- Various related embodiments are provided including optional or additional features. The system may include software and/or hardware for presenting a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone. The system may include software and/or hardware for presenting, over the course of therapy, a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone, and a greater number of stimuli to the secondary zone than to the remainder zone. The number of stimuli presented to the remainder zone may be non-zero. The system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli. The system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field. The retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance. The system may include software and/or hardware for using the record of the human's response to the stimuli to redefine one of the primary zone and the secondary zone. The system may usea change in the response with time for.a given visual field location to redefine one of the primary zone and the secondary zone. The zone may be automatically redefined.
- In a further embodiment of the invention, there is a system for treating the visual system of a patient. The system includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field. The system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions by using a campimetric representation of the visual field to define at a transition zone bordered by a blind zone and an intact zone and apportion stimuli to the transition zone with a bias toward the central visual field.
- Various related embodiments are provided including optional or additional features.
- The system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to update the transition zone, for updating the transition zone using a change in the response with time for a given visual field location, and for automatically redefining the transition zone.
- The foregoing features of the invention will be more readily understood by reference to the following detailed description, taken with reference to the accompanying drawings, in which:
-
Fig. 1 shows a flow chart of a method of visual restoration therapy in accordance with an embodiment of the invention; -
Fig. 2 shows an example of a training area having three (3) sub-areas; -
Fig. 3 shows a visual field map with a blind zone, intact zone and transition zones; -
Fig. 4 shows a visual field map with a defined border zone and central visual field; -
Fig. 5 shows a visual field map with multiple defined apportionment zones; -
Fig. 6 shows a visual field map before and after therapy; -
Fig. 7 shows how a particular visual field location may improve with therapy. - Definitions. As used in this description and the accompanying claims, the following terms shall have the meanings indicated, unless the context otherwise requires:
- "VRT" shall mean visual restoration therapy, a therapeutic process for selectively targeting and stimulating specific visual field regions;
- An "light emitting array having a set of individually actuable elements" shall mean any device capable of transmitting an illuminating pattern to the retina of a human including a cathode ray tube (CRT), liquid crystal display (LCD), organic light emitting diodes (OLED), or other such device which may be placed at various distances from a patient's eyes, and includes head mounted displays and image projection methods including the use of digital light processing (DLP™)
- In the context of visual restoration therapy, a "campimetric representation" shall mean any data set that associates a set of visual field positions with at least one corresponding patient performance data set. The patient performance data may include patient response times, or threshold intensity required to observe a stimulus;
- A "course of VRT" shall mean any temporally continuous or discontinuous VRT session, which may span minutes, hours, days, weeks, months, or years;
- An "apportioner" shall mean any device including hardware, software or both capable of apportioning a finite number of individual light stimuli events between specified visual field zones according to a particular bias. For example, the apportioner may be embodied in a computer with software for administering VRT. In the context of an apportioner, a "bias" shall mean a skewing of stimulus apportioning so as to stimulate a particular zone to a greater degree than one or more other zones.
- An "actuator" shall mean any device capable of switching array elements so as to illuminate the retina of a patient with a given pattern and distribution of stimuli
- Aspects of the present invention may solve the problems outlined above by apportioning or rationing stimuli over a course of VRT so as to optimize stimulation to obtain more significant clinical outcomes when using limited amounts of light stimuli. For a given length of therapy (e.g:, a single session, or a course of therapy over weeks or months), a patient will receive a finite number of stimuli. For example, a patient may receive 500-600 stimuli in a 20 to 30 minute VRT session. A therapist may desire to stimulate multiple visual field zones (e.g., both functionally important central areas and ARVs). However, a tradeoff must be made between the number of stimuli directed at a given zone and areal coverage. Illustrative embodiments of the present invention may solve some of these or other problems by dividing a therapy area into regions and applying different stimuli densities to each region. Unless otherwise indicated, the operations of the VRT systems described below may be fully automatic in the sense that the therapist need not intervene during a therapy session or even a multi-session course of therapy.
-
Fig. 1 shows a flow chart in accordance with an embodiment of the invention. The flow chart represents a method that may be embodied in a VRT apparatus or software module for use with a VRT apparatus. As is known in the art, a patient is situated in front of a display and instructed to fixate upon a fixation point or stimulus. The display may be a computer driven CRT, LCD, OLED, DLP, plasma display, or other such display including a head mounted display (e.g., goggles or helmet). The display has associated hardware for actuating subsets of individual elements of the display from a set (e.g. pixels or subsets of pixels) in order to target a specific area of the patient's retina and neuronal components of their visual field with a patterned illumination. The patterned illumination may be a single pixel, a contiguous subset of pixels that project a particular shape, or even a discontiguous subset of pixels. Targeting of the illumination pattern upon the retina may be accomplished by applying a specified offset from a point upon which the patient is instructed to fixate (i.e. a fixation point). - A campimetric representation of the patient's visual field (a "visual field map") is obtained (step 110). The representation may be manifested as a multi-dimensional data set or visual field map, either as an array in computer memory, or expressed graphically. The campimetric representation may be the result of a previous VRT session or other campimetric activity. For example, the campimetric representation may contain, as a function of position relative to the a fixation point, or in an array corresponding to pixels on a VRT display, response times, fraction of correct responses, or other data related to the sensitivity of the patient's visual field neurons to light stimuli. Alternately, rather than starting with the map, the map can be generated through subsequent steps in the process, such a those listed below.
- The campimetric representation is then used to assign the potential for a given neuron or visual field area to respond to VRT (step 120). For example, depending on the type of therapy chosen by the therapist, regions of the visual field that are partially responding, or are in a transition zone between a blind zone and an intact (i.e., seeing) zone may be indicative of a high recovery potential. Scores may be assigned based on potential. In an another example, a visual field location corresponding to a pixel element of a VRT may be assigned a low score if bounded on all sides by nonresponsive locations (i.e., blind regions), or bounded on all sides by intact regions, whereas locations bounded by both blind and intact locations, or one or more partially responding locations, may be awarded a higher scores. Trending data, i.e. improvements or decreases in patient responses in a given visual field areas may also be used to assign priorities; e.g., stimuli may be better invested in those areas showing an improvement with time. The result of
step 120 may be used as a priority map, which may be used to distribute (i.e., apportion) stimuli among multiple locations. - In a specific example of a scoring system, points are awarded to each element in a two dimensional array of VRT pixel locations as follows:
- i) locations adjacent to 8 blind locations (locations include diagonal locations) - 0 points;
- ii) locations adjacent to 8 intact locations - 0 points;
- iii) locations adjacent to one or more partially responding locations - 1 point for each partially responding location;
- iv) locations adjacent to both blind and intact locations - 5 points
- Optionally, additional factors may be used to assign priorities (step 130). Examples of additional factors include therapist intervention, or application of additional biases, which may be arrived at by using physiological or statistical factors. In one embodiment, a physiological bias is included that favors more central visual field regions over more peripheral regions so as to create a stimulus distribution that effects presentation of a larger fraction of the administered stimuli to more central regions. Thus, result may be desirable because more central regions of the visual field (e.g., the center 3-5°) have more neuronal synapses and are thus critical in certain key activities such as reading. The stimuli distribution can be tuned to match approximately the number of neuronal synapses at a given location (i.e. the cortical magnification factor) by using population-derived visual field structures, or maps of the individual patient's visual field.
- Stimuli are apportioned to the patient based on the assigned priorities by actuating the individual actuable light-emitting elements of a display device to target a specified region of the patient's visual field. Various techniques are available to apportion the stimuli, including:
- i) randomly assigning locations, and multiplying by a weighting factors based on a corresponding scores from those location obtained from the priority map; and
- ii) populating a location table with a list of locations, the locations having a frequency that is proportional to priority scores. The sequence of location presentations may then be randomized. Additionally, the list may be further sorted to temporal clustering of stimuli presentations in a given area or zone.
- After presenting a given stimuli, a patient response may be recorded; e.g., the by detection of a button actuation by the patient. Response times may also be recorded. Patient responses may be used to update the visual field map "in real time," i.e., prior to completion of a therapy session or course of therapy. In other words, the loop is closed by returning to step 110 and repeating the loop for the duration of therapy (step 160). As discussed above, derivative aspects of the patient response, including temporal improvements of the patient response accuracy, response time, or threshold intensity required for a patient to see a stimulus may be utilized in setting priorities and assigning the apportioning distribution. Alternately, the loop may be closed by returning to step 140.
- In accordance with another embodiment, the effectiveness of stimulus allocation is improved by varying the size of a stimulus according to the selected visual field location targeted by the stimulus. Because visual field resolution decreases with distance from the center of the visual field in a known way, stimulation of various neurons can be accomplished with different stimulus sizes (e.g., by altering the number of adjacent elements actuated). This approach may result in improved economies of stimulation allocation. For example, a computerized VRT apparatus may use an algorithm that randomly distributes stimuli, but avoids repetitive stimulation in the same location; using larger stimuli in peripheral regions of the visual field will result in a bias in favor of the central visual field. The larger stimuli are sized so as to illuminate a larger area of the patient's retina.
-
Fig. 2 shows a visual field map of a patient. Because the map would be generated using a VRT device, it is pixelated according to an array of actuable light emitting elements associated with a VRT apparatus. Afixation point 210 is used as a reference. The map has been divided into four zones: aprimary zone 230, asecondary zone 220, atertiary zone 240, and remainder zone 250 (the area not defined as one of the other zones). Although shown as continuous zones, the zones may also be discontinuous. The zones may be defined automatically or manually according to campimetric data. In an embodiment of the invention, a given, finite number of stimuli are apportioned among two or more zones. For example, 80% of the stimuli may be apportioned to theprimary zone - In a specific embodiment, the transition zone is defined as the primary zone and receives the majority of the stimuli, e.g., 70%. The remaining stimuli are presented to a border region secondary zone. The transition zone may be either continuous or discontinuous. The border region may be sized to extend beyond the transition zone into both blind and intact zones by a certain amount. For example, approximately two visual field cells on either side of the transition zone may be targeted. The patient response record may be used, periodically or continuously, to update the transition zone definition. A central visual field bias may also be applied to the transition zone.
- In a related embodiment, vision is more intensely stimulated in a given zone, yet patient response is tracked by stimulating outside the given zone with fewer stimuli, and optionally, at a lower frequency (i.e., stimuli per unit time) in order to track patient response across a larger visual field region or the entire visual field. In this way, the various cells in the visual field are reconnoitered for potential recruitment into the set of locations receiving the more intense or frequent therapy. For example, in this way, a cell may be discovered to be exhibiting a recovery trend and the therapy regimen is adjusted accordingly (either automatically, or manually)
-
Figs. 3-7 show a VRT process according to an embodiment of the present invention.Fig 3 shows, in map format, a campimetric representation of a patient's visual field obtained using a VRT apparatus. A transition zone is defined by non-contiguous high-potential regions 330, portions of which lie within anintact zone 320, ablind zone 310, or adjacent both the intact and blind zones.Fig. 4 shows aborder region 410 and acentral field region 420 that may be used in assigning stimulus apportioning priorities. Accordingly, as shown inFig. 5 , multiple zones may be created. Thus, aprimary zone 510 is apportioned 70% of the stimuli, asecondary zone 520 is apportioned 20% of the stimuli, and a noncontiguoustertiary zone 530 is apportioned 10% of the stimuli.Fig. 6 shows how, after a course of VRT treatment with the so-apportioned stimuli, the zones may be redefined to reflect changes in the patient's responsiveness (improvement or deterioration).Fig. 7 shows how a particular map element corresponding to a particular neuron may indicate improvement in responsiveness of the particular neuron over a course of stimulative therapy. - In various embodiments, zones may be defined and redefined automatically. However, tools may be provided to a therapist to define zones manually. For example, zones may be drawn on a computer screen so as to overlay a visual representation of the visual field (e.g., a campimetric map). For example, circles or ovals may be drawn to demark a zone for preferential stimulus apportionment.
- In alternative embodiments, the disclosed methods for stimulative therapy may be implemented as a computer program product for use with a computer system. Such implementations may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium. The medium may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques). The series of computer instructions embodies all or part of the functionality previously described herein with respect to the system. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems.
- Furthermore, such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies. It is expected that such a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web). Of course, some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware. Still other embodiments of the invention are implemented as entirely hardware, or entirely software (e.g., a computer program product).
- The described embodiments of the invention are intended to be merely exemplary and numerous variations and modifications will be apparent to those skilled in the art. All such variations and modifications are intended to be within the scope of the present invention as defined in the appended claims.
Claims (12)
- A system for treating the visual system of a patient, the system comprising:- a display having an array of individually actuable light emitting elements adapted to present stimuli to a human during a course of therapy;- an apportioner adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions of the visual field; and- an actuator for actuating display elements according to the apportionment of the apportioner, characterized in that- the apportioner is adapted to apportion a greater share of stimuli to those of the visual field regions nearer the center of the visual field.
- A system according to claim 1, wherein the actuator is adapted to present a fixation stimulus to the human.
- A system according to claim 1, further comprising means for recording the human's response to the stimuli.
- A system according to claim 3, further comprising means for using the record of the human's response to the stimuli to allocate future stimuli.
- A system according to claim 4, further comprising means for using a change in the response with time for a given visual field location to allocate future stimuli.
- A system according to claim 1, further comprising means for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field.
- A system according to claim 6, wherein the retinal area targeted by the subset of elements is in increasing relationship with corresponding distance from the center of the human's visual field by selecting larger stimuli to target peripheral visual field regions and smaller subsets to target central visual field regions.
- A system according to any of claims 1 to 7, wherein the apportioner is adapted to apportion by using a campimetric representation of the visual field to define at least a primary zone, a secondary zone, and a remainder zone, the remainder zone comprising the portion of the visual field that is outside of the other defined zones.
- A system according to claim 8, further comprising means for presenting a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone.
- A system according to claim 8, further comprising means for presenting, over the course of a therapy, a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone, and a greater number of stimuli to the secondary zone than to the remainder zone.
- A system according to any of claims 8 to 10, further comprising means for recording the human's response to the stimuli, and means for using the record of the human's response to the stimuli to redefine one of the primary zone and the secondary zone.
- A system according to any of claims 1 to 10, wherein the apportioner uses a campimetric representation of the visual field to define a transition zone bordered by a blind zone and an intact zone and apportions stimuli to the transition zone with a bias towards the central visual field.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US78423506P | 2006-03-21 | 2006-03-21 | |
PCT/US2007/064520 WO2007109724A1 (en) | 2006-03-21 | 2007-03-21 | Process and device for apportioning therapeutic vision stimuli |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2012733A1 EP2012733A1 (en) | 2009-01-14 |
EP2012733B1 true EP2012733B1 (en) | 2016-02-10 |
Family
ID=38325560
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07759016.4A Not-in-force EP2012733B1 (en) | 2006-03-21 | 2007-03-21 | Process and device for apportioning therapeutic vision stimuli |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP2012733B1 (en) |
JP (1) | JP2009530062A (en) |
AU (1) | AU2007226838A1 (en) |
CA (1) | CA2646080C (en) |
ES (1) | ES2569401T3 (en) |
WO (1) | WO2007109724A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009542368A (en) * | 2006-06-30 | 2009-12-03 | ノバビジョン, インコーポレイテッド | Eccentric vision diagnosis and treatment system |
CA2657762C (en) | 2006-07-25 | 2015-07-21 | Novavision, Inc. | Dynamic stimuli for visual field testing and therapy |
WO2008043027A2 (en) | 2006-10-04 | 2008-04-10 | Isport, Llc | System and method of enhancing a retino-geniculo-cortical pathway for a particular physical activity |
PT2552539E (en) * | 2010-04-01 | 2015-11-17 | Pixium Vision Sa | Retinal implant and visual prosthesis incorporating such an implant |
GB201007697D0 (en) * | 2010-05-06 | 2010-06-23 | Ucl Business Plc | A supra-threshold test for use in detecting sensitivity loss across the field of vision |
JP6060525B2 (en) * | 2012-05-31 | 2017-01-18 | 株式会社ニデック | Fundus examination device |
WO2021190762A1 (en) | 2020-03-27 | 2021-09-30 | Fondation Asile Des Aveugles | Joint virtual reality and neurostimulation methods for visuomotor rehabilitation |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5539482A (en) | 1992-02-28 | 1996-07-23 | The Australian National University | Glaucoma testing using non-linear systems identification techniques |
DE9305147U1 (en) | 1993-04-03 | 1994-08-04 | Schmielau, Fritz, Prof. Dr.Dr.Dr., 2400 Lübeck | Training device for the treatment of patients suffering from perceptual disorders |
US5534953A (en) * | 1994-07-01 | 1996-07-09 | Schmielau; Fritz | Training device for the therapy of patients having perception defects |
WO2000012042A1 (en) * | 1998-08-27 | 2000-03-09 | Novavision Ag | Process and device for the training of human vision |
AU2002238539B2 (en) * | 2002-02-08 | 2008-01-24 | Novavision, Inc. | Improved process and device for the training of human vision |
-
2007
- 2007-03-21 AU AU2007226838A patent/AU2007226838A1/en not_active Abandoned
- 2007-03-21 EP EP07759016.4A patent/EP2012733B1/en not_active Not-in-force
- 2007-03-21 JP JP2009501715A patent/JP2009530062A/en active Pending
- 2007-03-21 ES ES07759016.4T patent/ES2569401T3/en active Active
- 2007-03-21 WO PCT/US2007/064520 patent/WO2007109724A1/en active Application Filing
- 2007-03-21 CA CA2646080A patent/CA2646080C/en active Active
Also Published As
Publication number | Publication date |
---|---|
AU2007226838A1 (en) | 2007-09-27 |
CA2646080C (en) | 2014-12-02 |
WO2007109724A1 (en) | 2007-09-27 |
CA2646080A1 (en) | 2007-09-27 |
JP2009530062A (en) | 2009-08-27 |
EP2012733A1 (en) | 2009-01-14 |
ES2569401T3 (en) | 2016-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20070216865A1 (en) | Process and Device for Apportioning Therapeutic Vision Stimuli | |
EP2012733B1 (en) | Process and device for apportioning therapeutic vision stimuli | |
US7753524B2 (en) | Process and device for treating blind regions of the visual field | |
Møller | The role of neural plasticity in tinnitus | |
Sabel et al. | Restoration of vision by training of residual functions | |
Pahwa et al. | Bilateral subthalamic stimulation in patients with Parkinson disease: long-term follow up | |
US7748846B2 (en) | Dynamic fixation stimuli for visual field testing and therapy | |
Plow et al. | Temporal profile of functional visual rehabilitative outcomes modulated by transcranial direct current stimulation | |
US7682021B2 (en) | System and methods for the treatment of retinal diseases | |
US20080013047A1 (en) | Diagnostic and Therapeutic System for Eccentric Viewing | |
Kerkhoff et al. | A long-lasting improvement of tactile extinction after galvanic vestibular stimulation: two Sham-stimulation controlled case studies | |
Fitzgerald et al. | A pilot study of bed nucleus of the stria terminalis deep brain stimulation in treatment-resistant depression | |
JP2009525154A5 (en) | ||
US11235152B2 (en) | Systems and methods of conveying a visual image to a person fitted with a visual prosthesis | |
Pratt et al. | Attentional modulation of the gap effect | |
JP5068770B2 (en) | Process and apparatus for treating blind areas of vision | |
Krigolson et al. | Predictive information and error processing: The role of medial‐frontal cortex during motor control | |
Fornos et al. | Simulation of artificial vision: IV. Visual information required to achieve simple pointing and manipulation tasks | |
Barraza-Bernal et al. | A preferred retinal location of fixation can be induced when systematic stimulus relocations are applied | |
Sahraie et al. | Temporal properties of spatial channel of processing in hemianopia | |
JP2009530062A5 (en) | ||
Ağaoğlu et al. | Oculomotor responses of the visual system to an artificial central scotoma may not represent genuine visuomotor adaptation | |
Leff et al. | Hemianopic alexia | |
Doane | Changes in visual function with perceptual isolation. | |
Inggas et al. | Long-term Outcome of Deep Brain Stimulation in Intralaminar Thalamus for Refractory Tourette Syndrome: A Case Report |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20081017 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK RS |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: KENKEL, SIGRID Inventor name: SCHLUETER, DOROTHEE Inventor name: SABEL, BERNHARD |
|
17Q | First examination report despatched |
Effective date: 20100317 |
|
19U | Interruption of proceedings before grant |
Effective date: 20100428 |
|
19W | Proceedings resumed before grant after interruption of proceedings |
Effective date: 20120601 |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: NOVAVISION INC. |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150811 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 774285 Country of ref document: AT Kind code of ref document: T Effective date: 20160215 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602007044803 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2569401 Country of ref document: ES Kind code of ref document: T3 Effective date: 20160510 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160210 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 774285 Country of ref document: AT Kind code of ref document: T Effective date: 20160210 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160511 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160331 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160610 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160613 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602007044803 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 |
|
26N | No opposition filed |
Effective date: 20161111 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160510 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20070321 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160331 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160210 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160321 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20220323 Year of fee payment: 16 Ref country code: GB Payment date: 20220323 Year of fee payment: 16 Ref country code: DE Payment date: 20220322 Year of fee payment: 16 Ref country code: CH Payment date: 20220330 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20220321 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20220328 Year of fee payment: 16 Ref country code: ES Payment date: 20220404 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602007044803 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20230321 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230321 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230321 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230321 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231003 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230321 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20240430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230322 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230322 |