EP2012733B1 - Process and device for apportioning therapeutic vision stimuli - Google Patents

Process and device for apportioning therapeutic vision stimuli Download PDF

Info

Publication number
EP2012733B1
EP2012733B1 EP07759016.4A EP07759016A EP2012733B1 EP 2012733 B1 EP2012733 B1 EP 2012733B1 EP 07759016 A EP07759016 A EP 07759016A EP 2012733 B1 EP2012733 B1 EP 2012733B1
Authority
EP
European Patent Office
Prior art keywords
stimuli
zone
visual field
human
response
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP07759016.4A
Other languages
German (de)
French (fr)
Other versions
EP2012733A1 (en
Inventor
Bernhard Sabel
Dorothee Schlueter
Sigrid Kenkel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NovaVision Inc
Original Assignee
NovaVision Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NovaVision Inc filed Critical NovaVision Inc
Publication of EP2012733A1 publication Critical patent/EP2012733A1/en
Application granted granted Critical
Publication of EP2012733B1 publication Critical patent/EP2012733B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H5/00Exercisers for the eyes

Definitions

  • the present invention relates to focused vision therapy and, in particular, to selectively apportioning light stimulation to different areas of a patient's visual field.
  • Stimulating the vision system of human subjects with vision impairment may improve their visual performance.
  • presenting visual stimuli to areas of a human's visual system may allow improvement in the user's vision.
  • NovaVision of Boca Raton, FI, produces VRTTM (Visual Restoration Therapy) devices for effecting optical stimulation of defined locations of a patient's retina.
  • VRTTM Visual Restoration Therapy
  • a finite number of stimulation events are available. Therefore, these stimulation events should be judiciously directed to the particular visual field regions for which treatment is desired.
  • VRT may be used to treat neurological deficits of the visual system of a patient. Such deficits may result from retinal damage, damage to the optic nerve, damage to the visual cortex, such as may occur due to stroke or traumatic brain injury. For example, age related macular degeneration (AMD) may be treated with VRT.
  • AMD age related macular degeneration
  • DE 9305147 pertains to a training device for the treatment of patients suffering from perceptual disturbances.
  • US 5,539,482 relates to glaucoma testing using non-linear systems identification techniques.
  • the system includes a display that has an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy.
  • the system also includes an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions of the visual field.
  • the system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions a greater share of stimuli to those the visual field regions nearer the center of the visual field.
  • the actuator may present a fixation stimulus to the human.
  • the system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli.
  • the system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field.
  • the retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance from the center of the human's visual field by selecting larger stimuli to target peripheral visual field regions and smaller subsets to target central visual field regions.
  • a system for treating the visual system of a patient includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field.
  • the system also includes an actuator for actuating display elements according to the apportionment of the apportioner.
  • the apportioner apportions by using a campimetric representation of the visual field to define at least a primary zone, a secondary zone, and a remainder zone, the remainder zone comprising that portion of the visual field that is outside of the other defined zones.
  • the system may include software and/or hardware for presenting a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone.
  • the system may include software and/or hardware for presenting, over the course of therapy, a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone, and a greater number of stimuli to the secondary zone than to the remainder zone.
  • the number of stimuli presented to the remainder zone may be non-zero.
  • the system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli.
  • the system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field.
  • the retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance.
  • the system may include software and/or hardware for using the record of the human's response to the stimuli to redefine one of the primary zone and the secondary zone.
  • the system may usea change in the response with time for.a given visual field location to redefine one of the primary zone and the secondary zone.
  • the zone may be automatically redefined.
  • a system for treating the visual system of a patient includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field.
  • the system also includes an actuator for actuating display elements according to the apportionment of the apportioner.
  • the apportioner apportions by using a campimetric representation of the visual field to define at a transition zone bordered by a blind zone and an intact zone and apportion stimuli to the transition zone with a bias toward the central visual field.
  • the system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to update the transition zone, for updating the transition zone using a change in the response with time for a given visual field location, and for automatically redefining the transition zone.
  • an “actuator” shall mean any device capable of switching array elements so as to illuminate the retina of a patient with a given pattern and distribution of stimuli
  • aspects of the present invention may solve the problems outlined above by apportioning or rationing stimuli over a course of VRT so as to optimize stimulation to obtain more significant clinical outcomes when using limited amounts of light stimuli.
  • a patient will receive a finite number of stimuli. For example, a patient may receive 500-600 stimuli in a 20 to 30 minute VRT session.
  • a therapist may desire to stimulate multiple visual field zones (e.g., both functionally important central areas and ARVs).
  • a tradeoff must be made between the number of stimuli directed at a given zone and areal coverage.
  • Illustrative embodiments of the present invention may solve some of these or other problems by dividing a therapy area into regions and applying different stimuli densities to each region. Unless otherwise indicated, the operations of the VRT systems described below may be fully automatic in the sense that the therapist need not intervene during a therapy session or even a multi-session course of therapy.
  • Fig. 1 shows a flow chart in accordance with an embodiment of the invention.
  • the flow chart represents a method that may be embodied in a VRT apparatus or software module for use with a VRT apparatus.
  • a patient is situated in front of a display and instructed to fixate upon a fixation point or stimulus.
  • the display may be a computer driven CRT, LCD, OLED, DLP, plasma display, or other such display including a head mounted display (e.g., goggles or helmet).
  • the display has associated hardware for actuating subsets of individual elements of the display from a set (e.g. pixels or subsets of pixels) in order to target a specific area of the patient's retina and neuronal components of their visual field with a patterned illumination.
  • the patterned illumination may be a single pixel, a contiguous subset of pixels that project a particular shape, or even a discontiguous subset of pixels.
  • Targeting of the illumination pattern upon the retina may be accomplished by applying a specified offset from a point upon which the patient is instructed to fixate (i.e. a fixation point).
  • a campimetric representation of the patient's visual field (a "visual field map") is obtained (step 110).
  • the representation may be manifested as a multi-dimensional data set or visual field map, either as an array in computer memory, or expressed graphically.
  • the campimetric representation may be the result of a previous VRT session or other campimetric activity.
  • the campimetric representation may contain, as a function of position relative to the a fixation point, or in an array corresponding to pixels on a VRT display, response times, fraction of correct responses, or other data related to the sensitivity of the patient's visual field neurons to light stimuli.
  • the map can be generated through subsequent steps in the process, such a those listed below.
  • the campimetric representation is then used to assign the potential for a given neuron or visual field area to respond to VRT (step 120). For example, depending on the type of therapy chosen by the therapist, regions of the visual field that are partially responding, or are in a transition zone between a blind zone and an intact (i.e., seeing) zone may be indicative of a high recovery potential. Scores may be assigned based on potential. In an another example, a visual field location corresponding to a pixel element of a VRT may be assigned a low score if bounded on all sides by nonresponsive locations (i.e., blind regions), or bounded on all sides by intact regions, whereas locations bounded by both blind and intact locations, or one or more partially responding locations, may be awarded a higher scores.
  • Trending data i.e. improvements or decreases in patient responses in a given visual field areas may also be used to assign priorities; e.g., stimuli may be better invested in those areas showing an improvement with time.
  • the result of step 120 may be used as a priority map, which may be used to distribute (i.e., apportion) stimuli among multiple locations.
  • points are awarded to each element in a two dimensional array of VRT pixel locations as follows:
  • additional factors may be used to assign priorities (step 130).
  • additional factors include therapist intervention, or application of additional biases, which may be arrived at by using physiological or statistical factors.
  • a physiological bias is included that favors more central visual field regions over more peripheral regions so as to create a stimulus distribution that effects presentation of a larger fraction of the administered stimuli to more central regions.
  • result may be desirable because more central regions of the visual field (e.g., the center 3-5°) have more neuronal synapses and are thus critical in certain key activities such as reading.
  • the stimuli distribution can be tuned to match approximately the number of neuronal synapses at a given location (i.e. the cortical magnification factor) by using population-derived visual field structures, or maps of the individual patient's visual field.
  • Stimuli are apportioned to the patient based on the assigned priorities by actuating the individual actuable light-emitting elements of a display device to target a specified region of the patient's visual field.
  • Various techniques are available to apportion the stimuli, including:
  • a patient response may be recorded; e.g., the by detection of a button actuation by the patient. Response times may also be recorded.
  • Patient responses may be used to update the visual field map "in real time," i.e., prior to completion of a therapy session or course of therapy.
  • the loop is closed by returning to step 110 and repeating the loop for the duration of therapy (step 160).
  • derivative aspects of the patient response including temporal improvements of the patient response accuracy, response time, or threshold intensity required for a patient to see a stimulus may be utilized in setting priorities and assigning the apportioning distribution. Alternately, the loop may be closed by returning to step 140.
  • the effectiveness of stimulus allocation is improved by varying the size of a stimulus according to the selected visual field location targeted by the stimulus. Because visual field resolution decreases with distance from the center of the visual field in a known way, stimulation of various neurons can be accomplished with different stimulus sizes (e.g., by altering the number of adjacent elements actuated). This approach may result in improved economies of stimulation allocation.
  • a computerized VRT apparatus may use an algorithm that randomly distributes stimuli, but avoids repetitive stimulation in the same location; using larger stimuli in peripheral regions of the visual field will result in a bias in favor of the central visual field. The larger stimuli are sized so as to illuminate a larger area of the patient's retina.
  • Fig. 2 shows a visual field map of a patient. Because the map would be generated using a VRT device, it is pixelated according to an array of actuable light emitting elements associated with a VRT apparatus. A fixation point 210 is used as a reference.
  • the map has been divided into four zones: a primary zone 230, a secondary zone 220, a tertiary zone 240, and remainder zone 250 (the area not defined as one of the other zones). Although shown as continuous zones, the zones may also be discontinuous.
  • the zones may be defined automatically or manually according to campimetric data.
  • a given, finite number of stimuli are apportioned among two or more zones. For example, 80% of the stimuli may be apportioned to the primary zone 230 and 20% to the secondary zone. Alternately, some fraction may be reserved for the tertiary zone, higher order zones, the remainder zone, or combinations thereof.
  • the transition zone is defined as the primary zone and receives the majority of the stimuli, e.g., 70%. The remaining stimuli are presented to a border region secondary zone.
  • the transition zone may be either continuous or discontinuous.
  • the border region may be sized to extend beyond the transition zone into both blind and intact zones by a certain amount. For example, approximately two visual field cells on either side of the transition zone may be targeted.
  • the patient response record may be used, periodically or continuously, to update the transition zone definition.
  • a central visual field bias may also be applied to the transition zone.
  • vision is more intensely stimulated in a given zone, yet patient response is tracked by stimulating outside the given zone with fewer stimuli, and optionally, at a lower frequency (i.e., stimuli per unit time) in order to track patient response across a larger visual field region or the entire visual field.
  • a lower frequency i.e., stimuli per unit time
  • the various cells in the visual field are reconnoitered for potential recruitment into the set of locations receiving the more intense or frequent therapy. For example, in this way, a cell may be discovered to be exhibiting a recovery trend and the therapy regimen is adjusted accordingly (either automatically, or manually)
  • Figs. 3-7 show a VRT process according to an embodiment of the present invention.
  • Fig 3 shows, in map format, a campimetric representation of a patient's visual field obtained using a VRT apparatus.
  • a transition zone is defined by non-contiguous high-potential regions 330, portions of which lie within an intact zone 320, a blind zone 310, or adjacent both the intact and blind zones.
  • Fig. 4 shows a border region 410 and a central field region 420 that may be used in assigning stimulus apportioning priorities. Accordingly, as shown in Fig. 5 , multiple zones may be created.
  • a primary zone 510 is apportioned 70% of the stimuli
  • a secondary zone 520 is apportioned 20% of the stimuli
  • a noncontiguous tertiary zone 530 is apportioned 10% of the stimuli.
  • Fig. 6 shows how, after a course of VRT treatment with the so-apportioned stimuli, the zones may be redefined to reflect changes in the patient's responsiveness (improvement or deterioration).
  • Fig. 7 shows how a particular map element corresponding to a particular neuron may indicate improvement in responsiveness of the particular neuron over a course of stimulative therapy.
  • zones may be defined and redefined automatically.
  • tools may be provided to a therapist to define zones manually.
  • zones may be drawn on a computer screen so as to overlay a visual representation of the visual field (e.g., a campimetric map).
  • a visual representation of the visual field e.g., a campimetric map.
  • circles or ovals may be drawn to demark a zone for preferential stimulus apportionment.
  • the disclosed methods for stimulative therapy may be implemented as a computer program product for use with a computer system.
  • Such implementations may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium.
  • the medium may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques).
  • the series of computer instructions embodies all or part of the functionality previously described herein with respect to the system. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems.
  • Such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies.
  • a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web).
  • some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware. Still other embodiments of the invention are implemented as entirely hardware, or entirely software (e.g ., a computer program product).

Landscapes

  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Epidemiology (AREA)
  • Pain & Pain Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Rehabilitation Therapy (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Radiation-Therapy Devices (AREA)
  • Rehabilitation Tools (AREA)

Description

    Technical Field
  • The present invention relates to focused vision therapy and, in particular, to selectively apportioning light stimulation to different areas of a patient's visual field.
  • Background
  • Stimulating the vision system of human subjects with vision impairment may improve their visual performance. For example, as documented in US Patent No 6,464,356 , and US Published Patent Application No. 2005/0213033 , presenting visual stimuli to areas of a human's visual system may allow improvement in the user's vision. NovaVision, of Boca Raton, FI, produces VRT™ (Visual Restoration Therapy) devices for effecting optical stimulation of defined locations of a patient's retina. During a course of VRT, a finite number of stimulation events are available. Therefore, these stimulation events should be judiciously directed to the particular visual field regions for which treatment is desired.
  • VRT may be used to treat neurological deficits of the visual system of a patient. Such deficits may result from retinal damage, damage to the optic nerve, damage to the visual cortex, such as may occur due to stroke or traumatic brain injury. For example, age related macular degeneration (AMD) may be treated with VRT.
  • DE 9305147 pertains to a training device for the treatment of patients suffering from perceptual disturbances.
  • US 5,539,482 relates to glaucoma testing using non-linear systems identification techniques.
  • Summary of the Invention
  • In an embodiment of the invention as claimed, there is a system for treating the visual system of a patient. The system includes a display that has an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy. The system also includes an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions of the visual field. The system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions a greater share of stimuli to those the visual field regions nearer the center of the visual field.
  • Various related embodiments are provided including optional or additional features. The actuator may present a fixation stimulus to the human. The system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli. The system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field. The retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance from the center of the human's visual field by selecting larger stimuli to target peripheral visual field regions and smaller subsets to target central visual field regions.
  • In a further embodiment of the invention, there is a system for treating the visual system of a patient. The system includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field. The system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions by using a campimetric representation of the visual field to define at least a primary zone, a secondary zone, and a remainder zone, the remainder zone comprising that portion of the visual field that is outside of the other defined zones.
  • Various related embodiments are provided including optional or additional features. The system may include software and/or hardware for presenting a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone. The system may include software and/or hardware for presenting, over the course of therapy, a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone, and a greater number of stimuli to the secondary zone than to the remainder zone. The number of stimuli presented to the remainder zone may be non-zero. The system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to allocate future stimuli and/or for using a change in the response with time for a given visual field location to allocate future stimuli. The system may include software and/or hardware for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field. The retinal area may be targeted by the subset of elements in increasing relationship with corresponding distance. The system may include software and/or hardware for using the record of the human's response to the stimuli to redefine one of the primary zone and the secondary zone. The system may usea change in the response with time for.a given visual field location to redefine one of the primary zone and the secondary zone. The zone may be automatically redefined.
  • In a further embodiment of the invention, there is a system for treating the visual system of a patient. The system includes a display having an array of individually actuable light emitting elements to present stimuli to a human during a course of therapy and an apportioner that is adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions with the visual field. The system also includes an actuator for actuating display elements according to the apportionment of the apportioner. The apportioner apportions by using a campimetric representation of the visual field to define at a transition zone bordered by a blind zone and an intact zone and apportion stimuli to the transition zone with a bias toward the central visual field.
  • Various related embodiments are provided including optional or additional features.
  • The system may include software and/or hardware for recording the human's response to the stimuli, for using the record of the human's response to the stimuli to update the transition zone, for updating the transition zone using a change in the response with time for a given visual field location, and for automatically redefining the transition zone.
  • Brief Description of the Drawings
  • The foregoing features of the invention will be more readily understood by reference to the following detailed description, taken with reference to the accompanying drawings, in which:
    • Fig. 1 shows a flow chart of a method of visual restoration therapy in accordance with an embodiment of the invention;
    • Fig. 2 shows an example of a training area having three (3) sub-areas;
    • Fig. 3 shows a visual field map with a blind zone, intact zone and transition zones;
    • Fig. 4 shows a visual field map with a defined border zone and central visual field;
    • Fig. 5 shows a visual field map with multiple defined apportionment zones;
    • Fig. 6 shows a visual field map before and after therapy;
    • Fig. 7 shows how a particular visual field location may improve with therapy.
    Detailed Description of Specific Embodiments
  • Definitions. As used in this description and the accompanying claims, the following terms shall have the meanings indicated, unless the context otherwise requires:
    • "VRT" shall mean visual restoration therapy, a therapeutic process for selectively targeting and stimulating specific visual field regions;
    • An "light emitting array having a set of individually actuable elements" shall mean any device capable of transmitting an illuminating pattern to the retina of a human including a cathode ray tube (CRT), liquid crystal display (LCD), organic light emitting diodes (OLED), or other such device which may be placed at various distances from a patient's eyes, and includes head mounted displays and image projection methods including the use of digital light processing (DLP™)
    • In the context of visual restoration therapy, a "campimetric representation" shall mean any data set that associates a set of visual field positions with at least one corresponding patient performance data set. The patient performance data may include patient response times, or threshold intensity required to observe a stimulus;
    • A "course of VRT" shall mean any temporally continuous or discontinuous VRT session, which may span minutes, hours, days, weeks, months, or years;
    • An "apportioner" shall mean any device including hardware, software or both capable of apportioning a finite number of individual light stimuli events between specified visual field zones according to a particular bias. For example, the apportioner may be embodied in a computer with software for administering VRT. In the context of an apportioner, a "bias" shall mean a skewing of stimulus apportioning so as to stimulate a particular zone to a greater degree than one or more other zones.
  • An "actuator" shall mean any device capable of switching array elements so as to illuminate the retina of a patient with a given pattern and distribution of stimuli
  • Aspects of the present invention may solve the problems outlined above by apportioning or rationing stimuli over a course of VRT so as to optimize stimulation to obtain more significant clinical outcomes when using limited amounts of light stimuli. For a given length of therapy (e.g:, a single session, or a course of therapy over weeks or months), a patient will receive a finite number of stimuli. For example, a patient may receive 500-600 stimuli in a 20 to 30 minute VRT session. A therapist may desire to stimulate multiple visual field zones (e.g., both functionally important central areas and ARVs). However, a tradeoff must be made between the number of stimuli directed at a given zone and areal coverage. Illustrative embodiments of the present invention may solve some of these or other problems by dividing a therapy area into regions and applying different stimuli densities to each region. Unless otherwise indicated, the operations of the VRT systems described below may be fully automatic in the sense that the therapist need not intervene during a therapy session or even a multi-session course of therapy.
  • Fig. 1 shows a flow chart in accordance with an embodiment of the invention. The flow chart represents a method that may be embodied in a VRT apparatus or software module for use with a VRT apparatus. As is known in the art, a patient is situated in front of a display and instructed to fixate upon a fixation point or stimulus. The display may be a computer driven CRT, LCD, OLED, DLP, plasma display, or other such display including a head mounted display (e.g., goggles or helmet). The display has associated hardware for actuating subsets of individual elements of the display from a set (e.g. pixels or subsets of pixels) in order to target a specific area of the patient's retina and neuronal components of their visual field with a patterned illumination. The patterned illumination may be a single pixel, a contiguous subset of pixels that project a particular shape, or even a discontiguous subset of pixels. Targeting of the illumination pattern upon the retina may be accomplished by applying a specified offset from a point upon which the patient is instructed to fixate (i.e. a fixation point).
  • A campimetric representation of the patient's visual field (a "visual field map") is obtained (step 110). The representation may be manifested as a multi-dimensional data set or visual field map, either as an array in computer memory, or expressed graphically. The campimetric representation may be the result of a previous VRT session or other campimetric activity. For example, the campimetric representation may contain, as a function of position relative to the a fixation point, or in an array corresponding to pixels on a VRT display, response times, fraction of correct responses, or other data related to the sensitivity of the patient's visual field neurons to light stimuli. Alternately, rather than starting with the map, the map can be generated through subsequent steps in the process, such a those listed below.
  • The campimetric representation is then used to assign the potential for a given neuron or visual field area to respond to VRT (step 120). For example, depending on the type of therapy chosen by the therapist, regions of the visual field that are partially responding, or are in a transition zone between a blind zone and an intact (i.e., seeing) zone may be indicative of a high recovery potential. Scores may be assigned based on potential. In an another example, a visual field location corresponding to a pixel element of a VRT may be assigned a low score if bounded on all sides by nonresponsive locations (i.e., blind regions), or bounded on all sides by intact regions, whereas locations bounded by both blind and intact locations, or one or more partially responding locations, may be awarded a higher scores. Trending data, i.e. improvements or decreases in patient responses in a given visual field areas may also be used to assign priorities; e.g., stimuli may be better invested in those areas showing an improvement with time. The result of step 120 may be used as a priority map, which may be used to distribute (i.e., apportion) stimuli among multiple locations.
  • In a specific example of a scoring system, points are awarded to each element in a two dimensional array of VRT pixel locations as follows:
    1. i) locations adjacent to 8 blind locations (locations include diagonal locations) - 0 points;
    2. ii) locations adjacent to 8 intact locations - 0 points;
    3. iii) locations adjacent to one or more partially responding locations - 1 point for each partially responding location;
    4. iv) locations adjacent to both blind and intact locations - 5 points
  • Optionally, additional factors may be used to assign priorities (step 130). Examples of additional factors include therapist intervention, or application of additional biases, which may be arrived at by using physiological or statistical factors. In one embodiment, a physiological bias is included that favors more central visual field regions over more peripheral regions so as to create a stimulus distribution that effects presentation of a larger fraction of the administered stimuli to more central regions. Thus, result may be desirable because more central regions of the visual field (e.g., the center 3-5°) have more neuronal synapses and are thus critical in certain key activities such as reading. The stimuli distribution can be tuned to match approximately the number of neuronal synapses at a given location (i.e. the cortical magnification factor) by using population-derived visual field structures, or maps of the individual patient's visual field.
  • Stimuli are apportioned to the patient based on the assigned priorities by actuating the individual actuable light-emitting elements of a display device to target a specified region of the patient's visual field. Various techniques are available to apportion the stimuli, including:
    1. i) randomly assigning locations, and multiplying by a weighting factors based on a corresponding scores from those location obtained from the priority map; and
    2. ii) populating a location table with a list of locations, the locations having a frequency that is proportional to priority scores. The sequence of location presentations may then be randomized. Additionally, the list may be further sorted to temporal clustering of stimuli presentations in a given area or zone.
  • After presenting a given stimuli, a patient response may be recorded; e.g., the by detection of a button actuation by the patient. Response times may also be recorded. Patient responses may be used to update the visual field map "in real time," i.e., prior to completion of a therapy session or course of therapy. In other words, the loop is closed by returning to step 110 and repeating the loop for the duration of therapy (step 160). As discussed above, derivative aspects of the patient response, including temporal improvements of the patient response accuracy, response time, or threshold intensity required for a patient to see a stimulus may be utilized in setting priorities and assigning the apportioning distribution. Alternately, the loop may be closed by returning to step 140.
  • In accordance with another embodiment, the effectiveness of stimulus allocation is improved by varying the size of a stimulus according to the selected visual field location targeted by the stimulus. Because visual field resolution decreases with distance from the center of the visual field in a known way, stimulation of various neurons can be accomplished with different stimulus sizes (e.g., by altering the number of adjacent elements actuated). This approach may result in improved economies of stimulation allocation. For example, a computerized VRT apparatus may use an algorithm that randomly distributes stimuli, but avoids repetitive stimulation in the same location; using larger stimuli in peripheral regions of the visual field will result in a bias in favor of the central visual field. The larger stimuli are sized so as to illuminate a larger area of the patient's retina.
  • Fig. 2 shows a visual field map of a patient. Because the map would be generated using a VRT device, it is pixelated according to an array of actuable light emitting elements associated with a VRT apparatus. A fixation point 210 is used as a reference. The map has been divided into four zones: a primary zone 230, a secondary zone 220, a tertiary zone 240, and remainder zone 250 (the area not defined as one of the other zones). Although shown as continuous zones, the zones may also be discontinuous. The zones may be defined automatically or manually according to campimetric data. In an embodiment of the invention, a given, finite number of stimuli are apportioned among two or more zones. For example, 80% of the stimuli may be apportioned to the primary zone 230 and 20% to the secondary zone. Alternately, some fraction may be reserved for the tertiary zone, higher order zones, the remainder zone, or combinations thereof.
  • In a specific embodiment, the transition zone is defined as the primary zone and receives the majority of the stimuli, e.g., 70%. The remaining stimuli are presented to a border region secondary zone. The transition zone may be either continuous or discontinuous. The border region may be sized to extend beyond the transition zone into both blind and intact zones by a certain amount. For example, approximately two visual field cells on either side of the transition zone may be targeted. The patient response record may be used, periodically or continuously, to update the transition zone definition. A central visual field bias may also be applied to the transition zone.
  • In a related embodiment, vision is more intensely stimulated in a given zone, yet patient response is tracked by stimulating outside the given zone with fewer stimuli, and optionally, at a lower frequency (i.e., stimuli per unit time) in order to track patient response across a larger visual field region or the entire visual field. In this way, the various cells in the visual field are reconnoitered for potential recruitment into the set of locations receiving the more intense or frequent therapy. For example, in this way, a cell may be discovered to be exhibiting a recovery trend and the therapy regimen is adjusted accordingly (either automatically, or manually)
  • Figs. 3-7 show a VRT process according to an embodiment of the present invention. Fig 3 shows, in map format, a campimetric representation of a patient's visual field obtained using a VRT apparatus. A transition zone is defined by non-contiguous high-potential regions 330, portions of which lie within an intact zone 320, a blind zone 310, or adjacent both the intact and blind zones. Fig. 4 shows a border region 410 and a central field region 420 that may be used in assigning stimulus apportioning priorities. Accordingly, as shown in Fig. 5, multiple zones may be created. Thus, a primary zone 510 is apportioned 70% of the stimuli, a secondary zone 520 is apportioned 20% of the stimuli, and a noncontiguous tertiary zone 530 is apportioned 10% of the stimuli. Fig. 6 shows how, after a course of VRT treatment with the so-apportioned stimuli, the zones may be redefined to reflect changes in the patient's responsiveness (improvement or deterioration). Fig. 7 shows how a particular map element corresponding to a particular neuron may indicate improvement in responsiveness of the particular neuron over a course of stimulative therapy.
  • In various embodiments, zones may be defined and redefined automatically. However, tools may be provided to a therapist to define zones manually. For example, zones may be drawn on a computer screen so as to overlay a visual representation of the visual field (e.g., a campimetric map). For example, circles or ovals may be drawn to demark a zone for preferential stimulus apportionment.
  • In alternative embodiments, the disclosed methods for stimulative therapy may be implemented as a computer program product for use with a computer system. Such implementations may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium. The medium may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques). The series of computer instructions embodies all or part of the functionality previously described herein with respect to the system. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems.
  • Furthermore, such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies. It is expected that such a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web). Of course, some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware. Still other embodiments of the invention are implemented as entirely hardware, or entirely software (e.g., a computer program product).
  • The described embodiments of the invention are intended to be merely exemplary and numerous variations and modifications will be apparent to those skilled in the art. All such variations and modifications are intended to be within the scope of the present invention as defined in the appended claims.

Claims (12)

  1. A system for treating the visual system of a patient, the system comprising:
    - a display having an array of individually actuable light emitting elements adapted to present stimuli to a human during a course of therapy;
    - an apportioner adapted to accept a campimetric representation of the visual field and apportion a sequence of stimuli to specified regions of the visual field; and
    - an actuator for actuating display elements according to the apportionment of the apportioner, characterized in that
    - the apportioner is adapted to apportion a greater share of stimuli to those of the visual field regions nearer the center of the visual field.
  2. A system according to claim 1, wherein the actuator is adapted to present a fixation stimulus to the human.
  3. A system according to claim 1, further comprising means for recording the human's response to the stimuli.
  4. A system according to claim 3, further comprising means for using the record of the human's response to the stimuli to allocate future stimuli.
  5. A system according to claim 4, further comprising means for using a change in the response with time for a given visual field location to allocate future stimuli.
  6. A system according to claim 1, further comprising means for increasing the targeted retinal area of the presented stimulus increases with corresponding distance from the center of the human's visual field.
  7. A system according to claim 6, wherein the retinal area targeted by the subset of elements is in increasing relationship with corresponding distance from the center of the human's visual field by selecting larger stimuli to target peripheral visual field regions and smaller subsets to target central visual field regions.
  8. A system according to any of claims 1 to 7, wherein the apportioner is adapted to apportion by using a campimetric representation of the visual field to define at least a primary zone, a secondary zone, and a remainder zone, the remainder zone comprising the portion of the visual field that is outside of the other defined zones.
  9. A system according to claim 8, further comprising means for presenting a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone.
  10. A system according to claim 8, further comprising means for presenting, over the course of a therapy, a greater number of stimuli to the primary zone than to the secondary zone or to the remainder zone, and a greater number of stimuli to the secondary zone than to the remainder zone.
  11. A system according to any of claims 8 to 10, further comprising means for recording the human's response to the stimuli, and means for using the record of the human's response to the stimuli to redefine one of the primary zone and the secondary zone.
  12. A system according to any of claims 1 to 10, wherein the apportioner uses a campimetric representation of the visual field to define a transition zone bordered by a blind zone and an intact zone and apportions stimuli to the transition zone with a bias towards the central visual field.
EP07759016.4A 2006-03-21 2007-03-21 Process and device for apportioning therapeutic vision stimuli Not-in-force EP2012733B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US78423506P 2006-03-21 2006-03-21
PCT/US2007/064520 WO2007109724A1 (en) 2006-03-21 2007-03-21 Process and device for apportioning therapeutic vision stimuli

Publications (2)

Publication Number Publication Date
EP2012733A1 EP2012733A1 (en) 2009-01-14
EP2012733B1 true EP2012733B1 (en) 2016-02-10

Family

ID=38325560

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07759016.4A Not-in-force EP2012733B1 (en) 2006-03-21 2007-03-21 Process and device for apportioning therapeutic vision stimuli

Country Status (6)

Country Link
EP (1) EP2012733B1 (en)
JP (1) JP2009530062A (en)
AU (1) AU2007226838A1 (en)
CA (1) CA2646080C (en)
ES (1) ES2569401T3 (en)
WO (1) WO2007109724A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009542368A (en) * 2006-06-30 2009-12-03 ノバビジョン, インコーポレイテッド Eccentric vision diagnosis and treatment system
CA2657762C (en) 2006-07-25 2015-07-21 Novavision, Inc. Dynamic stimuli for visual field testing and therapy
WO2008043027A2 (en) 2006-10-04 2008-04-10 Isport, Llc System and method of enhancing a retino-geniculo-cortical pathway for a particular physical activity
PT2552539E (en) * 2010-04-01 2015-11-17 Pixium Vision Sa Retinal implant and visual prosthesis incorporating such an implant
GB201007697D0 (en) * 2010-05-06 2010-06-23 Ucl Business Plc A supra-threshold test for use in detecting sensitivity loss across the field of vision
JP6060525B2 (en) * 2012-05-31 2017-01-18 株式会社ニデック Fundus examination device
WO2021190762A1 (en) 2020-03-27 2021-09-30 Fondation Asile Des Aveugles Joint virtual reality and neurostimulation methods for visuomotor rehabilitation

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5539482A (en) 1992-02-28 1996-07-23 The Australian National University Glaucoma testing using non-linear systems identification techniques
DE9305147U1 (en) 1993-04-03 1994-08-04 Schmielau, Fritz, Prof. Dr.Dr.Dr., 2400 Lübeck Training device for the treatment of patients suffering from perceptual disorders
US5534953A (en) * 1994-07-01 1996-07-09 Schmielau; Fritz Training device for the therapy of patients having perception defects
WO2000012042A1 (en) * 1998-08-27 2000-03-09 Novavision Ag Process and device for the training of human vision
AU2002238539B2 (en) * 2002-02-08 2008-01-24 Novavision, Inc. Improved process and device for the training of human vision

Also Published As

Publication number Publication date
AU2007226838A1 (en) 2007-09-27
CA2646080C (en) 2014-12-02
WO2007109724A1 (en) 2007-09-27
CA2646080A1 (en) 2007-09-27
JP2009530062A (en) 2009-08-27
EP2012733A1 (en) 2009-01-14
ES2569401T3 (en) 2016-05-10

Similar Documents

Publication Publication Date Title
US20070216865A1 (en) Process and Device for Apportioning Therapeutic Vision Stimuli
EP2012733B1 (en) Process and device for apportioning therapeutic vision stimuli
US7753524B2 (en) Process and device for treating blind regions of the visual field
Møller The role of neural plasticity in tinnitus
Sabel et al. Restoration of vision by training of residual functions
Pahwa et al. Bilateral subthalamic stimulation in patients with Parkinson disease: long-term follow up
US7748846B2 (en) Dynamic fixation stimuli for visual field testing and therapy
Plow et al. Temporal profile of functional visual rehabilitative outcomes modulated by transcranial direct current stimulation
US7682021B2 (en) System and methods for the treatment of retinal diseases
US20080013047A1 (en) Diagnostic and Therapeutic System for Eccentric Viewing
Kerkhoff et al. A long-lasting improvement of tactile extinction after galvanic vestibular stimulation: two Sham-stimulation controlled case studies
Fitzgerald et al. A pilot study of bed nucleus of the stria terminalis deep brain stimulation in treatment-resistant depression
JP2009525154A5 (en)
US11235152B2 (en) Systems and methods of conveying a visual image to a person fitted with a visual prosthesis
Pratt et al. Attentional modulation of the gap effect
JP5068770B2 (en) Process and apparatus for treating blind areas of vision
Krigolson et al. Predictive information and error processing: The role of medial‐frontal cortex during motor control
Fornos et al. Simulation of artificial vision: IV. Visual information required to achieve simple pointing and manipulation tasks
Barraza-Bernal et al. A preferred retinal location of fixation can be induced when systematic stimulus relocations are applied
Sahraie et al. Temporal properties of spatial channel of processing in hemianopia
JP2009530062A5 (en)
Ağaoğlu et al. Oculomotor responses of the visual system to an artificial central scotoma may not represent genuine visuomotor adaptation
Leff et al. Hemianopic alexia
Doane Changes in visual function with perceptual isolation.
Inggas et al. Long-term Outcome of Deep Brain Stimulation in Intralaminar Thalamus for Refractory Tourette Syndrome: A Case Report

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20081017

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: KENKEL, SIGRID

Inventor name: SCHLUETER, DOROTHEE

Inventor name: SABEL, BERNHARD

17Q First examination report despatched

Effective date: 20100317

19U Interruption of proceedings before grant

Effective date: 20100428

19W Proceedings resumed before grant after interruption of proceedings

Effective date: 20120601

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: NOVAVISION INC.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150811

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 774285

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160215

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602007044803

Country of ref document: DE

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2569401

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20160510

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160210

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 774285

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160210

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160511

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160610

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160613

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602007044803

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

26N No opposition filed

Effective date: 20161111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160510

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070321

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160331

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160210

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160321

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IE

Payment date: 20220323

Year of fee payment: 16

Ref country code: GB

Payment date: 20220323

Year of fee payment: 16

Ref country code: DE

Payment date: 20220322

Year of fee payment: 16

Ref country code: CH

Payment date: 20220330

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20220321

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20220328

Year of fee payment: 16

Ref country code: ES

Payment date: 20220404

Year of fee payment: 16

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602007044803

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230321

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230321

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230321

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230321

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231003

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230321

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20240430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230322