Classifications

• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
  • A61B3/0016—Operational features thereof
  • A61B3/0025—Operational features thereof characterised by electronic signal processing, e.g. eye models
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
  • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
  • G09B21/001—Teaching or communicating with blind persons
  • G09B21/008—Teaching or communicating with blind persons using visual presentation of the information for the partially sighted
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
  • A61B3/0016—Operational features thereof
  • A61B3/0041—Operational features thereof characterised by display arrangements
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
  • A61B3/0091—Fixation targets for viewing direction
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
  • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T3/00—Geometric image transformations in the plane of the image
  • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/10—Segmentation; Edge detection
  • G06T7/11—Region-based segmentation
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/50—Depth or shape recovery
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/20—Special algorithmic details
  • G06T2207/20112—Image segmentation details
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30196—Human being; Person
  • G06T2207/30201—Face
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/10—Segmentation; Edge detection
  • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation

Definitions

• the invention relates to the field of visual exploration assisting methods for individuals with retinal pathology manifested by scotoma, such as age-related macular degeneration (AMD), Stargardt's disease. or maculopathies.
• AMD age-related macular degeneration
• Stargardt's disease Stargardt's disease. or maculopathies.
• the invention relates more particularly to a method of assisting the visual exploration of a digital image on a display device by an individual suffering from a retinal pathology resulting in a scotoma.
• AMD Stargardt's disease or maculopathies can lead to visual impairment resulting in the progressive destruction of central vision and the development of a blind spot called "scotoma" that suppresses information that reaches the foveal region.
• This information is essential for performing certain daily tasks such as reading or more generally the recognition of objects in an image.
• the absence of therapies capable of definitively eliminating this attack obliges the individual to opt for assistance procedures that are often of an optical nature.
• the system consists of informative glasses with an eye tracker. If the user is an individual with AMD, the system takes into account the area of the visual field of the individual who is masked by his macular scotoma. First, the glasses capture the image of a scene and project it onto ophthalmic lenses. Then, the oculometer implanted on these glasses makes it possible to measure the position of the look on the projected image. The user can activate the enrichment of the image area which is masked by his scotome. The enrichment of this image zone can be either the increase of its size, the increase and the offset of its lines, or a displacement and a deformation of its lines around the scotome.
• the position of the gaze and the size of the scotoma are used to define the enriched information near the scotoma. He is thus able to adapt to the characteristics of the scotome of each individual.
• the image processing proposed by this system takes into account the retinal pathology of the individual, the enrichment performed does not take into account fundamental aspects of reading in the presence of a macular scotoma. Indeed, this system only acts on the pixels of the image area, to move the information masked by the scotome. Consequently, it does not allow to optimize the interaction between the position of the gaze, the size of the scotome and the entities "words" and "letters" of the text.
• this system does not offer a control system that takes into account oculomotor events in the absence of central vision, which is however necessary to optimize the eye movements of individuals with retinal pathology. From these facts, this system may lack efficiency in terms of comfort and in particular in terms of reading performance.
• the present invention aims to overcome one or more of the disadvantages mentioned above by proposing a method of assisting the visual exploration of a digital image on a display device by an individual suffering from a retinal pathology. translating with a scotome, the digital image being composed of a dot matrix segmentable in zones.
• the method of the invention is essentially such that it comprises the steps of:
• the method thus advantageously makes it possible not only to use the position of the gaze and the size of the scotome in order to define the information to be reproduced in an enriched manner, but also to detect different objects of the image, to specifically identify those that the individual explores or wishes to explore visually and to optimize the enriched display of this object so as to compensate for the factors limiting its vision.
• the method further comprises the steps of: determining a zone of interest comprising at least one object zone, according to a criterion for positioning the blind zone on the digital image, the blind zone being positionable on the display device by slaving to a pointing device,
• the highlighting of the object zone consists in enriching the determined zone of interest by modifying it and reproducing it in a vision zone according to at least one predetermined treatment.
• the method thus advantageously makes it possible to visually inform the individual that he can enrich an object recognized by its automatic marking.
• the criterion for positioning the blind zone on the digital image according to which the area of interest is determined is chosen from:
• a criterion for recovering the zone of interest by the blind zone and a criterion for recovering the zone of interest by a preferred fixing zone determined for each individual, the positioning of this preferential fixing zone on the device. display being relative to the positioning of the blind area on the same device.
• said recovery criterion consists of determining:
• the enrichment of the area of interest further comprises moving the viewing area so that it is fully reproduced on the display and has a substantially maximum overlap with the area of vision which would be only partially reproduced on the display device according to said predetermined processing.
• the highlighting of the object area is controlled by the individual by actuating, and optionally maintaining actuated, an actuator, and the method further comprises a step of returning to the digital image before enrichment, this return being controlled by the individual by actuation, and possibly by loosening, of the actuator, respectively.
• the method according to this feature thus advantageously allows the individual to control the duration of the enrichment.
• At least one zone among the blind zone and the zone of vision comprises a visible marking on the display device.
• the method according to this feature thus advantageously makes it possible to help the individual to be aware of the extent of his scotome to enable him to optimize his eye movements.
• the method according to this feature also advantageously allows to help the individual to stabilize vertically on the line he is reading.
• the pattern recognition software comprises an algorithm for segmenting objects with respect to the background which is based on the principle of the segregation figure-background used in automatic image processing.
• the method according to this first embodiment is thus advantageously adapted to the local or semi-local recognition of objects, faces or geometric shapes.
• the predetermined treatment of the area of interest consists of the gradual enlargement of its size and possibly its gradual shift from its initial position in the digital image to occupy the device the viewing area and the method further comprises a step of returning to the digital image before enrichment consisting of a progressive decrease in the size of the enriched area of interest and possibly a progressive shift of its position to his return to his size and his position before enrichment.
• the method according to this feature of the first embodiment thus advantageously allows the individual to keep a memory of the initial position of the area of interest in the digital image, in particular to facilitate the subsequent visual exploration of the rest of the image. digital image.
• the shift of the position of the enriched area of interest also makes it possible advantageously to coincide as well as possible the zone of vision with a preferential fixing zone determined for each individual.
• the visual exploration assistance method is a reading assistance method;
• the digital image includes a text to be read;
• the pattern recognition software includes character recognition software, for recognizing at least a portion of text by segmenting into line areas, and then segmenting each line area into word areas;
• the object area is a word box;
• the vision zone is located on the periphery of the blind zone.
• the method according to its second embodiment thus advantageously makes it possible not only to use the position of the gaze and the size of the scotome in order to define the information to be reproduced in an enriched manner near the scotome, but also to detect different words of the image, to specifically identify a group of words that the individual wishes to read, visually inform the individual that he can enrich this group of words by the automatic marking of the latter and optimize the enriched display of this group of words from to compensate for the factors limiting his reading ability. It should also be noted that segmenting the image into word areas makes it possible to reproduce whole words in the viewing area.
• the method further comprises, prior to the determination of the area of interest, a step of modifying the image of the text by resizing it and / or by changing the spacing of the image. line spacing according to the size of the characters, the length and / or number of lines, the size of the display device and / or the size of the blind area.
• the recognition of said at least one text portion further comprises the segmentation of each word area into letter areas.
• the method according to its second embodiment thus advantageously allows a modification and a more finely controlled reproduction of the words located in the area of interest.
• the zone of interest comprises, in addition to said at least one word zone, at least two other word zones belonging to the same line zone, each word zone of the area of interest being juxtaposed with another word zone of the area of interest.
• said at least one predetermined treatment of the area of interest consists of:
• the method according to its second embodiment thus advantageously makes it possible to modify each of the words of the area of interest differently.
• the size of the characters and / or the spacing between the characters are further increased as the characters are intended to be reproduced on a line of the viewing zone farther from the blind zone.
• the method thus advantageously makes it possible to limit or eliminate the phenomenon of visual bulk.
• the method according to its second embodiment thus advantageously makes it possible to avoid that one and the same group of words is enriched several times and / or that successive areas of interest have zones of words in common, or at least allows to signal to the individual these occurrences.
• the method can thus advantageously make it possible to signal to the individual the next group of words to be enriched.
• the method further comprises a step of displaying on the display device a marker to the left of the line zone located directly below the line zone comprising the zone d 'interest.
• the method comprises, prior to reproduction in the viewing zone of the zone of interest treated or prior to determining the zone of interest according to a choice of said positioning criterion, a step of determining the peripheral position of the viewing zone with respect to the blind zone as corresponding to the position of a preferred binding area determined for each individual.
• the method thus advantageously makes it possible to optimize, in a manner adapted to each individual, the effectiveness of servo control in the absence of macular vision.
• the determination of the peripheral position of the viewing zone with respect to the blind zone comprises the calibration steps consisting of:
• the zone of vision is located juxtaposed and centered below or above the blind zone.
• the method according to its first and second embodiments thus advantageously allows the individual to identify the largest number of visual characteristics, such as letters, in a single attachment and thus to increase its visual span.
• the method according to this other feature allows the individual to retain, even during the display of the viewing zone, its perceptive span intact.
• the pointing device slaving the positioning of the blind zone is selected from a computer keyboard, a mouse and an eye tracker.
• the invention relates to a computer program comprising instructions for implementing the method according to any one of the preceding claims, when this program is executed by a processor.
• the advantages provided by the computer program as succinctly set forth above are at least the same as those mentioned above in connection with the method according to the first aspect of the invention.
• FIG. 1 illustrates the evolution of maximum reading speeds in central vision and in peripheral vision as a function of the size of the characters read
• FIG. 2 illustrates the visual span (on the left) and the effect of the size of the visual span on the reading speed (on the right),
• FIGS. 3a and 3b illustrates the phenomenon of visual congestion and a mode of suppression of this phenomenon according to the invention
• FIGS. 4a, 4b, 4c and 4d illustrate several variants of the second embodiment of the method according to the invention
• FIG. 5 illustrates a feature of the second embodiment of the method according to the invention
• FIG. 6 illustrates another feature of the second embodiment of the method according to the invention
• FIGS. 7a and 7b illustrate an embodiment of the determination of the peripheral position of the zone of vision with respect to the blind zone
• FIG. 8 represents a flow chart of the steps of the method according to its first and second embodiments.
• FIGS. 9a and 9b illustrate a feature of the method according to the invention in its second embodiment
• FIG. 10 illustrates the first embodiment of the method according to the invention.
• the invention relates to a method S of assisting the visual exploration of a digital image I on a display device D by an individual suffering from a retinal pathology resulting in a scotoma.
• the digital image I is composed of a dot matrix segmentable in zones.
• Process S comprises the steps of:
• the method S thus advantageously makes it possible not only to use the position of the gaze and the size of the scotome in order to define the information to be reproduced in an enriched manner, but also to detect different objects of the image I, to identify specifically those that the individual explores or wishes to visually explore and optimize the enriched display of that object so as to compensate for the factors limiting his vision.
• the method S further comprises the steps of:
• highlighting S70, S90 of the object area is to enrich the area of interest Z2 determined by modifying S70 and reproducing S90 in a viewing zone Z3 according to at least one predetermined treatment.
• the blind zone Z1 must be freely positionable by the reader on the display device D and more particularly on the digital image I. This is achieved by slaving the positioning of the blind zone Z1 to a pointing device, such as a computer keyboard, a mouse or preferably an eye tracker.
• a pointing device such as a computer keyboard, a mouse or preferably an eye tracker.
• the method thus advantageously makes it possible to visually inform the individual that he can enrich an object recognized by its automatic marking.
• the marking MZ2 of the zone of interest Z2 allows the individual to be aware of the recognized object that he can enrich.
• the marking of any zone, and of the zone of interest Z2 in particular, consists of the action of bringing out the graphical element (or more particularly the part of text according to the second embodiment described lower) constituting this zone by modifying its visual attributes.
• the marking may consist of an outline and / or a highlighting of the zone.
• the positioning criterion of the blind zone Z1 on the digital image I according to which the zone of interest Z2 is determined is chosen from: a criterion for recovering the zone of interest Z2 by the blind area Z1, and
• said recovery criterion consists of determining: the positioning of a specific point of the blind zone Z1 or of the preferential fixing zone PRL on the zone of interest Z2, said specific point being for example the center or the lower right corner of the zone considered, or - a greater area of overlap of the zone of interest Z2 by the blind zone Z1 or by the preferred zone of attachment PRL.
• the recovery criterion by determining a larger overlap surface probably requires some simple geometric calculations, for example based on the coordinates of each recognized object. These calculations are supposed to be within the skill of the skilled person.
• the zone of interest Z2 may be located close to an edge of the display device D so that the viewing area Z3 would only be partially reproduced on the display device D according to said predetermined processing.
• the enrichment of the zone of interest Z2 consists, in addition to the modification S70 and the reproduction S90 of the zone of interest Z2, in displacing the zone of vision Z3 so as to it is entirely reproduced on the display device D.
• This displacement is preferably made so that the vision zone Z3 thus displaced has a substantially maximum overlap with the zone of vision Z3 which would only be partially reproduced.
• This preference is all the more marked as the position of the zone of vision Z3 with respect to the blind zone Z1 is chosen as corresponding to the position of a preferred fixation zone determined for each individual, for example according to the test described below. .
• the highlighting of the object zone or the enrichment of the area of interest Z2 determined is controlled by the individual by actuating an actuator and the method may further comprise a step of return to the digital image I before enrichment, this feedback being controlled by the individual also by actuation of the actuator.
• actuation of the actuator can be maintained by the individual, and possibly the step of returning to the digital image I before enrichment is controlled by releasing the actuator.
• the method S according to this feature thus advantageously allows the individual to control the trigger and the duration of the enrichment.
• at least one zone among the blind zone Z1 and the vision zone Z3 comprises a visible marking on the display device.
• the method thus advantageously makes it possible to help the individual, not only to stabilize on the recognized object that he wishes to enrich, but also to be aware of the extent of his scotome to enable him to optimize his eye movements.
• the method according to its first embodiment illustrated in FIG. 10 is essentially such that the pattern recognition software comprises an algorithm for segmenting objects with respect to the background which is based on the principle of the segregation figure-background employed in treatment. automatic image.
• the method according to this first embodiment is thus advantageously adapted to the local or semi-local recognition of objects, faces or geometric shapes.
• Figure 10 shows drawings showing the same picture of three characters together with the blind zone Z1 representing the scotoma of the individual. At least one face of one of the three characters has been recognized as an object to be enriched. As illustrated in the photo in the center of FIG. 10, the inducing individual, according to the positioning criterion described above, the blind zone on this face sees a (black) outline around it so that it is informed of the possibility offered to enrich the recognized face for example in the manner illustrated in the drawing on the right of Figure 10.
• the predetermined processing of the zone of interest Z2 consists, as shown in the right-hand picture of FIG. 10, in enlarging the size of the zone of interest Z2, or equivalent to the object area ZO, including the recognized object.
• this enlargement is progressive in size until occupy on the display device D the viewing zone Z3. This enlargement can also be directly controlled by the individual for example via the wheel of his mouse.
• a progressive shift of the object area ZO from its initial position in the digital image I can be advantageously achieved so that the enriched object is in the center of the viewing area, especially when the position of the area of Z3 vision with respect to the blind zone Z1 is chosen as corresponding to the position of the preferred area PRL fixation.
• the method S may further comprise a step of returning to the digital image I before enrichment consisting of an inverse progressive decrease in the size of the enriched zone of interest Z2, and possibly in an inverse progressive shift of its position until its return to its size and its position before enrichment.
• the method S relates more particularly to a method of assisting reading on a display device of a text intended to be read by an individual suffering from a retinal pathology resulting in a scotoma is described below with reference to Figures 1 to 9.
• the text is part of a digital image I composed of a matrix of points. Like any matrix of points, that composing the image of the text is segmentable into zones. Each zone is preferably made of a single piece.
• the method comprises a step of modifying the image of the text.
• This modification may consist of a resizing of the digital image I.
• the image of the text is resized so that the lines of the text begin at an edge of the display device D on which the image of the text is displayed. and terminate before an opposite edge of the display device, so that it is not necessary for the reader to move the image, during its reading, with a corresponding scroll bar at the end and at the beginning of each line of text.
• Such resizing may automatically induce a change in interline spacing, but it is also suggested that this latter modification may be operated independently.
• This step of modifying the image is preferably carried out taking into account at least one parameter among: the size of the characters, the length and / or the number of lines, the size of the display device and / or the size of the a so-called blind zone Z1 representing the scotoma of the individual on the display device.
• the text image is resized so that the blind area does not overlap more than two successive line portions.
• the method according to the invention comprises a step of recognizing S10, using a character recognition software, at least a portion of text by segmenting it into line zones ZL, then by segmenting each line zone into ZM word zones.
• the recognition software designates a computer process for the translation of images of printed or typed texts into text files, such as Optical Character Recognition (OCR) software.
• OCR Optical Character Recognition
• the method according to the invention further comprises a step of determining S30 the blind zone Z1.
• This blind zone represents the scotoma of the individual on the display device D.
• this blind zone contains entirely the scotoma.
• the shape of this zone may for example be adapted to the shape of the scotoma of an individual, generally approximately the shape of a disk, or be defined by default, for example in a rectangular form.
• the method according to its second embodiment further comprises a step of determining S50 an area of interest Z2 comprising at least one ZM word area.
• the positioning and overlapping criteria are as described above.
• the words included in the zone of interest Z2 may for example be located under or near the edges of the blind zone Z1.
• the few simple geometric calculations necessary for the determination of a larger surface area are based on the detection of the coordinates of each word zone and possibly each letter zone.
• the line zones and the successive word zones are not necessarily juxtaposed, for example so that the sum of all the zones completely covers the area. image of the text, but may instead be slightly spaced apart by empty text areas.
• the zone of interest Z2 determined according to one of the previously described positioning or overlapping criteria is displayed S60 on the display device via a marking MZ2 allowing its visualization.
• the method according to the invention further comprises a step of modifying S70 the zone of interest Z2 according to at least one predetermined treatment and a step of reproducing S90 the zone of interest Z2 treated in a vision zone Z3 located on the periphery of the blind zone Z1.
• the modification S70 and the reproduction S90, or the single reproduction S90 are for example controlled by the individual by pressing a mouse button or a key on the keyboard.
• the recognition S10 of said at least one text portion further comprises the segmentation of each word area into letter areas.
• the method thus advantageously allows an S70 modification and a more finely controlled S90 reproduction of the words situated in the area of interest, for example by winding deformation of the letters of the group of words to be enriched or by an increase in the size of the letters furthest from the center of the scotome greater than that of the letters closest to the center of the scotoma.
• segmentation of the letter area image is performed, the coordinates of each letter area are detected for use.
• the enrichment performed according to the second embodiment of the method advantageously takes account of fundamental aspects of a reading exercise in the presence of a macular scotoma. Indeed, this enrichment is not content to move the information masked by the scotome (by resizing or distorting the image of the text), but recognizes the words of the image, specifically identifies those that the individual wish to read and optimize the display of these words so as to compensate for the factors limiting the reading in the presence of a scotome.
• Figure 1 therefore illustrates the reading performance as a function of the size of the characters for individuals using their normal vision (a) and individuals using their peripheral vision (b).
• the visual span is defined as an essential notion in reading studies. It corresponds to the extent of the visual field in which the letters can be identified apart from any linguistic information. It quantifies the number of letters that can be identified from a fixation without resorting to the context.
• the image on the left of Figure 2 illustrates the notion of visual span (EV). If the gaze of the individual fixes the center of the circle containing the words, his visual span then corresponds to the words "this must”.
• visual clutter is the product of spatial interaction between adjacent letters of a word, or between the words themselves. If the letter (or word) to be identified has a sufficiently large isolation area, congestion does not act on its identification. On the contrary, when other letters (or words) are present within this zone, the identification of the letter in question is disturbed.
• the size of the spatial area (called the isolation zone) necessary to avoid the phenomenon of visual congestion grows proportionally to the eccentricity. Figure 3a demonstrates this.
• the preferential area of PRL fixation is defined as the area of vision towards which attention is deployed, in the presence of a scotoma. Indeed, when a central scotoma is present, the center of the retina can not be used to identify a target and the individual is forced to focus his attention outside of the affected area thus dissociating his eyes from the area of attention deployment.
• the preferential fixation zone is thus spontaneously displaced, in the presence of a scotoma, towards one or more zones of healthy Z3 vision of the extrafoveal retina.
• these preferred attachment areas are detectable and positionable, for example using an eye tracker.
• the step of modifying the image of the text makes it possible to put the characters of the text to a size which allows the individual to read each words by placing themselves at the threshold of word acuity according to the size of the scotoma.
• This font size of the text is large enough to allow the individual to have a correct reading with his scotome, but not too large to avoid the loss of global information on the text.
• the line spacing of the text can be increased, depending on the size of the scotome, so that the individual can better position his scotome on the line being played. Referring to FIG.
• said at least one predetermined processing of the zone of interest Z2 consists of a segmentation of each word zone into character (or letter) zones and in an increase of the spacing between the characters, to allow to limit, even to avoid, the phenomenon of visual congestion.
• Figure 3b illustrates this by showing, on the left, a word whose spacing between the letters is normal, which makes difficult its identification in eccentric vision (by fixing the cross on the left), and on the right, a word whose spacing between the letters is increased, which makes it easier to identify in eccentric vision (by fixing the cross on the right).
• the zone of interest Z2 may comprise, in addition to said at least one word zone covered, at least two other word zones belonging to the same line zone, each zone the word of the zone of interest Z2 preferably being juxtaposed with another word zone of the zone of interest Z2.
• a feature already introduced above with reference to the first embodiment of the method at least one zone among the blind zone Z1 and the vision zone Z3 comprises a visible marking. on the display device.
• the method according to this feature thus advantageously makes it possible to further help the individual to stabilize vertically on the line he is reading.
• the blind area Z1 is delimited by an outline and the presence of this outline helps the individual to be aware of the boundaries of his blind spot and allows him to optimize his eye movements.
• the blind zone Z1 is brought by the individual by means of the pointing device to the group of words that he wishes to enrich.
• Zone of interest Z2 is displayed to help the individual to position himself on his target.
• the predetermined treatment or enrichment of the area of interest Z2 is according to this example an increase in size, an increase whose amplitude may for example depend on the size of the blind zone Z1.
• the blind zone Z1 is put in transparency so as to see the words it covers, whereas, in real situation, the words covered by the blind zone are masked to the individual by his scotome and are therefore invisible as illustrated in Figures 4c and 4d.
• the method S according to its second embodiment is implemented identically to the example discussed above with reference to FIG. 4a, except that the enrichment of the zone d
• the interest Z2 consists not only in an increase in its size, but also in a distribution of the words it comprises on several lines, in this case two lines, of the zone of vision Z3.
• the method S is implemented identically to the example discussed above with reference to FIG. 4b, except that the enrichment of the zone of interest Z2 furthermore comprises in that the character size and / or the spacing between the characters are further increased as the characters are reproduced S90 on a line of the viewing zone Z3 further from the blind zone Z1.
• the method S is implemented identically to the example discussed above with reference to FIG. 4c, except that the zone of interest Z2 comprises a long word zone ZM. and the enrichment of this area of interest further comprises a break of the long word.
• a preceding zone of interest Z20 and / or a next zone of interest Z22 respectively situated on either side of a zone of current interest Z21 (determined at step S50) are further determined.
• each zone Z20, Z21 and Z22 comprises a visible contour on the display device.
• the method further comprises a step of displaying on the display device a Z4 mark to the left of the line zone located directly below the line zone comprising the area of interest Z2. Wrapping is an important problem when reading text in eccentric vision.
• Figure 6 shows how a Z4 marker, here a black rectangle, to the left of the text can help locate the beginning of a next ZL line zone.
• the method S makes it possible to choose the words situated under the lower edge of the scotome.
• the black rectangle is displayed when the individual places the edge of his scotome on an area of interest Z2 of a line zone ZL which is just above it and remains for example displayed for a few seconds, for example during 3 seconds.
• the zone of interest Z2 is right next to the black rectangle Z4. If the individual misses the line, the black rectangle Z4 is not on the same line as the zone of interest Z2 and the individual thus perceives that he is not on the subsequent line.
• a test for selecting the preferential area of attachment PRL, possibly vertical, of the individual is performed to display the enriched words in an optimal position of the visual field of the individual.
• the method S comprises, prior to the reproduction S90 in the viewing zone Z3 of the zone of interest Z2 treated, a step of determining the peripheral position of the viewing zone Z3 with respect to the blind zone Z1 as corresponding to the position of a preferred fixation zone determined for each individual, for example by taking into account the position and the size of his scotoma.
• the determination of the peripheral position of the zone of vision Z3 with respect to the blind zone Z1 comprises the calibration steps consisting of: displaying on the display device a plurality of targets F,
• the determination of the peripheral position of the viewing zone Z3 with respect to the blind zone Z1 comprises the calibration steps of: displaying on the display device a plurality of targets F,
• the zone of vision Z3 or RVA (for Region of Augmented Vision) is then preferentially displayed on the preferential zone of attachment PRL of the individual.
• the preferential area of attachment PRL of the individual is supposed to have been determined according to the test described above as being vertical and located under the scotoma, so that that, as shown, the viewing zone Z3 is located vertically above the blind zone Z1 and beneath it.
• the center of the zone of vision Z3 is preferably aligned with the center of the blind zone Z1, which allows the individual to identify the largest number of letters in a single fixing and thereby increase its visual span. It should be noted that, according to the second embodiment of the method, the zone of interest Z2 remains preferably visible while the viewing zone Z3 is displayed.
• the zone of interest Z2 is located near an edge of the display device D so that the viewing zone Z3 is only partially reproduced on the display device D according to said predetermined processing may also induce a limitation of the area of interest to the word area located closest to the edge of the display device.
• the method advantageously provides that other word areas located in the same line area, on a side opposite to the edge of the display device is also selected as being included in the area of interest to continue take full advantage of the visual span of the individual, including in this situation.
• the text of the image can be fully recognized S10 in one go by the character recognition software.
• some only text can be recognized which would be for example selected by the reader on the image by a mouse movement together with a pressure on its left button. Another part of the text could then be selected in the same way.
• the recognition S10 and the other steps S30 to S90 of the method can be triggered by the individual by pressing a mouse button or a key on the keyboard.
• the method according to the invention is implemented on a computer comprising at least one processor capable of executing a computer program comprising instructions for implementing the method.
• any reference to a line of text is to be considered with regard to writing and reading a given language. Therefore, depending on the language considered, it may be considered a column instead of a line, without departing from the invention as claimed.
• the preceding areas of interest Z20, current Z21 and following Z22 as illustrated in FIG. 5 illustrate a direction of reading going from left to right, while certain other languages, such as Arabic, use a sense of writing and reading opposite.
• the present invention is also directed to a computer program comprising instructions for implementing the above method, when this program is executed by a processor. It also aims at a support (non transitory in particular) storing such a program.
• the computer program can be written in different programming languages, such as for example the Python TM language.
• this program may be based on applications and / or programming interfaces to facilitate their development; an application of this type is for example known under the trade name PsychoPy TM and a programming interface of this type is for example the OpenGL TM interface.
• the method according to the invention can be implemented using different hardware to facilitate the visual exploration of different digital contents.
• the display device may consist of a computer screen or tablet and the content in question may consist of a digital book or a virtual tour.
• the content can then be processed according to the method simultaneously with its visual exploration or upstream of one or all visual exploration.
• the digital content of the virtual tour such as an art gallery, can be pre-processed by recognizing the works of art exhibited there as objects in object areas, so that said zones can be enriched according to the method of the invention during any future visual explorations to facilitate to any user the visual exploration of the exposed works of art.
• the display device may consist of glasses of video or multimedia glasses connected or not to a communication network, such as the Internet, and the digital image I displayed on them.
• spectacle lenses may then consist wholly or partly of a shooting of the visual field of the wearer of the spectacles. This shooting can be performed by a camera arranged on the glasses and refreshed continuously to be representative of what is seen at every moment, the wearer through his glasses.
• the recognition of objects in this shooting can then be carried out continuously, for example the faces of people in the visual field of the wearer can be recognized as objects included in object areas, so that said Zones may be enriched according to the method of the invention, at least to facilitate the bearer identification of said persons.
• the enriched object area can also be refreshed continuously to be representative of the movements, and more generally of any evolution in time, of the recognized objects.

Landscapes

• Health & Medical Sciences (AREA)
• Engineering & Computer Science (AREA)
• Life Sciences & Earth Sciences (AREA)
• Physics & Mathematics (AREA)
• General Health & Medical Sciences (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Veterinary Medicine (AREA)
• Surgery (AREA)
• Public Health (AREA)
• Animal Behavior & Ethology (AREA)
• Molecular Biology (AREA)
• Biophysics (AREA)
• Ophthalmology & Optometry (AREA)
• Biomedical Technology (AREA)
• Heart & Thoracic Surgery (AREA)
• Medical Informatics (AREA)
• Business, Economics & Management (AREA)
• Educational Technology (AREA)
• Educational Administration (AREA)
• Audiology, Speech & Language Pathology (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Signal Processing (AREA)
• Eye Examination Apparatus (AREA)
• User Interface Of Digital Computer (AREA)
• Controls And Circuits For Display Device (AREA)
• Processing Or Creating Images (AREA)
• Image Processing (AREA)
• Image Analysis (AREA)

Priority Applications (1)

Applications Claiming Priority (3)

Publications (1)

Family

ID=49054480

Family Applications (1)

Country Status (8)

Families Citing this family (13)

Family Cites Families (7)

• 2014
  • 2014-08-07 CN CN201480045875.1A patent/CN105637570B/zh active Active
  • 2014-08-07 KR KR1020167004201A patent/KR102306768B1/ko active IP Right Grant
  • 2014-08-07 EP EP14750203.3A patent/EP3036733A1/fr active Pending
  • 2014-08-07 CA CA2921476A patent/CA2921476C/fr active Active
  • 2014-08-07 JP JP2016535402A patent/JP6502351B2/ja active Active
  • 2014-08-07 US US14/912,452 patent/US9861274B2/en active Active
  • 2014-08-07 BR BR112016003520-8A patent/BR112016003520B1/pt active IP Right Grant
  • 2014-08-07 WO PCT/EP2014/067017 patent/WO2015024790A1/fr active Application Filing

Non-Patent Citations (2)

Also Published As

Similar Documents

Legal Events