WO2019101841A1 - Dispositif et procédé de lecture de textes numériques associés à des effets audiovisuels - Google Patents

Dispositif et procédé de lecture de textes numériques associés à des effets audiovisuels Download PDF

Info

Publication number
WO2019101841A1
WO2019101841A1 PCT/EP2018/082177 EP2018082177W WO2019101841A1 WO 2019101841 A1 WO2019101841 A1 WO 2019101841A1 EP 2018082177 W EP2018082177 W EP 2018082177W WO 2019101841 A1 WO2019101841 A1 WO 2019101841A1
Authority
WO
WIPO (PCT)
Prior art keywords
digital
digital text
highlighting
scrolling
reading
Prior art date
Application number
PCT/EP2018/082177
Other languages
English (en)
Inventor
Luca Tommaso BILOTTA
Original Assignee
Movie Book S.R.L.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Movie Book S.R.L. filed Critical Movie Book S.R.L.
Publication of WO2019101841A1 publication Critical patent/WO2019101841A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Definitions

  • the present invention relates to a device and a method for reading digital texts combined with audiovisual effects, which are particularly, although not exclusively, useful and practical in digital reading devices, i.e. e-book readers, smartphones, tablet computers and the like, which make it possible to read and manage a large number of texts in digital format.
  • Another drawback of such conventional solutions consists in that they do not perform any active social function for children or for people with motor difficulties in their upper limbs or with learning difficulties, for example people who are affected by specific learning disabilities (LD).
  • LD learning disabilities
  • the aim of the present invention is to overcome the limitations of the known art described above, by devising a device and a method for reading digital texts combined with audiovisual effects which make it possible to involve the user more, and more actively, in his/her activity of reading digital texts.
  • an object of the present invention is to conceive a device and a method for reading digital texts combined with audiovisual effects which allow the user not to repeatedly turn or change the pages of the digital texts during his/her reading activity.
  • Another object of the present invention is to devise a device and a method for reading digital texts combined with audiovisual effects which enable a synergy with specific applications relating to digital texts.
  • Another object of the present invention is to conceive a device and a method for reading digital texts combined with audiovisual effects which enable high scalability and the use of the latest technologies.
  • Another object of the present invention is to provide a device and a method for reading digital texts combined with audiovisual effects which perform an important active social function, increasing the learning of children and helping persons with motor difficulties in their upper limbs or with learning difficulties, for example people who are affected by specific learning disabilities (LD).
  • LD learning disabilities
  • Another object of the present invention is to provide a device and a method for reading digital texts combined with audiovisual effects which make it possible to access digital texts easily and securely.
  • Another object of the present invention is to provide a device and a method for reading digital texts combined with audiovisual effects which are highly reliable, easily implemented, and at low cost if compared to the prior art.
  • a device for reading digital texts combined with audiovisual effects said device being operated by a user and comprising means for display configured to display a digital text and play video effects, means for selection configured to select said digital text, means for audio playback configured to play audio effects, and means for storing texts and audiovisual effects, characterized in that it further comprises a scrolling and highlighting module configured to perform an automatic scrolling and an automatic highlighting of said digital text, and an adjustment module configured to adjust the speed of said scrolling and said highlighting of said digital text, and in that said means for audio playback are further configured to play, upon the display of said digital text, audio effects stored in said means for storing texts and audiovisual effects and associated and synchronized with said digital text.
  • Figure 1 shows a typical use case of an embodiment of the device for reading digital texts combined with audiovisual effects, according to the present invention
  • Figure 2 is a block diagram that schematically illustrates an embodiment of the device for reading digital texts combined with audiovisual effects, according to the present invention
  • Figure 3 is a block diagram that schematically illustrates the acquisition assemblage of an embodiment of the device for reading digital texts combined with audiovisual effects, according to the present invention
  • Figure 4 is a block diagram that schematically illustrates the storage assemblage of an embodiment of the device for reading digital texts combined with audiovisual effects, according to the present invention
  • Figure 5 is a flowchart that illustrates an embodiment of the method for reading digital texts combined with audiovisual effects, according to the present invention
  • Figures 6a and 6b show a first example screen, displayed by an embodiment of the device for reading digital texts combined with audiovisual effects, according to the present invention
  • Figures 7a and 7b show a second example screen, displayed by an embodiment of the device for reading digital texts combined with audiovisual effects, according to the present invention.
  • the device for reading digital texts combined with audiovisual effects comprises substantially a control unit 18, means for display 32, means for audio playback 24, means for selection 26, an adjustment module 20, a scrolling and highlighting module 22, a profiling module 30, an acquisition assemblage 52, and a storage assemblage 54.
  • the acquisition assemblage 52 comprises video acquisition means 28 and audio acquisition means 31.
  • the storage assemblage 54 comprises means for storing texts and audiovisual effects 34, means for storing audio recordings 35 and means for storing user data 36.
  • the device 10 such as for example a tablet computer, a smartphone, a notebook computer etc., operated by a user 12, is preferably a portable or mobile device.
  • the device 10 is configured for the input, by way of the means for selection 26,“user data” by the user 12, such as for example personal details, a home address, an email address, a profile photo, and so on.
  • the device 10 is further configured to display, by way of the means for display 32, for example a digital text 16, video effects and so on.
  • the device 10 is further configured to execute, by way of the scrolling and highlighting module 22, an automatic scrolling of the digital text 16.
  • the device 10 is further configured to execute, by way of the scrolling and highlighting module 22, an automatic highlighting of the digital text 16 by way of an underlining 56 or a change of color of the digital text 16 being read.
  • the device 10 is further configured to play, by way of the means for audio playback 24, audio effects associated with the digital text 16, such as for example sounds, music tracks, an audio recording and the like.
  • the device 10 is further configured to adjust, by way of the adjustment module 20, the speed of automatic scrolling and highlighting of the digital text 16.
  • the control unit 18 of the device 10 for reading digital texts combined with audiovisual effects is the main functional element of the device 10 according to the invention, and for this reason it is connected to and in communication with the other elements that are comprised in the device 10.
  • the control unit 18 of the device 10 is provided with suitable capacity for processing and for interfacing with the other elements of the device 10, and it is configured to command, control and coordinate the operation of the elements of the device 10 to which it is connected and with which it is in communication.
  • the means for display 32 of the device 10 for reading digital texts combined with audiovisual effects are configured to display to the user 12 primarily a digital text 16, but also user data and information.
  • the digital text 16 is associated with one or more static illustrations.
  • the digital text 16 is adjacent to one or more static illustrations.
  • the digital text 16 is integrated within one or more static illustrations, such as for example a comic strip or the like.
  • the means for display 32 are further configured to play video effects associated and synchronized with the digital text 16, during the reading activity. In an embodiment, the means for display 32 are further configured to play video effects associated and synchronized with the digital text 16 upon the reading of a single digital word 17 or a plurality of digital words 17 comprised in the same digital text 16. In an embodiment, the means for display 32 are further configured to play video effects that are not associated with any digital text 16, such as for example a frame with no dialog comprised in a comic strip, during the reading activity.
  • the video effects can comprise static illustrations or images, for example in .jpg, .bmp, .png format, and the like, and/or graphic animations, for example in .gif format, and the like.
  • Figures 6a and 6b show a screen 52 that comprises a first portion 53 of the digital text 16, which corresponds to the title, and a second portion 54 of the digital text 16, which corresponds to the narration, both portions 53 and 54 being associated with a static illustration 55.
  • the presence of these static images and/or graphic animations enables a user 12, such as for example a child or an adolescent, to read a story, a school textbook or a comic strip, ensuring said user 12 a complete visual perception.
  • the means for display 32 are further configured to execute an automatic scrolling of two-page static illustrations from one end to the other, with or without a digital text 16 which may be optionally integrated in one or more static illustrations. Scrolling or sliding the framing toward the side page enables a complete vision of the static illustration that extends over a double page spread. Instead of changing page, which makes the previous page disappear and hence interrupts the vision of the user 12, the device 10 thus configured enables a continuity of display of the two pages that comprise the static illustration.
  • the means for display 32 of the device 10 comprise a screen, preferably a touch-screen.
  • the means for display 32 are connected to the means for storing texts and audiovisual effects 34, by way of the control unit 18.
  • a description of the means for storing texts and audiovisual effects 34 is given below in the present description.
  • the means for selection 26 of the device 10 for reading digital texts combined with audiovisual effects are configured for the user 12 to select digital texts 16, user data, images, commands and the like.
  • the means for selection 26 of the device 10 comprise a keypad or a set of buttons.
  • the means for selection 26 of the device 10 comprise a touch-screen.
  • the means for selection 26 of the device 10 comprise a graphical user interface (GUI) adapted to interact in input and in output between the user 12 and the device 10.
  • GUI graphical user interface
  • the graphical user interface of the means for selection 26 offers as output a plurality of information, in the form of screens, which the user 12 can in each instance select and/or display by way of the device 10.
  • the audio acquisition means 31 of the device 10 for reading digital texts combined with audiovisual effects are configured for the user 12 to make audio recordings.
  • any user 12 can record his/her voice by way of the audio acquisition means 31 while he/she conducts a complete reading of the digital text 16 or of a plurality of digital words 17 comprised in the digital text 16. Afterward, such audio recording can be heard by any other user 12 as an accompaniment to the digital text 16.
  • the audio recording can be the voice of a parent, of a teacher, of a doctor and the like.
  • the audio recordings can be made by the user 12, by way of the audio acquisition means 31, in languages other than the language in which the digital text 16 is written.
  • the user 12 chooses to read the digital text 16 in a given language such as, for example, Italian and, at the same time, to listen to the accompanying narrating voice in an additional language such as, for example, English, in order to better assimilate the grammatical structures and the words.
  • the audio acquisition means 31 of the device 10 comprise a microphone.
  • the audio acquisition means 31 are connected to the means for audio playback 24, by way of the control unit 18.
  • the audio acquisition means 31 are connected to the means for storing audio recordings 35, by way of the control unit 18.
  • the means for storing audio recordings 35 of the device 10 for reading digital texts combined with audiovisual effects are configured to store the audio recordings made by the user 12 by way of the audio acquisition means 31.
  • the means for storing audio recordings 35 comprise a database stored on conveniently dimensioned memory media.
  • the means for audio playback 24 of the device 10 for reading digital texts combined with audiovisual effects are configured to play audio effects to the user 12 during the activity of reading the digital texts.
  • the audio effects comprise music, environmental noises, sounds relating to objects or animals and the like.
  • the means for audio playback 24 are further configured to play audio effects associated and synchronized with the digital text 16. In an embodiment, the means for audio playback 24 are further configured to play audio effects associated and synchronized with the digital text 16 upon the reading of a single digital word 17 or a plurality of digital words 17 comprised in the same digital text 16. In an embodiment, the means for audio playback 24 are further configured to play audio effects associated and synchronized with a video effect, such as for example a static illustration.
  • the digital word 17“sea” or a plurality of digital words 17 relating to the marine environment such single digital word 17 or such plurality of digital words 17 are“accompanied” by sound effects and/or music tracks relating to such setting.
  • the means for audio playback 24 play, in fact, sound effects of waves, wind, seagulls and the like, so as to completely involve the user 12 in the reading of the digital text 16. This is particularly useful, for example, for younger users 12, facilitating their reading and learning of certain words, expressions or concepts.
  • the means for audio playback 24 are further configured to play audio recordings of the user 12 which are associated with the digital text 16 upon reading a plurality of digital words 17 comprised in the same digital text 16.
  • the means for audio playback 24 are further configured to play audio effects while at the same time viewing a static illustration or a moving graphic animation, which are displayed by the means for display 32 and are optionally associated with the digital text 16.
  • the sound effect is combined with a video effect and this enables the user 12, for example a child, to read a school textbook or a story while having at the same time a complete visual perception provided by the presence of images and/or animations accompanied by sound effects.
  • the means for audio playback 24 are further configured to play diction audio files while reading the digital words 17 comprised in the digital text 16, in order to facilitate or improve learning for users 12 with particular difficulties or needs.
  • the user 12 can listen to an audio diction file while he/she reads a digital text 16 in order to improve the pronunciation of certain words and expressions.
  • the means for audio playback 24 of the device 10 comprise a loudspeaker.
  • the means for audio playback 24 are connected to the means for storing texts and audiovisual effects 34, by way of the control unit 18.
  • the means for storing texts and audiovisual effects 34 of the device 10 for reading digital texts combined with audiovisual effects are configured to store the digital texts 16 and the audiovisual effects associated with them, i.e. the audio effects played by the means for audio playback 24 and the video effects displayed by the means for display 32, for each user 12.
  • the means for storing texts and audiovisual effects 34 comprise a database stored on conveniently dimensioned memory media.
  • the scrolling and highlighting module 22 of the device 10 for reading digital texts combined with audiovisual effects is configured to execute an automatic scrolling and an automatic highlighting of the digital text 16 displayed by the means for display 32.
  • the scrolling of the digital text 16 is not static or predefined, but adapts to the speed of reading of the digital text 16 by the user 12.
  • the highlighting of the digital text 16 is not static or predefined, but adapts to the speed of reading of the digital text 16 by the user 12.
  • the term “scrolling” when used with digital texts means: the vertical movement of the digital text 16, from below upward, i.e. from a lower position to an upper position, or conversely; changing a page or a static illustration corresponding to the digital text 16 which is optionally integrated within one or more static illustrations, such as for example a comic strip or the like.
  • the automatic scrolling of the digital text 16 enables the user 12 to read the digital text 16 without necessarily having to physically interact with the device 10, in particular without having to repeatedly turn or change the pages of digital texts during the activity of reading. For example, this function is essential if the users 12 have no upper limbs or are affected by particular motor difficulties.
  • the automatic scrolling of the digital text 16 enables the user 12 to make use of the digital text 16 continuously and without minor interruptions, caused for example by the aforementioned changing of pages or by interaction with the screen of the device 10.
  • the scrolling and highlighting module 22 of the device 10 is further configured to enlarge, or zoom in on, the digital text 16 being read, or a portion thereof.
  • This enlargement of the digital text 16 being read is shown by way of example in Figure 6a, which shows a screen 52 comprising an enlarged first portion 53 of the digital text 16 being read, which corresponds to the title; and in Figure 6b, which shows the same screen 52 comprising an enlarged second portion 54 of the digital text 16 being read, which corresponds to the narration.
  • the portions of digital text 16 and/or the video effects, such as for example the static illustration 55, that are not involved in the enlargement of the digital text 16 can be darkened by setting the degree of opacity.
  • the scrolling and highlighting module 22 of the device 10 is further configured to enlarge, or zoom in on, a static illustration, or a portion thereof, even if it is not associated with any digital text 16.
  • This enlargement of the static illustration is shown by way of example in Figure 7a, which shows a screen 62 comprising an enlarged first portion 63 and non-enlarged second 64 and third portions 65 of the static illustration; and in Figure 7b, which shows the same screen 62 comprising an enlarged second portion 64 and non-enlarged first 63 and third portions 65 of the static illustration.
  • the means for audio playback 24 of the device 10 are further configured to play audio effects associated and synchronized with a video effect, such as for example the static illustration 55 comprised in the screen 52, or the portions 63, 64 and 65 of the static illustration comprised in the screen 62.
  • the scrolling and highlighting module 22 of the device 10 is further configured to automatically underline the digital text 16 being read, or a portion thereof.
  • underlining 56 of the digital text 16 being read is not static or predefined, but spreads longitudinally starting from the first digital word 17 of the digital text 16 to the words after it, adapting to the speed of reading of the digital text 16 by the user 12.
  • This underlining 56 of the digital text 16 being read is shown by way of example in Figure 6a, which shows the screen 52 comprising a partially underlined first portion 53 of the digital text 16 being read, and in Figure 6b, which shows the same screen 52 comprising a partially underlined second portion 54 of the digital text 16 being read.
  • the scrolling and highlighting module 22 of the device 10 is configured to set the color, by way of a hexadecimal code, and the thickness, by way of the height in pixels, of the underlining 56.
  • This setting of the underlining 56 can take place on the basis of the type of digital text 16 (for example a story, a comic strip, and the like) and/or on the basis of the image associated with the digital text 16.
  • the automatic underlining 56 of the digital text 16 enables greater readability for the user 12 if he/she is a child or a person with learning difficulties, for example affected by specific learning disabilities (LD).
  • LD specific learning disabilities
  • the scrolling and highlighting module 22 of the device 10 is further configured to change the color, in particular the font color, of the digital text 16 being read, or of a portion thereof.
  • the change of color of the digital text 16 being read is not static or predefined, but spreads starting from the first digital word 17 of the digital text 16 to the words after it, adapting to the speed of reading of the digital text 16 by the user 12.
  • the device 10 can comprise the scrolling and highlighting module 22 configured to perform the enlargement of the digital text 16, and the automatic underlining of the digital text 16, and the change of color of the digital text 16, and then the user can choose the highlighting method on the basis of his/her needs, by way of the means for selection 26.
  • the scrolling and highlighting module 22 is further configured to enable the user 12 to perform a manual scrolling of the digital text 16.
  • the user 12 can scroll the digital text 16 vertically, from above downward or conversely, on the basis of his/her needs.
  • the scrolling and highlighting module 22 is further configured to display, by way of the means for display 32, an indicator of the speed of scrolling and highlighting, for example by way of an automatic scrolling from below upward and an underlining or a change of color of the digital text 16 being read, or an indicator of the speed of reading.
  • the scrolling and highlighting module 22 is connected to the means for display 32, to the means for selection 26 and to the adjustment module 20, by way of the control unit 18.
  • the scrolling and highlighting module 22 is further configured to display, by way of the means for display 32, at least one pop up, i.e. a window or a box, which comprises the digital text 16 corresponding to the illustration viewed by the user 12. This pop-up appears automatically on the means for display 32 of the device 10 whenever the aforementioned illustration is viewed by the user 12.
  • the pop-up appears automatically on the device 10, for example taking the shape of a speech bubble or of a generic box, comprising a specific digital text 16 associated with one of the two characters illustrated.
  • the video acquisition means 28 of the device 10 for reading digital texts combined with audiovisual effects are configured to acquire at least one facial image of the user 12.
  • the video acquisition means 28 are further configured to acquire video of the user 12.
  • the video acquisition means 28 are arranged on the front face of the device 10, where the means for display 32 display the digital text 16, in order to acquire the facial image of the user 12.
  • the video acquisition means 28 of the device 10 comprise a still camera.
  • the video acquisition means 28 are connected to the adjustment module 20, by way of the control unit 18.
  • the adjustment module 20 of the device 10 for reading digital texts combined with audiovisual effects is configured to adjust the speed of scrolling and highlighting of the digital text 16, performed by the scrolling and highlighting module 22, for each user 12.
  • the adjustment module 20 is connected to the scrolling and highlighting module 22, to the video acquisition means 28 and to the means for selection 26, by way of the control unit 18.
  • the adjustment module 20 is configured to automatically adjust the speed of scrolling and highlighting of the digital text 16 on the basis of the reading direction 14 of the user 12 detected from the facial image of the user 12 acquired by the video acquisition means 28.
  • the adjustment module 20 processes the facial image of the user 12, previously acquired by the video acquisition means 28, in order to detect the reading direction 14 of the user 12 and, as a consequence, to automatically adjust the speed of scrolling and highlighting of the digital text 16, performed by the scrolling and highlighting module 22, for the user 12.
  • the automatic adjustment enables the user 12 to read the digital text 16 with a personalized speed of underlining, change of color, or scrolling.
  • the adjustment module 20 is configured to manually adjust the speed of scrolling and highlighting of the digital text 16 on the basis of a selection by the user 12, by way of the means for selection 26, of a speed of scrolling and highlighting of the digital text 16 from among a plurality of speeds of scrolling and highlighting of the digital text 16.
  • the user 12 selects a specific speed of scrolling and highlighting of the digital text 16 on the basis of his/her needs, from among a plurality of speeds of scrolling and highlighting of the digital text 16.
  • the speed of scrolling and highlighting of the digital text 16 is customizable and the user 12 can, at any time, manually select a different speed of scrolling and highlighting of the digital text 16.
  • the profiling module 30 of the device 10 for reading digital texts combined with audiovisual effects is configured to perform a profiling of the user 12 by way of the user 12 proper entering user data.
  • the user data comprise personal details, such as for example name, surname, date of birth and the like, a home address, an email address, a profile photo or other photos, interests and/or hobbies, payment information, and the like.
  • the profiling module 30 is connected to the means for display 32, to the means for selection 26 and to the means for storing user data 36, by way of the control unit 18.
  • the means for storing user data 36 of the device 10 for reading digital texts combined with audiovisual effects are configured to store the user data for each user 12.
  • the means for storing user data 36 comprise a database stored on conveniently dimensioned memory media.
  • the device 10 further comprises one or more of the following functionalities: an automatic bookmark; a“Post-It”-style feature to insert notes in the digital text 16; backgrounds customizable by the user 12, in order to make reading the digital text 16 more comfortable; and an adjustable-size font, particularly for partially sighted users 12.
  • the device 10 is configured to collect, and subsequently present to the user 12, statistics for the reading activity, such as for example the reading time, the number of words read, the average speed of reading, and the like.
  • the user 12 initially chooses alternatively whether to perform the automatic adjustment or the manual adjustment of the speed of scrolling and highlighting of the digital text 16, by way of the adjustment module 20 of the device 10.
  • step 38 the user 12 performs an automatic adjustment of the speed of scrolling and highlighting of the digital text 16, by way of the adjustment module 20.
  • the user 12 performs at least one reading test of a plurality of digital words 17 comprised in a digital text 16, in order to ensure the correct automatic adjustment of the speed of scrolling and highlighting of the digital text 16.
  • the video acquisition means 28 of the device 10 acquire the facial image of the user 12.
  • the adjustment module 20 processes the acquired facial image, detecting the reading direction 14 of the user 12 and, as a consequence, automatically adjusting the speed of scrolling and highlighting of the digital text 16 of the user 12.
  • step 40 as an alternative to step 38, the user 12 performs a manual adjustment of the speed of scrolling and highlighting of the digital text 16, by way of the adjustment module 20.
  • the adjustment module 20 manually adjusts the speed of scrolling and highlighting of the digital text 16 on the basis of the speed selected by the user 12.
  • the user 12 can select, by way of the means for selection 26 of the device 10, his/her speed of scrolling and highlighting from among a plurality of speeds of scrolling and highlighting of the digital text 16.
  • step 42 the user 12 selects, by way of the means for selection 26, the digital text 16 that he/she wants to read.
  • the user 12 selects the desired digital text 16, the language of the digital text 16, and optionally the accompanying narrating voice.
  • step 44 the digital text 16 automatically scrolls and is highlighted, by way of the scrolling and highlighting module 22, for example by way of an automatic scrolling from below upward and an underlining or a change of color of the digital text 16 being read, to a speed of scrolling and highlighting that depends on the automatic or manual adjustment that was performed previously in steps 38 or 40.
  • the user 12 can interrupt the automatic scrolling of the digital text 16 at any time and resume it later, or select manual scrolling.
  • the user 12 can interrupt the automatic highlighting of the digital text 16 at any time and resume it later.
  • the scrolling and highlighting module 22 is further configured to enlarge, or zoom in on, the digital text 16 being read, or a portion thereof.
  • the scrolling and highlighting module 22 is further configured to automatically underline the digital text 16 being read, or a portion thereof.
  • underlining 56 of the digital text 16 being read is not static or predefined, but spreads longitudinally starting from the first digital word 17 of the digital text 16 to the words after it, adapting to the speed of reading of the digital text 16 by the user 12.
  • step 44 the scrolling and highlighting module 22 is further configured to change the color of the digital text 16 being read, or of a portion thereof.
  • the change of color of the digital text 16 being read is not static or predefined, but spreads starting from the first digital word 17 of the digital text 16 to the words after it, adapting to the speed of reading of the digital text 16 by the user 12.
  • the means for audio playback 24 play audio effects for the user 12 during the reading activity, at a single digital word 17 or at a plurality of digital words 17 which are comprised in the digital text 16 selected in step 42 by the user 12, or at a video effect, such as for example a static illustration.
  • the means for display 32 are further configured to play video effects associated and synchronized with the digital text 16, which was selected in step 42 by the user 12, during the reading activity. In an embodiment, in step 46, the means for display 32 are further configured to play video effects associated and synchronized with the digital text 16, which was selected in step 42 by the user 12, upon the reading of a single digital word 17 or a plurality of digital words 17 comprised in the same digital text 16. In an embodiment, in step 46, the means for display 32 are further configured to play video effects that are not associated with any digital text 16, such as for example a frame with no dialog comprised in a comic strip, during the reading activity.
  • the invention fully achieves the set aim and objects.
  • the device and the method for reading digital texts combined with audiovisual effects make it possible to overcome the qualitative limitations of the prior art, since they make it possible to involve the user more, and more actively, in his/her activity of reading digital texts.
  • Another advantage of the device and of the method for reading digital texts combined with audiovisual effects according to the present invention consists in that they make it possible for the user not to repeatedly turn or change the pages of the digital texts during his/her reading activity.
  • Another advantage of the device and of the method for reading digital texts combined with audiovisual effects according to the present invention consists in that they enable a synergy with specific applications relating to digital texts.
  • Another advantage of the device and of the method for reading digital texts combined with audiovisual effects according to the present invention consists in that they enable high scalability and the use of the latest technologies.
  • Another advantage of the device and of the method for reading digital texts combined with audiovisual effects according to the present invention consists in that they perform an important active social function, increasing the learning of children and helping persons with motor difficulties in their upper limbs or with learning difficulties, for example people who are affected by specific learning disabilities (LD).
  • LD learning disabilities
  • Another advantage of the device and of the method for reading digital texts combined with audiovisual effects according to the present invention consists in that they make it possible to access digital texts easily and securely.
  • the device and the method for reading digital texts combined with audiovisual effects according to the invention have been conceived in particular for the synchronous combination of video and/or audio effects with a single word or a plurality of words of a digital text with automatic highlighting, they can also be used, more generally, for reading and managing digital texts.

Abstract

L'invention concerne un dispositif (10) de lecture de textes numériques combinés à des effets audiovisuels, commandé par un utilisateur (12) et comprenant des moyens d'affichage (32) configurés pour afficher un texte numérique (16) et lire des effets vidéo, des moyens de sélection (26) configurés pour sélectionner le texte numérique (16), des moyens de lecture audio (24) configurés pour lire des effets audio, et des moyens pour stocker des textes et des effets audiovisuels (34). Le dispositif (10) comprend en outre un module de défilement et de mise en surbrillance (22) configuré pour effectuer un défilement automatique et une mise en surbrillance automatique du texte numérique (16), et un module de réglage (20) configuré pour ajuster la vitesse du défilement et de la mise en surbrillance du texte numérique (16). Les moyens de lecture audio (24) sont en outre configurés pour lire, lors de l'affichage du texte numérique (16), des effets audio stockés dans les moyens pour stocker des textes et des effets audiovisuels (34) et associés et synchronisés avec le texte numérique (16).
PCT/EP2018/082177 2017-11-22 2018-11-22 Dispositif et procédé de lecture de textes numériques associés à des effets audiovisuels WO2019101841A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT201700133587 2017-11-22
IT102017000133587 2017-11-22

Publications (1)

Publication Number Publication Date
WO2019101841A1 true WO2019101841A1 (fr) 2019-05-31

Family

ID=61656112

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2018/082177 WO2019101841A1 (fr) 2017-11-22 2018-11-22 Dispositif et procédé de lecture de textes numériques associés à des effets audiovisuels

Country Status (1)

Country Link
WO (1) WO2019101841A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120256967A1 (en) * 2011-04-08 2012-10-11 Baldwin Leo B Gaze-based content display
US20130205213A1 (en) * 2012-02-06 2013-08-08 edX Inc. Caption-based navigation for a video player
US8739019B1 (en) * 2011-07-01 2014-05-27 Joel Nevins Computer-implemented methods and computer program products for integrating and synchronizing multimedia content, including content displayed via interactive televisions, smartphones, electronic book readers, holographic imagery projectors, and other computerized devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120256967A1 (en) * 2011-04-08 2012-10-11 Baldwin Leo B Gaze-based content display
US8739019B1 (en) * 2011-07-01 2014-05-27 Joel Nevins Computer-implemented methods and computer program products for integrating and synchronizing multimedia content, including content displayed via interactive televisions, smartphones, electronic book readers, holographic imagery projectors, and other computerized devices
US20130205213A1 (en) * 2012-02-06 2013-08-08 edX Inc. Caption-based navigation for a video player

Similar Documents

Publication Publication Date Title
CN108629033B (zh) 电子文本的操纵和显示
US6564186B1 (en) Method of displaying information to a user in multiple windows
US8719029B2 (en) File format, server, viewer device for digital comic, digital comic generation device
US20060194181A1 (en) Method and apparatus for electronic books with enhanced educational features
JP5634853B2 (ja) 電子コミックのビューワ装置、電子コミックの閲覧システム、ビューワプログラム、ならびに電子コミックの表示方法
US20180067902A1 (en) Textual Content Speed Player
US8538758B2 (en) Electronic apparatus
JPWO2014069220A1 (ja) 再生装置、設定装置、再生方法およびプログラム
WO2012086359A1 (fr) Dispositif de visualisation, système de visualisation, programme de visualisation et support d'enregistrement
Gay Introduction to web accessibility
KR101567449B1 (ko) 음성인식에 기반한 애니메이션 재생이 가능한 전자책 단말기 및 그 방법
Skedsmo How to use comic-strip graphics to represent signed conversation
US20080040378A1 (en) Systems and methods for navigating page-oriented information assets
El-Glaly et al. Digital reading support for the blind by multimodal interaction
Lukeš Dyslexia friendly reader: Prototype, designs, and exploratory study
KR20170080519A (ko) 외국어 독해 지원 방법 및 장치
WO2019101841A1 (fr) Dispositif et procédé de lecture de textes numériques associés à des effets audiovisuels
KR20200000300A (ko) 이북을 이용한 요약노트 작성 및 암기학습 시스템과 그 방법
KR20180137369A (ko) 이북 및 워드 문서의 요약노트 작성 방법과 이를 이용한 암기학습 시스템 및 방법
Duarte et al. Users and usage driven adaptation of digital talking books
KR20180029563A (ko) 이북 및 워드 문서의 요약본 작성 시스템과 이를 이용한 학습 방법
Artz Responsive Web Design and its Impact on Web Accessibility
KR20170009487A (ko) 청크 기반 언어 학습 방법 및 이를 수행하는 전자 기기
Friedlander et al. iPad: Enhancing Learning and Communication for Students with Special Needs
KR20180137845A (ko) 이북과 스마트폰을 이용한 요약노트 작성 및 암기학습 시스템과 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18803710

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18803710

Country of ref document: EP

Kind code of ref document: A1