WO2001080027A1 - Systeme et procede de presentation visuelle serielle rapide avec audio - Google Patents

Systeme et procede de presentation visuelle serielle rapide avec audio Download PDF

Info

Publication number
WO2001080027A1
WO2001080027A1 PCT/SE2001/000861 SE0100861W WO0180027A1 WO 2001080027 A1 WO2001080027 A1 WO 2001080027A1 SE 0100861 W SE0100861 W SE 0100861W WO 0180027 A1 WO0180027 A1 WO 0180027A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
text
reading
sensory presentation
code
Prior art date
Application number
PCT/SE2001/000861
Other languages
English (en)
Inventor
Mikael Goldstein
Mikael Anneroth
Torbjörn LUNDBERG
Karin Sicheritz
Original Assignee
Telefonaktiebolaget Lm Ericsson (Publ)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget Lm Ericsson (Publ) filed Critical Telefonaktiebolaget Lm Ericsson (Publ)
Priority to EP01922222A priority Critical patent/EP1275051A1/fr
Priority to AU2001248996A priority patent/AU2001248996A1/en
Publication of WO2001080027A1 publication Critical patent/WO2001080027A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/02—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B17/00—Teaching reading
    • G09B17/003—Teaching reading electrically operated apparatus or devices
    • G09B17/006—Teaching reading electrically operated apparatus or devices with audible presentation of the material to be studied

Definitions

  • the present invention relates to rapid serial visual presentation (RSVP) with audio and/or other sensory information, and particularly to providing and utilizing RSVP -based text files with audio information.
  • RSVP rapid serial visual presentation
  • Reading text such as an electronic book
  • Reading text from a conventionally sized computer monitor involves much of the same activity as in reading printed material.
  • Several lines of text are simultaneously presented on the computer monitor and the reader reads each line of text before scrolling or paging to the next set of lines of text.
  • the reader cannot efficiently read a relatively large amount of text by utilizing the scrolling and other features utilized in reading from a large computer screen. Consequently, users of devices having small display screens are forced to transport the text to a computer or other device having a conventionally sized computer screen in order to read the text.
  • Rapid serial visual presentation involves the brief display of consecutive words at a fixed location. Typically, the rate of presentation per word is set by the experimenter or the reader, and each word is shown for an equivalent amount of time. In most of the research with RSNP, the display duration of each word is very brief, as implied by the word "rapid" in the acronym.
  • the functional relevance of RSVP lies in the fact that a small amount of text, such as a word or small number of words, is presented to the reader at any one time. This allows for use of small screens, like screens used in PDAs or wireless telephones. By presenting text as a stream of text to a reader such that only a small amount of text is presented to the reader at a time, users of PDAs, wireless telephones and other devices may easily and efficiently read relatively large amount of text.
  • a reading file that includes one or more text portions having text therein that forms a stream of text that is presentable to a reader in groups of one or more words at a time.
  • the reading file further includes at least one sense code portion associated with one or more words in an adj acent text portion.
  • the value of the sense code portion identifies a sensory presentation file, such as an audio file.
  • An embodiment of the present invention includes a display device, such as a portable, hand-held communication device having a small display, including a processing unit that reads the text portion and a sense code portion associated therewith, identifies the sensory presentation file associated with the text portion, determines the amount of the sensory presentation file to be presented to the reader based upon the selected reading speed, and presents the sensory presentation file substantially synchronously with the presentation of the associated text portion.
  • a display device such as a portable, hand-held communication device having a small display, including a processing unit that reads the text portion and a sense code portion associated therewith, identifies the sensory presentation file associated with the text portion, determines the amount of the sensory presentation file to be presented to the reader based upon the selected reading speed, and presents the sensory presentation file substantially synchronously with the presentation of the associated text portion.
  • the display device may include a wizard that creates the reading file from a text file, such as an RS VP-based text file, by identifying words in the text file that are related to a particular sound or other sense, and placing a tag code to each identified word whose value identifies an audio file. The audio file is subsequently executed when the tagged word is presented to the reader.
  • a text file such as an RS VP-based text file
  • Figure 1 is a portion of a reading file and related sensory presentation file in accordance with a preferred embodiment of the present invention
  • Figure 2 is a function block diagram of a display device for presenting the information in the reading file of Figure 1;
  • Figure 3 is a flow chart illustrating an operation of the display device according to a preferred embodiment of the present invention.
  • Figure 4 is a flow chart illustrating another operation of the display device in creating the reading file, in accordance with a preferred embodiment of the present invention.
  • a signal format and corresponding device for presenting text-based information to a reader is presented as a stream of words that is displayed on a screen one or a few words at a time.
  • the reading file 1 utilizes the rapid serial visual presentation (RSNP) technique. It is understood, however, that the reading file 1 may utilize other techniques for presenting a stream of text on a display one or a few words at a time.
  • Reading file 1 includes text portions 2 having therein text that forms a stream of text that is presented on a display in one or a few words at a time, as explained above.
  • Reading file 1 further includes one or more sense code portions 3 having therein a code that identifies a particular sensory presentation file 4.
  • Sense code portion 3 is sized to suitably identify one of a plurality of sensory presentation files 4.
  • a sense code portion 3 is located within reading file 1 adjacent and/or proximally to a text portion 2 with which sense code portion 3 is associated.
  • Each sense code portion 3 links a particular sensory presentation file 4 to a word or group of words in an adjacent text portion 2, and is available to be executed substantially simultaneously with the presentation of the associated reading file 1. In this way, the execution of a sensory presentation file stimulates a human sense in synchronicity with the presentation of the associated text to the reader.
  • sensory presentation files 4 include audio files that are audibly presented to a reader when played.
  • Audio files 4 may be MP3 audio files, but it is understood that audio files 4 may be other audio files.
  • each sense code portion 3 may link an executable sensory portion of the multi-media file to a specific text portion 2 thereof.
  • sensory presentation files 4 may instead include files that stimulate other human senses when played and or executed.
  • sensorypresentation files 4 may include video (MPEG) orpicture (JPEG) files that are presented simultaneously with the particular text to which sensory presentation files 4 are linked.
  • sensory presentation files 4 may include files that stimulate a reader's sense of taste, touch or smell when executed.
  • each sensory presentation file 4 is partitioned into one or more regions 5 of sensory information. Each region 5 is prioritized relative to each other.
  • each region 5 of sensory information of sensory presentation file 4 includes a priority code 6 having a value that identifies the relative ranking and/or priority of region 5. It is understood, however, that priority codes 6 may be located elsewhere, such as in sense code portion 3 of reading file 1.
  • a preferred embodiment of the present invention includes a display device 20
  • Display device 20 may include a processing unit 21 for reading reading file 1 stored in memory 22 and presenting text therein as a stream of text on display unit 23 one word or a group of words at a time.
  • display device 20 includes one or more sensory presentation units 24 for presenting the contents of sensory presentation files 4 to the reader.
  • Sensory presentation files 4 are stored in memory 22.
  • a sensory presentation unit 24, for example, may be a speaker for playing/executing an audio file 4.
  • Display device 20 may be a portable, hand-held communication device, such as a Smartphone or PDA. Accordingly, display device 20 may further include a receiving unit 25 that receives reading file 1 and sensory presentation files 4 linked thereto as one or more wireless signals for storage in memory 22. For example, reading file 1 and corresponding sensory presentation files 4 are downloaded substantially simultaneously from a source (not shown) using the wireless application protocol (WAP).
  • WAP wireless application protocol
  • Processing unit 21 parses text from text portions 2 for presenting on display unit 23 in groups of one or more words. Processing unit 21 decodes the code value in a sense code control portion 3 and thereby identifies a sensory presentation file 4 to execute substantially simultaneously with the display of text to which the identified sensory presentation file 4 is linked. Processing unit 21 determines the duration of and/or number of regions
  • wizard 27 may cause processing unit 21 to identify verbs that may be associated with a sound.
  • Wizard 27 and/or processing unit 21 place a tag and/or code control portion 3 on and/or near the identified text in the RSVP- based text file that identify an audio file 4 in a bank 28 of audio files stored in memory
  • the RSVP-based text file (having code control portions 3 therein) is subsequently retrieved from memory 22 for presentation to the reader and the audio file 4 identified in the sense code control portion 3 exists in memory 22, the identified audio file 4 is executed substantially synchronously with the presentation of the tagged text.
  • a reading file 1 is downloaded into memory 22 of display device 20 at step 30 together with sensory presentation files associated with reading file 1.
  • the reader provides to processing unit 21 at step 31 the desired reading speed at which the stream of text from reading file 1 is to be presented on visual text display unit 23.
  • Text portion 2 and a corresponding sense code control portion 3 of reading file 1 are retrieved from memory 22 and decoded at step 32.
  • Processing unit 21 prepares text from retrieved text portion 22 for presentation and identifies sensory presentation file 4 from control code portion 3 at step 33.
  • processing unit 21 determines the duration and/or the number of regions 5 of the identified sensory presentation file 4 to be executed at step 34.
  • the prepared text is presented on display unit 23 and the region(s) 5 of the identified sensory presentation file 4 is executed substantially simultaneously with the presentation of the prepared text at step 35.
  • Processing unit 21 then repeats steps 32-35 until the entire contents of reading file 1 has been retrieved and presented to the reader or until the reader signals to processing unit 21 to stop the presentation.
  • step 40 an RSVP-based text file is read by processing unit 21 and words identified therefrom that may be associated with a sound.
  • each identified word is tagged at step 41 by adding a control code thereto that indicate a particular sensory presentation file 4 in bank 28 of sensory presentation files 4.
  • the corresponding sensory presentation files 4 are thereby linked to the RSVP-based text file.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un système et un procédé de lecture assistée par ordinateur améliorée. Une présentation visuelle sérielle rapide (RSVP) basée sur un fichier texte comporte des parties avec texte et au moins une partie code (3) qui se lie à une partie texte particulière (4), au moins un fichier audio (4) ou un fichier autre (4) qui stimule(nt) les sens d'un lecteur. Lorsqu'un dispositif de lecture assistée par ordinateur lit la partie texte (2) et la partie code correspondante (3), le fichier audio (4) est récupéré et exécuté sensiblement en synchronicité avec la présentation du texte de la partie texte (2). Ainsi, le lecteur est présente avec une expérience de lecture amélioré.
PCT/SE2001/000861 2000-04-19 2001-04-19 Systeme et procede de presentation visuelle serielle rapide avec audio WO2001080027A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP01922222A EP1275051A1 (fr) 2000-04-19 2001-04-19 Systeme et procede de presentation visuelle serielle rapide avec audio
AU2001248996A AU2001248996A1 (en) 2000-04-19 2001-04-19 System and method for rapid serial visual presentation with audio

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US55195200A 2000-04-19 2000-04-19
US09/551,952 2000-04-19

Publications (1)

Publication Number Publication Date
WO2001080027A1 true WO2001080027A1 (fr) 2001-10-25

Family

ID=24203338

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2001/000861 WO2001080027A1 (fr) 2000-04-19 2001-04-19 Systeme et procede de presentation visuelle serielle rapide avec audio

Country Status (4)

Country Link
EP (1) EP1275051A1 (fr)
KR (1) KR20030010605A (fr)
AU (1) AU2001248996A1 (fr)
WO (1) WO2001080027A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002027710A1 (fr) * 2000-09-27 2002-04-04 International Business Machines Corporation Procede et systeme destines a synchroniser une presentation audio et visuelle dans un restituteur de contenu multimode
GB2369219A (en) * 2000-07-31 2002-05-22 John Christian Doughty Nissen System for synchronous display of text and audio data
GB2395804A (en) * 2002-11-27 2004-06-02 Sony Uk Ltd Information retrieval
US7613731B1 (en) 2003-06-11 2009-11-03 Quantum Reader, Inc. Method of analysis, abstraction, and delivery of electronic information
GB2509059A (en) * 2012-12-18 2014-06-25 Kathryn Chadwick Sensory device and system to provide haptic, audio and visual sensations with an electronic reader

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL1033081C2 (nl) 2006-12-18 2008-06-19 Sormac B V Inrichting voor het schillen van groenten of fruit.

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0598597A1 (fr) * 1992-11-18 1994-05-25 Canon Information Systems, Inc. Méthode et dispositif pour séquencer une présentation multimedia ayant une conversion texte-parole
JPH07175909A (ja) * 1993-12-20 1995-07-14 Canon Inc データ処理装置
WO1996015517A2 (fr) * 1994-11-02 1996-05-23 Visible Interactive Corporation Dispositif interpretatif personnel interactif permettant d'obtenir des informations sur plusieurs objets
EP0896322A2 (fr) * 1997-08-05 1999-02-10 AT&T Corp. Procédé et dispositif d'alignment d'enrégistrements vidéos naturels et synthétiques avec un signal de parole synthétique

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0598597A1 (fr) * 1992-11-18 1994-05-25 Canon Information Systems, Inc. Méthode et dispositif pour séquencer une présentation multimedia ayant une conversion texte-parole
JPH07175909A (ja) * 1993-12-20 1995-07-14 Canon Inc データ処理装置
WO1996015517A2 (fr) * 1994-11-02 1996-05-23 Visible Interactive Corporation Dispositif interpretatif personnel interactif permettant d'obtenir des informations sur plusieurs objets
EP0896322A2 (fr) * 1997-08-05 1999-02-10 AT&T Corp. Procédé et dispositif d'alignment d'enrégistrements vidéos naturels et synthétiques avec un signal de parole synthétique

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 1995, no. 10 30 November 1995 (1995-11-30) *
YAMADA A ET AL: "Visual text reader for virtual image communication on networks", IEEE WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING. PROCEEDINGS OF SIGNAL PROCESSING SOCIETY WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING,XX,XX, 23 June 1997 (1997-06-23), pages 495 - 500, XP002147180 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2369219A (en) * 2000-07-31 2002-05-22 John Christian Doughty Nissen System for synchronous display of text and audio data
WO2002027710A1 (fr) * 2000-09-27 2002-04-04 International Business Machines Corporation Procede et systeme destines a synchroniser une presentation audio et visuelle dans un restituteur de contenu multimode
GB2395804A (en) * 2002-11-27 2004-06-02 Sony Uk Ltd Information retrieval
US7613731B1 (en) 2003-06-11 2009-11-03 Quantum Reader, Inc. Method of analysis, abstraction, and delivery of electronic information
GB2509059A (en) * 2012-12-18 2014-06-25 Kathryn Chadwick Sensory device and system to provide haptic, audio and visual sensations with an electronic reader

Also Published As

Publication number Publication date
EP1275051A1 (fr) 2003-01-15
KR20030010605A (ko) 2003-02-05
AU2001248996A1 (en) 2001-10-30

Similar Documents

Publication Publication Date Title
US9349302B2 (en) Voice output device, information input device, file selection device, telephone set, and program and recording medium of the same
US7340689B2 (en) Method, system and program product for automatically modifying a display view during presentation of a web page
JP2677754B2 (ja) データ処理方法
US20020120675A1 (en) Method of transferring media files over a communications network
US20010054074A1 (en) Electronic mail system and device
US20100073382A1 (en) System and method for sequencing media objects
CN101088085A (zh) 便携式音频播放设备及其操作方法
CN110347309A (zh) 朗读控制方法、装置和设备及计算机存储介质
US20130311187A1 (en) Electronic Apparatus
JP2002268963A (ja) ブルートゥース機能を用いた無線データ送受信制御方法と無線データ送受信システム、及びそれに使用されるサーバーと端末機
EP1275051A1 (fr) Systeme et procede de presentation visuelle serielle rapide avec audio
EP1648168A4 (fr) Support d'enregistrement de donnees, dispositif d'enregistrement de donnees, dispositif et procede de lecture de donnees, dispositif et procede d'enregistrement/ lecture de donnees, programme informatique de commande d'enregistrement ou de lecture, et structure de donnees contenant un signal de comm
EP3203362A1 (fr) Dispositif d'interface d'utilisateur, programme et procédé de notification de contenu
US10775877B2 (en) System to generate a mixed media experience
WO2016169594A1 (fr) Technologie web en réponse a des mélanges d'émotions
EP2954438B1 (fr) Procédé et appareil interactifs pour une consommation de récit multimédia
CN109616117A (zh) 一种基于语音识别技术的手机游戏控制系统及方法
US20070183753A1 (en) Data outputting device, data outputting method, data outputting program, and recording medium
JP2004310352A (ja) 情報処理装置および情報処理方法ならびに記憶媒体、プログラム
CN100452171C (zh) 语音波形处理系统及方法
WO2001029694A3 (fr) Procede, systeme et dispositif servant a presenter du texte de journal en format de livre electronique
CN115499401B (zh) 一种播放语音数据的方法、系统、计算机设备及介质
WO2006109630A1 (fr) Dispositif d'affichage d'element de liste et procede correspondant
KR100337485B1 (ko) 디지털 캡션을 이용한 광고방법
US6721947B1 (en) System, method and program for producing a customized response

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2001922222

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020027013994

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2001922222

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020027013994

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Ref document number: 2001922222

Country of ref document: EP