KR20030010605A - System and method for rapid serial visual presentation with audio - Google Patents

Abstract

Systems and methods for providing enhanced computer-assisted reading are disclosed. A high-speed serial visual presentation (RSVP) based text file includes at least one code portion (3) that links one or more audio files (4) or other files (4) to specific text portions (4) that simulate the reader's senses. ) And the part with the text. When the computer-based reading device reads the next part 2 and the corresponding code part 3, the audio file 4 is searched and executed simultaneously with the presentation of the text of the text part 2. In this way, the reader is provided with an enhanced reading experience.

Description

SYSTEM AND METHOD FOR RAPID SERIAL VISUAL PRESENTATION WITH AUDIO}

Reading text, such as an electronic book, from a normal sized computer monitor involves many of the same activities as reading printed materials. Several lines of text are presented simultaneously on a computer monitor, and the reader reads each line of text before scrolling or paging to the next set of lines of text.

However, problems exist when trying to read a relatively large amount of text from a relatively small display such as a display screen for a PDA or a smartphone. In such cases, the reader may not be able to read relatively large amounts of text efficiently by utilizing scrolling and other features utilized to read from large computer screens. Thus, a user of a device having a small display screen is forced to pass the text to another device or computer having a computer screen of normal size for reading the text.

Advanced technologies have been made that allow users of devices with small displays to efficiently read large amounts of text. High-speed serial visual presentation (RAVP) includes a concise display of consecutive words at a fixed location. In general, the speed of presentation per word is set by the experimenter or the reader, and each word appears for an equivalent amount of time. In most studies using RSVP, the display duration of each word is very brief, as the word "rapid" in the acronym implies. Regardless of the speed of the presentation, the functional search capability of RSVP lies in the fact that small amounts of text, such as words or small numbers of words, are provided to the reader at once. This allows the use of small screens such as those used in PDAs or cordless phones. By providing text to the reader as a stream of text so that only a small amount of text is provided to the reader at a time, wireless telephones and other devices can easily and efficiently read a relatively large amount of text.

Like reading printed materials, computer-assisted reading is usually a silent activity. However, due to advances in computer technology, computers can now provide a wide variety of multimedia related tasks. In order to enhance the reading experience, it would be advantageous to incorporate multimedia and other audio-visual features into computer-assisted reading.

The present invention relates to high speed serial visual presentation (RSVP) with audio and / or other sensory information, and more particularly, to providing and utilizing RSVP-based text files with audio information.

1 illustrates a portion of an associated sensory presentation file and a read file in accordance with a preferred embodiment of the present invention.

2 is a functional diagram of a display device for providing information to the read file of FIG.

3 is a flow chart illustrating the operation of a display device according to a preferred embodiment of the present invention.

4 is a flow diagram illustrating yet another operation of a display device in generating a read file, in accordance with a preferred embodiment of the present invention.

The present invention addresses a significant need for such a system that overcomes the drawbacks of conventional computer-assisted reading systems and enhances the conventional silent reading experience. In accordance with a preferred embodiment of the present invention, there is provided a reading file comprising one or more text portions having text forming a stream of text that can be presented to a reader in a group of one or more words simultaneously. The read file further includes at least one sense code portion associated with one or more words in the proximity text portion. The value of the sense code portion identifies a sensory presentation file, such as an audio file. When the text from the proximity file portion is visually provided to the reader on the visual text display unit 23, the identified sensory presentation file is executed, so that the execution of the identified sensory presentation file occurs with the text visual presentation. . In this way, the reading experience is enhanced to provide sound or other sensory presentations that relate to the specific text provided to the reader, such as taste, smell, and tactile presentation.

Embodiments of the present invention include a display device, such as a portable, hand-held communication device having a small display, wherein the small display reads a text portion and senses a code portion associated therewith, and a sensory presentation file associated with the text portion. And a processing unit for determining the amount of sensory presentation file provided to the reader based on the selected reading speed, and for providing a sensory presentation file having a presentation of the relevant text portion. The display device generates a read file from a text file, such as an RSVP-based text file, by placing a tag code in each identified word that is a value identifying the audio file by identifying words in the text file with respect to a particular sound or other sense. It can contain a wizard. The audio file runs continuously when the tagged words are provided to the reader.

A more complete understanding of the system and method of the present invention can be obtained with reference to the following detailed description in conjunction with the accompanying drawings.

The invention is explained more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. However, the present invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In addition, examples are provided so that this disclosure will be thorough and will fully convey the scope of the invention to those skilled in the art.

1 and 2, there is shown a corresponding device and signal format for providing text-based information to a reader. The text-based information forming the reading file 1 is provided as a stream of words in which one or more words are displayed on the screen at the same time. In a preferred embodiment of the invention, the read file 1 utilizes a high speed serial visual presentation (RSVP) technique. However, it is understood that the read file 1 may use other techniques to provide a stream of text that displays more than one word at the same time.

The read file 1 comprises a text portion having text forming a stream of text provided on the display in one or more words at the same time as described above. The read file 1 further comprises one or more sense code portions 3 with a code identifying a particular sensory presentation file 4. The sense code portion 3 is made to a size that can adequately identify one of the plurality of sensory presentation files 4. The sense code part 3 is located in the read file 1 in proximity to and / or near the text part 2. Each sense code portion 3 is available to link a particular sensory presentation file 4 to a word or group of words in the adjacent portion 2 and to be executed in series with the presentation of the associated reading file 1. . In this way, the execution of the sensory presentation file simulates a person's senses in co-occurrence having a presentation of the relevant text to the reader.

In a preferred embodiment of the present invention, the sensory presentation file 4 comprises an audio file which is provided for the reader to listen to when played. The audio file 4 may be an MP3 audio file, but it is understood that the audio file 4 may be another audio file.

It is understood that the reading file 1 and the sensory presentation file 4 can be combined to form a single multimedia file and / or experience file. In this scenario, each sense code portion 3 may link the sensory portion executable by the multimedia file to its specific text portion 2.

In another embodiment of the present invention, the sensory presentation file 4 may include a file that assembles and experiments with the other's senses when played and / or executed.

For example, the sensory presentation file 4 may comprise a video (MPEG) or image (JPEG) file provided simultaneously with the specific text to which the sensory presentation file 4 is linked. Alternatively, the sensory presentation file 4 may include a file that, when executed, simulates the taste, touch or smell of the reader.

In providing a reader of the stream of text, it is understood that the speed of the text stream is controllable by the reader. In order to simultaneously provide for the execution of the sensory presentation file 4 with the presentation of linked relevant text, it is necessary to control the length of the play of each sensory presentation file 4. In particular, if the sensory presentation file 4 is linked such that the duration of the execution corresponds to a relatively slow reading speed, such as 100 wpm, the duration of the execution of the sensory presentation file 4 for faster reading speed. It is desirable to shorten. In a preferred embodiment of the invention, each sensory presentation file 4 is divided into one or more regions 5 of sensory information. Each area 5 is prioritized with respect to each other. The area 5 of sensory information with a relatively low priority assigned is not provided to the reader at higher reading speeds. As a result, the duration of the sensory presentation file 4 and its contents are synchronized to the linked text by controlling the duration of the sensory presentation file based on the speed at which the text is provided to the reader.

In a preferred embodiment of the invention, each area 5 of sensory information in the sensory presentation file 4 has a priority code having a value identifying the priority and / or relative ranking of the area 5. It includes (6). However, it is understood that the priority code 6 may be located somewhere else, such as in the sense code portion 3 of the read file 1.

A preferred embodiment of the present invention comprises a display device 20 (FIG. 2) suitable for receiving a reading file 1 and providing it to a person reading text and other sensory information. The display device 20 includes a processing unit 21 for reading a read file 1 stored in the memory 22 and simultaneously providing a single word or group of words on the display unit 23 as a stream of text. can do. The display device 20 also includes one or more sensory presentation units 24 that provide the reader with the contents of the sensory presentation file 4. The sensory presentation file 4 is stored in the memory 22. For example, the sensory presentation file 4 may be a speaker that plays and / or executes the audio file 4.

Display device 20 may be a portable, hand-held communication device such as a smartphone or a PDA. Accordingly, the display device 20 may further comprise a receiving unit 25 for receiving the sensory presentation file 4 and the reading file 1 which are linked as one or more radio signals for storage in the memory 22. . For example, the read file 1 and the corresponding sensory presentation file 4 are downloaded simultaneously from a source (not shown) using the Wireless Application Protocol (WAP).

When retrieving and decoding the read file 1 from the memory 22, the processing unit 21 analyzes the text as a component from the text part 2 which is provided on the display unit 23 as a group of one or more words. do. The processing unit 21 decodes the code value in the sense code control portion 3 to identify the sensory presentation file 4 for execution simultaneously with the display of the text to which the identified sensory presentation file 4 is linked. . The processing unit 21 is an area of sensory information of the sensory presentation file 4 identified for presentation and / or execution to the reader, based in part on the speed at which the stream of text is displayed on the display unit 23. Determine the number and / or duration of (5). The (read) speed is provided to the processing unit 21 from the reader / user of the display device 20.

As mentioned above, the reading file 1 and the corresponding sensory presentation file 4 are downloaded to the display device 20. This scenario enables the composer to add the sense code control portion 3 to the RSVP-based text file to generate a read file 1. In another embodiment of the invention, text-audio beads 27 may be utilized to automatically add the sense code control portion 3 to the read file 1. In particular, the application vision 27 stored in the memory 22 causes the processing unit 21 to identify text that can be audibly provided and to analyze the RSVP-based text file. For example, the beads 27 cause the processing unit 21 to identify verbs associated with the sound. The vision 27 and / or the processing unit 21 may be configured on and / or identified text of an RSVP-based text file identifying the audio file 4 in the bank 28 of the audio file stored in the memory 22. Located in the tag and / or code control part 3 in the vicinity. The RSVP-based text file (with the code control portion 3) is subsequently retrieved from the memory 27 for presentation to the reader, and the audio file 4 identified in the detection control portion 3 is stored in the memory ( When present at 22), the identified audio file is executed concurrently with the presentation of the tagged text.

The operation of the preferred embodiment (s) of the present invention is described with reference to FIGS. 3 and 4. Initially, it is assumed that the reading file 1 is down to the memory 22 of the display device 20 in step 30 together with the sensory presentation file associated with the reading file 1. Next, the reader in step 31 provides the processing unit 21 with the desired reading speed at which the stream of text from the reading file 1 is provided on the text display unit 23. The text portion 2 of the read file 1 and the corresponding sense code control portion 3 are retrieved from the memory 22 and decoded in step 32. In step 33 the processing unit 21 prepares text from the retrieved text portion 22 for presentation, identifying the sensory presentation file 4 from the control code portion 3. Based on the reading speed provided during step 31, the processing unit 21 determines the number and / or duration of the areas 5 of the sensory presentation file 4 identified to be executed in step 34. In step 35, the prepared text is provided on the display unit 23, and the area (s) 5 of the identified sensory presentation file 4 are executed simultaneously with the presentation of the prepared text. The processing unit 21 then repeats steps 32 to 35 until the entire contents of the read file 1 are retrieved and provided to the reader or the reader signal to the processing unit 21 stops the presentation.

In the case where the display device 20 includes the text-audio software beads 27, the operation of the read-only file 1 to include one or more links to the sensory presentation file 4 is described with reference to FIG. 4. It is explained. In step 40, an RSVP-based text file is prepared by the processing unit 21 to identify words that can be associated with the sound. Next, each identified word is tagged in step 41 by adding a control code that indicates the particular sensory presentation file 4 in the bank 28 of the sensory presentation file 4. Upon matching between each tagged control code and the corresponding sensory presentation file 4 present in the bank 28, the corresponding sensory presentation file 4 is linked to the RSVP-based text file.

Thus, according to the description of the present invention, it is clear that the same can be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and such modifications as are apparent to those skilled in the art are deemed to be included in the following claims.

Claims (21)

A read file that can be interpreted by a computer-assisted reader, A plurality of text portions comprising text for forming a stream of text that can be presented to a reader of at least one group of words at the same time, and At least one sense code portion associated with the at least one text portion, wherein the at least one sense code portion identifies an executable sensory presentation file and links the executable sensory presentation file to text in the associated text portion. Read file having a code that can be interpreted by a computer-assisted reading device. The method of claim 1, And the sensory presentation file comprises an audio file. The method of claim 1, And further comprising a plurality of sense code portions associated with the separate text portions and comprising code identifying an executable presentation file. The method of claim 1, And the sensory presentation file comprises an audio file of a sound corresponding to at least one word of a relevant text portion. As a way to provide the reader with information from the reading file, Retrieving a first portion of a read file having textual information, Retrieving a second portion of the read file associated with the first portion to include code; Determining a sensory presentation file identified by the code of the second portion, Visually presenting text from the first portion, and And executing the sensory presentation file concurrently with providing text visually from the first portion. The method of claim 5, And the sensory presentation file comprises an audio file. The method of claim 5, Receiving a desired reading speed from the reader, wherein executing the sensory presentation file comprises determining a duration of sensory presentation file execution based on the desired reading speed. How to provide the reader with information from the reading file. The method of claim 7, wherein The determining step, Determining an area for dividing the sensory presentation file; Determining priority information corresponding to each area of the sensory presentation file, and Executing one or more regions of the sensory presentation file having higher priority information based on a desired reading speed. The method of claim 5, First receiving a read file and associated presentation file using a wireless application protocol. A computer program product for providing text from a read file on a display device comprising a processing unit, a memory and a display unit, Retrieving a first portion of a read file having text information from memory of the display device, Retrieving a second portion of a read file associated with the first portion and containing code from the memory of the display device, Determining a sensory presentation file stored in a memory identified by the code in a second portion, Instructions for visually providing text from the first portion on the display unit, and Computer program product comprising instructions for executing a sensory presentation file concurrent with text from a first portion provided on a display. The method of claim 10, The display device includes a speaker, And the sensory presentation file comprises an audio file, wherein the instructions to execute the sensory presentation file include instructions to play the audio file using a speaker. The method of claim 10, Further comprising instructions for receiving a desired read rate from a person reading at the processing unit, And instructions for executing the sensory presentation file include instructions for determining a duration of sensory presentation file execution based on a desired reading speed. The method of claim 10 The command to execute is Determining an area for dividing the sensory presentation file, Determining priority information corresponding to each area of the sensory presentation file, and And instructions for executing one or more sensory presentation files having higher priority information based on a desired reading speed. The method of claim 10, Further comprising instructions to first receive a read file using a wireless protocol. The method of claim 10, And determining the priority information corresponding to each area of the sensory presentation file based on contents of the sensory presentation file and instructions for determining an area for dividing the sensory presentation file. Computer program product. A method of creating a read file that displays a stream of text from an electronic device, the method comprising: Identifying a word in an RSVP-based text file corresponding to the sound, For each identified word, determining a code value that links the audio file to the identified word of the RSVP-based text file, wherein the sound is generated by executing the audio file that is the same sound corresponding to the identified word. Determining the code value, and Adding each code value to an RSVP-based text file. The method of claim 16, Wherein each code value is located in an RSVP-based text file proximate a corresponding identified word. A device for providing a stream of text to a reader. A display unit for displaying text, A memory for storing a read file having a plurality of text portions containing text information and at least one sense code portion containing code, and Reads a read file, processes the text portion providing text as a stream to the display unit, identifies the sense code portion and the corresponding text portion, and extracts the sensory presentation file from the memory identified by the code of the sense code portion And a processing unit for retrieving and executing the sensory presentation file concurrently with the presentation of the text from the corresponding text portion. The method of claim 18, Further includes a speaker, And the sensory presentation file comprises an audio file, the execution of the audio file being played on a speaker. The method of claim 19, And the processing unit determines the amount of audio file played on the speaker based on the amount of time the text from the corresponding text portion is displayed on the display unit. The method of claim 19, And the device comprises a cordless phone.