CZ378699A3 - Method and system for making audiovisual work - Google Patents

Abstract

The audiovisual work has written components placed on images works so that both every word or other spoken expression is heard. Written component to create the association with the audible component is coordinated highlighting or differentiating a written component so future presentations either spoken or written the component will evoke a second component in the mind the original listener-viewer. Each word appears appropriately in a noticeable perspective near the mouth (M) of the speaker (S). The work is »Displayed linearly or as computer controlled through the listener-viewer together with the complementary teaching materials. Selective use can be used groups of words highlighted or not highlighted.

Description

Technical field

The present invention relates to an educational audiovisual work including picture scenes with natural communication situations for presentation to the viewer-listener.

BACKGROUND OF THE INVENTION

The present application is partially a continuation of U.S. Patent Application Serial No. No. 08 / 310,458, filed Sep. 22, 1994, entitled An Audio-Visual Work With A Series Of Visual Word Symbols Co-ordinated With Oral Word Utterances, which is pending, this application being partially a continuation of U.S. Patent Application Serial No. No. 08 / 209,168, filed Feb. 24, 1994, the disclosure of which is discontinued, this application being in part a continuation of U.S. Pat. No. 08 / 126,341, filed September 23, 1993, whose proceedings were suspended.

Prior art audio visual presentations may incorporate caption titles (US Patent No. 3,199,115 and US Patent No. 5,097,349) or bubble type legends (US Patent No. 1,240,774 and US Patent No. 2,524,276), which are always intended to assist in the linguistic interpretation of the oral parts. presentation.

Although the subtitles of the prior art have merged from time to time to pronounce one word in another language, such occurrences were random, infrequent, and without a controlled pattern to achieve a specific association of a series of sounds with a series of written symbols. Moreover, the placement of the caption words was distant from the pictorial action.

Prior art flashing cards, each displaying a word, attempted to teach reading through repeated emphatic and unnatural exercises. Although these cards ultimately have some effect, the use of these cards requires longer periods of learning and the personal presence of a literate lecturer, whether mother or school teacher. These cards also do not provide the strength of the association that the present invention provides by creating links during a story mediated by an audiovisual medium that has an appeal to a student outside of his literacy instruction.

US Patent No. 5,241,671 discloses a computer-screen presentation of the text of any article with certain words 15 underlined and certain words not underlined.

When a user selects a word from the text, its definition appears in the on-screen window and the voice is spoken. An audio icon may also be displayed

2Q playback.

Closed caption works provide separate areas or boxes where groups of words are displayed. closed caption systems displaying groups of words along the bottom of the screen or in other distant locations from speakers or actors. Closed caption words appear next to, below, or above a visual image scene with a different background, usually white. Images of sign language symbols with audiovisual components to help the deaf are also shown in separate

adjacent frames. These frame rendering techniques can be distracting for viewers.

Educational audiovisual works have been broadcast, which include instructors looking into the camera and saying words, with the corresponding written words being displayed in front of the speaker as they are pronounced. Audience viewers are already tired of such educational formats and especially younger audience viewers are completely losing interest in the presented subject.

SUMMARY OF THE INVENTION

Briefly, the present invention encompasses an audiovisual work and a method of making it that utilizes the natural environment of commonly followed words with their usual and common series of picture frames or segments presented along with the speech and other oral presentations of the work, in addition to a series of written components associated with or correspond to a series of linguistic utterances as they are gradually heard by the viewer-listener. In this description, this system will be referred to as eutetic (well placed) captioning.

The spoken word and the written word correspond in this context if they are the same word. A pronounced word in one language with a written word having the same meaning in another language is associated words in this context.

According to some embodiments of the present invention, it is an advantageous feature that each written component appears in proximity to, on or in conjunction with the speaker's head, so that the written word, the spoken word and the facial, lip and head movement can be viewed simultaneously by the viewer / listener. so that closeness and alignment with the mouth creates the impression that

the word came out of his mouth. In other embodiments, each written component appears near, on, or in conjunction with the hand or hands of a person using a sign language. According to further embodiments of the present invention, in conjunction with the spoken words of the speaker, a written component in Braille is displayed on a separate device.

The present invention is used with non-educational audiovisual programs typically designed for entertainment, information or other purposes, the primary purpose of these audiovisual works being not to teach literacy. The present invention can be used with such materials, either as an element of new production or as re-fed into previously created audiovisual works. The present invention can also be applied to newly created materials designed to teach literacy and which are designed to apply the present invention. Such newly created materials aimed at literacy teaching and implementing the present invention should, as a result of the use of the present invention, be less boring and less repulsive to students than current θ audiovisual materials whose primary objective is literacy teaching.

It is an advantageous feature that the audiovisual work of the present invention can be directly or linearly presented or integrated by programming and using a multimedia computer platform to create a work that is interactively operable by the viewer / listener to provide supplementary instructions.

Another advantageous feature of the method of the present invention is that it has utility in a social activity in which sufficient works are processed to insert words into audiovisual works as described above, using the basic words of the language and retransmitting or otherwise conveying such works the population to teach a certain part of the population to recognize these words as they are read.

Finally, the present invention also encompasses the selected use of a group of words appearing near the source or apparent source of pronouncing words, which words may or may not be selectively highlighted or otherwise distinguished to form an association with the heard word or words having the same meaning, or forming an association with the monitored and heard word or words.

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 illustrates the prior art;

Giant. 2 shows a series of front views of a speaker with written words appearing in different planes in the mouth of the speaker;

Giant. 3 shows a series of front views of a speaker with written words appearing, all in the same plane, in the mouth of the speaker;

Giant. 4 is a flowchart illustrating steps and items of equipment for use in the present invention;

Giant. 5 illustrates another flowchart illustrating the creation of an interactive work including simultaneous audiovisual speaking writing according to the present invention;

Fig. 6 is a flowchart illustrating further steps and items of equipment for use in the present invention;

Fig. 7 is a flowchart illustrating a method 5 of expanding an audio portion of an audiovisual work to assist in coordinating audio and written components;

Giant. 8 is a front elevational view of a speaker with a word near his mouth;

Giant. 9 is a partial schematic plan view of the illustration of FIG. 8 with dialog planes shown;

Fig. 10 shows a perspective view of a television screen 15 with a speaker in different positions;

Fig. 11 shows another perspective view of another speaker;

12a and 12b are flowcharts for a method of performing euthetic subtitling according to the present invention;

13 and 13b are flow charts for another system and method for performing euthetic subtitling according to the present invention;

Fig. 14 is a flow chart of another system and method for performing euthetic subtitling according to the present invention;

* · «· · · · ·

4 4 4 4

15a and 15b are representations of waveform sound expansion according to one aspect of the present invention;

Fig. 16 shows a flow chart of another system and 5 method for performing euthetic subtitling according to the present invention;

Fig. 17 is a flow chart of the system and method illustrated in Fig. 16, but showing further details regarding the computer workplace;

18a and 18b are flowcharts illustrating further details regarding the computer workstation as shown in Fig. 17;

19a to 19d show representations of the application of eutetic subtitling;

Fig.20 and Fig. 20B shows representations of four-quadrant placement achieved with eutetickým subtitling ²⁰ according to the present invention;

21a and 21b are flowcharts illustrating the intuitive application of euthetic captioning according to the present invention;

Fig. 22 shows a schematic diagram of a multimedia platform according to the present invention;

Fig. 23 is a flowchart of an interactive function according to the present invention;

• * * * * * M M «« «« «« M M M M M M M M M M

Giant .

Giant

Giant

Giant

Giant

FIG is a flowchart for interactively pronouncing words according to the present invention;

is a schematic representation of a suppressed zone according to the present invention;

is a schematic representation of one sign language embodiment of the present invention;

is a perspective view of a person with the word WOW near their mouth;

is a view similar to the illustration of Figure 27 but with two words close to the mouth;

is a view similar to the illustration of Figure 27 but with three words near the mouth;

Giant

Giant

Giant

Fig. Is a view similar to Fig. 27 but with three words displayed, one word being shown higher than the other two words;

is a view similar to that of FIG. 27 but with three words displayed, wherein the above word is differently positioned relative to the other words displayed;

.32 is a perspective view of a person's head in four (4) different dialog planes with words depicted in these planes;

.33 is a view similar to FIG. 32, in which a group of words appear in each dialog plane with the selected words highlighted;

Fig. 34 is a view similar to Fig. 32, in which words appear in planes parallel to the flat plane of the screen with the selected words highlighted;

Fig. 35 is a view similar to Fig. 33, in which words appear in a plane parallel to the flat plane of the screen with the selected words highlighted;

Fig. 36 is a view similar to Fig. 32 in which the words are not highlighted, the words being different from the initial appearance;

Fig. 37 is a view similar to Fig. 36, with words appearing in flat planes;

Fig. 38 is a view similar to Fig. 33, but without the words highlighted; and

Fig. 39 is a view similar to Fig. 36, but without the words highlighted.

DETAILED DESCRIPTION OF THE INVENTION

Giant. 1 illustrates a prior art X screen that shows a typical audiovisual image 2 (shaded area) having a prior art closed caption frame 3 inside image 2 that includes the words in the house "; The prior art sign language frame 4 in Figure 2, and the lower elongated word tracking area 5 in the Image 2, which includes the words at eleven. Area 5 carries the words that move in * · ·· «« «» * * * * • • • • • • • • • • • • • • • Φ «in the direction of the arrow A. Sounds involving dialogue associated with the image 2 appear to be extending from the area of the sound source 6 for the most part.

Words or other symbols according to the present invention are normally placed on the video portion of the audiovisual work within the audio source region 6; but the words can also be superimposed on that part of image 2, where the attention of the viewer-viewer is directed by his / her interest in the audiovisual work, such as where the action is, whether the location of the action merges or does not coincide with the sound source.

¹⁰

In one preferred embodiment, the present invention places words in a coordinate system of speakers in an audiovisual work (i.e., in planes not parallel to the screen plane). Because the viewer's coordinate system is on the screen plane, the words shifted from that plane to the actor's world are easier and meaningful to track and appear to the viewer as three-dimensional objects.

As can be seen from FIGS. 2 and 3, the spokesperson S. in the audiovisual work has a head H and a mouth M, from which

2in the plane £, he discovers the word look as a word that is spoken. The plane is approximately perpendicular to the plane through the ears of the speaker (not shown). Each word preferably appears within a short period of time in which the word is spoken or pronounced; however, the word may also appear just before and just after it is spoken (while ensuring that its appearance does not interfere undesirably with words and sounds spoken before or after). The criterion is that, as each word is spoken, the viewer-listener is provided with the associated corresponding written word or written component.

The present invention provides for the presentation of a meaningful sequence of spoken words (or other linguistic expressions) together with a * * *. A coordinated sequence of written words, numbers, or other written components to create a combination of such spoken word or linguistic expression and the written component at one point in the mind of the viewer; listeners.

The purpose of coordinating the presentation of a plurality of written words or written components, one at a time, with the corresponding spoken words is to provide the viewer-listener with a natural environment (the ability to form or associate) these sounds and characters for the purpose of remembering so future presentations of either sound or character will evoke a second element from the pair in the viewer-listener. Although this purpose is particularly suitable for literacy, foreign language learning and education, another advantage of the present invention is the increased clarity of understanding by allowing the viewer-listener to receive and understand the word orally or visually, or both, depending on his ability, attention or location , as regards the unit displaying the audiovisual work. A second advantage is the translation of foreign audio recordings with increased understanding provided by the location of the written translation in or near the mouth; and the third advantage is to achieve a simultaneous bilingual written presentation by presenting two written components, one in the speaker language and the other in the other language, both appearing concurrently with the spoken expression. Where spoken language may be published in series so quickly that visual coordination with the written components is not practical, the affected part of the audiovisual work may be digitally enhanced in terms of sound, and may be expanded visually by either digital or digital

• 44 4 4 4444 44 44 • 4 * 4 • 4 4 • 4 • « • • 4 4 · · • 4 4 · 4 4 4 4 4 4 4 4 4 • 44 44 44 44 »· 44

by analog means (so as to allow comprehensible association).

Bigrams, trigrams, or quadragrams (two, three, or even four word sequences) can be displayed simultaneously, where the goal is to understand the deaf or non-speaking language of the audiovisual audiovisual work and the one-word presentation is too fast; in both cases, the intention is for the subtitles to be offered in a language that the viewer already understands. In such a case, the number of words should be the smallest number of words that still allows an appropriate time frame for understanding by reading the phrase. This approach is a substitute for closed captions or subtitles of foreign films, where the goal is limited to understanding the story or entertainment program rather than creating appropriate associations with spoken language.

According to another embodiment of the present invention, one or more words are placed in conjunction with the hand or hands of the person speaking the sign language, such that a link is established between these words and one element of the sign language. In this way, the viewer-listener has the ability to create an association in the natural environment of these words for the purpose of remembering that these words are associated with this sign language element.

According to yet another embodiment of the present invention, the words may be placed on the audiovisual work such that they are only visible to a viewer using a special reading device. This is analogous to three-dimensional presentations, which are only visible when the viewer is wearing a special type of glasses. Of course use

A special type of glasses is a preferred method for implementing this embodiment of the invention.

The words are displayed according to the present invention as an integral part of the video scene of the audiovisual work to which they are superimposed. Image scenes include components such as human figures, furniture, sky, background cityscape, and the like. Words can be superimposed on one or more image components, and the written word need not prevent it from being positioned

Or to prevent partial viewing of a portion of an image component if the written word is translucent or semi-transparent or is composed, for example, of boxed letters.

Because presenting more than one written word to the 15 listener-viewer at a time while these words are pronounced makes it difficult or even impossible to correctly associate the correct sound with its corresponding written word, it is important that each sound and its corresponding written word is made available in such a way that it is then easily possible to listeners ^20-viewer to associated two corresponding elements. To avoid disagreement or confusion, each spoken word should be associated with its separate written counterpart, with the possible exception of an added pictogram of that word, a sign language element for that word, or a foreign translation of that 25 word. Such a written word or words may be displayed before, during and after the word is spoken, ensuring that such display does not take place while the previous word or the next word is spoken.

More than one word or symbol may appear during a linguistic expression while ensuring that each such word and symbol is associated with a linguistic expression.

For example, if the word thank-you is pronounced, the word thank-you and the word merci may appear at the same time.

During an audio-visual presentation, there are speech time periods in which words are spoken, and there are periods without speaking. In the one-word-at-one-time procedure of the present invention, the written word appears only during a period comprising (1) a no-speaking period following the previous word, (2) a speech-speaking period, and (3) a no-speaking period, following the utterance of the word (speech period of the word) before the following word is spoken.

By presenting the words based on the alphabet in the image environment of these words to the mind of an illiterate student, the words logograms are intended to be remembered, which use the part of the brain that records the entire visual images, just as the film receives light to create a photograph. A segmental presentation according to the present invention of an alphabetical word, accompanied by either spoken or pictorial reference, or both, creates a recallable association in the student's mind between the written word (which is accepted as a logogram, although normally written) and the currently presented link (s) ). After a certain repetition, the presentation of the word based on the alphabet (logogram) then invokes the reference (s) in the student's mind, i.e. the spoken word. This, of course, defines an act of reading whose teaching function is the purpose of the present invention.

The same process of duplication of spoken and written words also teaches, in the reverse way, a student who is literate in that language to be able to speak. In this case, the reference is a written word or logogram and the aim of teaching is the spoken word.

The key to learning intensity, especially in children, is that associations are presented in an environment that is natural and similar to the environment in which the child learns to speak. The environment in which the child learns to speak, which usually and generally does not include formal speaking lessons, is of the same type as the environment that the present invention provides audiovisual. In a preferred linear embodiment of the environment of the present invention, the listener-viewer is introduced into the environment of a story or other presentation whose primary purpose is not to teach literacy. When one learns to speak, it is exposed to visual images or actions that are demonstrated or played back by actors (such as parents) in the student environment, and which serve as links that reach associations with parallel speech. The environment of the present invention is an environment where the visual images or actions that are demonstrated and played back by actors (such as parents) in the student environment (i.e., children) serve as references that are achieved by association with parallel speech. Such an environment deliberately involves gradual linguistic utterances, since the actors in the student's environment also tend not to speak random vocal utterances. Thus, the natural situation for language learning is presented in a typical film in which natural communication situations are depicted and in which a repetitive sound presentation of the same word takes place through natural recurrences during the film. Together, the natural environment and the cinematic portrayal provide for associations between actions and objects and their corresponding descriptive language

speeches. The present invention extends the possibility of forming associations also to the written word in the audiovisual representation of the natural environment.

The method of the present invention makes it possible to teach reading through presentation to a student whole words as opposed to syllables or letters of a word. Tracking and memorizing an entire word is similar to watching and learning a symbol, such as a cat image or a Chinese language sign, in that such an entire word, as might be assumed, is processed by the human brain in the same way. Tracking each word as a whole (or reading it) provides learning based on the development of mind associations that are visually stored or instilled and re-equipped through the association rather than through human brain analysis required for alphabet, syllable or fonetice.

Where two written expressions are shown, i.e. one in written form and the other in pictorial form corresponding to one spoken word, the two written expressions may merge or separate to indicate that the two expressions are combined or even the same. For example, when a person pronounces cat in the video, the written word c-a-t could be converted to a cat image (cat = cat).

Whether the associations formed by the present invention are in the context of already existing audiovisual works already existing or are to be newly created, these associations according to the present invention occur in a normal, natural image environment. For example, such associations could occur in photographic fiction scenes where the detective converts with a suspect; in video scenes where the actor · sings, or in TV news, where the meteorologist speaks and points to the map. In all situations just cited, the primary purpose does not necessarily involve literacy instruction.

The present invention is also applicable to the teaching of lip reading, where spoken speech is performed, and as the written component is displayed, lip movement can be monitored simultaneously as part of the visual portion of the work.

One advantage of placing words at or near the context of the corresponding resource within the display image area is that it is now easier for the viewer to see the word when they hear the word, while keeping the view focused on the action in the work in progress. Although the eye can see peripherally words located at the edge of the screen or even outside the image area, it can only be read with difficulty if it still wants to maintain a meaningful focus on the elements of action in the audiovisual work. Among other things, the present invention greatly overcomes closed captioning. Closed captioning also presents more than one word at a time, preventing an association between one word and the sound. In addition, the present invention presents words in a dimensional relationship to the speaker, which limits violent insertion and minimizes the screen area occupied by the written word.

When two people are conversing with each other, whether or not facing each other, one plane between the two people can serve as a plane on which the written words will be displayed. This technique can also be used when one of the speakers is off camera, where the listener is informed of the relative position of the speaker off camera.

The color, shape and other characteristics of the letters of each written word are designed to be unobtrusive.

For example, if the background of the image component on which the word is superimposed is dark blue, the letters of the word may be light blue or in another shade of blue. Also, the written word can be made translucent or semi-transparent so as to allow partial continuation of the background visualization. Also, a word can be color, font, or otherwise encoded with its source.

Referring again to Figs. 2 and 3, as the head H of the speaker S rotates, the plane Et, which is approximately perpendicular to the line through the ears of the speaker, moves to three (3) additional positions; or planes P ,, P ₃ , P ₄ . When the word AT is pronounced, does it appear in perspective in the plane P _? ; when the word SPOT is pronounced, it also appears in plane P, ₃ in perspective, and finally, when the word GO is pronounced, it appears in plane P ₄ . Each word is placed at or near or even on the head and preferably at or near the mouth of the speaker when said word is pronounced. It should be noted that, as Speaker S.'s head H turned, she also leaned to raise her chin (see plane P ₄ ). The orientation of the written component preferably reflects the orientation of the head in terms of lateral and upward movements.

In FIG. 3, all written words appear in planes PP which lie in or parallel to the plane of the screen on which the audiovisual work is presented.

Fig. 4 shows an apparatus for creating an audiovisual work that includes an operator station; a video text generator for producing the desired written expression (such as the word look); input means • an audiovisual work for the insertion of a work that does not yet have written observations stored therein; a digital optical manipulator providing means for combining the text of the audiovisual work to ensure coordination of the spoken expression and the described expression according to the present invention in the correct orientation. This manipulation creates an audiovisual work according to the present invention in which this coordination occurs throughout the work so that the work can be viewed and listened without interruption during its presentation, such an embodiment being a linear (direct) embodiment of the present invention.

Groups of letters are appended, printed, superimposed, or otherwise placed on that part of the image that is most likely to be viewed when word 15 is pronounced. When the speaker's head is visible, the written words will generally be placed at or near the mouth so as to create the impression that the word comes out of the mouth. This sequence continues for all or a substantial number of spoken expressions throughout the work or, if desired, for the segment of the work.

0

Letters can be of any size, from any font, or any color. In a preferred embodiment of the invention, the size, font, color or any other graphic attribute is chosen to reflect the background colors and the emotional and intended content of each spoken expression. As far as the background is concerned, each written word will be implicitly translucent, semi-transparent, framed, or in a color that is a shade of background color to achieve visibility without leaving a shaky or duplicate image on the retina once the word has passed. In terms of emotion, intent, or meaning, anger words, for example, will have a red color with a sharply typeface, while lullaby words will be pastel color with a soft, slanted typeface. Emotionally neutral words will be presented in an implicit color. The purpose of graphical attributes is to provide the viewer-listener with dynamic graphics in parallel with the nuances of spoken expression created by volume, tone, melody, or other voice attributes, thereby improving the ability to create associations that can be recalled in the student's mind in the future.

Natural communication situations are predominant in the audiovisual work of the invention. Such situations include, for example, the detective interrogating the suspect as mentioned above. Placing words on scenes involving natural communication situations provides a tool for creating desired associations of sounds and written components, while the viewer-listener remains attentive to natural communication in the audiovisual work.

As now seen in Fig. 5, a linear embodiment of the present invention is used to create an interactive embodiment by creating a computer program that allows the viewer / listener to stop the audiovisual presentation to be displayed on the screen on which the audiovisual work is presented, definition of words, syntax and context of sentences or other information that can be traced. The interactive work is presented by the activity of a viewer / listener using a programmable educational means for using such a program to display the work, stop the work to watch selected written components, and to obtain additional information regarding those written components.

As can be seen from Fig. 6, the audiovisual works are created by the computer graphics creator at his workstation, where the video signal of the work (in analogue or digital form) is presented on the creator's screen. When working with frames (1/30 second image sequences), the computer graphics creator creates computer graphics or text (that is, a word), which then superimposes on the video signal of the frame or frames depending on the length of time it takes to utter the word. The length of time one word needs to be spoken varies with a large number of words in everyday English (or another language) conversation between 1/60 and 1/2 seconds. By using animation and drawing software, additional font properties can be added to the letter font in the word and the orientation of the word in the selected plane can be changed.

Giant. 7 illustrates a method of stretching the time a word is spoken in an audiovisual work for the purpose of providing a longer presentation for an associated written word. This extension or extension of the time for which the word is heard is done by digitizing the sound of the word on the hard disk as far as the waveform is concerned, and then reconfiguring that waveform. Such a technique does not distort the melody or tone.

The head K ', as shown in Fig. 8, faces the right side of the viewer as indicated by the dashed source line SL. The source line SL is located in the reference plane P of the display ₅ of the speaker (not shown). The viewer's vertical reference plane A is viewed as a line by the viewer. This plane remains fixed. The source line SL passes through the word WOW as a grill needle.

With respect to the WOW distance by which it is located from the speaker head H ', it preferably falls within a distance interval d, which is twice the width d ₁ of the speaker face N with the nose N (see FIG. 8). This 2W word placement (WOW) _: provides good results for scenes where the speaker's head is near. Where the head is distant, such as in a long shot, the word may be larger than the head but still close to head H ', or shifted to the viewer-listener object, in which case the distance ch may be 3 or 4 times width d _L .

Giant. 9 is a schematic plan view of FIG. 8 showing the dialog plane P ₅ , the plane A (180 ° viewer reference plane) and the plane B which is a 90 ° plane. The dialog plane P ₅ having the source line SL includes the word WOW that appears in such an orientation. Words appearing in other dialogue planes P _E and P _7, which are 25 ° from the plane A and the viewer 180 of the viewer reference plane, are readable but since words stored in dialogue planes closer to viewer reference A (main plane tracking for the viewer) is difficult to read, such a location (in this blocked area) is rarely used in the practice of the invention.

Giant. 10 shows the television screen 20 of the device 21 with the control knobs 22, 23. The speaker head / face position is shown in multiple views, as also shown in FIG. 2. The view to the left side of the screen 20 shows the head H, face F, El plane with a source line SL ₁ in this plane. The face plane FP is perpendicular to the dialog plane EL. The source line SL-1 is perpendicular to the face plane FP. The face planes generally lie in planes perpendicular to the horizontal when the speaker is in a sitting or standing position. Source line SL. linearly divides the word LOOK.

Other source lines SL, SL, and SL. they are shown lying in respective dialog planes P ₂ , _P, and each of these lines dividing the respective word linearly.

Finally, FIG. 11 shows a speaker with a head ₂ H ₃ F ₃ face and the mouth M. The face plane FP is perpendicular θ relative to the plane of the display (not shown in this figure. The source line SL ₃ which lies in the dialogue plane (not Because Head H ₃ can move in any orientation as spokesman S ₂ deflects or turns back to the viewer, the words at source line SL ·, as pronounced by Head H ₃ in such orientation, in each For example, when the speaker S. is in a standing position and turned away from the viewer, θ would be the word FAST if placed at the dialogue level, at an angle to the viewer at which the word FAST would be completely unreadable, in which case the word FAST would be represented in a selective orientation in such a chosen plane that makes it possible to give the impression that the word originates from H ₃ .

Where time permits, the word FAST may first appear at a position covering part of mouth M and then be rapidly shifted along the source line SL. dialog planes. Alternatively, for example, if a word is to appear on the screen at 0.024 thousandths of a second, that word may appear

• 4 4

4 may appear at 0.008 thousandths of a second partially at mouth M, and then may move along the source line SL- for 0.008 thousandths of a second, and may finally stop at that source line for a further 0.008 thousandths of a second before it stops appearing.

The purpose of storing the words on the source line Sh and in planes in perspective, as described above, is to cause the word to appear when it comes out of the mouth and then to appear as an object in the three-dimensional space of the audiovisual scene.

As an object, the written word is subject to the same laws of physics as any other object.

Thus, if it passes in front of a speaker in an audiovisual work using the present invention, the speech of the speaker may be suppressed and the observation of his written word may be temporarily blocked, partially or completely. The purpose of this aspect of the present invention is to make the word appear as a real object, a concept highly acceptable to the young mind, especially when words are found to be user-friendly rather than abstract.

The words are positioned to appear in perspective with the letters of the words increasing or decreasing in size (see Figure 8, where the letter w on the left is less than the letter o, which is further smaller than the letter w in the right). Words in perspective appear to have direction, including the appearance of movement in that direction. The word in perspective near the mouth of the speaker appears to come out of the mouth. Words are placed as close to the mouth as possible without disturbing the facial expressions of the speaker that are part of the communication.

Not all words spoken during a work must display the corresponding written word, as the selected run periods of the work may offer special spellings and, similarly or for other reasons, may not require written expression.

A preferred use of the present invention is to place words or other alphanumeric symbols or other written expressions on tapes, films, computer diskettes, CD ROMs or other media in a meaningful sequence that ensures association with the oral component of the tape or film or CD ROM or computer diskettes from above. described way. Such alignment and coordination can continue throughout the film or tape from start to finish. The audiovisual works of the present invention preferably have an entertaining or otherwise contextually meaningful substance and content. The viewer / listener learns without specific effort on his part because the viewer / listener enjoys the entertainment or other essence of the audiovisual work.

The present invention creates within the image area ^{20 of the} work the impression of a spoken word which, when visible, has dimension, color, font, movement and other features when viewed.

A word dimension is the orientation of a word in the plane of the screen or at an angle to such a plane of the screen. Words in such an orientation are three-dimensional, as are the other 2 5 components in the image.

Written expressions may include letters, words, pictures, or other symbols.

According to another embodiment of the present invention, the 30 written expressions are represented in Braille Braille,

preferably on a separate device that a person (for example a blind person) can use to listen to the audio program. By analogy to the other embodiments of the invention, a science-based connection is made between spoken expression and Braille written expression at a time, so that the user has the opportunity to form an association in the natural environment for such written expressions in order to remember that these written expressions are associated with these colloquial expressions.

θ Example

A fun video game is used in which a library of pictograms (symbolic views) is accessible to the player. The pictograms will be movable with the cursor. One mouse click on any link will result in the link fading and switching to its equivalent in a written word (logogram), while the speaker or talking head will pronounce that word.

The goal of the game is to create a series of pictogram references, q which create a meaningful sequence. Once a player has arranged such a row, double clicking on the computer mouse will result in the links being transformed into written words (logograms) from the left side to the right side, one at a time, accompanied by the corresponding spoken reference. Then the meaningful sequence is repeated loudly, from left to right, by the speaker, with each word suddenly accompanied by a reference in the background.

While playing this move game, the created link arrangement, which is not a meaningful sequence, will not be behind it

there is no double-click output and no points are counted.

The nuances in the color and graphics of the font can vary according to the natural course of meaningful dialogue. ⁵ such as overall organic look to the present invention creates a new, standardized emotive graphic vocabulary. By way of example, they may be for the following: emotions used the following colors and graphics:

Emotion Color Graphic Design luck white or pink flashing / glittering sadness blue or black broken font wrath red bold font eroticism purple wavy

association 20 in nature.

Physical nature cold 25 hot wet

The nuances of color and font would with physical nature, used for example,

Graphic icicles flames drops could also be as it can be found,

Color gray / ice blue orange / red milky

Such associations are based on the common sense and / or pre-existing studies linking associative graphic effects of color, texture and the like to human emotions and learning ability. In addition, the possibilities of current graphics computer software include visual phenomena such as glowing and radiating, which can be further layered on the above effects for a complementary associative effect.

C

Euthetic subtitling in the context of the story of the present invention can be performed in a number of ways. Giant. 12a and 12b show the steps for applying euthetic subtitling manually.

Giant. 13a and 13b the video system and method of applying euthetic subtitles.

Giant. 14 illustrates a system and method that slows speech performance without losing the melody or tone and without apparent distortion. Giant. 15a and 15b are views of the normal 15 and expanded waveform, respectively, for the word future, which has been expanded by the system and method shown in FIG. 14. The waveform shown in FIG. 15b has the same melody as the waveform shown in FIG. 15a, since the waveform amplitude is kept constant while the waveform is stretched.

Another embodiment of the present invention is useful when the waveform is stretched by some fractional multiplier over that of an integer multiplier. For example, when it is desired to increase the waveform length by one-half (50% magnification) versus doubling the length (100% magnification), known methods randomly choose which parts of the waveform will be stretched. According to this aspect of the present invention, the random selection of waveform portions is limited to the vowel portions only. This can be done by means known to those skilled in the art.

• · «. * »<<<<<<<<<9 <<<9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9

9 99 9 · 99 · 9 99

Giant. 16 illustrates a digital system and method of applying euthetic captioning using known character animation software for positioning words.

Giant. 17 to 21 relate to another embodiment of the present invention, which is a system and method for intuitive euthetic subtitling. Giant. 17 illustrates a system and method as already shown in FIG. 16 using euthetic subtitling software according to this embodiment of the present invention. Giant. 18 is a flowchart showing further details of the computer workplace used in the system and in the manner as illustrated in FIGS. 16 and 17.

Giant. Figures 19a to 19d illustrate details of the application of euthetic subtitling according to the present invention. Giant. 20 and 20b depict the four quadrants of a virtual three-dimensional world in which the eutetically subtitled word appears to appear. Giant. 21 is a flow chart of a software module for positioning a eutetically subtitled word in optimal orientation in any quadrant of the virtual three-dimensional world. This software advantageously triggers a computer workplace system. Although a number of input devices known to those skilled in the art can be utilized, preferably the user specifies a quadrant and creates a source line with the mouse and confirms and enters via the keyboard. The computer system operating the software module automatically places the word on the source line, preferably by passing the source line through the center of the main body of lowercase letters (known to typographers as x-height), such as the horizontal line in letter e. placed, the source line is deleted.

· 4444 • 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

Giant. 22 is a schematic illustration showing a multimedia platform incorporating an interactive multimedia computer workplace for creating interactive, eutetically subtitled works of the present invention. Giant. 23 is a flowchart for software implementing interactive functions.

Giant. 24 is a flow chart of the interactive pronunciation of words as illustrated in FIG. 23. According to this aspect of the present invention, when a user stops a eutetically subtitled audiovisual work on a particular word, a pronunciation lesson can be provided to the user. Advantageously, the user may speak to a microphone associated with a computer that includes voice wave analysis software, which then compares the waveform generated by the user's pronunciation when pronouncing a word with the standard waveform for correct pronunciation of that word stored in a computer file. The computer then provides feedback to the user either by confirming the correct pronunciation (for example, acceptable or excellent) or by notifying the user to retry the word.

The other options outlined in FIG. 23 will preferably be presented as a menu of interactive applications that the user can select. For example, the user may choose a writing application that allows the user to imitate a word displayed on the screen by typing the word on the keyboard or by typing the word on an electronic pickup table (tablet) that outputs the handwriting recognition software. Preferably, the interactive system will provide feedback to inform the user whether or not the word has been correctly typed or typed on a table.

Φ • • • • * *

«♦

··· · · · φ · ·

ΦΦΦ · Λ ·· ΦΦ

Giant. 25 represents the positioning of the word in the forward blocking zone illustrated in FIG. 9. The word may optionally be placed in that zone - on a plane passing through line AA in FIG. 25 - as one way to cause the word to appear out of the mouth of the speaker.

One or more words may also be placed in conjunction with the hand or hands of the person using the sign language, so that there is a connection between such words and one sign language sign. An example of this embodiment of the present invention is shown in Fig. 26, which illustrates a speaker on a TV screen and an embedded frame with the hand of a person performing simultaneous translation into sign language. As the speaker pronounces the word future, and the sign language translator signifies that word, the word future is placed in an embedded frame in conjunction with the sign language element for that word.

27 to 31 show a series of words as they emerge from the mouth of the speaker. Fig. 27 shows the word WOW near mouth M along the speech source line SL. The source line SL of the speech extending from mouth M is in an orientation such that the words just spoken appear as objects at the mouth. In Fig. 28, the second word HE'S appeared after the word WOW, which was shifted to create space for that word HE'S. The word WOW was also distinguished from the word HE'S by highlighting (bold) the word WOW and the third word FAST appeared in Figure 29, which was then also distinguished from the others by bold highlighting. In Fig. 30, the word WOW, now highlighted, has moved up, but is still near the head. Giant. 31 shows the word WOW placed as a distance from other displayed words ·

and is above and on the right side behind the head. All the words shown in Figures 27 to 31 are near the head and the words shown in Figures 27 to 30 are additionally near the mouth.

Another embodiment of the present invention is illustrated in Fig. 32, in which words appear sequentially, one new word at a time as the scene is presented sequentially.

Words, as they accumulate, are collected near the mouth, with some words positioned above other words, all words are displayed near the mouth of the speaker in the dialogue planes P. _T to P. ₄ , these planes having different orientations as is moving the head of the speaker. Gathering words is positioning them to occupy areas that have height and width dimensions that are different from those of the area that a string of words would occupy, which area would include an elongated rectangle where the width would be substantially greater than the height. The purpose of gathering, including the use of two or more lines or series of words, is to place all words near the source or apparent source of the spoken words.

As shown in FIG. 32, the word is first displayed in plane P, followed by the representation in planes P through P ₄ . In the plane P _; the words LOOK AT are in line just above the speaker’s lips. In the next plane Et, after the spokesman turned his head, the words LOOK AT appear in a line similarly positioned with the word LOOK closer to the lips and with the word AT somewhat further away from the lips. The word SPOT appears in the P ₃ plane in the bottom row and is highlighted in bold. Planes P ₂ to P ₄ are dialog planes in which each word lies and is distinguished from other words and image objects

4 • · ♦ 4

by means of bold type for a period of time, during which period the differentiated word is heard by the viewer-listener.

By distinguishing one word from the other words at the same time that the differentiated word is heard by the viewer-listener, an association is formed between the differentiated word that is followed by the viewer-listener and the word just heard. The distinction may be by any means that causes the viewer-listener to distinguish a differentiated word from other words or displayed objects. In this embodiment of the present invention, all displayed words are near the mouth and near the head of the speaker. Examples of word differentiation techniques include enlarging a word or a portion of it to a certain size, creating a certain hue, color, shape, or sharpness, or forcing the word to just move or to move or otherwise create a visual effect that draws attention to the word other words are present and therefore distinguish such a word from such other words.

In another embodiment of the invention illustrated in fig. 33 is shown assembled whole group or bundle of words in each dialogue plane P _T to P ₄ for a selected period of time and during part of such time period, each spoken word differentiated by bold highlighting. Differentiation and speaking or uttering take place at the same time. In this embodiment, no words are displayed that are not near the mouth of the speaker. Giant. 34 and 35 illustrate embodiments that are similar to the embodiments illustrated in FIGS. 32 and 33, except that words appear in planes PP parallel to the screen.

• ·

In the embodiment illustrated in FIG. 36, the word differentiation technique is based on its introduction. The word is spoken at the same time that the word is first introduced or displayed on the screen. When the word LOOK appears on the screen for the first time, the word LOOK is therefore simultaneously heard by the viewer-listener to form the desired association. While the word LOOK is still on the screen, a new word AT appears and at the same time the word AT is heard. In the third sequence, the viewer-listener sees the words LOOK AT near the mouth of the speaker, and when the listener-viewer hears the word SPOT he appears with that word SPOT for the first time on the screen. Giant. 37 illustrates the technique of FIG. 36 except that words appear in planes parallel to the screen.

One or more words in the embodiment illustrated in FIGS. 27 to 37 preferably appear in the monitored proximity of the mouth of the speaker as well as in the frame portion near the head of the speaker. Words also preferably appear for the viewer-listener in an order related to their meaning as a term, phrase or set of words. The words are spoken and heard in a sequenced manner during the time period in which the viewer-listener tracks the words near the speaker's head.

The last embodiment of the present invention employs a group word display technique (see Figs. 38-25 and 39). This embodiment has two specific purposes. One purpose is to give the viewer-listener the essence of what is being spoken in a language unknown to the viewer-listener. The second purpose is to provide the essence of words that are spoken but incomprehensible to the viewer listener due to hearing impairments or other obstacles or due to the inaudibility of sound. The collected words can be placed in dialog planes or planes parallel to the screen plane. No words need to be highlighted in this embodiment of the invention.

Represented by:

Claims (2)

PATENT CLAIMS An educational audiovisual work comprising image scenes with natural communication situations for presentation to a viewer-listener, comprising: (a) at least one video scene comprising frames that may have their visual portion displayed on the screen and their audio portion heard; (b) a series of spoken expressions of words by at least one speaker, each speaker having a head appearing in successive frames of such a presentation of the scene; (c) a series of visual word symbols, wherein one or more word symbols are displayed in a frame portion near the speaker head for a display period of time, wherein one or more such displayed word symbols in a frame portion near the head are differentiated for a differentiating time period, and wherein each differentiated symbol of the word: (i) corresponds to and may form an association with any such spoken expression of the word; (ii) can teach the viewer-listener the visual appearance by speaking the spoken word; (iii) appears with such distinction in the near-frame portion so that the viewer-listener has the opportunity to form such an association; and (iv) appears distinct in such picture frame at the same time as the spoken expression of the different word is heard, so that each such spoken expression and each such corresponding different symbol of the word can form an association at the same time and time within the viewer - listeners; wherein the viewer-listener forms an association of each such spoken expression with each such differentiated word symbol to teach the visual appearance by speaking the expressed word and the sound of the word symbol. The audiovisual work of claim 1, wherein the one or more word symbols appear sequentially protruding from the mouth, the selected protruding words being differentiated at the time such a selected word is expressed by speaking. The audiovisual work of claim 1, wherein each symbol of a word is distinguished upon its first appearance at the mouth. The audiovisual work of claim 1, wherein the differentiation is accomplished by highlighting the word, said word being de-highlighted at the end of the pressing time period, and the second displaying word being highlighted for the second highlighting time period. The audiovisual work of claim 1, wherein the word symbols emerge from the mouth from the speaker and while moving away from the mouth remain near the speaker head and then move to a portion of the screen remote from the speaker head. The audiovisual work of claim 1, wherein the speaker has ears, wherein the symbols of the words appear in a dialog plane extending substantially perpendicular to a line extending through the ears of the speaker. The audiovisual work of claim 1, wherein the presentation comprises non-learning scenes with said 5 word symbols superimposed on such scenes. The audiovisual work of claim 1, wherein the word or words appear in a dialog plane and the dialog plane is at least sixty (60) degrees diverted from the screen plane. The audiovisual work of claim 1, wherein the at least one word symbol is a logogram. The audiovisual work of claim 1, wherein at least one word symbol is a pictogram. The audiovisual work of claim 1, wherein the image scenes are presented in a linear manner without interruption. The audiovisual work of claim 1, wherein the image scenes are presented in an intermittent, non-linear manner using a computer controlled by a viewer-listener. 13. The audiovisual work of claim 1, wherein: 25 that part of the audiovisual work is stretched to expand the time period over which one or more word symbols are seen. 14. The audiovisual work of claim 8, wherein the dialogue plane is positioned through the head of the speaker, wherein at least one word symbol appears in or near the dialogue plane. 15. The audiovisual work of claim 1, wherein the speaker head comprises a face and lips, wherein the movements of the face, chin and head associated with the spoken language are included in said frames. The audiovisual work of claim 1, wherein the different word symbol appears for a selected period of time, and during that period of time, the word symbol is overshadowed by the object in the picture scene as the frames change. The audiovisual work of claim 1, wherein the word symbols are shaped and tilted to appear to be three-dimensional. 18. The audiovisual work of claim 1, wherein the series of spoken expressions is a series of words in a sentence form having meaning. 19 Dec se An audiovisual work for presentation to the viewer, comprising: (a) the number of scenes; b) at least one scene comprising frames which may have their visual part displayed on the screen and their audio part heard; c) one or more spoken expression of words by at least one spokesperson, each spokesperson having a head appearing in successive frames of such a scene presentation, and wherein spoken expression of words is heard by the viewer-listener for a spoken period of time; (d) one or more symbols of words appearing near the head of the speaker during the spoken period of time, the one or more word symbols: (i) answer and may form an association with the one or more spoken language; (ii) is placed in relation to the mouth of the speaker; (iii) give meaning to spoken expressions of words; wherein the viewer can form an association by speaking the expressed word or words with the tracked word or words, and wherein the tracked word or words provide meaning to the viewer by speaking the expressed word or words. The audiovisual work of claim 19, wherein the spoken word or words are a group of words having a sense, wherein the displayed word or words have the same meaning. 21. The audiovisual work of claim 19, wherein the speaker has ears, wherein the word symbols appear in a dialog plane extending substantially perpendicular to a line through the ears of the speaker. 22. The audiovisual work of claim 19, wherein the presentation comprises non-learning scenes with said word symbols superimposed on such scenes. 23. The audiovisual work of claim 19, wherein the dialogue plane has a dialogue plane and the dialogue plane is at least sixty (60) degrees away from the screen plane. 4 ·· * 24. The audiovisual work of claim 19, wherein the at least one word symbol is a logogram. 25. The audiovisual work of claim 19, wherein at least one word symbol is a pictogram. 26. The audiovisual work of claim 19, wherein the picture scenes are presented in a linear manner without interruption. 27. The audiovisual work of claim 19, wherein the image scenes are presented in an intermittent, non-linear manner using a viewer-listener-controlled computer. The audiovisual work of claim 19, wherein a portion of the audiovisual work is stretched to expand the time period over which one or more word symbols are seen. 29. The audiovisual work of claim 19, wherein the dialogue plane is positioned through the head of the speaker, wherein 20 at least one word symbol appears in or near the dialog plane. The audiovisual work of claim 19, wherein the speaker head includes a face and lips, wherein the movements of the face, chin and head associated with the spoken expressions of 25 words are incorporated in said boxes. The audiovisual work of claim 19, wherein the word symbols appear for a selected period of time, and during that period of time, one or more of the word symbols 30 is shaded by an object in the picture scene as the frames change. «* The audiovisual work of claim 18, wherein the word symbols are shaped and tilted to appear three-dimensional. 33. A method of generating an interest of a population group comprising: 5. . member, a group of written words of a language spoken in the territory, characterized by: (a) creating a plurality of audiovisual works, each such work comprising a plurality of image segments, including a series of spoken expressions with each segment; (b) on such a segment, the appearance of one or more written words corresponding to said spoken expression such that each spoken expression and each written word have an association 15 formed differently or otherwise with the corresponding spoken expression; (c) forming at least one segment in said portions for each word in a plurality of written words; and (d) broadcasting or otherwise placing said works into the territory to a certain extent and within a certain period of time; while the population group becomes interested in the written words of the language. 34. A method of teaching a student comprising: (a) the creation of one or more audiovisual works involving natural communication situations, each of which includes a presentation during these situations of a multitude of spoken statements simultaneously with the corresponding written components, each audiovisual work comprising an area of natural interest to the student; it includes: (i) a first section, either of which spoken expressions appear to be protruding or into which the student's eye is focused by inviting the meaning of spoken expressions, and (ii) a second section depicting one or more written components simultaneously with each spoken expression so that create in the cold mind! association between spoken expression and a differentiated corresponding written component; (b) making the works available to the student; and (c) allowing the student to choose an arrangement for viewing and listening over time until each of the plurality of spoken statements has been heard by the student along with watching their corresponding written components in sufficient number of repetitions to assist in learning certain particular spoken statements corresponding to said particular written components. The method of claim 34, wherein the first and second portions overlap. 36. An audiovisual work comprising picture scenes with natural communication situations for presentation to a viewer-listener, comprising: (a) a series of spoken statements by human or other speakers in such stage presentations; (b) a series of written components associated with said series of spoken expressions, wherein the written component distinguished by an initial appearance or highlight is briefly positioned within the image scenes, the written components corresponding to the spoken expression so that each spoken expression and the written component are formed in the mind of the viewer-listener. The method of claim 36, comprising the additional step of placing one or more word symbols in a dialog plane. 38. The method of claim 36, wherein the series of spoken expressions is a series of words in a sentence form having meaning. 39. The method of claim 36, further comprising the step of depicting the speaker with the ears, wherein the word symbols appear in a dialog plane extending substantially perpendicularly with respect to the straight line through the ears of the speaker. 40. The method of claim 36, further comprising the step of presenting non-learning scenes in video scenes with said one or more word symbols superimposed on such non-learning scenes. i. u 41. The method of claim 36, wherein the audiovisual work is tracked on a screen plane and has the step of positioning such a dialogue plane at a tilt of at least sixty (60) degrees from the screen plane. 42. The method of claim 36, wherein the at least one word symbol is a logogram. > 43. The method of claim 36, wherein the at least one word symbol is a pictogram. * 25 44. The method of claim 36, comprising the step of presenting the video scenes without interruption in a linear manner. 45. The method of claim 36, comprising the step of presenting image scenes in an intermittent, non-linear manner using a viewer-listener-controlled computer. 46. The method of claim 36, comprising the step of stretching a portion of the audiovisual work to expand a period of time for which the word symbol of the first region is seen. 47. The method of claim 36, wherein the dialog plane is positioned through the head of the speaker, wherein at least one word symbol appears in or near the dialog plane. 48. The method of claim 36, wherein the speaker head includes a face and lips, wherein the movements of the face, chin and head associated with the spoken word expressions are incorporated within said boxes. 49. The method of claim 36, wherein the one or more word symbols appear for a selected period of time, and during that time period, the one or more word symbols are shadowed by an object in the picture scene as the frames change. 50. The method of claim 36, wherein the word symbols are shaped and tilted to appear three-dimensional. • * 51. The method of claim 36, wherein the series of spoken expressions is a series of words in a sentence form having meaning. 52. A method of placing a series of written components on pictures, frames or segments of an audiovisual presentation, wherein the pictures, frames or other segments have a human or inanimate speaker therein at the time the spoken expression is performed, comprising: (a) selecting an operator-controlled equipment unit, including videotext means; (b) displaying a plurality of words by videotext means, each word having a choice of different sizes, shapes and orientations; (c) placing each of the series of images for viewing by the operator of the unit; (d) controlling the videotext means to select display words; (e) passing selected words to the selected image, frame or segment for permanent placement thereon; and (f) highlighting the selected words; so the word appears on the segment in both positional and temporal association with the spoken expression of the word. 53. The method of claim 52, wherein the words are placed near the head of the speaker. 54. A computer-based data processing system for euthetic subtitling of a plurality of image segments, including spoken language with each segment, comprising: (a) a computer processor means for data processing; (b) a data storage means; (c) means for superimposing on data representing a plurality of image segments, including spoken expressions with each segment, data representing written one or more words, said one or more words being highlighted to correspond to said spoken expressions such that each spoken expression and each written word has an association. 55. The system of claim 54, wherein the means for superimposing data comprises: (a) means for inputting a first analog video signal; (b) means for converting an analog video signal into a digital video signal; (c) means for displaying a video digital signal, one frame at a time; (d) means for exiting the user of the word data and quadrant data; (e) means for incorporating word data, in accordance with quadrant data and other predetermined criteria, into video digital data; (f) means for converting video digital data into a second analog video signal; (g) means for outputting a second analog video signal. 56. The system of claim 54 wherein the means of input from the user of the word and quadrant data comprises: 4 · 4 (A) means for enabling (b) means for the source line; (C) means for 5 (d) means and for (E) means for source lines. select a quadrant for the user; allowing the user to mark the angle calculation for the source line; allowing the user to enter word data; automatic placement of words along 57. A computer-based system for enabling a user to interactively operate eutetically subtitled audiovisual work, comprising: (a) means for displaying the audiovisual work; (b) means for interrupting the display of the audiovisual work; (c) means for allowing the user to specify the word; (d) means for processing additional data relating to the word specified by the user. 20 58. The system of claim 57, wherein the means for allowing the user to specify a word allows the user to specify a word that is displayed when the display of the audiovisual work is interrupted. 59. The system of claim 57, wherein: C means for processing other word-related data comprising: (a) means for storing standard data representing correct pronunciation for a plurality of words; (b) means for outputting from the user voice data ftftft representing the pronunciation of the word by the user; (c) means for comparing voice data with standard word data; and (d) a device responsive to the device for 5 comparing voice data with standard data to indicate to the user whether or not the pronunciation of the word by the user was correct. 60. A method of providing meaning to one or more words heard by a viewer-listener in an audiovisual work during a listening time period but not captured by a viewer-listener, comprising: 1) presenting a plurality of scenes in said audiovisual work, each scene having a speaker with a head and a mouth; 2) causing one or more word symbols to appear near said mouthpiece of the speaker during all or part of the listening time period, the one or more words meaning the one or more words heard. 61. The method of claim 60, comprising the additional step of placing one or more word symbols in a dialog plane. 62. The method of claim 60, wherein the series 25, the spoken expressions are a series of words in sentence form having meaning. 63. The method of claim 60, comprising the further step of depicting the speaker with the ears, wherein the word symbols appear in a dialog plane extending substantially perpendicular to the straight line through the ears of the speaker. * * * 9 9 9 9 9 64. The method of claim 60, further comprising the step of presenting non-learning scenes in video scenes with said one or more word symbols superimposed on such non-learning scenes. 65. The method of claim 60, wherein the audiovisual work is tracked on a screen plane and has the step of positioning such a dialogue plane at a tilt of at least sixty (60) degrees from the screen plane. 66. The method of claim 60, wherein the at least one word symbol is a logogram. 67. The method of claim 60, wherein the at least one word symbol is a pictogram. 68. The method of claim 60, wherein the step of presenting the picture scenes without interruption in the method. that includes linear 69. The method of claim 60, the step of presenting an image method using a computer comprising: intermittent, non-linear scenes operated by a viewer-audience. • 25 70. The method of claim 60, comprising the step of stretching a portion of the audiovisual work to extend a period of time for which the first region word symbol is seen. 71. The method of claim 60, wherein the dialog plane is located through the speaker head, wherein at least one word symbol appears in or near the dialog plane. 72. The method of claim 60, wherein the speaker head includes a face and lips, wherein the movements of the face, chin and head associated with the spoken language are included in said boxes. 73. The method of claim 60, wherein the one or more word symbols appear for a selected period of time, and during that time period, the one or more word symbols are shadowed by an object in the picture scene as the frames change. 74. The method of claim 60, wherein the word symbols are shaped and tilted to appear three-dimensional. 75. The method of claim 60, wherein the series of 15 spoken expressions is a series of words in a sentence form having meaning. Represented by: