US9911349B2 - System and method for language instruction using visual and/or audio prompts - Google Patents
System and method for language instruction using visual and/or audio prompts Download PDFInfo
- Publication number
- US9911349B2 US9911349B2 US13/163,193 US201113163193A US9911349B2 US 9911349 B2 US9911349 B2 US 9911349B2 US 201113163193 A US201113163193 A US 201113163193A US 9911349 B2 US9911349 B2 US 9911349B2
- Authority
- US
- United States
- Prior art keywords
- utterance
- student
- speech segment
- speech
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/06—Foreign languages
Definitions
- the present invention relates generally to teaching machines and, more particularly concerns a system and method for teaching a language.
- the invention is directed to a method of teaching a target language to a language student, wherein the method may include the steps of presenting display information on a display device of a computer system, the display information illustrating a sequence of activity within an instructional environment; prompting the student with audio and/or visual information to submit audible input in the target language to affect activity within the instructional environment; submitting a command by the student in response to the prompt; decoding the command by the computer system; and implementing the student command within the instructional environment.
- the invention is directed to a method for implementation on a language instruction system that includes a computer system, wherein the method may include identifying a speech segment in a target language that is susceptible to mispronunciation by language learners; selecting an auditory attribute for use in playing the identified speech segment by the language instruction system; altering a level of the auditory attribute to differ from a naturally occurring level of the attribute; and playing a first text sequence by the language instruction system, including at least one instance of the identified speech segment, using the altered level of the auditory attribute.
- the invention is directed to a language instruction method for implementation on a language instruction system that includes a computer system, wherein the method may include identifying at least two speech segments in a target language susceptible to being pronounced similarly by a language student; increasing the pitch level of a first of the speech segments with respect to a normally occurring pitch level of the first speech segment, in a first audio file within the language instruction system; decreasing the pitch level of a second one of the speech segments with respect to a normally occurring pitch level of the second speech segment, in a second audio file within the language instruction system; and playing a first text sequence by the language instruction system, including at least one instance of the identified speech segment, using the increased and decreased pitches of the first and second speech segments, respectively.
- FIG. 1 is a schematic block diagram of a language instruction system including a computer system and audio equipment suitable for practicing an embodiment of the present invention
- FIG. 2 is a block diagram of a system for generating computer data files representative of audible speech, from a vocal utterance, in accordance with an embodiment of the present invention
- FIG. 3 is a block diagram of a system and method for converting text, which may be encoded in computer-readable form, into audible machine-generated sound using suitable data conversion apparatus and methods in accordance with an embodiment of the present invention
- FIG. 4 is a block diagram of a computer system usable in conjunction with one or more embodiments of the present invention.
- FIG. 5 is a schematic diagram of a road system serving as an mechanism for prompting a language student to utter commands operable to simulate the navigation of a vehicle through the road system in accordance with an embodiment of the present invention
- FIG. 6 is the schematic diagram of FIG. 5 , in which the vehicle has advanced in accordance with an audible instruction from a language student;
- FIG. 7 is the schematic diagram of FIG. 6 , in which the vehicle has advanced in accordance with an audible instruction from a language student;
- FIG. 8 is the schematic diagram of FIG. 7 , in which the vehicle has advanced in accordance with an audible instruction from a language student;
- FIG. 9 is a flow diagram of a sequence of steps for improving the pronunciation of a language student using machine-induced pitch adjustments for selected sounds in accordance with an embodiment of the present invention.
- FIG. 10 is a flow diagram of a sequence of steps for applying the general approach of the method of FIG. 9 to a specific pronunciation application, in accordance with an embodiment of the present invention.
- FIG. 1 is a schematic block diagram of a language instruction system 100 including a computer system 150 and audio equipment suitable for teaching a target language to student 102 in accordance with an embodiment of the present invention.
- Language instruction system 100 may interact with one language student 102 , or with a plurality of students.
- Language instruction system 100 may include computer system 150 , which may include keyboard 152 (which may have a mouse or other graphical user-input mechanism embedded therein) and/or display 154 , microphone 162 and/or speaker 164 .
- Language instruction system 100 may further include additional suitable equipment such as analog-to-digital converters and digital-to-analog converters to interface between the audible sounds received at microphone 162 , and played from speaker 164 , and the digital data indicative of sound stored and processed within computer system 150 .
- additional suitable equipment such as analog-to-digital converters and digital-to-analog converters to interface between the audible sounds received at microphone 162 , and played from speaker 164 , and the digital data indicative of sound stored and processed within computer system 150 .
- the computer 150 and audio equipment shown in FIG. 1 are intended to illustrate one way of implementing an embodiment of the present invention.
- computer 150 (which may also referred to as “computer system 150 ”) and audio devices 162 , 164 preferably enable two-way audio-visual communication between the student 102 (which may be a single person) and the computer system 150 .
- software for enabling computer system 150 to interact with student 102 may be stored on volatile or non-volatile memory within computer 150 .
- software and/or data for enabling computer 150 may be accessed over a local area network (LAN) and/or a wide area network (WAN), such as the Internet.
- LAN local area network
- WAN wide area network
- a combination of the foregoing approaches may be employed.
- embodiments of the present invention may be implemented using equipment other than that shown in FIG. 1 .
- Computers embodied in various modern devices, both portable and fixed, may be employed including but not limited to Personal Digital Assistants (PDAs), cell phones, among other devices.
- PDAs Personal Digital Assistants
- FIG. 2 is a block diagram of a system 200 for generating computer data files representative of audible speech, such as sample utterances by language students and/or by native speakers in accordance with an embodiment of the present invention.
- FIG. 2 is provided to list and identify the various types of signals and information as well as the audio and data processing equipment that may be employed in accordance an embodiment of the present invention.
- a speaker who may be a language learner (i.e. a student), a native speaker providing a sample reading of a block of text, or an instructor, provides a vocal utterance.
- the vocal utterance which is preferably spoken at a normal conversational volume level is preferably directed to a microphone 204 .
- the microphone 204 preferably converts the audible sound of the utterance (also referred to herein as a speech sample) into an analog electrical signal representative of the audible utterance.
- the analog signal is preferably transmitted from microphone 204 to Analog-to-Digital Converter (ADC) 206 where the analog signal is preferably converted into digital data suitable for storage and manipulation by a digital computer, such as computer 150 of FIG. 1 .
- ADC Analog-to-Digital Converter
- the microphone 204 and the ADC 206 may be incorporated within a single enclosure for the sake of convenience.
- ADC 206 may sample the analog data at 16 KHz (Kilohertz) using 16-bit resolution. However, in other embodiments, sampling rates lower than or greater than 16 KHz and may be used. Moreover, resolution higher than or lower than 16-bit resolution may be employed.
- the digital data obtained at the digital side of ADC 206 is preferably transmitted to a computer memory device for temporary and/or long-term storage so that the data is accessible to programs operating within computer 150 .
- the digital data emerging from ADC 206 is preferably accumulated so as to provide a data file 210 representing an entire utterance (speech sample), that may, for example, represent an entire spoken English sentence (or still longer text portion) in a single data file (or plural data files) that is readily accessible to hardware and/or computer software seeking to access and/or manipulate the digital speech data.
- the digital speech data within data file 210 may be decomposed into speech units (also referred to herein as “speech segments”) accompanied by suitable identifiers of the respective speech units, or otherwise accessed and manipulated to obtain data indicative of characteristics of the speech sample.
- speech units also referred to herein as “speech segments”
- FIG. 3 is a block diagram of a system and method 300 for converting text into speech using suitable data conversion apparatus and methods in accordance with an embodiment of the present invention.
- a computing system such as computer system 150 , preferably obtains speech text in machine-readable form from a suitable computer memory or other source.
- the computer system 150 preferably converts the speech text into audible speech data.
- the data from step 304 may be further processed, as needed, to generate digital data indicative of sounds to be played from an audio speaker 164 . Thereafter, the data from step 306 may be sent to an Digital to Analog Converter (DAC) to generate signals suitable for physically driving speaker 164 in step 310 .
- DAC Digital to Analog Converter
- speaker 164 is caused to play audible baseband sound in response to the analog signals arising from step 308 .
- FIG. 4 is a block diagram of a computing system 400 adaptable for use with one or more embodiments of the present invention.
- Computer system 400 may generally correspond to computer system 150 of FIG. 1 .
- Central processing unit (CPU) 402 may be coupled to bus 404 .
- bus 404 may be coupled to random access memory (RAM) 406 , read only memory (ROM) 408 , input/output (I/O) adapter 410 , communications adapter 422 , user interface adapter 406 , and display adapter 418 .
- RAM random access memory
- ROM read only memory
- I/O input/output
- RAM 406 and/or ROM 408 may hold user data, system data, and/or programs.
- I/O adapter 410 may connect storage devices, such as hard drive 412 , a CD-ROM (not shown), or other mass storage device to computing system 600 .
- Communications adapter 422 may couple computing system 400 to a local, wide-area, or global network 424 .
- User interface adapter 416 may couple user input devices, such as keyboard 426 , scanner 428 and/or pointing device 414 , to computing system 400 .
- display adapter 418 may be driven by CPU 402 to control the display on display device 420 .
- CPU 402 may be any general purpose CPU.
- FIG. 5 shows a system of roads and intersections including a vehicle 600 suitable for being controlled by user utterances.
- the road system 500 may include roads 502 , 504 , 506 , 508 , 510 , and 512 ; intersections 520 and 522 , and bridge 524 .
- Road system 500 is used in the below example to aid in illustrating an aspect of the present invention. Specifically, a language student is prompted either visually or audibly to utter an audible command to control the activity of vehicle 600 within road system 500 . Uttering commands in this manner tends to train the language student to use terms directly related to an activity within a particular context, rather than merely translating words or phrases from the native language of the student to a target language.
- a method according the present invention may require the language student to enter terms that are merely associated with the meaning of the ultimate command, but where the uttered terms don't directly correspond to the meaning of the command.
- road system 500 as shown in this sequence of FIGURES may be displayed on a computer screen or other suitable display device, and audio prompts or other information may be deployed to play audio information to the language student.
- FIGS. 5-8 emulate the illustration of a sequence of activity within an instructional environment that may be provided to a language student using live-motion video and, optionally, an audio component as well. Microphones are preferably also deployed to enable utterances by the student to be received by computer system 150 for processing.
- Vehicle 600 is initially situated at a the lower left of FIG. 5 , at an entry point for road segment 502 .
- System 100 preferably prompts student 102 to utter a command to enable vehicle 600 to progress through road system 500 .
- This prompt may be in the form of an audible invitation to have student 102 speak.
- a visual prompt such as flashing the image of vehicle 600 on and off, or changing the color or other graphical attribute of vehicle 600 may be employed in addition to, or in place of the audio prompt.
- student 102 may utter a literal command such as “proceed” or “drive straight” to cause vehicle 600 to move to a subsequent position within road system 500 at which another decision and/or command is needed.
- system 100 may expect, and student 102 may provide, a non-literal command interpreted by system 100 as meaning “drive” or “go forward” or the like.
- the generic utterance “vehicle task one” is one example of an audible command that could be uttered by student 102 to cause vehicle 600 to proceed from the start of road segment 502 to the next stopping point in road system 500 .
- the following steps may also be implemented by having student 102 utter terms associated with literal terms. However, for the sake of brevity, the remaining commands in this example are provided using literal language.
- computer system 150 After student 102 utters the command “drive” or suitable equivalent, computer system 150 preferably adjusts the graphic of road system 500 to the condition shown in FIG. 6 , showing vehicle 600 at intersection 520 .
- vehicle 600 is now at intersection 520 , and a decision may be made to pursue at least two possible navigation options: (a) proceeding straight through intersection 520 toward the start of road segment 504 ; and (b) turning right at intersection 520 and proceeding along road segment 506 .
- System 150 may prompt student 102 , visually and/or audibly, to decide what vehicle 600 should do at intersection 520 .
- student 102 utters the literal instruction “turn right” or suitable equivalent, and vehicle 600 then turns right at intersection 520 , and proceeds along road segment 506 to four-way intersection 522 .
- student 102 may be prompted audibly and/or visually (using the display 154 ) to utter a command to control the subsequent action of vehicle 600 .
- a case is considered in which, upon being prompted, student 102 audibly instructs system 150 that vehicle 600 is to turn left at intersection 522 , by uttering “turn left”.
- student 150 may utter further commands to advance vehicle 600 , including “cross bridge” to advance vehicle 600 over bridge 524 and onto road segment 512 , the result of which is shown in FIG. 8 .
- Readers will appreciate that numerous other combinations of directional commands are possible within road system 500 , and that the specific commands provided in the above example, are provided herein solely to illustrate the interplay between student 102 and system 150 .
- student 102 is uses commands having a meaning within a specific context rather than merely translating words from a source language to target language and vice-versa.
- the principles illustrated by the example discussed above may be readily employed in a variety of different graphical and audio contexts, and it will be appreciated that the use of navigation commands for a vehicle within road system 500 is merely a means of illustrating a concept that could be implemented in a wide variety of decision-making situations.
- a schedule of commands with arbitrary names could be associated with the above-described directional commands, such as decisions to move forward, to cross bridges etc. For instance, if desired, a sequential task number could be assigned to each of the foregoing commands, and the student could be required to utter “task 1” or “task 2” instead of “turn left” or “turn right” at a given intersection.
- the system can preferably use two words that have similar sounds in the target language, but no meaning associated with the desired command, as the two commands. For example, if learners of English pronounce “the” and “dah”, the system might use The and duh as the commands for left and right, to help the student emphasize this pronunciation difference.
- the two or more words or phrases used as the commands can vary in response to a user's progress. That is, when the system indicates that the user has mastered the commands and the difference in pronunciation between the two, the system can instruct or require the user to change the command set to two different words, wherein the two different words may be even closer in pronunciation in the target language than the two prior words used as commands.
- the system can progressively work on harder and harder problems.
- FIG. 9 is a flow diagram of a sequence of steps for improving the pronunciation of a language student by changing selected auditory attributes of selected sounds in accordance with an embodiment of the present invention.
- the method described below is directed to using auditory attributes of machine-generated speech to serve as cues for the pronunciation of a segment of speech, such as phonemes, syllables, letters, words, or other pertinent speech segment, for a language student 102 .
- a general approach is provided in connection with FIG. 9 , followed by a more specification application of the concept in connection with FIG. 10 .
- Method 900 may start at step 902 , at which point speech segments (such as phonemes, syllables, letters, words) susceptible to being mispronounced, and/or groups of group segments susceptible to being pronounced in a confusingly similar way, may be identified.
- speech segments such as phonemes, syllables, letters, words
- groups of group segments susceptible to being pronounced in a confusingly similar way may be identified.
- An example of a single speech segment being mispronounced is the tendency of students starting from some source languages (i.e. native languages) to pronounce the English word “the” as “duh”, due to the absence of the “th” speech segment in various languages.
- An example of a group of separate speech segments being pronounced in a confusingly similar way is the tendency of speakers of certain source languages pronouncing the letters “L” and “R” in a confusingly similar manner.
- system 150 may identify the correct pronunciation for the speech segment to be audibly emphasized for the language student 102 .
- a suitable data representation of the correct pronunciation may be stored in a computer file for the purpose of later comparison with a digitized representation of the student's utterance of a corresponding speech segment.
- the system 150 may also audibly play a sample of the pertinent speech segment to serve as an auditory template for the student to use as a guide in pronouncing the pertinent speech segment during the training method, and thereafter.
- the system 150 preferably selects an auditory effect to impart to the machine-generated version of the speech segment to serve as a cue to the language student to pay particular attention thereto.
- the intensity of the auditory attribute may have an initial level, which may be adjusted in accordance with the student's progress in pronouncing the pertinent speech segment.
- the intensity of the auditory effect may also be adjusted as a function of time, and/or other variable, such as the number of times the system 150 has audibly played the speech segment for the student.
- the auditory attribute used for the machine-generated speech may be selected from a group of attributes that includes but which is not limited to: (a) pitch; (b) volume; (c) tone; (d) variation of the speed at which the speech segment is played; and/or (e) variation of the number of times the speech segment is played. It will be appreciated that the present invention is not limited by the auditory attributes listed above.
- tone (which may also be referred to as “tonal quality”) above may refer to the distribution of harmonics employed when playing the speech segment using system 100 , without necessarily altering the pitch of the speech segment.
- the audible attribute may be replaced with a visual attribute. That is, rather than use two different pitches or other audible attributes to distinguish between the two words at issue, one could use two different shapes, colors, etc. As the user becomes more proficient in the distinction between the two words at issue, the visual prompt to assist in distinguishing the two could gradually fade, perhaps appear less often, or otherwise diminish to the point of not being as much help to the user.
- system 150 may guide student 102 through various words that include the speech segments for which pronunciation improvement is sought.
- System 150 may invite the student 102 to speak a text sequence using audio and/or visual prompts.
- the student 102 utterance of the words may be recorded.
- recording of the student utterance of the speech segment at issue is compared to the previously established template, and a pronunciation error level is preferably calculated (step 912 ).
- the pronunciation error quantity may be determined by comparing the student utterance to the template in real time, without recording the student utterance.
- the setting of the auditory attribute imparted to the speech segment being taught may be adjusted in accordance the degree of progress in the student's 102 pronunciation, as measured in step 912 .
- the surplus volume may be reduced in step 914 to an extent commensurate with the extent of student progress measured in step 912 .
- the system 150 preferably plays the identified sounds using the auditory attribute set in step 914 .
- the magnitude of the alteration of the auditory attribute adjusted in step 914 may be gradually diminished (step 918 ) as the pronunciation of the student 102 gradually improves.
- Step 918 may represent an iterative repetition of steps 908 through 916 to achieve the desired improvement in student 102 pronunciation.
- the machine-generated alteration of the originally occurring auditory attribute for the speech segment at issue may be removed completely once the student 102 achieves a desired level of pronunciation accuracy, as determined in the measuring step 912 .
- FIG. 10 is a flow diagram of a method of applying the concepts of the method of FIG. 9 to a more specific situation. Specifically, the method of FIG. 10 is directed to altering the pitch of the machine-generated play of “L” and “R” speech-segment sounds to guide a language student 102 to a correct pronunciation of these speech segments.
- the principles described herein are not limited to this specific pronunciation issue, and that the system and method disclosed herein may be employed to modify any speech segment in any language to suitably guide student of the language of instruction toward a correct pronunciation of the speech element at issue.
- the method identifies the letters “L” and “R” as letters to being pronounced the same way, especially by students 102 having Japanese or other Asian languages as native tongues.
- methods described herein may be applied to a range of other speech segments (whether letters, syllables, phonemes, words etc) that are susceptible to being pronounced in a confusingly similar way.
- system 150 selects pitch as the auditory attribute to employ to emphasize the distinction between the “L” and “R” sounds.
- pitch As noted earlier herein, various auditory attributes could be modified to emphasize the sound of a consonant or other speech segment, and the present invention is therefore not limited to the use of pitch for this purpose.
- system 150 preferably establishes a regime in which the pitch of “L” sounds is be raised with respect to a naturally occurring pitch level, and the pitch of “R” sounds is to be lowered with respect to the naturally occurring pitch level, within a text sequence to be played for the student 102 by the system 150 .
- the system 150 directs the student 102 to utter a text sequence that preferably includes the “L” and “R” sounds of interest.
- the system 150 preferably records (step 1010 ) the student utterance and then measures (step 1012 ) the error level in the student 102 pronunciation of the “L” and “R” sounds in the uttered text sequence.
- the recording step could be omitted and the pronunciation error level could be determined in real time as the system 150 obtains digitized speech data from the student 102 utterance.
- system 150 preferably adjusts the magnitude of the pitch alteration of the “L” and “R” sounds to an extent commensurate with the measurement (in step 1012 ) of the pronunciation error of the student 102 .
- the greater the student pronunciation error the more system 150 will increase the pitch of the “L” sounds and decrease the pitch of the “R” sounds.
- system 150 plays the text that includes the “L” and “R” sounds with the adjusted pitch levels, for the student 102 .
- step 1018 the magnitude of the pitch adjustments for the “L” and “R” sounds adjusted in step 1014 may be gradually diminished (step 1018 ) as the pronunciation of the student 102 gradually improves.
- Step 1018 may represent an iterative repetition of steps 1008 through 1016 to achieve the desired improvement in student 102 pronunciation of the “L” and “R” sounds.
- the machine-generated pitch adjustment may be removed from the “L” and “R” sounds completely, once the student 102 achieves a desired level pronunciation accuracy, as determined in the measuring step 912 .
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
Description
Claims (10)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/163,193 US9911349B2 (en) | 2011-06-17 | 2011-06-17 | System and method for language instruction using visual and/or audio prompts |
PCT/US2012/042883 WO2012174506A1 (en) | 2011-06-17 | 2012-06-18 | System and method for language instruction using visual and/or audio prompts |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/163,193 US9911349B2 (en) | 2011-06-17 | 2011-06-17 | System and method for language instruction using visual and/or audio prompts |
Publications (2)
Publication Number | Publication Date |
---|---|
US20120322034A1 US20120322034A1 (en) | 2012-12-20 |
US9911349B2 true US9911349B2 (en) | 2018-03-06 |
Family
ID=46458606
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/163,193 Active 2032-04-25 US9911349B2 (en) | 2011-06-17 | 2011-06-17 | System and method for language instruction using visual and/or audio prompts |
Country Status (2)
Country | Link |
---|---|
US (1) | US9911349B2 (en) |
WO (1) | WO2012174506A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11875698B2 (en) | 2022-05-31 | 2024-01-16 | International Business Machines Corporation | Language learning through content translation |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5010495A (en) * | 1989-02-02 | 1991-04-23 | American Language Academy | Interactive language learning system |
US5885083A (en) * | 1996-04-09 | 1999-03-23 | Raytheon Company | System and method for multimodal interactive speech and language training |
WO2000022597A1 (en) | 1998-10-15 | 2000-04-20 | Planetlingo Inc. | Method for computer-aided foreign language instruction |
WO2000043975A1 (en) | 1999-01-26 | 2000-07-27 | Microsoft Corporation | Virtual challenge system and method for teaching a language |
US20020086269A1 (en) * | 2000-12-18 | 2002-07-04 | Zeev Shpiro | Spoken language teaching system based on language unit segmentation |
US20040176960A1 (en) * | 2002-12-31 | 2004-09-09 | Zeev Shpiro | Comprehensive spoken language learning system |
WO2005099414A2 (en) | 2004-04-12 | 2005-10-27 | Burlingtonspeech Limited | Comprehensive spoken language learning system |
US20060161440A1 (en) * | 2004-12-15 | 2006-07-20 | Aisin Aw Co., Ltd. | Guidance information providing systems, methods, and programs |
US20070015121A1 (en) * | 2005-06-02 | 2007-01-18 | University Of Southern California | Interactive Foreign Language Teaching |
US20080152094A1 (en) * | 2006-12-22 | 2008-06-26 | Perlmutter S Michael | Method for Selecting Interactive Voice Response Modes Using Human Voice Detection Analysis |
US7613616B2 (en) * | 2001-05-14 | 2009-11-03 | Sony Computer Entertainment America Inc. | Training a user to execute a sequence of commands in a game environment by using voice control |
US20130041670A1 (en) * | 1998-12-17 | 2013-02-14 | Nuance Communications, Inc. | Speech command input recognition system for interactive computer display with interpretation of ancillary relevant speech query terms into commands |
-
2011
- 2011-06-17 US US13/163,193 patent/US9911349B2/en active Active
-
2012
- 2012-06-18 WO PCT/US2012/042883 patent/WO2012174506A1/en active Application Filing
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5010495A (en) * | 1989-02-02 | 1991-04-23 | American Language Academy | Interactive language learning system |
US5885083A (en) * | 1996-04-09 | 1999-03-23 | Raytheon Company | System and method for multimodal interactive speech and language training |
WO2000022597A1 (en) | 1998-10-15 | 2000-04-20 | Planetlingo Inc. | Method for computer-aided foreign language instruction |
US20130041670A1 (en) * | 1998-12-17 | 2013-02-14 | Nuance Communications, Inc. | Speech command input recognition system for interactive computer display with interpretation of ancillary relevant speech query terms into commands |
WO2000043975A1 (en) | 1999-01-26 | 2000-07-27 | Microsoft Corporation | Virtual challenge system and method for teaching a language |
US20020086269A1 (en) * | 2000-12-18 | 2002-07-04 | Zeev Shpiro | Spoken language teaching system based on language unit segmentation |
US7613616B2 (en) * | 2001-05-14 | 2009-11-03 | Sony Computer Entertainment America Inc. | Training a user to execute a sequence of commands in a game environment by using voice control |
US20040176960A1 (en) * | 2002-12-31 | 2004-09-09 | Zeev Shpiro | Comprehensive spoken language learning system |
WO2005099414A2 (en) | 2004-04-12 | 2005-10-27 | Burlingtonspeech Limited | Comprehensive spoken language learning system |
US20060161440A1 (en) * | 2004-12-15 | 2006-07-20 | Aisin Aw Co., Ltd. | Guidance information providing systems, methods, and programs |
US20070015121A1 (en) * | 2005-06-02 | 2007-01-18 | University Of Southern California | Interactive Foreign Language Teaching |
US20080152094A1 (en) * | 2006-12-22 | 2008-06-26 | Perlmutter S Michael | Method for Selecting Interactive Voice Response Modes Using Human Voice Detection Analysis |
Non-Patent Citations (1)
Title |
---|
Vivien, Angelique, "International Application No. PCT/US2012/042883 Search Report", dated Nov. 2, 2012, Published in: WO. |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11875698B2 (en) | 2022-05-31 | 2024-01-16 | International Business Machines Corporation | Language learning through content translation |
Also Published As
Publication number | Publication date |
---|---|
US20120322034A1 (en) | 2012-12-20 |
WO2012174506A1 (en) | 2012-12-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Sahatsathatsana | Pronunciation problems of Thai students learning English phonetics: A case study at Kalasin University | |
Witt | Automatic error detection in pronunciation training: Where we are and where we need to go | |
Zhang et al. | A study of pronunciation problems of English learners in China | |
Hincks | Technology and learning pronunciation | |
JP2001159865A (en) | Method and device for leading interactive language learning | |
Adams-Goertel | Prosodic elements to improve pronunciation in English language learners: A short report | |
Dhillon et al. | Does mother tongue affect the English pronunciation | |
Demenko et al. | The use of speech technology in foreign language pronunciation training | |
Utami et al. | Improving students’ English pronunciation competence by using shadowing technique | |
Li et al. | Effects of L1 tone on perception of L2 tone-a study of Mandarin tone learning by native Cantonese children | |
Peabody et al. | Towards automatic tone correction in non-native mandarin | |
Deryabina et al. | Phonetization of teaching Russian as a foreign language in digital humanitarian knowledge: theoretical aspect | |
US9911349B2 (en) | System and method for language instruction using visual and/or audio prompts | |
喜多容子 et al. | Japanese learners of English and Japanese phonology | |
Delmonte | Exploring speech technologies for language learning | |
Lee-Kim | Development of Mandarin tones and segments by Korean learners: From naïve listeners to novice learners | |
Howlader | Approaches to developing pronunciation in a second language: A study in Bangladesh | |
Liu | Teaching Chinese pronunciation: Explanation, expectation, and implementation | |
Ahad et al. | Acoustic Analysis of English Long Vowels Produced by Pashto Speakers | |
Gunn | Dialect coaching and linguistics | |
CN111508523A (en) | Voice training prompting method and system | |
Hirose | Accent type recognition of Japanese using perceived mora pitch values and its use for pronunciation training system | |
Proença et al. | Teaching American English pronunciation using a TTS service. | |
Tsubota et al. | Practical use of autonomous English pronunciation learning system for Japanese students | |
Tonoyan et al. | Communicative approach to teaching pronunciation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ROSETTA STONE, LTD., NEW JERSEY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RENDUCHINTALA, ADITHYA;SMITH, ROBIN;REEL/FRAME:026479/0570 Effective date: 20110617 |
|
AS | Assignment |
Owner name: SILICON VALLEY BANK, MASSACHUSETTS Free format text: SECURITY AGREEMENT;ASSIGNORS:ROSETTA STONE, LTD.;LEXIA LEARNING SYSTEMS LLC;REEL/FRAME:034105/0733 Effective date: 20141028 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: ROSETTA STONE, LTD., VIRGINIA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE STATE/COUNTRY OF RECEIVING PARTY DATA PREVIOUSLY RECORDED ON REEL 026479 FRAME 0570. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:RENDUCHINTALA, ADITHYA;SMITH, ROBIN;REEL/FRAME:046363/0980 Effective date: 20110617 |
|
AS | Assignment |
Owner name: ROYAL BANK OF CANADA, AS COLLATERAL AGENT, CANADA Free format text: SECOND LIEN PATENT SECURITY AGREEMENT;ASSIGNORS:ROSETTA STONE LTD.;LEXIA LEARNING SYSTEMS LLC;REEL/FRAME:054085/0934 Effective date: 20201015 Owner name: ROYAL BANK OF CANADA, AS COLLATERAL AGENT, CANADA Free format text: FIRST LIEN PATENT SECURITY AGREEMENT;ASSIGNORS:ROSETTA STONE LTD.;LEXIA LEARNING SYSTEMS LLC;REEL/FRAME:054085/0920 Effective date: 20201015 Owner name: LEXIA LEARNING SYSTEMS LLC, MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SILICON VALLEY BANK;REEL/FRAME:054086/0105 Effective date: 20201014 Owner name: ROSETTA STONE, LTD, VIRGINIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SILICON VALLEY BANK;REEL/FRAME:054086/0105 Effective date: 20201014 |
|
AS | Assignment |
Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT, ILLINOIS Free format text: GRANT OF PATENT SECURITY INTEREST;ASSIGNORS:IXL LEARNING INC.;THINKMAP, INC.;WYZANT, INC.;AND OTHERS;REEL/FRAME:055581/0469 Effective date: 20210312 Owner name: ROSETTA STONE LTD., CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN PATENTS AT REEL/FRAME NO. 54085/0920;ASSIGNOR:ROYAL BANK OF CANADA, AS COLLATERAL AGENT;REEL/FRAME:055583/0555 Effective date: 20210312 Owner name: ROSETTA STONE LTD., CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN PATENTS AT REEL/FRAME NO. 54085/0934;ASSIGNOR:ROYAL BANK OF CANADA, AS COLLATERAL AGENT;REEL/FRAME:055583/0562 Effective date: 20210312 |
|
AS | Assignment |
Owner name: ROSETTA STONE LLC, VIRGINIA Free format text: CHANGE OF NAME;ASSIGNOR:ROSETTA STONE LTD.;REEL/FRAME:056256/0603 Effective date: 20210311 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: ROSETTA STONE LLC, CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN SPECIFIED PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:062904/0514 Effective date: 20230301 Owner name: WYZANT, INC., CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN SPECIFIED PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:062904/0514 Effective date: 20230301 Owner name: THINKMAP, INC., CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN SPECIFIED PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:062904/0514 Effective date: 20230301 Owner name: IXL LEARNING, INC., CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN SPECIFIED PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:062904/0514 Effective date: 20230301 Owner name: JPMORGAN CHASE BANK, N.A., ILLINOIS Free format text: SECURITY INTEREST;ASSIGNORS:IXL LEARNING, INC.;THINKMAP, INC.;WYZANT, INC.;AND OTHERS;REEL/FRAME:062846/0032 Effective date: 20230301 |