US20020087328A1 - Automatic dynamic speech recognition vocabulary based on external sources of information - Google Patents

Automatic dynamic speech recognition vocabulary based on external sources of information Download PDF

Info

Publication number
US20020087328A1
US20020087328A1 US09/749,615 US74961500A US2002087328A1 US 20020087328 A1 US20020087328 A1 US 20020087328A1 US 74961500 A US74961500 A US 74961500A US 2002087328 A1 US2002087328 A1 US 2002087328A1
Authority
US
United States
Prior art keywords
recited
grammar
message
information
method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/749,615
Other versions
US6937986B2 (en
Inventor
Lawrence Denenberg
Christopher Schmandt
Erin Panttaja
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amazon Technologies Inc
Original Assignee
Xura Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xura Inc filed Critical Xura Inc
Priority to US09/749,615 priority Critical patent/US6937986B2/en
Assigned to COMVERSE NETWORK SYSTEMS, INC. reassignment COMVERSE NETWORK SYSTEMS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SCHMANDT, CHRISTOPHER M., PANTTAJA, ERIN M., DENENBERG, LAWRENCE A.
Assigned to COMVERSE NETWORK SYSTEMS, INC. reassignment COMVERSE NETWORK SYSTEMS, INC. RE-RECORD TO CORRECT DOCUMENT DATES AND THE ADDRESS OF THE ASSIGNEE ON REEL 011617 FRAME 0199. ASSIGNORS HEREBY CONFIRM THE ASSIGNMENT OF THE ENTIRE INTEREST. Assignors: DENENBERG, LAWRENCE A., PANTTAJA, ERIN M., SCHMANDT, CHRISTOPHER M.
Publication of US20020087328A1 publication Critical patent/US20020087328A1/en
Assigned to COMVERSE, INC. reassignment COMVERSE, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: COMVERSE NETWORK SYSTEMS, INC.
Publication of US6937986B2 publication Critical patent/US6937986B2/en
Application granted granted Critical
Assigned to AMAZON TECHNOLOGIES, INC. reassignment AMAZON TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: COMVERSE, INC.
Assigned to AMAZON TECHNOLOGIES, INC. reassignment AMAZON TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: COMVERSE, INC.
Application status is Active legal-status Critical
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search
    • G10L15/18Speech classification or search using natural language modelling
    • G10L15/183Speech classification or search using natural language modelling using context dependencies, e.g. language models
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/487Arrangements for providing information services, e.g. recorded voice services, time announcements
    • H04M3/493Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4936Speech interaction details
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226Taking into account non-speech caracteristics
    • G10L2015/228Taking into account non-speech caracteristics of application context
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2201/00Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/40Electronic components, circuits, software, systems or apparatus used in telephone systems using speech recognition

Abstract

An interactive voice response system is able to respond to questions from users on general topics by including words related to those topics in the grammar of a speech recognition system. Words that are added for all users are obtained from current news reports obtained from news providers accessible via the Internet, or a similar source. In addition, information is stored in an information database about places or people that may be of interest to users, such as weather reports and forecasts for many cities. The grammar of the speech recognition system is modified for an individual user to enable the system to recognize questions relating to, e.g., the weather in one of the cities, only when the system detects that the user has accessed a file containing a word included in the information database. The file may be a message, calendar or address book.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0001]
  • The present invention is directed to updating speech recognition grammars and, more particularly, to automatically updating speech recognition grammars, so that users can receive responses to general questions, such as questions related to current events and locations. [0002]
  • 2. Description of the Related Art [0003]
  • Currently, speaker independent speech recognition systems use a limited vocabulary to increase recognition accuracy. Phrases that can be recognized are part of a “grammar.” The grammar specifies every possible combination of words which may be spoken by the user. Some of the many commercially available speech recognition systems include Speechworks from Speechworks International, Inc. of Boston, Mass.; Nuance from Nuance of Menlo Park, Calif. and Philips Speech Processing available from Royal Philips Electronics N.V. in Vienna, Austria. All of these systems and many others utilize grammars that can be modified for specific applications. By limiting the size of the grammar, speech recognition systems are now able to recognize spoken commands from many users without requiring training of the system to the way each user pronounces words. Such speaker independent systems can be contrasted with speech recognition systems used with word processing programs that have large vocabularies, must ideally adapt to each user's pronunciation, and have internal grammatical representations, such as statistical language models. [0004]
  • In some applications, the grammars are modified for individual users to recognize terms that the user has indicated might be spoken, such as names of stocks in the user's portfolio. The grammar may even be modified during interaction with the user to include only those words that can be spoken at the current position within a command interface. For example, a voice activated telephone might have an initial grammar limited to “call”, numbers, and names that have been recorded by the user for speed dialing, like “home”, “mom”, etc. After receiving a command to call a number input by speaking the digits of the number, the phone may request confirmation with words in the grammar limited to “yes”, “no” and “hang up”. An initial grammar is loaded when the application begins, for example, before a call is received by telephone. This grammar defines the basic functionality of the system. It may include subgrammars, which can be activated or deactivated depending on the state of the application. For example, when the application asks a yes/no question, it may activate a subgrammar containing only the words yes and no. Similarly, when the application requests a phone number from the user, it may activate a grammar consisting of only seven or ten digit number strings. [0005]
  • Other portions of the grammar may be specific to a particular user of the system, and will be loaded once that user has been identified. This might include an address book of phone numbers, or stock symbols in a personal portfolio. An example of an address book grammar might be the phrase “Call John Jones,” which can be associated with a phone number for John Jones from a specific user's address book. The grammar would not include this phrase for any user who did not have John Jones in his or her address book. [0006]
  • SUMMARY OF THE INVENTION
  • An object of the present invention is to provide a speaker independent speech recognition system that appears to a user to be more intelligent than conventional speaker independent speech recognition systems. [0007]
  • Another object of the present invention is to provide a speaker independent speech recognition system having an automatically updated grammar. [0008]
  • A further object of the present invention is to automatically update the grammar of a speaker independent speech recognition system using information external to the speaker independent speech recognition system and applications using the speaker independent speech recognition system. [0009]
  • The above objects are attained by providing a method of providing an interactive voice response system which recognizes a spoken question using a grammar that is automatically updated. The words in the grammar may be obtained from a message that a user has accessed or from news reports obtained from at least one news report provider, or from some other source. In any case, the words may be selected using any known technique. For example, in a news report all proper nouns, keywords identified by an editor, or all nouns in a headline might be selected for adding to the grammar. [0010]
  • One embodiment of the present invention preferably stores at least part of the news reports or links thereto and outputs at least one of the news reports or a portion thereof in response to recognizing that the user has spoken a keyword associated with the news report. If more than one news report has the same keyword, any conventional method may be used to navigate among the news stories, including beginning with the most recent news report while accepting commands for “next”, “menu”, etc. or providing a list of headlines for selection by the user. The news reports may be stored in any conventional format, including audio files or text files that are converted to audio prior to output. [0011]
  • In addition to news reports, an interactive voice response system according to the present invention may supply information related to words found in message(s) accessed by a user during a session. For example, weather information may be provided for place names identified in an e-mail message, the presumed location of a sender of an e-mail message obtained from the user's address book, a location that the user is believed to be near based on, e.g., automatic number identification, or locations obtained from calendar information or other data stored by the user on a system accessible by the interactive voice response system. Examples of other such location specific information could include traffic reports, or plane or train schedules. [0012]
  • There are many other questions which could be included in the grammar based on specific words found in information, such as messages, accessed by a user during a session with an interactive voice response system. One example is that when the name of a company is included in the text of a message, the grammar may be updated so that the user could ask for the current stock price of the company. [0013]
  • Thus, in contrast to the conventional systems described above, the present invention provides a way to modify or create grammars based on external sources of information, other than the user's identity, or the current dialogue state. These sources may be information from outside the application, such as news reports, or derived from information which the application accesses for the user, such as personal messages. [0014]
  • The objects listed above, together with other objects and advantages which will be subsequently apparent, reside in the details of construction and operation as more fully hereinafter described and claimed, reference being had to the accompanying drawings forming a part hereof, wherein like reference numerals refer to like parts throughout. [0015]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of an information services system that can be used to implement the present invention. [0016]
  • FIG. 2 is a functional block diagram of a system according to the present invention. [0017]
  • FIGS. 3, 4 and [0018] 6 are flowcharts of a method according to the present invention.
  • FIG. 5 is a data structure diagram for databases in an exemplary embodiment.[0019]
  • DETAILED DESCRIPTION OF THE INVENTION
  • The present invention may be used to augment many types of conventional speech recognition applications, or to provide a separate service to users who want to be able to ask general questions. An exemplary embodiment will be described in which the present invention operates on an information services system like that illustrated in FIG. 1 and described in U.S. Pat. Nos. 5,029,199; 5,263,080; 5,193,110; 5,659,599; 5,524,139; and 5,402,472, all assigned to Comverse Network Systems, Inc. of Wakefield, Mass. and incorporated herein by reference. However, a system could implement the present invention without access to messages for a user, or without access to news reports, depending upon what information is to be provided to users. [0020]
  • The system illustrated in FIG. 1 includes both primary [0021] 30 and standby 32 master control units (MCUs) that control switching by a digital switching system (DSS) 34. The MCU 30 coordinates the routing of calls from a central office 36, through the DSS 34 to application processing units (APUs) 38. Each APU 38 is a computer with a processor (CPU) 40 and program and data storage (HD) 42, as well as a T1 termination which may include up to 24 voice ports or telephone interface units 44. When a subscriber of the service provided by information services system 46 accesses system 46 from calling station 48, DSS 34 under control of MCU 30 routes the call to an APU 38 programed to perform subscriber call processing. The subscriber is able to access messages stored on hard drive 42 in any of the APUs 38, leave messages for other users and obtain access to other services that are conventionally provided by information services systems.
  • A functional block diagram illustrated in FIG. 2 shows major processes of the present invention that may be executed on the MCUs [0022] 30, 32 or APUs 38, and interaction with databases accessible by these processes. The databases may be stored in the MCUs 30, 32 or on HD 42 in one or more of the APUs 38, or could be stored on another system accessed via a data communication network, such as the Internet 60. An overview of an exemplary embodiment of the present invention will be provided with reference to FIGS. 1-3.
  • As illustrated in FIG. 3, when a user, represented by phone [0023] 62 in FIG. 2, calls 64 or otherwise is able to interact with system 46 (FIG. 1), a user process 66 begins execution on, e.g., APU 38. The user process 66 loads 68 global grammar database 70 which defines questions that any user can ask. In addition, information is obtained from user specific database 74 during interaction between the user and user process 66. If the user asks questions about something that the system identifies as a word in the news, user process 66 accesses news and information database 76 to obtain information requested by the user. The information in user specific database 74 is accessed to load 77 keywords that are used to augment the grammar utilized by the speaker independent speech recognition software that has already been loaded with data from the global grammar database 70. These keywords may include synonyms from synonym database 78, e.g., for words in messages received by the user.
  • The information, such as messages, calendar data and address book data, in user specific database [0024] 74 may be maintained by user process 66 using any conventional method. Similarly, the information in global grammar database 70, global information database 72 and news and information database 76 is maintained by main system control process 79 using conventional techniques. The information stored in news and information database 76 is obtained by news process 80 which interacts with main system control process 79 as described below.
  • In the preferred embodiment, users are able to ask questions about topics in which the interactive voice response system assumes the user may have an interest. There are many possible ways that the topics could be identified. For example, the information stored in news and information database [0025] 76 could be obtained from a predefined number of sources specified by the system operator, optionally with additional sources provided by each user for supplemental information unique to each user. Alternatively, the information stored in news and information database 76 could be obtained from news reports or other databases accessible via a data communication network, such as Internet 60, or files stored locally. The news and information database 76 and global information database 72 may be kept at a manageable size if the user or system operator specifies the number of web pages that can be obtained from any information source accessed by news process 80.
  • A flowchart illustrating a simplified example of news process [0026] 80 is illustrated in FIG. 4. As discussed above, the news stories or other web pages accessed by news process 80 may be identified by keywords or source of information. As each news report is accessed, if keywords were not provided initially or available from the news report provider, the keywords are extracted 84 from information associated with the report or the report itself. Extraction of keywords is done by analysis of headlines, direct delivery of keywords by the content provider, or analysis of the story contents. For example, if the report is contained in an audio file, there may be a synopsis of the report, a title or headline for the report, or other text associated therewith. If keywords were provided 82 when searching for the report, or by the news provider, it is determined 86 whether the report is a text file. If the report is a text file, the text is prepared 88 for speech synthesis in a conventional manner by removing extraneous characters, such as HTML links, etc., and possibly modifying spelling, etc., to result in easier to understand speech. Regardless of whether the report is a text file, a record is created 90 in news and information database 76 with an identifier for the report, contents of the report and the keywords.
  • A record is also created [0027] 92 in global grammar database 70 with a list of the keywords found in all of the stories. As an example, main system control 78 may put the keywords into a variable called $timely_news which is stored in global grammar database 70 along with phrases of the form $news=(tell me about [the])|(what is happening in)) $timely_news. These phrases are created when the application is developed and are specified by the programmer who defines the speech recognition grammar. Such phrases permit users to ask questions like “Tell me about the $timely_news” and “What is the weather in $user_weather_cities” where $timely_news and $user_weather cities represent symbolic non-terminal symbols in the grammar specification language commonly used by conventional speech recognition software.
  • The details of how this is done depend on the specifics of the speech recognition software. Some speech recognition software might require a whole new grammar to be loaded, while others might allow a selected region of the grammar, such as the sentences about weather, to be “activated” and “deactivated” under program control. [0028]
  • Examples of the database structure for the news and information database [0029] 76 and the global grammar database 70 which are accessed by news process 80, as well as the global information database 72 and user specific database, are provided in FIG. 5. The news and information database 76 includes an identifier (possibly a filename or a URL from Internet 60), the contents of a text report or a link to an audio file or other location where the content of the file can be obtained, and a keyword list. In addition to defining the syntax of questions that can be asked, the global grammar database 70 preferably includes the keywords for all news reports in an array “$timely_news.” This permits any user to ask a question related to a news report after global grammar database 70 is loaded into the speech recognition system as described above. As each news report is obtained by news process 80, keywords may be appended to the “$timely_news” array. Similarly, if information is obtained about a new city, relating to weather, airlines, trains, etc., the city name is appended to the corresponding string array in global information database 72.
  • In one embodiment of the present invention, only current news is provided to users. Therefore, some type of date field is preferably included in the news and information database [0030] 76. In the database structure, illustrated in FIG. 5, a “when obtained” field is included. This field may be used by main system control process 79 to perform a daily clean up of all records in the news and information database 76 that are more than one or two weeks old. The news process may check for new stories every hour, every four hours, or some other period. The content or identifier is compared with the news report to determine whether a news report is already stored in the news and information database 76 and the “when obtained” field is updated each time the same news report is found, or the record is overwritten, in case the content has changed slightly.
  • As discussed above, each time a user interacts with an interactive voice response system according to the present invention, a user specific grammar is generated that includes the contents of global grammar database [0031] 70. The global information database 72 contains string arrays, such as $weather_cities, identifying information in news and information database 76 that can be used to respond to the questions asked by a user. As the user interacts with the system, the grammar is modified to include words associated with files that the user accesses. For example, if the user accesses a message, all words in the message that are found in global information database 72 are preferably added to the grammar by performing the method illustrated in FIG. 6.
  • As illustrated in FIG. 6, the contents of messages are parsed [0032] 100 to find relevant portion(s). For example, the headers and any non-text portions may be removed. Each word in the relevant portion(s) is compared 102 with the contents of global information database 72 to determine what information can be provided about that word. If the word is found, the record containing the word is obtained 104 from global information database 72, so that a record can be created 106 in user specific database 74. The grammar is updated, so that during a session that the user accesses the message, questions can be asked by the user about information available for these words, such as weather forecasts.
  • In the case of an e-mail message that is either displayed to the user or processed by text-to-speech software and delivered as audio, the entire message can be parsed [0033] 100. For example, an e-mail message may contain information about a conference in Boston. The keyword “Boston” is stored 106 in user specific database 74 in the record for the current message. A similar record would be created if the user accesses a calendar entry containing “Meeting in Boston” or an address book entry for someone in Boston, or a message from someone whose address book entry indicates that they are from Boston. As in the case of a message, the words in the calendar or address book entry are compared 102 with the contents of the global information database 72 and a record is created 106 with the appropriate type and contents. Questions pertaining to Boston which can be answered by information found in global information database 72 are added to the current grammar while the message is being presented.
  • The process illustrated in FIG. 6 could also be applied to voicemail or facsimile messages. The relevant portions of voicemail and facsimile messages could be the person who left the voicemail message or sent the facsimile. For example, a facsimile header or ANI information may be used to look for the name or number of a caller or facsimile machine in an address book maintained for the user. If an entry is found in global information database [0034] 72, the user will able to ask questions about the city where the sender of the message lives, such as “What is the weather in San Diego?”
  • The many features and advantages of the present invention are apparent from the detailed specification, and thus it is intended by the appended claims to cover all such features and advantages of the system that fall within the true spirit and scope of the invention. Further, numerous modifications and changes will readily occur to those skilled in the art from the disclosure of this invention, thus it is not desired to limit the invention to the exact construction and operation illustrated and described. Accordingly, modifications and equivalents may be resorted to as falling within the scope and spirit of the invention. [0035]

Claims (48)

What is claimed is:
1. A method of providing an interactive voice response system, comprising:
recognizing a spoken question using a grammar that is automatically updated from sources of information external to the interactive voice response system.
2. A method as recited in claim 1, further comprising automatically obtaining at least one set of topics for questions spoken by a user from the sources of information.
3. A method as recited in claim 2, wherein said obtaining uses at least one communication connection between the interactive voice response system and at least one news report provider to obtain news reports.
4. A method as recited in claim 3, wherein said obtaining includes repeatedly accessing the at least one news report provider via a computer network.
5. A method as recited in claim 4, further comprising:
extracting keywords from the news reports; and
updating the grammar using the keywords.
6. A method as recited in claim 5, further comprising:
storing at least part of the news reports; and
outputting at least one of the news reports when the spoken question contains at least one of the keywords extracted therefrom.
7. A method as recited in claim 6, further comprising identifying the keywords from information included in the news reports.
8. A method as recited in claim 6, further comprising comparing words in the news reports with a list of potential keywords to identify the keywords for said extracting.
9. A method as recited in claim 6,
wherein said storing stores at least one file containing an audio signal related to at least one of the news reports; and
wherein said outputting plays back the at least one audio file.
10. A method as recited in claim 6, wherein said extracting is performed on text data associated with the audio signal.
11. A method as recited in claim 6,
wherein said storing stores at least one text file related to at least one of the news reports; and
wherein said outputting includes text-to-speech conversion of the at least one text file.
12. A method as recited in claim 3, further comprising determining the at least one news report provider based on selection by the user.
13. A method as recited in claim 12, wherein said determining is performed by
outputting an audio signal containing a list of available news report providers; and
receiving selection of the at least one news report providers by the user.
14. A method as recited in claim 12, wherein said determining is performed via a computer network connection between the interactive voice response system and a computer operated by the user.
15. A method as recited in claim 1, further comprising automatically obtaining grammar words to be added to the grammar from at least one message for a user.
16. A method as recited in claim 15, further comprising:
comparing message words in the at least one message with information in a global information database to determine for each message word whether there are any corresponding questions that can be answered by information in the global information database; and
updating the grammar with the corresponding questions and related message words.
17. A method as recited in claim 15, further comprising:
comparing message words in the at least one message with information in a synonym database to determine synonyms for the message words; and
adding the synonyms to the grammar.
18. A method as recited in claim 15, further comprising automatically adding words to the grammar based on a source of the message.
19. A method as recited in claim 18, wherein the message is a voicemail message and the source of the message is determined based on automatic number identification provided when the voicemail message was received.
20. A method as recited in claim 18,
wherein the message is an e-mail message, and
wherein said method further comprises adding information to the grammar from an address book entry for the sender of the e-mail.
21. A method as recited in claim 1, further comprising automatically updating the grammar based on calendar information stored for a user asking the spoken question.
22. A method as recited in claim 21, wherein said updating includes adding to the grammar to enable said recognizing for questions about locations found in the calendar information.
23. A computer readable medium storing at least one program for controlling an interactive voice response system to perform a method comprising:
recognizing a spoken question using a grammar that is automatically updated from sources of information external to the interactive voice response system.
24. A computer readable medium as recited in claim 23, wherein said method further comprises automatically obtaining at least one set of topics for questions spoken by a user from the sources of information.
25. A computer readable medium as recited in claim 24, wherein said obtaining uses at least one communication connection between the interactive voice response system and at least one news report provider to obtain news reports.
26. A computer readable medium as recited in claim 25, wherein said obtaining includes repeatedly accessing the at least one news report provider via a computer network.
27. A computer readable medium as recited in claim 26, wherein said method further comprises:
extracting keywords from the news reports; and
updating the grammar using the keywords.
28. A computer readable medium as recited in claim 27, wherein said method further comprises:
storing at least part of the news reports; and
outputting at least one of the news reports when the spoken question contains at least one of the keywords extracted therefrom.
29. A computer readable medium as recited in claim 25, wherein said method further comprises determining the at least one news report provider based on selection by the user.
30. A computer readable medium as recited in claim 29, wherein said determining is performed by
outputting an audio signal containing a list of available news report providers; and
receiving selection of the at least one news report providers by the user.
31. A computer readable medium as recited in claim 23, wherein said method further comprises automatically obtaining grammar words to be added to the grammar from at least one message for a user.
32. A computer readable medium as recited in claim 31, wherein said method further comprises:
comparing message words in the at least one message with information in a global information database to determine for each message word whether there are any corresponding questions that can be answered by information in the global information database; and
updating the grammar with the corresponding questions and related message words.
33. A computer readable medium as recited in claim 31, wherein said method further comprises:
comparing message words in the at least one message with information in a synonym database to determine synonyms for the message words; and
adding the synonyms to the grammar.
34. A computer readable medium as recited in claim 31, wherein said method further comprises automatically adding words to the grammar based on a source of the message.
35. A computer readable medium as recited in claim 34, wherein the message is a voicemail message and the source of the message is determined based on automatic number identification provided when the voicemail message was received.
36. A computer readable medium as recited in claim 34,
wherein the message is an e-mail message, and
wherein said method further comprises adding information to the grammar from an address book entry for the sender of the e-mail.
37. A computer readable medium as recited in claim 31, further comprising automatically updating the grammar based on calendar information stored for a user asking the spoken question.
38. A computer readable medium as recited in claim 37, wherein said updating includes adding to the grammar to enable said recognizing of questions about locations found in the calendar information.
39. An interactive voice response system, comprising:
recognition means for recognizing a spoken question using a grammar; and
update means for automatically updating the grammar from sources of information external to said interactive voice response system.
40. An interactive voice response system as recited in claim 39, further comprising means for communicating between the interactive voice response system and at least one news report provider to obtain news reports.
41. An interactive voice response system as recited in claim 40,
further comprising extraction means for extracting keywords from the news reports; and
wherein said update means automatically updates the grammar using the keywords.
42. An interactive voice response system as recited in claim 41, further comprising:
means for storing at least part of the news reports; and
means for outputting at least one of the news reports when the spoken question contains at least one of the keywords extracted therefrom.
43. An interactive voice response system as recited in claim 39, wherein said update means includes means for automatically obtaining grammar words to be added to the grammar from at least one message for a user.
44. An interactive voice response system as recited in claim 43,
wherein said update means further includes
means for comparing message words in the at least one message with information in a global information database to determine for each message word whether there are any corresponding questions that can be answered by information in the global information database; and
means for automatically updating the grammar with the corresponding questions and related message words.
45. An interactive voice response system as recited in claim 39, wherein said update means automatically updates the grammar based on calendar information stored for a user asking the spoken question.
46. An interactive voice response system as recited in claim 45, wherein said update means adds to the grammar to enable said recognition means to recognize questions about locations found in the calendar information.
47. An information services system, comprising:
at least one storage unit to store a grammar and information for response to a question by a user;
at least one processor, coupled to said storage unit, programmed to automatically update the grammar and the information from sources of information external to the information services system, and to recognize a question spoken by the user.
48. An information services system as recited in claim 47, further comprising:
a master control unit to control operation of said information services system, and
a plurality of application processing units, coupled to said master control unit, each including
at least one processor unit providing said processor,
one of said at least one storage unit, coupled to said at least one processor unit, and
at least one telephone interface unit coupled to said at least one processor unit.
US09/749,615 2000-12-28 2000-12-28 Automatic dynamic speech recognition vocabulary based on external sources of information Active 2023-01-07 US6937986B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US09/749,615 US6937986B2 (en) 2000-12-28 2000-12-28 Automatic dynamic speech recognition vocabulary based on external sources of information

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/749,615 US6937986B2 (en) 2000-12-28 2000-12-28 Automatic dynamic speech recognition vocabulary based on external sources of information
IL146985A IL146985A (en) 2000-12-28 2001-12-07 Automatic dynamic speech recognition vocabulary based on external sources of information

Publications (2)

Publication Number Publication Date
US20020087328A1 true US20020087328A1 (en) 2002-07-04
US6937986B2 US6937986B2 (en) 2005-08-30

Family

ID=25014481

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/749,615 Active 2023-01-07 US6937986B2 (en) 2000-12-28 2000-12-28 Automatic dynamic speech recognition vocabulary based on external sources of information

Country Status (2)

Country Link
US (1) US6937986B2 (en)
IL (1) IL146985A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050132262A1 (en) * 2003-12-15 2005-06-16 Sbc Knowledge Ventures, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US20050169453A1 (en) * 2004-01-29 2005-08-04 Sbc Knowledge Ventures, L.P. Method, software and system for developing interactive call center agent personas
US20050195961A1 (en) * 2004-03-04 2005-09-08 Sbc Knowledge Ventures, L.P. System, method and software for delivering targeted content to queued users
US6985865B1 (en) * 2001-09-26 2006-01-10 Sprint Spectrum L.P. Method and system for enhanced response to voice commands in a voice command platform
US20060045241A1 (en) * 2004-08-26 2006-03-02 Sbc Knowledge Ventures, L.P. Method, system and software for implementing an automated call routing application in a speech enabled call center environment
US20060173683A1 (en) * 2005-02-03 2006-08-03 Voice Signal Technologies, Inc. Methods and apparatus for automatically extending the voice vocabulary of mobile communications devices
US20060184626A1 (en) * 2005-02-11 2006-08-17 International Business Machines Corporation Client / server application task allocation based upon client resources
US20070185702A1 (en) * 2006-02-09 2007-08-09 John Harney Language independent parsing in natural language systems
US20070188901A1 (en) * 2006-02-14 2007-08-16 Microsoft Corporation Personal audio-video recorder for live meetings
EP1820182A2 (en) * 2004-11-30 2007-08-22 Vocera Communications, Inc. A system and method for improving recognition accuracy in speech recognition applications
US8498865B1 (en) 2004-11-30 2013-07-30 Vocera Communications, Inc. Speech recognition system and method using group call statistics
US20130283169A1 (en) * 2012-04-24 2013-10-24 Social Communications Company Voice-based virtual area navigation
US8600757B2 (en) * 2005-01-07 2013-12-03 At&T Intellectual Property Ii, L.P. System and method of dynamically modifying a spoken dialog system to reduce hardware requirements
US8606584B1 (en) * 2001-10-24 2013-12-10 Harris Technology, Llc Web based communication of information with reconfigurable format
US20150177959A1 (en) * 2009-03-31 2015-06-25 Samsung Electronics Co., Ltd. Method for creating short message and portable terminal using the same
US9319357B2 (en) 2009-01-15 2016-04-19 Social Communications Company Context based virtual area creation
US9411489B2 (en) 2007-10-24 2016-08-09 Sococo, Inc. Interfacing with a spatial virtual communication environment
US9411490B2 (en) 2007-10-24 2016-08-09 Sococo, Inc. Shared virtual area communication environment based apparatus and methods
US9923925B2 (en) 2014-02-20 2018-03-20 Palantir Technologies Inc. Cyber security sharing and identification system

Families Citing this family (152)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US6836760B1 (en) * 2000-09-29 2004-12-28 Apple Computer, Inc. Use of semantic inference and context-free grammar with speech recognition system
US20040120472A1 (en) * 2001-04-19 2004-06-24 Popay Paul I Voice response system
US7437295B2 (en) * 2001-04-27 2008-10-14 Accenture Llp Natural language processing for a location-based services system
US6848542B2 (en) * 2001-04-27 2005-02-01 Accenture Llp Method for passive mining of usage information in a location-based services system
US7970648B2 (en) 2001-04-27 2011-06-28 Accenture Global Services Limited Advertising campaign and business listing management for a location-based services system
US6944447B2 (en) * 2001-04-27 2005-09-13 Accenture Llp Location-based services
US7698228B2 (en) * 2001-04-27 2010-04-13 Accenture Llp Tracking purchases in a location-based services system
JP2002334086A (en) * 2001-05-10 2002-11-22 Sony Corp Information processor, its method, recording medium, and program
ITFI20010199A1 (en) 2001-10-22 2003-04-22 Riccardo Vieri System and method for transforming text into voice communications and send them with an internet connection to any telephone set
US8180742B2 (en) 2004-07-01 2012-05-15 Emc Corporation Policy-based information management
US7707037B2 (en) * 2004-07-01 2010-04-27 Emc Corporation Archiving of surveillance data
US20060004579A1 (en) * 2004-07-01 2006-01-05 Claudatos Christopher H Flexible video surveillance
US9268780B2 (en) * 2004-07-01 2016-02-23 Emc Corporation Content-driven information lifecycle management
US8244542B2 (en) * 2004-07-01 2012-08-14 Emc Corporation Video surveillance
US7457396B2 (en) * 2003-09-05 2008-11-25 Emc Corporation Automated call management
US8229904B2 (en) * 2004-07-01 2012-07-24 Emc Corporation Storage pools for information management
US8180743B2 (en) * 2004-07-01 2012-05-15 Emc Corporation Information management
US8103873B2 (en) 2003-09-05 2012-01-24 Emc Corporation Method and system for processing auditory communications
US20060004818A1 (en) * 2004-07-01 2006-01-05 Claudatos Christopher H Efficient information management
US7499531B2 (en) 2003-09-05 2009-03-03 Emc Corporation Method and system for information lifecycle management
US8626514B2 (en) * 2004-08-31 2014-01-07 Emc Corporation Interface for management of multiple auditory communications
US7444287B2 (en) * 2004-07-01 2008-10-28 Emc Corporation Efficient monitoring system and method
US8209185B2 (en) * 2003-09-05 2012-06-26 Emc Corporation Interface for management of auditory communications
US7633076B2 (en) 2005-09-30 2009-12-15 Apple Inc. Automated response to and sensing of user activity in portable devices
US7110949B2 (en) * 2004-09-13 2006-09-19 At&T Knowledge Ventures, L.P. System and method for analysis and adjustment of speech-enabled systems
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
WO2007121441A2 (en) 2006-04-17 2007-10-25 Vovision Llc Methods and systems for correcting transcribed audio files
US20080208594A1 (en) * 2007-02-27 2008-08-28 Cross Charles W Effecting Functions On A Multimodal Telephony Device
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US9053089B2 (en) 2007-10-02 2015-06-09 Apple Inc. Part-of-speech tagging using latent analogy
JP2011503638A (en) * 2007-10-26 2011-01-27 本田技研工業株式会社 Improvement of free conversation instruction classification for the car navigation system
US8620662B2 (en) 2007-11-20 2013-12-31 Apple Inc. Context-aware unit selection
WO2009073768A1 (en) 2007-12-04 2009-06-11 Vovision, Llc Correcting transcribed audio files with an email-client interface
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8065143B2 (en) 2008-02-22 2011-11-22 Apple Inc. Providing text input using speech data and non-speech data
US8255224B2 (en) * 2008-03-07 2012-08-28 Google Inc. Voice recognition grammar selection based on context
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US8464150B2 (en) 2008-06-07 2013-06-11 Apple Inc. Automatic language identification for dynamic text processing
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8768702B2 (en) 2008-09-05 2014-07-01 Apple Inc. Multi-tiered voice feedback in an electronic device
US8898568B2 (en) 2008-09-09 2014-11-25 Apple Inc. Audio user interface
US8583418B2 (en) 2008-09-29 2013-11-12 Apple Inc. Systems and methods of detecting language and natural language strings for text to speech synthesis
US8712776B2 (en) 2008-09-29 2014-04-29 Apple Inc. Systems and methods for selective text to speech synthesis
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US8117036B2 (en) * 2008-12-03 2012-02-14 At&T Intellectual Property I, L.P. Non-disruptive side conversation information retrieval
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
US8862252B2 (en) 2009-01-30 2014-10-14 Apple Inc. Audio user interface for displayless electronic device
US8380507B2 (en) 2009-03-09 2013-02-19 Apple Inc. Systems and methods for determining the language to use for speech generated by a text to speech engine
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US8682649B2 (en) 2009-11-12 2014-03-25 Apple Inc. Sentiment prediction from textual data
US8973071B2 (en) * 2009-12-22 2015-03-03 Verizon Patent And Licensing Inc. Remote access to a media device
US8600743B2 (en) 2010-01-06 2013-12-03 Apple Inc. Noise profile determination for voice-related feature
US8381107B2 (en) 2010-01-13 2013-02-19 Apple Inc. Adaptive audio feedback system and method
US8311838B2 (en) 2010-01-13 2012-11-13 Apple Inc. Devices and methods for identifying a prompt corresponding to a voice input in a sequence of prompts
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8977584B2 (en) 2010-01-25 2015-03-10 Newvaluexchange Global Ai Llp Apparatuses, methods and systems for a digital conversation management platform
US20110184736A1 (en) * 2010-01-26 2011-07-28 Benjamin Slotznick Automated method of recognizing inputted information items and selecting information items
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US8713021B2 (en) 2010-07-07 2014-04-29 Apple Inc. Unsupervised document clustering using latent semantic density analysis
US8719006B2 (en) 2010-08-27 2014-05-06 Apple Inc. Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesis
US8719014B2 (en) 2010-09-27 2014-05-06 Apple Inc. Electronic device with text error correction based on voice recognition data
US8781836B2 (en) 2011-02-22 2014-07-15 Apple Inc. Hearing assistance system for providing consistent human speech
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US20120278078A1 (en) * 2011-04-26 2012-11-01 Avaya Inc. Input and displayed information definition based on automatic speech recognition during a communication session
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US20120309363A1 (en) 2011-06-03 2012-12-06 Apple Inc. Triggering notifications associated with tasks items that represent tasks to perform
US8812294B2 (en) 2011-06-21 2014-08-19 Apple Inc. Translating phrases from one language into another using an order-based set of declarative rules
US8706472B2 (en) 2011-08-11 2014-04-22 Apple Inc. Method for disambiguating multiple readings in language conversion
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US8762156B2 (en) 2011-09-28 2014-06-24 Apple Inc. Speech recognition repair using contextual information
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US8775442B2 (en) 2012-05-15 2014-07-08 Apple Inc. Semantic search using a single-source semantic model
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
WO2013185109A2 (en) 2012-06-08 2013-12-12 Apple Inc. Systems and methods for recognizing textual identifiers within a plurality of words
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US8935167B2 (en) 2012-09-25 2015-01-13 Apple Inc. Exemplar-based latent perceptual modeling for automatic speech recognition
US20140136210A1 (en) * 2012-11-14 2014-05-15 At&T Intellectual Property I, L.P. System and method for robust personalization of speech recognition
KR20160127165A (en) 2013-02-07 2016-11-02 애플 인크. Voice trigger for a digital assistant
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
US9977779B2 (en) 2013-03-14 2018-05-22 Apple Inc. Automatic supplementation of word correction dictionaries
US9733821B2 (en) 2013-03-14 2017-08-15 Apple Inc. Voice control to diagnose inadvertent activation of accessibility features
KR101904293B1 (en) 2013-03-15 2018-10-05 애플 인크. Context-sensitive handling of interruptions
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
KR101759009B1 (en) 2013-03-15 2017-07-17 애플 인크. Training an at least partial voice command system
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
KR101772152B1 (en) 2013-06-09 2017-08-28 애플 인크. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
AU2014278595B2 (en) 2013-06-13 2017-04-06 Apple Inc. System and method for emergency calls initiated by voice command
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
EP3480811A1 (en) 2014-05-30 2019-05-08 Apple Inc. Multi-command single utterance input method
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
JP6022138B2 (en) * 2014-09-16 2016-11-09 三菱電機株式会社 Information provision system
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK201670578A1 (en) 2016-06-09 2018-02-26 Apple Inc Intelligent automated assistant in a home environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839853A (en) * 1988-09-15 1989-06-13 Bell Communications Research, Inc. Computer information retrieval using latent semantic structure
US5301109A (en) * 1990-06-11 1994-04-05 Bell Communications Research, Inc. Computerized cross-language document retrieval using latent semantic indexing
US5524139A (en) * 1994-07-15 1996-06-04 Boston Technology, Inc. System for automatic access to automated telephonic information services
US5724571A (en) * 1995-07-07 1998-03-03 Sun Microsystems, Inc. Method and apparatus for generating query responses in a computer-based document retrieval system
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
US5945989A (en) * 1997-03-25 1999-08-31 Premiere Communications, Inc. Method and apparatus for adding and altering content on websites
US5995918A (en) * 1997-09-17 1999-11-30 Unisys Corporation System and method for creating a language grammar using a spreadsheet or table interface
US5995943A (en) * 1996-04-01 1999-11-30 Sabre Inc. Information aggregation and synthesization system
US6026388A (en) * 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US6076088A (en) * 1996-02-09 2000-06-13 Paik; Woojin Information extraction system and method using concept relation concept (CRC) triples
US6078886A (en) * 1997-04-14 2000-06-20 At&T Corporation System and method for providing remote automatic speech recognition services via a packet network
US6088692A (en) * 1994-12-06 2000-07-11 University Of Central Florida Natural language method and system for searching for and ranking relevant documents from a computer database
US20010054085A1 (en) * 2000-02-04 2001-12-20 Alexander Kurganov Personal voice-based information retrieval system
US20020006126A1 (en) * 1998-07-24 2002-01-17 Gregory Johnson Methods and systems for accessing information from an information source
US6418440B1 (en) * 1999-06-15 2002-07-09 Lucent Technologies, Inc. System and method for performing automated dynamic dialogue generation
US6434524B1 (en) * 1998-09-09 2002-08-13 One Voice Technologies, Inc. Object interactive user interface using speech recognition and natural language processing
US6584464B1 (en) * 1999-03-19 2003-06-24 Ask Jeeves, Inc. Grammar template query system
US6601026B2 (en) * 1999-09-17 2003-07-29 Discern Communications, Inc. Information retrieval by natural language querying
US6748426B1 (en) * 2000-06-15 2004-06-08 Murex Securities, Ltd. System and method for linking information in a global computer network

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6058435A (en) * 1997-02-04 2000-05-02 Siemens Information And Communications Networks, Inc. Apparatus and methods for responding to multimedia communications based on content analysis
US5897616A (en) * 1997-06-11 1999-04-27 International Business Machines Corporation Apparatus and methods for speaker verification/identification/classification employing non-acoustic and/or acoustic models and databases
US6405170B1 (en) * 1998-09-22 2002-06-11 Speechworks International, Inc. Method and system of reviewing the behavior of an interactive speech recognition application
US6741967B1 (en) * 1998-11-02 2004-05-25 Vividence Corporation Full service research bureau and test center method and apparatus
US6665644B1 (en) * 1999-08-10 2003-12-16 International Business Machines Corporation Conversational data mining
US6798867B1 (en) * 1999-09-13 2004-09-28 Microstrategy, Incorporated System and method for the creation and automatic deployment of personalized, dynamic and interactive voice services, with real-time database queries
US6560590B1 (en) * 2000-02-14 2003-05-06 Kana Software, Inc. Method and apparatus for multiple tiered matching of natural language queries to positions in a text corpus
US6757544B2 (en) * 2001-08-15 2004-06-29 Motorola, Inc. System and method for determining a location relevant to a communication device and/or its associated user

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839853A (en) * 1988-09-15 1989-06-13 Bell Communications Research, Inc. Computer information retrieval using latent semantic structure
US5301109A (en) * 1990-06-11 1994-04-05 Bell Communications Research, Inc. Computerized cross-language document retrieval using latent semantic indexing
US5524139A (en) * 1994-07-15 1996-06-04 Boston Technology, Inc. System for automatic access to automated telephonic information services
US6088692A (en) * 1994-12-06 2000-07-11 University Of Central Florida Natural language method and system for searching for and ranking relevant documents from a computer database
US5724571A (en) * 1995-07-07 1998-03-03 Sun Microsystems, Inc. Method and apparatus for generating query responses in a computer-based document retrieval system
US6026388A (en) * 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US6076088A (en) * 1996-02-09 2000-06-13 Paik; Woojin Information extraction system and method using concept relation concept (CRC) triples
US5995943A (en) * 1996-04-01 1999-11-30 Sabre Inc. Information aggregation and synthesization system
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
US5945989A (en) * 1997-03-25 1999-08-31 Premiere Communications, Inc. Method and apparatus for adding and altering content on websites
US6078886A (en) * 1997-04-14 2000-06-20 At&T Corporation System and method for providing remote automatic speech recognition services via a packet network
US5995918A (en) * 1997-09-17 1999-11-30 Unisys Corporation System and method for creating a language grammar using a spreadsheet or table interface
US20020006126A1 (en) * 1998-07-24 2002-01-17 Gregory Johnson Methods and systems for accessing information from an information source
US6434524B1 (en) * 1998-09-09 2002-08-13 One Voice Technologies, Inc. Object interactive user interface using speech recognition and natural language processing
US6584464B1 (en) * 1999-03-19 2003-06-24 Ask Jeeves, Inc. Grammar template query system
US6418440B1 (en) * 1999-06-15 2002-07-09 Lucent Technologies, Inc. System and method for performing automated dynamic dialogue generation
US6601026B2 (en) * 1999-09-17 2003-07-29 Discern Communications, Inc. Information retrieval by natural language querying
US20010054085A1 (en) * 2000-02-04 2001-12-20 Alexander Kurganov Personal voice-based information retrieval system
US6748426B1 (en) * 2000-06-15 2004-06-08 Murex Securities, Ltd. System and method for linking information in a global computer network

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6985865B1 (en) * 2001-09-26 2006-01-10 Sprint Spectrum L.P. Method and system for enhanced response to voice commands in a voice command platform
US8606584B1 (en) * 2001-10-24 2013-12-10 Harris Technology, Llc Web based communication of information with reconfigurable format
US7415101B2 (en) 2003-12-15 2008-08-19 At&T Knowledge Ventures, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US8498384B2 (en) 2003-12-15 2013-07-30 At&T Intellectual Property I, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US8280013B2 (en) 2003-12-15 2012-10-02 At&T Intellectual Property I, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US20050132262A1 (en) * 2003-12-15 2005-06-16 Sbc Knowledge Ventures, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US20080267365A1 (en) * 2003-12-15 2008-10-30 At&T Intellectual Property I, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US8737576B2 (en) 2003-12-15 2014-05-27 At&T Intellectual Property I, L.P. System, method and software for a speech-enabled call routing application using an action-object matrix
US20050169453A1 (en) * 2004-01-29 2005-08-04 Sbc Knowledge Ventures, L.P. Method, software and system for developing interactive call center agent personas
US7512545B2 (en) 2004-01-29 2009-03-31 At&T Intellectual Property I, L.P. Method, software and system for developing interactive call center agent personas
US20050195961A1 (en) * 2004-03-04 2005-09-08 Sbc Knowledge Ventures, L.P. System, method and software for delivering targeted content to queued users
US8976942B2 (en) 2004-08-26 2015-03-10 At&T Intellectual Property I, L.P. Method, system and software for implementing an automated call routing application in a speech enabled call center environment
US7623632B2 (en) 2004-08-26 2009-11-24 At&T Intellectual Property I, L.P. Method, system and software for implementing an automated call routing application in a speech enabled call center environment
US20060045241A1 (en) * 2004-08-26 2006-03-02 Sbc Knowledge Ventures, L.P. Method, system and software for implementing an automated call routing application in a speech enabled call center environment
US8498865B1 (en) 2004-11-30 2013-07-30 Vocera Communications, Inc. Speech recognition system and method using group call statistics
EP1820182A2 (en) * 2004-11-30 2007-08-22 Vocera Communications, Inc. A system and method for improving recognition accuracy in speech recognition applications
EP1820182A4 (en) * 2004-11-30 2009-12-09 Vocera Communications Inc A system and method for improving recognition accuracy in speech recognition applications
US8977548B2 (en) 2004-11-30 2015-03-10 Vocera Communications, Inc. Speech recognition system and method using group call statistics
US8600757B2 (en) * 2005-01-07 2013-12-03 At&T Intellectual Property Ii, L.P. System and method of dynamically modifying a spoken dialog system to reduce hardware requirements
WO2006084144A3 (en) * 2005-02-03 2006-11-30 Elias P Behrakis Methods and apparatus for automatically extending the voice-recognizer vocabulary of mobile communications devices
US20060173683A1 (en) * 2005-02-03 2006-08-03 Voice Signal Technologies, Inc. Methods and apparatus for automatically extending the voice vocabulary of mobile communications devices
US8160884B2 (en) 2005-02-03 2012-04-17 Voice Signal Technologies, Inc. Methods and apparatus for automatically extending the voice vocabulary of mobile communications devices
US7548977B2 (en) * 2005-02-11 2009-06-16 International Business Machines Corporation Client / server application task allocation based upon client resources
US20060184626A1 (en) * 2005-02-11 2006-08-17 International Business Machines Corporation Client / server application task allocation based upon client resources
US8229733B2 (en) * 2006-02-09 2012-07-24 John Harney Method and apparatus for linguistic independent parsing in a natural language systems
US20070185702A1 (en) * 2006-02-09 2007-08-09 John Harney Language independent parsing in natural language systems
US20070188901A1 (en) * 2006-02-14 2007-08-16 Microsoft Corporation Personal audio-video recorder for live meetings
US8209181B2 (en) * 2006-02-14 2012-06-26 Microsoft Corporation Personal audio-video recorder for live meetings
US9483157B2 (en) 2007-10-24 2016-11-01 Sococo, Inc. Interfacing with a spatial virtual communication environment
US9411489B2 (en) 2007-10-24 2016-08-09 Sococo, Inc. Interfacing with a spatial virtual communication environment
US9411490B2 (en) 2007-10-24 2016-08-09 Sococo, Inc. Shared virtual area communication environment based apparatus and methods
US9319357B2 (en) 2009-01-15 2016-04-19 Social Communications Company Context based virtual area creation
US20150177959A1 (en) * 2009-03-31 2015-06-25 Samsung Electronics Co., Ltd. Method for creating short message and portable terminal using the same
US20130283169A1 (en) * 2012-04-24 2013-10-24 Social Communications Company Voice-based virtual area navigation
US20130283166A1 (en) * 2012-04-24 2013-10-24 Social Communications Company Voice-based virtual area navigation
US9923925B2 (en) 2014-02-20 2018-03-20 Palantir Technologies Inc. Cyber security sharing and identification system

Also Published As

Publication number Publication date
IL146985A (en) 2006-12-10
US6937986B2 (en) 2005-08-30
IL146985D0 (en) 2002-08-14

Similar Documents

Publication Publication Date Title
CN101297355B (en) Systems and methods for responding to natural language speech utterance
US7398209B2 (en) Systems and methods for responding to natural language speech utterance
US6915262B2 (en) Methods and apparatus for performing speech recognition and using speech recognition results
US5819220A (en) Web triggered word set boosting for speech interfaces to the world wide web
US6282511B1 (en) Voiced interface with hyperlinked information
US8005680B2 (en) Method for personalization of a service
US6314165B1 (en) Automated hotel attendant using speech recognition
US6937983B2 (en) Method and system for semantic speech recognition
US6192338B1 (en) Natural language knowledge servers as network resources
US7606714B2 (en) Natural language classification within an automated response system
Cole et al. New telephone speech corpora at CSLU
US6604075B1 (en) Web-based voice dialog interface
US7251604B1 (en) Systems and method for archiving and retrieving navigation points in a voice command platform
Chu-Carroll MIMIC: An adaptive mixed initiative spoken dialogue system for information queries
CN101621547B (en) Method and device for receiving input or address stem from the user
US7184539B2 (en) Automated call center transcription services
US7644000B1 (en) Adding audio effects to spoken utterance
US6823306B2 (en) Methods and apparatus for generating, updating and distributing speech recognition models
US6243684B1 (en) Directory assistance system and method utilizing a speech recognition system and a live operator
US6173279B1 (en) Method of using a natural language interface to retrieve information from one or more data resources
EP0935378B1 (en) System and methods for automatic call and data transfer processing
US6891932B2 (en) System and methodology for voice activated access to multiple data sources and voice repositories in a single session
US6643622B2 (en) Data retrieval assistance system and method utilizing a speech recognition system and a live operator
AU2004255809B2 (en) Behavioral adaptation engine for discerning behavioral characteristics of callers interacting with an VXML-compliant voice application
US5915001A (en) System and method for providing and using universally accessible voice and speech data files

Legal Events

Date Code Title Description
AS Assignment

Owner name: COMVERSE NETWORK SYSTEMS, INC., MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DENENBERG, LAWRENCE A.;PANTTAJA, ERIN M.;SCHMANDT, CHRISTOPHER M.;REEL/FRAME:011617/0199;SIGNING DATES FROM 20010130 TO 20010213

AS Assignment

Owner name: COMVERSE NETWORK SYSTEMS, INC., MASSACHUSETTS

Free format text: RE-RECORD TO CORRECT DOCUMENT DATES AND THE ADDRESS OF THE ASSIGNEE ON REEL 011617 FRAME 0199. ASSIGNORS HEREBY CONFIRM THE ASSIGNMENT OF THE ENTIRE INTEREST.;ASSIGNORS:DENENBERG, LAWRENCE A.;PANTTAJA, ERIN M.;SCHMANDT, CHRISTOPHER M.;REEL/FRAME:011891/0701;SIGNING DATES FROM 20010130 TO 20010213

AS Assignment

Owner name: COMVERSE, INC., MASSACHUSETTS

Free format text: CHANGE OF NAME;ASSIGNOR:COMVERSE NETWORK SYSTEMS, INC.;REEL/FRAME:016615/0435

Effective date: 20010905

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: AMAZON TECHNOLOGIES, INC., NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:COMVERSE, INC.;REEL/FRAME:030402/0961

Effective date: 20130429

AS Assignment

Owner name: AMAZON TECHNOLOGIES, INC., NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:COMVERSE, INC.;REEL/FRAME:030632/0324

Effective date: 20130429

FPAY Fee payment

Year of fee payment: 12