WO2010092431A1 - Method and system for detecting a relevant utterance - Google Patents
Method and system for detecting a relevant utterance Download PDFInfo
- Publication number
- WO2010092431A1 WO2010092431A1 PCT/IB2009/007860 IB2009007860W WO2010092431A1 WO 2010092431 A1 WO2010092431 A1 WO 2010092431A1 IB 2009007860 W IB2009007860 W IB 2009007860W WO 2010092431 A1 WO2010092431 A1 WO 2010092431A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- speech recognition
- processor
- voice
- utterance
- speech
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000010168 coupling process Methods 0.000 claims description 17
- 238000005859 coupling reaction Methods 0.000 claims description 17
- 230000008878 coupling Effects 0.000 claims description 15
- 238000012544 monitoring process Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 description 11
- 238000001514 detection method Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000000977 initiatory effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 230000000135 prohibitive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
- G10L2015/025—Phonemes, fenemes or fenones being the recognition units
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L2015/088—Word spotting
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/74—Details of telephonic subscriber devices with voice recognition means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/487—Arrangements for providing information services, e.g. recorded voice services or time announcements
- H04M3/493—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
Definitions
- the present invention relates generally to speech recognition processing, and in particular to providing speech recognition processing in response to detection of an utterance.
- a speech recognition processor uses a predefined grammar to detect words in speech. Speech recognition processors are frequently used as a front end to provide voice-enabled command and control applications. A speech recognition processor detects a word match relatively quickly, but the words that can be detected are limited to the words associated with the particular grammar. Speech recognition processors are typically not effective at or designed to detect a particular relevant word or utterance in an unbounded stream of largely irrelevant words or utterances spoken at a conventional speaking rate, as might occur during a conversation between two or more participants. Rather, a speech recognition processor typically requires a speaker to speak quite distinctly and with brief pauses between commands, because the speech recognition processor is attempting to process each separate utterance as a command.
- Speech recognition processors require significant memory and processing capabilities, and in commercial settings are frequently implemented in stand-alone devices that can handle speech processing requirements for a finite number of voice sessions concurrently. [0003] Many speech-enabled applications are front-ends to customer service systems that offer full-time availability, and thus use dedicated speech recognition processors.
- Telecommunications providers are beginning to develop On- demand' voice-enabled applications that can be initiated by a participant in a conversation on an impromptu basis.
- a telecommunications provider may desire to provide a subscriber the ability, at any time, to request that a third-party be invited to be joined to an existing call via a speech-enabled application.
- a speech recognition processor channel be dedicated to a voice session for the entire voice session.
- speech recognition processors are memory and processor intensive, it may be impractical or cost-prohibitive to simultaneously provide hundreds or even thousands of speech recognition processing channels during hundreds or thousands of voice sessions.
- speech recognition processors are not designed to select a particular relevant word out of a stream of mainly irrelevant words occurring at a conventional speaking rate, the speech recognition processor would attempt to match each irrelevant word during the conversation to a predefined grammar of commands. Since the majority of words spoken in the conversation would not match any commands in the predefined grammar, the speech recognition processor would repeatedly respond with error indicators or false positive results for each word that did not match.
- Speech analytic processors in contrast to speech recognition processors, are used to search for utterances, such as words or other sounds, in large quantities of recorded voice data. Speech analytic processors are not typically employed in real-time applications.
- a speech analytic processor typically receives a recorded voice session as input and encodes the recorded voice session into a searchable file, or database. The speech analytic processor, or associated query module, can then search for arid detect designated sounds that may appear in the database.
- Speech analytics processors do not utilize a grammar and are capable of searching for any designated word, phrase, or sound once the database is generated and, in response to a search request, provide a time offset within the recorded voice session where such word, phrase, or sound was spoken.
- Speech analytics processors are extremely fast and because they are not designed to be used in a real-time environment or recognize complicated grammars, and they use significantly less processor and memory resources than a speech recognition processor. [0005] To minimize costs associated with speech recognition processing, it would be beneficial if a speech recognition processor could be selectively allocated to a voice session after a determination has been made that a participant in the voice session desires a voice-enabled application, rather than dedicate a speech recognition processor to the voice session that may not be used during the voice session. If a speech recognition processor could be allocated on an impromptu basis, a relatively small pool of speech recognition processors could be used to support a relatively large number of voice sessions. It would be further beneficial if a speech analytics processor could be used to determine when a participant in a voice session desires an on-demand speech- enabled application, because speech analytics processors require significantly less resources than speech recognition processors.
- the present invention uses a speech analytics processor to monitor a conversation for the use of an utterance, such as a hot word.
- a speech recognition processor begins monitoring the conversation for the use of a command associated with a voice-enabled application.
- the speech recognition processor communicates with the voice-enabled application to provide the voice-enabled application information associated with commands spoken by a participant in the conversation.
- the speech analytics processor continues to monitor the conversation for use of the hot word, and the speech recognition processor is decoupled from the conversation and is available for use by other voice sessions.
- a voice session is encoded in a media stream comprising voice signals of the participants of the conversation.
- a speech analytics processor monitors the voice signals for use of an utterance spoken by a participant in the conversation to invoke a speech- enabled application.
- the voice session is coupled to one of a pool of speech recognition processor channels.
- the speech recognition processor channel is decoupled from the voice session and returned to the pool of speech recognition processor channels.
- a voice session carrying a conversation between first and second participants is provided to a media application server that provides one or more on-demand voice-enabled applications to the participants in the conversation.
- the voice session is monitored by a speech analytics processor running on the media application server.
- the first participant desires to invite a third participant to the voice session.
- the first participant speaks a hot word
- the speech analytics processor detects the use of the hot word
- the of speech analytics processor notifies a control system associated with the media application server thereof.
- the media application server is coupled to a speech recognition processor having a plurality of speech recognition processor channels.
- the media application server obtains a speech recognition processor channel from the pool of speech recognition processor channels, and couples the speech recognition processor channel to the voice session.
- the voice-enabled application provides the speech recognition processor a grammar for recognizing available commands that may be spoken by the participant.
- the speech recognition processor awaits a command spoken by the participant.
- the speech recognition processor provides the speech- enabled application the recognized command.
- the speech-enabled application determines that the command relates to initiating a voice session to a third party and joining the call with the existing voice session.
- the speech-enabled application initiates a call to the third party, joins the call to the existing voice session, and informs the control system that the speech recognition processor channel may be returned to the pool of speech recognition processor channels.
- the control system returns the speech recognition processor channel to the pool of speech recognition processor channels.
- the control system couples the voice session, now having three participants, to the speech analytics processor for monitoring for subsequent use of the hot word by one of the participants of the conversation.
- Fig. 1 is a block diagram illustrating modules for implementing one embodiment of the present invention.
- Fig. 2 is a flow chart illustrating a process for detecting an utterance during a conversation and providing a speech recognition processor channel for an on-demand voice-enabled application according to one embodiment of the invention.
- the present invention relates to selective use of a speech recognition processor.
- the present invention enables, among other advantages, providing on-demand voice-enabled applications that may be used on an impromptu basis without requiring that a relatively expensive and processor intensive speech recognition processing channel be allocated to a conversation during the entire duration of the conversation.
- a relatively small pool of speech recognition processing channels can be used to support a relatively large number of voice sessions, reducing both capital equipment expenditures and licensing fees associated with speech recognition processing channels and providing a participant in a conversation the ability to invoke the on-demand voice-enabled application while speaking at a conventional speaking rate.
- FIG. 1 is a block diagram illustrating modules for implementing one embodiment of the present invention.
- a media application server (MAS) 10 includes a control system 12 that includes a memory 14.
- the MAS 10 can be a conventional or proprietary computing device, such as a computer or telecommunications server, that includes a processor capable of executing the control system 12.
- the control system 12 can include a conventional or proprietary operating system and additional software and hardware suitable for providing conventional operating system and telecommunications functions, such as memory management, input/output functions, and the like, as well as additional functionality as described herein.
- the MAS 10 also includes a communications interface 16 that is coupled to one or more telecommunications devices 18, such as a call server 18A, a private branch exchange (PBX) 18B, a Session Initiation Protocol (SIP)/ Public Switched Telephone Network (PSTN) gateway 18C, and the like.
- Participants 24 use user devices 26 to engage in conversations with one another.
- the user devices 26 can comprise any suitable communications devices, such as wired, cordless, or cellular telephones, computers, personal digital assistants, and the like.
- the conversations between respective pairs of participants, such as the participants 24A, 24B, are established by one or more of the respective telecommunication devices 18 as a voice session, and are represented herein by voice sessions 28A, 28B, 28C.
- the telecommunications devices 18 are capable of providing one or more voice sessions 28 to the MAS 10 for desired processing.
- the MAS 10 includes a voice-enabled application 30 that may provide functionality to a participant 24 during a voice session 28.
- the voice-enabled application 30 may be an 'on-demand' application.
- the voice-enabled application 30 may not provide functionality until called upon by a participant 24 to do so.
- the voice-enabled application 30 interacts with a speech recognition processor 32 to enable the participant 24 to interact with the voice-enabled application 30 via speech commands.
- the speech recognition processor 32 provides speech recognition services to one or more voice-enabled applications 30 via speech recognition channels 34A-34D, one of which is allocated to a respective voice-enabled application 30 as needed.
- Speech recognition processors such as the speech recognition processor 32, are processor and memory intensive devices that utilize a defined grammar having a finite vocabulary of commands and attempt to detect the use of a command in speech in real-time.
- Speech recognition is a specialized technology that is frequently provided to a business by a third party that specializes in speech recognition technology.
- speech recognition processors are typically dedicated servers that work in conjunction with a specific application to provide an integrated voice-enabled application, or that provide a finite number of speech recognition channels for use however the business desires.
- Speech recognition processors are frequently licensed for use on a per channel basis, and in practice, licensing fees and equipment investment necessary to provide a speech recognition channel for a large number of voice sessions 28 is cost prohibitive.
- speech recognition processors specialize in recognizing a finite number of commands and are significantly more accurate in detecting the use of a command when words are spoken slowly, distinctly, and with pauses between each word. Using a speech recognition processor to detect a single word or utterance in a stream of words would cause the speech recognition processor to attempt to match each separate word or utterance to the predefined grammar, and repeatedly respond with error indicators or false positive results for each word or utterance that did not match the predefined grammar.
- the MAS 10 also includes an embedded speech analytics processor 36.
- the speech analytics processor 36 can execute on the same processor as other applications in the MAS 10. Alternately, the speech analytics processor 36 can be executed on a separate device and be coupled to the MAS 10 via a network.
- Speech analytic processors are designed to find occurrences of designated utterances, such as words, phrases, or other sounds, in large quantities of voice data. The process of speech analytics is sometimes referred to as data mining, and can be used, for example, by a government agency to determine if certain words were spoken during, for example, any international call that was placed on a particular day.
- a speech analytics processor typically receives voice signals associated with a conversation as input and encodes the voice signals into a searchable database or file.
- a query module can then be used to determine whether one or more words or phrases are present in the searchable database.
- speech analytics software is provided by Nexidia Inc., 3565 Piedmont Road. NE, Building Two, Suite 400, Atlanta, GA 30305 (www.nexidia.com), and its white paper entitled Phonetic Search Technology, 2007 and the references cited therein, wherein the white paper and cited references are each incorporated herein by reference in their entireties.
- the Nexidia speech analytics processor encodes voice signals as phonemes, and creates a phoneme-based index of the conversation.
- a query including a query term comprising one or more words is entered, the query term is similarly encoded as phonemes, and the phoneme-based index is used to determine if the query term is present in the searchable database. If so, the speech analytics processor can return a time offset indicating where in the voice signals the query term is present.
- a speech analytics processor is not designed to work with a complex grammar or react to a predetermined number of commands in real-time. Consequently, speech analytics processors use significantly less processor and memory than a speech recognition processor. However, speech analytics processors are very good at finding a particular utterance in a recorded conversation spoken at a conventional speaking rate.
- the present invention uses a speech analytics processor 36 to monitor a conversation and detect an utterance, such as a hot word, in a near real-time time frame.
- the drawings and examples provided herein will refer to the utterance as a hot word, but those skilled in the art will appreciate that the invention is not limited to detecting a hot word, and can be used to detect any utterance, whether it be a word, a combination of words, or other sounds.
- the present invention interfaces with the speech analytics processor 36 and provides the speech analytics processor 36 segments of speech as they are generated by the participants in the conversation.
- the precise method for providing the speech analytics processor 36 can vary depending on the particular speech analytics processor 36 used but, according to one embodiment of the invention, the speech analytics processor 36 provides an application programming interface (API) that can be called by the control system 12 to provide segments of speech to the speech analytics processor 36.
- API application programming interface
- the speech analytics processor 36 processes the speech segments and determines whether the hot word is located in the speech segment. Upon detection of the hot word, the speech analytics processor 36 notifies the control system 12, which in turn interacts with the voice-enabled application 30.
- a speech recognition channel 34 is obtained from a pool of the speech recognition channels 34A-34D, and is coupled to the respective voice session 28 in which the hot word was detected.
- the speech recognition processor 32 provides voice recognition services to the voice-enabled application 30. After the voice-enabled application 30 has provided the desired function to the participants 24, the speech recognition channel 34 is returned to the pool of speech recognition channels 34A-34D.
- the voice session 28 continues to be monitored for subsequent use of the hot word by the speech analytics processor 36.
- FIG. 2 is a flowchart providing an example of hot word detection according to one embodiment of the present invention.
- Fig. 2 will be discussed in conjunction with Fig. 1.
- the voice session 28A is established between the user devices 26A and 26B by one or more telecommunications devices 18.
- Voice signals of the participants 24A, 24B are provided in a media stream from the respective telecommunications devices 18 to the MAS 10.
- the speech analytics processor 36 receives the media stream of voice signals and monitors the conversation for the use of a predetermined hot word (step 100).
- the predetermined hot word can be any desired word or combination of words that a participant 24 may use to initiate, invoke, or otherwise establish communications with the voice-enabled application 30.
- the predetermined hot word is a word or phrase that would not normally arise in a conversation.
- participant 24B asks the participant 24A for a date of completion of a project.
- the participant 24A responds to the participant 24B indicating that the participant 24A cannot provide a completion date; however, another individual would be able to provide a completion date.
- the participant 24B suggests to the participant 24A that they attempt to initiate a telephone call with the individual and conference the individual into the existing voice session 28A.
- the participant 24B speaks the desired hot word, for example, 'personal agent.
- the speech analytics processor 36 in conjunction with the control system 12, is continually monitoring the voice session 28A, encoding the voice signals into encoded segments of a predetermined size, and searching the encoded segments for an occurrence of the hot word.
- the speech analytics processor 36 detects the use of the hot word in the media stream (step 102).
- the speech analytics processor 36 indicates to the control system 12 that the hot word was detected associated with the voice session 28A (step 104).
- the control system 12 decouples the voice session 28A from the speech analytics processor 36 (step 106).
- the control system 12 interfaces with the speech recognition processor 32 to obtain a speech recognition channel 34 from the pool of speech recognition channels 34A-34D.
- the control system 12 couples the speech recognition channel 34 to the voice session 28A (step 108).
- the control system 12 also initiates the voice-enabled application 30, which provides a grammar to the speech recognition processor 32 for use by the participants 24A, 24B (step 110).
- the voice-enabled application 30 may be initiated at the initial establishment of the voice session 28A, and upon initiation may provide the predetermined hot word to the control system 12 for monitoring.
- the participant 24B is prompted for a command.
- the participant 24B speaks a predetermined command that is recognized by the speech recognition processor 32 and is passed to the voice-enabled application 30, which in turn initiates a call to the individual.
- the voice-enabled application 30, upon reaching the individual, joins the call to the voice session 28A (step 112).
- the voice-enabled application 30 indicates to the control system 12 that the voice-enabled application 30 is finished.
- the control system 12 decouples the voice session 28A from the speech recognition channel 34 (step 114).
- the control system 12 re-couples the speech analytics processor 36 to the voice session 28A for continued monitoring of the conversation for subsequent use of the hot word by one of the participants 24 (step 116).
- the present invention thus provides a mechanism for sharing a relatively small number of speech recognition processing channels among a relatively large number of voice sessions to provide speech-enabled applications for each voice session.
- the present invention reduces capital equipment costs and licensing fees associated with the commercial use of speech recognition processors.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
BRPI0923566A BRPI0923566A2 (en) | 2008-12-22 | 2009-12-22 | method and system for detecting relevant vocal expression |
EP09839930A EP2380337A4 (en) | 2008-12-22 | 2009-12-22 | Method and system for detecting a relevant utterance |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/341,246 US8548812B2 (en) | 2008-12-22 | 2008-12-22 | Method and system for detecting a relevant utterance in a voice session |
US12/341,246 | 2008-12-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010092431A1 true WO2010092431A1 (en) | 2010-08-19 |
Family
ID=42267361
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2009/007860 WO2010092431A1 (en) | 2008-12-22 | 2009-12-22 | Method and system for detecting a relevant utterance |
Country Status (4)
Country | Link |
---|---|
US (1) | US8548812B2 (en) |
EP (1) | EP2380337A4 (en) |
BR (1) | BRPI0923566A2 (en) |
WO (1) | WO2010092431A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3050051B1 (en) * | 2013-09-25 | 2022-05-25 | Amazon Technologies, Inc. | In-call virtual assistants |
Families Citing this family (74)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013200423A (en) * | 2012-03-23 | 2013-10-03 | Toshiba Corp | Voice interaction support device, method and program |
NZ700273A (en) * | 2012-04-27 | 2016-10-28 | Interactive Intelligence Inc | Negative example (anti-word) based performance improvement for speech recognition |
WO2013184667A1 (en) | 2012-06-05 | 2013-12-12 | Rank Miner, Inc. | System, method and apparatus for voice analytics of recorded audio |
US9536528B2 (en) | 2012-07-03 | 2017-01-03 | Google Inc. | Determining hotword suitability |
US9245527B2 (en) | 2013-10-11 | 2016-01-26 | Apple Inc. | Speech recognition wake-up of a handheld portable electronic device |
JP6176055B2 (en) * | 2013-10-21 | 2017-08-09 | 富士通株式会社 | Voice search apparatus and voice search method |
US8719039B1 (en) | 2013-12-05 | 2014-05-06 | Google Inc. | Promoting voice actions to hotwords |
US9263042B1 (en) | 2014-07-25 | 2016-02-16 | Google Inc. | Providing pre-computed hotword models |
CN105791222A (en) * | 2014-12-22 | 2016-07-20 | 北京壹人壹本信息科技有限公司 | Secure communication method and system and communication terminal |
US10102201B2 (en) * | 2015-11-30 | 2018-10-16 | Soundhound, Inc. | Natural language module store |
CN105741838B (en) * | 2016-01-20 | 2019-10-15 | 百度在线网络技术(北京)有限公司 | Voice awakening method and device |
US10157629B2 (en) | 2016-02-05 | 2018-12-18 | Brainchip Inc. | Low power neuromorphic voice activation system and method |
US9947316B2 (en) | 2016-02-22 | 2018-04-17 | Sonos, Inc. | Voice control of a media playback system |
US10095470B2 (en) | 2016-02-22 | 2018-10-09 | Sonos, Inc. | Audio response playback |
US9826306B2 (en) | 2016-02-22 | 2017-11-21 | Sonos, Inc. | Default playback device designation |
US9965247B2 (en) | 2016-02-22 | 2018-05-08 | Sonos, Inc. | Voice controlled media playback system based on user profile |
US10509626B2 (en) | 2016-02-22 | 2019-12-17 | Sonos, Inc | Handling of loss of pairing between networked devices |
US10264030B2 (en) | 2016-02-22 | 2019-04-16 | Sonos, Inc. | Networked microphone device control |
US9978390B2 (en) | 2016-06-09 | 2018-05-22 | Sonos, Inc. | Dynamic player selection for audio signal processing |
US10152969B2 (en) | 2016-07-15 | 2018-12-11 | Sonos, Inc. | Voice detection by multiple devices |
US10134399B2 (en) | 2016-07-15 | 2018-11-20 | Sonos, Inc. | Contextualization of voice inputs |
US10115400B2 (en) | 2016-08-05 | 2018-10-30 | Sonos, Inc. | Multiple voice services |
US9942678B1 (en) | 2016-09-27 | 2018-04-10 | Sonos, Inc. | Audio playback settings for voice interaction |
US9743204B1 (en) | 2016-09-30 | 2017-08-22 | Sonos, Inc. | Multi-orientation playback device microphones |
US10181323B2 (en) | 2016-10-19 | 2019-01-15 | Sonos, Inc. | Arbitration-based voice recognition |
US10276161B2 (en) | 2016-12-27 | 2019-04-30 | Google Llc | Contextual hotwords |
US10475449B2 (en) | 2017-08-07 | 2019-11-12 | Sonos, Inc. | Wake-word detection suppression |
US10048930B1 (en) | 2017-09-08 | 2018-08-14 | Sonos, Inc. | Dynamic computation of system response volume |
US10446165B2 (en) | 2017-09-27 | 2019-10-15 | Sonos, Inc. | Robust short-time fourier transform acoustic echo cancellation during audio playback |
US10482868B2 (en) | 2017-09-28 | 2019-11-19 | Sonos, Inc. | Multi-channel acoustic echo cancellation |
US10621981B2 (en) | 2017-09-28 | 2020-04-14 | Sonos, Inc. | Tone interference cancellation |
US10051366B1 (en) | 2017-09-28 | 2018-08-14 | Sonos, Inc. | Three-dimensional beam forming with a microphone array |
US10466962B2 (en) | 2017-09-29 | 2019-11-05 | Sonos, Inc. | Media playback system with voice assistance |
US10880650B2 (en) | 2017-12-10 | 2020-12-29 | Sonos, Inc. | Network microphone devices with automatic do not disturb actuation capabilities |
US10818290B2 (en) | 2017-12-11 | 2020-10-27 | Sonos, Inc. | Home graph |
US11343614B2 (en) | 2018-01-31 | 2022-05-24 | Sonos, Inc. | Device designation of playback and network microphone device arrangements |
US11175880B2 (en) | 2018-05-10 | 2021-11-16 | Sonos, Inc. | Systems and methods for voice-assisted media content selection |
US10847178B2 (en) | 2018-05-18 | 2020-11-24 | Sonos, Inc. | Linear filtering for noise-suppressed speech detection |
US10959029B2 (en) | 2018-05-25 | 2021-03-23 | Sonos, Inc. | Determining and adapting to changes in microphone performance of playback devices |
US10681460B2 (en) | 2018-06-28 | 2020-06-09 | Sonos, Inc. | Systems and methods for associating playback devices with voice assistant services |
US11076035B2 (en) | 2018-08-28 | 2021-07-27 | Sonos, Inc. | Do not disturb feature for audio notifications |
US10461710B1 (en) | 2018-08-28 | 2019-10-29 | Sonos, Inc. | Media playback system with maximum volume setting |
US10587430B1 (en) | 2018-09-14 | 2020-03-10 | Sonos, Inc. | Networked devices, systems, and methods for associating playback devices based on sound codes |
US11024331B2 (en) | 2018-09-21 | 2021-06-01 | Sonos, Inc. | Voice detection optimization using sound metadata |
US10811015B2 (en) | 2018-09-25 | 2020-10-20 | Sonos, Inc. | Voice detection optimization based on selected voice assistant service |
US11100923B2 (en) | 2018-09-28 | 2021-08-24 | Sonos, Inc. | Systems and methods for selective wake word detection using neural network models |
US10692518B2 (en) | 2018-09-29 | 2020-06-23 | Sonos, Inc. | Linear filtering for noise-suppressed speech detection via multiple network microphone devices |
US11899519B2 (en) | 2018-10-23 | 2024-02-13 | Sonos, Inc. | Multiple stage network microphone device with reduced power consumption and processing load |
EP3654249A1 (en) | 2018-11-15 | 2020-05-20 | Snips | Dilated convolutions and gating for efficient keyword spotting |
US11183183B2 (en) | 2018-12-07 | 2021-11-23 | Sonos, Inc. | Systems and methods of operating media playback systems having multiple voice assistant services |
US11132989B2 (en) | 2018-12-13 | 2021-09-28 | Sonos, Inc. | Networked microphone devices, systems, and methods of localized arbitration |
US10602268B1 (en) | 2018-12-20 | 2020-03-24 | Sonos, Inc. | Optimization of network microphone devices using noise classification |
US10867604B2 (en) | 2019-02-08 | 2020-12-15 | Sonos, Inc. | Devices, systems, and methods for distributed voice processing |
US11315556B2 (en) | 2019-02-08 | 2022-04-26 | Sonos, Inc. | Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification |
US11120794B2 (en) | 2019-05-03 | 2021-09-14 | Sonos, Inc. | Voice assistant persistence across multiple network microphone devices |
US11361756B2 (en) | 2019-06-12 | 2022-06-14 | Sonos, Inc. | Conditional wake word eventing based on environment |
US10586540B1 (en) | 2019-06-12 | 2020-03-10 | Sonos, Inc. | Network microphone device with command keyword conditioning |
US11200894B2 (en) | 2019-06-12 | 2021-12-14 | Sonos, Inc. | Network microphone device with command keyword eventing |
US10871943B1 (en) * | 2019-07-31 | 2020-12-22 | Sonos, Inc. | Noise classification for event detection |
US11138969B2 (en) | 2019-07-31 | 2021-10-05 | Sonos, Inc. | Locally distributed keyword detection |
US11138975B2 (en) | 2019-07-31 | 2021-10-05 | Sonos, Inc. | Locally distributed keyword detection |
CN110246499B (en) * | 2019-08-06 | 2021-05-25 | 思必驰科技股份有限公司 | Voice control method and device for household equipment |
US11189286B2 (en) | 2019-10-22 | 2021-11-30 | Sonos, Inc. | VAS toggle based on device orientation |
CN111147444B (en) * | 2019-11-20 | 2021-08-06 | 维沃移动通信有限公司 | Interaction method and electronic equipment |
US11200900B2 (en) | 2019-12-20 | 2021-12-14 | Sonos, Inc. | Offline voice control |
US11562740B2 (en) | 2020-01-07 | 2023-01-24 | Sonos, Inc. | Voice verification for media playback |
US11556307B2 (en) | 2020-01-31 | 2023-01-17 | Sonos, Inc. | Local voice data processing |
US11308958B2 (en) | 2020-02-07 | 2022-04-19 | Sonos, Inc. | Localized wakeword verification |
US11727919B2 (en) | 2020-05-20 | 2023-08-15 | Sonos, Inc. | Memory allocation for keyword spotting engines |
US11482224B2 (en) | 2020-05-20 | 2022-10-25 | Sonos, Inc. | Command keywords with input detection windowing |
US11308962B2 (en) | 2020-05-20 | 2022-04-19 | Sonos, Inc. | Input detection windowing |
US11698771B2 (en) | 2020-08-25 | 2023-07-11 | Sonos, Inc. | Vocal guidance engines for playback devices |
US11984123B2 (en) | 2020-11-12 | 2024-05-14 | Sonos, Inc. | Network device interaction by range |
US11551700B2 (en) | 2021-01-25 | 2023-01-10 | Sonos, Inc. | Systems and methods for power-efficient keyword detection |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7117159B1 (en) * | 2001-09-26 | 2006-10-03 | Sprint Spectrum L.P. | Method and system for dynamic control over modes of operation of voice-processing in a voice command platform |
US20080089503A1 (en) * | 2002-04-30 | 2008-04-17 | At&T Knowledge Ventures, L.P. | Voice enhancing for advance intelligent network services |
US20080208594A1 (en) * | 2007-02-27 | 2008-08-28 | Cross Charles W | Effecting Functions On A Multimodal Telephony Device |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
NL8401862A (en) * | 1984-06-13 | 1986-01-02 | Philips Nv | METHOD FOR RECOGNIZING A CONTROL COMMAND IN A SYSTEM, AND AN INTERACTIVE SYSTEM FOR PERFORMING THE METHOD. |
US5761641A (en) * | 1995-07-31 | 1998-06-02 | Microsoft Corporation | Method and system for creating voice commands for inserting previously entered information |
US5719921A (en) * | 1996-02-29 | 1998-02-17 | Nynex Science & Technology | Methods and apparatus for activating telephone services in response to speech |
GB9620082D0 (en) * | 1996-09-26 | 1996-11-13 | Eyretel Ltd | Signal monitoring apparatus |
US6757652B1 (en) * | 1998-03-03 | 2004-06-29 | Koninklijke Philips Electronics N.V. | Multiple stage speech recognizer |
US6728671B1 (en) * | 2000-03-29 | 2004-04-27 | Lucent Technologies Inc. | Automatic speech recognition caller input rate control |
US20030023431A1 (en) * | 2001-07-26 | 2003-01-30 | Marc Neuberger | Method and system for augmenting grammars in distributed voice browsing |
US6785654B2 (en) * | 2001-11-30 | 2004-08-31 | Dictaphone Corporation | Distributed speech recognition system with speech recognition engines offering multiple functionalities |
EP1361740A1 (en) | 2002-05-08 | 2003-11-12 | Sap Ag | Method and system for dialogue speech signal processing |
US7133828B2 (en) * | 2002-10-18 | 2006-11-07 | Ser Solutions, Inc. | Methods and apparatus for audio data analysis and data mining using speech recognition |
US7065198B2 (en) | 2002-10-23 | 2006-06-20 | International Business Machines Corporation | System and method for volume control management in a personal telephony recorder |
TWI235358B (en) | 2003-11-21 | 2005-07-01 | Acer Inc | Interactive speech method and system thereof |
EP1562180B1 (en) | 2004-02-06 | 2015-04-01 | Nuance Communications, Inc. | Speech dialogue system and method for controlling an electronic device |
US7752043B2 (en) * | 2006-09-29 | 2010-07-06 | Verint Americas Inc. | Multi-pass speech analytics |
-
2008
- 2008-12-22 US US12/341,246 patent/US8548812B2/en active Active
-
2009
- 2009-12-22 EP EP09839930A patent/EP2380337A4/en not_active Withdrawn
- 2009-12-22 WO PCT/IB2009/007860 patent/WO2010092431A1/en active Application Filing
- 2009-12-22 BR BRPI0923566A patent/BRPI0923566A2/en not_active Application Discontinuation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7117159B1 (en) * | 2001-09-26 | 2006-10-03 | Sprint Spectrum L.P. | Method and system for dynamic control over modes of operation of voice-processing in a voice command platform |
US20080089503A1 (en) * | 2002-04-30 | 2008-04-17 | At&T Knowledge Ventures, L.P. | Voice enhancing for advance intelligent network services |
US20080208594A1 (en) * | 2007-02-27 | 2008-08-28 | Cross Charles W | Effecting Functions On A Multimodal Telephony Device |
Non-Patent Citations (1)
Title |
---|
See also references of EP2380337A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3050051B1 (en) * | 2013-09-25 | 2022-05-25 | Amazon Technologies, Inc. | In-call virtual assistants |
Also Published As
Publication number | Publication date |
---|---|
EP2380337A1 (en) | 2011-10-26 |
US20100161335A1 (en) | 2010-06-24 |
BRPI0923566A2 (en) | 2016-01-26 |
EP2380337A4 (en) | 2012-09-19 |
US8548812B2 (en) | 2013-10-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8548812B2 (en) | Method and system for detecting a relevant utterance in a voice session | |
US11996085B2 (en) | Enhanced speech endpointing | |
US10187503B2 (en) | Enabling voice control of telephone device | |
US8744848B2 (en) | Methods and systems for training dictation-based speech-to-text systems using recorded samples | |
US8254534B2 (en) | Method and apparatus for automatic telephone menu navigation | |
EP2717258B1 (en) | Phrase spotting systems and methods | |
US7805310B2 (en) | Apparatus and methods for implementing voice enabling applications in a converged voice and data network environment | |
US8515025B1 (en) | Conference call voice-to-name matching | |
US20070285505A1 (en) | Method and apparatus for video conferencing having dynamic layout based on keyword detection | |
US20070239458A1 (en) | Automatic identification of timing problems from speech data | |
US7318029B2 (en) | Method and apparatus for a interactive voice response system | |
US10199035B2 (en) | Multi-channel speech recognition | |
Hamidi et al. | Interactive voice response server voice network administration using hidden markov model speech recognition system | |
US9077802B2 (en) | Automated response system | |
EP2124427A2 (en) | Treatment processing of a plurality of streaming voice signals for determination of responsive action thereto | |
US8229750B2 (en) | Barge-in capabilities of a voice browser | |
US20070297581A1 (en) | Voice-based phone system user interface | |
US20230353671A1 (en) | Indicating callers for incoming voice calls on a shared speech-enabled device | |
WO2003060880A1 (en) | Network-accessible speaker-dependent voice models of multiple persons | |
US20210312143A1 (en) | Real-time call translation system and method | |
US10861463B2 (en) | Method for speech processing and speech processing device | |
JP2004264844A (en) | Method, apparatus, and product for automatically managing conversation floor of computer intervention communication | |
Narayanan et al. | Effects of dialog initiative and multi-modal presentation strategies on large directory information access. | |
US8954325B1 (en) | Speech recognition in automated information services systems | |
KR100230972B1 (en) | Voice cognition service apparatus of full electronic exchange |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09839930 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 701/MUMNP/2011 Country of ref document: IN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009839930 Country of ref document: EP |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: PI0923566 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: PI0923566 Country of ref document: BR Kind code of ref document: A2 Effective date: 20110622 |