US20030074199A1 - Speech input system, speech portal server, and speech input terminal - Google Patents

Speech input system, speech portal server, and speech input terminal Download PDF

Info

Publication number
US20030074199A1
US20030074199A1 US10/083,636 US8363602A US2003074199A1 US 20030074199 A1 US20030074199 A1 US 20030074199A1 US 8363602 A US8363602 A US 8363602A US 2003074199 A1 US2003074199 A1 US 2003074199A1
Authority
US
United States
Prior art keywords
speech
mean
speech input
information
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/083,636
Other languages
English (en)
Inventor
Soshiro Kuzunuki
Shinya Ohtsuji
Michio Morioka
Tadashi Kamiwaki
Mariko Okude
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Assigned to HITACHI, LTD. reassignment HITACHI, LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MORIOKA, MICHIO, OHTSUJI, SHINYA, KAMIWAKI, TADASHI, KUZUNUKI, SOSHIRO, OKUDE, MARIKO
Priority to US10/192,317 priority Critical patent/US6944593B2/en
Publication of US20030074199A1 publication Critical patent/US20030074199A1/en
Priority to US10/823,552 priority patent/US7058579B2/en
Priority to US11/060,390 priority patent/US7299186B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/487—Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4936—Speech interaction details
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72445—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting Internet browser applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/40—Electronic components, circuits, software, systems or apparatus used in telephone systems using speech recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2207/00—Type of exchange or network, i.e. telephonic medium, in which the telephonic communication takes place
    • H04M2207/18—Type of exchange or network, i.e. telephonic medium, in which the telephonic communication takes place wireless networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/42365—Presence services providing information on the willingness to communicate or the ability to communicate in terms of media capability or network connectivity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/487—Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4938—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals comprising a voice browser which renders and interprets, e.g. VoiceXML

Definitions

  • the present invention relates to a speech input system, a speech portal server, and a speech input terminal, and more specifically to a speech input system which have an access from a mobile terminal device such as a portable phone, and an onboard navigation system, and a home (stationary) terminal such as a home telephone, a TV set, or a PC to an network with a speech, and receive information and services from an information service provider which provides map information, music information, TV broadcast program information, and telephone information.
  • a mobile terminal device such as a portable phone, and an onboard navigation system
  • a home (stationary) terminal such as a home telephone, a TV set, or a PC to an network with a speech
  • an information service provider which provides map information, music information, TV broadcast program information, and telephone information.
  • Japanese application patent laid-open publication No. Hei 11-143493 describes a system which converts a provided speech into an intermediate language, which is a database language, with a speech language understanding device, and searches a word.
  • Japanese application patent laid-open publication No. 2000-57490 describes a method for increasing a recognition capability for a provided speech while switching recognition dictionaries.
  • Japanese application patent laid-open publication No. 2001-34292 describes a method for increasing a recognition capability where a word from a dictionary is extracted with a word spotting technique, a requested key word is recognized to determine a topic, and a speech is recognized with a recognition dictionary specific to the topic.
  • the technique in Japanese application patent laid-open publication No. Hei 11-143493 is a method to learn a hidden Markov model which converts a sentence data into a corresponding intermediate language such that a recognition error becomes minimum. Since this method is a learning based on statistic processing, learning in individual fields is required when service is provided for different fields simultaneously, the processing takes a long time, and the recognition capability decreases. This is not designed as a speech input system considering an actual conversation which includes mixed long sentences and short sentences. Further, no attention is paid for a case where there is an error in a part of recognized string.
  • the purpose of the present invention is to provide a speech input system, a speech portal server and a speech input system which have access from a mobile terminal such as a PDA and a portable phone, and stationary terminal such as a home telephone (Home TEL), a TV set and a PC to a network with speech, and receives services from a provider for providing map information, music information, broadcast program information and telephone information.
  • a mobile terminal such as a PDA and a portable phone
  • stationary terminal such as a home telephone (Home TEL)
  • Home TEL home telephone
  • TV set and a PC to a network with speech
  • the present invention proposes a speech input system comprising a speech input terminal provided with a speech input/output mean, a Web browser, and a display mean for displaying an access status to an external system and a search result, a speech portal server provided with a speech recognizing mean for receiving a speech from the speech input terminal to recognize it as a text, a command converting mean for checking the recognized text with a command text dictionary, and separating it into a command text and an object text, and a conversation control mean for having an access to, and receiving a service from an application service provider which provides different information based on the separated command text and object text, and providing the speech input terminal with the service, and an application service provider which is provided with an information search mean for searching information based on the command text and the object text received from the speech portal server, and serves the speech portal server with a search result.
  • the information search mean of the application service provider can extract every (n) characters from the received object text, and search for information based on an n-character INDEX created beforehand.
  • the application service provider includes a navigation information application service provider for serving map information, a music information application service provider for serving music information, a broadcast program information application service provider for serving at least one type of information of TV broadcast program information, CS broadcast program information, and CATV broadcast program information, and a telephone information application service provider for serving telephone information.
  • the speech portal server recognizes a speech received by the speech input terminal, and separates it into a command text and an object text, conducts a fuzzy search for information stored in the application service provider based on the separated texts, and provides the speech input terminal with intended information even if there is a partial recognition error in the object text in the present invention.
  • the present invention propose a speech input system comprising a speech input terminal provided with a speech input/output mean, and a mean for displaying an access status to an external system, an application service provider for providing different information, and a speech portal server which controls a conversation between the speech input terminal and the application service provider based on the provided speech, and is provided with a speech recognizing mean for receiving a speech from the speech input terminal to recognize it as a text, a command converting mean for checking the recognized text with a command text dictionary, and separating it into a command text and an object text, and a conversation control mean for sending the separated command text and the object text to the application service provider, and providing the speech input terminal with information searched by said application service provider.
  • the speech recognizing mean is provided with a connected speech recognizing mean, a word speech recognizing mean, and a comprehensive recognition evaluating mean for selecting either of recognition results of said two recognizing means with a speech characteristic value provided as a threshold.
  • the speech characteristic value is a speech time or a recognized string length.
  • a speech recognizing engine in the speech portal server comprises a connected speech recognizing engine suitable for a long sentence, and a word speech recognizing engine suitable for a short sentence such as a command for comprehensive evaluation, thereby increasing recognition capability of speech conversation.
  • a speech input terminal which has access to the speech portal server and the application service provider for providing different information is provided with a speech input/output mean, a Web browser, and a display mean for displaying an access status to an external system and a search result in the present invention.
  • the speech input terminals are classified into portable speech input terminals which are integrated into any one of a PDA, a portable phone, or an onboard navigation system, and home speech input terminals which are integrated into any one of a home telephone, a TV set and a PC.
  • the navigation information ASP, the music information ASP, the broadcast program information ASP, and the telephone information ASP are provided as application service providers (ASP's), the mobile speech input terminals such as a PDA, a Mobile TEL, and a Mobile Car PC and the home speech input terminals such as a home telephone, a TV set, and a PC are served with optimal information
  • FIG. 1 is a block diagram showing an overall constitution of an embodiment of a speech input system of the present invention.
  • FIG. 2 is a block diagram for showing an embodiment of a PDA serving as a speech input terminal of the present invention.
  • FIG. 3 is a block diagram for showing an embodiment of a Mobile TEL serving as a speech input terminal of the present invention.
  • FIG. 4 is a block diagram for showing an embodiment of a Mobile Car PC serving as a speech input terminal of the present invention.
  • FIG. 5 is a block diagram for showing an embodiment of a home telephone serving as a speech input terminal of the present invention.
  • FIG. 6 is a block diagram for showing an embodiment of a TV set serving as a speech input terminal of the present invention.
  • FIG. 7 is a block diagram for showing an embodiment of a PC serving as a speech input terminal of the present invention.
  • FIG. 8 is a block diagram for showing an embodiment of a speech portal server of the present invention.
  • FIG. 9 is a block diagram for showing a constitution of a speech recognizing mean of a speech portal server of the present invention.
  • FIG. 10 is a block diagram for showing an operation of a speech recognizing mean of a speech portal server of the present invention.
  • FIG. 11 is a block diagram for showing an operation of a speech recognizing mean of a speech portal server of the present invention.
  • FIG. 12 is a block diagram for showing an operation of a speech recognizing mean of a speech portal server of the present invention.
  • FIG. 13 is a block diagram for showing an operation of a speech recognizing mean of a speech portal server of the present invention.
  • FIG. 14 is a block diagram for showing a constitution of a command converting mean of a speech portal server of the present invention.
  • FIG. 15 is a drawing for showing an example of a speech command text dictionary of the present invention.
  • FIG. 16 is a drawing for showing an operation of a command converting mean of a speech portal server of the present invention.
  • FIG. 17 is a block diagram for showing a constitution of a conversation control mean of a speech portal server of the present invention.
  • FIG. 18 is a block diagram for showing a constitution of a navigation information ASP of the present invention.
  • FIG. 19 is a block diagram for showing a constitution of a music information ASP of the present invention.
  • FIG. 20 is a block diagram for showing a constitution of a TV broadcast program information ASP of the present invention.
  • FIG. 21 is a block diagram for showing a constitution of a telephone information ASP of the present invention.
  • FIG. 22 is a drawing for showing an example of a speech operation menu screen of the present invention.
  • FIG. 23 is a block diagram for showing a constitution of a fuzzy search mean of individual information ASP's of the present invention.
  • FIG. 24 is a drawing for showing an example of a procedure for a fuzzy search mean of individual information ASP's of the present invention.
  • FIG. 25 is a drawing for showing a communication procedure among a speech input terminal, a speech portal server and a navigation information ASP of the present invention.
  • FIG. 26 is a drawing for showing a communication procedure among a speech input terminal, a speech portal server and a music information ASP of the present invention.
  • FIG. 27 is a drawing for showing a communication procedure among a speech input terminal, a speech portal server and a TV broadcast program information ASP of the present invention.
  • FIG. 28 is a drawing for showing a communication procedure among a speech input terminal, a speech portal server and a telephone information ASP of the present invention.
  • FIG. 1 is a block diagram showing an overall constitution of an embodiment of a speech input system of the present invention.
  • a mobile terminal 10 and a home (stationary) terminal 30 are available as a speech input terminal device in the present embodiment.
  • the mobile terminal 10 includes a PDA 10 a , a cellular phone 10 b, and an onboard terminal 10 c.
  • the home (stationary) terminal 30 includes a stationary telephone 30 a which is intended for a household application, a television system TV 30 b as an information home electric appliance, and a personal computer PC 30 c.
  • the portable terminals 10 a to 10 c are connected with an Internet network 40 through a radio base station 20 , and the home terminals 30 a to 30 c are directly connected with the Internet network 40 .
  • the speech portal 50 for controlling the entire speech conversation, and different application service providers (ASP's) 60 are connected with the Internet network 40 as well.
  • the ASP includes a navigation information ASP 60 a for serving map information, a music information ASP 60 b, a TV broadcast program information ASP 60 c, and a telephone information ASP 60 d.
  • any one of the speech input terminals 10 a to 10 c, and 30 a to 30 c connects with a speech portal server 50 , a speech guidance and a menu display are provided on the speech input terminal, and entering a corresponding speech transmits the speech to the speech portal server 50 through the Internet network 40 .
  • the speech portal server 50 recognizes the speech, applies the command conversion to the content of the speech for converting it into a command and an object to be searched for, and transmits them to an ASP 60 corresponding to the content of the command.
  • the ASP 60 searches a corresponding database, and provides the speech input terminal where the speech is entered with a search result through the speech portal server 50 .
  • the speech input system is mainly used for a potable terminal under an environment where a keyboard (KB) is hardly available, and a household where keyboard operation is not popular, thereby facilitating the input.
  • a group of servers are connected with the Internet as an overall constitution of the speech input system in the present embodiment.
  • Information services other than those shown in FIG. 1 such as stock price information, trading partner information, customer information and product information may exist in the ASP server group.
  • the speech portal server 50 may manage personal information, and provide services according to personal characteristics.
  • FIG. 2 to FIG. 4 show constitutions of mobile terminals
  • FIG. 5 to FIG. 7 show constitutions of home (stationary) terminals. A primary part of the individual terminals is constituted almost in the same way.
  • FIG. 2 is a block diagram for showing an embodiment of a PDA serving as a speech input terminal of the present invention.
  • the PDA 10 a includes an antenna for communicating with the radio base station 20 , and a communication mean 10 a 2 for the radio communication.
  • the communication mean 10 a 2 can transmit and receive speeches and data simultaneously with a Voice Over IP (VoIP) technology or the like.
  • a processing apparatus and a Web browser 10 a 3 are connected with individual constituting parts and peripherals, and control the entire terminal.
  • the peripherals include a microphone MIC 10 a 4 for speech input, a coordinate input apparatus (tablet) TB 10 a 5 constituted as a touch panel, a liquid crystal display LCD 10 a 6 , and a speaker SP 10 a 7 .
  • the PDA 10 a is provided with a position detecting mean 10 a 8 important for a mobile terminal, and is connected with the GPS (Global Positioning System) 10 a 9 .
  • GPS Global Positioning System
  • the touch panel and a speech can be used for the operation of the PDA 10 a.
  • the processed result is shown on the display, and the PDA 10 a enters a state ready for the next operation.
  • FIG. 3 is a block diagram for showing a constitution of a Mobile TEL serving as a speech input terminal of the present invention.
  • the constituting elements are the same as those for the PDA 10 a in FIG. 2.
  • the size and the color display capability of a liquid crystal display LCD 10 b are generally different for reducing its cost.
  • different types of software for a mobile telephone is added.
  • FIG. 4 is a block diagram for showing a constitution of a Mobile Car PC serving as a speech input terminal of the present invention.
  • the constituting elements are basically the same as those for the PDA 10 a in FIG. 2.
  • a liquid crystal display LCD 10 c 6 suitable for installing on a vehicle and onboard application software are different from the PDA 10 a in FIG. 2.
  • the Mobile Car PC is connected with different onboard sensors, which are not shown in the figure, and may show information on a vehicle.
  • FIG. 5 is a block diagram for showing a constitution of a home telephone serving as a speech input terminal of the present invention.
  • the difference from the PDA 10 a shown in FIG. 2 is that it does not have the antenna 10 a 1 for communicating with the radio base station 20 , the position detecting mean 10 a 8 , and the GPS 10 a 9 .
  • FIG. 6 is a block diagram for showing a constitution of a TV set serving as a speech input terminal of the present invention.
  • the difference from the stationary home telephone 30 a in FIG. 5 includes a television apparatus TV 30 b 10 , a TV set control mean 30 b 8 , and a camera CM 30 c 9 .
  • the TV control mean 30 b 8 is a mean for programming for recoding a TV broadcast program, and setting a channel, and is generally referred as a set top box.
  • the camera CM 30 c 9 is used for transmitting an image for conversation to the other party, and monitoring a room with an image.
  • FIG. 7 is a block diagram for showing a constitution of a PC serving as a speech input terminal of the present invention.
  • the difference from the stationary home telephone 30 a in FIG. 5 is that there is no TV set control mean.
  • the operation for the PC is conducted through a touch panel or a speech.
  • a keyboard suppressed from the drawing may be connected for operating the PC.
  • the camera CM 30 c 9 shown in FIG. 6 and FIG. 7 maybe installed on the speech input terminal in FIG. 2 to FIG. 5.
  • FIG. 8 is a block diagram for showing a constitution of an embodiment of a speech portal server 50 of the present invention.
  • the speech portal server 50 which is a characteristic part of the present invention, comprises a communication mean 501 for communicating with the Internet network 40 , a processing apparatus 502 for processing the entire speech portal server 50 , a speech recognizing mean 503 for receiving speech data Vin, recognizing it with a recognition dictionary 504 , and providing text data Vtext 1 , a command converting mean 505 for using a command text dictionary 506 to convert the recognized speech Vtext 1 into a command and an object Vtext 2 , a conversation control mean 507 for controlling a conversation with the speech input terminal and different information ASP's, a speech synthesizing mean 508 for synthesizing a speech with a speech text Vtext 3 from the conversation control mean, and a Web browser 509 .
  • FIG. 9 is a block diagram for showing a constitution of the speech recognizing mean 503 of the speech portal server 50 of the present invention.
  • the present embodiment features that the speech recognizing mean is provided with two recognizing engines. Namely, the speech recognizing mean 503 comprises a connected speech recognizing engine 503 a for recognizing a relatively long speech, and a word speech recognizing engine 503 b for recognizing a relatively short speech such as a command.
  • the connected speech recognizing engine 503 a uses a connected speech recognition dictionary 504 a for recognizing a speech
  • the work speech recognizing engine 503 b uses a word speech recognition dictionary 504 b for recognizing a speech.
  • a comprehensive recognition evaluating mean 503 c comprehensively evaluates recognition results of the individual recognizing engines.
  • the connected speech recognizing engine uses a recognizing method for using a transition probability model between words, and presents an increased number of recognition errors when a short word such as a command is entered since knowledge on the preceding and the following words is not used.
  • FIG. 10 to FIG. 11 show examples where a speech time is used to switch the recognition results from the two recognizing engines.
  • the comprehensive recognition evaluating mean 503 c compares the speech data Vin with a threshold, and switches to S when Vin short and switches to L when Vin is long in the speech time evaluation.
  • FIG. 10 is a figure for describing an operation of the speech recognizing mean of the speech portal server 50 of the present invention, and shows a state where a speech “ ” with a relatively short speech time is entered.
  • the comprehensive recognition evaluating mean is switched to the S side, and provides an output Vtext 1 of a string “ ”.
  • the maximum speech time from the word speech recognition dictionary is selected for the threshold.
  • FIG. 11 is a figure for describing an operation of the speech recognizing mean of the speech portal server 50 of the present invention, and shows a state where a speech data “ ” with a relatively long speech time is entered.
  • the comprehensive recognition evaluating mean is switched to the L side, and provides an output Vtext 1 of a string “ ”.
  • FIG. 12 to FIG. 13 show examples where a speech time is not evaluated, but the resultant string length from the recognizing engine is compared with a threshold.
  • FIG. 12 is a figure for describing an operation of the speech recognizing mean of the speech portal server 50 of the present invention, and shows a state where a speech “ ” with a relatively short speech time is entered.
  • the comprehensive recognition evaluating mean is switched to the S side, and provides an output Vtext 1 of a string “ ”.
  • FIG. 13 is a figure for describing an operation of the speech recognizing mean of the speech portal server 50 of the present invention, and shows a state where a speech data “ ” with a relatively long speech time is entered.
  • the comprehensive recognition evaluating mean is switched to the L side, and provides an output Vtext 1 of a string “ ”.
  • the threshold is selected to a proper value (example: the maximum length of the command strings)
  • an optimal string is provided, thereby improving the overall recognition capability.
  • FIG. 14 is a block diagram showing a constitution of the command converting mean 505 of the speech portal server 50 of the present invention.
  • a command string search 505 a uses the command text dictionary to determine if a command string is included.
  • FIG. 15 is a figure for showing an example of the speech command text dictionary of the present invention.
  • the command text dictionary 506 includes a command ID and command name 1 to command name 5 , and any commands with the same command ID are treated in the same way.
  • a string “ ” and a string “ ” are determined as an identical command ID, D01.
  • Command text strings in FIG. 15 are roughly classified into commands corresponding to the individual information ASP's (NO 1 to NO 8), commands for speech conversation (NO 9 to NO 10), and commands for screen operations (NO 11 to NO 22).
  • command string search assumes a complete match, it may be designed that the search can be conducted for a case where a partial error is included as described later in FIG. 23 to FIG. 24.
  • Object extraction 505 b for extracting a string of an object other than a command is conducted after the command string search 505 a.
  • This processing is a processing for extracting a command transmitted to the individual APS's, and an object which is a subject of the search.
  • FIG. 16 is a drawing for describing an operation of the command converting mean 505 of the speech portal server 50 of the present invention.
  • the command text search 505 a refers to the command text dictionary 506 , determines that the command string is “ ”, and determines that the command ID is D01.
  • the object extraction 505 b determines that the part other than the command string is an object, and an object “ ” is extracted.
  • FIG. 17 is a block diagram for showing a constitution of a conversation control mean 507 of the speech portal server 50 .
  • the conversation control mean 507 comprises a conversation processing mean 507 a for controlling the entire part, basic conversation rules 507 b for speech conversation, a terminal data control mean 507 c for serving as an interface with the speech input terminal, an ASP control mean 507 d for serving as an interface with the individual information ASP's, and a speech synthesizing control mean 507 e.
  • the basic conversation rules 507 b store rules commonly used among the individual information ASP's, and conversation rules specific to the individual information ASP's are downloaded from the individual information ASP's.
  • the conversation processing mean 507 a receives Vtext 2 of output from the speech recognizing mean 505 , determines a command ID, determines which information ASP it corresponds to, and transmits the command ID and an object as ASPDataOut to the corresponding information ASP.
  • the terminal control 507 c provides the speech input terminal which has requested the search with Tdataout.
  • the speech input terminal shown the data of the search result.
  • the speech synthesizing control mean 507 e provides a speech sequence as Vtext 3 , a speech Vout synthesized by the speech synthesizing mean 508 is transmitted to the speech input terminal, and a speaker provides sounds.
  • TdataIn When there is a data input other than a speech from the speech input terminal, it is received as TdataIn.
  • the conversation control mean 507 may be constituted with a Voice XML browser for speech conversation.
  • FIG. 18 is a block diagram for showing a constitution of a navigation information ASP of the present invention.
  • the navigation information ASP is a provider serving map information and path search information, and comprises an interface 60 a 100 , a fuzzy search mean 60 a 200 , a path search mean 60 a 500 , and a conversation rule processing mean 600 a 700 .
  • the individual means refer to individual dictionaries to process requests.
  • the fuzzy search mean 60 a 200 refers to a landmark DB 60 a 300 , which is a database for landmark information, and a landmark INDEX 60 a 400 dictionary for the fuzzy search. The detailed operation is described later.
  • the path search mean 60 a 500 refers to Map DB 60 a 600 which are map data, and searches a path from a current position to a destination. This path search is a general path search processing, and the detailed description is skipped.
  • the conversation rule processing mean 60 a 700 is a mean for processing conversation rules specific to the individual information ASP's, and the conversation rules 60 b 800 are used as rules other than base conversation rules for the speech portal server 50 .
  • FIG. 19 is a block diagram for showing a constitution of a music information ASP of the present invention.
  • the music information ASP does not include what corresponds to the path search mean, and its contents are a music DB 60 b 300 , a music INDEX 60 b 400 , and conversation rules for music 60 b 800 .
  • FIG. 20 is a block diagram showing a constitution of a TV broadcast program information ASP of the present invention. It differs from the ASP in FIG. 19 in contents. Its contents include a TV broadcast program DB 60 c 300 , a broadcast program INDEX 60 c 300 , a broadcast program INDEX 60 c 400 and rules for broadcast programs 60 c 800 .
  • the TV broadcast programs mean at least one type of information of information on TV broadcast programs, information on CS broadcast programs, and information of CATV broadcast programs in this specification.
  • FIG. 21 is a block diagram for showing a constitution of a telephone information ASP of the present invention. It has contents different from those for the ASP in FIG. 19, and is provided with a telephone DB 60 d 300 , a telephone INDEX 60 d 400 , and conversation rules for telephone 60 d 800 .
  • FIG. 22 shows an example for a speech operation menu screen of the present invention.
  • the speech menu is provided with speech menu icons according to the individual information ASP's.
  • the icons relating to the navigation information ASP includes “ ”, “ ”, “ ”, and “ ”.
  • the icons relating to the music information ASP includes “ ”.
  • the icons relating to the broadcast program ASP includes “ ”, “ ”.
  • the icons relating to the telephone information ASP includes “ ”.
  • the present invention allows a method for entering an item from the speech menu and a method for entering everything including an object. For example, it is possible to enter a speech of “ +Z 903 ” for a destination search without pressing the menu.
  • FIG. 23 is a block diagram for showing a constitution of the fuzzy search mean 60 a 200 for the individual information ASP's of the present invention.
  • the other fuzzy search means 60 b 200 , 60 c 200 , and 60 d 200 have a constitution same as that of the fuzzy search mean 60 a 200 .
  • the fuzzy search mean 60 a 200 comprises a search engine 60 a 100 and two-character INDEX generation 60 a 220 in FIG. 23.
  • the search engine 60 a 100 and the two-character INDEX generation 60 a 220 search while referring to the landmark DB 60 a 300 , and the landmark INDEX 60 a 400 .
  • the present invention features a fast and fuzzy search with this two-character INDEX generation processing.
  • the fuzzy search here does not mean that meaning is fuzzy but that entered words are searched when there is a partial error in a string (a partially added string, a partially missing string, a random string order, and a partial error string).
  • FIG. 24 shows an example of the fuzzy search for the individual information ASP's of the present invention. This example sets a destination to “ ”.
  • the landmark INDEX search 20 a 212 searches the landmark DB, and extracts hit DB records.
  • the extracted records are sorted in the order of the number of hit characters, and an output processing 60 a 214 is conducted, and a list 60 a 200 res is provided as a search result.
  • the present embodiment uses two-character INDEX generation processing for the search as shown in FIG. 23 to FIG. 24, a three-character INDEX, or a four-character INDEX is also applicable.
  • the three-character INDEX generation or the four-character INDEX generation presents less unnecessary search output compared with the two-character INDEX processing.
  • FIG. 25 shows a communication procedure among the speech input terminal, the speech portal server, and the navigation information ASP of the present invention.
  • the communication procedure among the speech input terminal Mobile PC 10 c, the speech portal server 50 , and the navigation information ASP 60 a, and a communication procedure with another information ASP is almost similar.
  • the speech portal server 50 provides the speech input terminal Mobile PC 10 c with a speech output of “ ” through speech. Simultaneously, the speech menu in FIG. 21 is shown.
  • the speech input terminal Mobile PC 10 c conducts a direct speech input of “ ” through speech.
  • the speech portal server 50 recognizes it, and responds to it as “ ” through speech.
  • the speech portal server 50 When “ ” is entered, the speech portal server 50 returns a speech response of “ ” to the speech input terminal Mobile PC 10 c , sends data comprising a command ID “D01” and an object “ ” to the navigation information ASP 60 a , and receives a search result.
  • a search result two hits
  • a content XXX, YYY
  • the speech portal server 50 responds through speech as “ ?” according to the search result. Simultaneously the display of the speech input terminal Mobile PC 10 c shows the content of the search result.
  • an speech instruction “ ” is entered through speech, the speech portal server 50 recognizes the speech, and provides a corresponding speech output of “ ”.
  • the speech portal server 50 receives path information and map information as the search result from the navigation ASP, and provides the speech input terminal Mobile PC 10 c with it, and responds as “ ” through speech.
  • the Mobile PC 10 c is used as the speech input terminal, the PDA 10 a , and the mobile TEL 10 b can communicate with the navigation information ASP in FIG. 25.
  • the navigation system is a human. Since the current position of the own speech input terminal is known, it is possible to shown the current position information and search for a destination landmark.
  • FIG. 26 is a drawing for showing a communication procedure among the speech input terminal, the speech portal server, and the music information ASP. This is a communication procedure where a speech input Mobile PC 10 c receives a music content service from the music information ASP 60 b through the speech portal server 50 .
  • the speech portal server 50 provides the speech input terminal Mobile PC 10 c with a speech output of “ ” through speech. Simultaneously, the speech menu in FIG. 21 is shown.
  • the speech input terminal Mobile PC 10 c conducts a direct speech input of “Mariah Carey ” through speech.
  • the speech portal server 50 recognizes it, and responds to it as “Mariah Carey ?” through speech.
  • the speech portal server 50 When “ ” is entered, the speech portal server 50 returns a speech response of “ ” to the speech input terminal Mobile PC l 0 c , sends data comprising a command ID “M01” and an object “Mariah Carey ” to the music information ASP 60 b , and receives a search result.
  • a search result three hits
  • a content XXX, YYY, ZZZ
  • the speech portal server 50 responds through speech as “ ?” according to the search result. Simultaneously the display of the speech input terminal Mobile PC 10 c shows the content of the search result.
  • an speech instruction “ ” is entered through speech, the speech portal server 50 recognizes the speech, and provides a corresponding speech output of “ ”. Simultaneously, the music information ASP is instructed to download the third music tune.
  • FIG. 27 shows a communication procedure among the speech input terminal, the speech portal server, and the TV broadcast program information ASP of the present invention. This is a communication procedure where a speech input terminal TV 30 b and a PC 30 C receive a TV broadcast program content service from the broadcast program information ASP 60 c through the speech portal server 50 .
  • the speech portal server 50 provides the speech input terminal with a speech output of “ ” through speech. Simultaneously, the speech menu in FIG. 21 is shown.
  • the speech input terminal conducts a direct speech input of “ ” through speech.
  • the speech portal server 50 recognizes it, and responds to it as “ ” through speech.
  • the speech portal server 50 When “ ” is entered, the speech portal server 50 returns a speech response of “ ” to the speech input terminal, sends data comprising a command ID “T01” and an object “ ” to the broadcast program information ASP 60 c, and receives a search result.
  • the speech portal server 50 responds through speech as “ ” according to the search result. Simultaneously the display of the speech input terminal shows the content of the search result.
  • a channel can be programmed.
  • the speech portal server 50 provides a guidance asking if programming is conducted or not, and the programming ends when it is responded.
  • FIG. 28 shows a communication procedure among the speech input terminal, the speech portal server, and the telephone information ASP of the present invention. This is a communication procedure where a speech input terminal home telephone 30 a and a Mobile TEL 10 b receive a telephone information content service from the telephone information ASP 60 d through the speech portal server 50 .
  • the speech portal server 50 provides the speech input terminal with a speech output of “ ” through speech. Simultaneously, the speech menu in FIG. 21 is shown.
  • the speech input terminal conducts a direct speech input of “ ” through speech.
  • the speech portal server 50 recognizes it, and responds to it as “ ” through speech.
  • the speech portal server 50 When “ ” is entered, the speech portal server 50 returns a speech response of “ ” to the speech input terminal, sends data comprising a command ID “P01” and an object “ ” to the telephone information ASP 60 d , and receives a search result.
  • the speech portal server 50 responds through speech as “ ” according to the search result. Simultaneously the display of the speech input terminal shows the content of the search result.
  • an speech instruction “ ” is entered through speech, the speech portal server 50 recognizes the speech, and provides a corresponding speech output of “ ”.
  • a speech portal server recognizes a speech entered from a speech input terminal, the speech is separated into a command text and an object text, information stored in an application service provider is searched with fuzziness based on the separated texts, and an intended information is provided for the speech input terminal even if there is a partial error in the object text.
  • a speech recognizing engine of the speech portal server is constituted such that it comprises two speech recognizing engines of a connected speech recognizing engine suitable for a long sentence, and a word speech recognizing engine for a short sentence such as a command for comprehensive evaluation,the recognition capability for speech conversation increases.
  • a navigation information ASP a music information ASP, a broadcast program information ASP, and a telephone information ASP are provided as application service providers (ASP's)
  • mobile speech input terminals such as a PDA, a Mobile TEL, and a Mobile Car PC
  • home speech input terminals such as a home telephone, a TV set, and a PC can receive optimal information according to their individual requirement.
US10/083,636 2001-10-02 2002-02-27 Speech input system, speech portal server, and speech input terminal Abandoned US20030074199A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US10/192,317 US6944593B2 (en) 2001-10-02 2002-07-11 Speech input system, speech portal server, and speech input terminal
US10/823,552 US7058579B2 (en) 2001-10-02 2004-04-14 Speech input system, speech portal server, and speech input terminal
US11/060,390 US7299186B2 (en) 2001-10-02 2005-02-17 Speech input system, speech portal server, and speech input terminal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2001-306787 2001-10-02
JP2001306787A JP3997459B2 (ja) 2001-10-02 2001-10-02 音声入力システムおよび音声ポータルサーバおよび音声入力端末

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/192,317 Continuation US6944593B2 (en) 2001-10-02 2002-07-11 Speech input system, speech portal server, and speech input terminal

Publications (1)

Publication Number Publication Date
US20030074199A1 true US20030074199A1 (en) 2003-04-17

Family

ID=19126369

Family Applications (4)

Application Number Title Priority Date Filing Date
US10/083,636 Abandoned US20030074199A1 (en) 2001-10-02 2002-02-27 Speech input system, speech portal server, and speech input terminal
US10/192,317 Expired - Lifetime US6944593B2 (en) 2001-10-02 2002-07-11 Speech input system, speech portal server, and speech input terminal
US10/823,552 Expired - Lifetime US7058579B2 (en) 2001-10-02 2004-04-14 Speech input system, speech portal server, and speech input terminal
US11/060,390 Expired - Lifetime US7299186B2 (en) 2001-10-02 2005-02-17 Speech input system, speech portal server, and speech input terminal

Family Applications After (3)

Application Number Title Priority Date Filing Date
US10/192,317 Expired - Lifetime US6944593B2 (en) 2001-10-02 2002-07-11 Speech input system, speech portal server, and speech input terminal
US10/823,552 Expired - Lifetime US7058579B2 (en) 2001-10-02 2004-04-14 Speech input system, speech portal server, and speech input terminal
US11/060,390 Expired - Lifetime US7299186B2 (en) 2001-10-02 2005-02-17 Speech input system, speech portal server, and speech input terminal

Country Status (3)

Country Link
US (4) US20030074199A1 (US20030074199A1-20030417-P00947.png)
EP (1) EP1300828A3 (US20030074199A1-20030417-P00947.png)
JP (1) JP3997459B2 (US20030074199A1-20030417-P00947.png)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050033585A1 (en) * 2002-06-13 2005-02-10 Shields Paul William Semiconductor chip for a mobile telephone which includes a text to speech system, a method of aurally presenting information from a mobile telephone and a mobile telephone
US20090271193A1 (en) * 2008-04-23 2009-10-29 Kohtaroh Miyamoto Support device, program and support method
US20120271639A1 (en) * 2011-04-20 2012-10-25 International Business Machines Corporation Permitting automated speech command discovery via manual event to command mapping
US20130041666A1 (en) * 2011-08-08 2013-02-14 Samsung Electronics Co., Ltd. Voice recognition apparatus, voice recognition server, voice recognition system and voice recognition method
US20130185072A1 (en) * 2010-06-24 2013-07-18 Honda Motor Co., Ltd. Communication System and Method Between an On-Vehicle Voice Recognition System and an Off-Vehicle Voice Recognition System
CN103414934A (zh) * 2013-07-16 2013-11-27 深圳Tcl新技术有限公司 终端显示电视节目信息的方法和系统
US20140013249A1 (en) * 2012-07-06 2014-01-09 Shahram Moeinifar Conversation management systems and methods
US9390716B2 (en) 2013-04-19 2016-07-12 Panasonic Intellectual Property Corporation Of America Control method for household electrical appliance, household electrical appliance control system, and gateway
US9396737B2 (en) 2013-01-07 2016-07-19 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the display apparatus
CN106331874A (zh) * 2016-08-31 2017-01-11 浙江创佳数字技术有限公司 机顶盒的控制方法及设备
US9880808B2 (en) 2013-01-07 2018-01-30 Samsung Electronics Co., Ltd. Display apparatus and method of controlling a display apparatus in a voice recognition system

Families Citing this family (232)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US7904187B2 (en) 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US7024209B1 (en) * 2000-12-20 2006-04-04 Cisco Technology, Inc. Unified messaging system configured for management of short message service-type messages
JP3722359B2 (ja) * 2001-06-29 2005-11-30 Ｅｓｍｅｒｔｅｃエンジニアリングサービス株式会社 文字入力システム及び通信端末
JP3997459B2 (ja) * 2001-10-02 2007-10-24 株式会社日立製作所 音声入力システムおよび音声ポータルサーバおよび音声入力端末
US7398209B2 (en) 2002-06-03 2008-07-08 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
US7693720B2 (en) * 2002-07-15 2010-04-06 Voicebox Technologies, Inc. Mobile systems and methods for responding to natural language speech utterance
US7158779B2 (en) * 2003-11-11 2007-01-02 Microsoft Corporation Sequential multimodal input
US8442331B2 (en) 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US10635723B2 (en) 2004-02-15 2020-04-28 Google Llc Search engines and systems with handheld document data capture devices
US7812860B2 (en) 2004-04-01 2010-10-12 Exbiblio B.V. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US7983835B2 (en) 2004-11-03 2011-07-19 Lagassey Paul J Modular intelligent transportation system
US8954325B1 (en) * 2004-03-22 2015-02-10 Rockstar Consortium Us Lp Speech recognition in automated information services systems
US8081849B2 (en) 2004-12-03 2011-12-20 Google Inc. Portable scanning and memory device
US20060098900A1 (en) 2004-09-27 2006-05-11 King Martin T Secure data gathering from rendered documents
US9116890B2 (en) 2004-04-01 2015-08-25 Google Inc. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US9143638B2 (en) 2004-04-01 2015-09-22 Google Inc. Data capture from rendered documents using handheld device
US9008447B2 (en) 2004-04-01 2015-04-14 Google Inc. Method and system for character recognition
US7990556B2 (en) 2004-12-03 2011-08-02 Google Inc. Association of a portable scanner with input/output and storage devices
US8146156B2 (en) 2004-04-01 2012-03-27 Google Inc. Archive of text captures from rendered documents
US20060081714A1 (en) 2004-08-23 2006-04-20 King Martin T Portable scanning device
US7894670B2 (en) 2004-04-01 2011-02-22 Exbiblio B.V. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US8713418B2 (en) 2004-04-12 2014-04-29 Google Inc. Adding value to a rendered document
US8874504B2 (en) 2004-12-03 2014-10-28 Google Inc. Processing techniques for visual capture data from a rendered document
US8489624B2 (en) 2004-05-17 2013-07-16 Google, Inc. Processing techniques for text capture from a rendered document
US8620083B2 (en) 2004-12-03 2013-12-31 Google Inc. Method and system for character recognition
FR2871978B1 (fr) * 2004-06-16 2006-09-22 Alcatel Sa Procede de traitement de signaux sonores pour un terminal de communication et terminal de communication mettant en oeuvre ce procede
US8346620B2 (en) 2004-07-19 2013-01-01 Google Inc. Automatic modification of web pages
US7580837B2 (en) 2004-08-12 2009-08-25 At&T Intellectual Property I, L.P. System and method for targeted tuning module of a speech recognition system
US7242751B2 (en) 2004-12-06 2007-07-10 Sbc Knowledge Ventures, L.P. System and method for speech recognition-enabled automatic call routing
US7751551B2 (en) 2005-01-10 2010-07-06 At&T Intellectual Property I, L.P. System and method for speech-enabled call routing
US7627096B2 (en) * 2005-01-14 2009-12-01 At&T Intellectual Property I, L.P. System and method for independently recognizing and selecting actions and objects in a speech recognition system
US7529677B1 (en) 2005-01-21 2009-05-05 Itt Manufacturing Enterprises, Inc. Methods and apparatus for remotely processing locally generated commands to control a local device
US8225232B2 (en) * 2005-02-28 2012-07-17 Microsoft Corporation Dynamic configuration of unified messaging state changes
US7657020B2 (en) 2005-06-03 2010-02-02 At&T Intellectual Property I, Lp Call routing system and method of using the same
US7640160B2 (en) 2005-08-05 2009-12-29 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
JP5394738B2 (ja) * 2005-08-09 2014-01-22 モバイル・ヴォイス・コントロール・エルエルシー 音声制御型ワイヤレス通信デバイス・システム
US7620549B2 (en) 2005-08-10 2009-11-17 Voicebox Technologies, Inc. System and method of supporting adaptive misrecognition in conversational speech
US7949529B2 (en) 2005-08-29 2011-05-24 Voicebox Technologies, Inc. Mobile systems and methods of supporting natural language human-machine interactions
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8635073B2 (en) * 2005-09-14 2014-01-21 At&T Intellectual Property I, L.P. Wireless multimodal voice browser for wireline-based IPTV services
WO2007070842A2 (en) * 2005-12-15 2007-06-21 Josef Berger System and methods for initiating, maintaining, and delivering personalized information by communication server
US7620553B2 (en) * 2005-12-20 2009-11-17 Storz Endoskop Produktions Gmbh Simultaneous support of isolated and connected phrase command recognition in automatic speech recognition systems
US7996228B2 (en) * 2005-12-22 2011-08-09 Microsoft Corporation Voice initiated network operations
US7634263B2 (en) * 2006-01-30 2009-12-15 Apple Inc. Remote control of electronic devices
JP2007226649A (ja) * 2006-02-24 2007-09-06 Kenwood Corp 検索装置及びプログラム
US7698140B2 (en) * 2006-03-06 2010-04-13 Foneweb, Inc. Message transcription, voice query and query delivery system
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
EP2067119A2 (en) 2006-09-08 2009-06-10 Exbiblio B.V. Optical scanners, such as hand-held optical scanners
US8073681B2 (en) 2006-10-16 2011-12-06 Voicebox Technologies, Inc. System and method for a cooperative conversational voice user interface
KR100837542B1 (ko) * 2006-10-27 2008-06-12 주식회사 케이티 정보 통신망을 이용한 음악 콘텐츠 제공 방법 및 그 시스템
US7818176B2 (en) 2007-02-06 2010-10-19 Voicebox Technologies, Inc. System and method for selecting and presenting advertisements based on natural language processing of voice-based input
JP5233989B2 (ja) * 2007-03-14 2013-07-10 日本電気株式会社 音声認識システム、音声認識方法、および音声認識処理プログラム
US8650030B2 (en) 2007-04-02 2014-02-11 Google Inc. Location based responses to telephone requests
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8032383B1 (en) * 2007-05-04 2011-10-04 Foneweb, Inc. Speech controlled services and devices using internet
US8165886B1 (en) * 2007-10-04 2012-04-24 Great Northern Research LLC Speech interface system and method for control and interaction with applications on a computing system
US8595642B1 (en) 2007-10-04 2013-11-26 Great Northern Research, LLC Multiple shell multi faceted graphical user interface
US8140335B2 (en) 2007-12-11 2012-03-20 Voicebox Technologies, Inc. System and method for providing a natural language voice user interface in an integrated voice navigation services environment
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US20090234655A1 (en) * 2008-03-13 2009-09-17 Jason Kwon Mobile electronic device with active speech recognition
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8589161B2 (en) 2008-05-27 2013-11-19 Voicebox Technologies, Inc. System and method for an integrated, multi-modal, multi-device natural language voice services environment
US9305548B2 (en) 2008-05-27 2016-04-05 Voicebox Technologies Corporation System and method for an integrated, multi-modal, multi-device natural language voice services environment
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
JP2010048953A (ja) * 2008-08-20 2010-03-04 Toshiba Corp 対話文生成装置
JP5049934B2 (ja) * 2008-09-22 2012-10-17 株式会社東芝 対話文生成装置及び方法
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
US8340974B2 (en) * 2008-12-30 2012-12-25 Motorola Mobility Llc Device, system and method for providing targeted advertisements and content based on user speech data
CN105930311B (zh) 2009-02-18 2018-10-09 谷歌有限责任公司 执行与再现文档关联的动作的方法、移动设备和可读介质
US8326637B2 (en) 2009-02-20 2012-12-04 Voicebox Technologies, Inc. System and method for processing multi-modal device interactions in a natural language voice services environment
WO2010105245A2 (en) 2009-03-12 2010-09-16 Exbiblio B.V. Automatically providing content associated with captured information, such as information captured in real-time
US8447066B2 (en) 2009-03-12 2013-05-21 Google Inc. Performing actions based on capturing information from rendered documents, such as documents under copyright
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US20110099507A1 (en) 2009-10-28 2011-04-28 Google Inc. Displaying a collection of interactive elements that trigger actions directed to an item
US20110106783A1 (en) * 2009-11-03 2011-05-05 Kalbhavi Srinivas Mobile search with a landmark
US9502025B2 (en) 2009-11-10 2016-11-22 Voicebox Technologies Corporation System and method for providing a natural language content dedication service
US9171541B2 (en) 2009-11-10 2015-10-27 Voicebox Technologies Corporation System and method for hybrid processing in a natural language voice services environment
US8379801B2 (en) 2009-11-24 2013-02-19 Sorenson Communications, Inc. Methods and systems related to text caption error correction
US20110131040A1 (en) * 2009-12-01 2011-06-02 Honda Motor Co., Ltd Multi-mode speech recognition
US9081799B2 (en) 2009-12-04 2015-07-14 Google Inc. Using gestalt information to identify locations in printed information
US9323784B2 (en) 2009-12-09 2016-04-26 Google Inc. Image search using text-based elements within the contents of images
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US8626511B2 (en) * 2010-01-22 2014-01-07 Google Inc. Multi-dimensional disambiguation of voice commands
US8977584B2 (en) 2010-01-25 2015-03-10 Newvaluexchange Global Ai Llp Apparatuses, methods and systems for a digital conversation management platform
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US8521513B2 (en) 2010-03-12 2013-08-27 Microsoft Corporation Localization for interactive voice response systems
US8738377B2 (en) 2010-06-07 2014-05-27 Google Inc. Predicting and learning carrier phrases for speech input
US9015043B2 (en) * 2010-10-01 2015-04-21 Google Inc. Choosing recognized text from a background environment
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
KR101776673B1 (ko) * 2011-01-11 2017-09-11 삼성전자주식회사 자연어 처리용 문법 자동 생성 장치 및 방법
US10382509B2 (en) * 2011-01-28 2019-08-13 Amazon Technologies, Inc. Audio-based application architecture
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
JP5658641B2 (ja) * 2011-09-15 2015-01-28 株式会社Ｎｔｔドコモ 端末装置、音声認識プログラム、音声認識方法および音声認識システム
US20130069962A1 (en) * 2011-09-15 2013-03-21 Microsoft Corporation Active Lock Wallpapers
KR101294553B1 (ko) * 2011-10-13 2013-08-07 기아자동차주식회사 음원정보 관리 서비스 시스템
JP5887162B2 (ja) * 2012-02-23 2016-03-16 株式会社Ｎｔｔドコモ 通信端末、制御方法及びプログラム
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9317605B1 (en) 2012-03-21 2016-04-19 Google Inc. Presenting forked auto-completions
KR20130125067A (ko) * 2012-05-08 2013-11-18 삼성전자주식회사 전자 장치 및 그의 제어 방법
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9031848B2 (en) 2012-08-16 2015-05-12 Nuance Communications, Inc. User interface for searching a bundled service content data source
US9106957B2 (en) * 2012-08-16 2015-08-11 Nuance Communications, Inc. Method and apparatus for searching data sources for entertainment systems
US9026448B2 (en) 2012-08-16 2015-05-05 Nuance Communications, Inc. User interface for entertainment systems
US9497515B2 (en) 2012-08-16 2016-11-15 Nuance Communications, Inc. User interface for entertainment systems
US8799959B2 (en) 2012-08-16 2014-08-05 Hoi L. Young User interface for entertainment systems
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
KR20140093303A (ko) * 2013-01-07 2014-07-28 삼성전자주식회사 디스플레이 장치 및 그의 제어 방법
KR20140089862A (ko) * 2013-01-07 2014-07-16 삼성전자주식회사 디스플레이 장치 및 그의 제어 방법
EP2954514B1 (en) 2013-02-07 2021-03-31 Apple Inc. Voice trigger for a digital assistant
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US9123345B2 (en) 2013-03-14 2015-09-01 Honda Motor Co., Ltd. Voice interface systems and methods
AU2014233517B2 (en) 2013-03-15 2017-05-25 Apple Inc. Training an at least partial voice command system
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
WO2014200728A1 (en) 2013-06-09 2014-12-18 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
AU2014278595B2 (en) 2013-06-13 2017-04-06 Apple Inc. System and method for emergency calls initiated by voice command
US9646606B2 (en) 2013-07-03 2017-05-09 Google Inc. Speech recognition using domain knowledge
KR101749009B1 (ko) 2013-08-06 2017-06-19 애플 인크. 원격 디바이스로부터의 활동에 기초한 스마트 응답의 자동 활성화
JP6312053B2 (ja) * 2013-09-06 2018-04-18 株式会社ユピテル システム及びプログラム
US20150081495A1 (en) * 2013-09-19 2015-03-19 Barclays Bank Plc System and Method for Account Succession
US9245527B2 (en) 2013-10-11 2016-01-26 Apple Inc. Speech recognition wake-up of a handheld portable electronic device
JP6315942B2 (ja) * 2013-11-01 2018-04-25 株式会社ユピテル システム及びプログラム
JP6670364B2 (ja) * 2014-05-13 2020-03-18 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 音声認識機能を用いた情報提供方法および機器の制御方法
JP6440513B2 (ja) * 2014-05-13 2018-12-19 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 音声認識機能を用いた情報提供方法および機器の制御方法
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9966065B2 (en) 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9626703B2 (en) 2014-09-16 2017-04-18 Voicebox Technologies Corporation Voice commerce
US9898459B2 (en) 2014-09-16 2018-02-20 Voicebox Technologies Corporation Integration of domain information into state transitions of a finite state transducer for natural language processing
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
EP3207467A4 (en) 2014-10-15 2018-05-23 VoiceBox Technologies Corporation System and method for providing follow-up responses to prior natural language inputs of a user
US10614799B2 (en) 2014-11-26 2020-04-07 Voicebox Technologies Corporation System and method of providing intent predictions for an utterance prior to a system detection of an end of the utterance
US10431214B2 (en) 2014-11-26 2019-10-01 Voicebox Technologies Corporation System and method of determining a domain and/or an action related to a natural language input
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US10331784B2 (en) 2016-07-29 2019-06-25 Voicebox Technologies Corporation System and method of disambiguating natural language processing requests
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10950235B2 (en) * 2016-09-29 2021-03-16 Nec Corporation Information processing device, information processing method and program recording medium
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
JP2017182075A (ja) * 2017-05-01 2017-10-05 株式会社ニコン 情報処理装置
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
KR102045539B1 (ko) * 2017-05-12 2019-11-15 삼성전자주식회사 디스플레이 장치, 및 이의 제어 방법, 그리고 음성 인식 시스템의 디스플레이 장치 제어 방법
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US11423879B2 (en) * 2017-07-18 2022-08-23 Disney Enterprises, Inc. Verbal cues for high-speed control of a voice-enabled device
KR102374910B1 (ko) * 2017-08-22 2022-03-16 삼성전자주식회사 음성 데이터 처리 방법 및 이를 지원하는 전자 장치
KR102051480B1 (ko) * 2018-04-26 2019-12-03 삼성전자주식회사 디스플레이 장치, 및 이의 제어 방법, 그리고 음성 인식 시스템의 디스플레이 장치 제어 방법
US20220293106A1 (en) * 2019-09-24 2022-09-15 Lg Electronics Inc. Artificial intelligence server and operation method thereof
KR102089593B1 (ko) * 2019-11-11 2020-03-16 삼성전자주식회사 디스플레이 장치, 및 이의 제어 방법, 그리고 음성 인식 시스템의 디스플레이 장치 제어 방법
KR102124396B1 (ko) * 2020-03-10 2020-06-18 삼성전자주식회사 디스플레이 장치, 및 이의 제어 방법, 그리고 음성 인식 시스템의 디스플레이 장치 제어 방법

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5752232A (en) * 1994-11-14 1998-05-12 Lucent Technologies Inc. Voice activated device and method for providing access to remotely retrieved data
US5799279A (en) * 1995-11-13 1998-08-25 Dragon Systems, Inc. Continuous speech recognition of text and commands
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
US6044347A (en) * 1997-08-05 2000-03-28 Lucent Technologies Inc. Methods and apparatus object-oriented rule-based dialogue management
US6401068B1 (en) * 1999-06-17 2002-06-04 Navigation Technologies Corp. Method and system using voice commands for collecting data for a geographic database
US6434529B1 (en) * 2000-02-16 2002-08-13 Sun Microsystems, Inc. System and method for referencing object instances and invoking methods on those object instances from within a speech recognition grammar
US6473734B1 (en) * 2000-03-27 2002-10-29 Motorola, Inc. Methodology for the use of verbal proxies for dynamic vocabulary additions in speech interfaces

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2955297B2 (ja) * 1988-05-27 1999-10-04 株式会社東芝 音声認識システム
JPH06133039A (ja) 1992-10-16 1994-05-13 Oki Electric Ind Co Ltd 気象情報自動案内装置
JPH06212478A (ja) 1993-01-14 1994-08-02 Olympus Optical Co Ltd 電鋳型の製造方法
JP3526101B2 (ja) 1995-03-14 2004-05-10 株式会社リコー 音声認識装置
JP3284832B2 (ja) * 1995-06-22 2002-05-20 セイコーエプソン株式会社 音声認識対話処理方法および音声認識対話装置
TW490643B (en) * 1996-05-21 2002-06-11 Hitachi Ltd Estimated recognition device for input character string
US5960399A (en) * 1996-12-24 1999-09-28 Gte Internetworking Incorporated Client/server speech processor/recognizer
US6856960B1 (en) * 1997-04-14 2005-02-15 At & T Corp. System and method for providing remote automatic speech recognition and text-to-speech services via a packet network
JP3088364B2 (ja) 1997-11-05 2000-09-18 株式会社エイ・ティ・アール音声翻訳通信研究所 音声言語理解装置及び音声言語理解システム
US6144989A (en) * 1998-06-15 2000-11-07 Dejima, Inc. Adaptive agent-oriented software architecture
JP2000057490A (ja) 1998-08-06 2000-02-25 Fujitsu Ten Ltd ナビゲーション装置
EP1133734A4 (en) * 1998-10-02 2005-12-14 Ibm INTERACTIVE NAVIGATOR AND INTERACTIVE SYSTEMS
US6587822B2 (en) 1998-10-06 2003-07-01 Lucent Technologies Inc. Web-based platform for interactive voice response (IVR)
JP2001034292A (ja) 1999-07-26 2001-02-09 Denso Corp 単語列認識装置
JP2000224338A (ja) 1999-01-28 2000-08-11 Alpine Electronics Inc 車載用通信装置
JP2000259183A (ja) 1999-03-10 2000-09-22 Sony Corp 情報提供システム、クライアント、情報提供サーバ及び情報提供方法
US6338082B1 (en) * 1999-03-22 2002-01-08 Eric Schneider Method, product, and apparatus for requesting a network resource
US6327566B1 (en) * 1999-06-16 2001-12-04 International Business Machines Corporation Method and apparatus for correcting misinterpreted voice commands in a speech recognition system
US6601026B2 (en) * 1999-09-17 2003-07-29 Discern Communications, Inc. Information retrieval by natural language querying
US6356868B1 (en) * 1999-10-25 2002-03-12 Comverse Network Systems, Inc. Voiceprint identification system
US6922670B2 (en) * 2000-10-24 2005-07-26 Sanyo Electric Co., Ltd. User support apparatus and system using agents
JP3997459B2 (ja) * 2001-10-02 2007-10-24 株式会社日立製作所 音声入力システムおよび音声ポータルサーバおよび音声入力端末

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5752232A (en) * 1994-11-14 1998-05-12 Lucent Technologies Inc. Voice activated device and method for providing access to remotely retrieved data
US5799279A (en) * 1995-11-13 1998-08-25 Dragon Systems, Inc. Continuous speech recognition of text and commands
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
US6044347A (en) * 1997-08-05 2000-03-28 Lucent Technologies Inc. Methods and apparatus object-oriented rule-based dialogue management
US6401068B1 (en) * 1999-06-17 2002-06-04 Navigation Technologies Corp. Method and system using voice commands for collecting data for a geographic database
US6434529B1 (en) * 2000-02-16 2002-08-13 Sun Microsystems, Inc. System and method for referencing object instances and invoking methods on those object instances from within a speech recognition grammar
US6473734B1 (en) * 2000-03-27 2002-10-29 Motorola, Inc. Methodology for the use of verbal proxies for dynamic vocabulary additions in speech interfaces

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050033585A1 (en) * 2002-06-13 2005-02-10 Shields Paul William Semiconductor chip for a mobile telephone which includes a text to speech system, a method of aurally presenting information from a mobile telephone and a mobile telephone
US20090271193A1 (en) * 2008-04-23 2009-10-29 Kohtaroh Miyamoto Support device, program and support method
US8275614B2 (en) * 2008-04-23 2012-09-25 International Business Machines Corporation Support device, program and support method
US9620121B2 (en) 2010-06-24 2017-04-11 Honda Motor Co., Ltd. Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system
US9564132B2 (en) 2010-06-24 2017-02-07 Honda Motor Co., Ltd. Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system
US20130185072A1 (en) * 2010-06-24 2013-07-18 Honda Motor Co., Ltd. Communication System and Method Between an On-Vehicle Voice Recognition System and an Off-Vehicle Voice Recognition System
US10818286B2 (en) 2010-06-24 2020-10-27 Honda Motor Co., Ltd. Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system
US9263058B2 (en) * 2010-06-24 2016-02-16 Honda Motor Co., Ltd. Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system
US10269348B2 (en) 2010-06-24 2019-04-23 Honda Motor Co., Ltd. Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system
US9368107B2 (en) * 2011-04-20 2016-06-14 Nuance Communications, Inc. Permitting automated speech command discovery via manual event to command mapping
US20120271639A1 (en) * 2011-04-20 2012-10-25 International Business Machines Corporation Permitting automated speech command discovery via manual event to command mapping
US20130041666A1 (en) * 2011-08-08 2013-02-14 Samsung Electronics Co., Ltd. Voice recognition apparatus, voice recognition server, voice recognition system and voice recognition method
US20140013249A1 (en) * 2012-07-06 2014-01-09 Shahram Moeinifar Conversation management systems and methods
US9520133B2 (en) 2013-01-07 2016-12-13 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the display apparatus
US9396737B2 (en) 2013-01-07 2016-07-19 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the display apparatus
US9880808B2 (en) 2013-01-07 2018-01-30 Samsung Electronics Co., Ltd. Display apparatus and method of controlling a display apparatus in a voice recognition system
US9390716B2 (en) 2013-04-19 2016-07-12 Panasonic Intellectual Property Corporation Of America Control method for household electrical appliance, household electrical appliance control system, and gateway
USRE48569E1 (en) 2013-04-19 2021-05-25 Panasonic Intellectual Property Corporation Of America Control method for household electrical appliance, household electrical appliance control system, and gateway
CN103414934A (zh) * 2013-07-16 2013-11-27 深圳Tcl新技术有限公司 终端显示电视节目信息的方法和系统
CN106331874A (zh) * 2016-08-31 2017-01-11 浙江创佳数字技术有限公司 机顶盒的控制方法及设备

Also Published As

Publication number Publication date
EP1300828A3 (en) 2006-06-07
EP1300828A2 (en) 2003-04-09
US20050149332A1 (en) 2005-07-07
JP3997459B2 (ja) 2007-10-24
US20040199394A1 (en) 2004-10-07
US7299186B2 (en) 2007-11-20
US6944593B2 (en) 2005-09-13
JP2003115929A (ja) 2003-04-18
US7058579B2 (en) 2006-06-06
US20030074200A1 (en) 2003-04-17

Similar Documents

Publication Publication Date Title
US7058579B2 (en) Speech input system, speech portal server, and speech input terminal
KR101351992B1 (ko) 비표준화된 위치기반의 텍스트 입력
US8880405B2 (en) Application text entry in a mobile environment using a speech processing facility
US20020091527A1 (en) Distributed speech recognition server system for mobile internet/intranet communication
US20080221880A1 (en) Mobile music environment speech processing facility
US20090030687A1 (en) Adapting an unstructured language model speech recognition system based on usage
US20080312934A1 (en) Using results of unstructured language model based speech recognition to perform an action on a mobile communications facility
US20090030685A1 (en) Using speech recognition results based on an unstructured language model with a navigation system
US20020010000A1 (en) Knowledge-based information retrieval system and method for wireless communication device
US20100106497A1 (en) Internal and external speech recognition use with a mobile communication facility
US20080134038A1 (en) Interactive information providing service method and apparatus
KR100881334B1 (ko) 대화형 정보 제공 서비스 장치 및 방법
US20040122817A1 (en) Systems and methods for associating system entities with descriptions
JP2002123283A (ja) 音声認識操作装置
JP2002099531A (ja) 単語登録システム、これに用いられる単語登録装置及び単語送信装置並びに単語登録方法
KR20020076891A (ko) 무선인터넷 접속시스템
EP1376418B1 (en) Service mediating apparatus
US7062297B2 (en) Method and system for accessing a network using voice recognition
US20020077814A1 (en) Voice recognition system method and apparatus
KR20040042927A (ko) 단문 메시지 서비스를 이용한 정보 검색 서비스 시스템 및그 방법
KR100644027B1 (ko) 텍스트 기반의 음성정보 서비스 제공 시스템
KR100523289B1 (ko) 대화형 인터페이스를 이용한 사용자 정황 분석방법
KR20020072922A (ko) 카테고리 서비스를 이용한 무선 인터넷 서비스 제공시스템 및 그 방법
KR100432373B1 (ko) 독립적 음성처리를 위한 음성인식 시스템
EP0986013A2 (en) Information retrieval system

Legal Events

Date Code Title Description
AS Assignment

Owner name: HITACHI, LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KUZUNUKI, SOSHIRO;OHTSUJI, SHINYA;MORIOKA, MICHIO;AND OTHERS;REEL/FRAME:012923/0051;SIGNING DATES FROM 20020213 TO 20020214

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION