US20160026433A1 - Speech recognition interface for voice actuation of legacy systems - Google Patents

Speech recognition interface for voice actuation of legacy systems Download PDF

Info

Publication number
US20160026433A1
US20160026433A1 US14/873,637 US201514873637A US2016026433A1 US 20160026433 A1 US20160026433 A1 US 20160026433A1 US 201514873637 A US201514873637 A US 201514873637A US 2016026433 A1 US2016026433 A1 US 2016026433A1
Authority
US
United States
Prior art keywords
plurality
operations
legacy
computer
system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US14/873,637
Inventor
Steven G. Smith
Ralph J. Mills
Roland T. Morton, Jr.
Mitchell E. Davis
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nuance Communications Inc
Original Assignee
AT&T Intellectual Property I LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US09/892,664 priority Critical patent/US7606712B1/en
Priority to US12/571,779 priority patent/US9152375B2/en
Application filed by AT&T Intellectual Property I LP filed Critical AT&T Intellectual Property I LP
Priority to US14/873,637 priority patent/US20160026433A1/en
Assigned to BELLSOUTH INTELLECTUAL PROPERTY CORPORATION reassignment BELLSOUTH INTELLECTUAL PROPERTY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DAVIS, MITCHELL E., MILLS, RALPH J., SMITH, STEVEN G., MORTON, ROLAND T., JR.
Assigned to AT&T INTELLECTUAL PROPERTY I, L.P. reassignment AT&T INTELLECTUAL PROPERTY I, L.P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AT&T DELAWARE INTELLECTUAL PROPERTY, INC.
Assigned to AT&T INTELLECTUAL PROPERTY, INC. reassignment AT&T INTELLECTUAL PROPERTY, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: BELLSOUTH INTELLECTUAL PROPERTY CORPORATION
Assigned to AT&T BLS INTELLECTUAL PROPERTY, INC. reassignment AT&T BLS INTELLECTUAL PROPERTY, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: AT&T INTELLECTUAL PROPERTY, INC.
Assigned to AT&T DELAWARE INTELLECTUAL PROPERTY, INC. reassignment AT&T DELAWARE INTELLECTUAL PROPERTY, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: AT&T BLS INTELLECTUAL PROPERTY, INC.
Publication of US20160026433A1 publication Critical patent/US20160026433A1/en
Assigned to NUANCE COMMUNICATIONS, INC. reassignment NUANCE COMMUNICATIONS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AT&T INTELLECTUAL PROPERTY I, L.P.
Application status is Pending legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems
    • G10L15/30Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Abstract

Methods and apparatus are disclosed for a technician to access a systems interface to back-end legacy systems by voice input commands to a speech recognition module. Generally, a user logs a computer into a systems interface which permits access to back-end legacy systems. Preferably, the systems interface includes a first server with middleware for managing the protocol interface. Preferably, the systems interface includes a second server for receiving requests and generating legacy transactions. After the computer is logged-on, a request for voice input is made. A speech recognition module is launched or otherwise activated. The user inputs voice commands that are processed to convert them to commands and text that can be recognized by the client software. The client software formats the requests and forwards them to the systems interface in order to retrieve the requested information.

Description

    PRIORITY INFORMATION
  • This application is continuation of U.S. patent application Ser. No. 12/571,779, filed Oct. 1, 2009, which is a continuation of U.S. patent application Ser. No. 09/892,664, filed Jun. 28, 2001, now U.S. Pat. No. 7,606,712, the contents of which are incorporated herein by reference in their entirety.
  • FIELD OF THE INVENTION
  • The present invention relates generally to the field of telecommunications dispatching and, more particularly, to methods and apparatus for providing a user-friendly input to a systems interface to legacy systems.
  • BACKGROUND OF THE INVENTION
  • Telecommunications technicians, such as so-called “Installation and Maintenance” (I&M) technicians, may visit customer sites to install new equipment, set up new services, or to service existing equipment or services. Frequently, I&M technicians need certain information stored on back-end legacy systems to perform a job order. The legacy systems may include dispatch, facilities, and billing systems. The legacy systems may store information such as job assignment, facility assignment, network testing functions, maintenance processes, and customer-specific information.
  • A typical telephone company, for example, can have a number of such back-end legacy systems that I&M technicians may need to access to perform job orders. These legacy systems can include, for example, a loop facility assignment control system, a loop maintenance operations system, a computer system for mainframe operations, a mechanized loop testing system, a secure network element contract server, a mechanized time reporting system, and a work activity statistical sampling plan system. Other back-end legacy and non-legacy systems may exist.
  • According to a previous approach, technicians could access some information from certain legacy systems using a gateway. For example, BellSouth's I&M technicians use the BellSouth Craft Access System (CAS) gateway. However, access using the gateway had significant limitations. The access was dial-up, meaning that the technician often had to tie up a customer's phone line. Additionally, logging-in and accessing data using CAS was a slow, laborious process. For example, CAS access was sometimes provided via Computer Access Terminals (CATs) using a slow 1.2 kbps connection. Because of the drawbacks of CAS, such as its slow speed, the provision of services by I&M technicians was suboptimal because of delays and impediments to getting the information necessary to complete a job order. In addition, CAS was very difficult to improve. The platform did not lend itself to creating new capabilities due to limited memory and low processor speed.
  • Moreover, I&M technicians often have poor or suboptimal keyboard skills. Technicians seeking information from legacy system interfaces such as CAS sometimes make mistakes in entering their requests into a computer keyboard. These mistakes can generate user errors that may result in the retrieval of incorrect information or that may result in the delayed retrieval of the correct information. Such user errors can increase the amount of time it takes I&M technicians to complete their job orders. This can increase costs and lead to customer dissatisfaction.
  • SUMMARY OF THE INVENTION
  • The subject matter presented herein is generally directed to a system and method for permitting a user, such as a technician, to access information stored on back-end legacy systems that substantially obviates one or more of the problems due to the limitations and disadvantages of the prior art.
  • In an embodiment, a user logs a computer onto a systems interface which permits access to back-end legacy systems. The computer is running client software to access the systems interface. Preferably, the client software is application-specific software such as the “TECHNET client application.” Preferably, the systems interface includes a first server with middleware for managing the protocol interface. Preferably, the systems interface includes a second server for receiving requests and generating legacy transactions. Preferably, the systems interface responds to the log-on attempt by presenting an introductory home page, such as a “TECHNET home page.” After the computer is logged-on, a request for voice input is made. Preferably, the request results from a technician selecting an icon or engaging a software button on the home page. In response to the request for voice input, a voice recognition module is launched or otherwise activated.
  • For a system intended to be used by a technician operated entirely by voice, after the power switch is turned on, voice commands such as, for example, “Start Technet”, “login BYNKC2F” (common user ID), “password 123abc,” can be used to logon and get to Technet home page.
  • The user inputs voice commands that are processed to select operations and to complete data fields recognized by the client software. The client software formats the requests and forwards them to the systems interface in order to retrieve the requested information.
  • The advantages of the present invention are numerous. For example, the invention can permit a user, such as a technician, to remotely access information from back-end legacy systems using a voice input to a systems interface instead of making entries on a keyboard. The voice input to the computer can be made over a wireline or over a wireless communications network. Using a voice input to the systems interface can reduce difficulties arising from keyboard entry errors. Using a voice input can also free up the technician to tend to other tasks and thereby improve his efficiency. Using a voice input can reduce costs and improve customer satisfaction.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a schematic block diagram of a system for allowing users to access information from back-end legacy systems according to an embodiment of the invention.
  • FIG. 2 is a schematic block diagram of a system for allowing users to access information from back-end legacy systems according to an embodiment of the invention.
  • FIG. 3 is a schematic diagram of the software configuration of a computer used in accordance with an embodiment of the invention.
  • FIG. 4 is a flow diagram of a method for allowing a user to retrieve information from a back-end legacy system using a voice input according to an embodiment of the invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • FIG. 1 is a schematic block diagram of an exemplary system for allowing a user, such as a technician, to access information from back-end legacy systems according to an embodiment of the invention. The system of FIG. 1 includes computer 100, communications network 120, systems interface 130, and back-end legacy systems 140.
  • Computer 100 is a computer used by a technician or other service person in order to access information from back-end legacy systems 140. As used herein, “computer” is used in the broadest sense of the term. A “computer” may be a microcomputer, minicomputer, laptop, personal data assistant, cellular phone, two-way pager, processor, or any computerized device capable of transmitting and receiving data over a shared network. Preferably, computer 100 is a ruggedized laptop computer.
  • Computer 100 remotely accesses systems interface 130 through communications network 120. Communications network 120 may be any communications network that permits a remote computer to access a remote server. Communications network 120 could be a wireline network, wireless or cellular network, satellite network, and so forth. Preferably, communications network 120 is a Public Switched Telephone Network (PSTN). For example, communications network 120 can be BellSouth Communications Network (BSCN). Alternatively, communications network 120 can be a wireless communications network such as Cingular Wireless Network.
  • Systems interface 130 provides a systems interface between remote (and preferably portable, e.g., a ruggedized laptop computer) computers 100 seeking data from back-end legacy systems 140. Legacy systems 140 are generally mainframe-type computer systems that maintain data for a company. According to an embodiment, legacy systems 140 may include one or more of the following systems: a loop facility assignment control system; a loop maintenance operations system; a computer system for mainframe operations; a mechanized loop testing system; a secure network element contract server; a mechanized time reporting system; and a work activity statistical sampling plan.
  • The general operation of the system of FIG. 1 is as follows. A user of computer 100, such as a technician, logs onto systems interface 130 over communications network 120. The computer is running client software that includes a client graphical user interface (GUI) to interface with systems interface 130. After the log-on, systems interface 130 permits computer 100 to submit requests for information from legacy systems 140. The user can submit the requests either by keyboard entry of inputs to the client GUI or by speech inputs to a voice recognition module. After receiving the requests, systems interface 130 processes the requests, generates legacy transactions, receives information from legacy systems 140, and transmits the information back to computer 100.
  • FIG. 2 is a schematic block diagram of an exemplary preferred system for allowing technicians to access information from legacy systems according to an embodiment of the invention. The system of FIG. 2 includes audio input device 280, computer 200, modem 220, communications network 230, at least one protocol server 240, at least one transaction server 250, firewall 260, and legacy systems 270. Protocol server 240. transaction server 250, and firewall 260 can be collectively referred to as system interface 210.
  • In accordance with FIG. 2, computer 200 accesses legacy systems 270 via a systems interface including protocol servers 240 and transaction servers 250 protected by firewall 260. Generally, protocol servers 240 provide a protocol and middleware interface between computer 200 and transaction server 250. Protocol servers 240 may receive requests for information or other messages from computer 200; route requests or messages to transaction server 250; receive responsive information from transaction server 250; and route responsive information back to computer 200.
  • Generally, transaction servers 250 provide an interface to back-end legacy systems 270 so that responsive information can be retrieved. Transaction servers 250 may service requests, generate legacy transactions in response to those requests, and receive responsive information to be forwarded back to protocol servers 240.
  • The preferred systems interface (e.g., elements 240, 250 and 260 of FIG. 2) is disclosed in the copending, commonly owned, U.S. patent application Ser. No. 09/343,815, entitled “Systems and Methods for Utilizing a Communications Network for Providing Mobile Users Access to Legacy Systems (hereinafter, referred to as “the '815 application”), filed on Jun. 30, 1999, the entirety of which is hereby incorporated by reference. The preferred systems interface is described in the aforementioned application in connection with the disclosed “TECHNET” system.
  • In particular, the preferred protocol servers 240 are disclosed in the '815 application as the “protocol servers,” which may include any associated hardware and/or software disclosed in connection therewith. The preferred transaction servers 250 are disclosed in the '815 application as the “TechNet servers,” which may include any associated hardware and/or software disclosed in connection therewith.
  • Protocol server 240 and transaction server 250 are depicted in FIG. 2 as separate servers for purposes of clarity and illustration. The operations performed by protocol server 240 and transaction server 250 could easily be combined and performed on a single server. On the other hand, the operations performed by protocol server 240 and transaction server 250 could easily be further subdivided and performed on additional servers. It should also be understood that the term “server” is intended to encompass variations such as processor, microprocessor, computer, minicomputer, microcomputer, and so forth.
  • Audio input device 280 is a device for receiving voice input or other audio input into computer 200. Preferably, audio input device 280 is a microphone that is integrated into computer 200. According to an embodiment, audio input device 280 is a commercially available microphone designed for speech recognition applications, such as a microphone made by Andrea Electronics, Shure Brothers, SSCS, Inc., Telex, Labtec, Norcom Electronics, or VXI Corp. Other commercially available microphones could be used.
  • Computer 200 is a remote and preferably portable computer used by a technician. Computer 200 may be any of the devices discussed above for computer 100 (FIG. 1). Additionally, computer 200 of FIG. 2 of the instant application may comprise the “TECHNET client PC” disclosed in the '815 application, including any associated hardware and/or software disclosed in connection therewith. Computer 200 may include a memory for storing certain software discussed below. The memory can be internal or external. The memory can include any means for storing software, including a hard disk, an optical disk, floppy disk, ROM (read only memory), RAM (random access memory), PROM (programmable ROM), EEPROM (extended erasable PROM), and so forth.
  • Communications network 230 may be a wireline communications network, preferably a PSTN. Alternatively, or in addition, communications network 230 may be a wireless or cellular communications network.
  • Generally, modem 220 and communications network 230 can support transmission rates in the range of about 2-56 kilobits per second, depending on whether the communications link is a wireline link or a wireless link.
  • Legacy systems 270 is similar to and include any of the variations discussed in connection with legacy systems 140 of FIG. 1.
  • The general operation of the preferred system of FIG. 2 is now described. A user (e.g., a technician) of computer 200 dials up or otherwise contacts protocol servers 240 via modem 220 and communications network 230. Technician may log in via protocol server 240 to transaction server 250 using a user name and other data, such as a password and/or primary host group address.
  • Computer 200 can run a client application for accessing the systems interface. Preferably, the computer is running the client application disclosed in the '815 application as the “TECHNET client application.” The client application includes a client graphical user interface (GUI) layer that provides the user interface for receiving requests for information from the user, displaying information retrieved from the back-end systems, and other user interface tasks.
  • Upon log-on, a primary screen or primary home page may be presented to the user of computer 200 by the client GUI. Preferably, this primary home page is a “TECHNET home page” that presents various options for requesting information (referred to herein as “operations”) from legacy systems. A technician may make the requests by keyboard entry of inputs to the client GUI. For example, the technician may select a particular operation (e.g., “Retrieve Client Account Information”) using a mouse or like pointing device. The technician may then type in the information for a client (e.g., name, address, phone number, account number, and/or social security number, etc.) into client GUI-provided data fields. The client software formats the inputs into requests that are forwarded to the systems interface in order to retrieve the desired information. Other requests for information from the various legacy systems 270 can be initiated by typing in the appropriate information.
  • Alternatively, the user can opt to make the requests by voice input. After the computer is logged-on, the user makes a request for voice input. Preferably, the request for voice input is made by a technician speaking to the computer to start the application. When the PC is turned on, a speech recognition application is launched or otherwise activated. The user inputs speech commands into audio input device 280 that are processed by the voice recognition application in order to select particular operations and to complete the data fields for those operations. The speech recognition application and the client software are integrated so that voice input selection of a particular operation results in that operation being selected by the client GUI. The two software applications are also integrated so that voice input of information (for the selected operation) is used to complete the data fields presented by the client GUI. As before, the client software formats the inputs into requests that are forwarded to the systems interface in order to retrieve the desired information.
  • FIG. 3 is a schematic diagram of an exemplary software configuration of a computer used in accordance with an embodiment. To explain and illustrate, FIG. 3 is discussed in connection with structure shown in FIG. 2. However, the software configuration of FIG. 3 is not to be considered as limited to or constrained by the structure of FIG. 2 or any other structure.
  • In the embodiment of FIG. 3, computer 200 is programmed with speech recognition module 305, client application 310, and operating system 320.
  • Operating system 320 may be a conventional operating system program. One example of suitable operating system is Microsoft Windows 98. Operating system 320 may be any of the other operating systems disclosed in the '815 application.
  • Client application 310 is the software application that runs on computer 200 to permit the access to legacy systems (e.g., the legacy systems 270 of FIG. 2) via the systems interface (e.g., protocol servers 240 and transaction servers 250 of FIG. 2). Generally, client application 310 recognizes user requests, formats the requests, sends requests to the systems interface, receives retrieved information, and processes retrieved information so that it can be displayed to the user. Preferably, client application 310 is the TechNet client application disclosed in the '815 application. Client application 310 may includes a client GUI layer for managing the user-to-computer interface. Client application 310 may include a communications layer for allowing client application 310 to interact with the systems interface. Preferably, the client GUI layer is the TechNet GUI layer and the communications layer is the TechNet communications layer, both disclosed in the '815 application.
  • Speech recognition module 305 is the speech recognition software application that runs on computer 200 in order permit the user to present voice input requests to voice input device 280 (FIG. 2). Speech recognition module 305 is capable of performing STT (speech-to-text) operations that translate spoken words into text or other characters or commands. When activated, speech recognition module 305 is capable of recognizing voice inputs for selecting operations and/or for inputting information to complete data fields.
  • For example, a home page displayed to a user by the client GUI may present options for several operations (e.g., “Get a Job,” “Retrieve Client Account Information,” and so forth). Speech recognition module 305 is programmed to recognize verbal utterances of these operations, which are translated into a command that selects the corresponding operation in much the same way as if the user had selected the operation with a pointing device.
  • For example, after selecting a particular operation (e.g., “Retrieve Client Account Information”), the client GUI may present a page with data fields to be completed. Speech recognition module 305 is programmed to translate verbal inputs into text that is used to complete these data fields.
  • According to one embodiment, speech recognition module 305 has a series of submodules or subcomponents tailored to the various pages that may be presented by the client GUI. For example, the client GUI may be adapted to present a home page presenting several operations, as well as a series of linked pages corresponding to each operation. Speech recognition module 305 may tailor its speech recognition processing according to the active/page presented by the client GUI. For example, there may be a separate vocabulary accessed by voice recognition module 305 for each of the pages.
  • Design and coding of voice recognition module 305 is well within the skill of the ordinary artisan. Currently, a number of speech recognition software applications are commercially available. Such a commercially available application could be programmed or modified or adapted to perform the specific speech recognition operations of the present invention.
  • Commercially available speech recognition applications include those sold by United Research Labs (e.g., VOICEACTION), Dragon Systems (e.g., NATURALLYSPEAKING and DRAGONDICTATE), IBM (VIAVOICE, Natural Language Understanding, voice-enabled forms technology see Lernout & Hauspie (e.g., Voice Xpress), Phillips Speech Processing (e.g., FREESPEECH98), Verbex Voice Systems (e.g., Listen for Windows). Preferably, voice recognition module 305 is based on the Nuance 7.0 product sold by Nuance Communications of Menlo Park, California. The suite of Nuance products includes API interfaces for various programming languages to enable the development of voice-driven applications. Alternatively, voice recognition module 305 can be coded as a custom application.
  • FIG. 4 is a flow diagram of a method for allowing a user to retrieve information from a back-end legacy system using a voice input according to an embodiment of the invention. To explain and illustrate the invention, FIG. 4 is discussed in connection with structure from FIG. 2 and the software configuration of FIG. 3. However, the method of FIG. 4 is not to be considered as limited to or constrained by the structure of FIG. 2 or the software configuration of FIG. 3 or any other structure/software configuration.
  • In step 405 the user logs onto the systems interface. For example, a technician using computer 200 (FIG. 2) may attempt a log-on via protocol server 240 (FIG. 2).
  • In step 410, a speech recognition application is launched or otherwise activated. For example, the voice recognition application can be launched as part of the computer start-up process. Alternatively, the speech recognition module 305 of FIG. 3 may be activated by a user when needed. If the speech recognition software is started at computer startup, the user is able to start the TechNet application as well as using speech recognition capabilities to input and receive data from TechNet application. For example, to get from one field to a next field, the user can say “TAB” to move the cursor to the next field. Similarly, to input data, the user can say “Enter” and then data will be entered. To go to a new screen or to move to a new page in the application , the user can say, for example, “Go To” and then state the page he wishes to go to. For example, the user can say “Cosmos Inquiry” to go to a page for searches.
  • In step 415, voice inputs are received. For example, speech recognition module 305 (FIG. 3) may receive voice inputs based on a technician speaking into voice input device 280 (FIG. 2).
  • In step 420, the voice inputs are converted to a request that can be processed by the systems interface. Step 420 may comprise speech recognition module 305 processing the voice inputs in order to correlate or interpret them in accordance with a client GUI. As discussed above for FIG. 3, a client GUI may present options for operations and/or data fields corresponding to an operation. According to step 420, speech recognition module 305 processes the voice inputs (e.g., by accessing a stored vocabulary) to select operations and to complete data fields. When all information necessary for a request has been received by the client application, the request is formatted so that it is ready for transmission to the systems interface.
  • In step 425, the request is sent to the systems interface (e.g., protocol server 240 and transaction server 250 of FIG. 2).
  • In step 430, the requested data is received. For example, the requested data may be received at the client application 310 (FIG. 3) of computer 200 (FIG. 2). Preferably, the requested data is received via the TechNet communications layer and formatted for display by the TechNet GUI layer.
  • In step 435, the received data is displayed on the GUI.
  • In step 440, the user may ask for a voice readout of the received data.
  • The foregoing disclosure of the preferred embodiments of the present invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many variations and modifications of the embodiments described herein will be obvious to one of ordinary skill in the art in light of the above disclosure. The scope of the invention is to be defined only by the claims appended hereto, and by their equivalents.
  • Further, in describing representative embodiments of the present invention, the specification may have presented the method and/or process of the present invention as a particular sequence of steps. However, to the extent that the method or process does not rely on the particular order of steps set forth herein, the method or process should not be limited to the particular sequence of steps described. As one of ordinary skill in the art would appreciate, other sequences of steps may be possible. Therefore, the particular order of the steps set forth in the specification should not be construed as limitations on the claims. In addition, the claims directed to the method and/or process of the present invention should not be limited to the performance of their steps in the order written, and one skilled in the art can readily appreciate that the sequences may be varied and still remain within the spirit and scope of the present invention.

Claims (20)

We claim:
1. A method comprising:
presenting, via a display, a plurality of operations available to a user for interacting with a legacy system;
receiving a multimodal request from the user to perform a transaction, wherein:
the multimodal request has a speech portion that is recognized by an input device;
the multimodal request has a second portion comprising a cursor input; and
the multimodal request corresponds to an operation in the plurality of operations;
recognizing the speech portion via a vocabulary specific to the plurality of operations presented;
translating the multimodal request to a format compatible with the legacy system, to yield a translated multimedia request; and
submitting the translated multimodal request to the legacy system.
2. The method of claim 1, wherein communications with the legacy system occur over a wireless communications network.
3. The method of claim 1, wherein communications with the legacy system occur over a wireline communications network.
4. The method of claim 1, wherein the plurality of operations are presented via a graphical user interface on the display.
5. The method of claim 1, wherein a plurality of vocabularies are used for the plurality of operations, each vocabulary in the plurality of vocabularies corresponding to an operation in the plurality of operations.
6. The method of claim 1, wherein the speech portion corresponds to a legacy operation of the legacy system.
7. The method of claim 6, wherein the legacy operation was a cursory input operation.
8. A system comprising:
a processor; and
a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising:
presenting, via a display, a plurality of operations available to a user for interacting with a legacy system;
receiving a multimodal request from the user to perform a transaction, wherein:
the multimodal request has a speech portion that is recognized by an input device;
the multimodal request has a second portion comprising a cursor input; and
the multimodal request corresponds to an operation in the plurality of operations;
recognizing the speech portion via a vocabulary specific to the plurality of operations presented;
translating the multimodal request to a format compatible with the legacy system, to yield a translated multimedia request; and
submitting the translated multimodal request to the legacy system.
9. The system of claim 8, wherein communications with the legacy system occur over a wireless communications network.
10. The system of claim 8, wherein communications with the legacy system occur over a wireline communications network.
11. The system of claim 8, wherein the plurality of operations are presented via a graphical user interface on the display.
12. The system of claim 8, wherein a plurality of vocabularies are used for the plurality of operations, each vocabulary in the plurality of vocabularies corresponding to an operation in the plurality of operations.
13. The system of claim 8, wherein the speech portion corresponds to a legacy operation of the legacy system.
14. The system of claim 13, wherein the legacy operation was a cursory input operation.
15. A computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising:
presenting, via a display, a plurality of operations available to a user for interacting with a legacy system;
receiving a multimodal request from the user to perform a transaction, wherein:
the multimodal request has a speech portion that is recognized by an input device;
the multimodal request has a second portion comprising a cursor input; and
the multimodal request corresponds to an operation in the plurality of operations;
recognizing the speech portion via a vocabulary specific to the plurality of operations presented;
translating the multimodal request to a format compatible with the legacy system, to yield a translated multimedia request; and
submitting the translated multimodal request to the legacy system.
16. The computer-readable storage device of claim 15, wherein communications with the legacy system occur over a wireless communications network.
17. The computer-readable storage device of claim 15, wherein communications with the legacy system occur over a wireline communications network.
18. The computer-readable storage device of claim 15, wherein the plurality of operations are presented via a graphical user interface on the display.
19. The computer-readable storage device of claim 15, wherein a plurality of vocabularies are used for the plurality of operations, each vocabulary in the plurality of vocabularies corresponding to an operation in the plurality of operations.
20. The computer-readable storage device of claim 15, wherein the speech portion corresponds to a legacy operation of the legacy system.
US14/873,637 2001-06-28 2015-10-02 Speech recognition interface for voice actuation of legacy systems Pending US20160026433A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US09/892,664 US7606712B1 (en) 2001-06-28 2001-06-28 Speech recognition interface for voice actuation of legacy systems
US12/571,779 US9152375B2 (en) 2001-06-28 2009-10-01 Speech recognition interface for voice actuation of legacy systems
US14/873,637 US20160026433A1 (en) 2001-06-28 2015-10-02 Speech recognition interface for voice actuation of legacy systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/873,637 US20160026433A1 (en) 2001-06-28 2015-10-02 Speech recognition interface for voice actuation of legacy systems

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/571,779 Continuation US9152375B2 (en) 2001-06-28 2009-10-01 Speech recognition interface for voice actuation of legacy systems

Publications (1)

Publication Number Publication Date
US20160026433A1 true US20160026433A1 (en) 2016-01-28

Family

ID=41170386

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/892,664 Expired - Fee Related US7606712B1 (en) 2001-06-28 2001-06-28 Speech recognition interface for voice actuation of legacy systems
US12/571,779 Active US9152375B2 (en) 2001-06-28 2009-10-01 Speech recognition interface for voice actuation of legacy systems
US14/873,637 Pending US20160026433A1 (en) 2001-06-28 2015-10-02 Speech recognition interface for voice actuation of legacy systems

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US09/892,664 Expired - Fee Related US7606712B1 (en) 2001-06-28 2001-06-28 Speech recognition interface for voice actuation of legacy systems
US12/571,779 Active US9152375B2 (en) 2001-06-28 2009-10-01 Speech recognition interface for voice actuation of legacy systems

Country Status (1)

Country Link
US (3) US7606712B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019017687A1 (en) * 2017-07-18 2019-01-24 Samsung Electronics Co., Ltd. Method for operating speech recognition service and electronic device and server for supporting the same

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8831949B1 (en) 2001-06-28 2014-09-09 At&T Intellectual Property I, L.P. Voice recognition for performing authentication and completing transactions in a systems interface to legacy systems
US7606712B1 (en) * 2001-06-28 2009-10-20 At&T Intellectual Property Ii, L.P. Speech recognition interface for voice actuation of legacy systems
US8498871B2 (en) * 2001-11-27 2013-07-30 Advanced Voice Recognition Systems, Inc. Dynamic speech recognition and transcription among users having heterogeneous protocols
US20030101054A1 (en) * 2001-11-27 2003-05-29 Ncc, Llc Integrated system and method for electronic speech recognition and transcription
US8073681B2 (en) * 2006-10-16 2011-12-06 Voicebox Technologies, Inc. System and method for a cooperative conversational voice user interface
US7818176B2 (en) 2007-02-06 2010-10-19 Voicebox Technologies, Inc. System and method for selecting and presenting advertisements based on natural language processing of voice-based input
US9305548B2 (en) 2008-05-27 2016-04-05 Voicebox Technologies Corporation System and method for an integrated, multi-modal, multi-device natural language voice services environment
US8326637B2 (en) 2009-02-20 2012-12-04 Voicebox Technologies, Inc. System and method for processing multi-modal device interactions in a natural language voice services environment
US20150261968A1 (en) * 2014-03-12 2015-09-17 Ebay Inc. Visualizing random characters for keyboard-less devices
US9898459B2 (en) 2014-09-16 2018-02-20 Voicebox Technologies Corporation Integration of domain information into state transitions of a finite state transducer for natural language processing
EP3207467A4 (en) 2014-10-15 2018-05-23 VoiceBox Technologies Corporation System and method for providing follow-up responses to prior natural language inputs of a user

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6636831B1 (en) * 1999-04-09 2003-10-21 Inroad, Inc. System and process for voice-controlled information retrieval
US20070185717A1 (en) * 1999-11-12 2007-08-09 Bennett Ian M Method of interacting through speech with a web-connected server
US20090031302A1 (en) * 2007-07-24 2009-01-29 International Business Machines Corporation Method for minimizing risks of change in a physical system configuration
US20090313026A1 (en) * 1998-10-02 2009-12-17 Daniel Coffman Conversational computing via conversational virtual machine

Family Cites Families (87)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4776016A (en) 1985-11-21 1988-10-04 Position Orientation Systems, Inc. Voice control system
US5023283A (en) * 1986-12-24 1991-06-11 Ciba-Geigy Corporation N,N-bis(acyloxyethyl)hydroxylamine derivatives
US4905163A (en) 1988-10-03 1990-02-27 Minnesota Mining & Manufacturing Company Intelligent optical navigator dynamic information presentation and navigation system
US5038283A (en) 1989-04-13 1991-08-06 Panduit Corp. Shipping method
US5003591A (en) 1989-05-25 1991-03-26 General Instrument Corporation Functionally modifiable cable television converter system
WO1992011713A1 (en) 1990-12-21 1992-07-09 Gte Service Corporation Method for providing video programming nearly on demand
US5359649A (en) 1991-10-02 1994-10-25 Telefonaktiebolaget L M Ericsson Congestion tuning of telecommunications networks
US5659350A (en) 1992-12-09 1997-08-19 Discovery Communications, Inc. Operations center for a television program packaging and delivery system
US5953389A (en) 1993-11-16 1999-09-14 Bell Atlantic Network Services, Inc. Combination system for provisioning and maintaining telephone network facilities in a public switched telephone network
US5623404A (en) 1994-03-18 1997-04-22 Minnesota Mining And Manufacturing Company System and method for producing schedules of resource requests having uncertain durations
US5521958A (en) 1994-04-29 1996-05-28 Harris Corporation Telecommunications test system including a test and trouble shooting expert system
US5896440A (en) 1994-05-26 1999-04-20 Gte Service Corporation System and method for providing a unified communications link between divergent communication networks
US6023683A (en) 1994-08-10 2000-02-08 Fisher Scientific Company Electronic sourcing system and method
US5715314A (en) 1994-10-24 1998-02-03 Open Market, Inc. Network sales system
JPH08265424A (en) 1994-11-14 1996-10-11 Harris Corp User interface with terminal emulation driving operation support system provided for portable test/ communication equipment of engineer
US5570283A (en) 1994-11-18 1996-10-29 Travelnet, Inc. Corporate travel controller
US5664110A (en) 1994-12-08 1997-09-02 Highpoint Systems, Inc. Remote ordering system
US5696906A (en) 1995-03-09 1997-12-09 Continental Cablevision, Inc. Telecommunicaion user account management system and method
US5694323A (en) 1995-04-04 1997-12-02 Persyst, Inc. Monitoring system with particular application to monitoring a cash-basis operation
US5873070A (en) 1995-06-07 1999-02-16 Norand Corporation Data collection system
US5687212A (en) 1995-07-25 1997-11-11 Bell Atlantic Network Services, Inc. System for reactively maintaining telephone network facilities in a public switched telephone network
US5963940A (en) * 1995-08-16 1999-10-05 Syracuse University Natural language information retrieval system and method
US5799279A (en) * 1995-11-13 1998-08-25 Dragon Systems, Inc. Continuous speech recognition of text and commands
US5826270A (en) 1995-12-28 1998-10-20 Csg Systems, Inc. Methods and systems for client or customer-site transaction processing in a distributed database system
US5805775A (en) * 1996-02-02 1998-09-08 Digital Equipment Corporation Application user interface
US5920846A (en) 1996-02-27 1999-07-06 Southwestern Bell Telephone Co. Method and system for processing a service request relating to installation, maintenance or repair of telecommunications services provided to a customer premises
US5884262A (en) 1996-03-28 1999-03-16 Bell Atlantic Network Services, Inc. Computer network audio access and conversion system
US5754830A (en) 1996-04-01 1998-05-19 Openconnect Systems, Incorporated Server and web browser terminal emulator for persistent connection to a legacy host system and method of operation
BR9709338B1 (en) 1996-05-23 2012-05-29 system and process of global integration services.
US5940807A (en) 1996-05-24 1999-08-17 Purcell; Daniel S. Automated and independently accessible inventory information exchange system
US5923735A (en) 1996-05-29 1999-07-13 Symbol Technologies, Inc. Self-service checkout system utilizing portable self-checkout communications terminal
US6026379A (en) 1996-06-17 2000-02-15 Verifone, Inc. System, method and article of manufacture for managing transactions in a high availability system
US5857201A (en) 1996-06-18 1999-01-05 Wright Strategies, Inc. Enterprise connectivity to handheld devices
US6473407B1 (en) * 1997-09-05 2002-10-29 Worldcom, Inc. Integrated proxy interface for web based alarm management tools
US6115737A (en) 1996-07-24 2000-09-05 Telcordia Technologies, Inc. System and method for accessing customer contact services over a network
US5812977A (en) * 1996-08-13 1998-09-22 Applied Voice Recognition L.P. Voice control computer interface enabling implementation of common subroutines
US5931917A (en) 1996-09-26 1999-08-03 Verifone, Inc. System, method and article of manufacture for a gateway system architecture with system administration information accessible from a browser
US5848403A (en) 1996-10-04 1998-12-08 Bbn Corporation System and method for genetic algorithm scheduling systems
US6058373A (en) 1996-10-16 2000-05-02 Microsoft Corporation System and method for processing electronic order forms
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
CN1218260C (en) 1996-11-22 2005-09-07 维杜斯有限公司 Device and method for task allocation
US6101510A (en) 1997-01-29 2000-08-08 Microsoft Corporation Web browser control for incorporating web browser functionality into application programs
US5884266A (en) 1997-04-02 1999-03-16 Motorola, Inc. Audio interface for document based information resource navigation and method therefor
US6101472A (en) * 1997-04-16 2000-08-08 International Business Machines Corporation Data processing system and method for navigating a network using a voice command
US5970472A (en) 1997-05-13 1999-10-19 Fogdog Sports Performing electronic commerce on the internet providing links from product manufacturers to authorized dealers where the authorized dealer provides a custom order interface for the manufacturer's products
US5974135A (en) 1997-06-11 1999-10-26 Harrah's Operating Company, Inc. Teleservices computer system, method, and manager application for integrated presentation of concurrent interactions with multiple terminal emulation sessions
US6080202A (en) 1997-07-10 2000-06-27 Nortel Networks Corporation Universal compatibility software system for services in communication and information processing networks
US5960411A (en) 1997-09-12 1999-09-28 Amazon.Com, Inc. Method and system for placing a purchase order via a communications network
CA2303513A1 (en) 1997-09-15 1999-03-25 Maintenet Corporation Electronic information network for inventory control and transfer
US6385644B1 (en) 1997-09-26 2002-05-07 Mci Worldcom, Inc. Multi-threaded web based user inbox for report management
US6763376B1 (en) 1997-09-26 2004-07-13 Mci Communications Corporation Integrated customer interface system for communications network management
AU4449797A (en) 1997-09-29 1999-04-23 Fujun Bi A multi-element confidence matching system and the method therefor
US6023684A (en) * 1997-10-01 2000-02-08 Security First Technologies, Inc. Three tier financial transaction system with cache memory
US6445774B1 (en) 1997-11-17 2002-09-03 Mci Communications Corporation System for automated workflow in a network management and operations system
US6052785A (en) 1997-11-21 2000-04-18 International Business Machines Corporation Multiple remote data access security mechanism for multitiered internet computer networks
US5930773A (en) 1997-12-17 1999-07-27 Avista Advantage, Inc. Computerized resource accounting methods and systems, computerized utility management methods and systems, multi-user utility management methods and systems, and energy-consumption-based tracking methods and systems
US6092192A (en) 1998-01-16 2000-07-18 International Business Machines Corporation Apparatus and methods for providing repetitive enrollment in a plurality of biometric recognition systems based on an initial enrollment
US6219644B1 (en) * 1998-03-27 2001-04-17 International Business Machines Corp. Audio-only user speech interface with audio template
US6738815B1 (en) * 1998-07-01 2004-05-18 Telcordia Technologies, Inc. Systems and methods for utilizing a communications network for providing mobile users access to legacy systems
US6604086B1 (en) 1998-07-20 2003-08-05 Usa Technologies, Inc. Electronic commerce terminal connected to a vending machine operable as a telephone
JP2000112746A (en) 1998-09-30 2000-04-21 Toshiba Corp Resource procuring auxiliary device and storage medium
US6366829B1 (en) 1998-10-06 2002-04-02 J. P. Donmoyer, Inc. Bulk inventory network system (BINS)
US6587822B2 (en) * 1998-10-06 2003-07-01 Lucent Technologies Inc. Web-based platform for interactive voice response (IVR)
US6341271B1 (en) 1998-11-13 2002-01-22 General Electric Company Inventory management system and method
US6396833B1 (en) 1998-12-02 2002-05-28 Cisco Technology, Inc. Per user and network routing tables
US6671824B1 (en) 1999-04-19 2003-12-30 Lakefield Technologies Group Cable network repair control system
US6971072B1 (en) 1999-05-13 2005-11-29 International Business Machines Corporation Reactive user interface control based on environmental sensing
US6615176B2 (en) * 1999-07-13 2003-09-02 International Business Machines Corporation Speech enabling labeless controls in an existing graphical user interface
US7287031B1 (en) * 1999-08-12 2007-10-23 Ronald Steven Karpf Computer system and method for increasing patients compliance to medical care instructions
US6223541B1 (en) 1999-08-17 2001-05-01 Fasti, Farrag & Stipsits Gesmbh Method and device for the after-cooling of a preform in the injection molding process
US6724406B1 (en) 1999-11-10 2004-04-20 International Business Machines Corporation Method of controlling web applications from redirecting a client to another web address
US6587851B1 (en) 1999-12-22 2003-07-01 Bellsouth Intellectual Property Corporation Notification system and method
US6487278B1 (en) * 2000-02-29 2002-11-26 Ameritech Corporation Method and system for interfacing systems unified messaging with legacy systems located behind corporate firewalls
US6389337B1 (en) 2000-04-24 2002-05-14 H. Brock Kolls Transacting e-commerce and conducting e-business related to identifying and procuring automotive service and vehicle replacement parts
US20020103906A1 (en) 2000-07-10 2002-08-01 Knight Thomas A. Internet protocol intranet network system and method for a financial institution
US7111243B1 (en) * 2001-03-02 2006-09-19 Oracle International Corporation Customization of tab-order functionality in internet applications
US20020138656A1 (en) 2001-03-23 2002-09-26 Neil Hickey System for and method of providing interfaces to existing computer applications
US6915258B2 (en) * 2001-04-02 2005-07-05 Thanassis Vasilios Kontonassios Method and apparatus for displaying and manipulating account information using the human voice
US20030023601A1 (en) 2001-05-08 2003-01-30 Fortier Joseph W. System and method for intercommunication among disparate communication networks
US6957274B2 (en) 2001-06-27 2005-10-18 Microsoft Corporation System adds additional new routes and default routes to a routing table to allow concurrent access to two different network connections
US7606712B1 (en) * 2001-06-28 2009-10-20 At&T Intellectual Property Ii, L.P. Speech recognition interface for voice actuation of legacy systems
US6798358B2 (en) 2001-07-03 2004-09-28 Nortel Networks Limited Location-based content delivery
US20030008661A1 (en) 2001-07-03 2003-01-09 Joyce Dennis P. Location-based content delivery
US7890375B2 (en) 2001-07-31 2011-02-15 Half.Com, Inc. Method and system to facilitate pre-ordering via an electronic commerce facility, and to automatically facilitate satisfying of a pre-order upon listing of an appropriate offer via the electronic commerce facility
GB2387927B (en) 2001-12-20 2005-07-13 Canon Kk Control apparatus
US6736376B1 (en) 2002-03-19 2004-05-18 Delisle Gilles L. Anti-detonation fuel delivery system
US6898435B2 (en) 2002-07-16 2005-05-24 David A Milman Method of processing and billing work orders

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090313026A1 (en) * 1998-10-02 2009-12-17 Daniel Coffman Conversational computing via conversational virtual machine
US6636831B1 (en) * 1999-04-09 2003-10-21 Inroad, Inc. System and process for voice-controlled information retrieval
US20070185717A1 (en) * 1999-11-12 2007-08-09 Bennett Ian M Method of interacting through speech with a web-connected server
US20090031302A1 (en) * 2007-07-24 2009-01-29 International Business Machines Corporation Method for minimizing risks of change in a physical system configuration

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019017687A1 (en) * 2017-07-18 2019-01-24 Samsung Electronics Co., Ltd. Method for operating speech recognition service and electronic device and server for supporting the same

Also Published As

Publication number Publication date
US20100023332A1 (en) 2010-01-28
US7606712B1 (en) 2009-10-20
US9152375B2 (en) 2015-10-06

Similar Documents

Publication Publication Date Title
US8620664B2 (en) Open architecture for a voice user interface
US6574314B1 (en) Method for entering transaction data into data bases using transaction entry device
RU2355044C2 (en) Sequential multimodal input
EP1952279B1 (en) A system and method for conducting a voice controlled search using a wireless mobile device
US6742021B1 (en) Navigating network-based electronic information using spoken input with multimodal error feedback
US6718015B1 (en) Remote web page reader
US6185535B1 (en) Voice control of a user interface to service applications
US7398209B2 (en) Systems and methods for responding to natural language speech utterance
US7643998B2 (en) Method and apparatus for improving voice recognition performance in a voice application distribution system
US6691111B2 (en) System and method for implementing a natural language user interface
US5872915A (en) Computer apparatus and method for providing security checking for software applications accessed via the World-Wide Web
US7945851B2 (en) Enabling dynamic voiceXML in an X+V page of a multimodal application
US6513063B1 (en) Accessing network-based electronic information through scripted online interfaces using spoken input
US7006973B1 (en) Providing information in response to spoken requests
US6662163B1 (en) System and method for programming portable devices from a remote computer system
US9245522B2 (en) Methods and systems for correcting transcribed audio files
EP1163665B1 (en) System and method for bilateral communication between a user and a system
US7827033B2 (en) Enabling grammars in web page frames
US6401065B1 (en) Intelligent keyboard interface with use of human language processing
US5950167A (en) Screen-less remote voice or tone-controlled computer program operations via telephone set
US6885734B1 (en) System and method for the creation and automatic deployment of personalized, dynamic and interactive inbound and outbound voice services, with real-time interactive voice database queries
US6393462B1 (en) Method and apparatus for automatic downloading of URLs and internet addresses
US8719034B2 (en) Displaying speech command input state information in a multimodal browser
US8566087B2 (en) Context-based grammars for automated speech recognition
US6246983B1 (en) Text-to-speech e-mail reader with multi-modal reply processor

Legal Events

Date Code Title Description
AS Assignment

Owner name: BELLSOUTH INTELLECTUAL PROPERTY CORPORATION, DELAW

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SMITH, STEVEN G.;MILLS, RALPH J.;DAVIS, MITCHELL E.;AND OTHERS;SIGNING DATES FROM 20020219 TO 20020328;REEL/FRAME:036718/0953

AS Assignment

Owner name: AT&T INTELLECTUAL PROPERTY I, L.P., NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AT&T DELAWARE INTELLECTUAL PROPERTY, INC.;REEL/FRAME:036832/0428

Effective date: 20130508

Owner name: AT&T BLS INTELLECTUAL PROPERTY, INC., DELAWARE

Free format text: CHANGE OF NAME;ASSIGNOR:AT&T INTELLECTUAL PROPERTY, INC.;REEL/FRAME:036900/0380

Effective date: 20070727

Owner name: AT&T INTELLECTUAL PROPERTY, INC., DELAWARE

Free format text: CHANGE OF NAME;ASSIGNOR:BELLSOUTH INTELLECTUAL PROPERTY CORPORATION;REEL/FRAME:036900/0360

Effective date: 20070427

Owner name: AT&T DELAWARE INTELLECTUAL PROPERTY, INC., DELAWAR

Free format text: CHANGE OF NAME;ASSIGNOR:AT&T BLS INTELLECTUAL PROPERTY, INC.;REEL/FRAME:036900/0396

Effective date: 20071101

AS Assignment

Owner name: NUANCE COMMUNICATIONS, INC., MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AT&T INTELLECTUAL PROPERTY I, L.P.;REEL/FRAME:041498/0113

Effective date: 20161214

STCB Information on status: application discontinuation

Free format text: FINAL REJECTION MAILED