CA2050364C - Automation of telephone operator assistance calls - Google Patents

Abstract

This invention relates to methods and apparatus for automatically processing operator assistance calls. A caller is connected to an automated operator position. The automated position has speech recognition facilities to replace those of an operator, has announcement capabilities to replace those of an operator, and has control means for transmitting and receiving the same set of messages transmitted and received by an operator position. Advantageously, the operator assistance switch has the same interface to an automated position as to an operator position and interacts with the two identically. Since the capabilities of the automated position are limited by its program, the automated position switches a call to an automated position when a situation occurs for which it has not been programmed.
Advantageously, a switch need not be specially programmed to communicate with an automated position. Advantageously, new operator assistance services can be provided automatically without rewriting the complex control software of the switch.
The invention further relates to the use of automated operator positions for providing spontaneous voice message service wherein a caller converts a call to a message call if the called party does not answer or is busy, and to a method of recognizing a voice specified destination and establishing a call to that destination.

Description

AUTOMATION OF TELEPHONE OPERATOR ASSISTANCE CALLS

Technical Field This invention relates to methods and apparatus for automating the processing of operator assistance type telecommunications calls.
5 Problem Over the past several dec~cles, a great deal of toll telephone traffic which used to be handled by operators has been automated. The initial step of automating what was originally operator assistance traffic was to offer customer-dialed long distance call service. Then, customer-dialed operator assistance calls were 10 introduced to permit operators to process calls for which the number had already been dialed. Automatic recording of telephone charges was introduced also at that time. Today, the category of fully or partially automated operator ~ci~t~nce telephone traffic includes coin calls, calling card calls, automatic quotation of charges for hotel guest originated calls, and partial automation of collect and person 15 calls. In spite of the intensive effort to automate operator assistance calls, telephone companies annually spent over a billion dollars for operator wages and accompanying overhead costs.
Operator ~si~te~l calls aue processed from attended operator positions attached to operator assistance switching systems or switches. These switches are 20 operated under the control of a complex prograrn, generally referred to as a generic program, which must be tested very carefully to ensure that no program flaws remain that could cause a system to "crash" or become non-functional. The switch communicates with operator positions by data messages used to operate displays at the operator position, and to transmit information keyed by the operator, in response 25 to instructions from the caller, to the switch. The generic program is designed carefully to ensure that poor data received from an operator switch does not affect more than one call. A problem in such switches is that it is difficult to introduce new services and to automate operator functions because of the difficulty of changing the generic program. The largest component of operator assistance calls which have not 30 been fully automated are collect calls and third number calls. Even these are being partially automated through the use of an arrangement known as "More Efficient Call Handling For Operator ~si~t~nce Calls" (MECH) described in T. M. Bauer et al., U.S. patent 4,899,375, which discloses an arrangement wherein an initial operator determines the type of call and then is disconnected while the call is being 35 set up and the called customer is being alerted; subsequently, a second operator is attached to the call only if necessary, for example, after an answer for collect calls.
In A. N. Daudelin, U.S. patent 4,486,833, a speech recognition unit that is a part of an operator assistance switch is used to determine a call type, andcooperate in the automatic establishment of the call. When the called party answers 5 on a collect call, the speech recognition unit determines whether the called customer accepts the call.
Another arrangement is described in Comella et al: U.S. patent 4,054,756, wherein customers with dual tone multifrequency (DTMF) stations key initial digits indicating the type of call, then key all necessary numerical information 10 (including, for example, the identification of the third number). For collect or third number calls, the calling customer records his or her name for identification purposes to the collect or third number party; the latter then keys an acceptance signal if the call can be allowed to proceed.
In another arrangement recently announced by Northern 15 Telecommunications, Inc., a caller dials a number including an indication of a call type, and on a collect call, when prompted to do so, speaks his or her name. After the call has been established to the called customer for a collect call or to the third party for a third number call, a speech recognition unit is used to detect whether the called customer accepts the call by speaking a "yes" or a "no". A speech processing 20 unit is connected via a segregated tr~nsmi~cion facility for handling these calls. If the called customer has a DTMF station, the called customer or the third party can key an acceptance instead of speaking such an acceptance.
In view of the foregoing, a need exists in the art for an arrangement that facilely automates many of the rern~ining operator ~csi~t~nce calls, such as collect 25 calls and third number calls, which still require the assistance of an operator.
Another problem of the prior art relates to automatic dialing of frequently dialed telephone numbers. This need is served by customer station equiplllellt in which these frequently dialed numbers can be preset or in telephone central office arrangements which, in response to an abbreviated identification,30 establish a call to a prespecified destination. In both cases, the arrangements are operative only when the customer dials from his or her home or of fice telephone or from a mobile phone which has been preprogrammed with the desired telephone numbers.

2~5036~

Solution The above problem is solved and an advance is made over the prior art in accordance with the principles of our invention wherein an unattended automated position is substituted for some of the operator positions attached to an operator 5 assistance switch; such an automated position includes means for recognizing comm~nds such as speech comm~n~ , for making announcements to a connected telephone customer, and optionally, for detecting DTMF digits, for recording speech, and for detecting a switch-hook "flash" (i.e., a brief depression of the switch-hook).
In one preferred embodiment, the interface between the operator position and the10 operator ~csi~t~nce switching system is maintained for the automated position so that the existing data communications in both directions are the same. The assistanceswitching system communicates with the positions using the same messages for generating displays at the operator position and the automated position. Similarly, the automated position communicates with the switching system using the same 15 messages used by the operator position for controlling switching system operations.
If an automated position cannot process a particular call, either because the call type is not anticipated in the program controlling the automated position, or because the automated position cannot recognize the caller's speech, the automated position sends a data message to the switch asking that the call be switched to an attended 20 Op.,latOl position. Advantageously, the switching system has already been designed to react in a safe manner to any combination of control signals from the operator position so that the amount of damage inflicted on other calls as a result of improper performance by an automated position is highly restricted.
For processing a collect call, the automated position first announces to 25 the customer a request for selection of a call type and recognizes the requested command issued by the customer as a spoken "collect" or its DTh~IF equivalent.
This data is reported to the switch which makes a d~t~b~e check to ensure that the called customer is of a type that may accept collect calls. For example, pay phones and phones located in prisons typically are not allowed to accept collect calls.30 Certain countries will not accept collect calls. If the database check indicates that a collect call can be accepted, the automated position announces a request that the customer speak his or her name and records the response. The call is then set up to the called customer. When the called customer responds to an alerting (e.g., ringing) signal by going offhook, an announcement is transmitted from the automated 35 position to the called customer saying: "You have a collect call from" followed by the recorded name. The announcement continues: "If you wish to accept the 2050~6~

charges, please say yes". If the called customer says "yes" and this speech signal is recognized by the speech recognition unit, then a confirmation announcement is given, the call is completed as a collect call, and the switching system is notified by the automated position that the billing is to be arranged as collect call billing. The 5 called party is also offered the opportunity to say "no" or to go onhook if the charges are not accepted.
For a third number call, the automated position first requests the type of call. Upon detecting the words "third number" or their DTMF equivalent, the automated position requests the customer to supply the third number either by 10 keying the number on a DTMF station or by speaking the number. The automated position also requests that the caller speak his or her name, and records the response.
The automated position then reports the billing number and the call type to the switching system. The switching system checks databases to determine what type of verification is required before the call can be completed. Assume that the switching 15 system determines that it is necessary to consult the third party to verify that the third party is willing to pay. The switching system then sets up a connection to the customer station of the third number. After that customer station answers, the automated position announces to that station the identification of the call as a request that the third number pay for a call, followed by the recorded name of the caller, 20 followed by a request: "Will you accept charges for this call? If so, say yes". The response is then detected by the automated position which, if it detects a positive response, will signal to the switching system to set up the call. The third party is also offered the opportunity to say "no" or to go onhook if the charges are not accepted.
The automated position can access a remote database in essentially the same way that an opelator position does. The automated position sends the same kinds of messages and perforrns the same kind of data interpretation of the return message as is performed by an operator at a conventional operator position.
If a customer feels the necessity of invoking the services of a live 30 operator, the automated position is capable of detecting the word "operator" or DTMF 0 and responding to the detection of that input by signaling the operator ~si~t~nce switching system to connect the call to an operator position staffed by a live operator. This reconnection feature uses a feature that exists in AT&T's Operator Services Position System (OSPS) for transferring a call from one operator 35 position to another for invoking the services of an operator supervisor.

205036~

In accordance with one specific embodiment of the invention, the operator assistance switch is a switch arranged to interface with integrated services digital network (ISDN) terminals. The automated position interfaces with the twoB-channels and one D-channel of a basic rate interface of ISDN using one 64 kilobit 5 B channel for voice signals and using the 16 kilobit D channel for control and signaling signals and for database access.
Once the automated position has been installed, it is a relatively straightforward matter to increase the number and complexity of the scripts to be followed by such automated position groups because the protection in the switching 10 system against adverse results from receiving improper control signals from the operator position is already a basic part of the operator ~cci~t~nce switch. It is not necessary to modify the generic program of such a switch for accepting such additional scripts; the modification of the generic program requires great care in its introduction because a software error can cause the switch to fail.
Monitoring of the pelro~ ance of an automated assistance position is straightforward. Monitoring an operator in a system such as the Operator ServicePosition System (OSPS) which is a feature of AT&T's 5ESS(~ switch and is described, for example, in Document AT&T 5D5-520- 105, Operator Services Position System, Toll and Assistance Video Display Terminal Description and 20 Operation. This system has been arranged to allow any operator position to monitor any other operator position. Monitoring of an automated position from a monitoring operator position is performed in the same way. While monitoring, the monitoringposition receives all messages destined for the monitored position and receives all messages generated by the lllonitoled position. As a result, the introduction of a new 25 service can be tried on one automated position and the pelrollnance of that automated position can be monitored by a live operator sitting at a monitoring position. Alternatively, the automated position can be monitored by allowing an operator to bridge a headset across the voice signal path and to observe visual displays displayed on a screen of the automated position. Advantageously, this 30 arrangement allows for a straightforward and safe check of a new service feature.
In accordance with another feature of the OSPS, operator positions may be divided into teams and a flexible arrangement created for flowing traffic between these teams. This feature is known as intraflow and is described, for example, in AT&T 5ESS Switch Feature Handbook. When introducing a new feature, the new 35 feature is first introduced into a small number of automated positions which form a separate team and the performance of this separate team is carefully monitored. Any -6- 20~0364 excess traffic is handled by operator positions using the intraflow feature. After satisfactory performance has been established, the software for the new feature can be loaded into other automated positions which can then be added to the original team on which the feature was tested.
S In one embodiment of the invention, a voice processing unit and data processor serves four ports on the operator assistance switch, thus effectively sharing the unit over four automated positions. The number of ports served by a voice processing unit is a traffic engineering decision based on unit capacity and reliability requirements. This arrangement allows the voice processing unit and data processor to be shared, thus lowering per port cost of automated positions.The problem of providing a simplified arrangement for dialing frequently called numbers, when the caller is away from his home or office or isusing a mobile phone that has not been programmed with the appropriate numbers, is solved by connecting the caller to automated position means for recognizing a spoken command from the caller. These spoken commands are individually recorded for each caller and the commands are compared only with the command previously recorded for that caller. Advantageously, a connection is setup to a prespecified number in response to a spoken command from the caller.
The number which is used for accessing the caller's repertory of spoken commandsmay be preprogrammed into a mobile telephone unit so that commands which are recorded from the customer so that access to the appropriate voice recognition system is simplified. Advantageously, such an arrangement allows a caller, such as a busy attorney with frequent changes of clients, to record the telephone numbers of his or her current clients and to access these clients while away from home without having to remember their telephone numbers.
In accordance with one aspect of the invention there is provided in a switching system for connection to an attended operator position, a method of establishing a call comprising the steps of: responsive to receiving a number for identifying a calling customer, establishing a connection from said switching system to means for recognizing spoken commands for the identified calling customer;
recognizing a spoken command from said calling customer for identifying a numberof a called customer corresponding to said spoken command of said calling - 6a -customer, said spoken command being individual to said calling customer; and establishing a call to a telephone station identified by said identified number; and wherein said means for recognizing spoken commands communicate with said switching system by data messages essentially identical to data messages for communicating with said attended operator position.
In accordance with another aspect of the invention there is provided a method of establishing a call comprising the steps of: responsive to receiving a number for identifying a calling customer, establishing a connection to means for recognizing spoken commands for the identified calling customer; recognizing a spoken command from said calling customer for identifying a number of a called customer corresponding to said spoken command of said calling customer, said spoken command being individual to said calling customer; and establishing a call to a telephone station identified by said identified number; wherein the step ofestablishing a connection is executed in a switching system having a switching network with a plurality of ports for connection to an operator position and control means for controlling said network and wherein the step of establishing a connection comprises the step of establishing a connection to automated operatorposition means for recognizing said spoken commands and wherein the step of establishing a call comprises tran~ lg a message from said automated operator position means to said control means, said message being essentially the same as a -~ message from an attended operator position, for establishing said call.
Brief Description of the Drawin~
FIG. 1 is an overall block diagram of an operator assistance switch and a connected operator position and automated position group;
FIGS. 2-13 are flow diagrams of methods of processing operator assistance calls in conformance with the principles of this invention;
FIG. 14 is a block diagram of an automated position group; and FIGS. 15-18 are flow diagrams of a method for offering spontaneous voice mess~ging service and a simplified arrangement for dialing frequently called numbers in conformance with the principles of this invention.

Detailed Description The principles of the present invention may be understood by examining an exemplary embodiment. FIG. 1 is a block diagram of a system arranged to incorporate the present invention. The novel portion of FIG. 1 is an automated 5 position group, block 50, shown in heavy outline and expanded in FIG. 14. Block 1 represents a telecommunications switch operating under stored program control and having within it the elements necessary for practicing the invention. Switch 1 is a switch such as the 5ESS switch manufactured by AT&T Technologies, Inc., arranged to offer the Operator Services Position System (OSPS) features. The 5ESS
10 switch is described, for example, in AT&T Technical Journal, v. 64, no. 6, part 2, pp. 1305-1564, and the OSPS feature is described, for example, in Paper 3, Session 22C presented at the International Switching Symposium in May, 1984.
Within switch 1 are various blocks for carrying out the functions of a telecommunications switch. Control 10 is a distributed control system operating 15 under the control of a group of data and call processing programs to control various blocks of the switch. In order to practice the present invention, the operator services control programs must be augmented by programs described in the flow charts of FIGS. 2-13. Control 10 is used to control operations of switch 1. Block 12 is a voice and data switching network capable of switching voice and/or data between 20 inputs connected to the switching network.
In this embodiment, network 12 has integrated voice/data outputs in the Integrated Services Digital Network (ISDN) format. The switch comml-nic~tes withoperator positions over an ISDN connection with a Basic Rate Interface (BRI) forcon~llu.licating two B-channels (64 kbit~second (kb/s)) and one D-channel (16 kb/s).
25 The B-Channels are used for voice signals in this embodiment. Connected to the switch are a conventional operator position 24, ~ttende~ by a human operator, and automated position group 50, shown in detail in FIG. 14. The automated position group 50 serves four simultaneous calls and includes facilities for performing voice processing. The voice processing arrangement receives an input signal which may 30 be either voice or a dual tone multifrequency (DTMF) signal and has the capability for analyzing that signal to distinguish among the various allowable DTMF signals and among the individual elements of a predetermined list of spoken responses. The voice processing arrangement also generates tones and voice messages to prompt acustomer to speak or key information into the system for subsequent recognition by 35 the voice processing unit. In addition, the voice processing unit has the capability for recording a short customer response, typically, a name, for subsequent playback ~050364 to a called terminal. These recordings may also be saved for subsequent use in fraud detection. For example, evidence can be accumulated for stations with a high propensity for fraud. Within the automated position group, the voice processing arrangement generates an output data message, representing the result of the voice S processing; this output message is used as an input to a program in the automated position group for controlling the generation of position messages to the switch 10.
In response, the switch controls the establishment of connections in switching network 12 and generates display data for the automated position 50. The Conversant(~' Voice Information System, manufactured by AT&T Technologies, 10 Inc., is one unit which can be used to carry out the functions of the voice processing arrangement.
Two types of data base systems are used by switch 1 in order to set up operator assistance calls in conformance with the principles of this invention. Local data base system 16 is directly accessible by control 10 of switch 1 via switching 15 network 12. Remote data base system 20 is accessible to control 10 of switch 1 via switching network 12 and an interconnecting data network 18. A remote data base system is typically used for storing data that is shared by many switches. For example, a remote data base system might store data pertaining to customers for a region; the particular remote data base system that is accessed via data network 18 20 would be selected to be the remote data base system associated with the region of the called terminal. Interconnecting data network 18 can be any well known data network and specifically could be a common channel signaling system such as the the international standard telecommunications signaling system CCS 7.
Transaction recorder 22 is used for recording data about calls for 25 subsequent processing. This data typically is billing data which is subsequently sent over a data link to be processed by a billing processor in order to prepare customer bills. The transaction recorder is also used for recording traffic data in order to engineer additions properly and in order to control traffic dyn~mic~lly.
Operator position 24 connected to switch 1 comprises a termin~l for use 30 by an operator in order to control operator acsi~t~nce calls. Data displays for the terminal of operator position 24 are generated by control 10. Operator position 24 is connected to the voice and data switching network 12 by operator access facility 26 which may include carrier facilities in order to allow the operator position to be located remotely from switching network 12. Alternatively, operator access 35 facility 26 may be a simple voice and data access facility if the operator positions are located in close physical proximity to the switching network. Only one operator 20`5036~

position is shown in FIG. 1 but it is understood that a typical switch, arranged to offer operator assistance services, has access to a large number of such operator posltions.
It is often desirable that certain kinds of operator functions be assigned 5 to specialized teams. One example is Spanish-speaking operators who could be accessed by customers with English language difficulties whose native language- is Spanish. Another example is operators who have access to the special facilities required for setting up conference calls. Still another example is operators from a customer credit and service bureau who have access to customer billing records who 10 can handle customer requests for billing information and for credit in case acustomer reached a wrong number. In order to access the proper one of these operator teams, a customer's spoken comm~ncl, or, in the case of a customer with a DTMF terminal, a keyed command code is used. In some cases (not shown in FIG. 1) specialized teams may be attached to a different switch in which case an15 interconnecting network is used to connect the originating customer to that switch for connection to an operator from an appropriate operator tearn.
Connected to switch 1 are interconnecting networks 30 and 32. These are networks which may include one or more switches and which are used for interconnecting voice and data signals between customer terminals and switch 1.
20 Also connected to switch 1 are customer lines, including customer line 44, for connecting a calling terminal 42 to switch 1. The word "terminal" as used hereinincludes a simple customer telephone station, a customer station with more elaborate features such as magnetic stripe card readers, or a customer voice/data tçrmin~lCalling terminal 40 is connected through interconnecting network 30 to switch 1. In 25 this specific example, calling terminal 40 is connected by a customer line to a lAESS switch and that switch is connected to trunk 31 which is connected to switch 1. For the sake of clarity, a separate interconnecting network 32 is shown as being interposed between switch 1 and called terminal 46. In practice, interconnecting networks 30 and 32 are parts of a much larger common carrier 30 network. In the example call described below, interconnecting network 32 contains different switches from interconnecting network 30. Called terminal 46 is connected to interconnecting network 32 and via that network can be accessed by switch 1. If the calling terminal is not directly connected to switch 1, the directory number of the calling terminal, identified, for example, by automatic number identification, is 35 tr~ncmittecl from the switch connected to the calling termin~l to switch 1.

205036~

The term "operator assistance call" as used herein also refers to calls some of which are already automated. For example, Automated Calling Card Service (ACCS) has made it possible for customers having a DTMF terminal to place a calling card call without requiring the services of an operator. As discussed 5 hereinafter, other classes of operator assistance calls may also no longer require the service of an operator according to the principles of this invention. Thus, the term "operator assistance call" refers to those classes of calls which have in the past usually required the service of an operator, such as those which are dialed with an initial digit 0.
In order to illustrate the basic principles of the invention, a simple collect call from calling terminal 42 to called terminal 46 will be described. The customer at a calling terminal is referred to as a calling customer or caller. In this example, the called customer at terminal 46 has agreed ahead of time to accept collect calls but wishes to be informed when an incoming call is a collect call. The 15 caller at terminal 42 dials or keys 0, followed by the directory number of called terminal 46. This number which is dialed over customer line 44 is received in voice and data switching network 12 and passed to control 10 via control access 11.
Control 10 analyzes this dialed (using a dial terminal) or keyed (using a DTMF
terminal) number and recognizes that calling termin~l 42 has placed some kind of20 operator ~csict~nce call. In order to determine whether this is a calling card, third number (third), person-to-person (person), collect, Spanish-speaking (Spanish), conference, billing or other operator assistance call, it is necessary to connect the calling customer at terminal 42 to a port of automated position group 50. After this connection has been established, automated position group 50 returns a (promp~ g) 25 tone to calling terminal 42. In response to this tone, if the calling customer at terminal 42 has a DTMF telecommunications terminal, the customer will dial a two-digit command code identifying the class of the call to be placed as a collect call. If the calling customer does not have a DTMF terminal or chooses to speak, then thecustomer can speak one of the allowed call type phrases such as: collect, calling 30 card, person, third number, operator, espanol (to request a Spanish-speaking operator), conference, or billing, and, in this case, will say "Collect". If the calling customer fails to key in the command code or to speak the comm~ncl, he or she will be prompted by an announcement which says: "Please say collect, calling card, person, third number, espanol, conference, billing, or operator now." The keyed 35 command code, or the spoken command is analyzed by automated position group 50 which determines that a collect call is to be set up. The tone or announcement is - 2050~q used to prompt the calling customer to give the requested response. After a time, only the tone may be required since customers will learn to interpret the tone as a p~onlpling signal. To reassure the calling customer, that customer receives an announcement from voice processing unit 1405 (FIG. 14) of automated position 5 group 50, while the call is being set up, to indicate that a collect call is being set up from his terminal to the called customer.
A connection is then set up through interconnecting network 32 to called terminal 46. The characteristics of called customers, with respect to what kinds of collect calls they will accept, are stored in regional data base systems such as remote 10 data base system 20 which contains data for called termin~l 46. Other kinds of originating and terminating customer data are stored in local or remote data base systems as convenient. System 20 is queried before the connection to the called customer is being established. For this example call, the query indicates that the called customer will accept all collect calls but wishes to be informed that an 15 incoming call is collect.
When called terminal 46 answers, the answer signal is tr~n~mittecl back to switching network 12 and is passed to control 10 via control access 11. When control 10 receives this answer signal, control 10 sets up a connection in switching network 12 from automated position group 50 through interconnecting network 32 to 20 called terminal 46 to announce to the called customer that this is a collect call. Since called customer 46 has agreed in advance to accept all collect calls, the call between calling terminal 42 and called terminal 46 may be set up through switching network 12 after this announcement has been received by the called customer. Note that this exemplary call has been established without requiring the services of an 25 operator.
Customers may specify that they will accept all collect calls, that they wish to decide without further data whether or not to accept each collect call, that they want to know the name of the calling party and wish to decide for each call, or that they will accept no collect calls. Alternatively, an announcement to the called 30 customer announcing a collect call could include the area code, the geographic locality, or the full directory number of the calling customer in order to supply the called customer with further call data that he can use in order to decide whether to accept the call, or could include a recording, made in the automated position group by the caller, of the caller's name.

In this specific embodiment, automated credit card calls are detected in parallel with other types of automated operator calls. This is in contrast with the present arrangements wherein card calls are detected first when a customer keys a calling card number in response to an initial "bong" tone. A disadvantage of this 5 arrangement is that ACCS calls must be routed to an automated position thus utilizing the more expensive resources of an automated position instead of beingconnected to a DTMF detector. The advantage of the operation disclosed herein isthat there is no need to wait for a timeout following the ACCS tone before attaching the automated position thereby providing faster service to customers for calls other 10 than ACCS. An additional advantage is that the switch owner can modify the treatment of ACCS calls within the automated position without changing the control program of the switch.
FIGS. 2-13 are flow diagrams of the process of handling operator assistance calls under the control of the automated position group 50 and the 15 control 12 of the switch. The process begins when a customer dials 0 plus a directory number. (Calls to 0 with no further numbers are routed to operator positions since they may be emergency calls.) The customer is then connected under the control of 12 to an automated position (action box 200, FIG. 2). The automated position returns a tone to the caller (action box 202). The next action of the 20 automated position depends on the input from the calling customer (decision box 204). If the calling customer speaks, the program executes a transfer to box 214, discussed further below. If the calling customer keys DTMF signals into the system, test 206 is performed. Test 206 determines whether the numbers represented by the customer's keyed tones correspond to one of the codes used for identifying the class 25 of an operator assistance call, a telephone number, or the format of a calling card number, or none of these. If the tones correspond to the format of a calling card number, the number is passed to the switch (action box 211) and standard ACCS
tre~tment of the call is invoked (action box 212). With this standard treatment, the calling customer's calling card number is checked for validity, and, if the calling 30 card number is valid, the call is completed. Command codes are assigned to identify classes of operator assistance calls; the example classes are operator (O), collect (C), calling card (K), person-to-person (P), third number billing (T), Spanish (S), multi-party conference (M), and billing credit (B). The codes for these classes of calls might, for example, be the digits 11-18, the digits 19 being reserved for 10 additional 35 services, identified by l9X. 1 is a preferred initial number for these codes since this number can never be the initial number of a calling card or telephone number. By 205û364 using 1 as the initial digit, it is not necessary to time for possible additional digits after a two-digit command code has been keyed. The present embodiment of the invention can therefore be used without interfering with ACCS treatment of credit card calls. In terms of the flow chart, once one of these codes is recognized, the 5 applupliate subroutine for handling this type of call is entered. These subroutines have been called O for operator (subroutine 400), C for collect calls (subroutine 700), K for calling card calls (subroutine 600), P for person-to-person calls (subroutine 500), T for third party billing calls (subroutine 900), S for Spanish-speaking operator (subroutine 1000), M for multi-party conference operator 10 (subroutine 1100), and B for (billing) customer credit and service bureau operators (subroutine 1200).
The automated calling card service program including blocks 211, 212, 220, and 224 are performed under the control of switch control 12. First, the calling card number that has been keyed is passed from the automated position to the switch 15 controller 12 (action block 211). The switch controller 12 applies standard ACCS
checks (action block 212). These checks include a check for the correct number of digits, a query of a remote data base to ensure that the account number is valid, and a check that card billing is allowed from that calling number to that called number. If the calling card is found to be valid in test 220, then the call is processed by a 20 program for processing ACCS calls that is a part of the program of control 12 (action block 224); checks for possible spontaneous voice mess~ging are performed as described hereinafter with respect to FIG. 15. If the calling card number is not valid as determined in test 220, then the actions to be described below for ~prolllpl announcements starting with action block 302 are performed in the automated 25 position.
If no code is recognized (test 206) or if no tones have been transmitted from the customer to the system within a predetermined interval (timeout, actionbox 205), the voice processing unit 1405 (FIG. 14) of automated position group 50 returns a prompt announcement such as "Please say collect, calling card, person,30 third number, espanol, conference, billing, or operator now," and awaits a response by the calling customer (action box 208). If tones are detected when this announcement has been made, test 210, similar to test 206, is performed. Test 210 checks the code represented by the tones keyed by the calling customer. If thesetones correspond to a calling card number, the program executes a transfer to action 35 boxes 211 and 212 in order to apply the standard Automated Calling Card Service (ACCS) treatment. If one of the operator assistance command codes is recognized, a transfer to the corresponding subroutine is executed. If an unrecognized code has been keyed, a transfer is executed to subroutine R (subroutine 300, FIG. 3) to give the calling customer a leplolnpt announcement.
If decision boxes 208 or 204 recognize speech, then this speech is 5 analyzed (decision box 214) in order to detect one of the types of operator acsist~nce calls, or to detect that the speech signal is inadequate to properly classify the type of operator ~csi~t~nce call. If a request for one of the classes of operator assistance calls is recognized, then a transfer is made to one of the subroutines O, C, K, P, T, S, M, or B; if no command corresponding to an operator assistance call is so 10 recognized, a transfer is made to subroutine R (subroutine 300, FIG. 3) for a repl~ pt announcement.
If, at the time that the caller response is analyzed in decision box 204, a customer flash is recognized, a transfer is made to subroutine O (subroutine 400, FIG. 4) in order to connect the customer to an operator. A customer may flash in15 order to be connected to an operator. Similarly, if, following the prompt announcement (decision box 208), the customer flashes, a transfer is made to thesubroutine O (subroutine 400, FIG. 4). If the customer does nothing following the prompt, a timeout is detected in action box 216 and a transfer to subroutine O
(subroutine 400, FIG. 4) is executed in order to connect the calling customer to an 20 operator.
FIG. 3 illustrates the actions performed by the program in case the customer response is unrecognizable speech or an unassigned pair of DTMF signals.
The first step of subroutine R (300) is to repro,l-pt the caller with an announcement and listen for a response (decision box 302). If tones are recognized, test 304,25 analogous to tests 206 and 210, is performed. Test 304 checks for a calling card number, in which case, after checking (306) and validating (test 308) the calling card, standard automated Calling Card Service tre~tment is applied (action box 312), or one of the codes representing classes of operator ~sist~nce calls is recognized, in which case a transfer is executed to one of the subroutines O, C, K, P, T, S, M, or B.
30 If an invalid calling card number is supplied, action block 302 is reentered. Along with the execution of block 312, checks for possible spontaneous voice messagingare performed as described hereinafter with respect to FIG. 15. Finally, if following the lepr~ pt announcement to the caller, a number is keyed which does not correspond to a legitim~te code, the calling customer is connected to an operator 35 (transfer to subroutine O, 400, FIG. 4). Similarly, if a flash is recognized while the customer is responding, a transfer is made to subroutine O to connect the calling --lS- 20503g4 customer to an operator. If speech is recognized, the speech is analyzed in decision box 314. The decisions for decision box 314 are the same as those for decision box 214 except that in this case, if after the reprolllpt announcement to the caller the speech data is still unrecognized, the calling customer is connected to an operator.
S Alternatively, at the choice of the switch owner, the call is termin~te~1 after failure.
If the customer says nothing, does not key in a tone signal and does not flash, then action box 316 detects a timeout and the customer is connected to an operator.
The r~lu~ t announcement routines of decision box 302 are invoked in large part because of the imperfect characteristics of automatic speech recognition.
10 Whereas it is possible to detect tones with essentially 100 percent accuracy, it is not always possible to make a correct determin~tion of a customer's spoken comm~n-l The use of a reprompl announcement and decision box 302 allows a second i~lçntification of the customer's command based on a new speech sample. It is possible that human factors tests may indicate that the repro,l,pt announcement 15 should state the suspected spoken term, if any. (For example, the announcement may say: "Did you request a collect call?") Recognition of some spoken command may be forced or a "no command recognized" state allowed.
FM. 4 indicates the actions to be carried out if the calling customer is to be connected to an operator. Subroutine O (400), first retrieves data about the calling 20 number, the called number, and any other pertinent data about the status of the call so that the operator is fully informed and prepared to deal with the calling customer.
Data about either party, but especially the called party, may be obtained from aremote data base system such as data base system 20 (FIG. 1). This data includesrestrictions on either the calling or the called customer (for example, that the calling 25 customer can only make collect calls or that the called customer will not, or, because it is a public coin station, cannot, accept any collect calls). Next, the calling customer is connecte~l to the operator whose operator position has been initi~li7ed with that subset of the data retrieved in action box 402 (action box 404) which is pertinent to this type of call. The term "pertinent data" as used herein refers to that 30 subset of accessed data which is pertinent to the call. Subsequently, the operator processes the call in a standard manner.
FIG. S represents subroutine P (500), the program used for controlling person-to-person calls. The first step (decision box 502) is to retrieve data concerning called and calling parties and determine if there are any restrictions on 35 either party to make person-to-person calls or receive such calls. For exarnple, many prisons allow their inmates to place only collect calls; the operator processing a person call needs to know of this restriction. If a person call is allowed, then an announcement is returned to the calling party (action box 504). This announcement will indicate to the calling customer that the call is being set up. In parallel with this announcement a connection is set up from switch 1 to the called customer. Test 506 5 determines whether the called customer answers. If the called customer does not answer within a predetermined interval, checks for possible spontaneous voice mess~ging are perforrned as described hereinafter with respect to FIG. 15. If the calling customer disconnects before that predetermined interval, the call is similarly disconnected. If the called party answers, then the called party is connected through 10 switching network 12 to an operator position which has been initialized with the pertinent data that has been collected for the person-to-person call (action box 510).
The operator may then talk with either the calling or the called party, but under operator control the calling and called parties cannot talk to each other. Based on input received by the operator in talking to the two customers, the operator will 15 either allow the call to be completed or will disconnect the call. It is desirable to connect person and collect calls in such a way that until billing is verified, the calling and called customers are not connected, and that for bill to third number calls, the calling and third number customers not be connected. This prevents un~uthorized and unbillable co....~ ic~tions between the calling and called or third number 20 customers, as well as some more complex fraud schemes.
In setting up a person-to-person call in accordance with the methods described herein, it is important that an operator be attached quickly once the called customer picks up. While operator assict:~nce calls are normally placed in an operator assistance request queue to handle calls in an orderly fashion based on time 25 of arrival of the call, person-to-person calls processed as described herein may be placed in a special priority queue to reduce sharply the interval from the time that a called customer answers until an operator is attached to the call. As soon as the called customer answers, the call may be placed in the priority queue and an announcement may be connected to the called customer which states: "Please hold 30 for a person-to-person call." As soon as an operator is available, that operator is connected to the calling customer in order to ascertain the identity of the desired called customer. The operator then requests a connection to the called customer and can talk to either the calling or the called customer without having the calling and called customers talk to each other. The operator ascertains whether or not the call 35 should be completed and the call is either completed or disconnected in accordance with the operator's keyed request.

~050364 Note that the automated position could handle the functions of either or both of the MECH operators (referenced in the second paragraph of the Problem statement) according to the quality of the speech recognition equipment and the cost of the automated position, without changing the program of the operator assistance 5 switch. The flexibility offered by an automated position which, effectively, mimics a limited set of operations of an operator position makes this possible.
If the calling customer is violating a restriction in attempting to place a person-to-person call (detected in decision box 502) an announcement is returned to the calling customer (action box 520). If the calling customer then hangs up, the call 10 is simply disconnected. If the calling customer does not hang up within a predetermined interval, then, at the option of the telephone company, the calling customer can either be automatically disconnected or can be connected to an operator whose position will have been initi~li7e~ with a display containing thepertinent data necessary to communicate with the caller about this call (action 15 box 522).
FIG. 6 is a flow diagram of subroutine K (600) for controlling certain calling card calls. Subroudne K of FIG. 6 is entered if the calling card customer is not calling from a DTMF terminal, but wishes to place a calling card call, or if the customer, for some other reason, wishes to speak instead of keying the calling card 20 number. (An alternadve version of subroutine K, namely, subroutine K' (1300), is shown in FIG. 13 and is described hereinafter.) Decision block 602 describes theinitial acdons carried out for such calls. The system retrieves data concerning the calling and called customer to see if there are any restricdons, and determines whether a calling card call is allowed. If a calling card call is allowed, then the 25 control 10 is primed to receive a calling card number keyed in from the operator, i.e., to interpret nllmeric~l data keyed in by the operator as represendng a calling card number. A connecdon is set up between the calling customer and the operator whose posidon has been initialized with a display indicadng the characteristics of the call and addidonal perdnent data about the calling and called customers (acdon 30 box 604).
If it is determined that a calling card call is not allowed, then an announcement is returned to the calling customer (action box 606). If the calling customer hangs up, the call is disconnected; otherwise, after a predetermined interval, the calling customer is either automatically disconnected or connected to an 35 operator whose operator position has been initi~li7ecl with the perdnent data (action box 608) so that the operator can explain to the customer what happened.

For serving calling card calls, it may be desirable to recognize "credit card" as well as "calling card" as a legitim~te comm~nd Many customers still usethe term "credit card" when they refer to a telephone calling card.
FIG. 7 is a flow diagram of subroutine C (700), the program used for 5 processing collect calls. Initially, (decision block 702) the data for the calling and called customers is obtained in order to check for restrictions. In this case, the restrictions tend to be dependent on the called customer as described with respect to the example call. An initial record is made using transaction recorder 22. If collect calls are allowed then an announcement is connected to the calling customer. This 10 announcement requests the calling customer to speak his/her name so that the name can be recorded for possible subsequent tr~n~micsion to the called customer (action box 704). (Alternatively, the actions of blocks 704 and 706 can be deferred to precede block 802 in order to avoid incurring access charges unless absolutely necessary. The same remark applies to moving blocks 907 and 909 to precede 15 block 927.) The call is then set up and an announcement confirming reception of the calling customer's name response is returned to the calling customer (action box 706). Test 708 checks whether the called party answers before a predetermined interval has elapsed. Then test 710 is performed to select among the options of the called party. If the called party accepts all collect calls, then optionally an 20 announcement is connected to the called party to announce that a collect call is being set up to the called customer (action box 712) and the call is completed (actionbox 714). If the called customer wants to make a decision on every call as to whether or not she/he will accept the call but does not require the name of the calling customer, then the called customer is connected to an announcement (action 25 box 720). The announcement might announce a message such as: "You have a collect call, will you accept charges, yes or no". The voice processing unit which has already been used for making the announcement is then primed to listen for acalled party response (decision box 722). If the called party responds a "yes", either verbally or by keying, say, a 9 (= Y for "yes"), recognized by the automated position, 30 then the call is completed (action box 724). If the called customer announces "no", either verbally or by keying a 6 (= N for "no") recognized by the automated position or by disconnecting, then an announcement is returned to the calling customer and the call is disconnected (action box 726). If the automated position either does not recognize the called customer's response, or recognizes it but recognizes it as not 35 being either yes or no, or if no response is made by the called customer within a predetermined interval (timeout, action box 727), then both the calling and the called customers are connected to an operator position which has been initialized with a display indicating the status of the call and the pertinent data, in such a way that either the calling or the called customer can talk to the operator, but that the calling and called customers cannot talk to each other. The operator may then take 5 appropriate action to either disconnect the call or to let the call complete with appl~liate charging (action box 728). If the called party has selected the name required option, a transfer is made to subroutine N (800) described with respect to FIG. 8.
If the called customer does not answer within the predetermined 10 interval, checks for possible spontaneous voice messaging are performed as described hereinafter with respect to FIG. 15.
If no collect call is allowed to this called customer, for example, if the called customer terminal is a public coin station, then an announcement is returned to the calling customer (action box 740) and if the calling customer fails to 15 disconnect within a predetermined interval, the calling customer is either automatically disconnected or connected to an operator whose display indicates the status of the call and pertinent data (action box 742).
Using this arrangement, it is also possible to implement a service similar to present "Enterprise" service, a type of "automatic" collect call, without requiring 20 the use of an operator. The data base for the called customer indicates for which originating area plus office codes the called customer will accept collect calls. Calls from one of these area plus office codes are then automatically accepted.
Part of the reason for making an initial transaction record as one of the first steps of subroutine C (700) is to allow for possible attempt charges for collect 25 calls not completed because of a restriction or decision by a called customer.
FIG. 8 is a flow diagram of subroutine N used to control collect calls where the called customer has requested that collect calls be announced including the calling customer's name. The announcement of the collect call, in this case, will also include the caller's name previously recorded in action box 704 of FIG. 7 30 (action box 802). The automated position is then primed to listen for the called customer's response (decision box 804). If the response is recognized as "yes" or keyed 9, the call is completed (action box 806). If the response is recognized as "no"
or keyed 6, then the previously cited announcement is returned to the calling customer and the call is disconnected (action box 808). Finally, if the response of 35 the called customer is either unrecognized or represents an unassigned phrase (i.e., neither yes nor no) or if no response is detected within a predetermined interval ~950~6b (timeout, action box 809), then the calling and called customers are both connected (action box 810) to an operator position which is initi~li7e~ with a display indicating the status of the call and pertinent data retrieved in decision block 702 (FIG. 7). The operator can then make a decision as to whether to complete the call or disconnect 5 the parties. As in the case of action box 728, the called and calling parties cannot talk to each other while both are connected to the operator position.
FIG. 9 is a flow chart of subroutine T (900) for controlling calls to be billed to a third party. A prompt announcement is returned from the automated position which then listens for a response (action block 902). If the response is 10 "operator" then routine O is entered. If the customer flashes, routine O is entered. If there is a timeout (action block 903) then routine O is entered. Finally, if tones are detected, these are acc~lm~ te~l and tested to see if they represent a valid third number (test 904). If not, the customer is given a leplolllpt (action block 905)requesting that the third number be keyed. If, in response to this, the customer15 flashes, times out, or says "operator", then~ the routine O is entered. If the customer keys a number, this number is tested to check if it is a valid third number (test 913).
If not, an announcement is played to the customer from the automated position (action block 915) and the call is disconnected (action block 917). If a valid third number has been recognized in test 913 or in test 904, then the customer is prolllp~ed 20 to announce his or her name (action block 907). This is recorded. The third number keyed by the customer is sent as a data message to switch control 10 (action block 909). Switch control 10 then det~rmines whether a verification of the request to charge that number is required (test 911). If no verification is required, the call is set up to the called number (action block 919) under the control 10 of switch 1 and 25 the automated position is disconnected. If verification is required, the connection is set up to the third number (action block 921~. Test 923 determines whether the third number answers. If not, then an announcement is returned from the automated position and the call is disconnected or, according to the option of the operating telephone company, the call is set up to an operator position (action block 925). If 30 the third number does answer, then the type of call is announced and the third party is prompted to speak or key an acceptance (action block 927). The automated position listens for a response from the third party (action block 929). If no response is forthcoming, then the actions previously described for action block 925 are carried out. If the third party responds with a "yes" or keys DTMF 9, then the third number 35 is released and the call is set up to the called number (action block 933), checks for possible spontaneous voice messaging are perforrned as described hereinafter with 2050~64 respect to FIG. 15. If the third party responds "no" or keys a DTMF 6, then the actions previously described with respect to action block 925 are carried out. If the third party does not respond, a lcprolllpt is given from the automated position (action block 931). If, in response to the leplompt, the third number answers "yes" or keys S in DTMF 9, then the call is set up as previously described with respect to action block 933. If, in response to the lcprolnpt, the third number replies "no" or keys DTMF 6, or does not reply, then the actions previously described with respect toaction block 925 are carried out.
FIGS. 10-12 deal with calls requiring the use of special operator teams.
10 Three types of special operator teams are described herein: a Spanish-speaking team for handling operator assistance calls from customers who prefer to use Spanish in their commllnication with telephone operators, a second team for setting up conference calls, and a third team associated with a customer credit and servicebureau for h~n~lling customer inquiries on billing and for handling requests for15 refunds. Other specialized teams such as teams speaking languages other than English and Spanish could also be used for handling special categories of calls.Furthermore, it may be desirable to have operator teams which specialize in particular classes of operator ~csict~nce calls such as a team which specializes in person-to-person calls. The use of access codes keyed by customers with DTMF
20 terminals, or spoken comm~nds, can be used to route calls to an apprupliate team. In order to utilize operators most efficiently, it may also be desirable to have traffic flow between teams where there is a temporary overload on one of the teams.
FM. 10 is a flow diagram for subroutine S ( 1000) for responding to a spoken or keyed request for a Spanish-speaking operator. The system first retrieves 25 the call data for the originating customer and data associated with the called number in order to prepare to set up an initial display for the operator who will handle this call. In addition, an initial transaction record is made in order to prepare for future billing of this call (action box 1002). Next, a test is made (decision box 1004) of whether a Spanish-speaking operator (i.e., an operator on the specialized Spanish-30 speaking team) will be available within a predetermined interval. If so, then thecustomer is connected to a Spanish-speaking operator (i.e., a member of the specialized Spanish-speaking operator team) whose operator position has been initi~li7erl with the display of pertinent data generated by the control of switch 1 (action box 1006). Thereafter, the call is processed in essentially the same way as 35 calls to the general operator (as described with respect to FIG. 4). If no Spanish-speaking operator is available within the predetermined interval, as indicated by the length of the queue of requests for a Spanish-speaking operator, then the call is connected to a general operator whose position will be initi~li7e-1 with the applvpliate display of pertinent data (action box 1008). This general operator will then handle the call in the same way as other general operator ~s~ist~nce calls.FIG. 11 is a flow diagram of subroutine M (1100) which is entered when a customer either dials the access code for a conference call operator or when the customer speaks the word "conference". FIG. 11 is very similar to FIG. 10 exceptfor the fact that the conference operators have access to special facilities notavailable to members of some other operator teams for setting up multi-party 10 conference calls. Initially, the system retrieves the account data for the calling customer and, if the calling customer has already dialed at least one number of a multi-party conference call, then establishes a connection for any such called customers on this call. The system then makes an initial transaction record for subsequent billing processing (action box 1102). Next, decision block 1104 shows a 15 test to see whether a conference operator will be available within a predçtennined interval. This test is based on the length of the queue for conference operator requests. If a conference operator will be available within a predetermined interval, then as soon as a conference operator is available the calling customer will be connected to a conference operator; the operator position will be initi~li7~d with the 20 display of pertinent data gathered by the control of switch 1 (action box 1106).
Otherwise, if no conference operator is available within the predetermined interval, the calling customer will be connected to a general operator whose operator position will be initi~li7ed with the applopliate display of pertinent data (action box 1108).
FIG. 12 is a flow diagram of subroutine B (1200) entered when the code 25 for a request for an operator from the customer credit and service bureau has been keyed by a customer with a DTMF terrninal or the word "billing" has been spoken by a customer. In order to reduce the work time of an operator from this bureau, a prompt announcement is returned to the calling customer requesting the number ofthe account to receive credit. This number, in general, is the customer's directory 30 number, but may also be a third number which is to receive credit in case thecustomer query is with respect to a bill to third number call, or may be a calling card number (action box 1202).
In response to the prompt announcement, the customer who is connected to an automated position (action block 200) may key in a number if he has a DTMF35 terminal, may speak a response, may flash, or may do nothing. Test 1204 detçrmines which of these actions has been taken by the customer. If the customer keys in a 205~364 number, test 1206 is used to determine whether the number is a valid account number. If the number keyed in is a valid account number, then an announcement is returned to the caller stating the account number to allow the customer, to verify that the proper account is being handled, and data is retrieved from the data base of the 5 customer credit and service bureau (action box 1208). One way that this data could be retrieved is if the data were located in a remote data base such as data base 20, accessed via data network 18 (FIG. 1). From the retrieved data the restrictions on the calling customer are determined and the system then makes an initial transaction record of this call (action box 1208). This initial transaction record is available for 10 possible use in generating traffic data, and, as an initial record for possible use in conjunction with additional information, to provide appropriate credit to the proper account. Such initial records may also be useful to identify customers who generate excessive numbers of billing requests. The initial transaction record may also contain data which can be useful for subsequent analysis in order to identify possible 15 sources of fraud.
At this point, the system is ready to connect a credit operator and in test 1210 a determination is made whether a credit operator will be available within a predetermined interval. If a credit operator (i.e., an operator from the customer credit and service bureau) is available, a connection is set up from the calling20 customer to the credit operator; the credit operator position is initi~li7ecl with a display of the pertinent data gathered by the system (action box 1212). If no credit operator will be available within the predetermined interval, the customer is connected to a general operator whose operator position will be initi~li7ed with the applopliate display of pertinent data (action box 1214).
Returning now to test 1204 which checks on the response of the calling customer to the prompt announcement, if the calling customer's response is a spoken message, this message is analyzed (decision box 1220). If the message consists of a series of numbers representing a valid account number, then action box 1208 is entered in order to return an announcement to the customer stating the account 30 number, to retrieve account data, and determine restrictions and make an initial record as previously described. If the customer's message consists of the word "operator", then the system retrieves the account data for the calling customer terminal, determines the calling customer restrictions and makes an initial transaction record (action box 1222). At this point, the system is ready to set up a 35 connection to a credit operator by entering test 1210 for credit operator availability as previously described.

The action box 1222 is also entered if the customer's speech is not recognized by the system as representing an account number, in the same way as if the customer had spoken the word "operator". Also, if the account number spoken by the customer or keyed by the customer is not valid, then, action box 1222 is S similarly entered. Finally, if the response to the prompt announcement as determined by decision block 1204 is either a flash or the customer fails to respond within a predetermined interval as detected by time out block 1224, action box 1222 is similarly entered.
Note that the facilities of the voice processing unit are used extensively 10 in this subroutine to minimi7e the amount of data which is transmitted verbally from the calling customer directly to the credit operator; as a result, the work time of the credit operator is substantially reduced.
FIG. 13 is a flow diagram of an alternate method of handling calling card calls by customers who have not keyed in their calling card number. In the 15 alternate method of FIG. 13, represented by subroutine K' (1300), spoken calling card numbers are recognized. The initial step (action box 1302) for subroutine 1300 is the same as the initial step (action box 602) for subroutine 600. Further, if it is determined that no calling card call is allowed, the actions represented by action box 1306 and 1308 are the same as the action boxes 606 and 608 of subroutine K
20 (600). However, if a decision is made that a calling card call is allowed, then a prompt announcement is returned to the caller (action box 1310). The caller response is analyzed (decision box 1312). If the caller has keyed tones, test 1314 determines whether these tones represent a calling card number: if not, the customer is connected to an operator, if so, after checking (action block 1316) and validating 25 (test 1317) the calling card number, standard automated Calling Card Service tre~tment (action box 1319) is accorded to the calling customer, checks for possible spontaneous voice mPs~ ing are performed as described hereinafter with respect to FIG. 15. If the number is not valid (negative result of test 1317) the system returns control to action block 1310. If the caller's response to the prompt announcement is 30 either a flash or no response within a predetermined interval (timeout, action box 1313), then subroutine O is entered and the caller is connected to an operator. If the caller speaks, this speech is analyzed in decision box 1320. If the speech is interrupted by a flash or the customer's response is anything else other than a calling card number, or if the customer does not respond within a predetermined interval, 35 subroutine O is entered and the calling customer is connected to an operator. If the calling customer speaks a calling card number, this number is repeated back to the caller (action box 1322) along with a request that the caller verify the calling card number. The caller's response is analyzed in decision box 1324. If the response is recognized as "yes", then standard automated Calling Card Service treatment is provided for this call (action box 1316). If a "no" is recognized or any other speech 5 is recognized, or if there is no response within a predetermined interval (timeout, action box 1326), a transfer is made to subroutine O and the customer is connected to an operator. If experience in~içates that it is not necessary to repeat calling card numbers to the calling customer, this step can be bypassed at the option of the telephone company. This is entirely possible since all calling card numbers are 10 verified and it is unlikely that recognition errors would result in a valid calling card number.
Note that in all of the sequences described above, a customer is connected to an operator if a customer having a DTMF terminal keys a 0, if a calling customer flashes, or if the automatic speech recognition system fails to recognize an 15 app~ liate expression after appropriate leplolllpt tones or announcements.
While this description has been in terms of having customers key longer sequences of digits such as calling card numbers or third numbers, it is also possible to have customers, especially those calling from rotary dial stations, speak thenumbers and to use the automated position to recognize the spoken numbers. The 20 sequences following the recognition of a series of spoken numbers are essentially the same as the sequences following the recognition of a series of DTMF signals. Theinvention described herein may be readily updated to incorporate improved speechrecognition technology to recognize long strings of digits as such technology becomes available.
FM. 14 is a block diagram of an automated position group 50. The automated position group is connected via four ISDN digital subscriber lines grouped into entity 49 to corresponding ISDN T-interface line cards 1417 in switching network 12 of the operator ~csi~t~nce switch. Each of these digital subscriber lines is terrnin~e-l to an ISDN Personal computer Interface Board (IPIB) 1401. This personal computer interface board 1401 has as outputs both a D-channel output 1421 for conveying data messages bet~veen the switching network and the control equipment of the automated position group and a voice-channel output 1423 for commllnica~ing with an automated position TIP/RING (T/R) interface module 1403. The interface module 1403 includes common circuits 1404 35 for interfacing to the time division multiplex bus 1415 and to four individual voice interface circuits 1402 for interfacing with the B-channels of the four ISDN interface .

boards 1401. The T/R interface module 1403 reconverts the analog voice-channel output of the IPIB to a digital signal; provides a line-equivalent balancing network (in contrast to the IPIB which provides an operator position equivalent balancing network); and provides the equivalent of DTMF receivers for detecting DTMF. The 5 B-channel carries voice signals and DTMF tones from the calling or called customers connected to the line card 1417. The TIP/RING interface module 1403 conveys voice signals to time division multiplex bus 1415 for communication to the speech processing board 1405. The speech processing (SP) board processes speech signals and communicates with personal computer 1407 over an Advanced 10 Technology (a common PC state of the art) bus 1413. The SP provides announcements and prompts, and receives spoken input which it processes to recognize the words of that input. It is also used for recording a spoken name (for example, for collect calls) and applies speech recognition grammar rules. Bus 1413 is a 32 bit PC bus for communicating among the blocks connected thereto. Local 15 Area Network (LAN) interface 1419 is used to control bus 1413. The speech processor board i~entifies the spoken input and passes this data to PC 1407 which applies additional grammar checks using a software data interface process.
Memory 1409 is a PC expansion memory, a random access memory (RAM) to provide adequate RAM for the PC. The disk 1411 is a standard PC disk used for 20 storing system software, drivers, program, office data, and digitized announcement and prompting phrases. The PC co,~"~ icates data messages over one of the D-channels 1421 to one of the line cards 1417 and receives messages from the operator assistance switch over the same D-channel. A particular call is associated with a particular D-channel and line card while being served. The messages that are 25 exchanged over this D-channel are exactly the same messages as are used in co~ lunicating with an operator position staffed by a human being and used for controlling the display of that operator position and for sending data representing information keyed by the operator to the operator assistance switch.
The arrangements of FIGS. 1 and 14 can also be used to offer 30 spontaneous voice message service. If these arrangements are used for this purpose then the call completion action blocks are au~m~nted by the sequence of the actions shown in the flow diagram of FIGS. 15-16. The augmentation is to offer spontaneous voice mess~ging service in case the call cannot be completed becausethe called party is busy or does not answer.

205~36~

Test 1502 is used to represent a test to check whether the switch offers spontaneous voice message service. In practice, such a test would not be required since if the switch did not offer spontaneous voice message service, the details of FIGS. 15-16 simply would not be implemented. However, to show the flow of 5 actions, if the switch does not offer spontaneous voice message service, then the automated position is released (action block 1504) and the call is set up in theconventional way (action block 1506). If, however, the switch does offer spontaneous voice message service, then the call is set up but the connection to the automated position is m:3int~in~1 (action block 1508). The call being set up is 10 monitored from the automated position (action block 1510). If a disconnect isdetected the call is disconnected (action block 1512). If an answer is detected, the call is completed conventionally (action block 1514). If a busy signal is detected or a timed no-answer is detected, then an offer to set up a VMS call is announced to the caller (action block 1516) from the automated position (action block 1516). During 15 the announcement, if an answer is detected then the call is completed conventionally (action block 1514). If a spoken "no" is detected, the spoken "no" is ignored (action block 1517) in order to allow the caller to wait for a possible answer and to detect a disconnect leading to the disconnection of the call (action block 1512) after the customer stops waiting. However, if the customer, after responding "no" to the VMS
20 prompt, continues to wait for a possible answer and exceeds a specified time-out period, the caller will be p~olllpted for a final time ti.e., 1516), if a "no" is detected, the call will be disconnected (i.e., 1512). If a spoken "yes", a keyed 9 (for y or yes) or a keyed *867 (equals *VMS) is detected, then the forward connection to the called customer is released (action block 1518). The same action is performed if the 25 calling customer keys *867 prior to the time of a timed no-answer. Following action block 1518, a test is made to see if the call is a collect call (test 1520). It would be against telephone company policy to allow collect calls for voice message calls since the voice message recipient has no opportunity to deny the collect call. It is, of course, possible in the future that a check can be made to see if the called number 30 accepts collect voice message calls in which case a positive result of such a test would be treated in this flow chart as the equivalent of a "no" on the collect call test.
At any rate, if the output of test 1520 is positive, then an announcement is made to the caller to offer a calling card option (1522). If this offer is refused (as detected by a disconnect or the absence of a spoken "yes" or keyed 9) then the call is 35 disconnected. If the offer is accepted, then the call is completed as a VMS calling card call including obtaining the customer's calling card number. Further, details of 205036~

special call types are entered in the record of the voice message call to prepare for the special call delivery option described with respect to FIG. 17. If the call was not a collect call, a test is made whether the call was a calling card call (test 1526). If so, then the actions of block 1524 excluding the actions of obtaining the calling card 5 number are performed to complete this as a VMS calling card call.
If this was not a calling card call, then alternate billing is offered for this VMS call (test 1528). If the offer is accepted by the customer saying "yes" or keying a DTMF 9, then action block 1531 is executed. Otherwise, action block 1530 is executed and the VMS call is completed using the present type of billing. This 10 action includes recording special call type details if necessary. Action block 1531 is an announcement asking how the calling party would like to pay for the call. If the calling party says "station paid" or keys DTMF 1, then test 1532 is executed. If the calling party says "calling card" or keys DTMF 2, then action block 1524, previously described, is executed. If the calling party says "bill to third" or keys DTMF 3, then 15 action block 1539 is executed. Otherwise the call is disconnected (action block 1512). Action block 1539 requests the third party number and checks for acceptance in generally the same way as discussed previously with respect to blocks 923 et seq. If the charge is accepted, then the SVMS call is completed as a bill to third party call (action block 1540). Otherwise, if the charge is rejected, the 20 call is simply disconnected (action block 1512).
If, in response to the announcement of action block 1531, the customer stated "station paid" or keyed DTMF 1, then test 1532 is performed to check whether the call is from a coin station. If not, test 1533 is performed to check whether the call is from a hotel having individual room billing. If not, then the spontaneous 25 VMS call is completed and billed as a sent paid call (action block 1536). If the call is from a hotel, then an announcement is made to request the hotel room number from the caller (action block 1534). If the room number is successfully obtained, then the SVMS call is completed as a bill to hotel room call (action block 1535). If the caller fails to supply the hotel room number, the call is simply disconnected 30 (action block 1512).
If test 1532 determines that the call is from a coin station, then the amount of the charge for an SVMS is determined and the required deposit is requested. If the customer fails to deposit this amount of money then the call is disconnected (action block 1512). Otherwise, the call is completed as an SVMS coin 35 call (action block 1538).

The calls which are established using the methods of this specification are voice calls, data calls and facsimile calls.
An additional service which can be offered using the facilities of an automated operator is the following. Customers are assigned a specific individual 5 telephone number which may be a number in the 1-700, 1-800, or 1-900 block which will be routed to a switching system containing prerecorded phrases in the voice of that customer. These phrases might be phrases such as: "Mom," "Broker," "Office,"
"Home," "Secretary," "Bob," "Betty," etc. The customer would dial his or her personal number, would be connected to this switching system and the switching 10 system would select the prerecorded phrases based on that customer's specificnumber. Then, when the customer speaks, one of the prerecorded phrases, the automated operator system would match that phrase against one of the prerecordedphrases to determine the destination desired by the customer. Once that destination has been determined, the directory number of that destination is found and the call is 15 completed to that directory number. Subsequently, if the call is to a busy telephone or is not answered spontaneous voice message service can be invoked. These actions are described with respect to blocks 1550, 1552, and 1554. Block 1550 indicates that when the customer dials this personal number, that caller is connected to asystem having an automatic operator that contains the stored phrases of that 20 customer and the customer is connected to such an automated operator (action block 1550). The customer speaks the phrase identifying the destination (action block 1552) and the automated operator identifies the number associated with that phrase (action block 11554. Thereafter, the call is set up and monitored for a possible SVMS request (action block 1508 et seq.).
FIG. 17 is a description of call delivery from a voice message system or from an automated position for providing voice message service as described herein.
A previously recorded message is considered for delivery to the called customer by first setting up a connection to the called customer (action block 1602). Such attempts are made according to scheduling algorithms which are well known in the30 art and are described, for example, in [reference on delivery of voice m.oss~ges]. If there is a time out with no answer, the call is disconnected (action block 1604) and another attempt will be made according to the previous history of delivery for that call as amended by the fact that there has been no answer detected (action block 1606). If a busy signal is detected, then the call is disconnected (action35 block 1608) and another attempt based on the schedule of having encountered a busy signal is tried later (action block 1610). If an answer is detected, then a test 1620 is -~05036q pelrolmed to detect whether this is a special service call. If not, the voice message is delivered (action block 1622). If so, the called customer is prompted for an identification. This prompt may be proceeded by an identification of the destination customer (action block 1624). If the customer speaks or keys the proper 5 identification which is a personal identification number (action block 1626), test 1628 checks whether the identification is correct. If so, the voice message is delivered (action block 1622). If not, a counter is incremented (action block 1630) and a test 1632 is made whether the identification has been keyed more than three times. If so, the call is disconnected and a record is made that someone is trying to 10 access the voice message. If not, the called customer is given another chance to key the correct identification. This kind of service can be provided by giving the called customer a 700 number and recording in the database for that 700 number, the POTS
directory of that customer so that the call can be completed if the customer is available and by storing the customer's personal klentification number. If a caller 15 wishes to leave a voice message and does not wish to try to complete the call, then the caller can simply press *867 immecli~tely after dialing in order to request the voice message service. Advantageously, such an arrangement ensures that private messages are delivered only to the appl~,iate recipient.
This arrangement can also be used for setting up 1+ calls, (i.e., calls 20 which are not of an operator assistance type). If such a call is received in switch 1 (action block 1540, FIG. 15), then test 1542 determines whether the caller has SVMS
service. This test is performed as described in U.S. patent 4,932,042 by querying the translation ~l~tab~ce of switch 1 to determine whether the customer has that service.
In some cases, a telephone operating company will choose to offer the service to all 25 customers. The customer is identified by an automatic number identification forwarded from the end of fice connected to the customer or is simply identified by the location on the switch if the switch is an end office for that customer. If the caller does not have SVMS the call is set up conventionally (action block 1544) but if the caller does have SVMS then a connection is set up to an automated position for 30 monitoring the call (action block 1546) and thereafter the actions described above with respect to action block 1508 et seq. are performed.
By equipping the automated position group 50 with an appl~,pliate program in its PC 1407, voice message service can be provided from the automatedposition group and further the additional program to provide spontaneous voice 35 message service can also be provided from PC lA07. Disk 1411 is used for storing voice messages and speech processor 1405 can be used for recognizing speech (such as spoken numbers and "yes" and "no" for detecting dual tone multifrequency (DTMF) signals keyed by customers and for detecting busy tone and answer signalsas received from a called switch. The programs for controlling voice message service are well known in the art. The programs for controlling spontaneous voice 5 message service have been described herein and for providing spontaneous voicemessage service on non-operator calls from another switch have been described inU.S. Patent 4,932,042. ~ltem~tively, centralized voice message service can be utilized in conjunction with the principles of this invention by switching a call to a centralized voice message system at the time that a decision has been made to 10 complete a VMS call (action block 1524 or action block 1530 of FIG. 16). These action blocks would simply be replaced by an action block to fol wald set up a connection to a voice message center and to forward to that voice message center the accllm~ te~l records for the call. The voice message center can effect delivery including the delivery of special service calls in the same way as the automated15 position group adapted to provide spontaneous voice message service. A third option is to provide a voice m~ss~ging system 52 (FIG. 1) attached to the operator switch.
It may be desirable to provide a number of specialized automated position groups having a large amount of disk space available to provide voice 20 message service while the rest of the automated position groups are prim~rilydedicated to handling operator functions. If this decision is made, then at the time when a decision is made to set up a voice message call the call is rerouted to one of these specialists automated position groups; this specialist automated position group then also performs the message delivery function of FIG. 17.
FIG. 18 is a flowchart of the method for allowing subscribers to prerecord phrases for subsequent recognition by an automated operator as described with respect to block 1550 et seq. The subscriber dials a special directory change number, presumably an 800 number, which gives that subscriber and all other subscribers served from the automated position group in which the subscriber 30 phrases are stored, the recognition capabilities for recognizing that subscriber's phrases (action block 1702). The subscriber is prompted for the outbound number that is dedicated to that subscriber for the service (the 700, 800, or 900 number assigned to that customer) (action block 1704). The subscriber enters the appropriate outbound number via DTMF (action block 1706). The subscriber is then plolllpted 35 for a personal identification number to make sure that only the authorized subscriber can change the list (action block 1708). The subscriber enters the personal 2050~6~

identification number via DTMF (action block 1710). Assuming that the personal identification number is correct (if it is not correct the subscriber may be re-pronlpted and subsequently be disconnected), the subscriber is asked if he/she wishs to add or delete an entry or quit (action block 1712). The subscriber speaks a choice S (action block 1714). If the choice is "quit", then the call is disconnected (action block 1750).
If the choice is "add", then the subscriber is plump~ed to enter the phone number of the new party by DTMF (action block 1716). The customer is then asked to speak the identity of the client three times (action blocks 1718, 1720, 1722). The 10 entry is then added to the subscriber's list (action block 1724), and action block 1712 is reentered.
If the subscriber speaks the word "delete", then the subscriber is pro,llp~ed to speak the identity of the entry to be deleted (action block 1730).Test 1732 is used to check whether the identity is recognized. If the identity is 15 recognized, then the entry is deleted and an announcement to that effect is made (action block 1734), a count (discussed hereinafter with respect to action blocks 1736 and 1738) is reset, and action block 1712 is reentered. If the identity is not recognized, then a count is incremented (action block 1736) and test 1738 isperformed to determine whether the count is still less than three. If so, then action 20 block 1730 is entered; if not, action block 1712 is entered.
The above description is considered to be only an illustrative embodiment of the invention. Other ~ltern:~tives are possible without departing from the scope of the invention. For example, a service to the handicapped may be offered by asking them to speak an identifying command followed by a spoken 25 directory number to allow them to set up standard, normally dialed, calls. Further, it is possible to have many different tradeoffs between what is recognized by automatic voice processing techniques and what is recognized only by use of an operator.
P~ul~ g tones and prompting announcements can be selected based on experience in human factors tests and can be changed as customers become more sophisticated.
30 It is to be understood that various and numerous other arrangements may be devised by one skilled in the art without departing from the scope of the invention. Theinvention is thus limited only as defined in the accompanying claims.

Claims (11)

1. In a switching system for connection to an attended operator position, a method of establishing a call comprising the steps of:
responsive to receiving a number for identifying a calling customer, establishing a connection from said switching system to means for recognizing spoken commands for the identified calling customer;
recognizing a spoken command from said calling customer for identifying a number of a called customer corresponding to said spoken command of said calling customer, said spoken command being individual to said calling customer; and establishing a call to a telephone station identified by said identified number;
wherein said means for recognizing spoken commands communicate with said switching system by data messages essentially identical to data messages for communicating with said attended operator position.

2. The method of claim 1 further comprising the steps of:
prior to said establishing a connection, recording spoken commands and corresponding telephone numbers for said customer, for subsequent use in said recognizing step, in response to receiving another call from said customer.

3. The method of claim 2 wherein establishment of said another call comprises receiving a number for identifying said calling customer and a personal identification number for authenticating said call.

4. The method of claim 2 wherein said recording comprises receiving telephone numbers as a series of dual tone multifrequency (DTMF) signals.

5. The method of claim 1 wherein said number for identifying a calling customer is dialed into a first switching system for subsequent transmission to a second switching system comprising said means for recognizing.

6. The method of claim 1 when said means for recognizing spoken commands comprise speaker dependent means for recognizing said spoken commands.

7. A method of establishing a call comprising the steps of:
responsive to receiving a number for identifying a calling customer, establishing a connection to means for recognizing spoken commands for the identified calling customer;
recognizing a spoken command from said calling customer for identifying a number of a called customer corresponding to said spoken command of said calling customer, said spoken command being individual to said calling customer; and establishing a call to a telephone station identified by said identified number;
wherein the step of establishing a connection is executed in a switching system having a switching network with a plurality of ports for connection to anoperator position and control means for controlling said network and wherein thestep of establishing a connection comprises the step of establishing a connection to automated operator position means for recognizing said spoken commands and wherein the step of establishing a call comprises transmitting a message from said automated operator position means to said control means, said message being essentially the same as a message from an attended operator position, for establishing said call.

8. The method of claim 7 further comprising the steps of:
prior to said establishing a connection, recording spoken commands and corresponding telephone numbers for said customer, for subsequent use in said recognizing step, in response to receiving another call from said customer.

9. The method of claim 8 wherein establishment of said another call comprises receiving a number for identifying said calling customer and a personal identification number for authenticating said call.

10. The method of claim 8 wherein said recording comprises receiving telephone numbers as a series of dual tone multifrequency (DTMF) signals.

11. The method of claim 7 wherein said number for identifying a calling customer is dialed into a first switching system for subsequent transmission to a second switching system comprising said means for recognizing.