MXPA00004872A - Financial transaction apparatus and method that identifies an authorized user's appearance and voice - Google Patents

Abstract

A financial transaction apparatus (30) includes a financial transaction machine (32). The machine includes devices (34) including transaction function devices (42, 44, 46, 48) for carrying out operations associated with financial transactions. The terminal also includes an imaging device (50) and an audio input device (52), as well as a visual output device (36) and an audio output device (54). Terminal (32) is connected to a computer (68) which has an associated data store (70). The data store includes user data including image data and voice data corresponding to authorized users. The identity of a customer operating the machine is determined by resolving first identity data based on image signals from the imaging device which correspond to a user's appearence. Second identity data is resolved by the processor from voice signals from the audio input device corresponding to the user's voice. The computer enables operation of the transaction function devices if the level of correlation between the first and second identity data is sufficient to establish that the image and voice signals originate from a single authorized user.

Description

? APPARATUS FOR FINANCIAL TRANSACTION AND METHOD THAT IDENTIFIES L APPEARANCE AND THE VOICE OF AN AUTHORIZED USER TECHNICAL FIELD This invention relates to devices systems for carrying out financial transactions Specifically, this invention relates to an apparatus financial transactions that a user identifies authorizes based on the appearance and voice of the user.

ANTECEDENTS OF ART The financial transaction systems known in the prior art. A common type of financial transaction system includes ATM machines (ATMs). ATM machines can be used to carry out banking transactions such as withdrawing funds from an account, a transfer of funds between the 20 accounts, a deposit in an account, a balance account question and other types of transactions depending on l ATM machine capabilities.

Transaction terminals finance including ATM machines, have been equipped with the ability to supply items of value other than cash. Such items have included traveler's checks, written tickets, stamps and receipts.

In the past, customers have conventionally identified themselves to ATM machines and other financial transaction machines using a card. The card has data encoded thereon which is representative of the user and / or account number. Increased security is achieved by the automatic teller machine that reads the data from the card and then also requires the entry of a personal identification number (PI which corresponds in a unique way to the aforementioned data p the data encoded on the card. the personal identification number and the card data corresponds to the ATM machine enables the user to additionally operate the machine to carry out transactions.

Cards which include an integrated circuit chip on them have been developed. These so-called "smart cards" have information regarding the user and / or their accounts. The chip can also have the ability to verify the appropriate correspondence between the data stored on the card and the personal identification number entered by a customer at a financial transaction terminal. The data representative of the value of efectiv can also be stored on the chip. Although the smart cards can provide additional functions and increased security, their operation in relation to the financial transaction machine is generally similar to the cards which are encoded on a magnetic strip or through other means.

In recent years, it has been suggested that other means than the coded card and personal identification number data are used to identify an appropriate user of a financial transaction machine. Other means which have been suggested include the use of a finger print reading technology, wherein fingerprints of the user's finger can be read electronically to identify it as a suitable user. This approach has a disadvantage including a relatively high cost, maintaining a cleanliness of the finger print reading area and a possible transmission of communicable diseases. Others have suggested the use of an iris scanning technology. Using this technology, an identified user is identified by a unique pattern associated with the iris of their eyes. To use this technology it is required that a user see in a scanner device in the financial transaction machine when they wish to operate the machine.

Both of these alternate methods of identifying a user frequently encounter a client resistance. This is because many users want to keep privacy and do not wish to provide information regarding their fingerprints or eye characteristics to third parties. Frequently, there is a means that such information will be used. Users may be reluctant to expose themselves to the instruments which read the characteristics of the finger or eye. There is an unfounded concern by some people that exposure to such instruments can be harmful. As a result of this, users are sometimes reluctant to embrace alternate methods of identification for financial transaction dispositiv ..

The operators of the financial transaction system also want the ability to market item and products and services to the users of the financial transaction machines while they carry out their transactions. However, in the past such marketing n was very effective. This is due to the diverse interests of the users of such machines. The information regarding the same products was provided to all users. For users not interested in offering products, the presentation of the information was an inconvenience.

Therefore, there is a need for an apparatus financial transaction method that provides increased security without hitting user privacy rights or exposing them to devices that they may perceive as potentially harmful. There is also a need for a financial transaction apparatus that is capable of selectively marketing products to users, and which can drive users to operate the device through visual and audio instructions.

DESCRIPTION OF THE INVENTION It is an object of the present invention to provide a financial transaction apparatus.

It is a further object of the present invention to provide a financial transaction apparatus that can identify an authorized user through its general exterior appearance and voice characteristics.

It is a further object of the present invention to provide a financial transaction apparatus that can identify an authorized user based upon a correlation of physical appearance and the characteristics of the voice.

It is a further object of the present invention to provide a financial transaction apparatus that can identify an authorized user either by their physical appearance and voice characteristics, or alternatively through the manual entries.

It is a further object of the present invention to provide a financial transaction apparatus that guides a user through transactions with audio pulses.

It is a further object of the present invention to provide a financial transaction apparatus that can guide a user through transactions with either audio impulses or visual impulses depending on the preferences of a user.

It is a further object of the present invention to provide a financial transaction apparatus that selectively markets product offerings to users based upon a user's preference data.

It is further an object of the present invention to provide a financial transaction apparatus that selectively collects the user's preference data, the user's image data and the user's voice data and uses this information to identify a user and to market selectively offers the user products.

It is a further object of the present invention to provide a financial transaction apparatus that provides multimedia presentations to a customer based on the client's preference data.

It is a further object of the present invention to provide a financial transaction apparatus that includes a financial transaction machine that provides effective means that are redeemable by products.

It is a further object of the present invention to provide a financial transaction apparatus that receives inputs from a user through the voice inputs.

It is a further object of the present invention to provide a method for operating a financial transaction apparatus which identifies a user based on a correlation of image data and voice data.

It is a further object of the present invention to provide a method for operating a financial transaction apparatus that provides information in relation to product offerings to users selectively based upon the customer's preference data.

It is a further object of the present invention to provide a method for operating a financial transaction apparatus which includes a sequence of operation in which a financial transaction machine pulls out audio messages from a user and receives voice instructions from a user. answer to this It is a further object of the present invention to provide a method for operating a financial transaction apparatus in which a user can selectively operate a financial transaction machine either through voice inputs or manual entries.

The additional objects of the present invention will be apparent from the following better modes for carrying out the invention and from the appended claims.

The above objects are achieved in the preferred embodiment of the invention by an apparatus comprising a financial transaction machine. The machine includes an image forming device such as a camera for providing image input signals. The machine also includes an audio input device to provide audio input signals. The machine further includes manually operable input devices, such as a card reader and keyboard, and output devices such as a display screen and an audio horn.

The financial transaction machine and the components thereof are in operative connection with a computer. The computer is connected to a data store. The data store includes data corresponding to a plurality of authorized users of the financial transaction machine. The user data includes for each user identity data corresponding to the user such as a unique number, which may be a social security number or an account number. The store data further includes data corresponding to a user's appearance feature as well as voice data corresponding to a voice feature of the user. The data storage also preferably includes for each user, preference data which are representative of a user's purchasing preferences.

Data from the product offer representative of the product offers available for purchase by a user are also stored in the data warehouse and operative connection with the computer. Such product offers may include goods or services that are offered to customers which can be purchased through the financial transaction machine. The data storage also includes audiovisual data which is intended to be of interest to the buyers of several product offers.

In operation of the financial transaction machine, a customer approaches the machine and its presence is perceived. The machine generates image input signals based on the appearance feature of the client and the audio input signals based on the voice feature of the client. The computer or other processor operates based on the signals and data storage information to determine whether the customer's appearance corresponds to a particular recognized user. The computer operates based on the audio input signals to determine if the customer's voice corresponds to a particular recognized user. The computer then determines whether the visual and audio data are sufficiently correlated to indicate that the client on the machine is a recognized user (and only one). If the appearance and voice data correspond, the user is enabled to operate the transaction function devices which are part of the machine. Alternatively, if the user can not be verified with a sufficient degree of reliability of the appearance data and audio, the customer is urged to put identification data through manually operated devices on the machine such as a card reader and / or a keyboard.

Once the client on the machine has been identified and the customer's identity data is resolved, the user's preference data for the customer determines the data in the data storage. The product offer data are then selected by the computer based on the user preference data. The information relative to the product offers that the user expects to be interested are presented to the user through the financial transaction machine. In the preferred embodiment, the user is trained to instruct the machine in relation to purchases through voice inputs. Alternatively, the customer can select the machine to operate silently through manual entries.

When the customer has chosen to carry out a purchase of a product, the computer operates the financial transaction machine to provide the customer with a ticket, a supporting document, or other item representative of the product offer. The computer also provides the customer with audiovisual outputs which he expects to be entertainment based on the customer purchase while the customer is waiting for the delivery of the item.

The user of the financial transaction machine is also enabled to carry out other banking transactions of types conventionally made through an ATM machine. However, in cases where the device is able to identify the user through appearance and voice entries, there is no requirement that the customer enter a card or personal identification number data to achieve and such transactions. Upon completion of the transaction, the customer can take the assorted financial transaction machine items and move. By moving the client from the machine, the device is then ready to process the transactions for other clients.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic view of the financial transaction apparatus of a preferred embodiment of the present invention.

Figures 2-6 are a flow chart that refers to an example transaction carried out by a user with the financial transaction processing apparatus.

Figures 7-16 are schematic representations of audio and visual inputs and outputs which can be made to and from the apparatus of the present invention or carry out example transactions in which the offers of the products to the users include various types of tickets. concerts, figure 16 being a list of the various audio outputs made by the device in the course of such transactions.

BEST MODES TO CARRY OUT THE INVENTION Referring now to the drawings and in particular to Figure 1, there is shown a financial transaction apparatus of the present invention generally indicated with number 30. The apparatus 30 includes the financial transaction machine indicated schematically 32. The machine 32 as s sample is an ATM machine which is capable of carrying out banking transactions as well as providing ticket or supporting documents that can be exchanged for products. In other embodiments, the machine 32 can be any other type of financial transaction machine. such as a ticket printer, voucher issuing device, cash dispenser or other type of machine in which the identity of a user should be verified as that of an authorized user.

The machine 32 includes a plurality of devices 34 there. The devices 34 include a display 36 which may be a CRT or a similar output device. The manually operable input devices include the keyboard 38 and a card reader 40 and are included in the machine 42. The keyboard 38 may be of the type Alphanumeric similar to a telephone keypad or can be similar to a typewriter keypad. The card reader 40 is one of several conventional types suitable for reading data from a card entry by a user. The card reader 40 may be of a type suitable for reading magnetic strip cards, smart cards or both.

The machine 32 further includes a printer 42. The printer 42 may be one or more printers that are housed inside the machine may, for example, a printer d receipts. Alternatively, the printer 42 may be a suitable printer for printing items such as a voucher supporting documents or tickets which are redeemable by products, which may be goods or services. The machine 32 also includes a tank 44. The tank 44 can be of the type that accepts a customer's deposit envelopes. Alternatively, the deposit 44 may be of the type which is capable of accepting and canceling checks, coins, traveler's checks, other valuables that are entered by a customer within the machine 32.

The financial transaction machine 32 further includes a cash dispenser 46. The cash dispenser 4 is a device for supplying cash of one or more denominations to a customer. A ticket dispenser 48 is also shown housed in the exemplary machinery 32. The ticket dispenser 48 may conventionally be a combination of devices for supplying a ticket supply as well as for printing information thereon corresponding to a particular type of ticket. that a customer has bought.

The financial transaction machine 32 also includes a camera 50. The camera 50 serves an image forming device which produces image input signals when the user is placed in front of the machine. A video machine suitable for certain incorporations as a Facelt® video camera from Visionics Corporation of Meunchen, New Jersey. A microphone 52 is also included in the machine. The microphones serve as an audio input device which provides audio input signals and response to the user's voice inputs.

An audio horn 54 is included in the financial transaction machine 32. The horn 54 serves as an audio output device. The machine further includes a customer sensor 56. The customer sensor 56 may be one of either the optical, sonic type of various other types that are suitable for detecting the presence of a customer in close proximity to the machine, to allow verification of the identity of the user in the manner described here in advance.

All devices 34 in the financial transaction machine 32 are connected to one or more communication buses indicated schematically with the number 58. L devices are connected to the communication bus 58 through the interconnections 60, each being appropriate for a particular device. The communication bus 58 is connected to a processor 62. The processor 62 may comprise one or more discrete processors or computers. The process sends messages and receives messages from the devices and controls their operation. The processor 62 is in connection with data data storage indicated schematically with number 64. The data store 64 includes instructions and information used in the operation of the financial transaction machine 32. It should be understood that even in the embodiment shown, the financial transaction machine is connected to external computers and processors as well as to external data stores, the incorporations of the invention can have the processing and data storage apparatuses and the programs necessary to carry out all transactions hosted inside the machine 32 The processor 62 is in connection with a communications device 66. The communications device 66 is a modem or other device for communicating with other computers and systems. The communications device 66 can communicate through a telephone line, wireless communication methods, fiber optic cables or other suitable means for sending and receiving data messages.

The communication device 66 is communicating with a computer or external server 68. The computer 68 includes a data store schematically shown with the number 70. The financial transaction machine 32 is in connection with an external computer 68 through a network indicated schematically with the number 72. The network 72 can be either a local area network or a wide area network. The network 72 can alternatively be a proprietary network or a public network such as the internet. The appropriate safety precautions for the type of network and system that is being operated should be used. It should also be understood that even when a single external computer is shown 68, the financial transaction machine 3 may be in communication with a plurality of computers through the network, each computer having one or more data stores associated therewith.

As shown in Figure 1, the computer 6 has output and input devices associated therewith. A monitor 74 of the machine serves as an output device. The keyboard 76 and the mouse 78 serve as an input device.

A generally indicated input terminal c the number 80 is in operative connection with the network 72. Input terminal 80 includes the input devices including a keyboard 82 and the mouse 84. The input terminal 80 also includes the output devices including monitor 86 and the horns 88. A camera 90 and a microphone 9 are also included as part of the input terminal 80. The input terminal 80 may be used to enter user data in a manner discussed below.

A remote terminal 94 is also included as part of the apparatus 80. The remote terminal 94 is similar to the input terminal 80 except that it is connected to the network 7 through a server 96. The server 96 can serve as a wall of fire or another examiner device to limit the transmission of messages to and from the network 72.

The remote terminal 94 includes the input devices including a keyboard 98 and a mouse 100. A monitor 10 and the speakers 104 are output devices which are included as a part of the remote terminal 94. The remote termination 94 also includes a camera 106 and a microphone 108.

The remote terminal 94 is connected to a communications device 110 which in the preferred embodiment is a modem or other communication device. E modem 110 is in connection with a network 112 which may be a wide area network or a local area network. The network 112 can be a private or proprietary network, or alternatively it can be a public network such as the internet. The server 96 is connected to a communications device 114 which transmits message and receives the messages from the network 112.

In the operation of the system the data store 7 retains the user data in relation to the authorized users of the device. The user data includes the user's identity data which identifies the particular users of the system. The identity data of the user preferably includes image data corresponding to an appearance characteristic of each authorized user which can be detected by the camera 50 by viewing the face and / or upper torso of a user on one side of the machine. In an embodiment of the invention, the appearance data associated with the user is stored in the data store using a Facelt® face recognition program which is commercially available from Visionic Corporation.

The data store 70 also includes vo data relating to the authorized users. The voice data includes characteristics of the voice of an authorized user and a particular password that is selected by the user. In an embodiment of the invention, the data relating to the user voice is generated and stored using a computer speech recognition computer program commercially available from Lernout & Hauspie from Belgium.

The user data stored in the data store also includes account data relating to each user. The account data preferably includes a account number associated with each user as well as an account information and relation to balances and other data associated with the savings. checks, credit cards and other accounts. Such information can be stored in a manner which is conventional for the financial transaction processing systems which operate POS machine terminals. Such information can be entered into the data store 70 through the keyboard-like input devices 16 to the mouse 78 which are connected to the computer 68 and either directly or through the network 72.

The data store 70 also includes the data of audio and video output. The audio and video output data is data that is programmed to be entered through the display 36 and a speaker 54 on the financial transaction machine 32. The audio and video output data provide audio suggestions and screens of display torque driving the user to operate the machine. In one embodiment the text for the commercially available disc conversion program of Lernout &; Hauspie is used to allow the textual material presented in the vide outputs to be converted to an audio output. This allows the financial transaction machine 32 to take out the same user's impulses and other information both visually audibly.

The data store 70 also includes product offer data. The product offer data includes representative data of products such as services items which are available for purchase by the authorized users of the machine 32. Such product offer data may include for example information relating to concert tickets, or vouchers, vouchers or supporting documents that can be redeemed for goods or services. The data store further preferably includes audiovisual display materials which preferably refer to the product offerings that customers may choose to compare on the machine.

The data store 70 also preferably includes the user preference data for the authorized users. The user preference data preferably includes information representative of the types of product offers that will be of interest to an authorized user. Such user preference data may include, for example, music preferences and other product preferences that could predict what type of items services are feasibly of interest to an authorized user. Such product preference data may be representative of the tastes and rejections provided by the user. Alternatively, the customer preference data may comprise the demographics and other data stored in the data store from which the likely tastes and rejections of users may be resolved. The computer 68 includes programs which operate to select the product offers that are feasible to be of interest to a user based on the stored information.

Although in the described embodiment of the data store of the system 70 is described as retaining the user data, it should be understood that the data store 70 may consist of several data stores associated with several discrete processing units which work in a Coordinated relationship to store and retrieve user data. Alternatively, the data store 64 in the financial transaction machine 32 may store some or all of the user data and program the information necessary for the operation of the system.

Prior to the operation of the financial transaction apparatus, the account data relating to the authorized user is entered into the data warehouse 70 in a conventional manner for the financial transaction processing systems. The product offering data is also placed for the data warehouse in a manner which will allow the display of information in relation to the product offers available on the machine 36 display unit 32. As described below, such Product offer data may include concerts of various types, location of concerts, ticket prices and other pertinent information to a customer purchase decision.

The audiovisual information is also stored in the data warehouse. Such audiovisual information may be, for example, MPEG files which contain music videos of artists whose concert tickets are available for purchase through the machine 32. The data warehouses 70 and 64 are also programmed with the necessary data for operate the financial transaction machine 32 as an ATM machine, as well as to communicate information and relationship to debts and credits to the accounts of the various clients.

The image data of the client, the data of v and the user preference data are obtained to put the data store 70 through the terminals similar to the input terminal 80 or the input terminal 94. Computer 68 preferably transmits messages in response a profile acquisition routine stored in the data store 70. The profile acquisition routine operates to obtain the user data of a user operating the terminal 80 94. For example, if a user is placed in terminal 8 the user is driven by the profile acquisition routine put data that will identify them as an authorized user of the system. These may include, for example, a bank account number or a social security number which can be entered through the keyboard 82. In addition, the customer can be prompted to enter their own personal identification number through the key for a security increased.

The user is driven through the monitor 8 or through the horns 88 to view the monitor 86. The camera 9 which in the preferred embodiments is a face recognition camera Facelt®, commercially available from Visionics Corporation, obtains the signals from image input corresponding to the appearance of a user's face, head and / or upper body and the data is stored in data store 70. Afterwards, the perf acquisition routine operates to propel the user with a message through the horns 88 or from a monitor 86 to say a key. The cla may preferably be any word or phrase chosen by the users. When the user says the key, his voice is picked up by the microphone 92. The audio input signals generated by the microphone 92 are processed by the computer 68 and stored by the speech recognition program in the data store 70.

The data acquisition program also preferably encourages a user to provide information that can be used to establish user preference data. Such user preference data may include demographic data, music preference data, economic data and other data which may be useful in determining preferences or rejections of the user. In order to obtain the customer's cooperation in providing accurate user preference data, the customer can be offered an incentive such as a free verification or a promotional item to provide this information.

In the course of providing this information, the user may be asked to verbally answer certain questions. These verbal responses are preferably not only used to produce the user's preference data without also allowing the discursive recognition program to obtain additional data by means of which it accurately recognizes the user's voice. The acquisition routine of the profile is preferably sufficient to acquire the data of the user preference necessary to selectively market product offers for a client. The routine of data acquisition is preferably also sufficient to obtain the necessary voice and image data to verify the identity of the user through his voice and appearance.

Users can use terminal 80 in a bank branch or similar installation. As such facility or customer service representative can assist the user in the operation of the terminal, or the representative can operate the terminal to acquire the customer's image and voice data. Alternatively, the user can operate the terminal only in response to impulses provided by the terminal.

It may be inconvenient in some data for system users to move to places where terminals such as terminal 80 are available Alternatively, users may prefer greater privacy can provide the necessary user data from a remote location. This can be done using a terminal such as remote terminal 94. For example, remote terminal 94 can be a personal user computer located in your home or office. Such a terminal may be connected through the internet or another wide area network which is represented by the network 112. Of course, when clients are trained to provide user data in this manner, encryption and other security techniques are used. employees to protect the privacy of the client as well as to minimize the risk of fraud.

A flow scheme of the logic executed by financial transaction apparatus of the present invention is represented by the flow scheme in Figures 2-6. The logical steps in the flow scheme generally correspond to the inputs and outputs for the flow of transactions in Figures 7-15. The transaction starts from a start point 116. At this starting point, the machine 32 may be inactive. Alternatively, the display 36 and the horn 5 can be operated to present a welcome video com to bring users to the machine. The welcome video is represented by the screen usually indicated with e number 118 in figure 7.

As a user approaches the machine, the user's presence is sensed by the sensor 56 in step 120. S makes a decision in step 122 that the user be perceived in some embodiments when a user is perceived au side of the machine , the camera 50 can operate to acquire the user's image. However, in some embodiments as indicated in Figure 2, some users may prefer to operate the machine in interactive mode. For example, if a user is operating the machine with another consent of the authorized user, they will not be able to use the machine based on their own image and voice. Alternatively, some users may not prefer having the machine providing voice pulses or receiving voice inputs. As a result, in step 124 a user is driven to be perceived to determine whether they want a silent transaction. A decision is made in step 126 of whether a client has indicated that they prefer a silent transaction, and if this is the case, step 128 is executed.

In step 128, the processors operating the financial transaction machine 32 operate without or to suppress the audible outputs. In addition, the screen suggestions are added to the presentations made in the display 36 to take the place of the information that would normally be presented audibly. This is preferably achieved using the text-to-speech program which is operated in the system. If the client chooses to suppress voice inputs and voice outputs, the transaction flow proceeds through card entries / personal identification numbers which are discussed below in relation to figure 3. As will be appreciated the characteristics of Sound suppression of the machine may be desirable for people who have speech or hearing problems who can not respond to audible output or provide voice inputs. Alternatively, voice suppression may be desirable in noisy environments where a user has difficulty hearing the audible output, such as in a crowded shopping center or at a sporting event. Alternatively, users may prefer to suppress the sound simply to maintain its privacy.

In alternate additions when the machine is operated in a sound suppression mode, user images may be acquired during the transaction stored in memory in a correlated relationship with the data relating to the transaction. The image data relating to the person who operates the machine can be retrieved and analyzed in the event that the client realizes that the transaction was not authorized. Alternatively, the image data can be acquired and stored for each transaction regardless of the mode in which the machine is operated.

If a user does not suppress the audible outputs alternately if the machine does not provide the option of deletion, the transaction flow proceeds to step 130 in which the face of a user is observed by the camera. The orientation of the camera 50 on the terminal 32 is such that it centers its field of view on the user's face and the program operates to adjust the field of view or to capture the image dat centered on the face of the user.

The camera provides image input signals which are processed by the appropriate processor on the pa 132. After the image has been processed, the determination is made as to the image data for the client presenting on the machine correspond to the authorized user image data stored in the data store. This is done in step 134. If the image data does not correspond to an authorized user, the transaction flow continues to impel the client to access the machine using his card and personal identification number as described in the transaction flow represented in the figure 3 Nevertheless, if the image data corresponds to an authorized user, the transaction flow continues at step 136. In step 136 the processor operates the display 36 d of terminal 32 to display a screen which includes the user's name. Further, in step 138 an audible voice output message welcoming the user is presented through the speakers 54 on terminal 32. The welcome message along with other audible messages presented to the client in this embodiment is generated from the WAV file which are stored in one of the stores d data connected to a processor which is operatively connected to the terminal. The WAV files used in the example transactions described here are listed in Figure 16.

The transaction flow then continues through a step 140 in which a user is prompted through an audible message generated from a WAV file to say s keyword or a passphrase. This is represented by the screen 12 in figure 7. In step 142, the transaction flow d listens to the password (or phrase) and in step 144, a password was not heard, the user is again suggested to say his password in step 146. In the step of re-trafficking 140, an audible suggestion is given to the user of "please repeat". It is represented in figure 15 by screens 148 and 150. It should be understood that screens 148 and 150 n display screens but rather represent conditions which result in certain outputs. If the user's key n was understood on the second trial, an apology message is generated in step 152. This apology message corresponds to the screen 20 shown in figure 15. An audible apology message is taken out in relation to the screen twenty.

If the user's voice data is received, the audio input signals from the microphone are processed in a step 154 presented in FIG. 3. In step 156 a determination is made as to whether the audio input signals correspond The password of the client (or phrase) corresponds to the voice data stored in the data store for an authorized user. If not, the transaction flow continues to step 152 which produces the previously discussed screen 20 However, if the voice entries correspond to an authorized user, then a determination is made in step 158 e as to determine if there is a degree sufficient correlation between the user identification of the voice data and the identified user of the image data to ensure that only an authorized user is present on the machine.

Even though step 158 in the described incorporation involves the cross-checking of the identity data for the identified user through the process of the image with the identified user through the process of voice identification, in other embodiments, more complex correlations can be made. . This is particularly true when algorithms of various types are used which can produce percentages of probability in relation to multiple authorized users. When such percentages are produced it may be necessary to establish a level of confidence which indicates that both data and voice data points for a single user and that the confidence level must be exceeded before the user is considered as having been properly identified. The particular method pa to correlate the results of the voice and image comparisons will depend on the particular techniques and algorithms used for such verification in the particular embodiment.

If the voice and image data do not correspond to a single authorized user in step 158, the transaction flow then continues through step 152 previously discussed. However, if the voice and image data correspond to the transaction flow continues to a step 160. In step 160, an output on the display 36 is presented. A WAV file is used to generate a speech output which includes the words "verified identification". The voice output of the machine can optionally include the user name, which in the case of the example in figure 7 is "Jef Hill". This is presented by screen 3 in figure 7 The name of the user can be generated by computer based on the textual representation of the user's name stored in the memory, with the audible signals being presented by the text to speech program. , the representative signals of the user name as said by the user can be stored in the memory at the moment in which the user provides user data to the system in terminals 80 or 94.

If during the appearance / voice verification the identity of the user can not be verified from the available dat, the transaction flow continues through the previously discussed apology message. This message is generated in step 152 and corresponds to the screen 320 in figure 15. From this the transaction flow continues to a state 162 in which the user is urged to put his card inside the card reader 40 of the terminal 32. This impulse corresponds to the condition shown in figure 15 as to screen 164. The transaction flow then continues to process the card data in a step 166. In step 168, the user is urged to enter his or her personal identification number. through the keyboard 38. This corresponds to the condition d screen 170 shown in figure 15. The data of the personal identification number d are processed in step 172 and a determination is made in step 174 in relation to whether the identification number d personal data and the card data correspond to the authorized user.

If the personal identification number and the card data do not correspond, the transaction flow continues at the exit and an apology message at a step 176. An apology message corresponds to the condition of the screen 178 in Figure 15. If the Personal identification number and card data are suitably verified, then the transaction continues as if the device were able to identify the user based on their appearance and data. As previously discussed, embodiments of the invention can acquire and store images of the user. user and store it in memory in a correlated relationship with transaction data when the machine is operated in this way.

As shown in Figure 3, the transaction flow immediately continues through a step 180 in which the user's account information is determined. Then in step 182 the customer purchase preferences are resolved based on the client preference data stored in the data store. These preferential data may correspond to the information directly provided by the customer or alternatively may be based on the indicated preference indications resolved through an analysis of the information that was provided by the client. The analysis is preferably done by a computer.

The transaction flow then continues through a step 184 in which the client preference data is used to select the product data or relative offers of available products which are to be presented to the customer. Once the product data is selected the product data is taken out in step 186.

The product data outputs presented in step 186 are represented by the proportional screen series and the outputs shown in Figures 8-13. E each of these screens the input and output flows identified as pulses 1-6, are similar, only the screens in Figure 8 will be discussed in detail.

In the example shown in Figure 8, the client's preference data has indicated that the user plays rock and jazz music. An audio message for the user for this effect is made in relation to the screen 4. The incoming information concerning rock and jas concerts is presented in the display 36 in the terminal and a message of audible voice indicating that the tickets are available for this concerts is presented.

In the transaction flow in step 188 the customer is encouraged to make a selection in relation to whether to buy tickets for any of the concerts. This is done through an audible message from the terminal as shown in Figure 8. The client responds verbally with "yes" or "no". In the transaction flow the receipt of the purchase receipt, which is recognized by the speech recognition program is indicated in a step 190. If the customer indicates through his audible response that he does not wish to purchase the tickets for any In this case, the transaction flow continues through step 192 and then continues the steps of asking whether the client desires other transactions associated by the use of transaction machine 32.

However, if the user has chosen the purchase the transaction flow continues through a step 194 in which the user is prompted to make a purchase selection As shown in relation to screen 4 in figure 8, to user he is presented with an audible suggestion which asks the user to say the name of the concert that is These words that the user will use to red or are suggested by the information about the exhibitor. In this case, as shown in figure 8, the user reds with either the word "rock" or "jazz". In the transaction flow shown in Figure 4, the selection input is audibly made through a voice rese by the user and is received in step 196. In a step 198, a determination is made of whether the user has selected option A (rock), and if this is so, the transaction flow continues to step 200 to the output data representative of the selection. This allows the user to verify that the machine has properly received his selection. This is represented in figure 8 by screen 5 which correds to the selection of the "rock" concert.

Similarly, if option A (for example, the "rock" concert) was not selected in step 198, the transaction flow continues to a step 202 in which a determination is made as to whether the user reded by selecting the option B "jazz". If the transaction flow continues at the output of the selection data correding to "jazz" at step 204. This step correds to the condition represented by screen 6 in figure 8.

Regardless of the selection made by the user, the transaction flow then continues to a step 20 which suggests to the user to indicate an amount entry. As shown in figure 8, the suggestion is an audible suggestion which indicates the cost of Tickets for the selected concert and asks the user how many tickets he wants. The user then reds with a quantity entry. This is represented in the transaction flow by a step 208. It should be understood that although in the example shown in the figure the two concerts have tickets for the same price, this is merely coincidental. The price for any product is determined by the product offer data stored in the data warehouse which may be different for different products.

The transaction flow then continues to step 210 in which a check is made for the receipt of the quantity entry which is audibly provided by the customer. If the client has provided an adequate unit, the transaction flow then proceeds to suggest to the user in step 212 to indicate the account to which the tickets will be loaded. This is represented in figure 8 by screens 7 and 8 and which A user is suggested to indicate if he wants to pay for his tickets using his credit or debit card. As indicated in the transaction flow by a step 214, the apparatus listens in respect of a user's audio rese through the microphone 52 of the financial transaction machine 32. In step 216 a verification is then made for the receipt. adequate of the account data.

If the customer's rese is properly received, the account indicated by the customer's entry is loaded in a step 218. The process of loading the account was done in a conventional manner for the debit or credit accounts. Even though it has not been shown schematically in the transaction flow, the process includes a provision to stop the transaction from notifying the client in the event that the account can not be loaded, such as if the account is overdrawn. The appropriate exit messages are provided to the client if this occurs. These messages are preferably provided in a manner such as to embarrass the client in the case of a misunderstanding.

In the event that the charge to the account is determined as appropriate in step 218, the transaction flow continues through a step 220 in which the tickets are ordered by the customer and are prepared and stocked by the supplier. tickets 48 at terminal 32. This was done under the control of the processor or processors operating the terminal.In a step 222 the transaction flow operates to resolve the audiovisual data in the data warehouse that is feasibly as being of interest to the user based on the product offer that he has purchased. And the preferred embodiment, these are representative data of a music video that refers to the artist whose concert tickets the customer has purchased. After locating this video material, the transaction flow operates to provide an exit message as indicated in figure 8 which thanks the client and tells him to enjoy the video. This is done in a step 224 in which the video is also presented to the client. The outputs of terminal 32 are represented by screens 7 or 8 in Figure 8 as well as screen 226 in Figure 14.

The transaction flow then continues through a step 228 as shown in Figure 5, which corresponds to the condition of the screen 18 in Figure 14. In the condition of the screen 18 the audible suggestions are made to the customer. thanking him for his visit to the terminal, telling him to enjoy the concert for which he has purchased the tickets he also suggests taking his tickets.

After the customer takes their tickets, the transaction flow suggests to the customer through step 23 to indicate if they want another transaction. This is represented by screen 232 in Figure 14. If from step 230, the client indicates that he wants another transaction, the transaction flow continues through a ATM machine transaction sequence which enables the customer to operate it. transaction function devices in the automatic bagmaker machine. This may include, for example, the printer 42, deposit 44, cash dispenser 46 or ticket dispenser 48. The manner in which the customer is enabled to operate these transaction function devices will depend on the programming and the particular placement of the system.

As schematically depicted in Figures 4 and 5, if a response from the client is not received in steps 198, 210 or 216, an apology message is presented in transaction step 234. An exit is then made in the country 236 asking the client to repeat his response. This corresponds to the condition of screen 150 in figure 15 in which the customer is given an audible message of "por favor repeat" which is generated from a WAV file. In the transaction flow the machine then listens for an answer in step 238.

In step 240, a determination is made as to whether the client has provided audible input. If this is the case, the determination is made in step 24 of whether it is an appropriate entry to return to the transaction sequence. If the entry is appropriate, the transaction flow then continues back through the series of steps to point where the device was disabled from understanding the user using the client responses provided previously, from there the transaction flow continues in the usual way However, if a response or response is not received and inappropriate, the transaction flow continues to step d transaction 230 in which the customer is asked if he wishes to perform another transaction. This corresponds to the condition of the screen 232 in Figure 14.

Referring to Figure 6, the flow of transaction d follows immediately through a step 244 in which the response is received for the suggestion in relation to s the client wishes to carry out another transaction. In the country 246 a determination is made as to whether a response was received if this is so, in step 248 it is determined whether the response indicates that the client wishes to continue with other transactions. If this is the case, the transaction flow continues at a step 250 e which is representative of an ATM machine transaction sequence. It should be understood that this sequence of transaction may be one of any sequence number to suggest to the client in the operation of the transaction function devices included in the machine 32.

If a negative decision is made in step 246 or 248, then the transaction flow continues through step 252 in which an output message is generated. This output message corresponds to the screen indicated by number 19 and figure 14. In the embodiment shown, then this screen is presented at the terminal outputs with an audible "thank you" message to the customer. It should be noted that this "thank you" screen is the same screen and the audible message is the same audible message that is presented to the client in the event that the device is unable to process the client transaction for any reason, as shown reference to figure 15.

After the exit message, the client may remain in the financial transaction machine 32 for time to review the items that have been supplied to him, otherwise collect his personal items. As it may be undesirable for the apparatus to again process data to identify the same client, the transaction flow continues through step 254 in which the system expects the client to leave the area so that it is no longer perceived by the client. or the machine. This is done through a step 256. Once a client has left the area of the machine, a return pass 258 is executed to return the transaction flow to a position where the machine is ready to carry out transactions for another client. Alternatively, if the client does not leave the area of the machine at a predetermined time, the transaction flow can ask the customer if he wishes to make another transaction. The machine can restart the transaction sequence or wait for a period depending on the client's verbal response.

Although not shown in the transaction flow, the embodiments of the present invention may include provisions to immediately cease the transaction flow if an authorized user who is operating the machine moves out of the adjacent area of the machine. This may be Useful in circumstances where a user who operates the machine realizes a condition outside that requires his attention and leaves it. In such circumstances, the apparatus is configured to stop the transaction and prevent the collection of bills, cash or other items of value to the user. In this way a user is able to leave the vicinity of the machine and not worry about having forgotten your card or your valuable items. This feature can be particularly advantageous for people who are forgetful. Such people may forget to bring their card to a machine and may otherwise be prevented from carrying out transactions. Alternatively, a customer may forget to take their card or the money or other securities that have been supplied to them. The present invention increases the convenience and reduces the risk for such users.

It should be understood that while in the preferred embodiment a combination of visual and audible suggestions are used to suggest the customer to carry out transactions, in other embodiments, other combinations of suggestions or suggestions of only one type may be used. For example, as previously discussed, for individuals who can not hear or want privacy, the machine can only operate to provide only visual suggestions. A client is then enabled to operate the machine through manually operable devices such as "virtual buttons which can be provided on a screen 36 if it is a digital screen display, or physical buttons which are sometimes conventionally provided such a display. Alternatively, manual entries can be provided through the keyboard 38. The card reader also serves as a manual input device which responds to manual entry of cards In some embodiments, card data, particularly stored data On a smart card, they can be used to facilitate the carrying out of transactions by individuals with disabilities.

Alternatively, the machine can be operated with all outputs being of the audible type. This is advantageous for people who are visually impaired. The program to convert the text to speech and vice versa used in the preferred incorporation facilitates the flexibility of the machine and the accommodation of people with disabilities. This inclusion in the machine of manually operated input devices can be in the form of a touch screen, a card reader, a keyboard or other devices that greatly facilitates various modes of operation of the preferred embodiment of the apparatus.

As will be appreciated from the above discussion of transaction flow in relation to Figure 8, the alternate types of product offer data may be presented to the customers based on the client preference data stored in the data warehouse. For example, the figure shows a similar transaction for a client who prefers rock music and country music. The conditions of the screen associated with this transaction flow are screen conditions 9, 5, 5, 10, 7 and 11. Similarly, figure 10 shows a transaction for a person who prefers both rock music and music. classic The conditions of the screen involved are designated 12, 5, 13, 7 and 1 Figure 11 shows a transaction for a person whose preferences are jazz and country music. These screen conditions are displayed 15, 6, 10, 8 and 1 A person who has preferences are for jazz and classical music will be presented with the screen display shown in figure 12. These are screen conditions 16, 6, 13, 8 and 14. Finally, figure 13 presents the screens for a transaction by a person who prefers classical and country music. The screen conditions are 17 13, 10, 14 and 11. As will be appreciated from the previous discussion, these particular product offerings are for example only, as are visual screen and audio and suggestion conditions. Many other types of products may be offered through the financial transaction apparatus of the present invention. Common products include sports event tickets, game tickets, transportation tickets, any other type of product that is offered representing goods or services that can be conveniently represented by a document or ticket. The present invention can also be carried out by connecting to a network 72 or network 112 data warehouses that offer products and audio-visual material which allows users to purchase a wide variety of products through the apparatus of the present invention.

As demonstrated by the previously described incorporation, users can select from several product offers simultaneously. Even when in the incorporation shown the users select between two offers in the same category (for example, concert tickets), in other additions the client can select from a different number of product offers of different types. The presentation of product offer information can be tailored to products and customers and in some cases some customers may receive more limited or broader product offer information.

The preferred embodiment of the present invention also allows the exact identification of an authorized user without the need for the user to carry an identification card. Even though the present invention achieves accurate identification it does not generally offer privacy notions for individuals who do not want others to have access to their fingerprints or iris impressions. Furthermore, it is unlikely that the preferred form of the present invention will be perceived as passing any risk to customers that they may have concerns about devices that explore their eyes, their hands, or other parts of the body.

Therefore, the new method and apparatus of the financial transaction of the present invention achieves the aforementioned objectives, eliminates the difficulties encountered in the use of the previous devices and methods, solves the problems and achieves the desirable results described herein.

In the previous description, certain terms have been used for brevity, clarity and understanding. However, no unnecessary limitations should be implied because such terms are used for descriptive purposes only and are intended to be widely considered. In addition, the descriptions and illustrations herein are by way of example if the invention is not limited to the exact details shown or described.

In the following claims, any characteristic described as means for performing a function will be considered as encompassing any means capable of performing the recited function and should not be limited to the particular means described herein for carrying out the recited function or equivalent numbers. thereof.

Having described the characteristic discoveries and principles of the invention, the manner in which these are carried out and operated, and the advantages and useful results achieved, the new and useful structures, devices, elements, arrangements, parts, combinations, systems, equipment, operations, methods and relationships are set forth in the appended claims.

Claims (30)

R E I V I N D I C A C I O N S
1. An apparatus comprising: a financial transaction machine, wherein the machine includes an image forming device that provides image input signals, and an audio input device that provides audio input signals, at least one transaction function device, for what a user on the side of the machine causes image input signals to be generated and the user's voice causes audio input signals to be generated; a processor, the processing being in an operative connection with the imaging device, the audio input device and the transaction function device, the processor being also in operative connection with the data store, wherein the data includes data corresponding to a plurality of users, user data for each user includes identity data corresponding to the user, image data corresponds to a user's appearance feature, and voice data corresponds to a characteri of the user's voice; wherein the processor operates in response to the image input signals to first resolve the identity data and the processor operates in response to the audio input signals to resolve the second identity data and where the processor operates to compare the First and second identity data for a level of correlation and pair allow operation of the transaction function device when the level of correlation is reached.
2. 2. The apparatus as claimed in clause 1, characterized in that the machine includes a sensor device, wherein the sensor device is operated to perceive the user in the vicinity of the machine, and where the sensor device is in operative connection with the device. processor, and wherein the processor operates to resolve the first identity data in response to the sensor device sensing the user in proximity to the machine.
3. 3. The apparatus as claimed in clause 1, characterized in that the machine includes an output device, and wherein the output device is in operative connection with the processor, and wherein the processing operates to prompt the user to speak to the user. through d suggen outputs presented through the output device, by which when the user speaks, audio input signals are generated.
4. 4. The apparatus as claimed in clause 3, characterized in that the output device includes an exhibitor.
5. 5. The apparatus as claimed in clause 3, characterized in that the output device includes a horn.
6. 6. The apparatus as claimed in clause 5, characterized in that the data store also includes audio output data corresponding to audio outputs and where the output device suggests the user through audio messages.
7. 7. The apparatus as claimed in clause 1, characterized in that the machine also comprises an output device and an input device manually operable and where when the level of correlation is not reached, the processor is operated to drive a user through the output device to operate manually actuatable input device.
8. 8. The apparatus as claimed in clause 7, characterized in that the manually operable input device includes a card reader, wherein the user is urged to put a readable card by the machine associated with the user in the card reader.
9. 9. The apparatus as claimed in clause 8, characterized in that the user data also includes the account data wherein the account data includes at least one account associated with each user, and where the card readable by the machine includes the account identification data corresponding to an account associated with the user of the card, and wherein the card reader provides card entry signals in response to the reading of the card, and wherein the processor operates to resolve the account of the user in response to the data of the account identification.
10. 10. The apparatus as claimed in clause 9, characterized in that the machine includes a keyboard and wherein the processor operates in response to resolving the user's account data to operate the output device pair to prompt the user to enter a code in The keyboard, where the keyboard will generate a keyboard input signals in response to the user entering the code on the keyboard and where the processor operates to allow the operation of the device d transaction function in response to the input signals of keyboard that correspond to the entry by the client of a predetermined code.
11. 11. The apparatus as claimed in clause 1, characterized in that the transaction function device includes a coin dispenser.
12. 12. The apparatus as claimed in clause 1, characterized in that the transaction function device includes a ticket dispenser.
13. 13. The apparatus as claimed in clause 1, characterized in that the machine includes an output device and wherein the user data includes user preference data, and where the data store also includes product offer data, wherein the product offer data are representative of products available for purchase and wherein the processor operates to select the product offers from the product offer data in the data warehouse in response to the user's preference data they correspond to the user and to operate the output device to provide outputs corresponding to the selected product offers.
14. 14. The apparatus as claimed in clause 13, characterized in that the machine includes an exhibitor and the data store also includes representative data of the video materials and wherein the processor operates in response to the user's preference data to select a video material of the stored data and to provide output on the display corresponding to the selected vide material.
15. 15. The apparatus as claimed in clause 1, further characterized in that it comprises an input terminal d in operative connection with the processor, wherein the input terminal includes an additional imaging device, and an additional audio input device, e where the user image data and user voice data are entered through the input terminal.
16. 16. The apparatus as claimed in clause 15, characterized in that the data store also includes a user profile acquisition routine, and where the processor operates to acquire user data from the input terminal in response to the routine acquisition profile user profile.
17. 17. The apparatus as claimed in clause 1, characterized in that the machine includes a sensor device, wherein the sensor device operates to perceive the user in proximity to the machine and wherein the sensor device is in operative connection with the processing and wherein the processor operates to cease operation of the transaction function of the device in response to the sensor device ceasing to perceive the user in proximity to the machine.
18. 18. An operating method of an apparatus comprising the steps of: store in a data warehouse in operative connection with a processor, the user data for a plurality of users, said user data include: the identity data corresponding to the identity of each user; the image data corresponding to an appearance characteristics of each user; Y the voice data corresponding to a voice characteristic of each user; observing with an image device on a financial transaction machine an appearance characteristic of a user adjacent to the machine; solving the first identity data of the user with said processor of said appearance feature and of the image data in the data store; receiving with an audi input device on the financial transaction machine a voice feature of the user at the side of the machine; further solving the second user identity data with the processor from the voice feature and the voice data in the data store; comparing the first and second user identity data with the processor to determine whether such data corresponds to a single user; Y enabling the operation of a device of transaction function on the machine when the first and second identity data correspond to a single user.
19. 19. The method as claimed in clause 18, characterized in that the storage step further comprises: store in the data warehouse: the user preference data for each plurality of users; and product offer data corresponding to products available for purchase; and if in the comparison step the first second identity data corresponds to a single user, it also comprises l steps of: select products in said data offer products in response to the user's preference data for the single user; Y remove through an output device the machine the information corresponding to the selected products.
20. 20. The method as claimed in clause 18, characterized in that the storage step further comprises storing for each plurality of the users manual input data and where in the comparison step d the first and second identity data n correspond to a single user, and before step d habilitation, also comprises the steps of: suggest to the user through an output device in the machine to make an input through manually input device or input on the machine and furthermore, comparing the input of user data through the input device for manual data entry into the data store, where the correspondence of the data resolves the identity of a single user.
21. 21. The method as claimed in clause 18, characterized in that the storage step comprises driving a user through an input terminal d to provide at least the voice data or the image information data.
22. 22. The method as claimed in clause 19, characterized in that the storage step comprises driving a user through an input terminal d to provide user preference data.
23. 23. The method as claimed in clause 18, characterized in that the financial transaction machine also includes a sensor device where the sensor device allows to perceive the user in proximity to the machine and also comprises the step of avoiding the operation of function device of transaction in response to the user ceasing to be perceived in proximity to the machine.
24. 24. The apparatus comprising: a financial transaction machine, which includes a characteristic input device for perceiving at least one vocal physical characteristic of a user to one side of the machine, a manual input device and a transaction function device; a processor in operative connection with a data store, the processor in operative connection with the characteristic input device and the manual input device, wherein the data store includes characteristic data representative of the characteristic associated with a user, data of input associated with a manual input that corresponds to the user, and wherein the processor operates to determine if the characteristic data correspond to a characteristic of a user in proximity to the machine and if so, to allow the operation of the device. transaction function; and if not, to determine if the manual input by the user through the manual input device on the machine corresponds to the input data for the user if this is so, to allow the operation of the transaction function device.
25. 25. The apparatus as claimed in clause 24, characterized in that the feature data includes data representing both vocal physical characteristics of a plurality of authorized users, and wherein the user's characteristic in the machine must correspond both physical and vocal data. of an authorized user and where correspondence with such transaction function device is enabled to be operated.
26. 26. The apparatus as claimed in clause 25, characterized in that the manual input device includes a card reader so that the card reader reads a card that includes the identification card data corresponding to a user.
27. 27. The apparatus as claimed in clause 26, characterized in that the manual input device also includes a keyboard, wherein the user is enabled to enter a code corresponding to the user through the keyboard, and where the function device d transaction is enabled to be operated when the code d and card identification data both correspond to authorized user.
28. 28. The apparatus as claimed in clause 24, characterized in that the machine includes an audio output device, and wherein the audio output device is in operative connection with the processor, where the processor operates the audio output device pa prompting the user to provide an entry.
29. 29. The apparatus as claimed in clause 28, further characterized in that it comprises a suppression input device, wherein the user is selectively enabled to suppress the operation of the audio output device, whereby a user is enabled to selectively conduct a silent transaction.
30. 30. The apparatus as claimed in clause 29, characterized in that the processor operates in response to the selection of a suppression device for storing the characteristic data in relation to the user of the data store. SUMMARY A financial transaction apparatus includes a financial transaction machine. The machine includes devices including transaction function devices to carry out operations associated with financial transactions. The terminal also includes an imaging device and an audio input device as well as a visual output device and an audio output device. The terminal is connected to a computer which has an associated data store. The data store includes user data that includes image data and voice data that correspond to authorized users. The identity of a client operation of the machine is determined by resolving the first identity data based on the image signals from the image forming device which corresponds to the appearance of the user. The second identity data is solved by the processor of the voice signals of the audio input device corresponding to the voice of the user. The computer enables operation of the transaction function devices if the level of correlation between the first and second identification data is sufficient to establish that the image and voice signals originate from a single authorized user.