JP2012185736A - Smile banking system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system which is useful to improvements in image of a bank and customer satisfaction by making good use of technique associated with "smiles".SOLUTION: An ATM installed in bank facilities includes smile induction means of making a customer smile and picks up a naturally induced smile of the customer. The ATM extracts a part of a face image from the picked-up image of the customer, and determines "the degree of smile" of the face image. Further, the ATM includes means of presenting privilege service predetermined according to the determined degree of smile and letting the customer select it. An authentication server generates a composite image from the smile face image and distributes the composite image to a terminal in the bank facilities so as to implement the privilege service that the customer selects at the ATM. The customer when operating the ATM can receive the privilege service from the bank according to the degree of smile only by photographing the image of his or her smile.

Description

  The present invention relates to a banking system, and more particularly to a banking system based on the theme of smile for improving customer satisfaction.

  In recent years, various companies have been making various efforts to improve customer satisfaction (CS). As part of this effort, efforts are being made to educate employees about customer service manners. Contacting customers with “smiles” is very important for enhancing the corporate image and enhancing the sense of familiarity and security of customers.

  By the way, as a technique related to this “smile”, “smile recognition” realized in recent digital cameras and the like can be mentioned. The purpose of this is to detect a face portion from an image of a person, evaluate the facial expression of the detected face, and capture an image that is highly satisfactory for the subject or photographer ( For example, see Patent Document 1). There is also a technique related to a training device for evaluating facial feature points and allowing a user to effectively train facial muscles (see Patent Document 2). In addition, an image processing method has been developed that can digitize a user's smile status as a “smile level” and objectively evaluate the status (see, for example, Patent Document 3).

JP 2008-42319 A JP 2008-264367 A JP 2010-186373 A

  The technology related to “smile” shown in the above patent document was developed as an elemental technology for digital cameras and game machines, but this technology related to “smile” should be used to improve customer satisfaction. There are still few that have been offered as secure systems. Improving customer satisfaction is no exception for banks, and it is particularly time-consuming for customers to wait for a long time at long lines and windows in front of ATMs, as often seen in bank stores. It is wasteful and contributes to a decline in customer satisfaction. It is also often heard that young people nowadays do so at a convenience store rather than a bank to withdraw money. In this way, the opportunities for young people to go to bank stores are decreasing.

  In Europe and the United States, based on the customer experience (customer understanding) strategy, for example, the store of a bank is made into a space like a hotel lobby, information is provided on a large screen touch panel, a local singer mini concert is held, etc. Some banks have achieved an increase in custody assets by allowing customers to stay in cozy stores for a long time and have many conversations with their employees. Thus, how to connect a bank store, which is the forefront of contact with customers, to improve customer satisfaction is an issue.

  The present invention has been made in view of the problems as described above, and is intended to provide a system useful for improving the image of a bank and improving customer satisfaction by applying a technology related to “smile” to the environment of a bank store. Objective.

  In order to solve the above-described problems, the banking system of the present invention (hereinafter referred to as “smile banking system” in the meaning of a system that brings a smile to a bank store) has the following characteristics. .

  In a bank system connected to an ATM that accepts a request relating to a customer's money transaction and an authentication server that performs customer authentication, the ATM includes an image capturing unit that captures an image of the customer, and the customer's image from the captured image. A face image detection unit that detects a face image; and a smile processing unit that determines a smile level of the face image and presents a service according to the smile level. , Smile guidance means for selecting and outputting at least one of pre-stored text, images, and voices for guiding smiles, and smile levels for determining the smile level of the captured face image by quantifying Determining means; and privilege service presentation means for allowing a customer to select a predetermined privilege service according to the determined smile level, and the authentication server requests from the ATM In addition to customer authentication of which, characterized in that it comprises a privilege service execution unit for executing the selected privilege service.

  According to the said structure, ATM installed in the bank store has the smile guidance means which invites a customer's smile, and images the customer's smile induced naturally by this. Further, the ATM extracts the face image portion from the captured customer image (mainly the upper body image), and determines the “smile level” of the face image. And a privilege service predetermined according to the determined smile degree is presented to the customer and selected. The authentication server executes the selected privilege service in addition to customer authentication. That is, the customer can receive a privilege service from the bank according to the degree of smile by taking an image of his / her smile when operating the ATM. Here, the privilege service may be, for example, interest rate preferential treatment such as a mortgage loan or a card loan, but may not be directly related to the bank service.

  In this way, the customer can receive a privilege service just by taking a picture of himself / herself after the ATM operation, and can enjoy the operation of the ATM, and the store in the bank becomes a familiar place. For banks, it can be expected that the number of customers visiting the store will increase, and the impression of a bank full of smiles can be obtained, so the corporate image will be enhanced. Here, even if the customer does not laugh particularly, just laughing “suck” is effective to soften the surroundings.

In addition, the bank system described above can further include the following features.
The authentication server includes a composite image output unit that combines the captured customer image with at least one of a prestored background, person, animal, and character image, and is displayed in the privilege service. Alternatively, the synthesized image is added to data to be distributed.

  According to the above configuration, the authentication server synthesizes a captured customer image and a prestored image (background, person, animal, character, etc.) as one means for executing the privilege service, and is preferred by the customer. A composite image (for example, a two-shot image with a favorite actor or a cute animal) is created. The created composite image is added to data to be displayed or distributed as a privilege service, and the customer can enjoy his / her composite image in various scenes. In addition, if you can create a composite image that can be printed in the style of Purikura (registered trademark), it will be familiar to young people.

In addition, the bank system described above can further include the following features. That is, the data displayed in the privilege service includes at least one character information or image information among time, weather, news, and advertisement.
In this way, the customer who sees the composite image can feel as if he / she became a news caster or CM talent who communicates time, weather, news, and the like.

In addition, the bank system described above can further include the following features. That is, the data distributed in the privilege service is a direct mail.
By doing this, the composite image of the self-photo is printed on the direct mail etc. sent from the bank to the customer, so the interest of the direct mail is increased for the customer, and the direct mail is also not read for the bank and discarded. Can be reduced. The direct mail may be printed matter as well as electronic mail.

  In addition, the bank system described above can further include the following features. That is, the privilege service presenting means includes means for collecting evaluation data of others for the captured customer face image in addition to the determined smile level, and the smile ranking obtained from the evaluation data is expressed as the privilege ranking. It is added to the service presentation conditions.

  According to the above configuration, in addition to the “smile level” mechanically determined by the ATM for the self-smile, “smile ranking” based on voting by others can be added to the presentation conditions of the privilege service. Therefore, the possibility of receiving a privilege service with higher value is increased.

  In addition, the bank system described above can further include the following features. That is, the authentication server performs face authentication using a plurality of customer face images having different smile levels determined by the smile level determination unit as an authentication unit for verifying the identity of the customer. .

  According to the above configuration, the bank system of the present invention can perform face authentication using the captured face image at the same time, taking advantage of the ability to capture the customer's face image without resistance. However, face images registered in advance for authentication are also registered with a plurality of face images so that the customer can handle various smiles in front of the ATM. By doing so, there will be less resistance to taking a picture of your face at the bank, and it is expected that more customers will use face authentication as a more secure authentication method than just a PIN. Is done. Also, you can't smile under the circumstances where you are forced to “drop money”, so when you withdraw or transfer money, your smile level should be more than XX% to prevent crime. It is also possible to place a restriction that disables the operation.

  The banking system of the present invention described in the above solution is composed of an ATM installed in a store and an authentication server. However, for a customer who mainly uses the net banking, the bank system and the authentication are used. The server can also be realized with the following configuration.

  In a bank system in which a customer terminal, a net banking server that accepts a transaction request from the customer terminal via a network, and an authentication server that performs customer authentication are connected, the customer terminal captures an image of the customer. An image pickup unit, wherein the net banking server receives the picked-up image from the customer terminal, detects a face image of the customer, determines a smile level of the face image, and A smile processing unit that presents a service corresponding to the smile level, and the smile processing unit includes at least one of text, image, and voice stored in advance for guiding the customer to smile. A smile guidance means for selecting and outputting, a smile level determination means for determining the smile level of the captured face image by quantifying, and according to the determined smile level, Privilege service presenting means for allowing a customer to select a privilege service defined for the customer, and the authentication server, in addition to the customer authentication requested from the customer terminal via the net banking server, It is provided with the privilege service execution part which performs.

  The present invention can also be regarded as a customer service providing method in a bank system in which an ATM or a net banking server is connected to an authentication server as described below.

  Customer service in a bank system in which an ATM that accepts a request relating to a customer's money transaction, a customer terminal, a net banking server that accepts a transaction request from the customer terminal via a network, and an authentication server that authenticates the customer A method of providing, wherein the ATM or the customer terminal captures and transmits a customer image, and the net banking server or the authentication server receives the captured image, and A step of detecting a portion; a smile degree induction step of selecting and outputting at least one of text, image, and voice stored in advance for inducing a smile to the customer; and the captured face A smile level determination stage for determining the smile level of an image by a numerical value, and a privilege service determined in advance according to the determined smile level Run a privilege service selection step of selecting the customer, the authentication server, in addition to the authentication of the customer is requested from the customer terminal, the customer service providing method characterized by comprising the step of performing the privilege service.

  ADVANTAGE OF THE INVENTION According to this invention, the new ATM and store terminal which incorporate various ideas for calling a customer's smile to a bank store can be provided, and the system which improves the image to a bank and a customer satisfaction can be implement | achieved.

It is a figure which shows the external appearance of the outline of the smile ATM which concerns on 1st embodiment of the smile banking system of this invention. It is a figure which shows the image of a smile ATM installation store. It is a figure which shows the functional block of the smile ATM and smile authentication server which concern on 1st embodiment of the smile banking system of this invention. It is a figure which shows the image about a smile degree. It is a figure which shows an example of a smile degree privilege service association table. It is a figure which shows the processing flow of the smile ATM and smile authentication server which concern on 1st embodiment of the smile banking system of this invention. It is a figure which shows an example of a smile ATM menu screen. It is a figure which shows an example of a smile imaging | photography screen. It is a figure which shows an example of a smile registration screen. It is a figure which shows an example of the synthesized image produced from the imaged customer's face image. It is the figure which used the synthetic image for direct mail. It is a figure which shows an example of a smile vote screen. It is a figure which shows an example of the bankbook using a face image. It is a figure which shows the functional block of the smile ATM and smile authentication server which concern on 2nd embodiment of the smile banking system of this invention. It is a figure which shows the processing flow of the smile ATM and smile authentication server which concern on 2nd embodiment of the smile banking system of this invention. It is a figure which shows the functional block of the net banking server and smile authentication server which concern on 3rd embodiment of the smile banking system of this invention. It is a figure which shows the processing flow of the net banking server and smile authentication server which concern on 3rd embodiment of the smile banking system of this invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as embodiments) will be described in detail with reference to the accompanying drawings. In addition, the same number (code | symbol) is attached | subjected to the same element through the whole description of embodiment.

  FIG. 1 is a diagram showing an outline appearance of a smile ATM according to the first embodiment of the smile banking system of the present invention. “Smile ATM” comprises the smile banking system of the present invention, means for inducing a customer's smile (smile), means for imaging the customer's smile, means for determining the degree of smile of the customer, etc. It is the name of a new concept ATM (Automated Teller Machine).

  As shown in the figure, the smile ATM 10 is not much different from a normal ATM in appearance, and is a customer input operation key (operation button), an operation guide, and a touch panel 15 ("ATM service display / operation section") for displaying operation contents. A passbook entry part 17A for reading and printing a bankbook, a card reading part 17B for reading a cash card or a transfer card (sometimes integrated with a printing part for a usage statement slip), and a coin entry / exit for handling coins 17 C of gold | metal | money parts and the banknote depositing / withdrawing part 17D which handles taking in / out of a banknote are provided. Furthermore, ATM10 is provided with the image display part 11, the image imaging part 12, and the audio | voice output part 13 as a means to acquire a customer's smile (smile). Although not particularly illustrated, a biometric authentication mechanism such as fingerprint authentication or palm authentication may be provided. In addition, as for this ATM, it is desirable that the height of a chair, an operation part, and a display part is designed appropriately so that it can be operated even if the customer is sitting.

  The image display unit 11 can be replaced by a touch panel 15 (ATM service display / operation unit), but may be configured by a display device arranged to face the customer separately from the touch panel 15 as shown in the figure. desirable. Of course, the image display unit 11 may be configured with another touch panel so as to accept not only display but also input. The image capturing unit 12 is a digital camera provided to capture an image of a customer who has come to operate an ATM. As will be described in detail later, when the customer sits in front of the ATM, various images and texts for guiding the customer to smile are displayed on the image display unit 11 and the touch panel 15, and voices (music, sound effects, etc.) associated therewith are displayed. Are output from the audio output unit 13.

  The image display unit 11 displays a customer image as a subject in addition to the smile induction image and text. When the customer performs a predetermined operation (for example, pressing the shutter button displayed on the touch panel 15 or the image display unit 11) while confirming his / her face, the shutter of the camera of the image capturing unit 12 is lowered, and the customer's The image at that moment is recorded. The recorded image is immediately displayed on the image display unit 11 for confirmation. The audio output unit 13 is typically composed of a speaker and an audio output circuit, but other headphones may be added. The voice output unit 13 may also serve as a voice guide output unit (not shown) for guiding the operation of the touch panel 15 by voice. As described above, the smile ATM 10 has an image capturing function, a display function, and a sound output function that are not found in the normal ATM. However, the smile ATM 10 also functions as a normal ATM.

  FIG. 2 is a diagram showing an image of a store with a smile ATM. It is preferable that the bank store introducing the smile banking system of the present invention provides a space where customers can stay comfortably in the store. For example, as shown in the figure, a large display 30A that always displays information useful to the customer, a customer terminal 30B that can be directly operated in the store while the customer is sitting at the desk, and a BGM are provided, and a sofa and a chair that can be sat down are equipped. The above-described smile ATM 10 is desirably installed in such a store as a dedicated terminal, in addition to a normal ATM corner, and can be operated without worrying about the line of sight of other customers.

  FIG. 3 is a diagram showing functional blocks of a smile ATM according to the first embodiment of the smile banking system of the present invention. As shown in FIG. 1, the smile ATM 10 includes an image display unit 11, an image capturing unit 12, an audio output unit 13, a touch panel 15 (ATM service display / operation unit), a passbook entry unit 17A, and a card. A reading unit 17B, a coin deposit / withdrawal unit 17C, and a bill deposit / withdrawal unit 17D are provided. Furthermore, a face image detection unit 14, a smile processing unit 16, and an authentication request unit 18 are provided as internal function blocks. The external function block has already been described with reference to FIG.

  The face image detection unit 14 detects and extracts a face portion from the customer image captured by the image capturing unit 12. The detection of a face portion generally uses a technique called “Facial Recognition System”. The face recognition system is a technique for identifying a face of a person by extracting a part that seems to be a face in a live image and comparing it with a face image database (not shown). In other words, identification is performed by extracting a prominent feature from the face image. For example, the relative position and size of facial parts, the shape of eyes, nose, cheekbones, and chin are used as features. Using such features, search for images with matching features. Since the face recognition system is a well-known technique widely used in digital cameras and the like, detailed description thereof is omitted.

  The smile processing unit 16 further selects and outputs a text, an image, a voice and the like for guiding a smile naturally to a customer sitting in front of the smile ATM 10 and a face image detecting unit 14. The smile degree determining means 16B for determining the “smile level” of the face image detected by the above, and the privilege service presenting means 16C for displaying a privilege service predetermined according to the determined smile level, and presenting and selecting to the customer. Is done.

  When it is detected that the customer is sitting at the ATM, the smile guiding means 16A is activated automatically or semi-automatically and outputs text, images, sounds, etc. that induce a smile. The timing at which the smile guiding means 16A is activated may be before the ATM transaction operation is started, during the transaction operation, or after the transaction operation ends. For example, before starting the transaction, words and images (including moving images and animations) that make you want to laugh unexpectedly are displayed on the ATM menu screen of the touch panel 15. Furthermore, another word or image for enhancing the smile induction effect may be displayed on the image display unit 11, and a sound or sound effect may be sent from the sound output unit 13 accordingly.

  Images, texts, voices, etc. for inducing smiles are stored in advance in Smile ATM 10 or an external server (smile authentication server 20 described later), but the images to be taken out may be random, seasonal, current events, etc. You may make it select in consideration of information, such as news. In addition, if the customer has inserted a cash card or bankbook into the ATM, the content corresponding to the customer's profile (age, gender, etc.) and transaction details may be output. In this way, the customer who sees the image or the like output by the smile guiding means 16A can spill naturally and smile without having to laugh forcibly in front of the camera. In addition, the customer can feel pleasant just by operating the ATM without pressing the shutter of the camera. A specific example of the smile guidance means will be described later.

  After inserting the cash card, the authentication requesting unit 18 requests the input of a personal identification number, and requests the personal identification from the bank host computer or the authentication server. If ATM is compatible, means such as fingerprint authentication or palm authentication may be used instead of the password. Although details will be described as the second embodiment, since the smile ATM 10 has an image capturing unit for a customer's face image, the face image captured here may be used for authentication. By doing so, it is expected that the face image is taken naturally, and that it is useful for the spread of a face authentication system with higher security of authentication.

  The smile authentication server 20 is a server that is connected to the smile ATM 10 via a network in the bank, authenticates the customer, and mainly performs post-processing of the smile processing unit 16 of the smile ATM 10. In addition to connecting to the Smile ATM10, it is also connected to the bank's host computer via a dedicated network, accepting normal transaction processing requests such as transfers and withdrawals from the Smile ATM10, and authenticating the identity and host computer as preprocessing of the transaction The relay process may be performed. In such a configuration, the authentication unit 27 of the smile authentication server 20 functions as a relay that receives authentication request data and other data from the authentication request unit 18 of the smile ATM 10 and transmits / receives data to / from the host computer. Further, since the smile authentication server 20 performs a privilege service execution process as will be described later, the in-bank terminal 30, the DM distribution server 40, and the smile ATM 10 and the host computer are separated from each other (typically the Internet). Connected.

The smile image registration unit 21 stores in the smile image DB 25 the face image provided with numerical data as the smile level determined by the smile level determination unit 16B of the ATM 10, and passes the processing to the smile ranking acquisition unit 22. The smile ranking acquisition unit 22 compares the smile levels of the face images of other customers registered in the smile image DB 25 and the face image captured this time, and determines the rank of smile levels (smile rank). Further, a smile vote screen can be displayed on the bank terminal 30 (for example, the large display 30A or the customer terminal 30B in FIG. 2), and a popularity vote for a face image from another customer can be accepted. The smile ranking may be determined from the collected voting data. The smile image vote receiving means displays it on a terminal in the bank at an arbitrary timing. In addition to the terminal 30 within the bank, a voting reception means (information such as a link to a smile voting screen) is added to a direct mail (DM) distributed from the bank, and the home PC of the customer from the DM distribution server 40 You may make it transmit to a mobile telephone. When the direct mail is a printed matter, a similar direct mail document may be sent from the DM distribution server 40 to the DM creation center or the like.
Of course, it is assumed that there is means for requesting the judgment of the customer as to whether or not to enter the smile vote. After the smile voting period, the smile ranking value is added to the smile image and stored in the smile image DB 25.

  The privilege service execution unit 23 provides the customer with the smile level of the face image captured this time and the smile ranking obtained from the smile ranking acquisition unit 22 based on the smile level privilege service association table 100 described later. Generate a list of available privilege services. The obtained list of privilege services is transmitted to the privilege service presenting means 16C of the smile ATM 10, and the privilege service presenting means 16C displays it in a menu format to select the privilege service desired by the customer. If the selected privilege service creates a composite image, the process is passed to the composite image output unit 24. If the selected privilege service does not involve creation of a composite image, the process is passed to an appropriate system that executes necessary processes according to the contents of the service. For example, if the selected privilege service sets a preferential interest rate for a loan, the process is passed to a system (not shown) for managing and setting the interest rate of each loan. In addition, the privilege service execution unit 23 manages the provision of “smile points” described later and exchange with privilege services.

  The composite image output unit 24 has a function of reading a smile image from the smile image DB 25 and creating a composite image with another image as one of the privilege services selected by the customer. Further, it may have an image editing function. Other images are various images such as backgrounds, people, animals, characters, etc. that are stored in the composition image DB 26, and are a collection of materials that can be combined with customer smile images to obtain more fun images. is there. The image to be combined can be selected by the customer from the smile ATM 10 or the customer terminal 30B, but the type of image that can be combined may differ depending on the smile level or smile point of the face image. Good. In addition, the synthesized image itself may be a subject for smile voting. The composite image output unit 24 also plays a role of displaying the combined smile image on the image display unit 11 of the smile ATM 10 or the bank terminal 30 or outputting it to the DM distribution server 40. In this case, the bank terminal 30 as a display destination may be not only a terminal in a store but also a terminal of another branch, a customer's home PC, or a mobile phone. Similarly, the delivery destination of the DM may be the customer's home PC or mobile phone.

Note that the functional blocks shown in FIG. 3 are merely examples, and one functional unit may be divided or a plurality of functional units may be configured as one functional unit. The number of server devices is not limited to one, and may be a plurality. Each functional unit has a CPU (Central Processing Unit) built in the server device and a ROM (Read Only
A computer program stored in a storage device such as a memory or a hard disk is read, and the computer program executed by the CPU is stored in a database (DB; Data Base) stored in the storage device or a storage area on the memory, etc. It is realized by reading and writing necessary data and controlling related hardware (for example, input / output device, display device, communication interface device) in some cases. In addition, the database (DB) in the embodiment of the present invention may be a commercial database, but it simply means a collection of tables and files, and the internal structure of the database itself does not matter.

  FIG. 4 is a diagram showing an image of the smile level. As already described, the smile level is a numerical value of smile evaluation for the face image determined by the smile level determination means 16B of the smile ATM 10. For example, if the degree of smile is represented by a numerical value of 0 to 100%, it is determined that a smile of about 100% is a full smile, a smile of about 50% is a smile of ordinary smile, and a smile is closer to 0% (0 Nearly% may be sad or angry). Known techniques such as those described in Patent Documents 1 to 3 may be used to digitize the smile level. For example, the technique of Patent Document 3 uses a 3D model fitting technique that quickly adapts a 3D face shape model created based on the face images of several thousand people to a 2D face image, thereby rapidly changing the face shape. We measure and capture the shape of the eyes and mouth in real time, and further analyze changes in facial wrinkles that are characteristic of smiles in detail around the eyes and mouth, and analyze these changes using statistical methods.

  FIG. 5 is a diagram illustrating an example of a smile degree privilege service association table. The smile degree privilege service association table 100 is a table that defines the association between the smile degree determined by the smile degree determination means 16B, the smile ranking obtained by the smile ranking acquisition unit 22, and the privilege service provided to the customer. . For example, in the example of this figure, when the smile level is 100%, “smile points” corresponding to smile rankings are given. The smile ranking may be obtained relatively by comparing the smile level of the customer's face image with the smile level of other customers registered and stored in the smile image DB 25, or the “smile vote” described above. May be performed in a bank and requested by voting from other customers. The “smile point” is a point that can be exchanged for a predetermined privilege service in the bank. The more smile points, the more valuable benefits you can receive. In the table of this example, when the smile degree is 90 to 99%, the interest rate preferential service of the house Loon, when the smile degree is 80 to 89%, a service that can be registered in the “smile clock” described later, and when the smile degree is 70 to 79%, Services that can create two-shot composite images with your favorite actors, etc., are determined according to smile rankings. For example, in this example, even if the smile degree is 100%, the number of smile points that can be acquired varies depending on the smile ranking. Of course, the smile level and the privilege service or the smile ranking and the privilege service may be independently associated with each other.

  The table in FIG. 5 is merely an example, and a plurality of privilege services may be defined for a combination of a smile degree and a smile ranking, and the table may be configured so that a customer can select a privilege service desired by the customer. Good. The privilege service presenting means 16C uses the smile degree privilege service association table 100 to display the content of the privilege service provided to the customer on the touch panel 15 (ATM service display) based on the smile degree and smile ranking for the customer smile image. / Operation section) (see FIG. 3). For example, when a composite image creation service with an actor is selected for the privilege service displayed on the touch panel 15, images of a plurality of actors are displayed, and the customer can select a desired actor from the images. The information of the composite image selected by the customer is transmitted to the composite image output unit 24 of the smile authentication server 20 and used for creating the composite image and controlling the output destination of the composite image.

  FIG. 6 is a diagram showing a processing flow of the smile ATM and the smile authentication server according to the first embodiment of the present invention. In this figure, the smile ATM 10 is simply referred to as ATM, and the smile authentication server 20 is simply referred to as authentication server.

  First, when the presence of a customer in front of the ATM is detected by the sensor equipped in the ATM (step S10; Yes), the ATM displays a smile induction image (step S11). If there are text and audio as well as images, they are output simultaneously here. Next, when the shutter button of the camera is pressed by the customer (step S12; Yes), an image of the customer is taken and stored.

  In step S13, an image stored at the time when the shutter is pressed is analyzed, and a face image extraction process for detecting and extracting a face portion is performed. Next, smile level determination processing is performed in step S14. Since the process of step S13 and step S14 is a well-known technique, description is abbreviate | omitted here. Next, in step S15, the ATM requests the customer to insert a card such as a cash card, and transmits the read card data to the authentication server. At the same time, the face image whose smile level is determined in step S14 is transmitted to the authentication server (step S15). In addition, the dotted line shown in the flowchart of a figure has shown the flow of data (hereinafter the same). At the same time as step S15, the ATM asks the customer to decide whether or not to participate (entry) in the smile vote, and if there is a predetermined operation of the customer to participate (step S16; Yes), the request is authenticated. It transmits to the server (step S17). However, even when there is a predetermined operation by the customer not to participate (step S16; No), the fact is transmitted to the authentication server.

  When the authentication server receives data from the ATM and detects that there is any request (step S20; Yes), the customer is identified from the received card data and the photographed face image is registered in the smiley image DB 25. (Step S21). If there is an intention to participate in the smile vote (step S22; Yes), smile vote acceptance processing is started (step S23).

  Specifically, the smile voting acceptance process is to add the received face image to a voting screen to be described later and display it on the large display 30A or the customer terminal 30B in the store to accept the vote. A customer or the like in the store can vote for a smiling image with high liking from the displayed voting screen. The authentication server totals the data of the voting results and records it in the smiley image DB 25. Then, the smile ranking of each image is updated from the recorded voting result data. You may make it display the image of a ranking condition or a higher smile degree ranking on the large display 30A. The smile ballot acceptance process itself does not need to be synchronized with the operation request from the smile ATM 10, and may be performed by a server different from the authentication server.

  Returning to the flowchart of FIG. 6, when the customer has no intention to participate in the smile vote (step S22; No), the smile level of the received image is set to the smile level of other customers stored in the smile image DB 25. Compared with the data, the smile ranking of the image is obtained. Then, the obtained smile ranking is transmitted to the ATM side (step S24). On the ATM side, based on the determined smile level and the received smile ranking, the corresponding privilege service is read out from the smile level privilege service association table 100 and an available privilege service menu is displayed (step S18). When the customer selects the desired privilege service from this menu, information on the selected privilege service is transmitted to the authentication server (step S19). On the authentication server side, the privilege service execution unit 23 separately executes the privilege service according to the selected information.

  FIG. 7 is a diagram illustrating an example of a smile ATM menu screen. When the smile ATM 10 detects that the customer is present in front of the ATM, the smile ATM 10 displays a menu screen together with a voice message “Welcome”. Up to this point, it is the same as a normal ATM, but the smile ATM menu screen 200 displayed here is added with texts and images as shown in the figure that make the customer laugh unexpectedly. For example, an animated image 201 is displayed, or in the operation button area 202, a witty sentence as shown in the figure is displayed beside each button. Although this sentence may be displayed at random, in this example, it has some relationship with the function of the operation button. In addition to text, an image may be displayed.

  In addition, when the customer presses any of the transaction buttons, the screen transits to a screen such as transfer or withdrawal, but the transition destination screen may also display text and images corresponding to each screen. . For example, after a customer inserts a cash card, a message corresponding to the customer's profile can be output from the card data. The text and images displayed here should be displayed casually so as not to interfere with the operation of the ATM, and it is important to always feel fresh so that customers do not feel annoyed or bored. is there. This menu screen also has a smile shooting function, so that whenever a customer is interested in shooting a smile, the “shoot smile” button 203 can be pressed before or after a transaction operation such as a transfer. It has become.

  FIG. 8 is a diagram illustrating an example of a smile photographing screen. When the customer presses the “Smile smiling” button 203 on the smile ATM menu screen 200, a smile photographing screen 300 as shown in the figure is displayed, and a smile guidance text / image 301 is displayed. If you can't laugh this time, you're busy, and you usually want to enjoy it but skip this time, you may have a button (not shown) like "Skip smiling face". Audio may be output at the same time. The smile guidance text / image 301 may be displayed on the touch panel 15, but is preferably displayed on the image display unit 11. The smile guidance text / image 301 may also be changed continuously at random. The customer does not have to make a smiling face by looking at these texts and images in front of the ATM, and while looking at the live image 302 of his / her face that has moved to the same screen, the customer can take a shutter at an appropriate timing. By pressing the button 303, a smiling face image can be taken naturally.

  FIG. 9 is a diagram illustrating an example of a smile registration screen. The smile registration screen 400 is a screen that is displayed after the customer presses the shutter button 303, and the photographed face image 401 is displayed on this screen. The customer can see the face image and select one of “save”, “save and enter the smile vote”, “perform face authentication”, and “retake”. When “save” 402 is selected, the photographed image is registered in the database and can be used later when creating a composite image. When “Save and enter smile vote” 403 is selected, an image taken this time can be entered in a smile vote (smile contest) held in the bank. The result of the smile voting may be reflected in the smile point or may be reflected in the contents of the privilege service. When “perform face authentication” 404 is selected, face authentication can be performed by comparing the face image captured this time with a customer face image registered in advance. When “Re-shoot” 405 is selected, the screen returns to the smile shooting screen 300.

  A smile level, a smile level ranking, a smile point acquired this time, and a cumulative smile point are displayed in a region 406 with respect to the photographed face image 401. The smile level ranking displayed here indicates how much the smile level of the face image 401 this time is in the overall image. Smile points are given according to rules determined in advance based on smile levels and smile rankings. In addition, when exchanging for a privilege service using the stored smile points, a favorite privilege service is selected from the area 407 as shown in the figure. Here, it is displayed as a privilege service that can be exchanged for a smile point acquired by creating a composite image with a landscape / animal, creating a composite image with an actor, registering with a “smile clock”, and preferential treatment with a 1% card loan interest rate. Even from this screen, the normal ATM operation can be directly returned from the area 408.

  FIG. 10 is a diagram illustrating an example of a composite image created from a captured customer face image. The captured customer image is transmitted to the smile authentication server 20, where it can be combined with other images and text blocks to create and edit a composite image. This figure is an example of the composite image. For example, the composite image 500 generates an image called a “smile clock” by combining a background image in the city and a text block linked with the current time information. You can synthesize not only the background but also the hand and lower body images with text blocks. The composite image 501 is combined with a text block of weather forecast and news information to create composite images called “smile weather forecast” and “smile news”. You may make it synthesize | combine the image of an advertisement or may include the tagline of an advertisement in a text block. The composite image 502 is created by combining a customer image and a photograph of an actor or the like in a photo booth (registered trademark) style. The composite image is stored in the composite image DB 26 and can be arbitrarily selected such as a person, an animal, a plant, and a figure. However, the composite image that can be created is a range in which an object such as an actor can be selected, You may make it give a difference with respect to image quality, size, etc. according to the smile point to be used. Further, the created composite image itself may be a subject for smile voting.

  The composite image created in this way may be displayed on a bank homepage or the like in addition to being displayed on the large display 30A and the customer terminal 30B in the store. By doing this, you can create an image like a “smile bank” with a lot of smiley images in the bank, leading to an improvement in the corporate image. It also gives young people a sense of familiarity with banks.

  FIG. 11 is a diagram in which a composite image is used for direct mail (DM). As shown in this figure, in the direct mail 600, in addition to the notification information from the bank, the composite image 502 created by the customer is added to the header portion of the DM and transmitted to the customer. Direct mail is often discarded without taking your eyes as spam mail, but when your image is sent together with an image synthesized with your favorite actor etc. It is expected that there will be less immediate destruction. In addition, it is desirable that the direct mail can be entered from a link 601 to a screen for performing a smiling vote (next figure), or from a link 602 to a screen for confirming a currently acquired smile point. Even if the direct mail is a printed matter, the same can be done by printing the link information on the DM.

  FIG. 12 is a diagram illustrating an example of a smile vote screen. The smile voting screen 700 is a screen that is displayed on the large display 30A and the customer terminal 30B in the bank, and for performing a popularity vote on the image entered in the smile voting for customers visiting the bank. As shown in the figure, a voter completes voting by selecting a favorite image from a terminal in the bank by viewing a list of displayed images and pressing a vote button 701. When voting from the large display 30A, a remote controller is used. When there are both a person's image and a composite image, the image to be voted on may be a set of the person's image and the composite image as shown in the figure, or may receive a vote as a separate image. . The smile voting screen 700 may be posted not only on a bank terminal but also on a bank homepage or the like so that a vote can be made from a customer's home PC or the like.

  FIG. 13 is a diagram illustrating an example of a bankbook using face images. The face image with the smile level determined can be used in various scenes of banking operations as described above. In this example, a smile image and a thumbnail image of a smile photo at that time are printed on the bankbook or usage statement in response to a transaction performed when the customer images “smile”. . The passbook may be not only a paper passbook but also digital information such as Web usage details. By doing this, smiles are usually displayed in the dry bankbook and usage statement slips, so as nicknames for banking services, for example, “Smile Bank” (“Smile Bank”), “Smile Smile” ”(“ Smile deposit ”),“ Smile passbook ”(“ Smile passbook ”), and so on.

  FIG. 14 is a diagram showing functional blocks of a smile ATM and a smile authentication server according to the second embodiment of the smile banking system of the present invention. In the first embodiment described with reference to FIG. 3, the authentication unit 27 of the smile authentication server 20 performs identity verification using a normal password or biometric authentication. The smile authentication server 20 according to the second embodiment of the smile banking system replaces the authentication unit 27 with a face authentication unit 27A, and the face authentication unit 27A captures an image based on a request from the face authentication request unit 18A of the smile ATM 10. The customer image captured by the unit 12 for smile registration is used for “face authentication”. However, as will be described later, it is desirable that a plurality of images be registered in advance for personal authentication. This is because the customer can authenticate no matter what facial expression is photographed in front of the ATM. The other functional blocks in FIG. 14 are the same as those in FIG.

  FIG. 15 is a diagram showing a processing flow of the smile ATM and the smile authentication server according to the second embodiment of the smile banking system of the present invention. Since the basic flow of this flowchart is the same as that of the flowchart of FIG. 6, only different parts will be described below.

  On the ATM side, after taking a customer image and determining the smile level, in step S15A, the card data and the face authentication request are transmitted to the authentication server. At this time, it is also required to input the password of the card, and the password may be transmitted at the same time. On the authentication server side, face authentication processing is performed using the received face image in step S20B. At this time, the password may also be authenticated.

  In the face authentication process in step S20B, since the face image only becomes a smile image, a known face recognition system technique can be used. However, since a face image captured by ATM may be a face image having various expressions, a reference face image registered in advance for authentication is also a face image having a plurality of different smile levels. Register. Then, from the plurality of reference face images, an image having a smile level close to that of the photographed face image is used. One face image may be compared with a plurality of reference face images with close smile levels, and face authentication may be performed in a double or triple manner.

  If the result of the face authentication is OK (step S20c; Yes), the process proceeds to step S21 and a face image is registered. When the result of the face authentication is NG, as shown by the dotted line from step S20C, the face authentication NG message is transmitted to the ATM side, and the authentication server side does not perform the subsequent processing. In this case, the ATM side displays that the face authentication result is NG, and waits for the customer's next determination (not shown). The subsequent processing (steps S16 to S19) is the same as that in the case of FIG.

  FIG. 16 is a diagram showing functional blocks of a net banking server and a smile authentication server according to the third embodiment of the smile banking system of the present invention. In the first embodiment described in FIG. 3 and the second embodiment described in FIG. 14, the smile ATM 10 faces the customer and performs a smile-related process. In the third embodiment, A mode in which a customer accesses this system in a manner similar to so-called net banking from a customer terminal 30B in a bank or a PC at the customer's home, etc., instead of ATM.

  In the third embodiment, instead of the smile ATM 10, a net banking server 60 (hereinafter referred to as an NB server) is used from a customer terminal 50 (representing both a customer terminal 30B in a bank and a terminal such as a home PC). The request is received, and the same function as the smile ATM 10 is performed. For this reason, the basic functional blocks of the NB server are the same as those of the smile ATM 10, but the image pickup unit 12 provided in the smile ATM 10 does not exist on the server side, and image reception for receiving an image from the customer terminal 50 is received. Part 62 performs that function. The customer terminal 50 is assumed to be equipped with a digital camera. The control unit 69 plays a role instead of the touch panel 15 (ATM service display / operation unit). Here, it is assumed that the NB server performs all communication with the customer terminal 50 and the smile authentication server 20 via the control unit 69. Although not particularly illustrated, a storage unit (or database) that stores text, image, and audio data to be transmitted to the customer terminal 50 as a smile guidance means exists in the NB server. The NB server accepts transfer, balance inquiry, issuance of usage details, and confirmation / change of customer registration information from the customer terminal 50, but of course, it cannot handle banknotes or coins.

  The functional block on the smile authentication server 20 side is the same as in the case of FIG. 14 except that the communication partner is changed from the smile ATM 10 to the NB server. However, in order to be able to receive requests from the smile ATM 10 in parallel, the description of the arrows between the functional blocks has been changed so that all communications with the smile ATM 10 and the NB server are performed via the control unit 29. .

  FIG. 17 is a diagram showing a processing flow of the net banking server and the smile authentication server according to the third embodiment of the smile banking system of the present invention. Since the basic flow of this figure is the same as that of the flowchart of FIG. 15, only different parts will be described below.

  The NB server (net banking server) waits for a request from the customer terminal 50 in step S30. When there is a request from the customer terminal 50 (step S30; Yes), smile guidance data (text, image, voice, etc.) is transmitted to the customer terminal 50 in step S31. And it waits for a face image to be transmitted from the customer terminal 50 (step S32). When a face image is received (step S32; Yes), a face image extraction process is performed. The processing after step S33 corresponds to (steps S13 to S19) in FIG. The authentication server side is the same as in FIG. 15 except that it waits for a request from the NB server instead of ATM in step S20A.

  As described above, in the first, second, and third embodiments, the bank system has been described as a specific example, but the same system can be used for other financial institutions such as securities companies and personal loan companies, and various other services. It can also be applied at a store of a provider company. This is because it is a common issue for companies that provide services how to connect expensive shops to corporate image and customer satisfaction.

  In addition, although this invention was demonstrated using embodiment, it cannot be overemphasized that the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiments. Further, it is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

10 Smile ATM
DESCRIPTION OF SYMBOLS 11 Image display part 12 Image pick-up part 13 Audio | voice output part 14 Face image detection part 15 Touch panel (ATM service display / operation part)
16 Smile processing section 16A Smile guidance means 16B Smile degree determination means 16C Benefit service presentation means 17A Passbook entry section 17B Card reading section 17C Coin deposit / withdrawal section 17D Bill deposit / withdrawal section 18 Authentication request section 18A Face authentication request section 20 Smile authentication server 21 Smile image registration unit 22 Smile ranking acquisition unit 23 Benefit service execution unit 24 Composite image output unit 25 Smile image DB
26 Image DB for composition
27 Authentication Unit 27A Face Authentication Unit 29 Control Unit 30, 30A, 30B Bank Terminal 40 DM Distribution Server 50 Customer Terminal 60 NB Server (Net Banking Server)
62 image receiving unit 64 face image detecting unit 66 smile processing unit 66A smile guidance unit 66B smile degree determination unit 66C privilege service presentation unit 67A transfer processing unit 67B balance inquiry processing unit 67C usage details issue unit 67D registration confirmation / change unit 68 face authentication Request section 69 Control section 100 Smile degree privilege service association table 200 Smile ATM menu screen 300 Smile shooting screen 400 Smile registration screen 500 Smile clock 501 Smile weather forecast, smile news 502 Composite image 600 Direct mail 700 Smile vote screen 800 Smile passbook

Claims (8)

In a banking system to which an ATM that accepts a request related to a customer's money transaction and an authentication server that authenticates the customer are connected,
The ATM is
An image capturing unit that captures an image of the customer;
A face image detection unit for detecting the customer's face image from the captured image;
A smile processing unit for determining a smile level of the face image and presenting a service according to the smile level;
The smile processing unit
Smile guidance means for selecting and outputting at least one of texts, images, and sounds stored in advance for guiding a smile to the customer;
Smile degree determination means for quantifying and determining the smile degree of the captured face image;
According to the determined smile level, a privilege service presenting means for allowing a customer to select a predetermined privilege service,
The said authentication server is provided with the privilege service execution part which performs the said privilege service in addition to the authentication of the customer requested | required from the said ATM, The bank system characterized by the above-mentioned.   The authentication server includes a composite image output unit that combines the captured customer image with at least one of a prestored background, person, animal, and character image, and is displayed in the privilege service. The banking system according to claim 1, wherein the synthesized image is added to data to be distributed.   The system according to claim 2, wherein the data displayed in the privilege service includes at least one character information or image information among time, weather, news, and advertisement.   The bank system according to claim 2, wherein data distributed in the privilege service is a direct mail.   The privilege service presenting means has means for collecting evaluation data of other people with respect to the captured customer's face image in addition to the determined smile level, and the smile ranking obtained from the evaluation data is calculated based on the smile ranking of the privilege service. The banking system according to claim 1, wherein the banking system is added to the presentation condition.   The authentication server performs face authentication using a plurality of customer face images having different smile levels determined by the smile level determination unit as an authentication unit for verifying the identity of a customer. Item 6. The bank system according to items 1 to 5. In a bank system in which a customer terminal, a net banking server that receives a transaction request from the customer terminal via a network, and an authentication server that authenticates the customer are connected,
The customer terminal includes an image capturing unit that captures an image of a customer,
The net banking server is
A face image detector that receives the captured image from the customer terminal and detects the face image of the customer;
A smile processing unit that determines a smile level of the face image and presents a service according to the smile level,
The smile processing unit
Smile guidance means for selecting and outputting at least one of text, image, and voice stored in advance for guiding a smile to the customer;
Smile degree determination means for quantifying and determining the smile degree of the captured face image;
According to the determined smile level, a privilege service presenting means for allowing a customer to select a predetermined privilege service,
The said authentication server is provided with the privilege service execution part which performs the said privilege service in addition to the authentication of the customer requested | required from the said customer terminal via the said net banking server. Customer service in a bank system in which an ATM that accepts a request relating to a customer's money transaction, a customer terminal, a net banking server that accepts a transaction request from the customer terminal via a network, and an authentication server that authenticates the customer Providing method,
The ATM or the customer terminal captures and transmits a customer image;
The net banking server or the authentication server is
Receiving the captured image and detecting a portion of the customer's face image;
A smile degree induction step of selecting and outputting at least one of pre-stored text, image, and sound for inducing smile to the customer;
A smile level determination step for determining the smile level of the captured face image by quantifying;
A privilege service selection step for causing the customer to select a predetermined privilege service according to the determined smile level;
The authentication server is
A method for providing a customer service, comprising: performing the privilege service in addition to the authentication of the customer requested from the customer terminal.