JPH11175818A - Automatic transaction machine - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an automatic transaction machine that does not give a user a feeling of fear or an unpleasant feeling. SOLUTION: This device automatically performs a transaction of coin such as receiving transaction or paying transaction by an operating of a user. At this time, a video camera 18, which continuously inputs the picture of a user including at least the upper part of his body standing opposite to a customer service operation side, is provided. A behavior detection part 25 is provided for detecting the behavior of bringing a hand closer to a bank note part (a coin port) by analyzing the user's behavior from a picture inputted by this video camera 18. If the behavior detection part 25 detects the behavior of bringing the hand closer to the bank note port (the coin port) when a processing of closing a shutter of the bank note port (the coin port) is going to be executed, it is controlled so that the processing of closing the shutter of the bank note port (the coin port) is delayed for a specified time.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an automatic cash dispenser and an automatic cash dispensing machine for automatically performing a deposit transaction or a withdrawal transaction by a user operation in a financial institution such as a bank. It relates to an automatic transaction device.

[0002]

2. Description of the Related Art In recent years, for example, in financial institutions such as banks, automatic transaction machines (so-called ATMs) such as automatic teller machines and automatic teller machines have become remarkably widespread. It is up to processing with an automatic transaction device. In the past, users with visual disabilities who used a counter were not only on Saturdays and Sundays when the counter was not open, but also wanted to use an automatic transaction device even on regular days, and also to use it as a bank Needs are spreading. For this reason, at the beginning, operations that were simple deposit and withdrawal transactions have been expanded to more complicated transactions such as transfer, transfer, and utility bill collection transactions.

[0003] In such an automatic transaction apparatus, a bill slot into which bills are inserted is generally provided with a bill remaining sensor and a hand insertion sensor. After a predetermined time has elapsed after the sensor detects "remaining" and the hand insertion sensor detects "no hand insertion", closes the shutter provided in the bill slot, accepts the inserted bill and starts counting. I'm going to do it.

In an automatic transaction apparatus with a voice guidance function for performing various operation guidances by voice, generally, unless one process is completed within a predetermined time, the operation guidance prompting the transaction processing is performed by voice. Has become.

[0005]

However, in the conventional automatic transaction apparatus as described above, for example, in a bill insertion process at the time of a deposit transaction, when an additional bill is to be inserted, the bill is now inserted into the bill slot depending on the timing. When an attempt is made to insert a hand, the process of closing the shutter of the bill slot is started, which may cause fear to the user.

[0006] For example, at the time of a deposit transaction, in order to prepare for the correct insertion of the passbook, the user is mechanically prompted by voice even though the user has turned the page of the passbook. I sometimes felt uncomfortable. Therefore, an object of the present invention is to provide an automatic transaction device that does not give a user a fear or discomfort.

[0007]

An automatic transaction apparatus according to the present invention has an operation surface operated by a user, and automatically performs a desired transaction by performing a predetermined operation on the operation surface. In the automatic transaction device, image input means for continuously inputting an image including at least the upper body of the user located opposite to the operation surface, and detecting the behavior of the user from the image input by the image input means And a control means for controlling the transaction processing based on the behavior detected by the behavior detecting means.

Further, the automatic transaction apparatus of the present invention has a bill slot for receiving and releasing bills and a coin slot for receiving and releasing coins arranged side by side, and a key related to transactions. It has an operation surface provided with an operation unit for performing operations and operation guidance, and automatically performs transactions involving acceptance and release of bills and coins by performing a predetermined operation on the operation surface. In the automatic transaction device, image input means for continuously inputting an image including at least the upper body of the user located opposite to the operation surface, and the behavior of the user is determined from the image input by the image input means. A behavior detecting means for detecting a behavior of moving a hand toward or away from the bill slot or a coin slot by analyzing, and the bill slot based on the behavior detected by the behavior detecting section; And a control means for controlling the transaction processing related to coin outlet.

Further, the automatic transaction apparatus of the present invention has a shutter which is opened and closed as necessary, and has a currency slot for accepting and discharging currency, and a key operation and an operation guide for transactions. An automatic transaction device having an operation surface provided with an operation unit for performing the transaction, wherein a user performs a predetermined operation on the operation surface to automatically perform a transaction involving acceptance and release of money. Image input means for continuously inputting an image including at least the upper body of a user located in opposition to, and from the image input by the image input means, analyzing the behavior of the user to the coin slot by analyzing A behavior detecting means for detecting a behavior of approaching a hand, and a behavior of the behavior detecting means for detecting a behavior of approaching a hand to a currency slot when an attempt is made to execute a process of closing a shutter of the currency slot. If you have a shutter closing processing of the money inlet and control means for controlling to a predetermined time delay.

Further, the automatic transaction apparatus of the present invention has a shutter which is opened and closed as necessary, and has a currency slot for accepting and discharging currency, and a key operation and an operation guide for transactions. An automatic transaction device having an operation surface provided with an operation unit for performing the transaction, wherein a user performs a predetermined operation on the operation surface to automatically perform a transaction involving acceptance and release of money. Image input means for continuously inputting an image including at least the upper body of a user located in opposition to, and from the image input by the image input means, analyzing the behavior of the user to the coin slot by analyzing When trying to execute a process of closing the shutter of the currency slot, and a behavior detecting means for detecting a behavior of approaching the hand and a behavior of moving the hand away from the currency slot,
When the behavior detecting means detects a behavior of approaching the hand to the currency slot, control is performed to delay the process of closing the shutter of the currency port until the behavior detecting means detects a behavior of moving the hand away from the currency port. Control means.

Further, the automatic transaction apparatus of the present invention has a shutter which is opened and closed as required, and has a currency slot for accepting and discharging currency, and a key operation and operation guide for transactions. An automatic transaction device having an operation surface provided with an operation unit for performing the transaction, wherein a user performs a predetermined operation on the operation surface to automatically perform a transaction involving acceptance and release of money. Image input means for continuously inputting an image including at least the upper body of a user located in opposition to the user, and analyzing the behavior of the user from the image input by the image input means. A behavior detecting means for detecting a behavior of searching for an object or a behavior of taking out an object, and when trying to execute a process of closing a shutter of the money slot, the behavior detecting means detects the behavior or the object. When detecting the behavior retrieve, and the shutter closing processing of the money inlet and control means for controlling to a predetermined time delay.

The automatic transaction apparatus according to the present invention has an operation surface provided with a medium port for receiving and releasing transaction media, and an operation section for performing key operations and operation guidance relating to transactions. And voice guidance means for performing various kinds of operation guidance including an operation guidance for guiding the introduction of the transaction medium to the medium port and the removal of the transaction medium by voice, and the user performs the voice guidance on the operation surface. In an automatic transaction apparatus for automatically performing a transaction involving acceptance and release of a transaction medium by performing a predetermined operation in accordance with operation guidance of the means, an image including at least the upper body of a user located opposite to the operation surface is displayed. From the image input means for continuously inputting and the image input by this image input means,
A behavior detecting means for detecting a behavior of the user searching for an object or a behavior of removing the object by analyzing the behavior of the user, and performing a voice guidance process of a reminder in a process of waiting for insertion of the transaction medium. When trying to, when the behavior detecting means detects the behavior of searching for an object or the behavior of taking out an object,
Control means for controlling the operation guidance processing by the voice guidance means to be delayed for a predetermined time.

Further, the automatic transaction apparatus of the present invention includes a medium port for receiving and releasing a transaction medium, a currency port for receiving and releasing money, and key operation and operation guidance related to the transaction. In an automatic transaction apparatus having an operation surface provided with an operation unit for performing such operations, a user performs a predetermined operation on the operation surface to automatically perform a transaction involving acceptance and release of a transaction medium. Image input means for continuously inputting an image including at least the upper body of the user located opposite to the operation surface, and analyzing the behavior of the user from the image input by the image input means, A behavior detecting means for detecting a behavior of a user searching for an object or a behavior of taking out an object, and in a process of waiting for the input of the transaction medium, a transaction medium for a predetermined period of time. If the input is not made, a timeout processing means for performing a timeout processing for terminating the transaction processing at that time, and when the timeout processing is performed by the timeout processing means, the behavior detecting means retrieves a behavior or retrieves a behavior. If we detect behavior,
Control means for controlling the timeout processing by the timeout processing means to be delayed by a predetermined time.

Further, the automatic transaction apparatus of the present invention includes a passbook port for accepting and releasing a passbook as a transaction medium, a currency port for accepting and releasing money, and key operations related to transactions. And an operation surface provided with an operation unit for performing operation guidance and the like, and voice guidance means for performing various operation guidance including voice guidance for inserting and removing a passbook from the passbook mouth with voice. An automatic transaction apparatus that automatically performs a transaction involving acceptance and release of a passbook and money by a user performing a predetermined operation in accordance with the operation guidance of the voice guidance unit on the operation surface. Image input means for continuously inputting an image including at least the upper body of a user located at a predetermined position, and solving the behavior of the user from the image input by the image input means. When the user tries to perform a voice guidance process of a reminder in a process of waiting for insertion of the passbook, the behavior detection unit detects the behavior of turning the page of the passbook. And control means for controlling the operation guidance processing by the voice guidance means to be delayed for a predetermined time when a page turning behavior is detected.

Further, the automatic transaction apparatus of the present invention provides a passbook port for accepting or releasing a passbook as a transaction medium, a currency port for accepting or releasing money, and key operations related to transactions. And an operation surface provided with an operation unit for performing operation guidance and the like, and voice guidance means for performing various operation guidance including voice guidance for inserting and removing a passbook from the passbook mouth with voice. An automatic transaction apparatus that automatically performs a transaction involving acceptance and release of a passbook and money by a user performing a predetermined operation in accordance with the operation guidance of the voice guidance unit on the operation surface. Image input means for continuously inputting an image including at least the upper body of a user located at a predetermined position, and solving the behavior of the user from the image input by the image input means. And a behavior detecting means for detecting a behavior of the user turning a page of the passbook, and in a process of waiting for insertion of the passbook, if the passbook is not inserted for a predetermined period of time, a transaction is performed at that time. A time-out processing means for performing a time-out processing for terminating the processing; and a time-out processing by the time-out processing means when the behavior detecting means detects a behavior of turning over a passbook page when the time-out processing is attempted by the time-out processing means. And control means for controlling the delay of a predetermined time.

Further, the automatic transaction apparatus of the present invention has a first mode operated by a sighted person and a second mode operated by a visually impaired person, and the user operates the first mode or the second mode. In an automatic transaction device that automatically performs a desired transaction by selectively performing a predetermined operation by selectively using an image, an image including at least an upper body of a user located opposite to the operation surface is continuously input. Input means, first behavior detecting means for detecting the behavior of the user from the image input by the image input means, and control for controlling the transaction processing based on the behavior detected by the first behavior detecting means Means, a second behavior detecting means for detecting a sign based on a predetermined behavior indicating that the user is a visually impaired person, from the image input by the image input means, And set the first mode, in which the eye's operation, the second behavior detection means is provided with a mode switching means for switching to the second mode and detecting a sign indicating the visually impaired.

According to the present invention, the behavior of the user located in front of the operation surface is detected, and the transaction processing is controlled based on the detection result, so that the user feels fear or inconvenience as in the related art. Without giving a pleasant feeling, smooth operation is always possible with peace of mind.

[0018]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows an automatic transaction apparatus according to the present embodiment (for example, installed in a bank office,
1 shows the appearance of an automatic teller machine capable of performing transactions such as deposit, withdrawal, transfer, transfer, balance inquiry, and passbook entry. In FIG. 1, a substantially L-shaped customer service operation surface 2 is formed on a front surface of a housing 1. Vertical surface 2 of customer operation surface 2
a, a plurality of media inlets, for example, a bill slot 3 having a shutter that can be opened and closed, which can collectively input a large number of bills and collectively receive released bills, and
A coin slot 4 having a shutter that can be opened and closed, a passbook slot 5 for accepting a magnetic passbook as a transaction medium, a personal identification number, an account number, etc., which can collectively receive a large number of coins and collectively receive released coins. A magnetic card as a transaction medium in which is recorded or a transfer ticket for a transfer transaction, and a card slot 6 for discharging a receipt (statement slip) on which the transaction content is printed, and for voice guidance to a user. Speaker 7 is provided.

The bill slot 3 and the coin slot 4 are arranged side by side on the left and right. Between the bill slot 3 and the coin slot 4, a CCD type video camera 18 as an image pickup means is provided. The video camera 18, which will be described in detail later, continuously captures and inputs an image including at least the upper body of the user in order to detect the behavior of the user located in front of the customer service operation surface 2. For example, it is installed so as to be obliquely upward from below to above with respect to the front upper body of the user who operates.

On the horizontal surface 2b of the customer service operation surface 2, there is provided a rectangular transparent XY matrix switch type touch panel 8 capable of inputting predetermined information by touching the surface with a finger. A color CRT display device 9 as a display means is provided opposite to the lower surface.

The CRT display device 9 displays the operation guide procedure and other information on the screen in color using characters, words, illustrations, or image information, guides the user's operation, and displays various transaction information necessary for the transaction. Displays various operation keys such as numbers, katakana characters and English characters for input,
By touching a segment of the touch panel 8 corresponding to the displayed operation key with a finger, desired key input (input of various transaction information and the like) can be performed.

Here, the touch panel 8 and the CRT
The display device 9 constitutes an information input device 10 of a touch panel type. A handset communication device 19 with a numeric keypad for guiding the operation by voice when the user is visually impaired is provided at a predetermined position on the left end with respect to the drawing of the customer service operation surface 2.
Is installed.

A customer detector 20 for detecting a user located in front of the customer service operation surface 2 is provided at a predetermined position on the front surface of the housing 1. On the other hand, inside the housing 1, a passbook printer unit 11 corresponding to the passbook slot 5, a card reader / receipt printer unit 12 corresponding to the card slot 6,
A bill receiving / dispensing unit 13 is provided corresponding to the bill opening 3, and a coin receiving / dispensing unit 14 is provided corresponding to the coin opening 4. Further, a control unit 15 for controlling the present apparatus is provided at a lower portion in the housing 1.

FIGS. 2 and 3 schematically show the configuration of the information input device 10. FIG. This information input device 10
Is substantially the same as that disclosed, for example, in JP-A-61-77918. That is, CR
The touch panel 8 is provided close to the screen of the T display device 9. For example, as shown in FIG. 3, the touch panel 8 includes transparent sheets 41 and 42 each coated with a transparent conductor forming a matrix switch circuit on the inside thereof.
And an electrically insulating separator 43 for forming an interval between them, and the surface thereof is pressed by a finger as shown in FIG. 4, and when the sheets 41 and 42 come into contact with each other, the pressing is performed. The matrix switch circuit corresponding to the segment thus closed is closed (X4-Y3 in the example of FIG. 4), and information of a signal name corresponding to this closed circuit is stored in the main control unit 25 described later.
To be sent to

The upper sheet 41 of the touch panel 8
In FIG. 5, a dot-like projection mark 44 is formed by embossing, which is expressed by a combination of dot-like projections, that is, Braille so as to have a fixed meaning corresponding to each switch segment, as shown in FIG. Have been. In the example of FIG. 5, for example, the numbers “0 to 9” and the kanji “10,000, yen” are each represented by Braille, but the transaction type can be similarly represented by Braille.

On the other hand, as shown in FIG. 6, for example, the CRT display device 9 is controlled so as to output different screens according to operation steps. FIG. 7 schematically shows the overall configuration of the above-described automatic transaction apparatus, and includes an information input device 10, a passbook printer unit 11, a card reader / receipt printer unit 12,
Bill receiving / dispensing unit 13, coin receiving / dispensing unit 14, voice guiding unit 16 as voice guiding means, customer detector 20, touch panel control unit 21, display control unit 22, storage unit 23, transmission control unit 24, and behavior detecting means Behavior detection unit 25 and the main control unit 2 that controls the entire system.
6 and the like.

The passbook printer unit 11 reads or writes data on the magnetic stripe of the passbook received from the passbook mouth 5, and prints the passbook as necessary.

The card reader / receipt printer unit 12 reads or writes data on a magnetic card received from the card slot 6 or on a magnetic stripe of a transfer ticket. Further, a receipt on which the details of the transaction are printed is issued, and the receipt is discharged from the card slot 6.

The banknote pay-in / pay-out unit 13 receives, discriminates, counts, and stores the banknotes which are put into the banknote slot 3 all at once, and takes out a predetermined number of banknotes previously stored in the safe, as necessary. And pay out all at once from the bill slot 3.

The coin depositing / dispensing unit 14 accepts, collectively discriminates, counts and stores coins which have been collectively inserted into the coin slot 4 and, if necessary, picks up a predetermined number of coins previously stored in a safe. And pay it out from the coin slot 4 in a lump.

The voice guidance unit 16 is provided with the speaker 7
From the handset communication device 19 when the user is visually impaired.

The touch panel control section 21 controls the touch panel 8. The display control unit 22 controls the CRT display device 9. The storage unit 23 is used to store various data, and stores a program of a processing procedure related to the operation of the present apparatus, records various kinds of information and transactions to be provided for transactions, records the operation status of the present apparatus, and the like.

The transmission control unit 24 is connected online via a communication line 27 to a host computer 28 serving as a center ledger, and communicates with the host computer 28 as needed.

The main control unit 26 refers to the program information in the storage unit 23, and
1 to 14, 16, the behavior detection unit 25, the transmission control unit 24, and the like are controlled to perform a predetermined transaction operation such as deposit or withdrawal.

The behavior detector 25 detects the behavior of the user located in front of the customer service surface 2 from the image input by the video camera 18, and will be described in detail below.
FIG. 8 shows a configuration of the behavior detection unit 25. The behavior detecting unit 25 outputs, for example, the output of the video camera 18 to 256
An image input unit 51 for continuously inputting an image including the upper body of a user operating the present apparatus, the image input unit 51 comprising an A / D converter for converting the digital image data into gradation digital image data, and 256 input by the image input unit 51 An image storage unit 52 for temporarily storing digital image data of gradation, extracting a change region (person region) from an image stored in the image storage unit 52, a top position of a person's head, a center of gravity of the person region, Based on the area of the person region, the width of the lower part of the person, and the output of the changing region extracting unit 53 which detects vertical and horizontal projections (projected images), the extracted changing region is used as the background change. The image change determination unit 54 determines whether a person is approaching or distant based on the output of the image change determination unit 54. A person approach detection unit 55 for determining whether or not the person is touching, a person position detection unit 556 for detecting the direction and the position of the person when the person appears on the screen or exits based on the output of the image change determination unit 54; Based on the output of the change determination unit 54, a person turning direction detection unit 57 that detects whether the person is facing the front or side toward the device, based on the output of the image change determination unit 54, And a plurality of persons detecting unit 58 for detecting the number of persons when a person enters, and the detection results of these units 55 to 58 (person approaching state, person position, person moving direction,
A behavior analysis unit 59 that identifies the position state and the operation state of the operating person from the person turning state, the number of persons, and the like, and analyzes the behavior of the operating person.

That is, the digital image data of 256 gradations input by the image input unit 51 is compressed and then stored in the image storage unit 52 once. Change area extraction unit 53
Generates a background difference image using the initial screen as a background image from the image in the image storage unit 52, binarizes the generated background difference image, and extracts a region changed with respect to the background. , The top position of the head of the person, the position of the center of gravity of the person area, the area of the person area, the width of the lower part of the person, and
Detect vertical and horizontal projections respectively.

Next, the change area extraction unit 53 generates the background difference binarized image, the top position of the detected person's head, the center of gravity of the person area, the area of the person area, the width of the lower part of the person, and The vertical and horizontal projections are sent to the image change determination unit 54, respectively.

Next, the image change determination unit 54 determines whether the change in the extracted change region (in the input image) is a change in the background or the appearance of a person based on the output of the change region extraction unit 53. , To determine if the noise is caused by a non-person,
When a change region due to the appearance of a person can be determined, the top position of the head of the person, the area of the person region, the center of gravity of the person region, and the vertical and horizontal projections output from the change region extraction unit 53 are output. I do.

Next, the person approach detecting section 55 detects whether the person is approaching or moving away from the top position of the person's head and the area of the person area output from the image change determining section 54. , And outputs the detection result.

The person position detecting section 56 detects the direction of a person entering or leaving the screen from the position of the center of gravity of the person area output from the image change judging section 54, and detects the detection result. Output.

Further, the person turning direction detecting section 57 determines whether the operating person is facing the front or the side toward the customer service surface 2 based on the projection (projected image) output from the image change determining section 54. And outputs the detection result.

The plural-person detecting section 58 outputs a projection (projected image) output from the image change determining section 54.
, The number of persons when a plurality of persons enter the screen is detected, and the detection result is output.

Next, the behavior analysis unit 59 is configured to
Based on each detection result 58 (person approaching state, person position, person moving direction, person turning state, number of persons, etc.), the position state and the operation state of the operating person are specified, and the behavior of the operating person is analyzed.

Hereinafter, each part will be described in detail. First, the internal processing of the change area extraction unit 53 will be described with reference to the flowchart shown in FIG. Image input unit 51,
The image obtained by the image storage unit 52 is converted (mosaiced) into a reduced image, and then a background difference image with the initial screen as a background image is generated.

Next, a region changed with respect to the background (changed region) is extracted by performing binarization processing on the generated background difference image. Next, the extracted image of the change area is subjected to noise removal and filling processing to determine the final person area (change area). This processing will be described with reference to FIG.

In the noise removal processing, the center pixel is set to a certain value or more with respect to a pixel having a value equal to or less than a certain value when the four pixels at the top, bottom, left, and right are converted into a background difference (hereinafter referred to as “0” pixels) Is a pixel having a value (hereinafter, referred to as a “1” pixel), the central pixel value is set to “0” (isolated point removal).

On the other hand, the hole filling process basically fills a closed “0” pixel region generated in the person region. However, since the video camera 18 is installed obliquely upward, the person cannot be filled. Appearing from the lower part of the screen, basically, when raising their hands, taking into account the case where a plurality of persons are on the screen, it is necessary to fill in a hole with a certain percentage (N
%) Is defined as a "closed pixel area". In order to realize this, the processing is performed in the following order.

(A) Basically, scanning is performed in the horizontal direction sequentially from the uppermost line, and a portion from "1" to "0" to a portion from "0" to "1" is filled. I do. In FIG. 10, the area between A and B corresponds to the area.

(B) However, places where “0” continues for a certain width or more are not filled. (C) When actually filling in, one of the parts to be filled in
All the pixels on the line are checked, and if there is a pixel with a certain ratio or more (N%) “1”, the pixel is filled in, but if it is less than that (the shaded portion in FIG.
%) If it is determined that the pixel is a non-human area “0”), it is regarded as an area whose upper side is open, and the filling process is not performed.

Since the area of the person area (change area) is examined, it is inconvenient to use an algorithm that largely changes the area. Therefore, this method is used to fill in holes while maintaining the contour as much as possible. .

FIG. 11 is an example showing what the filling will be by this method. Here, assuming that the threshold value of the filling width is “4” and the threshold value of the upper check is N = 100 (%). In the area of C, the ratio of “1” of the upper check is less than N = 100 (%). It is not filled.

In the region D, the ratio of the upper "1" is N = 1.
Filling is performed to satisfy 00 (%). In the region of E, the ratio of “1” in the upper row satisfies N = 100 (%), but the width is too wide, so that no holes are filled.

When the filling process is completed,
Perform calculations to obtain various types of statistical data (the top position of the head of the person, the position of the center of gravity of the person region, the area of the person region, the width of the lower part of the person, and the vertical and horizontal projections).
The calculation result is output to the image change determination unit 54. In addition,
The calculation method for obtaining various types of statistical data is well known in the related art, and a description thereof will be omitted.

Next, the internal processing of the image change determination section 54 will be described. Various situations can be considered for the change of the input image, which can be roughly divided into the following three.

(1) An object (including a person) moves in the background of the device user. (2) A small object, which is a non-person, enters the screen. (3) The video image moves or the lighting changes, and the background image is displayed. Recognize.

In order to find these, the following conditions are checked, and it is estimated that the whole background area has changed when the object is caught. (1) Checking the number of blocks on the entire screen (area check) If most of the screen changes, except when a person comes closer to the video camera, it is determined that the background has changed due to changes in lighting or video camera movement. Or check to judge it as noise if it is too small.

(2) Comparison check of the number of blocks in the uppermost row with the lowermost row When a person appears normally, there are not many blocks at the uppermost row, but when a person approaches or there is a tall person, It reaches the top. Also in this case, a check is performed assuming that the number of blocks will be smaller than the number of blocks at the bottom (extraction when the background image changes greatly).

(3) Luminance value check that gives the peak of the histogram of the background difference image When a person appears, the luminance value that gives the peak of the histogram of the background difference image is almost close to “0”. Check that the luminance value giving the peak often shifts to a large value because the density changes over the entire screen when is changed.

(4) Checking the Number of Blocks at the Bottom Level Check that the video camera is facing upward, so that when a person appears, it is always assumed that a block with a certain width or more exists at the bottom level (whether the person is a person or not). Is not it?).

Using the above conditions, the input image is
FIG. 12 shows a flow of the classification into two. First, the above-mentioned (1) is checked, and if it is less than a certain threshold value k1, it is determined that there is no change, and if it is more than a certain threshold value k2, it is regarded as a background change. Therefore, if an appropriate change in area occurs, the above (2)
Is checked, and if the change is normal again, the check in (3) above is performed.If the density indicating the peak is equal to or higher than a certain value, it is assumed that the illumination of the entire screen has changed, and this is regarded as the background image. I do. Finally, the above-mentioned (4) is checked. If the lowermost row has a certain width or more, it is determined to be a person. Otherwise, it is determined to be due to noise.

Next, the internal processing of the person approach detection section 55 will be described. When it is determined that a person has appeared at the time when the above-described processing of the image change determination unit 54 has ended, it is necessary to track the movement of the person. If it is determined that the person is not in the screen, the person distance status indicating the state of the person is defined as NONE. Since the video camera satisfies the condition of obliquely upward, the person area in the input image appears to move upward from the bottom of the screen when the person approaches. In other words, by tracking the top position of the head, it can be determined that the head is approaching when moving upward, and separated when moving downward.

However, the resolution in the vertical direction may be about "30" due to the possibility of approaching from the horizontal direction and the mosaicization of the input image. Therefore, it is necessary to incorporate other information. It is. Therefore, it is possible to determine whether the area of the region (region 1) that is considered to be a person in the image increases or decreases. The approach and the separation are detected in consideration of the two. Specifically, ・ Condition for judging approach (state: NEAR) Area increase & (head height ≧ head position of previous frame −1) ・ Condition for judging to go away * (state: FAR) Area decrease & (Head height ≦ Head height of previous frame + 1) ・ The area considered to be a person has a certain area or more.
If none of the above apply, the state is set to STAY. Since the vertical mosaic block is “30”, the position of the head does not always move even if a person moves back and forth to some extent. Since the conditions are relaxed and the noise causes a blur of about one pixel, a margin is provided for one pixel.

Further, in order to reduce the influence of noise, as shown in FIG. 13, several scanning lines 61 for scanning in the horizontal direction are drawn from the upper part of the screen, and a changing area 62 having a certain width is formed on the upper scanning line. A method is also used in which a check is made in order from 61 to check how far the object has risen. This can be easily calculated by using lateral projection. Because it is an image from a diagonally upward video camera,
When a person approaches to a certain extent, a certain width of change should occur up to the upper scanning line.

The condition for judging that a person has approached or has disappeared is NEAR for approaching and moving away in order to eliminate malfunction due to the effect of an instantaneous judgment error.
With the COUNT and FARCOUNT approach detection counters and distance detection counters, and looking at several frames of data, the results show that "a person came in front of the device" and "a person disappeared in front of the device." Is determined. When there is no person, only approach is always detected, and once a person comes in front of the device, only distance is detected.

Here, the approach detection counter NEARCOU
FIGS. 14 and 15 show the processing flow of the NT and the distance detection counter FARCOUNT, respectively. Each counter NE
The count values of ARCOUNT and FARCOUNT are initially set to zero, but the counter is increased or decreased by approach / remove determination for each frame. +2 ”, FAR, NO
In the case of NE, the counter NEARCOUNT is set to "-1".
), The count value is a fixed threshold (COMMAX, A
(WAYMAX), it is determined for the first time that it is present in front of the video camera and that it has disappeared from the front of the video camera.

Next, the internal processing of the person position detecting section 56 will be described. By tracking the horizontal coordinates of the center of gravity of the portion that is regarded as a person area, and by tracking the movement of the center of gravity, it is possible to check the direction when a person enters and exits the screen. When a person enters the screen, the horizontal coordinates of the center of gravity in the frame immediately after entering the screen, and when the person leaves the screen, the horizontal coordinates of the center of gravity in the frame immediately before exiting the screen are taken into account. It detects whether it is left or right for the whole. In this case, when the person is present in the center of the screen, it is determined to be “center” instead of forcibly deciding left and right.

Next, the internal processing of the person turning detector 57 will be described. When the person turns sideways, the position of the head is basically shifted in the direction in which the person is turned, so that the top position of the head is shifted in the direction in which the person is turned. Also, due to the obliquely upward facing video camera, the position of the shoulder in the facing direction on the screen is lowered,
The position of the opposite shoulder moves up. Therefore, the area located on the side facing the direction decreases, and the area of the part located on the opposite side increases.

By utilizing this, it is detected that the operating person turned around when finishing the work and leaving. Also, in addition to judging whether the player is facing the front or the side, he wants to detect how far the player is facing the side. Therefore, since the horizontal coordinates at the top of the head are known, the area of the projection 63 is calculated on the basis of the horizontal coordinates, as shown in FIG. Basically, when the left and right have substantially the same area, it is determined to be the front. Further, since a number indicating the degree of turning sideways is required, L: the area of the portion located on the left side of the perpendicular 64 dropped from the top of the head R: more than the perpendicular 64 dropped from the top of the head The area of the portion located on the right side is represented by the turning index α = L / (R + L). The index α is a numerical value located between “0” and “1”. It can be determined that the front is at “0.5”, rightward when approaching “1”, and leftward when approaching “0”.

For example, approaching “1” means
That the value of L increases in a given equation. That is, as shown in FIG. 17B, it is determined that the head has turned to the right because the area of the portion located on the left side of the top of the head has increased. FIG. 17 (a) shows a case where the camera is turned to the left.

Next, the internal processing of the multiple person detecting section 58 will be described. Multiple persons exist when a suspicious person approaches while a person is using the device, or when another person enters from the side at the moment when trying to leave without completing the process If such a situation can be recognized, such a situation can be dealt with.

As shown in FIG. 18, a vertical projection is used for the background difference binarized image.
Where there is no person, the projection is "0", and conversely, where there is a person, the projection value is a certain value or more. For this reason, the projections taken in the vertical direction are sequentially viewed from the horizontal direction, and if a group of mountains having a certain threshold or more is detected, it is regarded as a person. In order to detect a plurality of persons, if the projection value is below a certain threshold 65 and continues for a certain width or more, it is determined that the person has temporarily cut off there, and the next mountain that appears is regarded as another person. In this case, by giving a margin to the threshold 65, it is possible to separate even if the person areas slightly overlap.

Next, the internal processing of the behavior detecting section 59 will be described. The behavior detection unit 59 includes detection results of the person approach detection unit 55, the person position detection unit 56, the person turning direction detection unit 57, and the plurality of person detection units 58 (person approaching state, person position, person moving direction, person turning state, number of persons). Etc.) to identify the position status and operation status of the operating person (user),
By analyzing the behavior of the operating person, various behaviors as shown in Table 1 below are detected.

[0073]

[Table 1]

That is, for example, a behavior of approaching a hand in the direction of a bill slot, a behavior of approaching a hand in the direction of a coin slot, a behavior of searching for an object, a behavior of taking out an object, a behavior of turning a page of a passbook, and the like are detected. Table 2 below shows control examples for various behaviors detected in this way.

[0075]

[Table 2]

In addition to the various behaviors described above, the behavior detecting section 59 analyzes the behavior of the operating person in the same manner as described above, and thereby also detects a sign (hand gesture) by a predetermined behavior performed by a visually impaired person. Detected as An example is shown in Table 3 below.

[0077]

[Table 3]

That is, for example, a "confirmation" sign in which the user holds the hand and swings down from above, a "cancel" sign in which the hand is opened and shakes two or more times left and right, and the hand is opened and the upper right to lower left or upper left to right Detects the sign of "correction" by swinging down and the sign of "being visually impaired (preferred for visually impaired mode)", which is the sign of "confirmation" and the sign of "cancel", which are described above. I do. Table 4 below shows an example of control on the signature based on the various behaviors detected as described above.

[0079]

[Table 4]

Next, in the above configuration, FIG.
The overall operation will be described with reference to the flowchart shown in FIG. First, in step S1, when the customer detector 20 detects a user, the main control unit 26 displays a guidance for selecting a transaction type on the display device 9 (S2), and the voice guidance unit 16 outputs a voice to select the transaction type. Guide (S
3), a built-in first timer (software or hardware) is started (S4).

Next, in step S5, the main control unit 2
6 judges whether or not the transaction type has been selected, and if not selected, performs the behavior analysis by the behavior detection unit 59 described above (S6), and the sign indicating that the person is visually impaired as described above is obtained. It is determined whether or not a sign for confirmation has been detected in response to the voice guidance prompting confirmation (S7). When a sign indicating that the person is a visually impaired is not detected, the main control unit 26 checks whether or not the first timer has reached a predetermined time (for example, 20 seconds) (S8). If not, the flow returns to step S5 to repeat the same operation as described above, and if the predetermined time has been reached, the flow returns to step S1.

In step S7, if a sign indicating that the user is visually impaired is detected, and if a confirmation sign is detected, the main control unit 26 determines that the user is a visually impaired person, The voice guidance unit 16 provides voice guidance to pick up the handset communication device 19 on the left side of the device (S
9), restart the first timer (S10).

Next, in step S11, the main control unit 26 determines whether or not the handset communication device 19 has been picked up (S11).
Checks whether the first timer has reached a predetermined time (for example, 20 seconds) (S12), and if it has not reached the predetermined time, returns to step S11 to repeat the same operation as described above. If it has reached, the process returns to step S1.

In step S11, when the handset communication device 19 is picked up, the main control unit 26 sets the visually impaired person mode and executes a transaction process by voice guidance using the handset communication device 19 (S13).

In the visually impaired person mode, a sign (hand gesture) based on a predetermined behavior indicating functions such as "confirmation", "correction", and "cancellation" performed by the visually impaired person as shown in Table 3 above. ), The input processing is advanced, so that it is not necessary to groping for the operation button, and even a visually impaired person can quickly perform the input processing.

In the visually impaired person mode, the transaction processing by voice guidance using the handset communication device is already a known technique, and further description will be omitted. When a transaction type is selected in step S5, the main control unit 26 executes a transaction process of the selected transaction type. Hereinafter, for example, a case where a deposit transaction is selected will be described.

First, in step S21, the main control section 26 displays a guide to insert a bill on the display device 9, opens the shutter of the bill slot 3 (S22), and starts the built-in second and third timers. (S23, S24).

Next, in step S25, the main control section 26 determines whether or not a bill detector (not shown) provided in the bill slot 3 is detecting a bill. The second timer is set for a predetermined time (for example, 3
0 second) (S26), and if the predetermined time has been reached, a timeout process is performed, at which point the transaction process ends.

In step S26, if the predetermined time has not been reached, the main control unit 26 checks whether or not the third timer has reached a predetermined time (for example, 10 seconds) (S27). If not, step S2
Returning to step 5, the same operation as above is repeated.

In step S27, if the predetermined time has been reached, the main control unit 26 performs the behavior analysis by the behavior detection unit 59 described above (S28), and inserts the above-described bill or disposes the object (bill). It is determined whether or not the search behavior has been detected (S29). When the behavior of bill insertion or the search for a bill is detected, the main control unit 26 returns to step S24 to repeat the same operation as described above, and when not detected, performs voice guidance for bill insertion with the voice guidance unit 16 ( S30), returning to step S24 to repeat the same operation as above.

In step S25, when a bill is detected in the bill slot 3, the main control section 26 starts the built-in fourth and fifth timers (S31, S3).
2). Next, in step S33, the main control unit 26
Is a hand insertion detector (not shown) provided in the bill slot 3
Determines whether the hand insertion has been detected, and if so, checks whether the fourth timer has reached a predetermined time (for example, 30 seconds) (S34). If so, a timeout process is performed, at which point the transaction process ends.

In step S34, if the predetermined time has not been reached, the main control unit 26 checks whether or not the fifth timer has reached a predetermined time (for example, 10 seconds) (S35). If not, step S3
3, the same operation as above is repeated.

In step S35, if the predetermined time has been reached, the main control unit 26 provides voice guidance for reinsertion of the bill by the voice guidance unit 16 (S36), and proceeds to step S32.
And the same operation as above is repeated.

If hand insertion has been detected in step S33, the main controller 26 determines whether or not a bill detector (not shown) provided in the bill slot 3 has detected bills (S37). If not, the process returns to step S24 to repeat the same operation as described above.

In step S37, when a bill is detected in the bill slot 3, the main control section 26 starts a built-in sixth timer (S38). Then, in step S39, the main control unit 26 waits for the sixth timer to reach a predetermined time (for example, 3 seconds).

In step S39, when the sixth timer reaches a predetermined time, the main control unit 26 performs the behavior analysis by the behavior detection unit 59 described above (S4).
0), it is determined whether or not the above-described behavior of bill insertion (the behavior of approaching the hand toward the bill mouth) has been detected (S).
41). When the behavior of bill insertion is detected, the main control unit 2
6 returns to step S38 and repeats the same operation as described above. If no operation is detected, the shutter of the bill slot 3 is closed (S42), and guidance is displayed on the display device 9 during bill counting (S42).
43), the counting operation of the accepted bills is started (S4).
4). Then, the counted bills are stored in the safe, and the deposit transaction processing is terminated.

[0097] Although the above description is of processing when a deposit transaction is selected, the same processing is performed, for example, when a withdrawal transaction is selected. In addition, not only processing of banknotes,
The same applies to the processing of coins.

As described above, for example, when the behavior of approaching the hand in the direction of the bill mouth is detected at the timing when the shutter of the bill mouth is closed in the bill insertion process at the time of a deposit transaction, the shutter is operated until the predetermined time elapses. This delays the closing process.

When a behavior of searching for an object or a behavior of removing an object is detected at the time of medium insertion, the operation guidance by voice is delayed for a predetermined time, and the timeout time of the process is extended for a predetermined time. .

Further, when the behavior of turning the page of the passbook is detected at the timing of inserting the passbook, the operation guide by voice is delayed for a predetermined time and the timeout time of the process is extended for a predetermined time.

Therefore, as in the prior art, for example, the process of closing the shutter of the bill slot is started when an attempt is made to insert a hand into the bill slot in order to additionally insert a bill.
Therefore, the user does not fear the user, and smooth operation can always be performed with peace of mind.

Also, for example, in order to prepare for inserting the passbook correctly, the user is mechanically prompted by voice even though the user has turned the page of the passbook, so that the user feels discomfort. And smooth operation is always possible with peace of mind.

Further, when a sign based on a predetermined behavior indicating that the person is visually impaired is detected, the mode is automatically switched to the visually impaired person. Even a disabled person can operate quickly.

Further, by proceeding with the input by detecting a signature based on a predetermined behavior indicating a function such as "confirm", "correct", or "cancel", it is not necessary to fumble for the operation button, and Even people with disabilities can input quickly.

The present invention is not limited to the above-described embodiment, but can be variously modified without departing from the scope of the present invention. For example, at the timing of closing the shutter of the bill mouth in the bill insertion process at the time of a deposit transaction,
When the behavior of approaching the hand in the direction of the bill mouth is detected, the case where the process of closing the shutter is delayed until a predetermined time has elapsed has been described.However, by detecting the behavior of moving the hand away from the bill mouth, When the behavior of approaching the hand toward the bill slot is detected, the process of closing the shutter may be delayed until the behavior of moving the hand away from the bill slot is detected.

[0106]

As described in detail above, according to the present invention, it is possible to provide an automatic transaction apparatus which does not give a user a fear or discomfort.

[Brief description of the drawings]

FIG. 1 is a perspective view showing an external configuration of an automatic transaction apparatus according to an embodiment of the present invention.

FIG. 2 is a vertical side view schematically showing a configuration of an information input device.

FIG. 3 is a vertical sectional side view schematically showing a configuration of a touch panel.

FIG. 4 is a plan view of a touch panel.

FIG. 5 is a plan view showing an example of forming point-like projection marks on a touch panel.

FIG. 6 is a plan view showing a display screen example of a display device.

FIG. 7 is a block diagram schematically showing the overall configuration of the automatic transaction apparatus.

FIG. 8 is a block diagram schematically showing a configuration of a behavior analysis unit.

FIG. 9 is a flowchart illustrating internal processing of a change area extraction unit.

FIG. 10 is a view for explaining a hole filling process in a change area extraction unit.

FIG. 11 is a diagram showing an example of execution of a filling process performed by a change area extraction unit.

FIG. 12 is a flowchart illustrating internal processing of an image change determination unit.

FIG. 13 is a view for explaining internal processing of a person approach detection unit.

FIG. 14 is a flowchart illustrating processing of an approach detection counter in a person approach detection unit.

FIG. 15 is a flowchart illustrating processing of a distance detection counter in a person approach detection unit.

FIG. 16 is a view for explaining processing of a person turning detection unit;

FIG. 17 is a view for explaining processing of a person turning detection unit;

FIG. 18 is a view for explaining the processing of a multiple person detection unit.

FIG. 19 is a flowchart for explaining the overall operation.

FIG. 20 is a flowchart for explaining the overall operation.

FIG. 21 is a flowchart for explaining the overall operation.

[Explanation of symbols]

1 ... housing, 2 ... customer service operation surface, 3 ... bill slot, 4 ...
Coin slot, 5: Passbook slot, 6: Card slot, 7: Speaker for voice guidance, 8: Touch panel, 9: Color C
RT display device, 10 information input device, 11 passbook printer unit, 12 card reader / receipt printer unit, 13 banknote deposit / withdrawal unit, 14
Coin deposit and withdrawal unit, 15 Control unit, 16
Voice guidance unit, 18 Video camera (imaging means), 19 Handset communication device, 20 Customer detector, 21 Touch panel control unit, 22 Display control unit, 23 Storage unit, 25 ... behavior detecting section (behavior detecting means), 26 ... main control section, 51 ... image input section, 52 ...
... image storage unit, 53 ... change area extraction unit, 54 ... image change determination unit, 55 ... person approach detection unit, 56 ... person position detection unit, 57 ... person swing direction detection unit, 58 ... multiple persons Detecting section, 59: Behavior analyzing section.

Claims (13)

[Claims] 1. An automatic transaction apparatus having an operation surface operated by a user and automatically performing a desired transaction by performing a predetermined operation on the operation surface. Image input means for continuously inputting an image including at least the upper body of a located user; behavior detecting means for detecting the behavior of the user from the image input by the image input means; detection by the behavior detecting means Control means for controlling the transaction processing based on the performed behavior. 2. The image input means is mainly constituted by an image pickup means such as a video camera.
2. The automatic transaction apparatus according to claim 1, wherein the automatic transaction apparatus is disposed substantially at the center of the operation surface. 3. A bill slot for receiving and releasing bills and a coin slot for receiving and releasing coins are provided side by side, and for performing key operations and operation guidance related to transactions. An automatic transaction device that has an operation surface provided with an operation unit, and that automatically performs a transaction involving acceptance and release of bills and coins by a user performing a predetermined operation on the operation surface, Image input means for continuously inputting an image including at least the upper body of a user located in opposition to, and from the image input by the image input means, analyzing the behavior of the user, the bill slot and A behavior detecting unit that detects a behavior of moving a hand toward or away from a coin slot; and a transaction process related to the bill slot or the coin slot based on the behavior detected by the behavior detecting unit. An automatic transaction apparatus, comprising: a control unit for controlling; 4. The image input means mainly comprises an image pickup means such as a video camera, and the image pickup means comprises:
The automatic transaction device according to claim 3, wherein the automatic transaction device is provided between a bill slot and a coin slot on the operation surface. 5. It has a shutter which is opened and closed as necessary, and has a money slot for receiving and discharging money, and an operation section for performing key operations and operation guidance relating to transactions. An automatic transaction device having a control surface, wherein a user performs a predetermined operation on the control surface to automatically perform a transaction involving acceptance and release of money, wherein the user is located facing the control surface. Image input means for continuously inputting an image including at least the upper body of the user; and analyzing the behavior of the user from the image input by the image input means to detect a behavior of bringing a hand closer to the money slot. When the behavior detecting means detects a behavior of approaching the hand with respect to the currency slot, when performing a process of closing a shutter of the currency slot, a shutter of the currency slot is performed. Control means for controlling the processing of closing the shutter to delay for a predetermined time. 6. A shutter for opening and closing as required, a money slot for receiving and discharging money, and an operation unit for performing key operations, operation guidance, and the like related to transactions are provided. An automatic transaction device having a control surface, wherein a user performs a predetermined operation on the control surface to automatically perform a transaction involving acceptance and release of money, wherein the user is located facing the control surface. Image input means for continuously inputting an image including at least the upper body of the user, from the image input by the image input means, by analyzing the behavior of the user, the behavior of approaching the hand to the money slot and the A behavior detecting unit that detects a behavior of keeping a hand away from the currency slot, and when trying to execute a process of closing a shutter of the currency slot, the behavior detecting unit brings a hand closer to the currency slot. When detecting the behavior, the control means controls to delay the process of closing the shutter of the bill slot until the behavior detecting means detects the behavior of moving the hand away from the bill slot. Trading equipment. 7. A shutter having a shutter which is opened and closed as required, a money slot for receiving and discharging money, and an operation unit for performing key operations and operation guidance relating to transactions are provided. An automatic transaction device having a control surface, wherein a user performs a predetermined operation on the control surface to automatically perform a transaction involving acceptance and release of money, wherein the user is located facing the control surface. Image input means for continuously inputting an image including at least the upper body of the user, and from the image input by the image input means, analyzing the behavior of the user to extract a behavior or an object for searching for the object of the user Behavior detection means for detecting the behavior, When trying to execute the process of closing the shutter of the money slot, when the behavior detection means detects the behavior to search for or take out the object, Control means for controlling the processing of closing the shutter of the money slot so as to be delayed by a predetermined time. 8. A medium having a medium port for receiving and releasing a transaction medium, and an operation surface provided with an operation unit for performing key operations, operation guidance, and the like relating to the transaction, and And a voice guidance unit for performing various operation guidance including voice guidance for inputting the transaction medium to the mouth and taking out the transaction medium, and a user performs predetermined operation according to the operation guidance of the voice guidance unit on the operation surface. An automatic transaction apparatus for automatically performing a transaction involving acceptance and release of a transaction medium by performing an operation, comprising: an image input means for continuously inputting an image including at least the upper body of a user located opposite to the operation surface And analyzing the behavior of the user from the image input by the image input means to detect a behavior of searching for or removing an object of the user. Output means, and when performing a voice guidance process of a reminder in a process of waiting for the input of the transaction medium, when the behavior detection means detects a behavior of searching for an object or a behavior of removing an object, the voice guidance means And control means for delaying the operation guide processing by a predetermined time. 9. A medium port for receiving and releasing transaction media, a currency port for receiving and releasing money, and an operation unit for performing key operations and operation guidance related to transactions. An automatic transaction device having an operation surface provided, wherein a user performs a predetermined operation on the operation surface to automatically perform a transaction involving acceptance and release of a transaction medium. Image input means for continuously inputting an image including at least the upper body of the user who performs the operation of searching for an object of the user by analyzing the behavior of the user from the image input by the image input means or Behavior detecting means for detecting the behavior of taking out an object, In the process of waiting for the input of the transaction medium, if the transaction medium has not been input for a predetermined period of time, Time-out processing means for performing time-out processing for ending the transaction processing at a point in time; and when the time-out processing by the time-out processing means is to be performed, when the behavior detection means detects a behavior for searching for an object or a behavior for removing an object, Control means for controlling the time-out processing by the time-out processing means to be delayed for a predetermined time. 10. A passbook mouth for accepting or releasing a passbook as a transaction medium, a currency slot for accepting or releasing money, and for performing key operations and operation guidance relating to transactions. An operation surface provided with an operation unit, and voice guidance means for performing various kinds of operation guidance including an operation guidance for guiding insertion and removal of a passbook to and from the passbook mouth by voice, and a user is provided on the operation surface. An automatic transaction device that automatically performs a transaction involving acceptance and release of a passbook and money by performing a predetermined operation in accordance with the operation guidance of the voice guidance unit, wherein at least a user located facing the operation surface. Image input means for continuously inputting an image including the upper body, and analyzing the behavior of the user from the image input by the image input means, thereby enabling the user A behavior detecting means for detecting a behavior of turning the page of the passbook; and an attempt to perform a voice guidance process of a reminder in a process of waiting for insertion of the passbook, the behavior detecting means detects a behavior of turning the page of the passbook. Control means for controlling the operation guidance processing by the voice guidance means to be delayed for a predetermined time in the automatic transaction apparatus. 11. A passbook slot for accepting and releasing a passbook as a transaction medium, a currency slot for accepting and releasing currency, and for performing key operations and operation guidance related to transactions. An operation surface provided with an operation unit, and voice guidance means for performing various kinds of operation guidance including an operation guidance for guiding insertion and removal of a passbook to and from the passbook mouth by voice, and a user is provided on the operation surface. An automatic transaction device that automatically performs a transaction involving acceptance or release of a passbook and money by performing a predetermined operation in accordance with the operation guidance of the voice guidance unit, wherein at least a user located facing the operation surface. Image input means for continuously inputting an image including the upper body, and analyzing the behavior of the user from the image input by the image input means, thereby enabling the user Behavior detecting means for detecting the behavior of turning the page of the passbook, and in the process of waiting for the insertion of the passbook, if a passbook has not been inserted for a predetermined period of time, a time-out process for terminating the transaction process at that time. A time-out processing means for performing, and when performing the time-out processing by the time-out processing means, if the behavior detecting means detects a behavior of turning the page of the passbook, the time-out processing by the time-out processing means is delayed by a predetermined time. An automatic transaction device, comprising: 12. A first mode operated by a sighted person and a second mode operated by a visually impaired person, and the user selectively uses the first mode or the second mode to perform a predetermined operation. In an automatic transaction apparatus for automatically performing a desired transaction by performing an operation, image input means for continuously inputting an image including at least the upper body of a user located opposite to the operation surface, and the image input means First behavior detecting means for detecting the behavior of the user from the image input in step 1, control means for controlling transaction processing based on the behavior detected by the first behavior detecting means, A second behavior detecting means for detecting a signature based on a predetermined behavior indicating that the user is a visually impaired person from the input image; and a first mode normally operated by the sighted person. Automatic transaction apparatus characterized by setting, equipped with a, and mode switching means for switching between detecting the sign to the second mode indicating that the second behavior detection means is a visually impaired. 13. The automatic transaction apparatus according to claim 12, wherein the signature based on a predetermined behavior indicating the visually impaired person is a combination of two or more actions.