JP2001169272A - Photographing device and monitoring system using the photographing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a photographing device and a monitoring system capable of easily providing that a transaction processor is illicitly utilized, reducing the capacity of image data per one transaction processing and lowering a cost. SOLUTION: This photographing device is provided with an image forming element provided with an image forming surface, a photographing viewing angle division means for dividing photographing viewing angles A and B corresponding to a plurality photographed portions and forming the images of the respective photographed portions on the image forming element and an image data generation means for generating the image data of the respective photographed portions on the basis of the output of the image forming element. In this case, the images of the plurality of photographed portions are image- formed on the image forming surface of one image forming element, and hence the plurality of photographed portions are simultaneously photographed by one image pickup means. Thus, the need of disposing a plurality of image pickup means so as to photograph respective photographed portions is eliminated.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a person who commits fraud on a transaction processing device such as an automatic teller machine (ATM), an unattended contract terminal, a shopping terminal, a vending machine, and a POS terminal (including a cash register). The present invention relates to a photographing device for monitoring the image and a monitoring system using the photographing device.

[0002]

2. Description of the Related Art Conventionally, crimes such as withdrawing cash from another person's account with a stolen cash card or credit card and shopping in the name of another person have occurred.
Therefore, in financial institutions and distribution institutions, transaction processing is carried out by mounting a photographing device equipped with a camera inside or above the transaction processing device, or by attaching a photographing device to the ceiling corner of the room where the transaction processing device is installed. These crimes were addressed by photographing the face and body of the user of the device.

[0003]

However, the conventional photographing apparatus requires a camera for each part of a user's face or body to be photographed (hereinafter, referred to as a part to be photographed), which increases the cost. At the same time, it becomes larger. In addition, since the user's face and body are captured in separate image frames, the amount of image data increases accordingly.

Further, the conventional photographing apparatus captures the face and body of the user of the transaction processing apparatus and displays the image on a monitor arranged at a remote place, so that the user of the transaction processing apparatus can be remotely operated. In order to monitor the operation, either a face monitor for displaying a face image and a body monitor for displaying a body image are provided, or a single face and body image is combined. Must be displayed on the monitor. However, in the case where a monitor for the face and a monitor for the body are provided, two monitors are required, which increases the cost. Further, in the case of combining face and body images into one and displaying them on a single monitor, an image processing apparatus for performing predetermined processing on each of the face and body image data is required, which increases costs. I will.

[0005] In addition, in the conventional photographing apparatus, the field of view of the camera is narrow, and the main part of the user of the transaction processing apparatus may be qualified. In this case, even if the transaction processing device is used improperly, the operation at hand of the user or the operation of the user accessing the transaction port (card port, passbook port, bill port, coin port, etc.) is photographed by the camera. And it becomes difficult to prove that the transaction processing device has been used improperly. Particularly, in recent years, crimes such as forging a card rather than stealing the card, withdrawing cash from another person's account with the card, and shopping in the name of another person are increasing. In such cases, the genuine owner of the card is often unaware that a crime has occurred, and the crime is often discovered later. In this case, it may be difficult to prove that the transaction processing apparatus has been used improperly since a time has passed since the crime occurred. Further, in recent years, crimes in which a forged coin is used for shopping with a vending machine to illegally obtain goods and change have been increasing. Again, because you don't know who used the counterfeit coin,
It is difficult to prove that a transaction processing device has been used improperly. Furthermore, there is a crime that an unauthorized device is attached to a POS terminal (including a cash register) to steal information of another person's card. Also in this case, it is difficult to prove that the transaction processing device has been used improperly because it is not known who installed the unauthorized device or who operated the transaction processing device. Conventional imaging devices have not been able to adequately cope with such crimes.

The present invention solves the above-mentioned problems of the conventional photographing apparatus, can easily prove that the transaction processing apparatus has been used improperly, and can reduce the image data per transaction processing. It is an object of the present invention to provide an imaging device and a monitoring system that can reduce the capacity and reduce the cost.

[0007]

In order to achieve the above-mentioned object, in an imaging apparatus according to the present invention, an imaging element having an imaging surface and an imaging angle of view are divided corresponding to a plurality of imaging regions. A photographing angle-of-view dividing unit that forms an image of each part to be imaged on the image forming element; and an image data generating unit that generates image data of each part to be photographed based on an output of the image forming element. Have.

Further, in the monitoring system of the present invention,
Transaction processing device, and having a photographing device for photographing the user of the transaction processing device, the photographing device, the image data of the photographed user, in correspondence with the operation of the transaction processing device during the transaction Record on recording means.

[0009]

DESCRIPTION OF THE PREFERRED EMBODIMENTS In the present invention, a face and a body image of a user of a transaction processing apparatus are stored in a storage means in association with each other so as to have sufficient ability to prove a crime.

[0010] The monitoring system of the present invention comprises a transaction processing device,
And a photographing device for photographing a user of the transaction processing device. The transaction processing apparatus is provided with a lens-equipped camera as an image pickup device of the photographing apparatus. The lens-equipped camera is provided at a predetermined timing with a user's face and other parts of the user's body, for example, at hand. Shoot at once. Then, the transaction processing device outputs the photographed image data of the user and data relating to the operation of the transaction processing device to the control unit of the imaging device.

The control unit can be provided in the transaction processing device, and can be integrated with the control unit of the transaction processing device. In the photographing device shown in FIGS. 2 and 10, the control unit of the photographing device and the control unit of the transaction processing device are integrated, and an automatic cash processing machine control device 54 is configured.

[0012] The control unit of the photographing apparatus transfers data relating to the operation of the transaction processing apparatus to various data (for example, transaction customer number, transaction processing apparatus serial number, transaction content of the transaction processing apparatus, transaction processing). The classification is performed according to predetermined items based on the operation contents of the apparatus, the time at which the photographing was performed, the photographing timing, the number of the sensor used for taking the photographing timing, the type of the sensor, the reaction of the sensor, and the like. The control unit of the photographing device records the photographed image data of the user in the recording unit in association with the classified data relating to the operation of the transaction processing device.

The control unit of the photographing device reads out specific image data from the image data recorded in the recording device by a reading means (for example, a keyboard, a card reader, etc.) provided in the photographing device. be able to. For example, when a trouble that is considered to be caused by a user's injustice occurs, first, the monitor operates the reading unit to read data such as the transaction processing apparatus's machine number and the time when the photographing was performed. To enter. Thereby, the photographing device
The image data of the user at the time of occurrence of the trouble is retrieved from the image data recorded in the recording means, and an image of the image data is displayed on an image display device, for example, a monitor device. Then, the monitor visually checks the displayed image of the user, and determines whether the user illegally uses the transaction processing apparatus. If the user uses the transaction processing device illegally, the monitor may print the image by image printing means provided in the photographing device, or record the image data in a recording device provided in another system. For recording.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The transaction processing device may be in the form of an automated teller machine (ATM), an unattended contract terminal, a shopping terminal, a vending machine, a POS terminal (including a cash register), etc. This will be explained. In addition, since the motion of the hand simply indicates the motion of the user, the following description will be made assuming that the image capturing apparatus captures the hand as a body part of the user.

<First Embodiment> FIG. 1 shows a first embodiment of the present invention.
It is a side view of the automatic cash processor which mounts the imaging device in embodiment. In FIG. 1, 11 is a tall user, 12 is an average user, 13 is a low user, 14 is a face of the users 11 to 13 as a first part to be imaged, and 23 is a user. These are the hands of the users 11 to 13 as the second part to be imaged. Reference numeral 15 denotes an automatic cash processor managed by a financial institution as an administrator, 16 denotes a photographing device, 17 denotes a camera with a lens as an image pickup unit, 18 denotes a mirror as a photographing view angle dividing unit and a reflection member, and 19 denotes a mirror. A card slot (not shown) for inserting and removing a card such as a bank card, 20 is a bill slot for inserting and removing a bill (not shown), and 21 is a CRT with a touch panel as an operation unit. On the CRT 21 with a touch panel, various item panels, numeric panels, etc. are displayed. When the users 11 to 13 press (touch) the item panels, numeric panels, etc., corresponding touch panel sensors (not shown) press the corresponding panels. It is designed to detect. In addition, the automatic cash processing machine 15
A passbook port (not shown) for inserting and removing a passbook (not shown) is provided adjacent to the card slot 19.

Next, a case will be described in which the users 11 to 13 respectively operate the automatic cash processor 15 to select cash withdrawal as transaction processing and withdraw cash from the automatic cash processor 15. A menu screen is displayed on the CRT 21 with a touch panel of the automatic cash processing machine 15, and users 11 to 13 are displayed on the menu screen by the automatic cash processing machine 15.
Various items for operating are displayed. According to the guidance of the menu screen or the guidance by voice, the users 11 to 13 perform the first operation as the CRT 2 with the touch panel.
Touch the item “Drawer” on the touch panel 1. Next, the users 11 to 13 insert a card into the card slot 19 as a second operation, and touch a numeric panel of the CRT 21 with a touch panel as a third operation to input a personal identification number. The entered password is input to the automatic cash processor 15
Is transmitted to a not-shown host computer, where it is compared with a personal identification number registered corresponding to the card. When the input password matches the password registered in correspondence with the card by the collation, the host computer transmits a permission signal to the automatic cash processor 15. Thereby, the automatic cash processing machine 15 is permitted to perform the following operation.

Thereafter, as a fourth operation, the users 11 to 13 enter the amount of cash to be withdrawn by pressing the numeric panel. As a result, after the predetermined processing is performed by the automatic cash processor 15, the input amount of cash is
Will be withdrawn. Then, the users 11 to 13 take out cash from the bill slot 20 as a fifth operation. In this way, the users 11 to 13 can withdraw cash by the first to fifth operations. During this time, camera 1 with lens
7 photographs the faces 14 and the hands 23 of the users 11 to 13, and the photographed image data of the faces 14 and the hands 23 are recorded in the photographing device 16 in association with the transaction processing of the automatic cash processor 15. In particular, the face 1 corresponding to the second, third, and fifth operations
The image data of the hand 4 and the hand 23 are recorded as important image data.

In this embodiment, the photographing device 16 includes a card slot 19, a bill slot 20, and a CRT 21 with a touch panel.
Is disposed at the upper end of the automatic cash processing machine 15 so as to be opposed to. The photographing device 16 includes one camera 17 with a lens.
And a mirror 18, which are arranged as follows so that the faces 14 and the hands 23 of the users 11 to 13 can be simultaneously photographed. That is, one lens-equipped camera 17 is installed so that the optical axis is aligned with the direction of the user's hand or face in order to photograph the user's hand or face. In some cases, the mirror 18 is arranged so that the user's face or hand is reflected on the reflection surface. More specifically, the camera with lens 17 is an automatic cash processing machine 1.
The card slot 19 and the bill slot 2 are located above and near the front end of the slot 5.
0, it is attached so that the image of the hand of the user who operates the CRT 21 with the touch panel is in the upper half of the shooting angle of view. On the other hand, the mirror 18 includes a lens of the camera 17 with a lens and a CC as an imaging element having an imaging surface (not shown).
When viewed from the optical axis at a predetermined position on the optical axis connecting the D element (below the camera 17 with a lens and above the card slot 19, the bill slot 20, and the CRT 21 with a touch panel), Is tilted at a predetermined angle so that the face or hand is reflected on the reflection surface. Accordingly, the angle of view of the camera 17 with the lens is divided into A and B by the mirror 18, and the face 14 of each of the users 11 to 13 is located at the angle of view A.
The hand 23 of each of the users 11 to 13 is photographed at the photographing angle of view B.

As described above, the face 14 and the hands 23 of the users 11 to 13 can be simultaneously photographed by one camera 17 with a lens.
There is no need to provide a camera for each part to be imaged, so that the cost of the imaging apparatus can be reduced and the imaging apparatus can be downsized. In addition, users 11 to 13
Since the face 14 and the hand 23 are captured in one image frame, the amount of image data to be recorded per case can be reduced by that much, and the same amount of image data can be stored with the same storage capacity as before. it can. Further, the photographing device 1
By displaying the image data of the face 14 and the hand 23 taken by the user 6 on a monitor (not shown) arranged at a remote place, the users 11 to 11 of the automatic cash processing machine 15 are displayed from a remote place.
In order to monitor the operation of the face 13, the image of the face 14 and the hand 23 are displayed on one monitor without using an image processing device.
Can be displayed simultaneously. Therefore, the cost of the imaging device can be reduced.

Next, a method of generating image data of the faces 14 and hands 23 of the users 11 to 13 in the first to fifth operations will be described. FIG. 2 is a block diagram of the photographing apparatus according to the first embodiment of the present invention, and FIG. 3 is a sectional view of the photographing apparatus according to the first embodiment of the present invention.
In the figure, reference numeral 17 denotes a camera with a lens.
CCD element 32 as an imaging element and CCD element 3
2 and a CCD control circuit 33 as an image pickup control unit for generating a video signal based on the output of the CCD element 32. Reference numeral 34 denotes an image processing circuit serving as image data generating means for performing image processing based on the video signal and generating image data. Reference numeral 35 denotes a video signal for transmitting a video signal from the CCD control circuit 33 to the image processing circuit 34. A line 36 is a photographing timing signal line for transmitting a photographing timing signal for photographing in the CCD control circuit 33 from the CPU 51 to the CCD control circuit 33, and a line 37 represents image data generated by the image processing circuit 34.
An image data signal line to be sent to 51. And 1
9 is a card slot, 23 is a hand of the user 11 to 13, 39 is a card inserted into and removed from the card slot 19 in the direction of the arrow, 40
Is a card processing device, 41 is a card detection sensor that detects the card 39 inserted in the card slot 19 and generates a card detection signal, and 42 is a card detection signal line for sending the card detection signal to the CPU 51.

Reference numeral 20 denotes a bill slot, 44 is a bill, 45 is a bill transport roller for transporting the bill 44 from the main body of the automatic cash processor 15 toward the bill slot 20, and 46 is disposed in the bill slot 20. A hand detection sensor for detecting the inserted hand 23 and generating a hand detection signal is provided.
This is a hand detection signal line to be sent to the PU 51. And 2
1 is a CRT with a touch panel, 49 is a CR with a touch panel
A touch panel sensor that detects when an item panel or a numeric panel of T21 is touched and generates a touch panel sensor signal; 50, a touch panel sensor signal line for sending a touch panel sensor signal to the CPU 51;
7 is a CRT and 58 is an operation instruction signal line. CRT57
Displays predetermined guidance, instructions, and the like on a menu screen or the like based on an operation instruction signal transmitted from the CPU 51 via the operation instruction signal line 58.

Reference numeral 54 denotes an automatic cash processing machine control device. The automatic cash processing machine control device 54 includes a CPU 51, a memory 52 as a storage means, a power supply 53, and an external interface unit 55. Note that the CPU 51 is connected to an external device (not shown) (device on the monitor side of the photographing device 16) via the data output line 56 and the external interface unit 55, and sends predetermined data to the external device.

In the photographing apparatus having the above configuration, the CPU 51
Are provided in a card detection sensor 41 provided in the card processing device 40, a hand detection sensor 46 provided in the bill slot 20, a touch panel sensor 49 provided in the CRT 21 with a touch panel, and a passbook processing device (not shown). It receives detection signals such as a card detection signal, a hand detection signal, a touch panel sensor signal, and a passbook detection signal from each sensor such as a passbook detection sensor. Then, the CPU 51 sends the shooting timing signal to the camera 1 with the lens via the shooting timing signal line 36.
7 is sent to the CCD control circuit 33. Upon receiving the photographing timing signal, the CCD control circuit 33 operates in accordance with the signal.
The element 32 is controlled. As a result, the faces 14 and the hands 23 of the users 11 to 13 are photographed by the camera 17 with the lens.

The face 14 and the hand 2 of the users 11 to 13
The image of No. 3 is converted to the CCD element 3 by the lens unit 31.
The output of the CCD element 32 is read by the CCD control circuit 33 at the timing of the photographing timing signal and converted into a video signal. In this case, the imaging surface of the CCD element 32 is composed of a CCD area 60 for hand photographing and a CC
The CCD control circuit 33 is divided into a C region and a D region 62.
A CCD area 60 for manual photographing along a scanning line of the CD element 32
CCD element 32 without distinction between the
Capture the output of Then, the video signal is sent to the image processing circuit 34, where the image signal (an NTSC format), which is a predetermined video standard signal, is based on the specifications of each financial institution that manages the automatic teller machine 15. A luminance signal, a color difference signal, a digital signal defined by IEEE 1394 or the like, or a USB standard signal).
The data is sent to the CPU 51 as image data.

Next, the CPU 51 performs data processing such as image compression processing and encryption processing corresponding to the specifications of each financial institution on the image data of the faces 14 and hands 23 of the users 11 to 13. Then, the CPU 51 stores the processed image data in the memory 52. At this time, the CPU 51
Additional information such as data indicating the date and time of shooting, a code indicating the type of transaction processing, a code indicating the type of operation, a sensor identification flag indicating which sensor has been activated, and data indicating the number of shooting timings Is added to the image data and stored. Then, the CPU 51 stores and manages the image data and the additional information added thereto here. Therefore, when reading the image data later, the CPU 51
Can read image data from the memory 52 based on the additional information. Note that the memory capacity of the memory 52 has a limit. Therefore, the financial institution that manages the automatic teller machine 15 operates an external management device (not shown) to transmit the C via the external interface unit 55.
The PU 51 may be accessed periodically to read the image data stored in the memory 52 and the additional information added thereto, and transfer the read data to an external management device.

The photographing device 16 is used by the users 11 to 1
Among the various operations according to (3), the operation of an important monitoring target is mainly monitored. For example, the imaging device 16 monitors the operation of the users 11 to 13 inserting the card 39 into the card slot 19 as an important operation to be monitored. This is to keep a record of who started the trading operation. In monitoring, the card detection sensor 41 provided in the card slot 19 detects the insertion of the card 39 into the card slot 19, and the photographing device 16 starts the user 1 from this point.
This is performed by photographing the faces 14 and the hands 23 of 1 to 13. Note that the photographing at this time is based on the state of access to the automatic cash processing machine 15 by the users 11 to 13 (for example,
The camera 17 with the lens is operated irrespective of the postures and orientations of the users 11 to 13). Also, the photographing device 16
Monitors the operation of the users 11 to 13 pulling out the card 39 from the card slot 19 as an important monitoring target operation.
This is because if the user forgets to take the card 39 and the card 39 is taken away by another person, the record of who took it is recorded. The monitoring is performed by the card detection sensor 41 disposed in the card slot 19 by the card 3.
9 is detected from the card slot 19, and the photographing device 16 photographs the faces 14 and the hands 23 of the users 11 to 13 from this point as a starting point. The photographing at this time is also performed by the automatic cash processing machine 15 by the users 11 to 13.
The camera 17 with the lens is operated regardless of the state of access to the camera. Further, the photographing device 16 is used by the user 11
13 monitors the operation of setting the bill 44 in the bill slot 20 as an important monitoring target operation. This is because when someone inserts counterfeit banknotes (which may be coins) or foreign matter, who records them is recorded. Monitoring is performed by the hand detection sensor 4 provided in the bill slot 20.
6 detects that the bill 44 is set in the bill slot 20, and the photographing device 16 photographs the face 14 and the hands 23 of the users 11 to 13 with this as a starting point. Further, the photographing device 16 monitors an operation of taking out the banknote 44 from the banknote slot 20 as an important monitoring target operation. This is to keep a record of who removed the banknote from the account.
In monitoring, the hand detection sensor 46 disposed in the bill slot 20 detects the removal of the bill 44 from the bill slot 20, and the photographing device 16 uses the hand detection sensor 46 as a starting point for the face 14 and the hand 23 of the users 11 to 13. This is done by shooting. The photographing at this time is also performed by operating the camera with lens 17 irrespective of the state of access to the automatic cash processor 15 by the users 11 to 13.

By the way, the automatic cash machine 15 is provided for the user 1
The operation of the CRTs 1 to 13 touching the CRT 21 with a touch panel can be monitored as important monitoring target operations.
The CRT 21 with a touch panel displays an item panel, a numeric panel, and the like, and the item panel includes various operations such as selection of transaction processing, input of a password, input of an amount, input of a confirmation, input of a transfer destination, and the like. Have been. Automatic cash processing machine 15
Each time an item panel or a numeric panel is touched, the touch panel sensor 49 detects the touch and sends a touch panel sensor signal to the CPU 51 via the touch panel sensor signal line 50. C that receives the touch panel sensor signal
The PU 51 generates a photographing timing signal to cause the camera with lens 17 to photograph.

At this time, if the photographing timing signal is generated for all the touch panel sensor signals, the automatic cash machine 15 will also photograph an operation of a monitoring target that is not important for the financial institution. For this reason, the automatic cash apparatus 15 stores useless image data in the memory 52, so that the memory 52 runs out of free space in a short period of time. Therefore, the financial institution specifies the important surveillance control in advance, and the automatic cash processing machine 1 performs photographing only when the important surveillance control operates.
It is desirable to set a program in the CPU 51 of the fifth embodiment.

For example, the operation of the users 11 to 13 when the CRT 21 with a touch panel displays a message such as "Please input a password" is extremely important in transaction processing. This is because the financial institution needs proof that the transaction has been processed by the owner of the card 39, and the PIN is generally known only to the owner of the card 39. 39
This is evidence that the transaction has been processed by the owner of the transaction. Also, for example, a CRT 21 with a touch panel
The operation of the users 11 to 13 when the display such as "Please enter the amount" is also extremely important in the transaction processing. This is because this display is for executing the payment transaction, and if a malfunction occurs during the payment transaction, the financial institution suffers a large loss.

Next, the photographing device 16 will be described.

In FIG. 3, reference numeral 16 denotes a photographing device arranged to be inclined forward and downward, 18 denotes a mirror arranged to be inclined upward and forward, 31 denotes a lens unit, and 32 denotes a CCD. 33, a CCD control circuit; 60, a CCD area for photographing the hand 23 for photographing the hand 23; 61, a boundary line; 62, a CCD area for photographing the face 14 for photographing the face 14; 63, a rear lens; Front lens, 65 is a lens barrel, 66 is a lens mount, 67 is a mirror frame, 68 is a CCD substrate fixing screw for fixing the CCD element 32, 69 is a lens fixing screw for fixing the lens unit 31, 70 is a lens fixing screw. Mirror 18, lens unit 3
It is a cover that covers 1 and the like.

FIG. 3 shows a side surface and an image forming surface of the CCD element 32. The normal CCD element 32 has an aspect ratio, that is, H: W of 3: 4. Therefore, the users 11 to 13 in the height direction of the automatic cash processing machine 15
When it is necessary to monitor the operation of (1), if the CCD element 32 is arranged in the direction as shown in FIG. 3, the shooting angle of view A, B of the camera 17 with lens can be increased.

By the way, the mirror 18 is provided in front of the lens unit 31. The mirror 18 is arranged such that its tip 18a coincides with the optical axis SH1 located at the center of the angle of view A, B of the camera 17 with lens.
Thus, the image divided into two around the optical axis SH1 is formed on the CCD element 32 as described below. That is, the image of the face 14 within the shooting angle of view A is incident on the mirror 18 obliquely downward from above.
After being reflected by the lens unit 31, it is sent upward through the lens unit 31, and the face photographing CCD area 62 of the CCD element 32 is
Image. On the other hand, the image of the hand 23 within the shooting angle of view B is sent upward through the lens unit 31 and
An image is formed on the second hand photographing CCD area 60.

The focus state of the images of the face 14 and the hand 23 is determined by the positional relationship between the CCD 32 and the lens unit 31. In the present embodiment, a screw surface is formed on the surface of the lens barrel 65, and the lens barrel 65 and the lens mount 66 are screwed through the screw surface. Therefore, by rotating the lens unit 31 with respect to the lens mount 66, the distance between the rear lens 63 of the lens unit 31 and the imaging plane of the CCD element 32 can be changed, and the focus state can be adjusted. After the adjustment of the focus state is completed, the lens mount 6 is tightened by tightening the lens fixing screw 69.
6, the lens unit 31 can be fixed.

The lens unit 31 has two lenses, a front lens 64 and a rear lens 63. When the face 14 and the hand 23 are simultaneously photographed as in the present embodiment, the lens unit 31 has a relatively wide angle. Must be set. For example, assuming that the light receiving size of the CCD element 32 is 1/3 [inch] (diagonal distance of the image plane), the focal length of the lens unit 31 is 15 [m].
m] or less, and the total of the photographing angles of view A and B is 4
It is necessary to be 0 [°] or more.

The mirror 18 has a mirror frame 67.
And is fixed by bonding. Then, the CCD control circuit 33 controls the lens mount 6.
6 is attached by a CCD substrate fixing screw 68.

In this embodiment, the mirror 1
8 is an optical axis SH1 of the tip 18a of the lens unit 31.
Are arranged so as to coincide with each other.
It is equally divided into the D region 62. That is, boundary line 6
1 is set at a position of の of the width W.

Next, a description will be given of a monitor image when the photographing device 16 having the above-described configuration is mounted on the automatic cash processing machine 15 and the faces 14 and the hands 23 of the users 11 to 13 are photographed. For convenience of explanation, the monitor image of the hand 23 indicates a state in which various operations are performed simultaneously.

FIG. 4 is a diagram showing an example of a monitor image according to the first embodiment of the present invention. In FIG. 4, 14 is a face, 20 is a bill slot, 21 is a CRT with a touch panel, 23
Is a hand, 39 is a card, 44 is a bill, and 79 is a passbook.
As shown in FIG. 4, the monitor screen 80 is divided into two, and the left side area includes the faces 1 of the users 11 (FIG. 11) to 13.
The monitor image of No. 4 is displayed in the right area, and the monitor images of the hands 23 and the arms of the users 11 to 13, the card 39, the banknote 44, the passbook 79, the CRT 21 with a touch panel, and the like are displayed.

<Second Embodiment> In the first embodiment, as described above, the mirror 18 is arranged such that its tip 18a coincides with the optical axis SH1 of the lens unit 31. Therefore, the imaging plane of the CCD element 32 is divided into the CCD area 60 for photographing the hand and the CCD area 6 for photographing the face.
It is equally divided into two. That is, the boundary line 61 has the width W
Is set to a half of the position.

However, depending on the object to be photographed, the photographing angle of view A for photographing the face 14 needs to be larger or smaller than the photographing angle of view B for photographing the hand 23. In addition, when the height of the user 11 to 13 is extremely low, or when the user 11 to 13 greatly changes the posture, the face 14 cannot be photographed when the photographing angle of view A is fixed. There is.

Therefore, a second embodiment in which the angle of view A, B for photographing can be adjusted according to the object to be photographed will be described below. In addition, about what has the same structure as 1st Embodiment, the description is abbreviate | omitted by attaching the same code | symbol.

FIG. 5 is a sectional view of a photographing apparatus according to the second embodiment of the present invention. In FIG. 5, reference numeral 85 denotes a mirror driving frame; 86, a motor as a driving unit and a photographing angle changing unit for changing a photographing angle of view; And a mirror slider that holds a mirror 18 as a reflection member. The mirror slider 87 is formed with two sliding holes (not shown) and one screw hole (not shown), and the sliding shaft 88 is passed through the sliding hole, and the screw hole and the feed screw 89 are formed. They are engaged. In addition,
90 is a motor fixing screw for attaching the motor 86 to the mirror driving frame 85.

In the present embodiment, for example, it is determined whether or not the operator can recognize the image of the face 14 reflected on the left side of the monitor screen 80 by looking at the monitor. When the image of the face 14 is not well displayed in the left area of the monitor screen 80 (see FIG. 4), when the operator drives the motor 86 to rotate the feed screw 89, the mirror slider 87 moves in the direction of the arrow. As a result, the image of the face 14 is favorably shown in the left area of the monitor screen 80. Incidentally, when the tip 18a of the mirror 18 is placed at a point a, the position and the lens unit 31 of the tip 18a since the optical axis SH1 coincide, the photographing field angle theta ₁ and the hand 23 for photographing the face 14 shooting photographing field angle theta ₂ to become equal. Also, tip 1
When 8a is placed at the point b, the photographing field angle theta ₃ for photographing the face 14 is larger than the photographing field angle theta ₄ for taking the hand 23. When the leading end 18a is placed at the point c, smaller than photographing field angle theta ₆ for the imaging angle theta ₅ for photographing the face 14 to shoot a hand 23.

In the present embodiment, since the position of the mirror 18 can be changed by driving the motor 86, the angle of view for photographing the face 14 and the angle of photographing for photographing the hand 23 can be changed. The angle can be adjusted. Further, if or when the user 11 to 13 is extremely low height of the user 11 to 13 greatly change the attitude, when the theta ₃ to increase the photographing field angle, to sufficiently photographing the face 14 it can.

In the present embodiment, the following configuration allows the photographing device 16 itself, not the operator, to satisfactorily photograph the images of the faces 14 of the users 11 to 13 by the camera 17 with the lens. You can also determine whether or not. That is, the image recognition means is provided in the CPU 51. The image recognition means performs image recognition on the image data sent from the image processing circuit 34 according to a predetermined algorithm. For example, the image recognizing means first determines whether or not the image data includes the nose image data, and if the image data includes the nose image data, then determines whether or not the image data includes the eye image data. The image recognizing means makes a predetermined determination in this way, and determines whether or not the image of the face 14 has been successfully captured based on the result. And CPU
When the image of the face 14 is not photographed, the motor 51 drives the motor 86 to change the position of the mirror 18 and adjust the photographing angle of view.

Further, the photographing device 16 identifies whether the users 11 to 13 are the principals by performing the following processing, and interrupts the transaction or sounds an alarm based on the result. Can be. For example, the photographing device 16 acquires biometric data such as image data and iris data of the face 14 of the person from a host computer (not shown) or a card owned by the user, stores the acquired data in the memory 52, and stores the photographed usage data. Person 11-
The biometric data is generated from the image data of the thirteen faces 14, and the stored biometric data is collated with the generated biometric data of the users 11 to 13.

In the present embodiment, the position of the mirror 18 is changed one-dimensionally by moving the mirror 18 linearly. However, the mirror 18 is moved in multiple directions by moving the mirror 18 in multiple directions. Can be multidimensionally changed. Further, in the present embodiment, the mounting angle of the mirror 18 can be changed by rotating the mirror 18.

In the present embodiment, the image plane of the CCD element 32 is divided into two and two monitor images are displayed on the monitor screen 80. It is also possible to divide into three or more and display three or more monitor images on the monitor screen 80.

By the way, it is desired that the photographing apparatus photograph the user's face and other parts as large as possible.

Accordingly, a third embodiment in which the user's face and other parts can be photographed as large as possible will be described below. In addition, about what has the same structure as another embodiment, the description is abbreviate | omitted by attaching | subjecting the same code | symbol.

<Third Embodiment> FIG. 7 shows a third embodiment of the present invention.
FIG. 8 is a side view of an automatic cash processing machine equipped with an image capturing device according to the third embodiment, FIG. 8 is a front view of the automatic cash processor equipped with an image capturing device according to the third embodiment of the present invention, and FIG.
FIG. 11 is a front view of a main part of an automatic cash processing machine equipped with a photographing device according to a third embodiment of the present invention.

In FIG. 7, reference numeral 115 denotes an automatic cash processing machine managed by a financial institution serving as an administrator; 116, a photographing device; 117, a camera with a lens as an image pickup means disposed on the photographing device 116; Is a folding type mirror as a photographing view angle dividing means and a reflecting member, 119 is a passbook opening for inserting and removing a passbook (not shown), 120 is a coin opening for inserting and removing a coin not shown, and 121 is a part to be photographed. A face 14 shooting port for shooting the face 14 is a hand shooting port for shooting the hand 23 and the like. The face 14 shooting opening 121 and the hand shooting opening 122 are provided with a dark-colored translucent material so that the shooting device 116 cannot be seen from the outside.

The photographing device 116 is an automatic cash processing machine 1
The camera 11 with one lens mounted at the center position of the camera 15
And the camera 117 with the lens.
To 13 and the hands 23 and the like are photographed at the same time. The lens-equipped camera 117 has a half-fold mirror 1
18 is provided, and the angle of view of the camera 117 with the lens is set to three shooting angles of view A by the folding mirror 118.
1, B1 and B2.

The center-fold mirror 118 has two mirrors, namely, a right mirror 118a and a left mirror 1
18b is formed by fitting it into a "C" shape,
It is provided with two reflecting surfaces which are disposed relatively to each other around the optical path of a CCD element described later. Then, the center-fold mirror 118
, The shooting angle of view B1 is set by the right mirror 118a, and the shooting angle of view B2 is set by the left mirror 118b. Thus, the photographing device 116 moves the face 14 of each of the users 11 to 13 at the photographing angle of view A1 to the coin opening 120, the passbook opening 119, or the coin opening 120 at the photographing angle of view B1.
23 of the users 11 to 13 stretched to the bill slot 20, the card slot 19 or the bill slot 20 at the shooting angle of view B2.
The hands 23 and the like of the users 11 to 13 that are extended are photographed, respectively. Note that the photographing device 116 can photograph the passbook mouth 119 at the photographing angle of view B1 and the card opening 19 at the photographing angle of view B2 as necessary.

As described above, since the photographing device 116 is provided with the center-fold mirror 118, the photographing angle of view A1 and the photographing angle of view B1, B2 can be set independently. Therefore, the photographing device 116 is located at the center of the user 1
In order to photograph the faces 14 of 1 to 13, the photographing angle of view A1 can be set large.
Can easily cope with a difference in height between the users 11 to 13 standing in front of the user.

A2 is the optical axis of the lens-equipped camera 117, and A3 is the optical axis when viewed from the front side of the photographing device 116.
This is a shooting range in which shooting can be performed at the shooting angle of view A1. The photographing range A3 is set at a position away from the photographing device 116 by a distance L. Therefore, as shown in FIG. 7, since the faces 14 of the users 11 to 13 are within the photographing range A3, the camera 117 with the lens is used.
Thus, the face 14 of each of the users 11 to 13 can be sufficiently photographed.

In the present embodiment, the right mirror 118
A rectangular mirror having the same shape and the same dimensions is used as a and the left mirror 118b. Moreover,
In the present embodiment, since the right mirror 118a and the left mirror 118b have the same inclination, not only can the structure of the center-fold mirror 118 be simplified, but also the shooting angle of view B1 and the shooting angle of view B2 can be reduced. Can be exactly equal. In addition, as shown in FIG. 8, although only half of the bill mouth 20 is photographed, the bills dispensed from the automatic cash processor 115 to the users 11 to 13 are not broken in half. At the shooting angle of view B2, it is possible to sufficiently monitor the presence or absence of a bill in the bill slot 20 and the operation of the users 11 to 13 to take out the bill.

Further, as shown in FIG. 8, the shooting angles of view B1, B2 extend along the outer edge of the housing of the automatic cash processing machine 115, so that the monitoring effect can be improved.

In this embodiment, each transaction port (ie, passbook port 119, card port 19, bill port 20)
And the coin slot 120) are disposed symmetrically with respect to the center position where the photographing device 116 is mounted, so that the center-fold mirror 118 is symmetrical about the optical path of a CCD element described later. Will be arranged. On the other hand, when each trading port is disposed asymmetrically, the folding mirror 11 is used.
Preferably, 8 changes the inclination of the right mirror and the left mirror so that each transaction port can be photographed asymmetrically.

In the present embodiment, the center-fold mirror 118 is used. However, the center of the mirror 118 is recessed so that each transaction port is included in each shooting angle of view. A mirror may be used.

As described above, in the present embodiment, C
In correspondence with each other around the optical path of the CD element,
By arranging two reflecting surfaces relative to each other, each transaction port is included in the angle of view of each reflecting surface.

Next, a case will be described in which the users 11 to 13 select withdrawal of cash as transaction processing and withdraw cash. Automatic cash dispenser 115 with touch panel CR
At T21, a menu screen is displayed, and various items for the users 11 to 13 to operate the automatic teller machine 115 are displayed on the menu screen. User 1
According to the guidance on the menu screen or the guidance by voice, the CRT 21 with a touch panel is provided as a first operation.
Touch the item “Drawer” on the touch panel. Next, the users 11 to 13 insert a card into the card slot 19 as a second operation, and touch a numeric panel of the CRT 21 with a touch panel as a third operation to input a personal identification number. The entered password is input to the automatic cash processor 11
5 is transmitted to a host computer (not shown), where it is collated with a personal identification number registered corresponding to the card.
When the input password matches the password registered in correspondence with the card by the collation, the host computer transmits a permission signal to the automatic teller machine 115. Thereby, the automatic cash processing machine 115 is permitted to perform the following operation.

Thereafter, as a fourth operation, the users 11 to 13 enter the amount of cash to be withdrawn by pressing the numeric panel. Thereby, after predetermined processing is performed by the automatic cash processor 115, the input amount of cash is
0 is paid out. Then, the users 11 to 13 take out cash from the bill slot 20 as a fifth operation. In this way, the users 11 to 13 can withdraw cash by the first to fifth operations. During this time, the camera with lens 117 photographs the face 14 and the hand 23 of the users 11 to 13, and the image data of the photographed face 14 and the hand 23 is associated with the transaction processing of the automatic cash processor 115, and
16 is recorded. In particular, the image data of the face 14 and the hand 23 corresponding to the second, third, and fifth operations are recorded as important image data.

As described above, the photographing device 116 arranges the right mirror 118a and the left mirror 118b in front of one camera 117 with a lens, and divides the angle of view of the camera 117 with a lens. Accordingly, the imaging device 116 can simultaneously image the face 14 at the imaging angle of view A1, the left hand 23 at the imaging angle of view B1, and the right hand 23 at the imaging angle of view B2, for example. . That is, the photographing device 116 can photograph the face 14 with a sufficient photographing angle of view A1 without increasing the angle of view of the lens of the lens-equipped camera 117, and is set by the right mirror 118a and the left mirror 118b. Shooting angle of view B1, B
With 2, the hand 23, the bill slot 20, the coin slot 120 and the like can be photographed.

Therefore, if the automatic cash processing machine 115 is used improperly, the monitoring system will
, And the operations of the users 11 to 13 accessing the transaction port, etc., so that it can be easily proved that the automatic teller machine 115 has been illegally used. In addition, since the monitoring system does not need to dispose a plurality of cameras such as a camera for the face 14 and a camera for the hand, the cost of the photographing device 116 can be reduced, and the size of the photographing device 116 can be reduced. Can be.

The photographing device 116 is used by the users 11 to 1
Since the three faces 14 and the hands 23 and the like can be captured in one image frame, the amount of image data can be reduced by that much and the amount can be reduced to half of that in the related art. Therefore, the monitoring system can reduce the memory capacity of the memory (not shown). Alternatively, when it is not necessary to reduce the memory capacity, the monitoring system can lengthen the shooting time.

Further, the surveillance system sends image data of the face 14 and the hand 23 photographed at a remote place to a monitor device (not shown), and displays a monitor image on a monitor screen of the monitor device. 115 users 11 to 11
When monitoring the operation of 13, it is not necessary to provide a monitor device for displaying the face 14 and a monitor device for displaying the hands 23, respectively. That is, since the monitoring system can display the image data of the face 14 and the image data of the hand on one monitor screen without editing, the image processing device becomes unnecessary. Therefore, the cost of the imaging device 116 can be reduced.

Next, a method for generating image data of the faces 14 and the hands 23 of the users 11 to 13 in the first to fifth operations will be described.

FIG. 10 is a block diagram of a photographing apparatus according to the third embodiment of the present invention.

In FIG. 10, reference numeral 117 denotes a camera with a lens. The camera 117 with a lens has a lens unit 31 as a light-condensing element and a CCD element 3 as an image-forming element.
2, and the CCD element 32, and
A CCD control circuit 33 is provided as an imaging control unit that generates a video signal based on the output of the D element 32.

Reference numeral 119 denotes a passbook mouth, and 79 denotes a passbook mouth.
19, a passbook processing device; 140, a passbook detection sensor for detecting the passbook 79 inserted into the passbook opening 119 to generate a passbook detection signal; 142, a passbook detection sensor; A passbook detection signal line for sending a signal to the CPU 51.

Reference numeral 120 denotes a coin slot, 144 denotes a coin, 145 denotes a coin transport roller for transporting the coin 144 from the main body of the automatic cash processor 115 toward the coin slot 120, and 146 denotes a coin slot. A hand detection sensor 147 is provided to detect the inserted hand 23 and generate a hand detection signal.
This is a hand detection signal line for sending to the user.

In the photographing apparatus 116 having the above configuration, the CP
U51 is a card detection sensor 41, a hand detection sensor 46,
146, a detection signal such as a card detection signal, a hand detection signal, and a passbook detection signal is received from the passbook detection sensor 141 and the like.
Then, the CPU 51 sends a shooting timing signal to the CCD control circuit 33 via the shooting timing signal line 36. The CCD control circuit 33 that has received the photographing timing signal controls the CCD element 32 according to the signal. as a result,
The face 14 and the hand 23 of the users 11 to 13 are simultaneously photographed by the camera 117 with a lens.

The face 14 and the hand 2 of the users 11 to 13
An image such as 3 is formed on the image forming surface of the CCD element 32 by the lens unit 31, and the output of the CCD element 32 is read by the CCD control circuit 33 at the timing of the photographing timing signal and converted into a video signal. Then, the video signal is sent to the image processing circuit 34 and the image processing circuit 3
4, based on the specifications of each financial institution that manages the automatic teller machine 115, an image signal (a luminance signal, a color difference signal, an IEEE
1394 or the like or a signal of the USB standard), and converted as image data by the CPU 51.
Sent to

Next, the CPU 51 determines that the users 11 to 13
Image processing such as image compression processing and encryption processing corresponding to the specifications of each financial institution. Then, the CPU 51 stores the processed image data in the memory 52 with the additional information.

The memory capacity of the memory 52 is limited. Therefore, the financial institution that manages the automatic cash processing machine 115 accesses the CPU 51 periodically through the external interface unit 55 by operating an external management device (not shown), and the image data stored in the memory 52 and the The added additional information may be read and transferred to the outside.

By the way, the photographing device 116 is
As in the case of No. 6, an important monitoring target operation among various operations by the users 11 to 13 is mainly monitored.

For example, the photographing device 116 is used by the users 11 to
13 monitors the operation of inserting the card 39 into the card slot 19 as an important monitoring target operation. Also, the photographing device 11
6 monitors the operation of the users 11 to 13 pulling out the card 39 from the card slot 19 as an important monitoring target operation. In addition, the imaging device 116 monitors the operation of the users 11 to 13 setting the bill 44 in the bill slot 20 as an important monitoring target operation. Further, the photographing device 116 monitors an operation of taking out the bill 44 from the bill slot 20 as an important monitoring target operation.

Further, the photographing device 116 is used by the users 11 to 1
3 monitors the operation of inserting the passbook 79 into the passport 119 as an important monitoring target operation. In monitoring, the passbook detection sensor 141 disposed in the passbook mouth 119 detects the insertion of the passbook 79 into the passbook mouth 119, and uses this as a starting point for the photographing apparatus 1
16 is performed by photographing the face 14 and the hands 23 of the users 11 to 13.

Further, the photographing device 16 is provided for the users 11 to 13
Monitors the operation of pulling out the passbook 79 from the passport 119 as an important monitoring target operation. This means that if the user
If the user forgets to take 9 and the passbook 79 has been taken away by another person, this is to keep a record of who took it away. For monitoring, the passbook detection sensor 141 provided in the passbook mouth 119 detects the withdrawal of the passbook 79 from the passbook mouth 119, and the photographing device 116 starts using the facebook 14 and the hands 23 of the users 11 to 13 based on this. This is done by shooting. Further, the photographing device 116 is used by the users 11 to 13
Monitors the operation of setting the coin 144 in the coin slot 120 as an important monitoring target operation. This is because when someone inserts a counterfeit coin or foreign matter, who records it is recorded. For monitoring, the hand detection sensor 146 disposed in the coin slot 120
4 is set in the coin slot 120, and the photographing device 116 photographs the faces 14 and the hands 23 of the users 11 to 13 with this as a starting point.

Further, the photographing device 116 is
The operation of taking out the coin 44 from is monitored as an important monitoring target operation. This is to keep a record of who removed the coin from the account. Monitoring is coin slot 1
The hand detection sensor 146 disposed in the camera 20 detects the removal of the coin 44 from the coin slot 120, and the photographing device 116 photographs the face 14 and the hand 23 of the users 11 to 13 with this as a starting point. Done.

Note that photographing at these times is performed by the user 11
The camera 117 with a lens is operated regardless of the state of access to the automatic cash processing machine 115 (for example, the posture and orientation of the users 11 to 13).

By the way, the photographing device 116 corresponds to the operation of the automatic cash processing machine 115 during the transaction, and
4 and the image data of the hand 23 are recorded in the memory 52. At this time, the photographing device 116 adds predetermined additional information to the forefront or last part of the image data and stores the image data. In the present embodiment, as the additional information, data representing a unique sensor number added to the card detection sensor 41, the hand detection sensors 46 and 146, and the passbook detection sensor 141 when the face 14 or the hand 23 is photographed. And data representing the date and time when the image was taken, a transaction customer number designated for each financial institution managing the automatic teller machine 115, data representing account numbers of the users 11 to 13, card ID numbers, and the like, card payment And card withdrawal, passbook deposit, passbook withdrawal, transfer, passbook entry,
Data or the like representing transaction operation items such as balance inquiry is provided. The additional information constructs a surveillance image database in which image data is classified according to specific conditions. The financial institution can detect predetermined image data by reading means (not shown) based on the additional information.

Next, details of the photographing device 116 and an example of a monitor image will be described.

FIG. 6 is a side view of a main part of a photographing apparatus according to a third embodiment of the present invention, FIG. 11 is a front view of a main part of the photographing apparatus according to the third embodiment of the present invention, and FIG. FIG. 13 is a diagram showing a first example of a monitor image according to the third embodiment of the present invention, FIG. 13 is a diagram showing a second example of a monitor image according to the third embodiment of the present invention, and FIG. FIG. 15 is a diagram showing a third example of a monitor image according to the third embodiment;
Is the fourth of the monitor image in the third embodiment of the present invention.
It is a figure showing the example of.

In the figure, reference numeral 116 denotes a photographing device. The photographing device 116 includes a camera 117 with a lens and a right mirror 1.
Folding mirror 1 composed of 18a and left mirror 118b
18, a CCD element 32, a CCD control circuit 33, a mirror block 170, a main frame 171, a mirror block mounting screw 172, a lens adjustment play removing spring 173, a lens mount 176, a lens barrel 177, and a camera mounting hole 178. Then, the mirror block 170
Is connected to the main frame 171 by three mirror block mounting screws 172, and the CCD control circuit 33 is connected to two C
The lens mount 176 is fixed to the CCD control circuit 33 by two screws 179, and the lens mount 176 is fixed to the main frame 171 by the CD substrate set screw 174 and the collar 175.

The lens barrel 177 has a threaded surface on its outer peripheral surface. When the lens barrel 177 is rotated, the lens unit 31
The distance between the rear end face and the CCD element 32 is adjusted, and each image is focused. Lens mount 17
Between the lens barrel 6 and the lens barrel 177, a lens adjusting play spring 173 is mounted in order to eliminate backlash on the screw surface. And the above-mentioned folding mirror 1
18 is formed by bonding the right mirror 118a and the left mirror 118b to the tip of the mirror block 170. In this manner, the lens unit 31 forms the shooting angle of view B1, B2 by the portion of the shooting angle of view A4 of the originally included angle of view (A1 + A4). A2
Is the optical axis.

The CCD control circuit 33 includes a CCD
A device 32 is mounted, and a photographing angle of view A is provided on the CCD device 32.
, B1 *, B1 *, B1 *, B1
2 * is formed. The CCD element 32 is mounted vertically with the upper edge 32a extending vertically so that H <W when the height is H and the width is W. Therefore, sufficient imaging areas A1 *, B1 *, B2 * in the height direction of the users 11 to 13 can be secured. When an image of the face 14 (not shown) of each of the users 11 to 13 is formed on the image forming area A1 *, the CCD element 32 outputs image data of the face 14 to the monitor device. 23 and coin slot 12
0 (see FIG. 10), the image of the passbook 79, the coin 144, and the like are output to the monitor device, and the hand 23, the bill slot 20, the card 39, the card 39, and the like are displayed in the image forming area B2 *. When an image of the bill 44 or the like is formed, the image data is output to the monitor device. It should be noted that the monitor screen of the monitor device is disposed vertically long in correspondence with the direction in which the CCD elements 32 are disposed.

FIG. 12 is a monitor image when there are no users 11 to 13 in front of the automatic cash processing machine 115. At this time, since there are no users 11 to 13, the area a1 of the monitor image does not show the face 14 of the users 11 to 13 but only the background of the automatic cash processor 115, and the area b1 has a coin slot 120. And its surroundings, and the area b2 reflects the bill slot 20 and its surroundings.

FIG. 13 shows when the users 11 to 13 are standing in front of the automatic cash processing machine 115 and operate the touch panel of the CRT 21 with a touch panel, or when the automatic cash processing machine 115 is waiting for a response. It is a monitor image. At this time, the area a1 is the face 14 of the users 11 to 13.
The area b1 reflects the coin slot 120 and its periphery, and the area b2 reflects the bill slot 20 and its periphery.

FIG. 14 shows that the users 11 to 13 have the card
9 is a monitor image when a card 39 is inserted into / removed from 9. At this time, the area a1 is the face 1 of the users 11 to 13
4, the area b1 shows the coin slot 120 and its periphery, and the area b2 shows the hand 23 and the card 39.

FIG. 15 shows that the users 11 to 13
7 is a monitor image when a bill 44 is inserted into and removed from the monitor. At this time, the area a1 shows the faces 14 of the users 11 to 13, the area b1 shows the coin slot 120 and its periphery, and the area b2 shows the hands 23 and the bills 44.

Thus, one lens-equipped camera 117
Thus, the face 14 and the hands 23 of the users 11 to 13 can be photographed, so that it is not necessary to dispose the lens-equipped camera 117 for each of the faces 14 and the hands 23. Therefore, in this embodiment, not only the cost of the imaging device 116 can be reduced, but also the imaging device 116 can be downsized. Further, in the present embodiment, since the face 14, the hand 23, and the like can be captured in one image frame, the image data can be reduced accordingly.

In the present embodiment, for example, in order to dispose the miniaturized automatic cash processing machine 115 in a department store or a convenience store, the distance between the camera with lens 117 and the users 11 to 13 is reduced. Even when it is not possible to take a large value, the angle of view A1, B1, B2 can be increased. Therefore, it is not necessary to increase the angle of view of the lens of the lens unit 31, so that the monitor image is not greatly distorted at the edge of the screen of the monitor device. As a result, in the present embodiment, the face 14 and the hand 23
Etc. can be easily recognized. In addition, according to the present embodiment, it is not necessary to use an expensive ultra-wide-angle lens for the lens unit 31, so that the cost of the photographing device 116 can be reduced.

Then, the photographing apparatus 1 in the present embodiment
The automatic cash processing machine 115 equipped with the camera 16 can simultaneously photograph the faces 14 and the hands 23 of the users 11 to 13, so that even if a trouble occurs in a transaction, the trouble can be quickly dealt with. Can be. For example, user 1
Even if 1 to 13 forget to take the card 39, banknote 44, passbook 79, coin 144, etc., it is possible to generate an alarm urging the users 11 to 13 to confirm. Then, the operation of the users 11 to 13 is monitored by the photographing device 116, and the users 11 to 13 enter the face 14 into a predetermined transaction port among the passbook port 119, the card port 19, the bill port 20, the coin port 120, and the like.
When you turn your hand or bring your hand 23 close,
9, banknotes 44, passbook 79, coins 144 and the like can be issued. Therefore, the card 39, the bill 44, the passbook 7
9. It is possible to further prevent forgetting to take the coin 144 or the like.

Further, in this embodiment, the face 14 and the hands 23, etc., from when the users 11 to 13 stand in front of the automatic teller machine 115 until the transaction processing ends and the user leaves the automatic teller machine 115, etc. Can be simultaneously photographed, so that the photographing device 116 can confirm the reaction of the users 11 to 13 to the operation guide from the automatic cash processor 115. In addition, face 1 of users 11 to 13
4. In particular, since the transaction guide of the automatic cash processing machine 115 can be performed in accordance with the line of sight and the movement of the hand 23, the users 11 to 13 are elderly people, physically handicapped persons, etc., or the automatic cash processing machine 115 Even if the user is unfamiliar with the operation, the automatic cash processing machine 115 can be easily operated.

When the automatic cash processor 115 is installed in a department store, a convenience store, or the like,
In the case where a foreign object is inserted into the card slot 19, the bill slot 20, the coin slot 120, or the like, the inserted person can be specified.

When a person other than the person withdraws cash using the card 39, the passbook 79, or the like, it is possible to specify the person based on not only the characteristics of the face 14 and the hand 23 but also the characteristics of the operation. it can. In addition, dominant arm, presence of ring,
A person can also be specified based on the presence or absence of nail polish. When the cash is withdrawn by threatening the owner of the card 39, it is possible to know that the owner of the card 39 has not touched the cash.

<Fourth Embodiment> In the third embodiment, the center-fold mirror 118 includes a right mirror 118a and a left mirror 118b as mirror blocks 170.
However, a positioning jig is required to position the right mirror 118a and the left mirror 118b at the time of bonding, and a manufacturing operation is troublesome. Further, the adhesive may adhere to the surfaces of the right mirror 118a and the left mirror 118b. Therefore, a fourth embodiment of the present invention including a center-fold mirror in which two reflecting surfaces are integrally formed will be described.

FIG. 16 is a plan view of a center-fold mirror according to the fourth embodiment of the present invention, FIG. 17 is a front view of the center-fold mirror according to the fourth embodiment of the present invention, and FIG. FIG. 15 is a left side view of the center-fold mirror according to the fourth embodiment.

In the figure, reference numeral 181 denotes a V-groove type folding mirror as a photographing angle-of-view dividing means. The folding mirror 181 is a glass body having a V-groove formed on the front surface by cutting. 182, and an aluminum coat 183 with a protective film coated on the surface of the main body 182. The aluminum coat 183 with a protective film further coats the protective film after mirror-coating aluminum on the surface of the main body 182. Formed by The center-fold mirror 181 is fixed to the mirror block 170 (FIG. 6) by screwing a screw (not shown) into the hole 184.

In this case, since the two reflecting surfaces RS1 and RS2 of the center-fold mirror 181 are formed integrally, the opening angles of the reflecting surfaces RS1 and RS2 can be formed accurately. Further, since there is no need to position the reflection surfaces RS1 and RS2, the operation for manufacturing the center-fold mirror 181 can be simplified. Further, since it is not necessary to use an adhesive to fix the center-fold mirror 181 to the mirror block 170, the adhesive does not adhere to the reflection surfaces RS1 and RS2.

<Fifth Embodiment> By the way, the third embodiment
In the embodiment, the monitor image is in the area a1 (FIG. 1).
5) Although it is divided into b1 and b2, if it is affected by the color, brightness, pattern, etc. of the monitor image, it becomes difficult to identify the boundaries between the areas a1, b1, and b2 on the monitor image. I will.

Therefore, a description will be given of a fifth embodiment of the present invention in which the boundaries between the areas a1, b1, and b2 can be easily identified. In addition, about what has the same structure as 3rd Embodiment, the description is abbreviate | omitted by attaching the same code | symbol.

FIG. 19 is an exploded perspective view of a center-fold mirror according to a fifth embodiment of the present invention, and FIG. 20 is a fifth embodiment of the present invention.
FIG. 21 is a sectional view taken along line AA of FIG. 19, FIG. 22 is a front view of a center-fold mirror according to a fifth embodiment of the present invention, and FIG. It is a figure showing the field of the monitor picture in a 5th embodiment of the invention.

In the figure, 185 is a fixing screw, 186 is a mirror pressing spring, 187 is a rectangular flat mirror having a reflection surface, and 188 is a mirror holder having a V-groove formed on the front.

Each flat mirror 187 is fitted (removed) into a concave portion formed on the back surface of the mirror holder 188, and the flat mirror 187 is fixed by a fixing screw 185 while the back surface of each flat mirror 187 is pressed by a mirror pressing spring 186. Is fixed to the mirror block 170. As a result, each end face of each plane mirror 187 is surrounded by the mirror holder 188, and a substantially frame is formed at the boundary of each reflection surface. Therefore, as shown in FIG.
1, b1 and b2 can be separated by a frame 189. Therefore, the boundaries between the regions a1, b1, and b2 can be easily identified. Further, since it is not necessary to use an adhesive to fix the mirror holder 188 to the mirror block 170, the adhesive does not adhere to the reflection surface.

Here, the CCD element 32 as an image forming element
When the mirror holder 188 has a white color when (FIG. 10) is a monochrome type, each area a1, b1, b2
Can be more easily identified. When the CCD element 32 is of a color type, the color of the background displayed in the area a1, the color of the coin slot 120 displayed in the area b1, the color of the bill slot 20 displayed in the area b2, and the like are taken into consideration.
If the mirror holder 188 is made different from the above colors and relatively bright, the boundaries between the regions a1, b1, and b2 can be more easily identified.

<Sixth Embodiment> Next, a sixth embodiment of the present invention in which image data can be subjected to feature processing will be described. In addition, about what has the same structure as 3rd Embodiment, the description is abbreviate | omitted by attaching the same code | symbol.

Although each operation is performed by the CPU 51, it can be performed by an operator.

FIG. 24 is an explanatory view of a feature processing area according to the sixth embodiment of the present invention, FIG. 25 is a view showing a black-and-white image according to the sixth embodiment of the present invention, and FIG. FIG. 27 is a diagram showing a first example of a monitor image according to the embodiment of the present invention, FIG. 27 is a diagram showing a second example of a monitor image according to the sixth embodiment of the present invention, and FIG. 28 is a sixth embodiment of the present invention. FIG. 29 shows a third example of the monitor image in the form of FIG.
Is the fourth of the monitor image in the sixth embodiment of the present invention.
FIG. 30 is a diagram showing a fifth example of a monitor image according to the sixth embodiment of the present invention.

In this case, as shown in FIG. 24, the area a1 is divided into nine feature processing areas S0 to S8, and based on the contrast distribution of each image in each of the feature processing areas S0 to S8, the area a1 is divided into nine areas. Characteristic processing is performed. For this purpose, a feature processing unit (not shown) of the CPU 51 (FIG. 10) performs a binarization process on the image data to form a black and white image as shown in FIG. Next, X in FIG.
Taking a black-and-white distribution in the Y direction, extracting a pair of black points 198,
Boundary lines 194 to 19 surround the black spot 198.
7, and a feature processing area S0 around the black point 198 is defined.
The characteristic processing areas S1 to S8 are set around the characteristic processing area S0.

Next, the feature extraction means of the feature processing means performs feature extraction of each of the feature processing areas S0 to S8 in order from the feature processing area S0 to the feature processing area S8. For example, in the feature processing region S0, the distance between the eyes, the presence or absence of wearing sunglasses 190, and the like in the feature processing regions S1 to S3, the hairstyle (separation, mesh, and the like), the presence or absence of a hat, and the like. In S5, hair length, ear shape,
The presence / absence of earrings is determined by the feature processing areas S6 and S8.
In, the motion of the arm, clothes (short-sleeved, long-sleeved) and the like are extracted as features of the image in the feature processing area S7, such as the shape of the mouth, the presence or absence of the mask 191 and the presence or absence of a tie (not shown).

Therefore, the CPU 51 analyzes the above-mentioned features by an analyzing means (not shown), and the automatic cash processing machine 11 based on the analysis result by an estimating means (not shown).
The state before 5 (FIG. 7) is guessed, or the transaction processing of the automatic cash processor 115 is stopped by a transaction processing stop means (not shown), and the users 11 to 13 are guided to the counter of the financial institution. Furthermore, announcements, pictures, and the like can be displayed in accordance with the operations of the users 11 to 13. In this embodiment, since it is necessary to find an abnormal behavior when using the automatic cash processor 115, the features extracted particularly in the feature processing areas S0, S2, and S7 are mainly analyzed. You.

When the card 39 is detected by the card detection sensor 41 and the transaction processing of the automatic cash processing machine 115 is started, as shown in FIG. 26, the users 11 to 13 are displayed in the area a1 of the monitor image. Face 14 is not displayed, only the background of the automatic teller machine 115 is displayed, and the card 39 is displayed in the area b2, the user who tries to avoid monitoring by the photographing device 116, or extremely stature It is presumed that a low user uses the automatic cash processing machine 115 with the card 39 inserted.

When the face 14 is not displayed in the area a1 of the monitor image and only the background of the automatic cash processor 115 is displayed immediately before the card 39 is discharged to the card slot 19, the user 11 It is presumed that the user 13 forgot to take the card 39 and left from in front of the automatic cash processor 115. In this case, by stopping the transaction processing of the automatic cash processor 115 and stopping the ejection of the card 39 to the card slot 19, the card 39 can be prevented from being taken away by another person.

Further, based on the size of the characteristic processing area S0, the state in front of the automatic cash processing machine 115 is estimated, if necessary, the transaction processing of the automatic cash processing machine 115 is stopped, Users 11 to 11 using
13 can be led to a window of a financial institution.
Feature processing area S0 in the monitor image shown in FIG.
Is defined as Y1, the width is defined as X1, the height of the feature processing area S0 in the monitor image shown in FIG. 28 is defined as Y2,
When the width is X2, Y1 <Y2 X1 <X2, and even when the same card 39 is inserted, the users 11 to 13 displayed on the monitor image of FIG.
It can be determined that the users 11 to 13 displayed on the monitor image 8 are different persons.

Further, by analyzing the characteristics of the characteristic processing areas S0, S2, S7, it can be understood that the users 11 to 13 displayed on the monitor image of FIG. 28 are wearing the sunglasses 190 and the mask 191. .

Therefore, if it is found that the users 11 to 13 displayed on the monitor image in FIG. 28 use the automatic cash processing machine 115, for example, the users 11 to 13 are not the owners of the card 39. However, the transaction processing of the automatic cash processor 115 is stopped, and the ejection of the card 39 is stopped, or after the card 39 is ejected, the bill 44, the passbook 79,
The discharge of the coin 144 or the like can be stopped.

Further, as shown in FIG. 29, the faces 14 of the users 11 to 13 are displayed in the area a1 of the monitor image.
The passbook 79 is not displayed in the area b1 and the card 3 is displayed in the area b2.
If 9 is not displayed, it is determined whether the user is waiting for the transaction processing of the automatic cash processor 115 to end or whether he / she is confused because the operation of the automatic cash processor 115 is not understood. Can be determined based on the expression, action, and the like of the user, so that the users 11 to 13 can be effectively guided.

As shown in FIG. 30, when the card 39 is ejected, the users 11 to 13 are present in front of the automatic teller machine 115 but their backs are turned. Forgetting the card 39 and automatic cash handling machine 1
It is presumed that he is about to leave from before Fifteen.
In this case, by issuing an alarm from the automatic cash processor 115, the attention of the users 11 to 13 can be directed to the card slot 19, and it is possible to prevent the card 39 from being forgotten.

Next, the operation of the photographing apparatus 116 having the above configuration will be described.

FIG. 31 is a first flowchart showing the operation of the photographing apparatus according to the sixth embodiment of the present invention.
FIG. 33 is a second flowchart showing the operation of the photographing apparatus according to the sixth embodiment of the present invention, and FIG. 33 is a third flowchart showing the operation of the photographing apparatus according to the sixth embodiment of the present invention.

In this case, the feature level 1 is, as shown in FIG. 28, the users 11 to 1 displayed on the monitor image.
The feature level 2 indicates that a feature that can be recognized as wearing the sunglasses 190, the mask 191 and the like is extracted from the user 11 to the user 11 displayed on the monitor image as shown in FIG. 13 indicates that a feature that can be seen to indicate that the face 14 is directed in a direction unsuitable for transaction processing has been extracted.

In the present embodiment, the alarm is generated up to three times, and the faces 14 of the users 11 to 13 are changed to the card slot 19 (FIG. 10), the passbook slot 119, the bill slot 20,
It is directed to a transaction port such as the coin port 120.

First, an automatic cash processor (ATM) 115
(FIG. 7) and the power of the photographing device 116 are turned on, and the automatic cash processor 115 is set to the standby mode. And CPU5
1 is a card detection sensor 41, hand detection sensors 46 and 14
6. Based on the detection signal from the passbook detection sensor 141, it is determined whether or not the users 11 to 13 have access to the transaction port, and it is confirmed which transaction port has been accessed.

Subsequently, an image is obtained by photographing the faces 14 and hands 23 of the users 11 to 13 by the camera 117 with a lens to generate image data P1. Then, the CPU 51 sets the image data P1 of the areas b1 and b2.
Is performed based on the result of the image processing, and based on the result of the image processing, it is determined whether the card 39, the passbook 79, and the like are displayed in the areas b1 and b2, and the card 39, the passbook 79, and the like are displayed. It is determined whether the card 39, the passbook 79, and the like are detected by the card detection sensor 41, the passbook detection sensor 141, and the like.

When the card 39, the passbook 79, and the like are detected, it is considered that the users 11 to 13 are performing some operation in front of the automatic teller machine 115.
1 performs the second image processing based on the image data P1 of the area a1, and determines whether there are users 11 to 13 in front of the automatic cash processor 115 based on the result of the image processing. In this case, the image data P1 is subjected to a binarization process,
It is determined whether a black-and-white image as shown in FIG. 25 can be formed. If a black-and-white image cannot be formed, the users 11 to 11 are provided in front of the automatic cash processor 115.
It is determined that 13 does not exist.

When it is determined that there are no users 11 to 13 in front of the automatic cash processing machine 115, the CPU 51 determines again whether the card 39, the passbook 79, and the like are detected by the card detection sensor 41, the passbook detection sensor 141, and the like. to decide. When the card 39, the passbook 79, and the like are detected, the users 11 to 1 that try to avoid monitoring by the imaging device 116
3 or very short users 11 to 13 are card 3
It is presumed that the automatic cash processing machine 115 is used by inserting 9. Therefore, the CPU 51 determines that the transaction processing by the automatic cash processing machine 115 is impossible, and takes in the card 39, the passbook 79, and the like, and also uses the lens-equipped camera 117 to control the faces 14, hands 23, and the like of the users 11 to 13. An image is obtained by shooting, and image data P10
Generate.

Subsequently, the CPU 51 sets a touch panel C
A guide is displayed on the display unit of the RT 21 and the users 11 to 13 are displayed.
To the counter of the financial institution. Then, the staff of the financial institution directly meets with the users 11 to 13 to confirm the identity of the users. The CPU 51 adds a code F to the image data P1 and P10 by a storage unit (not shown), and stores the image data P1 and P10 together with the code F in a memory 52 as a recording unit. Therefore, the actions of the users 11 to 13 when it is determined that the transaction processing by the automatic cash processor 115 is not possible can be recorded.

Further, based on the result of the second image processing,
When it is determined that there are users 11 to 13 in front of the automatic cash processor 115, the CPU 51 starts a transaction process. When the transaction processing is being executed, the CPU 51 determines the characteristic processing areas S0 to S8 based on the image data P1.
, And it is determined whether or not the extracted feature is at feature level 1. The extracted feature is feature level 1
In the case of, the CPU 51 stops the transaction processing, takes in the card 39, the passbook 79, and the like, displays a guide on the display unit of the CRT 21 with a touch panel, and displays
Guide 3 to the window of the financial institution. Then, the staff of the financial institution directly meets with the users 11 to 13 to confirm the identity of the users.
Subsequently, the CPU 51 obtains an image by photographing the faces 14 and the hands 23 of the users 11 to 13 with the lens-equipped camera 117, and generates image data P6. Subsequently, the storage unit adds the code A to the image data P1 and P6, and stores the image data P1 and P6 in the memory 52 together with the code A. Therefore, the card 39, the passbook 79, etc. may be returned to the person who seems to be suspicious,
Withdrawal of coins 144 or the like can be prevented. Also, when a person who seems suspicious leaves the place without going to the window of the financial institution, the action of the person can be recorded.

If the extracted feature is not the feature level 1, the CPU 51 ends the transaction processing, returns the card 39, the passbook 79, etc. to the users 11 to 13, and the transaction processing is the withdrawal processing. Then, a predetermined amount of cash is dispensed to the bill slot 20 and the coin slot 120. At this time, CPU
Reference numeral 51 denotes users 11 to 1 by a camera 117 with a lens.
An image is obtained by photographing the face 14, hands 23, and the like of No. 3 to generate image data P2 (N). Therefore, when cash is withdrawn by threatening the owner of the card 39, it is possible to know that the owner of the card 39 has not touched the cash.

For this purpose, the CPU 51 performs the second image processing based on the image data P2 (N) of the area a1, and
Based on the result of the image processing, it is determined whether there are users 11 to 13 in front of the automatic cash processing machine 115. When there are no users 11 to 13 in front of the automatic cash processing machine 115,
The CPU 51 notifies the users 11 to 11 that the transaction processing has been completed.
13 to generate an alarm up to three times. Note that an alarm character can be displayed on the CRT 21 with a touch panel. In spite of generating the alarm in this way, the users 11 to 13 can use the card 3
9, forget to pull out the passbook 79, banknotes 44, coins 14
If the player forgets to take the number 4 or the like, the CPU 51 cancels the transaction processing at the stage when the alarm is generated three times, and
9, take in passbook 79, banknotes 44, coins 144, etc.
On the CRT 21 with a touch panel, a character that indicates that the transaction processing has been canceled is displayed. Then, CPU
Reference numeral 51 denotes users 11 to 1 by a camera 117 with a lens.
An image is obtained by photographing the face 14, hands 23, etc. of the third image and generating image data P8. Then, the storage means stores the code E in the image data P1, P2 (4), P8.
And the image data P1, P2 (4) and P8 are stored in the memory 52 together with the code E.

When there are users 11 to 13 in front of the automatic cash processing machine 115, the CPU 51
Based on 2 (N), feature extraction of feature processing areas S0 to S8 is performed, and it is determined whether or not the extracted feature is feature level 1. When the extracted feature is the feature level 1, the CPU 51 stops the transaction processing, takes in the card 39, the passbook 79, and the like, and sets the CRT 2 with the touch panel.
The guidance display is performed on the display unit 1 to guide the users 11 to 13 to the counter of the financial institution. Then, the staff of the financial institution directly meets with the users 11 to 13 to confirm the identity of the users. continue,
The CPU 51 uses the camera with lens 117 to
Images are obtained by photographing the faces 14 and the hands 23 of 1 to 13 and the image data P1, P2 (1), P2
(2),..., P2 (N) and P7 are generated. continue,
The image data P1, P2 (1), P2
(2),..., P2 (N), P7, and a code B is added, and image data P1, P2 (1), P2 (2),.
(N), P7 is stored in the memory 52 together with the code B.

If the extracted feature is not at feature level 1, the CPU 51 determines that the extracted feature is at feature level 2
Is determined. When the extracted feature is feature level 2, as shown in FIG.
13 have their backs turned to the automatic cash processor 115, the CPU 51 informs the user 1 that the transaction processing has been completed.
An alarm is generated up to three times to notify 1 to 13. When the users 11 to 13 forgot to remove the card 39, the passbook 79, etc., or forgot the banknotes 44, coins 144, etc., despite generating the alarm in this way, the alarm was generated three times. At the stage, CPU5
1 cancels the transaction processing, takes in the card 39, the passbook 79, the banknote 44, the coin 144, etc.,
At T21, a character indicating that the transaction processing has been canceled is displayed. Subsequently, the CPU 51 uses the camera with lens 117 to control the faces 14 and the hands 2 of the users 11 to 13.
An image is obtained by photographing 3
After generating the image data 8, the image data P1,
A code E is added to P2 (4) and P8, and the image data P
1, P2 (4) and P8 are stored in the memory 52 together with the code E.

If the extracted feature is not the feature level 2, the CPU 51 executes a transaction process to execute the user 1
The card 39, the passbook 79, and the like are returned to 1 to 13, and when the transaction process is a withdrawal process, a predetermined amount of cash is dispensed to the bill slot 20 and the coin slot 120.

By the way, usually, the image data P2 (N)
27 is generated by an image in which the owner of the card 39, the passbook 79, or the like looks at a predetermined transaction port of the automatic teller machine 115 as shown in FIG. When N) is generated, the users 11 to 13 are in front of the automatic cash processor 115, and the extracted features are neither the feature level 1 nor the feature level 2. Therefore, the CPU 51 executes the transaction processing to provide the users 11 to 13 with the card 39 and the passbook 79.
If the transaction process is a withdrawal process, a predetermined amount of cash is dispensed to the bill slot 20 and the coin slot 120. Therefore, the card detection sensor 41 and the passbook detection sensor 14
The card 39, the passbook 79, etc. are detected by 1 or the like.

When the card detection sensor 41, the passbook detection sensor 141, and the like no longer detect the card 39, the passbook 79, and the like, the CPU 51 sets the card 39, the passbook 79, and the like.
It is determined that etc. have been extracted. Subsequently, the CPU 51
Face 1 of users 11 to 13 by camera 117 with lens
4 and the hand 23, etc., an image is acquired, and after generating image data P5, a code D is added to the image data P1, P5 by the storage means, and the image data P1,
P5 is stored in the memory 52 together with the code D.

When the card 39, the passbook 79, etc. are detected, the CPU 51 starts monitoring the operation end time.
The internal timer (not shown) starts counting time. When the time T exceeds a preset threshold value α, the CPU 51 obtains an image by photographing the faces 14 and the hands 23 of the users 11 to 13 with the lens-equipped camera 117, The image data P4 is generated, the second image processing is performed based on the image data P4 of the area a1, and the automatic cash processor 115 is generated based on the result of the image processing.
It is determined whether or not there are users 11 to 13 before. When there are no users 11 to 13 in front of the automatic cash processing machine 115, the CPU 51 cancels the transaction processing, takes in the card 39, the bankbook 79, the banknote 44, the coin 144, and the like. An image is obtained by photographing the face 14, the hand 23, and the like, and image data P9 is generated.
1, a code C is added to P4, P9, and the image data P1,
P4 and P9 are stored in the memory 52 together with the code C. In the present embodiment, the threshold α is set to about 30 [seconds].

The codes A to F indicate the photographing state of the image data stored in the memory 52, that is, how the users 11 to 13 use the automatic cash processor 115 according to the operation. Therefore, image data can be searched based on the codes A to F.

Further, based on the number of image data to which the code B is added, it is possible to calculate the number of times the automatic cash processor 115 has been used illegally. Then, similar analysis can be performed based on the number of image data to which other codes are added. A similar analysis can be performed based on the data amount of the image data to which the same code is added. When storing the image data in the memory 52, predetermined additional information can be added to the forefront part or the last part of the image data. In the present embodiment, when the face 14 or the hand 23 is photographed as the additional information,
A sensor number, a photographing time, a transaction customer number, a transaction operation item, and the like are given.

Next, the flowchart will be described. Step S1 The power of the automatic teller machine (ATM) 115 and the imaging device 116 is turned on. Step S2: Set 1 to the value N. Step S3 The automatic cash processor 115 is set to the standby mode. Step S4: It is determined whether or not there is access to the transaction unit. Step S5 if there is access to the trading account
If not, the process returns to step S2. Step S5: An image is obtained (image data P1). Step S6 First image processing is performed. Step S7: It is determined whether the card 39, the passbook 79, etc. are displayed. When the card 39, the passbook 79, and the like are displayed, the process proceeds to step S9, and when not displayed, the process proceeds to step S8. Step S8: It is determined whether the card 39, the passbook 79 and the like have been detected. When the card 39, the passbook 79, and the like are detected, the process proceeds to step S9, and when not detected, the process returns to step S2. Step S9 Perform second image processing. Step S10 User 1 in front of the automatic cash processing machine 115
It is determined whether 1 to 13 are present. Users 11-13
If there is, go to step S16, otherwise go to step S11. Step S11: It is determined whether the card 39, the passbook 79 and the like are detected. When the card 39, the passbook 79 and the like are detected, the process proceeds to step S12, and when not detected, the process returns to step S2. Step S12 The card 39, the passbook 79 and the like are taken in. Step S13: An image is obtained (image data P10). Step S14: The users 11 to 13 are guided to the window. Step S15 The image data P1 and P10 are stored, and the process returns to step S2. Step S16: Start transaction processing. Step S17: Extract features. Step S18: It is determined whether or not the extracted feature is at feature level 1. If the feature level is 1, the process proceeds to step S19. If the feature level is not 1, the process proceeds to step S23.
Proceed to. Step S19: Stop the transaction processing. Step S20: The users 11 to 13 are guided to the window. Step S21: An image is obtained (image data P6). Step S22: The image data P1 and P6 are stored, and the process returns to step S2. Step S23: Terminate the transaction processing. Step S24: Acquire an image (image data P2 (N))
I do. Step S25: Perform second image processing. Step S26: User 1 before the automatic cash processing machine 115
It is determined whether 1 to 13 are present. Users 11-13
If there is, go to step S33, otherwise go to step S27. Step S27: It is determined whether or not the value N is 4.
If the value N is 4, the process proceeds to step S28; otherwise, the process proceeds to step S31. Step S28 Cancel the transaction processing. Step S29: An image is obtained (image data P8). Step S30: The image data P1, P2 (4), and P8 are stored, and the process returns to step S2. Step S31 Generate an alarm. Step S32: increment the value N, and
Return to 24. Step S33: It is determined whether or not the extracted feature is at feature level 1. If the feature level is 1, the process proceeds to step S34. If the feature level is not 1, the process proceeds to step S38.
Proceed to. Step S34: Stop the transaction processing. Step S35 The users 11 to 13 are guided to the window. Step S36: An image is obtained (image data P7). Step S37: Image data P1, P2 (1),..., P
2 (N) and P7 are stored, and the process returns to step S2. Step S38: It is determined whether or not the extracted feature is feature level 2. If the feature level is 2, the process returns to step S27. If the feature level is not 2, the process returns to step S27.
Proceed to 39. Step S39: Execute a transaction process. Step S40: It is determined whether the card 39, the passbook 79, etc. have been detected. When the card 39, the passbook 79 and the like are detected, the process proceeds to step S43, and when not detected, the process proceeds to step S41. Step S41: An image is obtained (image data P5). Step S42 The image data P1 and P5 are stored, and the process returns to step S2. Step S43: Monitoring of the operation end time is started. Step S44: Wait until the time T becomes longer than the threshold value α. Step S45: An image is obtained (image data P4). Step S46: Perform second image processing. Step S47: User 1 in front of the automatic cash processor 115
It is determined whether 1 to 13 are present. Users 11-13
If there is, the process returns to step S33; otherwise, the process proceeds to step S48. Step S48: Cancel the transaction processing. Step S49: To obtain an image (image data P9). Step S50 The image data P1, P4 and P9 are stored, and the process returns to step S2.

<Seventh Embodiment> By the way, in the above other embodiment, the photographing device optically connects the user's face and other parts of the user with one camera by one camera. Although the camera is configured to capture images so as to be combined with image data, two cameras capture the image of the user's face and other parts of the user, and these captured image data of the user are subjected to arithmetic processing. It is also possible to adopt a configuration in which it is combined with one image data.

Therefore, in the following, the user's face and other parts of the user are photographed by two cameras, and these photographed image data of the user are combined into one image data by arithmetic processing. The seventh embodiment will be described. In addition, about the thing which has the same structure as said another embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 34 is a side view of an automatic cash processing machine equipped with a monitoring device according to a seventh embodiment of the present invention.
FIG. 17 is a block diagram of a monitoring device according to a seventh embodiment of the present invention.

In the figure, 215 is an automatic cash processing machine, 2
16 is a monitoring device, 217 is a camera with a face photographing lens, 2
Reference numeral 18 denotes a camera with a lens for hand photographing, 231 denotes a lens unit as a condensing element, and 232 denotes a CCD as an imaging element.
The element 233 controls the CCD element 232 and generates a video signal based on the output of the CCD element 232. The CCD control circuit 234 performs image processing based on the video signal, and outputs image data. Image processing circuit as image data generating means for generating 235
Is a video signal line for transmitting a video signal from the CCD control circuit 233 to the image processing circuit 234, 241 is a lens unit as a light condensing element, 242 is a CCD element as an imaging element, and 243 is a control of the CCD element 242. With C
A CCD control circuit 245 serving as an imaging control unit for generating a video signal based on the output of the CD element 242 is a video signal line for transmitting a video signal from the CCD control circuit 243 to the image processing circuit 234.

In the photographing apparatus having the above configuration, the CPU 51
Are provided in a card detection sensor 41 provided in the card processing device 40, a hand detection sensor 46 provided in the bill slot 20, a touch panel sensor 49 provided in the CRT 21 with a touch panel, and a passbook processing device (not shown). It receives detection signals such as a card detection signal, a hand detection signal, a touch panel sensor signal, and a passbook detection signal from each sensor such as a passbook detection sensor. Then, the CPU 51 sends a photographing timing signal to the CCD control circuit 233 of the camera 217 with the lens for face photographing and the CCD control circuit 243 of the camera 218 with the lens for hand photographing via the photographing timing signal line 36. CCD control circuits 233 and 243 receiving the photographing timing signal
, According to this signal,
3 is performed. As a result, the faces 14 of the users 11 to 13
Is photographed by the camera 217 with the lens for face photographing, and the hand 23 is photographed by the camera 218 with the lens for hand photographing. The image data of the photographed face 14 is sent from the CCD control circuit 233 of the camera 217 with the lens for face photographing to the image processing circuit 234. The image data of the hand 23 taken is sent from the CCD control circuit 243 of the camera 218 with the hand-taking lens to the image processing circuit 234. The image processing circuit 234 performs a predetermined operation on the acquired image data of the face 14 and the hand 23, and processes the image data into, for example, the shape shown in FIG.

In the seventh embodiment having the above-described structure, the capacity of image data per transaction can be reduced as in the other embodiments. Data can be stored.

The present invention is not limited to the above embodiments, but can be variously modified based on the gist of the present invention, and they are not excluded from the scope of the present invention.

For example, according to the present invention, a clerk operation unit (touch panel) provided in the transaction processing device can be used as a reading unit and an image display device. Thereby, the monitor can check the image of the user at the time of occurrence of the trouble at the place where the transaction processing device is provided. Further, according to the present invention, biometric data such as an iris and a fingerprint may be obtained from a user, and may be stored in a storage unit in association with image data captured by a capturing device. In addition, photographing devices are not limited to automatic cash processors,
Vending machines, POS terminals (including cash registers)
And so on. The monitoring system of the present invention includes these.

[0152]

As described in detail above, the present invention provides
In an imaging apparatus, an imaging element having an imaging surface, and an imaging angle of view that divides an imaging angle of view corresponding to a plurality of imaging regions and forms an image of each imaging region on the imaging element The image processing apparatus further includes a dividing unit and an image data generating unit configured to generate image data of each of the parts to be imaged based on an output of the imaging element.

With such a configuration, according to the present invention, images of a plurality of imaging sites can be formed on the imaging plane of one imaging element. Can be taken simultaneously. Therefore, according to the present invention, it is not necessary to dispose a plurality of image pickup means to image each part to be imaged, so that the cost of the image pickup apparatus can be reduced and the image pickup apparatus can be downsized. Further, according to the present invention, since a plurality of imaging sites are captured in one image frame, image data can be reduced accordingly. Furthermore, the present invention displays image data of a part to be imaged photographed in a remote place as a monitor image on a monitor screen, and monitors the operation of a user of the transaction processing apparatus. There is no need to dispose a plurality of monitors to display the monitor images, and the monitor images of the respective photographed parts can be displayed on one monitor screen, so that an image processing device is not required.
Therefore, the present invention can reduce the cost of the photographing device.

Further, according to the present invention, the photographing angle-of-view dividing means can be configured so as to include two reflecting surfaces disposed relatively to each other with the optical path of the imaging element as a center.

In this case, since the photographing angle-of-view dividing means has two reflecting surfaces, it is possible to photograph each part to be photographed simultaneously. Therefore, when the transaction processing device is used improperly, it is possible to photograph the operation at hand of the user, the operation of the user accessing the transaction port, and the like, so that it is easy to use the transaction processing device improperly. Can be proven. Further, since it is not necessary to dispose a plurality of cameras such as a camera for the face 14 and a camera for the hand as the imaging means, it is possible not only to reduce the cost of the photographing apparatus but also to downsize the transaction processing apparatus. .

In addition, such a configuration can widen the field of view even when the distance between the imaging means and the user cannot be made large. Therefore, since it is not necessary to increase the angle of view of the lens, the monitor image does not become significantly distorted at the edge of the screen of the monitor device. As a result, each subject to be imaged can be easily recognized. Further, since it is not necessary to use an expensive super wide-angle lens, the cost of the photographing apparatus can be reduced.

[Brief description of the drawings]

FIG. 1 is a side view of an automatic cash processing machine equipped with a photographing device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of the photographing apparatus according to the first embodiment of the present invention.

FIG. 3 is a cross-sectional view of the photographing apparatus according to the first embodiment of the present invention.

FIG. 4 is a diagram illustrating an example of a monitor image according to the first embodiment of the present invention.

FIG. 5 is a sectional view of a photographing apparatus according to a second embodiment of the present invention.

FIG. 6 is a side view of a main part of an imaging device according to a third embodiment of the present invention.

FIG. 7 is a side view of an automatic cash processing machine equipped with a photographing device according to a third embodiment of the present invention.

FIG. 8 is a front view of an automatic cash processing machine equipped with a photographing device according to a third embodiment of the present invention.

FIG. 9 is a front view of a main part of an automatic cash processing machine equipped with an image capturing device according to a third embodiment of the present invention.

FIG. 10 is a block diagram of a photographing apparatus according to a third embodiment of the present invention.

FIG. 11 is a front view of a main part of an imaging device according to a third embodiment of the present invention.

FIG. 12 is a diagram illustrating a first example of a monitor image according to the third embodiment of the present invention.

FIG. 13 is a diagram illustrating a second example of a monitor image according to the third embodiment of the present invention.

FIG. 14 is a diagram illustrating a third example of a monitor image according to the third embodiment of the present invention.

FIG. 15 is a diagram illustrating a fourth example of a monitor image according to the third embodiment of the present invention.

FIG. 16 is a plan view of a center-fold mirror according to a fourth embodiment of the present invention.

FIG. 17 is a front view of a center-fold type mirror according to a fourth embodiment of the present invention.

FIG. 18 is a left side view of a center-fold mirror according to a fourth embodiment of the present invention.

FIG. 19 is an exploded perspective view of a center-fold mirror according to a fifth embodiment of the present invention.

FIG. 20 is a side view of a main part of an imaging device according to a fifth embodiment of the present invention.

21 is a sectional view taken along line AA of FIG.

FIG. 22 is a front view of a center-fold mirror according to a fifth embodiment of the present invention.

FIG. 23 is a diagram illustrating an area of a monitor image according to the fifth embodiment of the present invention.

FIG. 24 is an explanatory diagram of a feature processing area according to the sixth embodiment of the present invention.

FIG. 25 is a diagram illustrating a black-and-white image according to the sixth embodiment of the present invention.

FIG. 26 is a diagram illustrating a first example of a monitor image according to the sixth embodiment of the present invention.

FIG. 27 is a diagram illustrating a second example of the monitor image according to the sixth embodiment of the present invention.

FIG. 28 is a diagram illustrating a third example of a monitor image according to the sixth embodiment of the present invention.

FIG. 29 is a diagram illustrating a fourth example of a monitor image according to the sixth embodiment of the present invention.

FIG. 30 is a diagram illustrating a fifth example of a monitor image according to the sixth embodiment of the present invention.

FIG. 31 is a first flowchart showing the operation of the imaging device according to the sixth embodiment of the present invention.

FIG. 32 is a second flowchart illustrating the operation of the imaging device according to the sixth embodiment of the present invention.

FIG. 33 is a third flowchart illustrating the operation of the imaging device according to the sixth embodiment of the present invention.

FIG. 34 is a side view of an automatic cash processing machine equipped with a photographing device according to a seventh embodiment of the present invention.

FIG. 35 is a block diagram of a photographing apparatus according to a seventh embodiment of the present invention.

[Explanation of symbols]

14 face 18 mirror 18a tip 23 hand 32 CCD element 34 image processing circuit 52 memory 86 motor A, B, θ _{1 to} θ ₆ shooting angle of view SH1 optical axis

Continued on front page F-term (reference) 3E040 BA07 DA01 FL04 3E044 AA09 BA02 BA04 CA03 CA10 DA06 DD01 FB03 5C054 AA01 AA05 CA04 CC03 CH02 EA01 EA07 FC12 FE18 FF06 FF07 GA00 GA04 HA18 HA21 5L096 BA02 CA04 CA05 FA37 FA03 BB03 BB04 HH23 JJ64 KK54 KK58 LL03

Claims (15)

[Claims] 1. An imaging element having an imaging surface, and an imaging angle of view for dividing an imaging angle of view corresponding to a plurality of imaging regions and forming an image of each imaging region on the imaging element. An imaging apparatus comprising: a dividing unit; and an image data generating unit that generates image data of each of the imaging target parts based on an output of the imaging element. 2. The photographing apparatus according to claim 1, wherein the photographing angle-of-view dividing unit is a reflecting member disposed on an optical path of the image forming element. 3. The photographing apparatus according to claim 2, wherein the position of the tip of the reflecting member is made coincident with the optical axis located at the center of the photographing angle of view. 4. The photographing apparatus according to claim 1, further comprising a photographing angle-of-view changing unit that changes each photographing angle of view divided by the photographing angle-of-view dividing unit. 5. The photographing apparatus according to claim 1, further comprising storage means for storing image data generated by said image data generating means. 6. The photographing apparatus according to claim 1, wherein the photographing angle-of-view dividing unit includes two reflecting surfaces disposed relatively to each other around an optical path of the image forming element. 7. The photographing apparatus according to claim 6, wherein a frame is formed at a boundary between the reflection surfaces. 8. A feature extracting means for extracting a feature of an image based on the image data, and a transaction processing stopping means for analyzing a feature of the extracted image and stopping the transaction processing based on the analysis result. The photographing apparatus according to claim 1, wherein: 9. An image processing apparatus comprising: feature extracting means for extracting a feature of an image based on the image data; and storing means for storing the image data in a recording means together with a code corresponding to the feature of the extracted image. The photographing apparatus according to claim 1, wherein: 10. A transaction processing device, comprising: a photographing device for photographing a user of the transaction processing device; wherein the photographing device converts the photographed image data of the user into a transaction processing device A surveillance system which records on a recording means in correspondence with an operation. 11. The image processing apparatus according to claim 1, wherein the photographing device photographs a user's face and other parts of the user, combines the photographed image data of the user into one, and combines the photographed image data of the user with the transaction processing device. The monitoring system according to claim 10, wherein the recording is performed by a recording unit in association with the operation. 12. The monitoring system according to claim 11, wherein the other part is a hand. 13. The photographing apparatus according to claim 1, wherein one photographing device optically photographs a user's face and another part of the user so as to be combined into one image data. 12. The monitoring system according to item 11. 14. The photographing device photographs a user's face and other parts of the user with two cameras, and converts the photographed image data of the user into one image data by arithmetic processing. 12. The combination of claim 11,
A monitoring system according to claim 1. 15. The monitoring system according to claim 10, further comprising a reading unit for reading specific image data from the image data recorded in the recording unit based on a predetermined classification. system.