JP6473962B2 - Display processing apparatus and program - Google Patents

Description

  The present invention relates to a display processing apparatus and a program for executing various processes in response to an instruction operation for display contents on a display screen.

  2. Description of the Related Art Generally, a sales processing device such as an ECR (Electronic Cash Register) or a POS (Point of sale) terminal, or an ATM (automated teller machine) of a financial institution has an authentication function for confirming an operator. For example, Patent Document 1 describes a technique for releasing a drawer only when the identity of a person can be confirmed by fingerprint collation using a fingerprint sensor. Patent Document 2 describes a technique for controlling a POS terminal by photographing a face of the employee and performing face authentication when the employee starts work for operating the POS terminal. .

  Further, Patent Document 3 describes a technique that suppresses unauthorized operations by simply displaying a user's face image, without using the authentication function as described above. In the technique of Patent Document 3, in order to prevent unauthorized transactions by users other than the account opener, the user opens an account by displaying the account opener's face image (registered image) and the user's face image. The third party in the vicinity can check whether the person is an authorized person, and fraudulent transactions by users other than the account opener are suppressed.

JP-A-6-274759 JP 2005-293172 A JP 2009-110148 A

  However, in the technique of Patent Document 3, the purpose is to display a face image so that a third party around the user can confirm the user. Therefore, the photographed user's face image is displayed unconditionally. As a result, for the account opener (regular operator), discomfort and resistance increase due to the display of his / her face, and the possibility of complaints from the account opener increases. In particular, it becomes a big problem in terms of protecting personal information.

  An object of the present invention is to appropriately check fraud when there is a high possibility of fraud.

In order to solve the above-described problems, a display processing device according to the present invention is a display processing device that executes various processes in response to an instruction operation on display content on a display screen, and includes a specific process among the various processes. When an execution instruction operation is detected, an acquisition unit that acquires an image obtained by capturing the operator, and a display control unit that performs display control for displaying the captured image acquired by the acquisition unit together with display contents on the display screen. The identification processing is identification processing premised on personal authentication, and the personal authentication compares the acquired captured image with a pre-registered face image to perform personal authentication. Yes, when comparing the acquired photographed image and a pre-registered face image, a similar determination is made as to whether or not the tolerance is set wider in advance, the display control means, Forgiveness If the error is within the error but the error is greater than or equal to a predetermined value, the acquired captured image is displayed on the display screen. If the error is less than the predetermined value, the acquired captured image is displayed on the display screen. It is characterized by controlling so that it is not displayed .
A program according to the present invention is a program for controlling a computer of a display processing apparatus that executes various processes in response to an instruction operation for display contents on a display screen, and the computer is included in the various processes. When the execution instruction operation of the specific process is detected in the acquisition unit, an acquisition unit that acquires an image obtained by capturing the operator, and a display that performs display control for displaying the captured image acquired by the acquisition unit together with display contents on the display screen The identification process is a identification process on the premise of identity authentication, and the identity authentication performs identity authentication by comparing the acquired captured image with a pre-registered face image. When comparing the acquired photographed image with a pre-registered face image, it is similar whether or not the tolerance is set to be wider in advance. The display control means displays the acquired captured image on the display screen when the error is within the allowable error but the error is greater than or equal to a predetermined value, and when the error is less than the predetermined value. Controls to prevent the acquired photographed image from being displayed on the display screen.

  ADVANTAGE OF THE INVENTION According to this invention, when a possibility of being fraudulent is high, a fraudulent act can be checked appropriately and it becomes a thing with a high fraud prevention effect.

The block diagram for demonstrating the sales processing system containing the sales processing apparatus applied as a display processing apparatus. The block diagram which showed the basic component of the sales processing apparatus 1. FIG. (1) is a diagram showing display contents on the screen (touch screen) of the touch input display unit 13, and (2) is when an operation instructing execution of a specific process that is likely to be fraudulent is performed. The figure which illustrated the case where the image which image | photographed the operator according to the operation was displayed on the touch screen. The flowchart for demonstrating the characteristic operation | movement of 1st Embodiment started execution when it switches to goods registration mode. The flowchart following the operation | movement of FIG. (1), (2) is the figure which showed the example of a display of a touch screen. The block diagram which showed the basic component of ATM (automated teller machine) in 2nd Embodiment. The external view of ATM in 2nd Embodiment. The flowchart for demonstrating the characteristic operation | movement of ATM in 2nd Embodiment. 10 is a flowchart following the operation of FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
This embodiment is a case where the present invention is applied to a sales processing apparatus installed in a store as a display processing apparatus that executes various processes in response to an instruction operation on display contents on a display screen. FIG. 1 includes this sales processing apparatus. It is a block diagram for demonstrating a sales processing system.
The sales processing system is, for example, a nationwide wide-area communication system, and each sales processing device 1 installed in each store has a public line network (for example, a telephone line network, a wireless communication network, Internet 3) and a mobile terminal device 4 (for example, a smartphone) possessed by a guard in the store or the like, and connected via the public network 3. The sales processing system is not limited to the wide area communication system, but may be a local communication system built in a single store.

  When the sales processing device 1 performs a settlement process (accounting process) for each product purchased by the customer in the store, the sales processing device 1 executes a registration process for registering the sales data for each product, or registers one transaction. It is a portable tablet terminal that executes a tightening process (including a drawer open process) at the end, and is connected to the scanner device 5, the printer device 6, and the drawer device 7 via short-range wireless communication in the store. . The drawer device 7 stores cash, and is configured to control the opening and closing of the drawer with an electromagnet (not shown), for example, and operates to open the drawer in response to an open instruction signal from the sales processing device 1. In response to the close instruction signal from the sales processing device 1, the drawer is forcibly closed. The drawer device 7 transmits a close signal to the sales processing device 1 when the drawer is artificially closed.

FIG. 2 is a block diagram showing basic components of the sales processing device (tablet terminal) 1.
The CPU 11 that is the core of the sales processing device 1 is a central processing unit that controls the overall operation of the sales processing device 1 according to various programs in the storage unit 12. The storage unit 12 stores various programs and information. The storage unit 12 stores programs and various applications for realizing the present embodiment in accordance with the operation procedure illustrated in FIGS. 4 and 5. It has a work area for temporarily storing various information necessary for the operation of the sales processing device 1 (for example, time information obtained by a time measurement function, a flag, etc.). Connected to the CPU 11 as input / output peripheral devices are a touch input display unit 13, a key operation unit 14, a wide-area communication unit 15, a short-range wireless communication unit 16, a camera unit 17, and the like. Controls their behavior.

  The touch input display unit 13 includes a display panel and a touch panel (not shown). By placing the touch panel on the front surface of the high-definition display panel, various software keys (touch keys) are provided on the screen (touch screen). Although not shown, for example, a mode key for switching to various operation modes such as a product registration mode and a setting mode. In the product registration mode, a numeric key, a product-specific registration key, a withdrawal key, a deposit key (tightening) Keys) are allocated and arranged to display their function names, processing menus, and the like. A touch operation with a finger or the like is detected and data corresponding to the touch operation is input.

  The key operation unit 14 includes a push button type power key (not shown). The wide area communication unit 15 is communicatively connected to the public line network 3, and the short-range wireless communication unit 16 is connected to the scanner device 5, the printer device 6, and the like via a wireless LAN (Local Area Network) or Bluetooth (registered trademark) communication, for example. This is a communication interface for communication connection to the drawer device 7. The camera unit 17 is activated at the time of specific processing related to withdrawal (when the drawer is opened or withdrawn), and shoots mainly on the operator's face, and the CPU 11 captures the face image (shooting by the operator). Image) is displayed on the screen (touch screen) of the touch input display unit 13. The camera unit 17 is a digital camera that can capture not only still images but also moving images, and a still image or a moving image is displayed as a face image on the touch screen.

FIG. 3A is a diagram illustrating display contents on the screen (touch screen) of the touch input display unit 13.
That is, FIG. 3 (1) shows the display content displayed on the touch screen in the product registration mode for registering sales data for each product. This touch screen is a software key (touch key). It is a merchandise registration screen on which merchandise registration keys, subtotal keys, cash keys, correction keys, numeric keys, and the like for each merchandise A to H are displayed. A camera unit 17 is arranged in the upper center portion of the front surface (touch screen) of the touch input display unit 13 so that the face of the operator who operates can be photographed while viewing the display content of the touch screen. Note that the shooting parameters are set to a zoom angle that allows the entire face of the operator who is performing the touch operation while looking at the touch screen to be shot, and the entire face to be displayed on the screen. Has been.

In FIG. 3B, when an operation for instructing execution of a specific process having a high possibility of being fraudulent is performed, an image (face image) obtained by photographing the operator according to the operation is displayed on the touch screen. It is the figure which illustrated the case.
When the specific process (drawer open process in the first embodiment) is instructed by operating the cash key at the end of registration for one customer in the product registration mode, the CPU 11 performs this specific process (drawer open process). Is being executed, the camera unit 17 is controlled so as to photograph the operator. Then, the CPU 11 acquires the operator's face image captured by the camera unit 17 and displays the operator's face image along with the display contents (registration key, subtotal key, cash key, etc.) on the product registration screen. I try to let them. Note that the face image is displayed in a size that allows the operator to sufficiently recognize his / her face (for example, a business card size).

  The face image of the operator is displayed when the specific process (drawer open process) is executed under a predetermined condition. What is the “predetermined condition”? In the first embodiment, it means a predetermined time zone (for example, a late night or early morning time zone, a non-business time zone). That is, when the cash key that instructs execution of the drawer open process is operated in a predetermined condition (predetermined time period), the CPU 11 displays the operator's face image together with the operator's face image when executing the drawer open process. Is displayed on the touch screen (product registration screen). In the example shown in the figure, the face image and the message being recorded are displayed in the empty area on the product registration screen. However, display areas such as a registration key and a subtotal key that are not used while the drawer is open. The face image may be displayed superimposed on the face.

  Next, the operation concept of the sales processing apparatus (tablet terminal) 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium. 4 and 5 are flowcharts showing an outline of the operation of the characteristic part of the present embodiment in the overall operation of the sales processing apparatus 1. When the flow of FIG. 4 and FIG. Return to the main flow (not shown) of the overall operation.

4 and 5 are flowcharts for explaining characteristic operations of the first embodiment that are started when the product registration mode is switched.
First, when switched to the product registration mode, the CPU 11 displays a product registration screen as shown in FIG. 3A on the touch input display unit 13 (step A1 in FIG. 4). In this state, it is checked whether the product-specific registration key for instructing product registration has been touched (step A2), or whether an operation for instructing execution of the specific process (drawer open process) (cash key operation) has been performed. (Step A2).

  When the product-specific registration key is operated (YES in step A2), the processing (step A3) for registering the sales data of the product in the product-specific totalizer (not shown) in the storage unit 12 is performed. Return to A2. When a key other than the product-specific registration key and cash key (for example, subtotal key, correction key, etc.) is operated (NO in step A4), subtotal processing, correction processing, etc. are executed as processing corresponding to the operation ( After step A5), the process returns to step A2.

  Now, when an operation (cash key operation) instructing execution of the specific process (drawer open process) is performed (YES in step A4), the operator photographed by the camera unit 17 prior to the start of the specific process The captured image is acquired, the operator's image is analyzed from the captured image, and the image is difficult to recognize the operator (described later, but the operator seems to be intentionally hidden) If it is intentionally hidden, execution of the specific process is suppressed. In this case, control is performed so that the specific process is not executed.

  That is, in response to the operation of the cash key, the CPU 11 acquires a face image of the operator photographed by the camera unit 17 (step A6), and the photographed image is stored in an image memory (not shown) in the storage unit 12. An operation for recording and saving is started (step A7). Then, by analyzing this captured image, the appearance of the operator's face is discriminated (step A8), and it is checked whether the operator is intentionally hiding so as not to appear in the camera unit 17 (step A9). Here, in this embodiment, “intentionally hidden” means that the operator covers the lens portion of the camera unit 17 with a hand or the like when operating the cash key (for example, when the entire image is dark, In addition to the case where there is an obstruction in front of the camera), or a case where most of the face (for example, 3/4 or more) is outside the shooting range when the cash key is operated. It should be noted that even when the eyes, nose, and mouth are hidden by wearing a mask and sunglasses, it may be included in “intentionally hidden”.

  When it is determined that the operation is intentionally hidden in this manner (YES in step A9), it is checked whether the operation has continued for a predetermined time (for example, 5 seconds) (step A10). Now, when the intentional hiding operation continues for a predetermined time or longer (YES in step A10), it is determined that there is a possibility of an unauthorized person, and a message indicating that the specific process (drawer open process) is prohibited, It is displayed on the touch screen (product registration screen) together with the display contents (step A11). FIG. 6A shows a display example of this prohibition message, and is a case where the prohibition message is displayed on the touch screen (product registration screen) together with the display content (registration key, etc.). Thereafter, the process returns to step A2.

  On the other hand, if the operator is not intentionally hidden during the operation of the cash key, or if the operator does not continue for a predetermined time even if it is momentarily hidden (NO in step A9), step A12 in FIG. Then, the current time zone is determined based on the current time obtained by the time measuring function. Then, it is checked whether or not the current time when the cash key is operated is a predetermined time zone (for example, a late night or early morning time zone that is likely to be fraudulent, a non-business time zone) (step A13), If it is not the predetermined time zone (NO in step A13), a specific process (drawer open process) is executed, an open instruction signal is transmitted to the drawer device 7, and the drawer is opened (step A14). Thereafter, the process returns to step A2 in FIG. 4 on condition that a drawer close signal output from the drawer device 7 side is received when the drawer is artificially closed (step A15).

  If the cash key is operated within a predetermined time zone (YES in step A13), a photographed image (an operator's face image) is acquired and a touch screen (product) is displayed as shown in FIG. A captured image (an operator's face image) is displayed on the registration screen) together with the display content (step A16). In this case, a captured image (an operator's face image) is displayed in an empty area on the product registration screen. If the captured image is a moving image, an operation of displaying the captured image while sequentially acquiring the captured image is started. Then, a message indicating that the operator's face image is being recorded and saved is displayed on the product registration screen together with the photographed image (step A17). Thereafter, a specific process (drawer open process) is executed to open the drawer (step A18).

  Then, the process proceeds to step A19, where it is checked whether the drawer has been artificially closed, that is, whether the drawer close signal has been received from the drawer device 7 side. When the close signal is received (YES in step 19A), the step of FIG. Returning to A2, but if a drawer close signal is not received (NO in step A19), the process proceeds to the same process (steps A20 to A22) as in the above case (steps A8 to A10).

  That is, the operator's face image captured by the camera unit 17 is acquired to determine how the operator's face is reflected (step A20), and whether the operator is intentionally hidden (step A21). It is checked whether the hidden state continues for a predetermined time (for example, 2 seconds) or longer (step A22). Note that since steps A8 to A10 described above are processing before the drawer is opened, the duration of the hidden state is set to “5 seconds”, but this time steps A20 to A22 are being opened. Therefore, from the viewpoint of preventing fraud, the duration is set to “3 seconds”, which is shorter, but these may be set to the same time (for example, 3 seconds).

  Here, when the operator is not intentionally hidden, or when the operator is hidden momentarily, but does not continue for a predetermined time (NO in step A21), the process returns to step A2 in FIG. However, when the state where the operator is intentionally hiding continues for a predetermined time or longer (YES in step A22), in order to interrupt the specific process, a close instruction signal is transmitted to the drawer device 7, The drawer is forcibly closed (step A23). Then, as shown in FIG. 6B, a message indicating that the specific process (drawer open process) has been interrupted is displayed on the touch screen (product registration screen) (step A24).

  In addition to connecting to the portable terminal device 4 possessed by a guard in the store or the like, a message requesting confirmation of the unauthorized person is sent together with the photographed image of the operator, and a warning notification is shown as shown in FIG. A warning message (for example, a message indicating that a security request has been made or a message indicating that an alarm sound is generated) is displayed on the touch screen (product registration screen) (step A25). FIG. 6B shows the case where the operator's face image, interruption message, and warning message are displayed on the touch screen (product registration screen) together with the display contents. Then, it returns to step A2 of FIG. It should be noted that the specific process may be forcibly terminated at the time when this warning is given to enter a pause state.

  As described above, in the first embodiment, when the CPU 11 of the sales processing device 1 detects a specific process among various processes, the CPU 11 acquires a photographed image of the operator photographed by the camera unit 17 and uses the photographed image. Since it is displayed on the display screen of the touch input display unit 13 together with the display content, it is possible to inform the operator himself that the operator is photographed and to check fraud, and there is a possibility of being fraudulent. When it is high, fraudulent acts can be appropriately controlled, and the fraud prevention effect is high. In other words, the operator's photographed image is displayed at the same time as the display content for the specific processing, so that the operator can operate while looking at his / her own photographed image, and psychologically suppress unauthorized operations Also, instead of always displaying the photographed image of the operator, fraud can be appropriately prevented with the minimum necessary checks, and the resistance felt by the operator who is not the fraud Sensation) can be greatly reduced, and the operator who is not improper is also satisfied.

  The CPU 11 determines whether or not the specific process is executed under a predetermined condition, and displays a photographed image of the operator on the touch screen when the specific process is executed under the predetermined condition. Instead of unconditionally checking fraud at the time of processing, check fraud only during times when there is a high possibility of fraud (for example, late at night, early morning, off-business hours, etc.) Is possible.

  Since the CPU 11 controls the camera unit 17 so as to photograph the operator while the specific process is being performed, the CPU 11 can photograph the operator only when executing the specific process that is likely to be fraudulent. Thus, it is possible to perform control so that the operator is not photographed and displayed during various processes other than the specific process.

  Since the photographed image of the operator is displayed and a message indicating that the photographed image is recorded is displayed, it is possible to further increase the restraint against fraud.

  As a result of analyzing the operator's image appearance from the captured image prior to the start of the specific processing, the CPU 11 suppresses execution of the specific processing if the image is difficult to recognize the operator. Cheating can be prevented in advance.

  The CPU 11 performs control so as not to execute the specific processing if the image is incapable of recognizing the operator due to the intentional hiding operation by the operator. The person can recognize that the possibility of the unauthorized person is high and prohibit the specific processing, and can prevent the illegal action.

  When the execution of specific processing is suppressed, a message to that effect is output, so if the operator is not an unauthorized person, the posture is corrected so that the image is taken correctly, and the process immediately proceeds to execution of the specific processing. be able to.

  When a photographed image is displayed during the execution of specific processing, it is impossible to recognize the operator by intentionally hiding by the operator as a result of analyzing how the operator is reflected in the photographed image. If it is a reflection, the specific process is interrupted, so even if the specific process is being executed, the person who performs the intentional hiding action may be recognized as an unauthorized person and interrupt the specific process. And fraud can be prevented just before that.

  When the specific process is interrupted, a message to the effect that it will be interrupted is output, so if the operator is not an unauthorized person, it will immediately shift to the specific process execution by correcting the posture etc. It becomes possible.

  If the image is incapable of recognizing the operator due to the intentional hiding action by the operator, the photographed image is reported to the outside, or a warning message to notify the warning is output. As a result, emergency response such as a request from a guard can be made, and the checking power can be further increased.

  In the sales processing apparatus 1 that performs sales processing in cooperation with a cash drawer, the specific process that is executed in response to the instruction operation on the display content on the display screen is a drawer open process that opens the drawer and is illegal. It is possible to check fraud when opening a drawer with high possibility.

  The display screen is a touch screen that allows touch operation, and the operator's captured image is displayed on the touch screen, so the operator can also adjust his / her own captured image when operating while viewing the touch screen. As a result, it is possible to further increase the checking power against fraud.

  In the first embodiment described above, the cash key that instructs the execution of the specific process (drawer open process) is operated under a predetermined condition (for example, late-night or early morning hours, non-business hours). However, the predetermined condition is not limited to the time zone, and other conditions such as a predetermined day of the week, date / time, period, etc. where the store is crowded or manpower is insufficient, for example, are displayed. The cash stored in the drawer may be a predetermined amount (for example, 5,000 yen) or more, and both the time zone and the amount may be a predetermined condition.

  In 1st Embodiment mentioned above, although the case where a specific process was performed at the time of operation of a cash key was shown, the case where a specific process is performed at the time of operation of a payment key may be sufficient.

  In the first embodiment described above, if the captured image is difficult to recognize the operator, control is performed so that the specific process is not performed, but only a part of the specific process is executed. You may make it suppress.

  In the first embodiment, the specific process is interrupted, but the specific process may be stopped (locked).

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
The first embodiment described above exemplifies a case where the present invention is applied to a sales processing device (tablet terminal) as a display processing device that executes various processes in response to an instruction operation on display contents on a display screen. In 2 embodiment, it is a case where it applies to ATM (automatic teller machine) of the financial institution side which performs the specific process (cash payment process) on the assumption of identity authentication. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 7 is a block diagram showing basic components of an ATM (automated teller machine) 8.
The ATM 8 executes various processes in response to an instruction operation on the display contents on the display screen, and the CPU 81 as the core controls the overall operation of the ATM 8 according to various programs in the storage unit 82. The storage unit 82 stores various programs and information, and stores programs and various applications for realizing the present embodiment in accordance with the operation procedure illustrated in FIGS. 8 and 9. The CPU 81 is connected with a touch display unit 83, a camera unit 84, a card processing unit 85, a money input / output unit 86, a printing unit 87, and the like as input / output devices.

  The touch display unit 83 guides and displays transaction details to the user (operator) or inputs transaction information by a touch operation by the operator. The camera unit 84 is used by the user (operator). ), For example, and is arranged in the upper center portion of the touch screen. The card processing unit 85 is a card reader / writer for a cash card, an IC card, and the like, and the money input / output unit 86 is a money transfer unit that processes money deposit / withdrawal. The printing unit 87 prints a statement slip or prints on a passbook. Also in ATM8 comprised in this way, similarly to 1st Embodiment, if operation which instruct | indicates execution of a specific process is detected among various processes, the image which image | photographed the operator will be acquired, and on a display screen Is displayed together with the display contents. In this case, the specifying process of the second embodiment is a process (cash payment process) on the assumption of personal authentication.

FIG. 8 is an external view of ATM8.
The ATM 8 includes a lower unit 88 and an upper unit 89, and a touch display unit 83 is disposed on the upper surface of the lower unit 88. Furthermore, a banknote-dedicated banking / paying part 86 and a coin-dedicated banking / paying part 86 are provided. Is arranged. The front unit of the upper unit 89 is provided with a card processing unit 85 having a card entrance and a printing unit 87 having a passbook or single entry / exit port. A camera unit 84 is disposed in the center portion. The camera unit 84 operates in the touch display unit 83 or the face of the user (operator) who is inserting the card from the card processing unit 85 so that the shooting direction is diagonally upward. The user's face direction is set, and the entire face of the user (operator) is photographed at a predetermined size. The image photographed by the camera unit 84 is displayed on the screen (touch screen) of the touch display unit 83 together with the display contents as shown in the figure.

FIG. 9 and FIG. 10 are flowcharts showing an outline of the operation of the characterizing portion of the present embodiment, out of the entire operation of the ATM 8 that is started in response to power-on in the second embodiment.
First, the CPU 81 of the ATM 8 displays a transaction menu screen on the touch display unit 83 (step B1 in FIG. 9). In this state, it is checked whether or not the “cash payment” menu item has been selected (step B2), and when other menu items (eg, “payment”, “balance inquiry” menu items) are selected (step B2). NO), the process proceeds to the next step B3, and after performing, for example, a deposit process, a balance inquiry process, etc. as a process corresponding to the selection menu, the process returns to the above-described step B1.

  Now, when the “cash payment” menu item is selected (YES in step B2), the operator's face image captured by the camera unit 17 is acquired prior to the start of the specific process (cash payment process) ( In step B4), an operation of recording and saving the photographed image in an image memory (not shown) in the storage unit 12 is started (step B5). Then, by analyzing this captured image, the appearance of the operator's face is determined (step B6), and it is checked whether the operator is intentionally hidden so as not to appear in the camera unit 17 (step B7). If it is hidden (YES in step B7), it is checked whether or not the state continues for a predetermined time (for example, 5 seconds) (step B8). If the intentional hiding operation continues for a predetermined time or longer (YES in step B8), a message indicating that the possibility of an unauthorized person is high and prohibiting a specific process (cash payment process) is displayed on the touch screen. After displaying on the (transaction menu screen) (step B9), it returns to the above-mentioned step B1.

  On the other hand, if the operator is not intentionally hidden, or if the operator is hidden momentarily, but does not continue for a predetermined time (NO in step B7), the flow proceeds to the flow of FIG. Processing (first authentication processing) is performed (step B10), and encryption number authentication processing (second authentication processing) is performed for authenticating the user by another method different from the first authentication processing (step B11). . In this face authentication process, a photographed image (face image) acquired from the camera unit 17 is compared with a customer's face image registered in advance, and identity verification is performed based on the similarity determination. The permissible error is set to be wide (loose) in advance. In this way, the face authentication process can be said to be an auxiliary or secondary authentication process for the encryption number authentication process for verifying the password by setting the accuracy to be low. Overall, the accuracy of personal authentication is high.

  As a result of the first and second authentication processes, it is checked whether the identity is confirmed, that is, “authentication is OK” (step B12), and the identity can be confirmed by any one of face authentication and encryption number authentication. If not (NO in Step B12), a process of adding “1” to a counter (not shown) for counting the number of retries and updating the value (Step B13) is performed, and then the process returns to Step B10 described above. Further, even if “authentication is OK” as a result of face authentication and code number authentication, if the number of retries exceeds a limit value (for example, 4 times) (YES in step B14), specific processing (cash payment processing) is prohibited. However, when the number of retries becomes “authentication OK” before the limit value is exceeded (YES in step B12, NO in step B14), a specific process (cash payment process) is started. (Step B15). When the cash payment process is started, the display content on the touch screen is sequentially switched to a transaction screen that changes according to the progress of the process.

  And it is discriminate | determined whether a specific process (cash payment process) is performed on predetermined conditions (step B16-B18). Here, the predetermined condition is one of “error at face authentication”, “predetermined time zone”, and “transaction over a predetermined amount”. That is, as described above, since the tolerance for similarity determination is set to be wider (relaxed) in the face authentication process as described above, it is within the tolerance, but the error is greater than or equal to a predetermined value, or less than the predetermined value. Is checked (step B16). Furthermore, it is checked whether the transaction time is a predetermined time zone (for example, a dangerous time zone such as midnight or early morning) (step B17), or the transaction amount is a predetermined amount (for example, 100,000 yen) or more. (Step B18).

  Here, if the error is within an allowable error but the error is greater than or equal to a predetermined value (YES in step B16), or if the transaction time falls within a predetermined time zone (YES in step B17), or the transaction amount is greater than or equal to the predetermined amount In the case of (YES in Step B18), a photographed image (operator's face image) is acquired and the photographed image (operator's face image) is displayed on the touch screen (transaction screen) together with the display content ( Step B19). Further, a message indicating that the operator's face image is being recorded and stored is displayed on the touch screen (transaction screen) (step B20). Then, on the condition that the specific process being executed (cash payment process) is completed (step B21), the process returns to step B1 in FIG.

  As described above, in the second embodiment, when performing a specific process premised on personal authentication, the user authentication is performed by comparing a photographed image acquired for checking fraud and a pre-registered face image. Therefore, it is possible to authenticate the person using a captured image for fraud control.

  Since the authentication process using the face image and the authentication process using the password are performed as the premise of the specific process, the accuracy of the personal authentication can be improved as a whole.

  As a result of the similarity determination as to whether or not the error is within the tolerance set in advance (loose) as the authentication processing by the face image, if the error is within the tolerance but the error is equal to or larger than a predetermined value, Since the captured image is displayed and control is performed so that the captured image is not displayed when it is less than the predetermined value, even if the tolerance is widened (loosened) and the accuracy is set low, it is displayed by the operator's face display. It is possible to compensate, and it becomes possible to check unauthorized operations.

  In the second embodiment described above, when checking whether or not the specific process (cash payment process) is executed under a predetermined condition, as the predetermined condition, “error during face authentication”, “predetermined "Time zone" and "Transaction over a predetermined amount", but if the number of retries does not reach the limit value (for example, 4 times), but it is a predetermined value (2 times) or more, retry in that case The captured image may be displayed with the number of times as a predetermined condition.

  In 2nd Embodiment mentioned above, although the process (cash payment process) which presupposed identity authentication was illustrated as a specific process, if it is a transaction involving the withdrawal premised on identity authentication, it is not restricted to a cash payment process. .

  In the second embodiment described above, double authentication processing (authentication processing using a face image and authentication processing using a personal identification number) is performed as a premise of the specific processing. Authentication processing by means of authentication and authentication processing by means of fingerprints may be used.

  In the second embodiment described above, a case where the present invention is applied to an ATM (automated teller machine) 8 is illustrated, but even an authentication terminal or a PC (personal computer) that performs a specific process based on an authentication process is exemplified. Good. For example, it may be a PC that performs identity verification and performs credit payment processing, or a gate device that confirms the visitors and opens the entrance gate. In addition, it may be a mobile phone such as a PDA (personal portable information communication device) or a smartphone.

  In each embodiment described above, when an operation instructing execution of the specific process is detected in the seed process, the photographed image of the operator captured by the camera unit 17 is acquired. When actually starting, a photographed image of the operator may be acquired.

  In each of the embodiments described above, when various messages are output, in addition to the display message, a voice message may be output together, or only a voice message may be output.

  In the first embodiment described above, the built-in camera unit 17 (camera unit 84) is disposed in the upper center portion on the front surface of the touch screen, and in the second embodiment, the center portion is disposed on the front surface portion of the upper unit 89. However, the disposition position is arbitrary, and further, a camera device separate from the sales processing device 1 (ATM8) is disposed in front of the operator, and this separate camera device is sold. You may make it image | photograph an operator's face by carrying out remote control from the processing apparatus 1 (ATM8).

  In each embodiment described above, the touch screen is exemplified as the display screen. However, the display screen is not limited to the touch screen, and may be, for example, a display screen adjacent to a push button type key operation unit. Even when the key operation unit and the display screen are adjacent to each other in this way, the operator performs the key operation while viewing the display content on the display screen, so that his / her own face image is displayed. I can confirm that. Further, the display content on the display screen may be a processing menu, various kinds of guidance, and the like.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
A display processing device that executes various processes in response to an instruction operation on display content on a display screen,
Detection means for detecting a specific process among the various processes;
An acquisition unit that acquires an image of the operator when a specific process is detected by the detection unit;
Display control means for performing display control for displaying the captured image acquired by the acquisition means together with display content on the display screen;
Characterized by comprising,
(Claim 2)
The invention according to claim 2 is the display processing device according to claim 1,
The display control means determines whether the specific process is executed under a predetermined condition, and displays the acquired captured image on the display screen when the specific process is executed under a predetermined condition.
It is characterized by that.
(Claim 3)
The invention according to claim 3 is the display processing device according to claim 1 or 2,
Prior to the start of the specific process, an analysis means for analyzing how the operator is reflected in the captured image;
As a result of the analysis by the analysis means, if it is difficult to recognize the operator, the process suppression means for suppressing the execution of the specific process,
Further comprising
It is characterized by that.
(Claim 4)
According to a fourth aspect of the present invention, in the display processing device according to the third aspect,
The processing suppression means, as a result of the analysis by the analysis means, if the image is incapable of recognizing the operator by an intentional hiding operation by the operator, it controls so as not to execute the specific process,
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the display processing apparatus according to claim 1 or 2,
An analysis means for analyzing a state of reflection of an operator in the captured image when the captured image is displayed on the display screen during execution of the specific process;
As a result of the analysis by the analysis means, if it is impossible to recognize the operator by intentional hiding motion by the operator, the process interruption means for interrupting the specific process,
Further comprising
It is characterized by that.
(Claim 6)
The invention according to claim 6 is the display processing device according to claim 8,
The processing interruption means, if the image is impossible to recognize the operator due to the intentional hiding operation by the operator, the photographed image is reported to the outside, or a warning message to notify the warning is issued. Output,
It is characterized by that.
(Claim 7)
The invention according to claim 7 is the display processing device according to any one of claims 1 to 6,
The identification processing is identification processing premised on personal authentication, and performs personal authentication by comparing the acquired captured image with a pre-registered face image.
It is characterized by that.
(Claim 8)
The invention according to claim 8 is the display processing apparatus according to claim 7,
The identification processing is identification processing premised on personal authentication, and includes first authentication processing for performing personal authentication by comparing the acquired captured image with a pre-registered face image, and the first authentication. A second authentication process for authenticating the user by another method different from the process,
It is characterized by that.
(Claim 9)
The invention according to claim 9 is the display processing device according to claim 7 or 8,
In the process of the personal authentication, when comparing the acquired captured image with a pre-registered face image, a similarity determination is made as to whether or not the tolerance is set to be wider in advance.
The display control means displays the acquired captured image on the display screen when the error is within the allowable error but the error is greater than or equal to a predetermined value, and acquires the acquired image when the error is less than the predetermined value. Control not to display the captured image on the display screen,
It is characterized by that.
(Claim 10)
The invention according to claim 10 is the display processing device according to any one of claims 1 to 9,
The processing device is a display processing device with a sales processing function that performs sales processing in cooperation with a cash drawer.
The specific process to be executed in response to an instruction operation on the display content on the display screen is a drawer open process for opening the drawer.
It is characterized by that.
(Claim 11)
The invention according to claim 11 is the display processing device according to any one of claims 1 to 10,
The display screen is a touch screen capable of touch operation, or a display screen adjacent to the operation unit,
The processing device performs various processes according to touch operations on the display content on the display screen, or performs various processes according to operations on an operation unit adjacent to the display screen.
It is characterized by that.
(Claim 12)
The invention according to claim 12
A program for controlling a computer of a display processing device that executes various processes in response to an instruction operation for display contents on a display screen,
The computer,
Detection means for detecting a specific process among the various processes;
An acquisition unit that acquires an image of the operator when a specific process is detected by the detection unit;
Display control means for performing display control for displaying the captured image acquired by the acquisition means together with display content on the display screen;
Program to function as.

1 Sales processing device 3 Public line network 4 Mobile terminal device possessed by security guard 8 ATM
11, 81 CPU
12, 82 Storage unit 13, 83 Touch input display unit 17, 84 Camera unit

Claims (5)

A display processing device that executes various processes in response to an instruction operation on display content on a display screen,
An acquisition means for acquiring an image obtained by photographing an operator when an execution instruction operation of a specific process is detected in the various processes;
Display control means for performing display control for displaying the captured image acquired by the acquisition means together with display content on the display screen;
With
The specific process is a specific process based on identity authentication,
The personal authentication is to perform personal authentication by comparing the acquired photographed image with a pre-registered face image, and when comparing the acquired photographed image with a pre-registered face image. Makes a similar determination as to whether it is within the tolerance set in advance,
The display control means displays the acquired captured image on the display screen when the error is within the allowable error but the error is greater than or equal to a predetermined value, and acquires the acquired image when the error is less than the predetermined value. Control not to display the captured image on the display screen,
A display processing device. The display control means determines whether the operation is an execution instruction operation for the specific process under a predetermined condition. When the operation is an execution instruction operation under a predetermined condition, the acquired captured image is displayed on the display screen. Displayed on the
The display processing apparatus according to claim 1. The processing device is a display processing device with a sales processing function that performs sales processing in cooperation with a cash drawer.
The specific process is a drawer open process for opening the drawer.
The display processing apparatus according to claim 1, wherein the display processing apparatus is a display processing apparatus. The display screen is a touch screen capable of touch operation, or a display screen adjacent to the operation unit,
The processing device performs various processes according to touch operations on the display content on the display screen, or performs various processes according to operations on an operation unit adjacent to the display screen.
The display processing apparatus according to claim 1 , wherein the display processing apparatus is a display processing apparatus. A program for controlling a computer of a display processing device that executes various processes in response to an instruction operation for display contents on a display screen,
The computer,
An acquisition means for acquiring an image obtained by photographing an operator when an execution instruction operation of a specific process is detected in the various processes;
Display control means for performing display control for displaying the captured image acquired by the acquisition means together with display contents on the display screen;
Function as
The specific process is a specific process based on identity authentication,
The personal authentication is to perform personal authentication by comparing the acquired photographed image with a pre-registered face image, and when comparing the acquired photographed image with a pre-registered face image. Makes a similar determination as to whether it is within the tolerance set in advance,
The display control means displays the acquired captured image on the display screen when the error is within the allowable error but the error is greater than or equal to a predetermined value, and acquires the acquired image when the error is less than the predetermined value. Control not to display the captured image on the display screen,
A program characterized by that.

Images