KR102300391B1 - Apparatus and method for user deviation/change detection of smart automated teller machine using facial recognition - Google Patents

Abstract

Using facial recognition technology in a Smart Automated Teller Machine (hereinafter referred to as "STM"), the user's departure and change are accurately detected, and the logout is controlled based on the user's departure and change information to protect personal information. It relates to a device and method for detecting user departure/change of a smart financial automatic device using facial recognition to prevent leakage and improve security, wherein when a financial transaction starts in the financial business control unit built in the smart financial automatic device, the user leaves/changes It interlocks with the judgment unit to request facial recognition monitoring, executes a facial recognition solution when the user departure/change judgment unit requests facial recognition monitoring, and generates a user departure/change detection event when user departure/change is detected to perform financial business It is transmitted to the control unit, and when a user departure/change detection event is received during a financial transaction from the financial business control unit, security is strengthened by selectively controlling logout according to departure or change to protect personal information.

Description

Apparatus and method for user deviation/change detection of smart automated teller machine using facial recognition}

The present invention accurately detects user departure and change using facial recognition technology in a smart automated teller machine (STM), and controls logout based on user departure and change information. It relates to a user departure/change detection device and method of a smart financial automatic device using facial recognition to prevent leakage of personal information and improve security.

According to Digital Transformation, the window business performed only through face-to-face window business and automated financial device business (account transfer, withdrawal, deposit, bankbook arrangement, etc.) is losing Here, the required authentication means for non-face-to-face real-name verification is to verify at least two of the following: submission of a copy of ID card, video call, confirmation when delivering access media (real transaction confirmation), account use (designated account transfer), and bio-verification. Confirm.

Recently, in the financial market, smart financial automation machine (STM) that can work at the window and automatic machine (ATM) is spreading according to digital transformation.

Conventionally proposed techniques for automated financial devices are disclosed in <Patent Document 1> to <Patent Document 3>.

In the prior art disclosed in <Patent Document 1>, a main body having a media deposit/withdrawal unit for depositing/withdrawing media, a display unit provided in the main body, and a display unit for selectively displaying a repair selection unit for activating a repair service function, a repair service and a storage box in which goods for receiving support are stored, a communication unit communicatively connected to a service terminal for supporting a repair service with respect to the stored goods, and a control unit for opening the storage box when the repair selection unit is selected on the display unit. When it is confirmed that the goods are stored in the storage box, the control unit transmits storage information on the goods to the service terminal. Through this configuration, it is possible to perform a repair service function in addition to the financial transaction service in the automated financial device.

In addition, the prior art disclosed in <Patent Document 2> includes the steps of receiving and storing check card application information including customer information in a temporary database, receiving check card application information from a customer terminal, and responding to the check card application information Displaying a check card application page for applying for a check card on the screen, when the customer's account number and password are input through the check card application page, generating a check card application form based on the customer information, account number and password and when a signature is entered in the check card application, after completing the application for the check card based on the check card application, transmitting an issuance command of the check card to the automated financial device. Through this configuration, a check card is issued using an automated financial device.

In addition, in the prior art disclosed in <Patent Document 3>, when a user who has the right to use the device in a computer device cannot detect the user's face from the image acquired by the camera while using the device, the user's face can be detected through voice and screen display. It gives a warning and automatically locks the computer if a user is not detected within a set time to prevent others other than the user from using the computer, thereby improving security.

Republic of Korea Patent Publication 10-2019-0020358 (published on March 4, 2019) (Financial devices, control methods of financial devices and financial systems) Republic of Korea Patent Publication No. 10-2014-0000509 (published on Jan. 3, 2014) (Method and system for issuing check cards using automated financial devices) Japanese Patent Registration No. 4699139 (Registered on March 11, 2011) (Security System)

However, with the general smart financial automation devices mentioned above and the financial automation devices mentioned in the patent literature, repair services or check card applications can be made through the window in addition to the normal financial automation business. There is a risk of information exposure, but there is a disadvantage in that it is insufficient to protect such personal information.

In particular, if the user's information is not input within the specified time during use, the general smart financial automation device is a method that starts again from the beginning due to a short timeout. The downside is that you have to spend a lot of time on it.

In addition, general smart financial automation devices frequently require authentication for tasks such as window tasks.

In addition, the prior art disclosed in <Patent Document 3> can automatically lock the computer according to the departure of the user during the transaction, but there is a disadvantage in that it cannot respond to a user change during use and leaks personal information as it is.

Therefore, the present invention has been proposed to solve the problems that occur in general smart financial automatic devices and prior art as described above, and facial recognition technology in smart automated teller machines (hereinafter referred to as "STM"). Using facial recognition to accurately detect user departure and change, and to control logout based on user departure and change information to prevent leakage of personal information and improve security. An object of the present invention is to provide a change detection device and method.

In order to achieve the above object, the device for detecting user departure/change of a smart financial automatic device according to the present invention includes: a camera unit for photographing an image for user recognition when a financial transaction is started according to a user's transaction request; a user recognition unit for recognizing a user's face image taken by the camera unit; a user departure/change determination unit for storing the user image recognized by the user recognition unit, and determining departure/change of the user during a transaction; When a departure or change is detected by the user departure/change determination unit during a transaction, it automatically controls logout, and it characterized in that it comprises a financial business control unit for integrated control of tasks requiring authentication and financial automation tasks.

In addition, the user departure/change detection device of the smart financial automation device according to the present invention transmits a voice for a transaction, and when a user leaves during a transaction, a departure announcement is broadcast for maintaining transaction continuity under the control of the financial business control unit. It characterized in that it further comprises a voice transmission unit.

In the above, the camera unit is characterized in that it includes a face recognition camera for photographing the user's face for user departure and change and additional authentication.

In the above, the user departure/change determination unit registers a user image using a facial recognition solution when a financial transaction starts under the control of the financial business control unit, and continuously analyzes the user image until the financial transaction is terminated to change the user's departure and change. and, when user departure or change is detected, a detection event for user departure or change is transmitted to the financial business control unit.

In the above, when a user departure event occurs from the user departure/change determination unit during a financial transaction, the financial business control unit controls the announcement about user departure, and if the user does not return within a preset time, automatically to protect personal information It is characterized by logging out and switching to the initial screen.

In the above, when a user change event occurs from the user departure/change determination unit during a financial transaction, the financial business control unit automatically logs out immediately and switches to the initial screen to protect personal information.

In the above, when additional authentication is required during the financial transaction, the financial business control unit interlocks with the user departure/change determination unit and considers that additional authentication has been made without performing additional authentication if a user departure/change event does not occur during the financial transaction characterized in that

In order to achieve the above object, the method for detecting user departure/change of a smart financial automation device according to the present invention includes (a) a user departure/change determination unit when a financial transaction starts in the financial business control unit built in the smart financial automation device requesting facial recognition monitoring in conjunction with; (b) executing a face recognition solution when a face recognition monitoring is requested from the user departure/change determination unit, and generating a user departure/change detection event when a user departure/change is detected and transmitting it to the financial business control unit; (c) when a user departure/change detection event is received during a financial transaction from the financial business control unit, selectively controlling logout according to the departure or change to protect personal information.

In the above (b) step (b1) executing the face recognition solution, and acquiring the camera control rights; (b2) registering a user image acquired through a user recognition unit; (b3) monitoring the departure or change of the user by comparing the image acquired through the user recognition unit with the registered user image in real time; (b4) generating a user departure/change detection event when the departure or change of the user is detected in step (b3); (b5) when the termination of facial recognition monitoring occurs from the financial business control unit, terminating the facial recognition solution and returning the camera control right.

In step (c), (c1) when a user departure/change detection event is received during a financial transaction from the financial business control unit, it is checked whether the received event is a user departure detection event, and if it is a user departure detection event, transaction continuity is maintained. sending a return guidance voice to (c2) Check the lapse of time after the return guidance voice is transmitted, and if the user departure detection event does not occur within the set time, automatically log out and switch to the initial screen to protect personal information, and at the same time It characterized in that it comprises the step of transmitting a face recognition monitoring end signal to the change determining unit.

In step (c), (c3) when a user departure/change detection event is received during a financial transaction from the financial business control unit, it is checked whether the received event is a user change detection event, and if it is a user change detection event, it is automatically logged It characterized in that it further comprises the step of protecting personal information by controlling the out.

In addition, in the method for detecting user departure/change of a smart financial automatic device according to the present invention, (d) when additional authentication occurs while performing a financial transaction in the financial business control unit, the financial transaction control unit interworks with the user departure/change determination unit to provide financial services. The method further includes the step of considering that additional authentication is performed without performing additional authentication if no user departure/change event occurs during the transaction.

According to the present invention, there is an effect that a user's departure/change is detected during a transaction using facial recognition technology in a smart financial automatic device, and when a user leaves/changes, the user automatically logs out to prevent exposure of the user's personal information.

In addition, according to the present invention, when a transaction related to the window business characteristic is continuously carried out, the user's departure/change detection information is used in the additional authentication procedure to replace the additional additional authentication, so that the user can be more quickly due to the omission of the additional authentication procedure. and facilitates convenient financial transactions.

1 is a schematic configuration diagram of a user departure/change detection device of a smart financial automatic device using facial recognition according to the present invention;
2 is a block diagram showing an embodiment of a device for detecting user departure/change of a smart financial automatic device using facial recognition according to the present invention;
3 is a flowchart illustrating a user departure/change detection method of a smart financial automatic device using facial recognition according to the present invention.

Hereinafter, an apparatus and method for detecting user departure/change of a smart financial automatic device using facial recognition according to a preferred embodiment of the present invention will be described in detail.

The terms or words used in the present invention described below should not be construed as being limited to conventional or dictionary meanings, and the inventor may appropriately define the concept of terms in order to best describe his invention. It should be interpreted as meaning and concept consistent with the technical idea of the present invention based on the principle that there is.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are only preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, so various equivalents and It should be understood that there may be variations.

<Example 1>

1 is a schematic configuration diagram of a user departure/change detection device of an automated smart financial device using facial recognition according to a preferred embodiment of the present invention, and FIG. 2 is a user departure/change detection device of an automated smart financial device using facial recognition is a block diagram of

The user departure/change detection device of a smart financial automation device (STM) using facial recognition according to the present invention has a built-in camera for facial recognition, etc. A main body 120 in which various devices are embedded is provided, and the main body 120 is provided with a user sensing unit 101 for detecting a user's approach.

Here, the tasks that require authentication include account opening and biometric information authentication tasks, and financial automation tasks include transaction tasks such as cash deposits and withdrawals and account transfers.

Such a user detection unit 101 may use a proximity sensor to detect that the user approaches the main body 120 of the smart financial automation device 100, and other known proximity sensors that can detect user access Various detection sensors may be used.

The main body 120 is provided with a camera unit 102 that captures an image for image consultation or user face recognition. Here, the camera unit 101 is provided with a video consultation camera 1021a for acquiring a photographed image for video consultation, and a face recognition camera 102b for acquiring a facial image for recognizing a user's face.

In addition, in the main body 120, the user recognition unit 103 for recognizing the user's facial association photographed by the camera unit 102, the user image recognized by the user recognition unit 103 is registered, and the user during the transaction When a departure or change is detected by the user departure/change determination unit 111, which determines the departure/change of A financial business control unit 105 is provided to strengthen security by preventing the transaction, and to control the window business and financial automation business, which are tasks that require authentication.

In addition, the voice transmission unit 106 transmits a voice for the transaction, and when the user leaves during the transaction, the voice transmitter 106 that makes a departure announcement for maintaining transaction continuity under the control of the financial business control unit 105, and the user's operation information A customer operation unit 104 that transmits to the financial business control unit 105 is provided. The customer manipulation unit 104 performs information display and customer information input using a single touch display.

In addition, the main body 120 includes a voice memory 108 having a built-in voice or control program to be provided to the user, an ID recognition unit 109 for recognizing an ID presented by the user, and a biometric recognition unit for recognizing the user's biometric information. (110), a speaker 107 for transmitting a guide voice signal to the outside is provided.

In addition, the main body 120 includes a function for recognizing information (passbook, etc.) necessary for a window business or financial business in a normal smart financial automatic device, or for organizing a bankbook.

The operation of the user departure/change detection device of the smart financial automation device (STM) using facial recognition according to the present invention configured as described above will be described in detail as follows.

First, when the user approaches the main body 120 within a certain distance while the smart financial automation device 100 is waiting for user detection, the proximity sensor of the user detection unit 101 detects it, and An event (user detection signal) is generated and transmitted to the financial business control unit 105 .

When an event for user detection occurs, the financial business control unit 105 switches from the standby mode to the financial business mode, and transmits a pre-registered basic customer guidance voice through the voice transmitter 106 .

Thereafter, when the user selects a specific financial transaction, it controls to monitor the user's facial recognition in conjunction with the user departure/change determination unit 111, and at the same time starts the financial transaction selected by the user.

The user departure/change determination unit 111 receives a user image generated from the user recognition unit 103 when a user face recognition monitoring request, that is, a monitoring request for user departure/change, occurs from the financial business control unit 105 . Acquire and save Here, the facial recognition camera 102b of the camera unit 102 is activated when a financial transaction is started to photograph the user's face. The face recognition camera 102b transmits the captured user's face image to the user recognition unit 103 . Here, the face recognition camera 102b is preferably installed in a position where both the faces of the disabled or normal persons using a wheelchair can be photographed.

The user recognition unit 103 pre-processes the facial image transmitted by the facial recognition camera 102b, and provides only a basic facial image image to the user departure/change determination unit 111 through the financial business control unit 105 .

The user departure/change determination unit 111 executes a facial recognition solution when a facial recognition monitoring is requested under the control of the financial business control unit 105, acquires the camera control right, and then analyzes the transmitted user's face image. The largest face image is extracted and registered as a user image. Here, extracting a face image from an image is a commonly known image processing algorithm that extracts and recognizes an image image, such as extracting and recognizing facial features by separating the eyes, nose, mouth and chin from the face image obtained through outline extraction and outline extraction. Available. When a plurality of user's face images are recognized during image analysis, the recognition of the plurality of user's face images is notified through the financial business control unit 105 .

When the financial business control unit 105 recognizes that a plurality of user face images are recognized when recognizing a facial image, a plurality of face images are recognized through the customer manipulation unit 104, so that only one person who makes an actual financial transaction remains. send out Afterwards, a timer is activated and financial transactions are continued if only one face image remains within a set time (eg, 5 seconds). On the other hand, if multiple face images are detected even after the set time has elapsed, it is automatically to forcibly log out to return to the initial screen, and provide transaction termination information to the user departure/change determination unit 111 . When the transaction termination information is provided, the user departure/change determination unit 111 terminates the facial recognition solution and returns the camera control right.

On the other hand, if only one person's face image remains within the set time, the user departure/change determination unit 111 registers the corresponding face image as the user image and starts monitoring the user's face recognition.

The user departure/change determination unit 111 registers the user image recognized through the facial recognition solution, and monitors the user's departure and change by analyzing the user image continuously acquired until the financial transaction is completed. When registering a user image, it can be registered by giving an ID. Here, as a method of monitoring user departure and change, a face image is extracted from an image obtained from the face recognition camera 102b in real time, and the user change is monitored through a face tracking technology that compares it with a registered user image to check the match. do. In addition, through image analysis obtained from the face recognition camera 102b, if a face image is not recognized or only an image other than the face is recognized, it is determined that the user has departed, and the face image recognized through the face tracking technology is registered If it is different from the face image, it is determined that the user has changed. And when user departure or change is detected, a detection event for user departure or change is transmitted to the financial business control unit 105 .

When a user departure or change detection event occurs from the user departure/change determination unit 111 during a financial transaction, the financial business control unit 105 checks whether the generated event is a user departure event. Here, by giving different IDs to the user departure event and the user change event, it is possible to easily determine whether the user exits or the user changes in the financial business control unit 105 .

As a result of analyzing the event information, if the financial operation control unit 105 is a user departure detection event signal, a notification broadcast about user departure through the voice transmitter 106 (eg, move to a designated seat when a financial transaction is desired) announcement) to recommend During actual financial transactions, users may drop their belongings or make phone calls. In this case, if you log out immediately, the user has the inconvenience of having to proceed with the financial business again from the beginning. In order to improve this inconvenience, a timer is activated when a user departure detection event occurs, and if the user returns within a preset time (for example, 10 seconds), the current financial transaction is maintained so that the user can start a financial transaction from the beginning. It relieves the discomfort of starting over. On the other hand, if the user does not return within a preset time, it automatically logs out and switches to the initial screen to protect personal information, thereby preventing personal information leakage and enhancing security.

On the other hand, when a user change event occurs from the user departure/change determination unit 111 during a financial transaction, the financial business control unit 105 automatically logs out immediately and switches to the initial screen to protect personal information. Prevent information leakage and strengthen security.

On the other hand, as another feature of the present invention, when additional authentication is required during a financial transaction, the financial business control unit 105 interworks with the user departure/change determination unit 111 so that a user departure/change event does not occur during the financial transaction. Additional authentication is deemed to have been made without performing additional authentication. That is, for financial transactions such as the window business that requires authentication, additional authentication is performed during the financial transaction to enhance security. In this case, additional authentication is made through authentication of other organizations or verification of personal information. Therefore, the user has to perform an inconvenient operation for additional authentication during the financial transaction. This causes time-consuming financial transaction time, causing inconvenience to users, and consequently delaying financial transaction time due to additional authentication time.

Therefore, in the present invention, if an event such as departure or change of a user does not occur during a financial transaction, a determination is made such as real name confirmation through actual face-to-face, and an additional authentication procedure is omitted, thereby shortening the overall financial transaction time, and additional authentication The user's inconvenience caused by the procedure will be improved.

In addition, as another feature of the present invention, the financial operation control unit 105 replaces the authentication required for the conventional financial automation business through facial recognition.

<Example 2>

3 is a flowchart showing a user departure/change detection method of a smart financial automatic device according to the present invention. Steps (S101 - S103) of requesting face recognition monitoring in conjunction with (111), (b) when the face recognition monitoring is requested in the user departure/change determination unit 111, a face recognition solution is executed, and the user departs/changes When this is detected, a user departure/change detection event is generated and delivered to the financial business control unit 105 (S110), (c) When a user departure/change detection event is received during a financial transaction in the financial business control unit 105 , and selectively controlling logout according to departure or change to protect personal information (S104 - S109, S120).

The (b) step (S110) includes the steps of (b1) executing the face recognition solution, obtaining the camera control right (S111 - S112), (b2) registering the user image obtained through the user recognition unit 103 (S113), (b3) monitoring the departure or change of the user by comparing the image acquired through the user recognition unit 103 with the registered user image in real time (S114), (b4) in the step (b3) Steps (S115) of generating a user departure/change detection event when a user's departure or change is detected (S115), (b5) When the end of facial recognition monitoring occurs from the financial business control unit 105, the face recognition solution is terminated and the camera control right is returned and steps S116 to S117.

In step (c), (c1) when a user departure/change detection event is received in the middle of a financial transaction from the financial business control unit 105, it is checked whether the received event is a user departure detection event, and if it is a user departure detection event, transaction continuity Transmitting a return guidance voice for maintenance (S104 - S106), (c2) checking the lapse of time after sending the return guidance voice, and if the release of the user departure detection event does not occur within the set time, for the protection of personal information Steps (S107 - S109), (c3) of automatically logging out and switching to the initial screen, and transmitting a facial recognition monitoring end signal to the user departure/change determination unit (S107 - S109), (c3) the user during the financial transaction in the financial business control unit 105 When a departure/change detection event is received, it is checked whether the received event is a user change detection event, and if it is a user change detection event, it automatically controls logout immediately to protect personal information (S120).

In addition, although not shown in the drawing, in the method for detecting user departure/change of a smart financial automatic device according to the present invention, when additional authentication occurs while performing a financial transaction in the financial business control unit 105, the user departure/change determination is made The method further includes the step of considering that additional authentication is performed without performing additional authentication if no user departure/change event occurs during the financial transaction in conjunction with the unit 111 . This step may be added to the transaction progress step (S104) or may be added to the step (S109) for confirming the normal transaction termination.

A method for detecting user departure/change of a smart financial automation device (STM) using facial recognition according to the present invention configured as described above in detail is as follows.

First, when the user approaches the main body 120 within a certain distance while the smart financial automation device 100 is waiting for user detection, the proximity sensor of the user detection unit 101 detects it, and An event (user detection signal) is generated and transmitted to the financial business control unit 105 .

When an event for user detection occurs, the financial business control unit 105 switches from the standby mode to the financial business mode, and transmits a pre-registered basic customer guidance voice through the voice transmitter 106 .

Thereafter, when the user selects a specific financial transaction in step S101, in step S103, in conjunction with the user departure/change determination unit 111, the user's face recognition is controlled to be monitored, and at the same time, the user's selected financial transaction is started.

The user departure/change determination unit 111 is a user face recognition monitoring request from the financial business control unit 105 in step S110, that is, when a monitoring request for user departure/change occurs (facial recognition monitoring Async function call), the user The user image generated from the recognition unit 103 is acquired and stored. Here, the face recognition camera 102b of the camera unit 102 is activated when a financial transaction is started to photograph the user's face. The face recognition camera 102b transmits the captured user's face image to the user recognition unit 103 . Here, the face recognition camera 102b is preferably installed in a position where both the faces of the disabled or normal people using a wheelchair can be photographed. The user recognition unit 103 pre-processes the facial image transmitted by the facial recognition camera 102b, and provides only a basic facial image image to the user departure/change determination unit 111 through the financial business control unit 105 .

The user departure/change determination unit 111 executes the face recognition solution in step S111 when a face recognition monitoring is requested under the control of the financial business control unit 105, and after acquiring the camera control right in step S112, in step S113 The largest face image is extracted through analysis of the delivered user face image and registered as a user image. Here, extracting a face image from an image is a commonly known image processing algorithm that extracts and recognizes an image image, such as extracting and recognizing facial features by separating the eyes, nose, mouth and chin from the face image obtained through outline extraction and outline extraction. Available. When a plurality of user's face images are recognized during image analysis, the recognition of the plurality of user's face images is notified through the financial business control unit 105 .

When the financial business control unit 105 recognizes that a plurality of user face images are recognized when recognizing a facial image, a plurality of face images are recognized through the customer manipulation unit 104, so that only one person who makes an actual financial transaction remains. send out Afterwards, a timer is activated and financial transactions are continued if only one face image remains within a set time (eg, 5 seconds). On the other hand, if multiple face images are detected even after the set time has elapsed, it is automatically to forcibly log out to return to the initial screen, and provide transaction termination information to the user departure/change determination unit 111 . When the transaction termination information is provided, the user departure/change determination unit 111 terminates the facial recognition solution and returns the camera control right.

On the other hand, if only one person's face image remains within the set time, the user departure/change determination unit 111 registers the corresponding face image as the user image, and moves to step S114 to start monitoring the user's face recognition.

The user departure/change determination unit 111 registers the user image recognized through the facial recognition solution in step S115, and monitors the user departure and change by analyzing the user image continuously acquired until the financial transaction is completed. do. When registering a user image, it can be registered by giving an ID. Here, as a method of monitoring user departure and change, a face image is extracted from an image obtained from the face recognition camera 102b in real time, and the user change is monitored through a face tracking technology that compares it with a registered user image to confirm the degree of conformity. do. In addition, through image analysis obtained from the face recognition camera 102b, if a face image is not recognized or only an image other than the face is recognized, it is determined that the user has departed, and the face image recognized through the face tracking technology is registered If it is different from the face image, it is determined that the user has changed. And when user departure or change is detected, a detection event for user departure or change is transmitted to the financial business control unit 105 .

When a user departure or change detection event occurs from the user departure/change determination unit 111 during a financial transaction as in step S104, the financial business control unit 105 moves to step S105 and checks whether the generated event is a user departure event do. Here, by giving different IDs to the user departure event and the user change event, it is possible to easily determine whether the user exits or the user changes in the financial business control unit 105 .

As a result of analyzing the event information, if the financial business control unit 105 is a user departure detection event signal, it moves to step S106 and broadcasts information about user departure through the voice transmitter 106 (for example, if you want a financial transaction) In this case, an announcement recommending moving to a designated seat) is performed. During actual financial transactions, users may drop their belongings or make phone calls. In this case, if the user logs out immediately, the user has the inconvenience of having to proceed with the financial business from the beginning. In order to improve this inconvenience, a timer is operated when a user departure detection event occurs, and if the user returns within a preset time (eg, 10 seconds) as in steps S107 and S108, the current financial transaction is maintained. This eliminates the inconvenience of users starting financial transactions again from scratch. On the other hand, if the user does not return within the preset time, it moves to step S120 to automatically log out to protect personal information and switch to the initial screen to prevent personal information leakage, thereby enhancing security. In the case of automatically logging out, a financial transaction termination signal is also transmitted to the user departure/change determination unit 111 . When the user departure/change determination unit 111 receives the financial transaction termination signal, the facial recognition solution is terminated in step S116, and the camera control right is returned in step S117. Here, after sending out a guide message for the user departure event, if the user departure/change detection event is released as in step S107 before the set time elapses, the transaction proceeds.

On the other hand, when a user change event occurs from the user departure/change determination unit 111 during a financial transaction, the financial business control unit 105 moves to step S120 to automatically log out immediately and the initial screen to prevent leakage of personal information and enhance security. In the case of automatically logging out, a financial transaction termination signal is also transmitted to the user departure/change determination unit 111 . When the user departure/change determination unit 111 receives the financial transaction termination signal, the facial recognition solution is terminated in step S116, and the camera control right is returned in step S117.

On the other hand, as another feature of the present invention, when additional authentication is required during a financial transaction, the financial business control unit 105 interworks with the user departure/change determination unit 111 so that a user departure/change event does not occur during the financial transaction. Additional authentication is deemed to have been made without performing additional authentication. That is, for financial transactions such as window business, additional authentication is performed during financial transactions to enhance security. In this case, additional authentication is made through authentication of other organizations or verification of personal information. Therefore, the user has to perform an inconvenient operation for additional authentication during the financial transaction. This causes time-consuming financial transaction time, causing inconvenience to users, and consequently delaying financial transaction time due to additional authentication time.

Therefore, in the present invention, if an event such as departure or change of a user does not occur during a financial transaction, a determination is made such as real name confirmation through actual face-to-face, and an additional authentication procedure is omitted, thereby shortening the overall financial transaction time, and additional authentication The user's inconvenience caused by the procedure will be improved.

Although the invention made by the present inventor has been described in detail according to the above embodiment, the present invention is not limited to the above embodiment, and it is common knowledge in the art that various changes can be made without departing from the gist of the present invention. self-evident to those who have

100: smart financial automation device
101: user detection unit
102: camera unit
102a: video conference camera
102b: face recognition camera
103: user recognition unit
104: customer control panel
105: financial business control unit
106: voice transmitter
107: speaker
108: voice memory
109: ID recognition unit
110: bio-recognition unit
111: user departure / change decision unit
120: body

Claims (12)

a camera unit for capturing an image for user recognition when a financial transaction is started according to a user's transaction request;
a user recognition unit for recognizing the user's face image taken by the camera unit;
a user departure/change determination unit storing the user image recognized by the user recognition unit and determining departure/change of the user during a financial transaction; and
When a departure or change is detected by the user departure/change determination unit during a financial transaction, it automatically controls logout and includes a financial business control unit for integrated control of tasks requiring authentication,
If the user departure/change event does not occur when additional authentication occurs during financial transaction in conjunction with the user departure/change determination unit, the financial business control unit considers that additional authentication has been made without performing additional authentication,
When a user change event occurs from the user departure/change determination unit during a financial transaction, the financial business control unit automatically logs out immediately and switches to the initial screen to protect personal information. Departure/change detection device.
The smart finance according to claim 1, further comprising a voice transmitter that transmits a voice for the financial transaction and provides a departure announcement for maintaining transaction continuity under the control of the financial business control unit when a user leaves during a transaction. User departure/change detection device for automated equipment.
The apparatus of claim 1, wherein the camera unit includes a face recognition camera for photographing the user's face for user departure and change and additional authentication.
The method according to claim 1, wherein the user departure/change determination unit registers a user image using a facial recognition solution when a financial transaction is started under the control of the financial business control unit, and continuously analyzes the user image until the financial transaction is terminated. A user departure/change detection device for a smart financial automation device, which monitors departure and change, and transmits a detection event for user departure or change to the financial business control unit when user departure or change is detected.
The method according to claim 1, When a user departure event occurs from the user departure/change determination unit during a financial transaction, the financial business control unit controls the announcement for user departure, and protects personal information if the user does not return within a preset time A user departure/change detection device of a smart financial automation device, characterized in that it automatically logs out and switches to the initial screen.
delete delete A method for protecting personal information by controlling logout through user departure/change detection in a smart financial automation device (STM),
(a) requesting facial recognition monitoring in conjunction with a user departure/change determination unit when a financial transaction is started in the financial business control unit built into the smart financial automation device;
(b) executing a face recognition solution when a face recognition monitoring is requested from the user departure/change determination unit, and generating a user departure/change detection event when a user departure/change is detected and transmitting it to the financial business control unit;
(c) when a user departure/change detection event is received during a financial transaction in the financial business control unit, selectively controlling logout according to the departure or change to protect personal information; and
(d) If additional authentication occurs while performing a financial transaction in the financial business control unit, additional authentication is not performed if no user departure/change event occurs during the financial transaction in conjunction with the user departure/change determination unit A method for detecting user departure/change in a smart financial automation device, comprising the step of considering that authentication has been made.
The method of claim 8, wherein step (b) comprises: (b1) executing a facial recognition solution and acquiring a camera control right; (b2) registering the user image acquired through the user recognition unit; (b3) monitoring the departure or change of the user by comparing the image acquired through the user recognition unit with the registered user image in real time; (b4) generating a user departure/change detection event when the departure or change of the user is detected in step (b3); (b5) when the end of facial recognition monitoring occurs from the financial business controller, terminating the facial recognition solution and returning the camera control right.
The method of claim 8, wherein, in step (c), (c1) when a user departure/change detection event is received during a financial transaction in the financial business control unit, it is checked whether the received event is a user departure detection event, and if the user departure detection event is a transaction transmitting a return guidance voice to maintain continuity; (c2) Check the lapse of time after the return guidance voice is transmitted, and if the user departure detection event does not occur within the set time, automatically log out and switch to the initial screen to protect personal information, and at the same time A method for detecting user departure/change in a smart financial automation device, comprising the step of transmitting a facial recognition monitoring end signal to a change determining unit.
The method of claim 10, wherein in step (c), (c3) when a user departure/change detection event is received during a financial transaction in the financial business control unit, it is checked whether the received event is a user change detection event, and if it is a user change detection event, immediately A method for detecting user departure/change in a smart financial automation device, characterized in that it further comprises the step of protecting personal information by automatically controlling logout.


delete

Images