KR101087698B1 - Method for authenticating security of smart-phone - Google Patents

Abstract

PURPOSE: A security authentication method of a smart phone is provided to perform security authentication by comparing a face image in a smart phone with a face image in face authentication database. CONSTITUTION: A face authentication server extracts face information from a face image that is received from a smart phone(S7). The face authentication server stores the extracted face information in face authentication database(S10). The face authentication server transmits a storing result to the smart phone(S11). The face authentication server compares a face image in the smart phone with a face image in the face authentication database. The face authentication server transmits a comparison result to the smart phone.

Description

Method for Authenticating Security of Smart-Phone}

The present invention relates to a security authentication method according to the use of a smartphone, and more particularly, to an authentication method for protecting personal information and enhancing security of a smartphone by preventing unauthorized use of the function of the smartphone. will be.

In general, mobile communication terminals are becoming more advanced due to the improvement of communication speed and the transmission and reception of large-capacity multimedia through electronic and communication technologies. Among them, a smart phone is an intelligent terminal that adds computer support functions such as internet communication and information retrieval to a mobile phone. On the go, you can communicate on the Internet, send faxes, and even have a personal information manager. Smartphones combine the advantages of cell phones and personal digital assistants (PDAs), integrating data communication functions such as calendaring, fax transmission and reception, and Internet access. Moreover, unlike conventional mobile phones, which are released as a finished product and use only a given function, hundreds of various applications can be installed and added or deleted as desired.

In addition, the smart phone not only can directly access the Internet using the wireless Internet, but also can be accessed in a variety of ways using various browsing programs, the user can create a desired application directly, through a variety of applications The ability to implement a suitable interface, and the ability to share applications among smartphones with the same operating system (OS) is also an advantage that existing mobile phones do not have.

In addition to the general voice and text transmission and reception information of the user, the smart phone stores personal information such as ID (ID), password (P / W) or public certificate for internet search or online banking. It is. This includes a variety of functions, such as a computer that can carry a smart phone, the utilization and dependence of the smart phone is increasing.

Conventionally, when a smartphone is stolen or lost, there is a problem that other users may use it illegally or steal various information stored in the smartphone. Therefore, various information of the individual stored in the smartphone needs security. For security of the smartphone, a smartphone user usually sets a password. The user can authenticate by input such as a password set before using the smartphone. In addition, for the convenience of the user, authentication may be performed by selecting a pattern instead of inputting a password or fingerprint recognition or voice recognition may be employed. However, there is a problem that the authentication of the smart phone is easy to be exposed to others and may be stolen. In addition, there was a problem that the application mounted on the smart phone to use various information or functions through the Internet can also be used without permission.

The present invention is to solve the above problems, by applying a face authentication application (Application, application or app) for the security authentication of the smartphone and by using the camera to shoot and authenticate the face of the smartphone user, Restricting the use of various functions of the smartphone, restricting the use of a plurality of applications mounted on the smartphone, or preventing unauthorized access or theft of various information or functions stored in the smartphone to enable stronger security authentication The purpose is to.

The present invention, in order to achieve the above object, the security authentication method of the smart phone, in the security authentication method of the smart phone, (a) if the face authentication application mounted on the smart phone is executed by the user face registration or face authentication Transmitting a user's face image photographed by a camera mounted on a smartphone to a face authentication server of a security authentication system via the mobile communication company's wireless communication network through the Internet; (b) the face authentication server extracting face information from a face image received from the corresponding smartphone, storing the extracted face information in a database after storing the extracted face information in a database, and transmitting a registration result to the smartphone; (c) comparing the face image received from the smart phone with the face information already stored in the face authentication DB after the face registration is completed in the face authentication server, and transmitting the same to the smartphone. Face authentication allows you to limit the use of these features on your smartphone.

In addition, in the present invention, the step (c) is (c-1) when any one of the general application is protected by the face authentication mounted on the smart phone is executed by the user to perform the face authentication or password authentication via the smart phone Selecting; (c-2) transmitting the user's face image photographed by the camera mounted on the smart phone to the face authentication server of the security authentication system through the wireless communication network of the mobile communication company for the face authentication through the Internet; (c-3) the face authentication server comparing the face information received from the smart phone with the face information stored in the face authentication DB for face authentication of the smart phone and transmitting the same to the smart phone; (c-4) The smart phone may further include a step of releasing the protection setting of the general application corresponding to the case where the authentication is successful from the face authentication server by the determination of the same.

In addition, in the present invention, in the step (c-1), when authentication for the execution of the protected application in the smartphone and the smartphone and the face authentication server when offline or communication is not possible to enable password authentication on the smartphone Password authentication of the smartphone may further include allowing a user to execute a corresponding general application by inputting and authenticating a password set in the smartphone.

Further, in the present invention, in the step (b), the face authentication server may receive the smart phone basic information along with the face image from the smart phone and store in the face authentication DB.

The present invention, by the solution means, by using the face authentication application and the camera in the smart phone environment by authentication based on the feature analysis of the user's face image by the other person's surrogate authentication, additional additional equipment or solutions for authentication It does not require this, and it provides enhanced security for providing the optimized and convenient self-authentication solution of the smart phone and the loss or theft of important data such as ID, password or public certificate in the smart phone.

1 is a block diagram showing a system for security authentication of a smart phone according to the present invention.
2A to 2G illustrate a display screen for setting an application to be protected according to security authentication of a smart phone according to the present invention.
3A to 3J illustrate a process of setting an application to be protected according to security authentication of a smart phone according to the present invention.
4A and 4B are flowcharts illustrating a security authentication method of a smartphone according to the present invention.

Hereinafter, with reference to the accompanying drawings, a security authentication method of the smart phone according to the present invention will be described in detail.

The present invention restricts the use of various functions of the smartphone, that is, the use of a plurality of applications mounted on the smartphone, message transmission, voice call, Wi-Fi or Internet communication, video playback including images, data viewing of documents, games, etc. Or through the face authentication of the smart phone user to prevent theft of ID (ID), password or public certificate.

In FIG. 1, a system for secure authentication of a smartphone includes a user having a smartphone 10, a mobile communication company including a gateway server 30 and a data relay server 31, and a mobile communication company via a mobile communication company. 10) is provided with a face recognition system including a web server 50, a face authentication server 51, DB 52 for data transmission and reception with. A wireless communication network 20 for data communication is wirelessly connected between the smartphone 10 and the gateway server 30 of the mobile communication company, and the data relay server 31 of the mobile communication company and the face authentication server of the face authentication system ( 51 is connected to the Internet 40 for data communication by wire and / or wirelessly.

The smartphone 10 includes an operating system (OS) necessary for operation, and includes various applications operating in the operating system and additional devices supporting the same. Furthermore, a face authentication application is included to limit the use of various applications or the use of various functions. It is to perform the protection setting function through face authentication that requires security authentication so that other users other than the smartphone user can use the face authentication application without permission.

The gateway server 30 of the mobile communication company converts or connects a network connected by 3G (Generation, 3rd generation) or more or Wi-Fi (WiFi), and the like, and the data relay server 31 relays data transmitted and received. .

The web server 50 of the face authentication system includes a program for providing a user with a file including a web page. The web server 50 provides a service through a web site, and the face authentication server 51 is a web server 50. It is to extract the customer relationship management (CRM) configuration and facial information of the face image input through the database. In addition, the face authentication server 51 extracts, analyzes and classifies the input face image with a built-in algorithm. The DB 52 stores and inputs customer information and face information to the face authentication server 51.

The security authentication method of the smart phone according to the present invention made as described above will be described with reference to a screen implemented through the smart phone display of FIGS. 2A to 2G.

First, the face authentication application must be downloaded from the web server 50 or the corresponding website or app store or app market by the user and installed in the smart phone. In the present invention, all applications except for face authentication applications, that is, applications for setting protection through face authentication, are referred to as general-purpose applications.

Figure 2a shows a screen for face authentication in a smartphone. The center of the display screen 100 includes a camera photographing region 102 in which an image taken from a camera, that is, a face image is displayed, and a button region 103 is disposed below. When the lock transition of the button area 103 is clicked, the screen is moved to a password input screen which can be unlocked when clicked. The user registration of the button area 103 requests registration to the face authentication server 51, and the face authentication is face authentication. Click to request the server 51 for authentication. In the user registration / face authentication button of the button area 103, after face authentication is registered once, the information of the button is changed to face authentication.

2b shows a screen for inputting a password in a smartphone. The display screen 100 includes a plurality of buttons 104 for inputting a password, and a button area 103 for switching face authentication, that is, switching to face authentication. The face authentication switch button c is moved to the face authentication screen which can be unlocked at the click. The face authentication screen of FIG. 2A and the password input screen of FIG. 2B may be selectively used by lock switching. In addition, the password input button 104 is input only a number, the input information is encrypted with a password and displayed on the password display area (101). In addition, when the hint (a) button (a) of the password input button 104 is clicked on, it switches to FIG. 3F where the password of the application itself can be initialized. Clicking the CLEAR button b initializes the password display area 101 of the application itself.

Figure 2c shows a screen for protecting the application on the smartphone. A plurality of tab areas 105 is provided above the display screen 100, and a protection list area 106 is provided below the display screen 100. The protection tab (d) moves to a screen showing a list of applications that the user wants to protect, and the entire tab (e) moves to a screen for managing a list of all applications installed on the smartphone, and the setting tab (f) Is to move to the setting screen for face authentication, the information tab (g) is to move to the description screen of the face authentication application. Protection If the selected application does not exist, the icon does not appear and you can check the icon of the corresponding application when the list exists. The environment setting (h) of the protected list area 106 may delete the protected application from the list.

2D shows that the entire tab b is clicked on in the tap area 105. Under the tab area 105, a list of applications installed on the smartphone, that is, the entire application list 107 is exposed, and if the corresponding list is checked (i), the corresponding application is stored in the protection list, and the check of the corresponding list ( If you release i) it will be removed from the protection list. If you select more than one of these lists, you can no longer select them and indicate that you can run them on a higher version.

2E shows that the setting tab f is clicked on in the tap area 105. Under the tab area 105, the basic option category 108, the lock option category 109, and the information category 110 are exposed. Lock activation (j) can start / stop the service of the face authentication application, password setting (k) is moved to the screen to reset the application itself password, password hint (l) is for resetting the application itself password Hint is redirected to the screen to reset, the lock termination selection (m) is executed according to the lock type such as face authentication and password when the locked application is executed, and the contact (n) is bug report or improvement of the program Move to the screen to send the information to the developer, etc., Pro version (o) is moved to the corresponding app store or app market for use of the upper version.

2F shows that the information tab g is clicked on in the tap area 105. Below the tab area 105, an information page area 111 is exposed, and descriptions of functions, features, usage, setting methods, and the like of the face authentication application can be checked. Furthermore, clicking on the hyperlink (p) takes you to the corresponding website.

2G illustrates an example of using a face authentication application through face authentication or password authentication on the display screen 105 of FIGS. 2A to 2F. That is, if the face authentication is successful, the screen is moved to the protection screen, the full screen, the setting screen, and the information screen. If the password authentication is successful, the screen is moved to the application screen to set the corresponding protection.

Next, a flow of registration for face authentication, authentication after registration, and the like will be described with reference to the flowcharts of FIGS. 4A and 4B and FIGS. 3A to 3J.

First, in order to set up user registration and protection of the smart phone 10 by the user, the user is initially subjected to a registration process according to face authentication using a face authentication application. To this end, when the application mounted on the smart phone 10 is executed (S1), it is determined whether the user is registered (S2). When the user registration is initially performed, the terms of use and precautions are displayed on the display screen (S3). This confirms the agreement of the terms and conditions in Fig. 3a. In other words, if the user agrees to the terms and conditions agreement and clicks the agree button, the user moves to the face authentication screen. If the user does not agree, the face authentication application ends. The precautions indicate the precautions to be taken when shooting faces for face authentication. Precautions may be optionally notified. And enter the password of the face recognition application itself as a registration required. If the password and password confirmation match, the registration of the password is completed. Then, as a registration required, the user can input a password hint for initializing the password of the face authentication application itself (S4).

In addition, to capture the user's face using a camera mounted on the smart phone 10 for the user's face authentication, and transmits the photographed face image (S5). That is, using the camera mounted on the smart phone 10, the user's photographed face image through the mobile carrier to the face authentication server 51 along with the information including the basic information of the smartphone, for example, the phone number, customer name, etc. Transmit (S6). The face authentication server 51 constructs a CRM for face recognition using a built-in algorithm of the received face image of the corresponding smartphone user, extracts face information, and configures it into a database (S7). When the database of the face image is successful (S8), the face authentication server 51 stores and registers the information and face information of the corresponding customer in the DB 52 (S10). In addition, the face authentication server 51 notifies the registration result to the corresponding smartphone 10 via the mobile communication company when the face information is registered (S11). Therefore, the registration process for using the face authentication application is completed.

In the registration process of FIG. 3A, after the user agrees to the terms and conditions displayed on the display screen and confirms the precautions, the user moves to the screen for face authentication, and if the user does not agree to the terms and conditions, requests for consent again. However, if you enter a button that does not agree, the face authentication application is terminated. When the user moves to the screen for face authentication, the user's face is photographed by a camera mounted on the smartphone, and the photographed face image is transmitted to the face authentication server 51 and stored in the DB 52.

In FIG. 3B, when the user's registration is successful, a pop-up window indicating that the registration is successful is displayed on the display screen, and when it is confirmed, the pop-up window is moved to the protection screen of the tab area 105. If the registration of the user fails, a failure message is displayed on the display screen, and a registration request is made after inputting the registration button (S9).

In addition, when the registration process is completed and the initial face authentication is registered, the information on the authentication is transmitted from the face authentication server 51 to the smartphone 10. Therefore, when a smartphone user registers for the first time from a smartphone or authenticates after being already registered, it is possible to select a general-purpose application to protect according to the result.

After the smart phone user executes the face authentication application for authentication for the protection setting of the plurality of general-purpose applications mounted on the smart phone 10, the user may go through the lock setting and authentication procedure in the corresponding setting page. That is, in FIG. 3C, one or more general-purpose applications to be mounted on the smartphone are selected in full screen (S12), and a list of selected general-purpose applications is checked (S13). If you check the application that you want to set the protection through face authentication, it is registered in the protection list, and if you uncheck it, it is deleted from the protection list for the protection setting through face authentication. When you select more than one list, you can move to the corresponding app store and messages that make the higher version available.

When the setting is completed by the user after checking the list, the service related to face authentication may be set (S13). In FIG. 3D, the face authentication application is executed with the lock activation check from the basic option function, and the function for the option for the lock is executed. The lock option can be selected at the time of execution of an application to be protected by selection of a lock type such as face authentication or password selection.

In addition, in FIG. 3E, a password input service may be provided as an option regarding lock to the face authentication application. This can reset the password of the application itself. The password can be reset by checking the current password and entering a new random password.

In addition, in FIG. 3F, in order to prevent the loss of the reset password, a hint about the application itself password is set, and the selection and answer of the question regarding the password are input.

In addition, in FIG. 3G, the screen for setting the information category of the face authentication application may be used to query the information category, use a higher version, or send an e-mail to a developer of bugs or improvements of the application.

In addition, in Fig. 3h, the screen for enabling the information of the face authentication application can be confirmed, the information screen can check the introduction of the overall service related to the face authentication by moving the website, and can check the information related to the face authentication application. .

The following is a process for face authentication, the face authentication server 51 is a user face image photographed after the selection of the corresponding application to be protected for the lock authentication of the application to be protected mounted on the smart phone 10 by the user is completed Received from the smart phone 10, and compares the received face image data and the data stored in the face authentication DB (52) to perform a face authentication and then transmit the authentication result to the smart phone 10, smart phone 10 ) Can switch the selected application to the locked state according to the authentication result of the face authentication server 51.

In addition, after the registration and authentication process using the smart phone 10, the authentication procedure is required to execute the lock-protected general-purpose application. Therefore, when the user executes a general purpose application mounted on the smartphone 10, the user can select authentication. At this time, the face image of the user photographed by the camera of the smart phone 10 is transmitted to the face authentication server 51 for authentication. The face authentication server 51 compares the face image received from the smart phone 10 with the face information stored in the DB 52 and performs an authentication procedure, and then transmits the authentication result to the smart phone 10. At this time, if the authentication result is successful, the general purpose application selected by the user is executed after the lock is released. However, when authentication fails, that is, when the registered face image and the face image transmitted for authentication are different, authentication of the lock-protected general-purpose application becomes impossible and the lock is switched, and the general-purpose application is terminated.

 Referring to the face authentication process in more detail from the flow chart of FIG. 4B, the face authentication process is not performed during the initial registration process through the step S2, and the face authentication service is selected when the smart phone user runs the general application. If no service is selected, the corresponding general purpose application is executed. However, when face authentication service is activated, it is possible to select whether to perform automatic face authentication or password authentication (S21).

In FIG. 3I, when face authentication is selected by the smartphone user, setting of an application to be protected for environment setting is executed. At this time, precautions are displayed during face authentication. The face image of the user photographed by the camera of the smart phone 10 is transmitted to the face authentication server 51 for face authentication (S22). The face authentication server 51 compares the face image received from the smart phone 10 with face information stored in the DB 52 and goes through an authentication procedure (S23). The face authentication server 51 transmits the authentication result to the smart phone 10 after the authentication procedure (S24). At this time, if the authentication result is successful, the corresponding general-purpose application selected by the user is executed (S25). However, if the authentication fails, request for face authentication again or allow password authentication to be executed by lockout. That is, if the authentication is successful, a message indicating the authentication success is displayed, and the user is moved to the environment setting of the application to be protected. If authentication fails, a corresponding error message is displayed requesting re-authentication or moving to password authentication by selecting lock switching.

Execution (S26) of the password authentication is moved to the password screen by the execution of the application to be protected in Figure 3j. At this time, the user enters a password already set. If the password authentication is successful (S27), it is moved to the corresponding protection setting screen, but if it fails, it is moved to face authentication by requesting re-entry or selecting lock switching.

In addition, in FIG. 3K, when the password authentication is executed, when the user clicks the hint button on the screen for entering the password, the user moves to the password hint input screen. When the user answers the password hint, the user moves to the password reset screen. By entering, the new password entered is applied.

Therefore, the authentication process of the face authentication application is terminated. The locked application cannot be used without authorization by the user. When the authentication result fails, that is, when the registered face image and the face image transmitted for authentication are different, authentication for locking the general application using the face authentication application becomes impossible.

Furthermore, after the registration and authentication process using the smart phone 10 as needed, other authentication procedures may be performed to execute the lock-protected general-purpose application. This may be authenticated by input of a password or pattern, not a face image, in the selection process of authentication. In other words, if a password or pattern is registered in advance, instead of a face image, the user may be authenticated by inputting a password or pattern. The input of the password or pattern may be stored in the DB 52 through the face authentication server 51 and then subjected to the authentication procedure. Could be

As described above, the application security authentication method of the smart phone of the present invention allows the user to go through the registration and authentication procedures of the face authentication application and the face image so that others cannot use the various general-purpose applications mounted on the smart phone in a smart phone environment. It can provide an optimized and convenient self-identification solution, and has the advantage of strengthening the security against the loss, theft, etc. of important data such as ID, password or authorized certificate in the smartphone.

While the invention has been shown and described with respect to the specific embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined by the appended claims. Anyone who has it will know it easily.

10: smart phone 20: wireless communication network
30: gateway server 31: data relay server
40: Internet 50: Web Server
51: face authentication server 52: DB

Claims (4)

In the security authentication method of the smartphone,
(a) When the face authentication application mounted on the smart phone is executed by the user, the user's face image taken by the camera mounted on the smart phone for face registration or face authentication is secured over the Internet through the mobile communication company's wireless communication network. Transmitting to the face authentication server of the system;
(b) the face authentication server extracting face information from a face image received from the corresponding smartphone, storing the extracted face information in a database after storing the extracted face information in a database, and transmitting a registration result to the smartphone;
(c) comparing the face image received from the smartphone with the face information already stored in the face authentication DB after the face registration is completed in the face authentication server and transmitting the same to the smart phone; including face registration and registration. The face authentication allows you to restrict the use of the functions on the smartphone,
The step (c) includes (c-1) selecting face authentication or password authentication through a smart phone when any one of the general applications protected by face authentication mounted on the smart phone is executed by the user;
(c-2) transmitting the user's face image photographed by the camera mounted on the smart phone to the face authentication server of the security authentication system through the wireless communication network of the mobile communication company for the face authentication through the Internet;
(c-3) the face authentication server comparing the face information received from the smart phone with the face information stored in the face authentication DB for face authentication of the smart phone and transmitting the same to the smart phone;
(c-4) further comprising the step of releasing the protection setting of the general application corresponding to the case where the authentication is successful from the face authentication server by the determination of the same from the face authentication server;
In the step (c-1), when authentication for the execution of the protected application on the smartphone when the smartphone and the face authentication server is offline or communication is not possible to enable password authentication on the smartphone, password authentication of the smartphone The security authentication method of the smartphone further comprises the step of allowing the user to run the corresponding general application by inputting and authenticating the password set in the smartphone.
delete delete The method of claim 1, wherein in the step (b), the face authentication server receives the basic information of the smartphone together with the face image from the smartphone and stores it in the face authentication DB.

Images