WO2010113326A1 - Authentication apparatus, authentication method, and authentication program - Google Patents

Abstract

When an authentication registration button is depressed, a screen for registering authentication information is displayed next (step S7). Whether selection occurs or not is judged (step S8). In the case of judging that the selection occurs, a process for confirming the registration of the authentication information is executed (step S9). Then, whether the authentication registration is OK or not is judged (step S10). When the authentication registration is OK, the authentication registration is executed (step S11). When the authentication registration is not OK, a process is executed as unsuccessful authentication registration (step S12).

Description

Authentication apparatus, authentication method, and authentication program

The present invention relates to an authentication device, an authentication method, and an authentication program using image information.

So-called password authentication is well known as a personal authentication method.
Password authentication is simple in terms of system as an authentication method, and is currently widely used. The problem with password authentication is that it is difficult to memorize and use meaningless symbols or information without experience in the brain and remember it when humans, especially elderly people, have poor memory. , Easy to make mistakes.

In particular, password authentication using numbers and alphanumeric characters increases the load on memory due to periodic changes to increase security, increasing the number of digits, or making passwords difficult to understand.

In this regard, Japanese Patent Application Laid-Open No. 2003-228553 proposes an authentication method using image information that is likely to be stored in memory, and specifically, a user stores a plurality of pieces of image information in a storage unit. An authentication method has been proposed that can reduce the load on storage by selecting a registered image (registered image) and increase security.

JP 2003-228553 A

However, in the authentication method disclosed in Japanese Patent Laid-Open No. 2003-228553, a method of performing image processing to improve security on image information registered by a user is disclosed. The image information may be completely different from the selected image information, and the image information registered by the user may not be properly selected on the authentication screen.

Therefore, when image processing is performed, it is desirable that the user confirm the image information again.

The present invention has been made to solve the above-described problems, and is an authentication device, an authentication method, and an authentication method capable of reducing the load on storage during authentication and enhancing security by a simple method. The purpose is to provide an authentication program.

An authentication apparatus according to an aspect of the present invention includes a display unit that displays an authentication screen, a plurality of image information to be displayed on the authentication screen, and correct image information that is authentication data that is at least one of the plurality of image information. Is executed based on whether the image information selected from among the plurality of pieces of image information displayed on the authentication screen matches the stored correct image information as authentication data. An authentication processing unit, an image processing unit that performs image processing on the registered image information when the user stores registration image information to be registered in advance in the image storage unit, and the correct image of the registered image information subjected to the image processing A registration availability confirmation unit that displays on the display unit a confirmation screen for confirming whether or not to use the information;

Preferably, the image processing unit executes a plurality of different image processes on the registered image information. The registration availability confirmation unit displays a plurality of image processed registered image information processed by the image processing unit on a confirmation screen, and selects at least one image processed registered image information from the plurality of image processed registered image information Accept input.

In particular, the image processing unit executes the same image processing with different levels on the registered image information.

Preferably, the registered image information selected in the image storage unit is stored as correct image information, and at least one of a plurality of image processed registered image information excluding the correct image information is displayed as an option on the authentication screen together with the correct image information. For this purpose, an image registration unit is further provided.

Preferably, the registration availability confirmation unit displays a plurality of pieces of haze image information displayed as a plurality of pieces of image information on the authentication screen together with the correct image information on the confirmation screen.

In particular, the plurality of bag image information has been subjected to image processing by the image processing unit in the same manner as the registered image information.

In particular, the image processing for a plurality of haze image information is the same image processing as the registered image information.
In particular, at least one image process for a plurality of haze image information is an image process different from the registered image information.

In particular, the feature extraction unit that extracts the feature data of the registered image information, and the feature data having high similarity among the plurality of pieces of image information stored in the image storage unit based on the feature data extracted by the feature extraction unit A similar image search unit for searching for similar images to be displayed on the confirmation screen as the cocoon image information in order.

In particular, the bag image information is obtained by performing image processing by the image processing unit in the same manner as the registered image information.

Preferably, the confirmation screen is displayed before storing the registered image information as correct image information in the image storage unit.

Preferably, the confirmation screen is displayed after storing the registered image information as correct image information in the image storage unit.

In particular, the registration availability confirmation unit deletes the correct image information stored in the image storage unit when receiving an input of a deletion instruction.

An authentication method according to another aspect of the present invention is an image in which correct image information that is authentication data that is at least one of a plurality of image information and a plurality of image information to be displayed on an authentication screen of a display unit is stored. An authentication method for an authentication apparatus including a storage unit, the step of displaying an authentication screen, and stored correct image information in which image information selected from a plurality of pieces of image information displayed on the authentication screen is authentication data; A step of performing authentication processing based on whether or not they match, a step of executing image processing on the registered image information when storing the registered image information to be registered in the image storage unit in advance, and image processing And a step of displaying a confirmation screen for confirming whether or not the registered image information is correct image information on the display unit.

An authentication program according to still another aspect of the present invention stores a plurality of pieces of image information to be displayed on an authentication screen of a display unit and correct image information that is authentication data that is at least one of the plurality of pieces of image information. The step of displaying the authentication screen on the computer of the authentication device including the image storage unit, and the image information selected from the plurality of image information displayed on the authentication screen match the stored correct image information that is the authentication data. A step of executing authentication processing based on whether or not, a step of executing image processing on the registered image information when previously storing registered image information to be registered in the image storage unit, and a registered image subjected to image processing And a step of displaying a confirmation screen for confirming whether or not the information is correct image information on the display unit.

The authentication apparatus according to the present invention includes an image processing unit that performs image processing on registered image information when a user stores registered image information to be registered in advance in an image storage unit, and corrects the registered image information that has been subjected to image processing. A registration availability confirmation unit that displays a confirmation screen for confirming whether or not the image information is to be displayed on the display unit;

Accordingly, since it is possible to confirm the registered image information subjected to the image processing, the user can recognize and store the registered image information subjected to the image processing. Can be reduced and security can be increased.

It is a schematic block diagram explaining the function of terminal devices 5, such as PC (Personal Computer) which has a function of an authentication device according to Embodiment 1 of the present invention. It is a flowchart explaining the flow of the process which performs the authentication process according to Embodiment 1 of this invention. It is a figure explaining the authentication initial screen 100 according to Embodiment 1 of this invention. It is a figure explaining the authentication execution screen 110 according to Embodiment 1 of this invention. It is a figure explaining the authentication information registration screen 120 according to Embodiment 1 of this invention. It is a flowchart explaining the authentication information registration confirmation process according to Embodiment 1 of this invention. It is a figure explaining the specific example of the authentication information registration screen 120 according to Embodiment 1 of this invention. It is a figure explaining the specific example of the registration image confirmation screen 130 according to Embodiment 1 of this invention. It is a schematic block diagram explaining the function of the terminal device 5a which has a function of the authentication apparatus according to the modification 1 of Embodiment 1 of this invention. It is a flowchart explaining the authentication information registration confirmation process according to the modification 1 of Embodiment 1 of this invention. It is a flowchart explaining the specific example of the image determination process in the image determination part. It is a figure explaining the registered image information including the image data of the license plate. It is a figure explaining pixel comparison of simple similarity. It is a figure explaining the standard pattern for determining the number "0" in a pattern matching process. It is a figure explaining the filter used for a blurring process. It is a figure explaining the specific example of a blurred image. It is a flowchart explaining another specific example of the image determination process in the image determination part. It is a figure explaining the specific example of the trimming process according to the modification 1 of Embodiment 1 of this invention. It is a flowchart explaining another specific example of the image determination process in the image determination part. It is a figure explaining the specific example of the background removal process according to the modification 1 of Embodiment 1 of this invention. It is a figure explaining the specific example of the registration image confirmation screen 150 according to the modification 2 of Embodiment 1 of this invention. It is a figure explaining the specific example of the registration image confirmation screen 160 according to the modification 2 of Embodiment 1 of this invention. It is a flowchart explaining the flow of the process which performs the authentication process according to the modification 3 of Embodiment 1 of this invention. It is a figure explaining the authentication registration screen 210 according to the modification 3 of Embodiment 1 of this invention. It is a figure explaining the authentication registration deletion screen 220 according to the modification 3 of Embodiment 1 of this invention. It is a schematic block diagram explaining the function of the terminal device 5b which has a function of the authentication apparatus according to Embodiment 2 of this invention. It is a flowchart explaining the flow of the process which performs the authentication process according to Embodiment 2 of this invention. It is a flowchart explaining the authentication information registration availability determination process in the registration availability determination part 24 according to Embodiment 2 of the present invention. It is a flowchart explaining the specific example of the authentication information registration availability determination process in the registration availability determination part. It is a flowchart explaining the specific example of the authentication information registration availability determination process in the registration availability determination part 24 according to the modification 1 of Embodiment 2 of this invention. It is a schematic block diagram explaining terminal device 5 # according to the third embodiment of the present invention. It is a flowchart explaining the flow of the process which performs the authentication process according to Embodiment 3 of this invention. It is a flowchart explaining the authentication information registration confirmation process according to Embodiment 3 of this invention. It is a figure explaining the specific example of the registration image confirmation screen 170 according to Embodiment 3 of this invention. It is a flowchart explaining another authentication information registration confirmation process according to Embodiment 3 of the present invention. It is a figure explaining the specific example of an authentication execution screen. It is a figure explaining another specific example of an authentication execution screen. It is a schematic block diagram explaining the structure of portable terminal devices 5p, such as PDA (Personal Digital Assistant) which has a function of an authentication apparatus. FIG. 2 is a schematic block diagram illustrating a configuration of an MFP 5q having an authentication device function.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and description thereof will not be repeated.

(Embodiment 1)
FIG. 1 is a schematic block diagram illustrating the function of terminal device 5 such as a PC (Personal Computer) having the function of the authentication device according to the first embodiment of the present invention.

Referring to FIG. 1, terminal device 5 according to the first embodiment of the present invention includes an authentication image database (DB) 14 that stores authentication image information, and a ROM (Read-Only Memory) that constitutes storage unit 16. ), RAM (Random Access Memory), HDD (Hard Disk Drive), and a communication interface unit 18 for executing transmission / reception of data with an external terminal device via a network (not shown), a mouse or a keyboard Between the operation unit 17 constituted by the display unit, the display unit 15 for displaying information using liquid crystal or organic EL (Electro-Luminescence), the control unit 10 for controlling the terminal device 5 as a whole, and the respective units And an internal bus 12 for exchanging data.

Each unit is connected to the control unit 10 via the internal bus 12, and the control unit 10 can exchange data with each unit.

The communication interface unit 18 can exchange data with other external terminal devices connected via a network.

The RAM constituting the storage unit 16 is a volatile semiconductor storage device, and is used as a working area necessary for control processing in the control unit 10. ROM and HDD are nonvolatile semiconductor memory devices.

Note that software programs for realizing various functions of the terminal device 5 are stored in the ROM, and in this example, software programs necessary for authentication processing are stored. The control unit 10 realizes a predetermined function by calling various programs stored in the ROM. Further, the process shown in the flowchart described below is realized by the control unit 10 executing a predetermined program stored in the ROM of the storage unit 16. The HDD stores various data used in the terminal device 5.

The control unit 10 stores image information in the authentication processing unit 20 for executing authentication processing in the terminal device 5, an image registration unit 22 for storing image information for executing authentication processing, and the authentication image DB 14. It includes a registration permission / non-permission confirmation unit 24 for confirming whether to store, an authentication control unit 25 that controls the entire authentication process, and an image processing unit 26 that performs image processing on image information. In addition, the image registration part 22 shall delete the image information memorize | stored in image DB14 for authentication according to the instruction | indication.

FIG. 2 is a flowchart illustrating a process flow for executing the authentication process according to the first embodiment of the present invention.

Referring to FIG. 2, first, an authentication initial screen is displayed (step S1).
Specifically, for example, when the terminal device 5 is activated, a software program necessary for the authentication process is automatically loaded from the storage unit 16 and the process in the flowchart is executed. First, the authentication control unit 25 of the control unit 10 displays on the display unit 15 based on data for displaying an authentication initial screen stored in the storage unit 16 in advance.

FIG. 3 is a diagram illustrating an authentication initial screen 100 according to the first embodiment of the present invention.
Referring to FIG. 3, a case where an authentication button 102 and an authentication registration button 104 are provided on the authentication initial screen 100 is shown. A case where “Please select one” is displayed is shown.

It is assumed that the user can execute various functions by selecting (pressing) the authentication button 102 or the authentication registration button 104 using a mouse or the like that is a pointing device of the operation unit 17.

When the authentication button 102 is selected (pressed), an authentication processing function using the authentication processing unit 20 is executed. Further, when the authentication registration button 104 is selected (pressed), a registration processing function for image information necessary for executing the authentication processing in the registration availability determination unit 24 and the image registration unit 22 is executed. . If image information necessary for executing the authentication process is not stored, the authentication process cannot be executed. In this case, the authentication button 102 may not be displayed. is there. Alternatively, it may be set so that it cannot be selected.

In addition, when the registration function of image information necessary for executing the authentication process is being executed, if the authentication registration button 104 is selected (pressed), the stored authentication process is executed. It is assumed that processing for updating image information necessary for processing is performed.

Referring to FIG. 2 again, next, the authentication control unit 25 determines which of the authentication button or the authentication registration button has been pressed (step S2). If it is determined in step S2 that the authentication button has been pressed, an authentication execution screen is displayed (step S3). Specifically, the authentication control unit 25 instructs the authentication processing unit 20 to display an authentication execution screen based on the authentication image DB 14.

FIG. 4 is a diagram illustrating an authentication execution screen 110 according to the first embodiment of the present invention.
Referring to FIG. 4, authentication execution screen 110 according to the first embodiment of the present invention displays 12 pieces of image information of a plurality of images PA, PB, PC,. The case where it is provided as a state is shown.

The case where an “OK” button 114 and a “Cancel” button 116 are provided is shown.

The user selects at least one of the selection buttons 112 provided corresponding to each of the 12 pieces of image information using a mouse or the like as a pointing device of the operation unit 17 and selects an “OK” button 114 ( It is assumed that the authentication processing unit 20 can execute the authentication process by pressing the button.

Then, referring again to FIG. 2, it is determined whether or not there is a selection (step S4). In step S4, when it is determined that there is a selection, the authentication processing unit 20 performs an authentication process next (step S5).

Specifically, in the authentication execution screen 110 of FIG. 4, the authentication processing unit 20 selects the selection button 112 corresponding to the image and determines whether or not the OK button 114 is selected (pressed).

Then, it is determined whether or not the authentication is successful (step S6).
Specifically, the authentication processing unit 20 determines whether or not the image information stored in advance as an authentication code by the user matches the image information selected on the authentication execution screen 110 by image information registration processing to be described later. To do. If the image information matches, the authentication is successful. On the other hand, if the image information does not match, it is determined that the authentication has failed.

If it is determined that the authentication has failed, the process returns to step S3 again.
On the other hand, if it is determined in step S6 that the authentication is successful, the authentication process ends (END).

In this case, since the authentication is successful, it is assumed that the authentication process is completed and another predetermined function in the terminal device 5 can be executed. On the other hand, when authentication fails, it is assumed that other predetermined functions in the terminal device 5 cannot be executed.

In this example, as shown in FIG. 4, on the authentication execution screen, a plurality of images, that is, image information stored (registered) by the user himself (also referred to as correct image information) and other image information (情報 image information). Is also displayed, and the correct image information is selected, so that the user authentication process can be executed by a simple method instead of password authentication or the like.

Referring to FIG. 2 again, the processing when the authentication registration button 104 is selected (pressed) will be described next.

If the authentication registration button is pressed in step S2, an authentication information registration screen is displayed (step S7).

Specifically, the authentication control unit 25 displays an authentication information registration screen based on selection (pressing) of the authentication registration button. Specifically, in this example, as an example, the authentication control unit 25 displays an authentication information registration screen using image information stored in advance in the HDD of the storage unit 16. Here, as an example, a case where the authentication information registration screen is displayed using image information stored in advance in the HDD of the storage unit 16 will be described. However, the present invention is not limited to this. The input image information may be displayed on the image information registration screen. For example, the image information may be acquired from an external terminal device connected via a network using the communication interface unit 18.

FIG. 5 is a diagram illustrating an authentication information registration screen 120 according to the first embodiment of the present invention.
Referring to FIG. 5, here, the image information of images A to F, which are a plurality of registration candidates to be registered, is displayed as an authentication code, and is provided in a state that can be selected by a selection button 122. The case is shown.

Then, on the authentication information registration screen 120, the user selects (presses) image information (registered image information) that the user desires to store (register) as an authentication code, thereby storing the designated image as correct image information. It is possible to start the process. Here, a plurality of registration candidates images A to F are displayed, but not limited to a plurality of images, and may be one.

Then, referring again to FIG. 2, it is determined whether or not there is a selection (step S8). Specifically, on the authentication information registration screen 120 in FIG. 5, the authentication control unit 25 selects the selection button 122 corresponding to the image and determines whether or not the OK button 124 is selected (pressed).

If it is determined in step S8 that there is a selection, an authentication information registration confirmation process is executed (step S9). The authentication information registration confirmation process will be described later.

Then, after step S9, it is determined whether or not the authentication registration is OK (step S10). Specifically, the authentication control unit 25 determines whether or not the authentication registration is OK based on the result of the authentication information registration confirmation process in the registration availability confirmation unit 24.

If the authentication registration is OK, the authentication registration is executed (step S11). Specifically, when the authentication control unit 25 determines that the authentication registration is OK based on the result of the authentication information registration confirmation process, the authentication control unit 25 stores the registered image information in the authentication image DB 14 as correct image information. The image registration unit 22 is instructed. The image registration unit 22 stores the registered image information in the authentication image DB 14 as correct image information in accordance with an instruction from the authentication control unit 25. Then, the process ends (END). Since the preparation for executing the authentication process is completed by the process, the authentication process described above can be executed.

On the other hand, if authentication registration is not OK in step S10, it is processed as authentication registration failure (step S12). In this case, authentication registration is not executed, and the process ends (end). In this case, the authentication information registration screen 120 may be displayed again, or the authentication initial screen 100 may be displayed again. Alternatively, it is also possible to display a dialog and ask the user whether or not to really register for authentication. Alternatively, the user can be notified of in which part the authentication registration has failed.

FIG. 6 is a flowchart illustrating authentication information registration confirmation processing according to the first embodiment of the present invention. The processing shown in the flowchart described below is realized by the control unit 10 executing a predetermined program stored in the ROM of the storage unit 16. The same applies to the flowcharts processed by the functional blocks of the control unit 10 below.

Referring to FIG. 6, first, image processing is executed on the selected image (registered image information) (step S21).

Specifically, the authentication control unit 25 instructs the image processing unit 26 to perform image processing on the selected registered image information.

Next, an image to be registered (registered image information subjected to image processing) is displayed as a preview (step S22).

Specifically, the authentication control unit 25 instructs the registration enable / disable confirmation unit 24 to preview the registered image information that has been subjected to image processing by the image processing unit 26. The registration availability confirmation unit 24 displays a registration image confirmation screen on the display unit 15 for previewing the registered image information subjected to image processing.

Next, it is determined whether or not the registration is OK (step S23).
Specifically, the registration permission confirmation unit 24 determines whether or not the registration is OK based on whether or not a selection button indicating that the registration is OK is input on the registration image confirmation screen.

In step S23, if the registration is OK, the authentication registration is OK (step S24).

On the other hand, if the registration is not OK in step S23, authentication registration NG determination is made (step S25).

More specifically, when there is an input of a selection button indicating that the registration is OK, the registration propriety confirmation unit 24 outputs to the authentication control unit 25 as an authentication registration OK determination. In addition, when there is an input of a selection button (Cancel) indicating that the registration is NG, the registration propriety confirmation unit 24 outputs to the authentication control unit 25 as an authentication registration NG determination.

Then, the process returns to the process of FIG. 2 (return).
That is, in the authentication information registration confirmation process, if the user selects and inputs that the registration is OK, the authentication registration is OK, and if the user does not select and inputs that the registration is OK, authentication registration is performed. Becomes NG. Only when the authentication registration is OK, the registered image information whose authentication registration is OK is stored in the authentication image DB 14 as correct image information.

Then, as described above, the correct image information stored (registered) by the user and the other image information are displayed and the correct image information is selected so that the user can use a simple method rather than password authentication. The authentication process can be executed.

FIG. 7 is a diagram illustrating a specific example of authentication information registration screen 120 according to the first embodiment of the present invention.

Referring to FIG. 7, here, there is shown a case where image information as a plurality of registration candidates to be registered is displayed and provided in a selectable state.

Then, on the authentication information registration screen 120, the user selects (presses) image information (registered image information) that the user desires to register as an authentication code, thereby starting registration processing with the specified image as correct image information. It shall be possible. In this example, a case where the registered image information indicated by the selection button 128 is selected and the OK button 124 is selected (pressed) will be described as an example.

FIG. 8 is a diagram illustrating a specific example of registered image confirmation screen 130 according to the first embodiment of the present invention.

Referring to FIG. 8, here, in FIG. 7, the original image (registered image information) 132 when the selection button 128 is selected (pressed) on the authentication information registration screen 120, and the image (image processing) on which image processing has been executed The registered image information) 134 is displayed. Here, as an example of image processing, a case where blur processing is performed on an original image is shown.

In the registration image confirmation screen 130, when the OK button 136 is selected (pressed), the authentication registration is OK, and when the Cancel button 138 is selected (pressed), the authentication registration is NG.

When the user selects (presses) the OK button 136, the registered image information subjected to image processing is stored in the authentication image DB 14 as correct image information.

In this example, the case where the image processing unit 26 executes the blurring process has been described as an example of the image processing. Alternatively, known image processing techniques such as brightness adjustment processing for incrementing pixel values, color inversion processing, contrast adjustment processing, γ correction processing, gray scale processing, noise removal processing, and the like can be used. Further, the method is not limited to one method, and a plurality of methods may be combined.

In the method according to the present embodiment, after image processing is performed, the registered image information that has been subjected to image processing is previewed on the user, so that the user can recognize and store the registered image information that has undergone image processing. It is possible to reduce the load on the memory at the time of authentication and increase the security by a simple method.

(Modification 1 of Embodiment 1)
As the registered image information, for example, when information that is determined to be personal information is included in a predetermined area in the image as an example, for privacy, the registered image information is subjected to image processing. It may be desirable to do so.

FIG. 9 is a schematic block diagram illustrating the function of the terminal device 5a having the function of the authentication device according to the first modification of the first embodiment of the present invention.

Referring to FIG. 9, terminal device 5a according to the first modification of the first embodiment of the present invention is different from terminal device 5 described in FIG. 1 in that control unit 10 is replaced with control unit 10a. .

The control unit 10a is different in that an image determination unit 23 is newly added. Since other points are the same as those of the control unit 10, detailed description thereof will not be repeated.

The image determination unit 23 executes an image determination process based on the feature data of the selected registered image information.

FIG. 10 is a flowchart illustrating authentication information registration confirmation processing according to the first modification of the first embodiment of the present invention. The process shown in the flowchart described below is realized by the control unit 10a executing a predetermined program stored in the ROM of the storage unit 16. The same applies to flowcharts processed by the functional blocks of the control unit 10a.

Referring to FIG. 10, first, an image determination process is executed on the selected image (registered image information) (step S31).

Specifically, the authentication control unit 25 instructs the image determination unit 23 to execute image determination processing. The image determination unit 23 executes an image determination process based on the feature data of the registered image information selected according to the instruction from the authentication control unit 25.

The image determination process will be described later.
Then, in the image processing unit 26, image processing is executed based on the determination result (step S32).

Specifically, the authentication control unit 25 instructs the image processing unit 26 to execute image processing based on the determination result of the image determining unit 23.

Next, an image to be registered (registered image information subjected to image processing) is displayed as a preview (step S22).

Since the subsequent processing is the same as that described with reference to FIG. 6, detailed description thereof will not be repeated.
FIG. 11 is a flowchart illustrating a specific example of image determination processing in the image determination unit 23.

Referring to FIG. 11, the image determination unit 23 determines whether there is specific image data (feature data) in the registered image information (step S51). When it is determined that there is specific image data, the blurring process request determination is made (step S52). On the other hand, if it is determined in step S51 that there is no specific image data, it is determined that the blurring process is unnecessary. Then, the process ends (return).

Specifically, as specific image data, for example, it is possible to determine whether there is image data including a license plate number or a credit card number as an example of personal information.

FIG. 12 is a diagram illustrating registered image information including license plate image data.

Referring to FIG. 12, here, the image data of the license plate on which the number “0000” is marked is displayed.

As an example, the number of the license plate can be determined by determining whether or not a number is included by a pattern matching process that is a known technique.

Here, a process called simple similarity will be described as an example of the pattern matching process.

Simple similarity is, for example, a technique for determining similarity based on pixel comparison included in image data.

FIG. 13 is a diagram for explaining pixel comparison of simple similarity.
Referring to FIG. 13A, as an example, a standard pattern c = (c1, c2,..., C289) serving as a reference in the case where numbers are assigned to pixels included in a predetermined area is shown. Yes.

Referring to FIG. 13B, image data (input pattern) x = (x1, x2,..., X289) is shown.

These pixel comparisons are performed.
Specifically, the following calculation formula is executed.

Here, the cos of the angle formed by the two vectors is calculated, and it is determined that the closer the value is, the closer the value is.

In this example, as an example, if the absolute value of (Equation 1) is 0.95 or more, it is determined as 1 and recognized as a number.

FIG. 14 is a diagram for explaining a standard pattern for determining the number “0” in the pattern matching process.

Referring to FIG. 14, the above simple similarity processing is executed on the image data shown in FIG. 12 using a standard pattern that is distinguished from data “0” and “1” for numeral “0”. Whether or not the number “0” exists is determined.

Here, as an example, a standard pattern for determining the number “0” is described, but other numbers can also be determined by using the same standard pattern.

When it is determined by the pattern matching process that there is specific image data including a license plate number, it is processed as a blurring process request determination.

On the other hand, if it is determined by the pattern matching process that there is no specific image data that includes the number of the license plate, it is processed as a blurring process unnecessary determination.

FIG. 15 is a diagram illustrating a filter used for blurring processing.
Referring to FIG. 15, here, as an example, a filter that replaces a pixel of average value of eight pixels that are the peripheral region around the target pixel with the value of the target pixel is shown. Has been.

Referring to FIG. 10 again, in step S32, image processing is executed based on the determination result. That is, the image processing unit 26 is instructed to execute the blurring process by the authentication control unit 25 based on whether or not the blurring process request determination is a determination result from the image determination unit 23.

Specifically, by applying the filter described in FIG. 15 to the area portion where the number on the license plate is displayed, the pixels included in the area portion are respectively replaced with the average value of the surrounding pixels by the filter. As a result, the area where the number is displayed is displayed as a blurred image, and the number cannot be specified.

FIG. 16 is a diagram illustrating a specific example of a blurred image.
Referring to FIG. 16, here, a case is shown in which the area portion where the number of the license plate is displayed is displayed as a blurred image.

Referring to FIG. 10 again, in step S22, an image to be registered (registered image information subjected to image processing) is displayed as a preview.

Thereby, after performing image processing based on the determination result of the image determination processing, the user recognizes the registered image information subjected to the image processing by previewing the registered image information on which the image processing has been performed to the user. It becomes possible to memorize, and it is possible to reduce the load on the memory at the time of authentication and enhance security by a simple method.

Then, for example, when it is determined that the information that is determined to be personal information is included as the registered image information, the image of the registered image information that is considered to have a privacy problem by executing the blurring process. Processing can be performed to protect privacy and improve security.

In this example, the number on the license plate has been described as the specific image data (feature data), but the credit card number, telephone number, address, etc. can also be determined by the same method. Specifically, it is possible to specify and determine a numeric string having a certain number of digits, a blank, a hyphen, or the like using a known technique.

Also, the image processing is not limited to numbers, and similar image processing can be executed when specific image data (feature data) such as a person image is included.

In this example, the case where the blurring process is executed as the image process has been described. However, the present invention is not limited to the blurring process, and is not limited to the blurring process. It is possible to use known image processing techniques such as brightness adjustment processing, color inversion processing, contrast adjustment processing, γ correction processing, gray scale processing, noise removal processing, and the like. Further, the method is not limited to one method, and a plurality of methods may be combined.

FIG. 17 is a flowchart for explaining another specific example of the image determination process in the image determination unit 23.

Referring to FIG. 17, first, for registered image information, the image determination unit 23 performs a determination process as to whether or not the image includes a date (step S <b> 40).

Next, it is determined whether or not there is a date (step S41). If it is determined that there is a date, a trimming process request determination is made (step S42). On the other hand, if it is determined in step S41 that there is no date, it is determined that trimming processing is not required (step S43). And it returns to the process of FIG. 10 (return).

Whether or not the image includes a date is determined by the image determination unit 23 using, for example, the above pattern matching process, whether or not a number is included, and “.” Or “/”. The determination process can be executed depending on whether or not a symbol is included.

Referring to FIG. 10 again, in step S32, image processing is executed based on the determination result. That is, the image processing unit 26 is instructed by the authentication control unit 25 to execute the trimming process based on whether or not the trimming process request determination is a determination result from the image determination unit 23.

FIG. 18 is a diagram illustrating a specific example of the trimming process according to the first modification of the first embodiment of the present invention.

Referring to FIG. 18, here, as an example, photograph data 140 is shown as registered image information. In the lower right area of the photo data 140, the case where the date “08.9.9.10” is included is shown.

As described above, in the image determination process, it is determined that there is a date based on the pattern matching process or the like, and a trimming process request determination is made.

The authentication control unit 25 instructs the image processing unit 26 to execute the trimming process based on the trimming process request determination.

Then, the image processing unit 26 performs the trimming process on the registered image information including the date according to the instruction based on the trimming process request determination from the authentication control unit 25.

Specifically, the image processing unit 26 displays the date in a part of the lower right area of the photo data 140 with the vertex at the upper left corner of the photo data as a reference, as indicated by the dotted line area in FIG. A trimming process is performed to cut off the area that is covered (dotted line area).

By this process, it is possible to obtain an image that does not include a date by executing a trimming process that cuts out an area where the date is displayed.

Thereby, after performing image processing based on the determination result of the image determination processing, the user recognizes the registered image information subjected to the image processing by previewing the registered image information on which the image processing has been performed to the user. It becomes possible to memorize, and it is possible to reduce the load on the memory at the time of authentication and enhance security by a simple method.

In the above description, the method of determining based on whether or not displayed data such as numbers exists as specific image data has been described. However, the image determining unit 23 is not limited to the displayed data. In the above, the registered image information is analyzed, and the image determination processing for determining whether there is specific image data is performed based on the feature data using the saturation, edge strength, etc. of the entire image as the feature data. It is also possible to execute image processing based on the determination result.

FIG. 19 is a flowchart for explaining still another specific example of the image determination process in the image determination unit 23.

Referring to FIG. 19, first, for registered image information, image determination unit 23 executes a determination process as to whether or not a background image is included (step S60).

Next, it is determined whether or not there is a background image (step S61). If it is determined that there is a background image, a background removal process request determination is made (step S62). On the other hand, if it is determined in step S61 that there is no background image, it is determined that background removal processing is not required (step S63). And it returns to the process of FIG. 10 (return).

Whether the image includes a background image is determined based on the feature data by analyzing the registered image information in the image determination unit 23 and using the saturation, edge strength, and the like of the entire image as feature data. Then, it is possible to execute a process for determining whether or not there is a background image.

Referring to FIG. 10 again, in step S32, image processing is executed based on the determination result.

That is, the image processing unit 26 is instructed to execute the background removal process from the authentication control unit 25 based on whether or not the background removal process request determination is a determination result from the image determination unit 23.

FIG. 20 is a diagram for explaining a specific example of background removal processing according to the first modification of the first embodiment of the present invention.

Referring to FIG. 20 (a), here, as an example, image data including a background image together with a person image is shown as registered image information.

Referring to FIG. 20B, here, image data when background removal processing is executed on registered image information is shown.

Thereby, after performing image processing based on the determination result of the image determination processing, the user recognizes the registered image information subjected to the image processing by previewing the registered image information on which the image processing has been performed to the user. It becomes possible to memorize, and it is possible to reduce the load on the memory at the time of authentication and enhance security by a simple method.

(Modification 2 of Embodiment 1)
In the registered image confirmation screen 130 described above, a case has been described in which an image (registered image information subjected to image processing) on which image processing has been performed is displayed one by one with respect to an original image (registered image information). It is also possible to perform image processing and let the user select one of them.

FIG. 21 is a diagram for explaining a specific example of the registered image confirmation screen 150 according to the second modification of the first embodiment of the present invention.

Referring to FIG. 21, here, a registered image confirmation screen is shown when blurring processing is executed as image processing on registered image information including the license plate image data described in FIG. .

Specifically, the image processing unit 26 performs two types of blurring processing on the original image 152. Then, a registration image confirmation screen for previewing the two types of images 154 and 156 subjected to image processing is displayed on the display unit 15 by the registration availability confirmation unit 24.

The image 156 is an image that is more blurred than the image 154. That is, in this example, the case where two kinds of image processing with different levels, that is, image processing with a high degree of blurring and image processing with a low level of blurring is performed on the original image 152 is shown.

In the illustrated example, an image PA button 158 for selecting an image PA corresponding to the image 154, an image PB button 160 for selecting an image PB corresponding to the image 156, and a Cancel button 162 are provided.

In the registered image confirmation screen 150, when the image PA button 158 is selected (pressed), the authentication registration is OK for the image PA, and when the image PB button 160 is selected (pressed), the image PB is selected. If the authentication registration is OK and the Cancel button 162 is selected (pressed), the authentication registration is NG.

When the user selects (presses) the image PA button 158, the registered image information (image PA) subjected to image processing is stored in the authentication image DB 14 as correct image information. When the image PB button 160 is selected (pressed), the registered image information (image PB) subjected to image processing is stored in the authentication image DB 14 as correct image information.

By displaying a preview of registered image information that has been subjected to a plurality of types of image processing to the user by the method according to the present embodiment, the user can select registered image information that has been selected from the registered image information that has undergone a plurality of types of image processing. Since it is possible to store the registered image information that has been subjected to the image processing desired by the user, the load on the storage at the time of authentication can be reduced and the security can be increased by a simple method.

FIG. 22 is a diagram for explaining a specific example of the registered image confirmation screen 160 according to the second modification of the first embodiment of the present invention.

Referring to FIG. 22, the original image 162 is the same as the original image (registered image information) 132 described in FIG. 8.

Then, a registered image confirmation screen when a plurality of different types of image processing is executed as image processing on the original image 162 is shown.

Specifically, the case where a so-called water paper filter process, a glass filter process, a texturer process, and a blur process are executed as image processing on the original image 162 is shown. The image processing is realized by executing a predetermined program stored in the ROM of the storage unit 16 in the image processing unit 26.

In this example, images 164, 166, 168, and 170 are shown in which the water paper filter process, the glass filter process, the texturer process, and the blurring process are performed on the original image 162, respectively.

An image QA button 172 for selecting an image QA corresponding to the image 164, an image QB button 174 for selecting an image QB corresponding to the image 166, an image QC button 176 for selecting an image QC corresponding to the image 168, The case where an image QD button 178 for selecting an image QD corresponding to the image 170 and a Cancel button 180 are provided is shown.

If the image QA button 172 is selected (pressed) on the registered image confirmation screen 160, the authentication registration is OK for the image QA, and if the image QB button 174 is selected (pressed), the image QB is selected. If the authentication registration is OK and the image QC button 176 is selected (pressed), the authentication registration is OK for the image QC, and if the image QD button 178 is selected (pressed), the authentication registration is performed for the image QD. When OK is selected and the Cancel button 180 is selected (pressed), the authentication registration is NG.

When the user selects (presses) the image QA button 172, the registered image information (image QA) subjected to image processing is stored in the authentication image DB 14 as correct image information. When the image QB button 174 is selected (pressed), the image information stored image information (image QB) is stored in the authentication image DB 14 as correct image information. When the image QC button 176 is selected (pressed), the registered image information (image QC) subjected to image processing is stored in the authentication image DB 14 as correct image information. When the image QD button 178 is selected (pressed), the registered image information (image QD) subjected to image processing is stored in the authentication image DB 14 as correct image information.

By displaying a preview of registered image information that has been subjected to a plurality of types of image processing to the user by the method according to the present embodiment, the user can select registered image information that has been selected from the registered image information that has undergone a plurality of types of image processing. It is possible to store the information, and the registered image information processed by the user himself / herself is stored. Therefore, the load on the memory at the time of authentication can be reduced and the security can be increased by a simple method.

Further, image information that has not been selected on the registered image confirmation screen and that has been subjected to image processing is stored in the authentication image DB 14 for display as image information on the authentication execution screen at the time of authentication processing. It is also possible.

(Modification 3 of Embodiment 1)
In the first embodiment, the registered image information subjected to the image processing is previewed to the user before being stored in the authentication image DB 14, and after the user confirms, the authentication registration is OK. The case of storing in the authentication image DB 14 has been described.

On the other hand, the timing stored in the authentication image DB 14 may be before the preview display to the user.

FIG. 23 is a flowchart for explaining the flow of processing for executing the authentication processing according to the third modification of the first embodiment of the present invention. The processing shown in the flowchart described below is realized by the control unit 10 executing a predetermined program stored in the ROM of the storage unit 16. The same applies to the flowcharts processed by the functional blocks of the control unit 10 below.

Referring to FIG. 23, the processing after step S8 is different from the flowchart of FIG.

Specifically, if it is determined in step S8 that there is a selection on the authentication information registration screen 120 in FIG. 5, next, image processing is executed on the selected image (step S13).

Specifically, the authentication control unit 25 instructs the image processing unit 26 to perform image processing on the selected registered image information. Since the image processing is the same as that described in the first embodiment, detailed description thereof will not be repeated.

Next, the image registration unit 22 registers the image to be registered (registered image information subjected to image processing) in the authentication image DB 14 as correct image information (step S14).

Next, an authentication registration screen is displayed (step S15).
Specifically, the authentication control unit 25 instructs the registration permission confirmation unit 24 to display the correct image information stored in the authentication image DB 14. The registration availability confirmation unit 24 displays an authentication registration screen that prompts confirmation of the stored correct image information on the display unit 15.

FIG. 24 is a diagram for explaining an authentication registration screen 210 according to the third modification of the first embodiment of the present invention.

Referring to FIG. 24, the stored correct image information (registered image information subjected to image processing) is displayed here, and the user is prompted to confirm the correct image information registered. "?" Is displayed and an OK button 212 and a delete button 214 are provided.

Again referring to FIG. 23, it is next determined whether or not the registration is OK (step S16). In step S16, if the registration is OK, that is, if the OK button 212 is selected (pressed) on the authentication registration screen 210, the process ends (END).

On the other hand, if the registration is not OK in step S16, that is, if the delete button 214 is selected (pressed) on the authentication registration screen 210, the correct image information registered for authentication is deleted (step S17). Specifically, the registration availability confirmation unit 24 outputs a deletion instruction corresponding to the deletion button 214 on the authentication registration screen 210 to the authentication control unit 25. The authentication control unit 25 instructs the image registration unit 22 to delete the image information stored in the authentication image DB 14 in accordance with the deletion instruction. Accordingly, the image registration unit 22 deletes the correct image information stored in the authentication image DB 14.

Next, an authentication registration deletion screen is displayed (step S17 #). Specifically, the authentication control unit 25 displays an authentication registration deletion screen on the display unit 15. And it returns to step S7 again.

FIG. 25 is a diagram for explaining an authentication registration deletion screen 220 according to the third modification of the first embodiment of the present invention.

Referring to FIG. 25, in authentication registration deletion screen 220 according to the third modification of the first embodiment of the present invention, “The image registered for the correct image has been deleted. Please re-register.” The case where the guidance display is displayed is shown.

And the case where the OK button 222 is provided is shown. When the user selects (presses) the OK button 222, the process proceeds to step S7 and an authentication information registration screen is displayed.

The registered image information that has been subjected to image processing is stored in the authentication image DB 14, and then the correct image information stored in the user is displayed and confirmed by the user so that the user can perform the image processing. If the information is recognized and the registered image information is not desired, it can be deleted. That is, with a simple method, it is possible to reduce the load on storage during authentication and increase security.

(Embodiment 2)
FIG. 26 is a schematic block diagram illustrating the function of terminal device 5b having the function of the authentication device according to the second embodiment of the present invention.

Referring to FIG. 26, terminal device 5b according to the second embodiment of the present invention differs from terminal device 5a described in FIG. 9 in that control unit 10a is replaced with control unit 10b. More specifically, the control unit 10b is different from the image determination unit 23 in that a registration availability determination unit 27 is provided. Since the other points are the same as described above, detailed description thereof will not be repeated.

The registration availability determination unit 27 determines whether to store image information in the authentication image DB 14.
FIG. 27 is a flowchart illustrating a process flow for executing the authentication process according to the second embodiment of the present invention. The processing shown in the flowchart described below is realized by the control unit 10b executing a predetermined program stored in the ROM of the storage unit 16. The same applies to the flowcharts processed by the functional blocks of the control unit 10b.

Referring to FIG. 27, the processing after step S8 is different from the flowchart of FIG.

Specifically, if it is determined in step S8 that there is a selection on the authentication information registration screen 120 in FIG. 5, authentication information registration availability determination processing is executed (step S18).

The authentication information registration availability determination process will be described later.
Then, after step S18, it is determined whether or not the authentication registration is OK (step S19). Specifically, the authentication control unit 25 determines whether or not the authentication registration is OK based on the determination result of the authentication information registration availability determination process in the registration availability determination unit 24.

If the authentication registration is OK, an authentication information registration confirmation process is executed next (step S9).

On the other hand, if the authentication registration is NG, it is processed as authentication registration failure (step S12). The processing after step S9 is the same as that described in FIG.

FIG. 28 is a flowchart illustrating authentication information registration availability determination processing in registration availability determination unit 24 according to the second embodiment of the present invention.

Referring to FIG. 28, first, feature data extraction processing for registered image information is executed (step S71). Next, it is determined whether or not the determination condition is satisfied (step S72).

In step S72, if the determination condition is satisfied, the authentication registration OK determination is made (step S24).

On the other hand, if the determination condition is not satisfied in step S72, authentication registration NG determination is made (step S23).

Then, the processing returns to FIG. 27 (return).
That is, in the authentication information registration availability determination process, if the determination condition is satisfied, the authentication registration is OK, and if the determination condition is not satisfied, the authentication registration is NG. Only when the authentication registration is OK, the process proceeds to the authentication information registration confirmation process.

FIG. 29 is a flowchart for explaining a specific example of authentication information registration availability determination processing in the registration availability determination unit 24.

Here, a case where registered image information with a low resolution is not registered for authentication will be described.
Referring to FIG. 29, here, the vertical and horizontal pixel sizes are acquired as the feature data of the registered image information (step S81).

Then, it is determined whether or not the acquired pixel size is a predetermined number or more (step S82). If it is determined that the number is equal to or greater than the predetermined number, authentication registration OK determination is made (step S83). On the other hand, if it is determined that the number is less than the predetermined number, authentication registration NG determination is made (step S84). Specifically, in this example, the determination is made based on 300 pixels as threshold values of the vertical and horizontal pixel sizes as an example.

For example, in the authentication execution screen of FIG. 4, it is assumed that the haze image information displayed together with the correct image information is stored in advance in the authentication image DB 14 as an image having a vertical and horizontal pixel size of 300 pixels or more. Therefore, when the vertical and horizontal pixel sizes of the registered image information are less than 300 pixels, for example, when displaying each image as the same size on the authentication execution screen of FIG. When the image is enlarged and displayed, since the image is displayed coarsely, it is highly likely that the correct image information is inferred. In this example, the case where the determination is made based on whether the vertical and horizontal pixel sizes are 300 pixels or more is described as an example. However, the present invention is not limited to this, and the size of the displayed image is taken into consideration. Therefore, it is possible to set to an appropriate number of pixels determined to have a low resolution.

In this case, a method for acquiring vertical and horizontal pixel sizes as feature data and determining whether to perform authentication registration OK determination or NG determination based on whether the vertical and horizontal pixel sizes are a predetermined number or more. Although described, the present invention is not particularly limited to this, and another determination condition can be used.

Further, it is also possible to extract another feature data of the registered image information that is considered that the registered image information is likely to be analogized as correct image information, and execute the authentication information registration availability determination process.

For example, as the feature data of the registered image information, for example, when the contrast of the registered image information is determined using a known technique as described in Japanese Patent Application Laid-Open No. 2001-243463, etc., it is too high or too low It is also possible to execute authentication registration NG determination. Further, as feature data, for example, a known technique such as that described in Japanese Patent Application Laid-Open No. 2006-28595 is used to extract a region where the red-eye phenomenon occurs, and the red-eye phenomenon occurs in the registered image information. If it is, the authentication registration NG determination can be executed. Further, as feature data, for example, a known technique as described in Japanese Patent Application Laid-Open No. 2005-159626 is used to determine whether or not the registered image information is in focus, and the focus is not in focus. In the case where it is determined, it is also possible to execute authentication registration NG determination. Further, as feature data of registered image information, for example, Exif (R) (ExchangeableImage as described in Japanese Patent Application Laid-Open No. 2004-343610, etc.)
It is also possible to extract the brightness using a well-known technique using (File Format) information and execute authentication registration OK judgment or NG judgment when the brightness of the registered image information is too high or too low It is. Further, for example, by using a known technique as described in Japanese Patent Application Laid-Open No. 2001-16467, etc., an extra color is overlapped due to the influence of the light source of the photographing place, etc., regarding the color tone of the registered image information. If it is determined whether the image is a so-called color cast image, and it is determined that the image is a color cast image, it is also possible to execute authentication registration NG determination. Furthermore, when it is determined whether or not the registered image information is a camera shake image, and it is determined that the image is a camera shake image, it is also possible to execute authentication registration NG determination. Further, it is possible to determine whether or not the registered image information is an image including a date. If the registered image information is an image including a date, the authentication registration NG determination can be executed.

Further, when the registered image information is the same as the bag image information already stored in the authentication image DB 14, it is also possible to execute authentication registration NG determination.

Note that the above determination condition is an example, and it is also possible to determine based on other determination conditions. Further, the number of determination conditions may be one, or the authentication registration OK determination may be performed when all the determination conditions are satisfied by combining the above determination conditions.

If the registered image information is selected that is not appropriate to be stored as registered image information before executing the image processing, the registered image information is registered before proceeding to the next step S9. By avoiding the image processing, the image processing is executed on the appropriate registered image information, so that the security can be improved.

(Modification 1 of Embodiment 2)
In the first modification of the second embodiment, another determination condition in the authentication information registration availability determination process will be described.

As a genre of 囮 image information stored in the authentication image database 14, only image information belonging to a natural image that is not a CG (computer graphic) image may be stored.

Therefore, in such a case, when registered image information of different genres, specifically, registered image information that is a CG image is stored as correct image information, the stored CG image is an image that is not a natural image. Therefore, there is a possibility that correct image information is easily inferred. Therefore, in order to eliminate such a case, it is possible to provide a determination condition for excluding a CG image as registered image information.

FIG. 30 is a flowchart illustrating a specific example of authentication information registration availability determination processing in registration availability determination unit 24 according to the first modification of the second embodiment of the present invention. The process shown in the flowchart described below is realized by executing a predetermined program stored in the ROM of the storage unit 16 in the registration availability determination unit 24. Here, a case where the CG image is not registered for authentication will be described.

Referring to FIG. 30, a CG image determination process is executed (step S91). And it is judged whether it is a CG image (step S92). Specifically, the CG image area of the registered image information and the photographic image area are discriminated using a known technique as described in Japanese Patent Application Laid-Open No. 2004-192401, etc. For example, when it is 10% or less, it can be determined that the image is a CG image as a whole. In this example, 10% or less is used as a criterion, but other numerical values may be used.

If it is determined in step S92 that the image is a CG image, authentication registration NG determination is made (step S93). On the other hand, if it is determined in step S93 that the image is not a CG image, authentication registration OK determination is made (step S94). Then, the process returns (return).

With this processing, the registered image information is determined before executing the image processing. For example, if the registered image information is determined to be a CG image, the authentication registration NG determination is made. Therefore, the CG image is used as the registered image information. It is possible to exclude the correct image information that is a CG image from being included in the haze image information that is a natural image on the authentication execution screen, and security can be improved.

Here, as the genre of the 囮 image information stored in the authentication image database 14, when only image information belonging to a natural image that is not a CG (computer graphic) image is stored, the registered image information The method of eliminating the CG image has been described. For example, when only a person image is stored as the genre of the cocoon image information, and when other landscape images are stored as correct image information. Since the correct image information may be easily inferred, the registered image information genre is stored by storing only the registered image information that is a person image using a known technique such as a person determination condition. It is also possible to restrict.

(Embodiment 3)
FIG. 31 is a schematic block diagram illustrating terminal device 5 # according to the third embodiment of the present invention.

Referring to FIG. 31, terminal device 5 # according to the third embodiment of the present invention is different in that control unit 10 is replaced with control unit 10 #. Since the other points are the same as those of the terminal device 5 described in FIG. 1, detailed description thereof will not be repeated.

The control unit 10 # is different from the control unit 10b in that a haze image registration unit 28 and a haze image search unit 29 are further added. Since other points are the same as those of the control unit 10b, detailed description thereof will not be repeated.

The saddle image registration unit 28 stores the correct image information and the correct image information to be displayed on the authentication execution screen when storing the processed image information as correct image information.

The heel image search unit 29 acquires the feature amount of the image information, and based on the acquired feature amount, the similar images are sequentially selected from a plurality of pieces of image information stored in the authentication image DB 14 in descending order of similarity. Search for.

FIG. 32 is a flowchart illustrating a process flow for executing the authentication process according to the third embodiment of the present invention. The process shown in the flowchart described below is realized by the control unit 10 # executing a predetermined program stored in the ROM of the storage unit 16. The same applies to the flowcharts processed by the functional blocks of the control unit 10 #.

Referring to FIG. 32, compared with the flowchart of FIG. 27, the authentication information registration confirmation process in step S9 is changed to another authentication information registration confirmation process (step S9 #), and the registered image information subjected to the image processing is changed. The difference is that after registration in the authentication image DB 14 (step S11), the process of registering the eyelid image (step S11 #) is further executed. Since other points are similar to those described above, detailed description thereof will not be repeated.

FIG. 33 is a flowchart illustrating authentication information registration confirmation processing according to the third embodiment of the present invention.

Referring to FIG. 33, first, in the authentication information registration permission / inhibition determination process (step S18), a process for acquiring the feature amount of the registered image information to be authenticated and registered in which authentication registration is determined to be OK is executed (step S101). Specifically, the authentication control unit 25 acquires the feature amount of the registered image information acquired by the authentication information registration availability determination process in the registration availability determination unit 27.

Next, a similar image search process is executed based on the acquired feature amount (step S102). Specifically, the authentication control unit 25 instructs the bag image search unit 29 to execute a similar image search process based on the acquired feature amount of the registered image information. In accordance with an instruction from the authentication control unit 25, the haze image search unit 29 determines the value of the registered image information based on values such as saturation and edge strength as the feature amount of the color and texture, for example. Similar image search processing is executed in descending order of similarity. As such a technique, for example, Visual RetrievalWare, which is a search software of Excalibur, and VIR Image Engine, which is a search software of Virage, are known. In this example, as an example, it is assumed that a similar saddle image information search process is executed from the authentication image DB 14 stored in advance.

Then, image processing is executed on the registered image information to be authenticated and registered (step S21). Specifically, as described with reference to FIG. 6, the authentication control unit 25 instructs the image processing unit 26 to execute image processing on the selected registered image information.

Then, an image to be registered (registered image information subjected to image processing) and a habit image that is a result of the search processing of similar images are displayed as a preview (step S22 #).

Specifically, the authentication control unit 25 instructs the registration permission confirmation unit 24 to display a preview image of the saddle image that is the result of the similar image search process together with the registered image information that has been image processed by the image processing unit 26. The registration availability confirmation unit 24 displays a registered image confirmation screen on the display unit 15 that displays a preview of the eyelid image together with the registered image information subjected to image processing.

FIG. 34 is a diagram illustrating a specific example of registered image confirmation screen 170 according to the third embodiment of the present invention.

Referring to FIG. 34, here, in FIG. 7, the original image (registered image information) 172 and the original image (registered image information) 172 when the selection button 129 is selected (pressed) on the authentication information registration screen 120 are displayed. On the other hand, an image subjected to image processing (registered image information subjected to image processing) 174 is displayed in the upper area. Here, as an example of the image processing, a case is shown in which “rubbing” processing is performed in which the original image is displayed as if it was rubbed.

In addition, a case is shown in which a bag image 176 to be displayed at the time of authentication is displayed in the lower area.

Specifically, the case where eight types of similar images are respectively displayed is shown.
In the registered image confirmation screen 170, when the OK button 178 is selected (pressed), the authentication registration is OK, and when the Cancel button 180 is selected (pressed), the authentication registration is NG.

When the user selects (presses) the OK button 178, the registered image information subjected to the image processing is stored as the correct image information in the authentication image DB 14, and the saddle image that is the result of the similar image search processing is also displayed. Are also stored in the authentication image DB 14.

Again referring to FIG. 33, it is next determined whether or not the registration is OK (step S23).
Specifically, the registration permission confirmation unit 24 determines whether or not the registration is OK based on whether or not a selection button indicating that the registration is OK is input on the registration image confirmation screen.

In step S23, if the registration is OK, the authentication registration is OK (step S24).

On the other hand, if the registration is not OK in step S23, authentication registration NG determination is made (step S25).

More specifically, when there is an input of a selection button indicating that the registration is OK, the registration propriety confirmation unit 24 outputs to the authentication control unit 25 as an authentication registration OK determination. In addition, when there is an input of a selection button (Cancel) indicating that the registration is NG, the registration propriety confirmation unit 24 outputs to the authentication control unit 25 as an authentication registration NG determination.

Then, the processing returns to FIG. 32 (return).
That is, in the authentication information registration confirmation process, if the user selects and inputs that the registration is OK, the authentication registration is OK, and if the user does not select and inputs that the registration is OK, authentication registration is performed. Becomes NG.

Referring again to FIG. 32, only when the authentication registration is OK, the registered image information whose authentication registration is OK is registered in the authentication image DB 14 as correct image information (step S11). Next, the haze image that is the result of the similar image search process is registered in the authentication image DB 14 (step S11 #). Then, the process ends (END).

Then, as described above, on the authentication execution screen, the correct image information registered by the user and the hail image information that is a result of the search processing of the similar images are respectively displayed, and the password is selected by selecting the correct image information. The user authentication process can be executed by a simple method rather than authentication.

By this processing, it is possible to use a similar image whose feature quantity is similar to that of the registered image information as the bag image information, so that it is possible to further improve security at the time of executing authentication.

FIG. 35 is a flowchart illustrating another authentication information registration confirmation process according to the third embodiment of the present invention.

Referring to FIG. 35, as compared with the flowchart of FIG. 33, a difference is that step S21 # for performing image processing on the bag image is added after step S21. Since the other points are the same as those described with reference to FIG. 33, detailed description thereof will not be repeated.

Specifically, in step S21 #, the image processing unit 26 performs image processing on a similar image that is a bag image in the same manner as the registered image information.

In step S22 #, the image-processed haze image and the image-processed haze image are displayed in the same manner as described above. The subsequent processing is the same as in FIG.

In this example, it is assumed that image processing is executed in step S21 # in order to increase the similarity for similar images obtained based on the search results. For example, FantaMorph, a morphing software from Abrosoft, and Magic Morph, a morphing software from iTinySoft Studio, are well known.

With this processing, it is possible to use a similar image whose feature amount is similar to that of the registered image information as the bag image information, and to further increase the similarity, so that it is possible to further improve the security at the time of executing authentication. .

FIG. 36 is a diagram for explaining a specific example of the authentication execution screen.
Referring to FIG. 36, here, as an example, in the authentication information registration screen described with reference to FIG. 7, one registered image information is subjected to image processing and displayed on the authentication execution screen and displayed on the authentication information registration screen. The case where the other image information that has been used is a bag image is shown. And the case where the other image information is also subjected to image processing and displayed on the authentication execution screen is shown.

Here, a case is shown where the same image processing as the image processing performed on the registered image information is performed on the bag image as the image processing.

As described above, it is possible to increase the similarity by executing the image processing on the samurai image, so that the security at the time of executing the authentication can be further improved.

FIG. 37 is a diagram for explaining another specific example of the authentication execution screen.
Referring to FIG. 37, here, as an example, in the authentication information registration screen described in FIG. 7, one registered image information is image-processed and displayed on the authentication execution screen and displayed on the authentication information registration screen. The case where the other image information that has been used is a bag image is shown. And the case where the other image information is also subjected to image processing and displayed on the authentication execution screen is shown.

Here, a case is shown in which a plurality of types of image processing is performed on the leopard image as the image processing.

As described above, it is possible to increase the similarity by executing the image processing on the samurai image, so that the security at the time of executing the authentication can be further improved.

In the above description, a terminal device such as a PC (Personal Computer) having the function of an authentication device has been described as an example. However, the present invention is not limited to a PC or the like and can be applied to other devices as well.

FIG. 38 is a schematic block diagram illustrating the configuration of a mobile terminal device 5p such as a PDA (Personal Digital Assistant) having the function of an authentication device.

38, the portable terminal device 5p is different from the terminal device 5 in that the operation unit 17 includes a touch panel 19 as compared with the terminal device 5. Therefore, it is possible to select (press) using the touch panel 19 instead of a pointing device such as a mouse. The other points are the same. Note that the terminal device 5 may be provided with a touch panel 19.

FIG. 39 is a schematic block diagram illustrating the configuration of the MFP 5q having the function of the authentication device.

Referring to FIG. 39, MFP (Multifunction Peripheral) 5q is capable of printing image information on a paper medium or the like, and image reading unit 6 capable of reading image information, as compared with terminal device 5. The image forming unit 7 is further included. Since the other points are the same, detailed description thereof will not be repeated.

That is, the authentication process described above can be executed at the time of authentication in the MFP 5q.

In the above description, the case where one registered image information is selected on the authentication information registration screen has been described. However, the number is not limited to one, and a plurality of registered image information can be selected. In that case, the authentication information registration availability determination process is executed for each registered image information. When a plurality of registered image information is selected, the authentication processing can be executed by selecting a plurality of stored correct image information on the authentication execution screen.

Also, when selecting a plurality of registered image information, the selection order can be included in the authentication data. For example, when two pieces of registered image information are selected, the authentication process may be executed by selecting the stored correct image information on the authentication execution screen according to the order of selecting the registered image information. .

In addition, it is also possible to provide a program that causes a computer to function for each unit that controls the terminal device to execute control as described in the above flow. Such a program is stored on a computer-readable recording medium such as a flexible disk, CD-ROM (Compact Disk-Read Only Memory), ROM (Read Only Memory), RAM (Random Access Memory), and memory card attached to the computer. And can be provided as a program product. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

The program may be a program module that is provided as a part of an operation system (OS) of a computer and that calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description of the embodiments but by the scope of claims, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

5, 5a, 5b, 5 # terminal device, 6 image reading unit, 7 image forming unit, 10, 10a, 10b, 10 # control unit, 12 internal bus, 14 authentication DB, 15 display unit, 16 storage unit, 17 operation section, 18 communication interface section, 19 touch panel, 20 authentication processing section, 22 image registration section, 23 image determination section, 24 registration enable / disable confirmation section, 25 authentication control section, 26 image processing section, 27 registration enable / disable determination section, 28 囮 image registration unit, 29 囮 image search unit.

Claims (15)

1. A display unit (15) for displaying an authentication screen;
   An image storage unit (14) in which correct image information that is authentication data that is at least one of the plurality of image information and the plurality of image information to be displayed on the authentication screen is stored;
   An authentication processing unit (20) that performs an authentication process based on whether image information selected from the plurality of image information displayed on the authentication screen matches the stored correct image information that is the authentication data. )When,
   An image processing unit (26) for performing image processing on the registered image information when the user stores in advance the registered image information to be registered in the image storage unit;
   An authentication apparatus, comprising: a registration availability confirmation unit (24) that displays a confirmation screen for confirming whether or not the registered image information subjected to the image processing is the correct image information on the display unit.
2. The image processing unit performs a plurality of different image processes on the registered image information,
   The registration propriety confirmation unit displays a plurality of image processed registration image information processed by the image processing unit on the confirmation screen, and registers at least one image processed from the plurality of image processed registration image information. The authentication device according to claim 1, wherein the authentication device receives selection input of image information.
3. The authentication apparatus according to claim 2, wherein the image processing unit executes the same image processing with different levels on the registered image information.
4. The registered image information selected in the image storage unit is stored as the correct image information, and at least one of the plurality of image processed registered image information excluding the correct image information is displayed on the authentication screen together with the correct image information. The authentication apparatus according to claim 1, further comprising an image registration unit (22) to be stored for display as an option.
5. 2. The authentication apparatus according to claim 1, wherein the registration availability confirmation unit displays, on the confirmation screen, a plurality of bag image information displayed as the plurality of image information on the authentication screen together with the correct image information.
6. 6. The authentication device according to claim 5, wherein the plurality of bag image information is obtained by performing image processing by the image processing unit in the same manner as the registered image information.
7. The authentication apparatus according to claim 6, wherein the image processing for the plurality of bag image information is the same image processing as that for the registered image information.
8. The authentication apparatus according to claim 6, wherein at least one image processing for the plurality of bag image information is an image processing different from the registered image information.
9. A feature extraction unit (27) for extracting feature data of the registered image information;
   Based on the feature data extracted by the feature extraction unit, among the plurality of image information stored in the image storage unit, the feature data is displayed on the confirmation screen as the saddle image information in descending order of similarity. The authentication apparatus according to claim 5, further comprising a similar image search unit (29) for searching for a similar image.
10. 10. The authentication apparatus according to claim 9, wherein the bag image information is obtained by performing image processing by the image processing unit in the same manner as the registered image information.
11. The authentication apparatus according to claim 1, wherein the confirmation screen is displayed before storing the registered image information as the correct image information in the image storage unit.
12. The authentication apparatus according to claim 1, wherein the confirmation screen is displayed after the registered image information is stored in the image storage unit as the correct image information.
13. 13. The authentication device according to claim 12, wherein the registration permission confirmation unit deletes the correct image information stored in the image storage unit when receiving an input of a deletion instruction.
14. An authentication method for an authentication apparatus comprising an image storage unit storing a plurality of pieces of image information to be displayed on an authentication screen of a display unit and correct image information which is authentication data that is at least one of the plurality of pieces of image information. There,
    Displaying an authentication screen (S3);
    Executing authentication processing based on whether image information selected from the plurality of image information displayed on the authentication screen matches stored correct image information as the authentication data (S5); ,
    A step (S21) of executing image processing on the registered image information when storing the registered image information to be registered in advance in the image storage unit;
    And (S22) displaying a confirmation screen for confirming whether or not the registered image information subjected to the image processing is the correct image information.
15. Executed by a computer of an authentication apparatus including an image storage unit that stores a plurality of pieces of image information to be displayed on an authentication screen of a display unit and correct image information that is authentication data that is at least one of the plurality of pieces of image information. Certification program,
    Displaying an authentication screen (S3);
    Executing authentication processing based on whether image information selected from the plurality of image information displayed on the authentication screen matches stored correct image information as the authentication data (S5); ,
    A step (S21) of executing image processing on the registered image information when storing the registered image information to be registered in advance in the image storage unit;
    An authentication program for executing processing, comprising: a confirmation screen for confirming whether or not the registered image information subjected to the image processing is the correct image information is displayed on the display unit (S22).

Images