JP2018112804A - Image processing method and apparatus, and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing method and an apparatus, and a system for preventing biometric information from being unintentionally leaked and for improving safety of biometric authentication.SOLUTION: An image processing method of a computer for invalidating biometric information from an image including the biometric information used for biometric authentication includes at least: an image input step S1 of inputting target image data by an image input unit; a biometric information recognition step S2 of recognizing whether or not the biometric information is included from the image by a biometric information recognition processing unit; a biometric information invalidating step S5 of performing predetermined image processing on an image region in the image including at least the biometric information and changing it to invalidated image data in which the biometric information cannot be recognized, by a biometric information invalidation processing unit; and an image outputting step S6 of outputting the invalidated image data by an image outputting unit.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a technique for invalidating a biometric information image used for biometric authentication included in an image captured from an imaging device.

In recent years, many technologies that use biometric authentication have been developed when performing authentication processing in computers and network systems.
For example, it is known to use a fingerprint, DNA, a palm shape, a retina, an iris, a face, a blood vessel, an ear shape and the like as a user's physical characteristics.
In addition, as a behavioral feature, handwriting (a method that uses wrinkles such as changes in trajectory, speed, and writing pressure at the time of writing. Research on authentication methods for estimating wrist rotation and finger length is also being conducted. ), Keystroke authentication (method using the keystroke speed and timing wrinkles of the keyboard), lip movement (method using the wrinkle of lip movement during speech), blinking (method of measuring the amount of change in the black eye area due to blinking) Walking (authentication method using human walking) has been proposed.

Most of the information related to biometric authentication (hereinafter referred to as biometric information) can be extracted from still images and moving images (hereinafter referred to as images), and the extraction technique is well known. For example, Patent Document 1 discloses a method for extracting the characteristics of a person.
Biometric information has been used because it was originally difficult to plagiarize, but in the past, there were many that focused on handling after acquisition. Patent Documents 2 to 5 are all techniques that disclose image extraction and subsequent deletion.

  On the other hand, recently, it is regarded as a problem that a malicious third party extracts biological information from an image taken carelessly and performs an act such as impersonation.

JP, 2006-51981, A JP2015-158921 JP2013-105424A JP2011-048523 JP2010-140499A

  An object of the present invention is to solve the conventional problems, and an object of the present invention is to prevent unintentional leakage of biometric information and improve the safety of biometric authentication.

In order to solve the above problems, the following means are provided.
According to the first embodiment of the present invention, a computer image processing method for invalidating biometric information from an image including biometric information used for biometric authentication, in which an image input unit inputs target image data. An image input step, a biometric information recognition processing unit recognizes whether or not biometric information is included in the image, and a biometric information invalidation processing unit includes at least biometric information in the image A biometric information invalidation step for performing predetermined image processing on an image region and changing to invalidation image data in which biometric information cannot be recognized, and an image output unit includes at least an image output step for outputting invalidation image data An image processing method is provided.

  According to a second embodiment, in the image processing method, the biological information is at least one of images related to a fingerprint, a palm print, a palm shape, a retina, an iris, a face, a blood vessel, and an ear shape. The described image processing method is provided.

  According to the third embodiment, there is provided an image processing method in which the image processing performs at least one of pixelation processing and color reduction processing.

  According to the fourth embodiment, in the image processing method, when at least biological information is included after the biological information recognition step, the recognition result output unit recognizes whether biological information is included. A recognition result output step for outputting a result, and an invalidation instruction receiving unit has an invalidation instruction receiving step for accepting an instruction as to whether or not to invalidate the biological information from the user, and the biometric information invalidation step is performed according to the instruction result An image processing method for executing processing is provided.

  According to the fifth embodiment of the present invention, there is provided an image processing device for a computer that invalidates biometric information from an image including biometric information used for biometric authentication, and an image input unit that inputs target image data; A biometric information recognition processing unit for recognizing whether or not biometric information is included in an image, and invalidation in which biometric information cannot be recognized by performing predetermined image processing on an image area including at least biometric information in the image There is provided an image processing apparatus comprising at least a biometric information invalidation processing unit for changing to image data and an image output unit for outputting invalidated image data.

  According to the sixth embodiment of the present invention, there is provided an image processing method in a network system for invalidating biometric information from an image including biometric information used for biometric authentication. The network system communicates with a plurality of terminal devices. An image receiving step in which the image receiving unit of the server device receives target image data from the terminal device, and the biometric information recognition processing unit of the server device includes the biometric information from the image. The biometric information recognition step for recognizing whether or not the biometric information is invalidated, and the biometric information invalidation processing unit of the server apparatus performs predetermined image processing on an image area including at least the biometric information in the image, and the biometric information cannot be recognized The biometric information invalidation step for changing to invalidated image data, and the image output unit of the server device sends the invalidated image data to the server device. It exists or an image output step of transmitting to the terminal device to provide an image processing method characterized by including at least.

  According to the seventh embodiment, in the image processing method, if at least biometric information is included after the biometric information recognition step, the result transmission unit of the server device includes biometric information. A recognition result transmitting step for transmitting the recognition result to the terminal device, and an invalidation instruction receiving unit for receiving an instruction from the terminal device regarding whether or not the invalidation instruction receiving unit of the server device invalidates the biological information. There is provided an image processing method including a step and executing a biometric information invalidation step according to an instruction result.

  ADVANTAGE OF THE INVENTION According to this invention, it can prevent that biometric information flows out unintentionally, and can improve the safety | security of biometric authentication. In particular, it is difficult to recognize whether or not biometric information is included in the image, but according to the present invention, the biometric information is automatically invalidated even if the user takes an image without paying particular attention. Therefore, it is possible to improve both usability and biometric authentication safety.

  Furthermore, if the present invention is implemented in a server device that provides an SNS or the like, it is possible to prevent unintended biological information from being exposed to the network, improve network security, and contribute to the added value of services. To do.

1 is a configuration diagram of an image processing apparatus according to the present invention. 3 is a flowchart of an image processing method according to the present invention. 1 is a configuration diagram of an image processing system according to the present invention. 3 is a flowchart of an image processing method according to the present invention.

The image processing method, apparatus, and system according to the present invention will be described below. The present invention is implemented using a computer, and any computer such as a known personal computer, network server, terminal device, smartphone, mobile phone, game machine, digital camera having an image processing function may be used as the computer. Can be used.
Moreover, it is not limited to the following Example, It can change arbitrarily in the range of a claim statement.

Example 1
The present invention provides a computer image processing method for invalidating biometric information from an image including biometric information used for biometric authentication. FIG. 1 shows an image processing apparatus 1 according to the present invention, and FIG. 2 shows an image processing method according to the present invention.
The image processing apparatus 1 includes a CPU 10 of a computer, and the CPU 10 includes an image input unit 101, a biological information recognition processing unit 102, a biological information invalidation processing unit 105, and an image output unit 106. In addition, the recognition result output unit 103 and the invalidation instruction reception unit 104 can be selectively provided. Each of these processes is realized by executing a program stored in a storage medium (not shown) such as a memory or an external storage device.

  Along with the CPU 10, a network interface 11 for performing network communication such as the Internet, a monitor 12, a card slot 13 for reading and writing a memory card for storing image data, and an image acquisition unit 14 such as an imaging unit and a sensor unit can be provided. These are all provided selectively.

As shown in FIG. 2, first, the image input unit 101 performs an image input step S1 for inputting target image data. As a method for inputting image data, an image acquisition unit 14 such as an image sensor provided in the apparatus 1 itself, an external digital camera, a fingerprint sensor, a palm print sensor, a retina sensor, an iris sensor, a blood vessel sensor, or the like. Input image data or reading image data stored in a memory card using the card slot 13.
Further, the image input unit 101 may input by acquiring image data through the network interface 11.

  For the input image, fingerprints, palm prints, palm shapes, retinas, irises, faces, blood vessels, ear shapes, handwriting, lip movement, blinking, walking, etc. can be used. The image includes a still image and a moving image. In the moving image, any one frame may be used, or a plurality of transition images may be used.

When the image is input, the biological information recognition processing unit 102 performs a biological information recognition step S2 for recognizing whether the biological information is included from the image.
A method for recognizing biometric information input in an image is known and will not be described in detail, but a method known as biometric authentication technology can be applied. In the present invention, the authentication itself is not performed, but the purpose is to invalidate the biometric information necessary for the authentication. Therefore, a highly accurate process similar to the authentication is not necessarily required.

  For example, in the case of fingerprint / palmprint authentication, a general fingerprint / palmprint technology extracts feature points included in a pattern, or performs extraction by paying attention to the direction and change of the pattern. It is sufficient if it can be acquired whether or not extractable information is included in the image. A technique for extracting whether or not biometric information is included is also known. For example, a sample image (such as a fingerprint image or a palmprint image) of biometric information to be invalidated is stored in advance, and a certain amount of these images is stored. The biometric information recognition process can be performed by recognizing whether an image in which similarity is recognized is included. Various methods for measuring the degree of similarity of images are well known.

  In addition, when a palm shape, a retina, an iris, a face, a blood vessel, an ear shape or the like is used as biological information, it is extracted whether or not these shapes are included in the image. For example, in the retina, iris, blood vessel, and the like, there is a case where collation processing is performed after performing image processing in advance at the time of biometric authentication. The biometric information recognition processing unit 102 performs these known image processing and then performs biometric processing. It is also possible to recognize whether information is included or not.

In addition, when targeting handwriting, lip movement, blinking, walking, etc.
A plurality of images in the moving image are used to recognize whether or not the information used can be acquired.

  When the input image data includes an image similar to a fingerprint or a palm print, this area in the image is referred to as a biometric information image area, and the biometric information invalidation processing unit 105 performs a biometric information invalidation step. S5 is executed. In the biometric information invalidation step S5, predetermined image processing is performed on at least the biometric information image area in the image, and the biometric information is changed to invalid image data that cannot be recognized. The target of the image processing is not limited to the biometric information image region, but may be up to a region near the biometric information image region or the entire image data.

  As image processing, pixelation processing generally referred to as mosaic processing, or color reduction processing that reduces the number of colors or shades can be performed. According to the pixelation process, the biometric authentication becomes impossible because the resolution is reduced to reduce the discrimination. Further, even in the color reduction processing, the biometric authentication becomes impossible because the color and darkness of the biometric information and other parts are reduced or eliminated.

  The image data targeted by the present invention is not what the user intended to shoot a fingerprint or the like in the first place, but is a detail that was unintentionally reflected by the enhancement of the performance of the imaging device. Even if the biological information image region is changed by color reduction processing, there is an advantage that an image without a sense of incongruity can be provided.

  The image processing method can be appropriately implemented according to the recognized biological information, but it is also preferable to perform deformation in addition to pixelation and color reduction processing. That is, when using fingerprints, palm prints, palm shapes, faces, blood vessels, ear shapes, handwriting, lip movement, blinking, walking, etc., it is difficult to perform biometric authentication by deforming the image into a predetermined shape. The deformation may be performed only by expanding and contracting in a predetermined direction, or by changing the position of each pixel according to a predetermined conversion formula. Only the biological information image region or its vicinity can be changed.

  When moving images such as handwriting, lip movement, blinking, walking, etc., changing the length of each frame changes the transition timing in the moving image, making authentication difficult. You can also.

In the present invention, any other method can be appropriately employed for the image processing. The number of image processing methods is not limited to one, and a plurality of image processing methods can be combined.
The image processing is desirably irreversible, but may be a reversible processing that can be restored by a person having management authority.

  Finally, the image output unit 106 performs an image output step S6 for outputting invalid image data. The output mode is arbitrary, but it may be stored in a storage medium (not shown), the invalidation image may be transmitted to the outside through the network interface 11, or the invalidation image may be displayed from the monitor 12. However, it may be stored in the memory card by the card slot 13.

As another example, the method may allow a user to intervene whether to invalidate or not.
Therefore, a recognition result output step S3 for outputting a recognition result indicating whether or not the biometric information is included when the biometric information is included at least when the biometric information is included after the biometric information recognition step S2. The invalidation instruction accepting unit 104 may include an invalidation instruction acceptance step S4 for accepting an instruction as to whether or not to invalidate the biometric information from the user, and the biometric information invalidation step may be executed according to the instruction result.

The recognition result output unit 103 outputs the recognition result when the biometric information recognition processing unit 102 recognizes that the biometric information is included as a result of the recognition or when it is determined that the biometric information is likely to be included. be able to. The latter possibility can be determined, for example, when the image similarity is higher than a predetermined threshold or when the accuracy is high by a known image recognition technique.
As a method of outputting the recognition result, notification may be given to the outside through the network interface 11 or may be displayed from the monitor 12.

  The invalidation instruction receiving unit 104 receives an instruction from the outside through the network interface 11 or an invalidation instruction from the user through an input unit such as a keyboard, a mouse, or a touch panel (not shown). If there is, the biometric information invalidation processing unit 105 can be notified to perform the invalidation process.

  In the present invention, even when it is not recognized that biometric information is included, it is possible to notify the user that it is not included and to determine whether it is actually included. In that case, even if it is determined that the biometric information is not included in the biometric information recognition processing unit 102, the biometric information invalidation processing unit 105 can perform invalidation processing on the image data.

(Example 2)
According to the second embodiment of the present invention, it is possible to provide an image processing apparatus 1 for a computer that invalidates biometric information from an image including biometric information used for biometric authentication.
The apparatus 1 includes an image input unit 101 for inputting target image data, a biometric information recognition processing unit 102 for recognizing whether biometric information is included from the image, and at least biometric information in the image. A biometric information invalidation processing unit 105 that performs predetermined image processing on an image area and changes to invalidated image data in which biometric information cannot be recognized, and an image output unit 106 that outputs invalidated image data. .

The apparatus 1 can have the same configuration as that of the image processing apparatus 1 shown in the first embodiment. For example, the apparatus 1 can include a recognition result output unit 103 and an invalidation instruction reception unit 104.
The other embodiments are the same as above.

(Example 3)
According to the third embodiment of the present invention, it is possible to provide an image processing method in a network system for invalidating biometric information from an image including biometric information used for biometric authentication. FIG. 3 shows a configuration diagram of the network system, and FIG. 4 shows a process flowchart.

  As illustrated, the network system includes a plurality of terminal devices 30 and a server device 20 connected by a communication network 40, and the image receiving unit 201 of the server device receives target image data from the terminal device 30. Image receiving step S11, the biometric information recognition processing unit 202 of the server device recognizes whether or not biometric information is included in the image, and the biometric information invalidation processing unit 205 of the server device The biometric information invalidation step S15 in which predetermined image processing is performed on at least the image area including the biometric information and the biometric information is changed to invalid image data that cannot be recognized, and the image output unit 206 of the server device invalidates the biometric information. The image output step S16 for saving the image data in the server device 20 or transmitting the image data to the terminal device 30 is reduced. To provide an image processing method characterized by including the.

  In the above image processing method, whether or not the recognition result transmission unit 203 of the server device 20 includes biometric information when at least biometric information is included after the biometric information recognition step S12. Recognition result transmission step S13 for transmitting the recognition result to the terminal device 30, and the invalidation instruction receiving unit 204 of the server device 20 receives the user's instruction as to whether or not to invalidate the biological information from the terminal device 30 The biometric information invalidation step can be executed according to the instruction result.

  The third embodiment is the same as each process in the first and second embodiments, and detailed description thereof is omitted. In particular, in the server device, the biological information recognition processing unit 102, the recognition result output unit 103, and the invalidity in the image processing device 1 are invalid. Processing similar to that of the activation instruction receiving unit 104 and the biometric information invalidation processing unit 105 can be performed.

  By implementing the server device 20 according to the present embodiment in, for example, a server of a social network system, it is possible to invalidate biometric information from an image uploaded from a registered user, and simultaneously improve the safety and convenience of the service, It also contributes to increasing the added value of services.

1 Image processing apparatus 10 CPU
DESCRIPTION OF SYMBOLS 11 Network interface 12 Monitor 13 Card slot 14 Image acquisition part 101 Image input part 102 Biometric information recognition process part 103 Recognition result output part 104 Invalidation instruction reception part 105 Biometric information invalidation process part 106 Image output part

Claims (7)

A computer image processing method for invalidating biometric information from an image including biometric information used for biometric authentication,
An image input step in which the image input unit inputs target image data;
A biological information recognition step in which the biological information recognition processing unit recognizes whether or not biological information is included from the image;
A biometric information invalidation step in which a biometric information invalidation processing unit performs predetermined image processing on an image region in which at least the biometric information is included in the image, and changes to invalidated image data in which the biometric information cannot be recognized;
An image processing method, wherein the image output unit includes at least an image output step of outputting the invalidated image data. In the image processing method,
The image processing method according to claim 1, wherein the biological information is at least one of images related to fingerprints, palm prints, palm shapes, retinas, irises, faces, blood vessels, and ear shapes. The image processing method according to claim 1, wherein the image processing performs at least one of pixelation processing and color reduction processing. In the image processing method, after the biological information recognition step,
A recognition result output step for outputting a recognition result as to whether or not the recognition result output unit includes biometric information when at least biometric information is included;
4. The invalidation instruction receiving unit includes an invalidation instruction receiving step for receiving an instruction as to whether or not to invalidate biometric information from a user, and executes the biometric information invalidation step according to the instruction result. An image processing method according to any one of the above. An image processing apparatus for a computer that invalidates biometric information from an image including biometric information used for biometric authentication,
An image input unit for inputting target image data;
A biological information recognition processing unit for recognizing whether biological information is included from the image;
A biometric information invalidation processing unit that performs predetermined image processing on an image area including at least the biometric information in the image, and changes the biometric information to invalidated image data that cannot be recognized;
An image processing apparatus comprising: at least an image output unit that outputs the invalidated image data. An image processing method in a network system for invalidating biometric information from an image including biometric information used for biometric authentication, the network system comprising a plurality of terminal devices and a server device connected by a communication network. ,
An image receiving step in which the image receiving unit of the server device receives target image data from the terminal device;
A biological information recognition step in which the biological information recognition processing unit of the server device recognizes whether or not biological information is included from the image;
The biometric information invalidation processing unit of the server device performs predetermined image processing on an image area including at least the biometric information in the image and changes the biometric information to invalidated image data that cannot be recognized. Invalidation step,
An image processing method characterized in that the image output unit of the server device includes at least an image output step of storing the invalidated image data in the server device or transmitting it to the terminal device. In the image processing method, after the biological information recognition step,
A recognition result transmission step of transmitting, to the terminal device, a recognition result indicating whether or not the result transmission unit of the server device includes biometric information when at least biometric information is included;
The invalidation instruction receiving unit of the server device has an invalidation instruction receiving step for receiving a user instruction as to whether or not to invalidate biometric information from the terminal device, and the biometric information invalidation step is performed according to the instruction result. The image processing method according to claim 6, wherein execution processing is performed.

Images