JP7238617B2 - Service providing device, service providing system, program, and service providing method - Google Patents

Description

The present invention relates to a service providing apparatus and the like for providing services to users.

Currently, services using face recognition technology are provided in various places, and users enjoy convenience in various ways. For example, Patent Literature 1 describes an example in which face authentication is performed for user entrance/exit management.

In cases where such face authentication is performed, the user's face image is often registered in advance and managed by a server or the like. However, since the face image is biometric information of the user, it cannot be easily changed like an ID or password. Therefore, if the face image data is obtained and misused by a third party, it may develop into a serious problem, and it is necessary to pay attention to the use of the face image.

On the other hand, Non-Patent Literatures 1 and 2 introduce techniques for processing facial photographs to avoid identification of a user by face recognition technology and invalidate face recognition. This technology performs a processing process that makes a large number of very minute changes to the pixels of the image that makes up the face photo, so that at first glance it looks the same as the original face photo, but from the algorithm used for face recognition, it is a completely different person. This is to create a processed image that is judged to be the image of the person, and to prevent face recognition by artificial intelligence or the like.

Patent No. 5211797

Nikkei XTECH Special, “Privacy protection D-ID by disabling face authentication”, [online], [Searched on June 4, 2019], Internet <URL: https://special.nikkeibp.co.jp/atclh /NXT/18/israelinjapan0725/p4/index.html> CNET JAPAN, “D-ID officially released a product for protection against face recognition at TechCrunch Disrupt 2018”, [online], [searched June 12, 2019], Internet <URL: https://japan .cnet.com/release/30268177/〉

Processed images processed by techniques such as those described above cannot be used to identify an individual using face recognition technology, so they are excellent from the standpoint of personal information protection, and are less risky than facial images when used in a variety of ways. However, when providing a service that requires user identification on the system, it is difficult to use the processed image as it is for the service.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to provide a service providing apparatus or the like capable of specifying a user and providing a service while using a processed image.

A first invention for solving the aforementioned problems is a service providing apparatus for providing a service to a user, which stores a processed image obtained by processing a biometric image of the user and a facial image of the user. storage means; authentication means for authenticating a user by using the processed image before providing the service; and a collation means for specifying by collation, wherein the authentication means acquires a processed image of a medium held by a user and performs authentication by collation with the processed image stored in the storage means. It is a service providing device that provides

According to the service providing apparatus of the first invention, the user is authenticated using the processed image obtained by processing the biometric image of the user before the service is provided. It is possible to identify the user by matching the face image and provide the service to the user. Since the processed image obtained by processing the biometric image is not the biometric image itself, it is possible to avoid identifying the user even if it is leaked, and it can be used in a variety of ways, such as having a processed image for authentication on a medium such as an ID card. small risk. On the other hand, face images are used only when authentication using a processed image is successful, so there is little need for such diverse uses, and they can be placed under highly confidential management. Further, authentication can be performed using a processed image for authentication displayed or recorded on a medium such as an ID card held by the user or a user terminal.

After authenticating the user using the processed image, it is preferable that the authenticating means further authenticate the user using the face image.
As a result, it is possible to prevent spoofing by a third party who illegally obtains the processed image, thereby improving security.

The biometric image may be any one of a fingerprint, a vein pattern, and an iris image.
In the present invention, it is also possible to process biometric images such as fingerprints, vein patterns, and irises to obtain the above-described processed images. be able to.

A second aspect of the invention is a service providing apparatus for providing a service to a user, comprising storage means for storing a processed image obtained by processing a biometric image of the user and a facial image of the user; (2) authenticating means for authenticating a user using the processed image; and matching means for identifying a user who receives a service by matching a face image when the authentication by the authenticating means is successful. and wherein the biometric image is a face image of the user.
According to the service providing apparatus of the second invention, before providing the service, the user is authenticated using the processed image obtained by processing the biometric image of the user. It is possible to identify the user by matching the face image and provide the service to the user. Since the processed image obtained by processing the biometric image is not the biometric image itself, it is possible to avoid identifying the user even if it is leaked, and it can be used in a variety of ways, such as having a processed image for authentication on a medium such as an ID card. small risk. On the other hand, face images are used only when authentication using a processed image is successful, so there is little need for such diverse uses, and they can be placed under highly confidential management. In addition , the user only needs to photograph a face image at the time of pre-registration for using the service, and the burden of the registration work is light. In addition, for pre-registration, an ordinary camera is sufficient, and a separate photographing device or the like is not required, which simplifies the system.

It is desirable that the processed image is the face image processed to avoid identification of the user by face recognition technology.
As in Non-Patent Literatures 1 and 2, by applying processing to the face image to avoid identifying the user by face recognition technology, the user cannot be identified depending on the processed image, which is excellent from the viewpoint of personal information protection. In addition, since the processed image can be made to look almost the same as the original face image, it has a high utility value and can be used for visual confirmation of an individual by being displayed on the above-mentioned medium, for example.

It is desirable that the service providing device has service providing means for transmitting information relating to the service to the user terminal of the user identified by the matching means. The information is, for example, location information of the user.
In the present invention, the service can be provided by transmitting the information related to the service to the user terminal of the user who receives the service. For example, by using the information as the user's location information, a location guide service can be provided to the user.

A third aspect of the invention is a service providing system comprising a service providing device for providing a service to a user and a medium held by the user, wherein the medium is a processed image obtained by processing the biometric image of the user. The service providing apparatus has an image, and includes storage means for storing the processed image and the user's face image, authentication means for authenticating the user using the processed image before providing the service, and the authentication means. and verification means for identifying a user to be provided with the service by verifying the face image of the user to whom the service is provided when the authentication by the authentication is successful.

For example, the biometric image is a user's facial image, and the service providing system of the third invention processes the user's facial image to create a processed image, and sends the user's facial image and the processed image to the service providing device. A user terminal for transmission is further provided, and the service providing apparatus stores the user's face image and its processed image transmitted from the user terminal in the storage means.
This allows the user terminal to process the face image and use the processed image for pre-registration. Also, the processed image can be displayed on the user terminal and used for visual identification of the person.

A fourth aspect of the invention is a service providing apparatus for providing a service to a user by storing a processed image, which is an image obtained by processing a user's biometric image, and a user's facial image. authentication means for authenticating a user by using the processed image; and verification means for identifying a user who receives the service by verifying the face image when the authentication by the authentication means is successful. The authentication means is a program for functioning as a service providing apparatus that acquires a processed image held by a medium held by a user and performs authentication by matching with the stored processed image.
A fifth aspect of the present invention is a service providing apparatus for providing a service to a user by storing a processed image, which is an image obtained by processing a user's biometric image, and a user's facial image. authentication means for authenticating a user by using the processed image; and verification means for identifying a user who receives the service by verifying the face image when the authentication by the authentication means is successful. The biometric image is a program for functioning as a service providing apparatus in which the user's face image is provided.

A sixth aspect of the invention is a service providing method for providing a service to a user by a computer that stores a processed image that is a processed image of a user's biometric image and a user's face image, wherein the computer stores a a step of authenticating the user using the processed image; and, if the user authentication is successful, a step of identifying the user who receives the service by matching the face image when the service is provided , The service providing method is characterized in that, in the authentication step, a processed image held by a medium held by the user is obtained, and authentication is performed by comparing the processed image with the stored processed image.
A seventh invention is a service providing method for providing a service to a user by a computer that stores a processed image that is a processed image of a user's biometric image and a user's face image, wherein the computer stores a a step of authenticating the user using the processed image; and, if the user authentication is successful, a step of identifying the user who receives the service by matching the face image when the service is provided, The service providing method is characterized in that the biometric image is a face image of the user.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a service providing apparatus or the like that can specify a user and provide a service while using a processed image.

1 is a diagram showing the configuration of a service providing system 1; FIG. 3 shows an example of a hardware configuration of a service providing device 3; FIG. 3 shows user information 310 and face image data 320. FIG. FIG. 10 is a diagram showing processing of a face image 322; FIG. An example of a hardware configuration of a user terminal 4. FIG. 3 is a diagram showing a functional configuration of a service providing device 3; FIG. An example of a facility where the location service is provided. 6 is a flow chart showing a procedure of user authentication using a processed image; 4 is a flowchart showing a procedure for user face authentication; 4 is a flow chart showing a procedure for providing a location guidance service; The figure which shows a user's movement path|route. An example of a position guidance screen 452. FIG. An example of a processed image 314. FIG. An example of displaying a processed image 314 on the user terminal 4 .

Preferred embodiments of the present invention will be described in detail below with reference to the drawings.

(1. Service providing system 1)
FIG. 1 is a diagram showing the configuration of a service providing system 1 according to an embodiment of the present invention. The service providing system 1 of this embodiment will be described as an example of a system that provides location guide services in facilities such as amusement parks, art museums, event facilities, airports, and the like.

As shown in FIG. 1, the service providing system 1 includes a service providing device 3, user terminals 4, facility terminals 6, and the like. These are communicably connected via a network 9 .

The service providing device 3 is for providing a location guide service for notifying the location information of the user in the facility to the user holding the medium such as the user terminal 4 or the ID card 5 . The service providing device 3 performs user authentication before providing a service, transmits the location information of the user to the user terminal 4 of the successfully authenticated user, and provides a location guidance service.

FIG. 2 is a diagram showing the hardware configuration of the service providing device 3. As shown in FIG. As shown in FIG. 2, the service providing device 3 can be implemented by a computer configured by connecting a control unit 301, a storage unit 302, a communication unit 303, and the like via a bus 309. FIG. However, the configuration of the service providing device 3 is not limited to this, and can be changed as appropriate.

The control unit 301 includes a CPU, ROM, RAM, and the like. The CPU calls a program stored in a storage medium such as the storage unit 302 or a ROM to a work area on the RAM and executes the program. The ROM is a non-volatile memory that permanently holds programs such as a boot program and BIOS, data, and the like. The RAM is a volatile memory that temporarily holds programs and data loaded from the storage unit 302, ROM, etc., and has a work area that the control unit 301 uses to perform various processes.

The storage unit 302 is a hard disk drive, a solid state drive, or the like, and stores programs to be executed by the service providing apparatus 3 in the process described later, data necessary for executing the programs, an OS, and the like. These programs and data are read and executed by the control unit 301 as necessary.

The communication unit 303 has a communication control device, a communication port, etc., and mediates communication via the network 9 . The service providing device 3 is communicably connected to the user terminal 4 and the like via the network 9, and can transmit and receive various data.

As shown in FIG. 1, user information 310, face image data 320, and the like are stored in advance in the storage unit 302 of the service providing apparatus 3. FIG.

FIG. 3A is a diagram showing user information 310. As shown in FIG. In this embodiment, as the user information 310, the user ID 311 of the user who receives the service, the user registration information 312, the destination 313, the processed image 314, etc. are stored in association with each other.

The user ID 311 is identification information for identifying a user, and is issued by the service providing apparatus 3, for example, when the user performs pre-registration for using the service.

The user registration information 312 is information that the user registers in advance, such as the user's name, address, age, and the like.

A transmission destination 313 is a transmission destination of the user's location information provided to the user as a service by the service providing apparatus 3, and is registered when the user is pre-registered. The destination 313 is, for example, the user's e-mail address.

The processed image 314 is an image created by the service providing apparatus 3 by processing the user's face image 322 by image processing, as shown in FIG. This processed image 314 is also displayed on the ID card 5 held by the user (see FIG. 1).

In this embodiment, as the processed image 314, a user's face image 322 processed to avoid identification of the user by face recognition technology using artificial intelligence or the like is used. For example, as shown in Non-Patent Literatures 1 and 2 mentioned above, by applying face authentication disabling technology provided by D-ID Inc. and adding a large number of very fine changes to the pixels of the face image 322, 4, it looks the same as the original face image 322 to the human eye, but is processed so that it is judged to be an image of a completely different person from the algorithm used for face recognition.

However, the processed image 314 is not limited to this, and an image obtained by processing the user's face image 322 into an animation style or a painting style may be used. By processing the image into an anime-like or painting-like image, it is possible to express the features of the user's face while making it impossible for the face recognition algorithm to identify the user, thus avoiding the user's identification by face recognition technology. can.

FIG. 3B is a diagram showing face image data 320. As shown in FIG. In this embodiment, as the face image data 320, a user ID 311, a face image 322, a service usage state 323, etc. of the user receiving the service are stored in association with each other.

The face image 322 is the face image of the user. For example, when the user performs pre-registration, the user takes his or her own face image with the camera 406 (see FIG. 5) of the user terminal 4 and transmits it to the service providing apparatus 3 for registration. .

The service usage status 323 is information indicating the user's current service usage status, and while the user is being provided with the location guide service, information indicating that the service is being used ("use" in the example of the figure) is displayed. Recorded.

Returning to the description of FIG. The user terminal 4 is a terminal held by a user who receives service, and is a mobile terminal such as a smart phone or a tablet terminal, for example.

FIG. 5 is a diagram showing the hardware configuration of the user terminal 4. As shown in FIG. As the user terminal 4, for example, a computer terminal configured by connecting a control unit 401, a storage unit 402, a communication unit 403, an input unit 404, a display unit 405, a camera 406, an audio input/output unit 407 and the like via a bus 409 is used. . However, the configuration of the user terminal 4 is not limited to this, and can be changed as appropriate.

The functions of the control unit 401, the storage unit 402, and the communication unit 403 of the user terminal 4 are substantially the same as the control unit 301, the storage unit 302, and the communication unit 303 described above, and the storage unit 402 stores an application for service provision. be done. The display unit 405 is, for example, a liquid crystal display, and is provided with a touch panel as the input unit 404 . A camera 406 is, for example, a digital camera equipped with an imaging device such as a CCD or CMOS. The audio input/output unit 407 includes a microphone for inputting audio, a speaker for outputting audio, and the like.

The facility terminal 6 is a terminal installed in a facility, and can be realized by a computer including a control section, a storage section, a communication section, and the like. The facility terminal 6 is communicably connected to a plurality of cameras 7 installed in the facility to provide the location guidance service.

Next, the functional configuration of the service providing device 3 in the service providing system 1 will be described with reference to FIG. As shown in FIG. 6, the service providing device 3 has storage means 31, authentication means 32, collation means 33, service providing means 34, and the like.

The storage unit 31 corresponds to the storage unit 302 of the service providing device 3 and stores user information 310 including a user's processed image 314 and face image data 320 including a user's face image 322 .

The authentication means 32 is for the control section 301 of the service providing device 3 to authenticate the user before providing the service. As will be described later, in this embodiment, two-stage authentication using the processed image 314 and the face image 322 is performed.

The matching means 33 identifies the user who receives the service when the control unit 301 of the service providing apparatus 3 provides the service by matching the face image when the user authentication is successful.

The service providing means 34 provides the service to the specified user by the control unit 301 of the service providing device 3 . In the present embodiment, a location guide service is provided to the user by transmitting location information of the user as information related to the service to the user terminal 4 of the user.

(2. Service provision method)
Next, the processing (service providing method) executed in the service providing system 1 of this embodiment will be described. The service providing system 1 of the present embodiment mainly performs three processes of user authentication using the processed image 314, user face authentication, and provision of a location guidance service to the user, and each procedure will be described below.

In this embodiment, as described above, the user registers the user registration information 312, the destination 313, and the face image 322 in the service providing apparatus 3 at the time of pre-registration for using the service. processes the face image 322 of the user to create a processed image 314 and issues a user ID 311 . Then, the user ID 311 , user registration information 312 , destination 313 , and processed image 314 are linked and stored in the storage unit 302 as user information 310 . The face image data 320 is created by associating the face image 322 with the user ID 311 and leaving the service usage state 323 blank, and is also stored in the storage unit 302 .

On the other hand, the ID card 5 displaying the processed image 314 is provided by the service provider to the user who has completed the pre-registration. The processed image 314 is displayed on the face of the ID card 5 by pasting or printing on the ID card 5 . The ID card 5 may be sent to the address of the user, or the print data of the ID card 5 may be sent to the user terminal 4 so that it can be printed by a home printer or a multimedia terminal such as a convenience store. .

(2-1. User Authentication by Processed Image 314)
The user enters the facility with the ID card 5 described above. FIG. 7 shows an example of this facility. In the facility where the location guide service is provided, cameras 7 (7a to 7t) are installed at multiple locations on the upper and lower floors, and each camera 7 captures a picture of the visitor. be done.

When the user gets lost in the facility and wants to receive the location guide service, first, the user is authenticated using the processed image 314 .

FIG. 8 is a flowchart showing the procedure of user authentication using the processed image 314. S101-S102, S107-S108, and S110-S111 in FIG. do. Other processes are executed by the control unit 301 of the service providing device 3 controlling each component of the service providing device 3 .

At the time of user authentication using the processed image 314, the user first activates an application for providing a service on the user terminal 4, and photographs the processed image 314 of the ID card 5 with the camera 406 (S101). The user terminal 4 transmits the photographed processed image 314 of the ID card 5 to the service providing device 3 (S102).

When the service providing device 3 receives and acquires the processed image 314 of the ID card 5 from the user terminal 4 (S103), it performs user authentication by collating the processed image 314 (S104).

In S104, for example, the processed image 314 of the ID card 5 and the processed image 314 of the user information 310 are collated, and the processed image 314 of the user information 310 that matches the processed image 314 of the ID card 5 is searched. As a result of collation, if there is no processed image 314 of the user information 310 that matches the processed image 314 of the ID card 5, the authentication fails (S105; No). ) to the user terminal 4 (S106).

Upon receiving the authentication result (S107), the user terminal 4 displays the authentication result on the display unit 405 (S108), and ends the process.

On the other hand, if there is a processed image 314 of the user information 310 that matches the processed image 314 of the ID card 5, the authentication is successful (authentication OK) (S105; Yes), and the service providing apparatus 3 receives the authentication result (authentication success) is transmitted to the user terminal 4 (S109).

When the user terminal 4 receives the authentication result (S110), it displays a photographing instruction for prompting the user's face image to be photographed on the display unit 405 (S111), and shifts to the user's face authentication processing described below.

(2-2. User face authentication)
In this embodiment, after performing authentication using the processed image 314 as described above, user authentication (face authentication) using the face image 322 is performed before providing the service. As a result, it is possible to prevent spoofing by another person who illegally obtains the processed image 314 by picking up the ID card 5 or the like.

FIG. 9 is a flow chart showing the procedure of user face authentication. S201-S202, S207-S208, and S211-S212 of FIG. Other processes are executed by the control unit 301 of the service providing device 3 controlling each component of the service providing device 3 .

At the time of face authentication, the user takes a face image of the user with the camera 406 of the user terminal 4 according to the face image shooting instruction (see S111 in FIG. 8) (S201). The user terminal 4 transmits the photographed face image to the service providing device 3 (S202).

When the service providing device 3 receives the face image from the user terminal 4 (S203), it authenticates the user by matching the face image (S204).

In S204, the face image received in S203 and the face image 322 of the face image data 320 are collated. For example, temporarily storing the user ID 311 associated with the processed image 314 of the user information 310 determined to match the processed image 314 of the ID card 5 in S104 (see FIG. 8), The facial image 322 of the data 320 and the facial image received in S203 can be compared and verified.

If these face images do not match, the authentication fails (S205; No), and the service providing device 3 transmits the authentication result (authentication failure) to the user terminal 4 (S206). Upon receiving the authentication result (S207), the user terminal 4 displays the authentication result on the display unit 405 (S208), and ends the process.

On the other hand, if the face images match, the authentication is successful (authentication OK) (S205; Yes), and the service providing apparatus 3 records "use" in the service usage status 323 of FIG. Service use registration is performed (S209), and an authentication result (authentication success) is transmitted to the user terminal 4 (S210). When the user terminal 4 receives the authentication result (S211), it displays the authentication result on the display unit 405 of the user terminal 4 (S212), and the provision of the location guide service to the successfully authenticated user is started.

(2-3. Provision of location guidance service)
Next, a procedure for providing the location guide service to the user will be described. FIG. 10 is a flow chart showing the procedure for providing the location guidance service. S301-S304 in FIG. The control unit 401 of the terminal 4 controls and executes each unit of the user terminal 4 .

In this embodiment, the user moves within the facility as indicated by the arrows in FIG. , 7q, 7p, 7s). The position of each camera 7 in the facility is fixed, and the image captured by the camera 7 and the camera position are transmitted to the facility terminal 6 . The service providing device 3 receives the captured image and camera position from the facility terminal 6 (S301).

The service providing device 3 extracts a face image from the photographed image received in S301 (S302). A known image processing technique can be used to extract the face image.

Then, the service providing apparatus 3 identifies the user to whom the service is provided by matching the face image (S303).

In S303, the extracted face image and the face image 322 of the face image data 320 are collated to identify the user (user ID 311) who receives the service. For example, among the users whose service use status 323 (see FIG. 3B) of the face image data 320 is "use", the face image 322 of the user who receives the service is the face image extracted above. Identifies users that match .

When the user is specified, the service providing device 3 acquires the destination 313 corresponding to the user ID 311 from the user information 310, and uses the camera position received in S301 as the user's position information to display the location guidance screen and the destination. 313 (S304).

When the user terminal 4 receives the position information of the user together with the position guidance screen (S305), the display image showing the position information on the position guidance screen is displayed on the display unit 405 (S306).

FIGS. 12A to 12C are examples of this position guide screen 452. For example, when the user is photographed by the camera 7b in FIG. A mark 453 indicating the user's current position is displayed at a position corresponding to the camera 7b. As described above, when the user moves in the facility and is photographed by the camera 7p shown in FIG. Moving. As a result, the user can know his/her current position and can move to the destination without getting lost in the facility.

As a location guidance service, for example, if the user designates a destination on the location guidance screen 452, that position is displayed when a mark 453 (user's position) is displayed as shown in FIGS. It is also possible to display the route from the point to the destination. FIG. 12(c) shows the route A from the user's position to the target value G in the example of FIG. 12(a). In this case, the service providing device 3 calculates the route A from the specified destination and the positional information of the user, and in S304 transmits the positional information of the user and the route A to the user terminal 4 for display.

As described above, in the service providing system 1 of the present embodiment, the user is authenticated using the processed image 314 obtained by processing the user's face image 322 before the service is provided. It is possible to identify the user who receives the service by matching the face image and to provide the service to the user.

Since the processed image 314 obtained by processing the face image 322 is not the face image 322 itself, it is possible to avoid specifying the user even if it is leaked, and the medium such as the ID card 5 has the processed image 314 for authentication. Such as, the risk is small in various uses. Another advantage is that the processed image 314 has a low risk of being forged. On the other hand, the face image 322 is used only when the authentication using the processed image 314 is successful, so there is little need for various uses as described above, and it can be placed under highly confidential management. .

In this embodiment, the processed image 314 is displayed on the ID card 5 held by the user, and the user can be authenticated using this image. As described in Non-Patent Documents 1 and 2 above, the face image 322 is processed to avoid identifying the user by face recognition technology, and the processed image 314 is created. , excellent from the viewpoint of personal information protection. In addition, since the processed image 314 can be made to look almost the same as the original face image 322, the utility value is high.

Furthermore, in this embodiment, in addition to user authentication based on the processed image 314, authentication based on the user's face image 322 is also performed, thereby preventing spoofing by another person who illegally obtains the processed image 314 by picking up the ID card 5 or the like. and improve security.

However, the present invention is not limited to this. For example, in this embodiment, the service provided to the user is a location guidance service, which prevents the user from getting lost in a facility or the like. However, the service provided to the user is not limited to this. Various services can be provided to the user by changing the information to be transmitted to the user terminal 4 .

In this embodiment, the processed image 314 and the face image 322 registered in advance in the service providing apparatus 3 are used for user authentication. may be followed by registering the face image 322 in order to receive the service. It is also possible to delete the face image 322 after providing the service.

However, in this case, since the face of the user cannot be authenticated before the service is provided, if the ID card 5 is dropped by the user himself/herself, other people who pick up the ID card 5 can also receive the service. Therefore, it is desirable to take measures to prevent such abuse. For example, if the user drops the ID card 5, the user terminal 4 or the like notifies the service provider of the fact, and the authentication of the ID card 5 by the processed image 314 is temporarily invalidated. Alternatively, user authentication using the processed image 314 or registration of the face image 322 may be performed at a dedicated booth or the like where an attendant is present. may be performed. Further, when performing user authentication using the processed image 314, password authentication may also be performed so that only the person who knows the password can receive the service.

In the present embodiment, the user photographs the processed image 314 of the ID card 5 and transmits the processed image 314 to the service providing apparatus 3 at the time of user authentication using the processed image 314. may read the processed image 314 and transmit it to the service providing apparatus 3 .

In addition, in the present invention, the ID card 5 has the processed image 314. As a form thereof, the processed image 314 is displayed on the ID card 5 as in the present embodiment, and the IC chip of the ID card 5 can display the processed image 314. A processed image 314 may be stored. In this case, at the time of user authentication using the processed image 314 , the processed image 314 in the IC chip is read by a reading device such as an IC card reader installed in a dedicated booth or the like and transmitted to the service providing device 3 .

Also, in the present embodiment, the face image 322 and its processed image 314 are used for user authentication, but instead of that, it is also possible to use a biometric image other than the face image 322 and its processed image. Biometric images other than the face image 322 include, for example, images of the user's fingerprint, vein pattern, iris, etc. FIG. This is an example of a processed image 314 obtained by processing an image. These processed images are stored, for example, in the IC chip of the ID card 5 or stored in the storage unit 402 of the user terminal 4, and used for user authentication in the same manner as described above.

However, in this case as well, the face image 322 must be pre-registered in order to specify the user in order to provide the service, and it is necessary to photograph these biometric images in addition to the face image at the time of pre-registration. Therefore, the burden on the user at the time of pre-registration is large. In addition, a dedicated imaging device that is different from a normal camera is also required for a biometric image imaging device. Furthermore, handling multiple types of biometric images (face image 322 and other biometric images) increases the risk of information leakage accordingly.

On the other hand, when the processed image 314 obtained by processing the face image 322 is used for authentication as in the present embodiment, the user only needs to take a picture of the face image at the time of pre-registration, which reduces the burden of the registration work. In addition, pre-registration requires only a normal camera and does not require a separate imaging device, so the system is simple, and only one type of biometric information (face image 322) is handled, so there is a risk of information leakage. less.

Further, in the present embodiment, the service providing apparatus 3 creates the processed image 314 from the user's face image 322, but the image processing application stored in the storage unit 402 of the user terminal 4 allows the user terminal 4 to change from the example shown in FIG. Similarly, the processed image 314 may be created from the user's facial image 322, and the facial image 322 and the processed image 314 may be transmitted to the service providing apparatus 3 at the time of pre-registration. The service providing device 3 stores the face image 322 and the processed image 314 transmitted from the user terminal 4 as the face image 322 of the face image data 320 and the processed image 314 of the user information 310, respectively.

On the other hand, on the user terminal 4 side, the created processed image 314 is linked to the service providing application, stored in the storage unit 402, and displayed on the display unit 405 as shown in FIG. It can be used as an alternative medium, and is less likely to be lost than the ID card 5.例文帳に追加At the time of user authentication using the processed image 314 , the processed image 314 stored in the storage unit 402 of the user terminal 4 may be transmitted to the service providing device 3 . The user can also use this processed image 314 on his or her own SNS or the like. In this case as well, the user cannot be identified by the processed image 314 on the Internet, which is preferable from the viewpoint of personal information protection.

Although the preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person skilled in the art can conceive of various modifications or modifications within the scope of the technical ideas disclosed in the present application, and these also belong to the technical scope of the present invention. Understood.

1: Service providing system 3: Service providing device 4: User terminal 5: ID card 6: Facility terminal 7: Camera 31: Storage means 32: Authentication means 33: Verification means 34: Service providing means 310: User information 311: User ID
312: User registration information 313: Destination 314: Processed image 320: Face image data 322: Face image 323: Service usage status

Claims (13)

A service providing device for providing a service to a user,
a storage means for storing a processed image obtained by processing a user's biometric image and a user's facial image;
authentication means for authenticating a user using the processed image before providing the service;
a verification means for identifying a user who receives a service when the verification by the verification means is successful, by verifying the face image of the user who receives the service;
with
The authentication means obtains a processed image held by a medium held by a user, and performs authentication by comparing the processed image with the processed image stored in the storage means.
A service providing device characterized by: 2. The service providing apparatus according to claim 1 , wherein said authentication means authenticates the user using said processed image, and then uses said face image to authenticate said user. 3. The service providing apparatus according to claim 1 , wherein the biometric image is any one of a fingerprint, a vein pattern, and an iris image. A service providing device for providing a service to a user,
a storage means for storing a processed image obtained by processing a user's biometric image and a user's facial image;
authentication means for authenticating a user using the processed image before providing the service;
a verification means for identifying a user who receives a service when the verification by the verification means is successful, by verifying the face image of the user who receives the service;
with
The service providing apparatus, wherein the biometric image is a face image of the user. 5. The service providing apparatus according to claim 4, wherein the processed image is obtained by processing the face image to avoid identification of the user by face recognition technology. 6. The service providing apparatus according to any one of claims 1 to 5 , further comprising service providing means for transmitting service-related information to the user terminal of the user specified by said collating means. 7. The service providing apparatus according to claim 6 , wherein said information is user's location information. A service providing system comprising a service providing device for providing a service to a user and a medium held by the user,
The medium is
Having a processed image that is an image obtained by processing the biometric image of the user;
The service providing device
storage means for storing the processed image and the face image of the user;
authentication means for authenticating a user using the processed image before providing the service;
a verification means for identifying a user who receives a service when the verification by the verification means is successful, by verifying the face image of the user who receives the service;
A service providing system comprising: the biometric image is a face image of the user;
The service providing system is
further comprising a user terminal that processes a user's facial image to create a processed image, and transmits the user's facial image and the processed image to the service providing device;
9. The service providing system according to claim 8 , wherein said service providing device stores the user's face image and its processed image transmitted from said user terminal in said storage means. A computer that stores a processed image obtained by processing a user's biometric image and a user's facial image,
A service providing device for providing a service to a user,
authentication means for authenticating a user using the processed image before providing the service;
a verification means for identifying a user who receives a service when the verification by the verification means is successful, by verifying the face image of the user who receives the service;
with
A program for causing the authentication means to function as a service providing apparatus that acquires a processed image held by a medium held by a user and performs authentication by matching with the stored processed image. A computer that stores a processed image obtained by processing a user's biometric image and a user's facial image,
A service providing device for providing a service to a user,
authentication means for authenticating a user using the processed image before providing the service;
a verification means for identifying a user who receives a service when the verification by the verification means is successful, by verifying the face image of the user who receives the service;
with
A program for functioning as a service providing apparatus in which the biometric image is a face image of a user . A service providing method for providing a service to a user by a computer that stores a processed image that is a processed image of a user's biometric image and a user's face image,
the computer
a step of authenticating a user using the processed image before providing the service;
a step of identifying a user who receives a service in providing the service by matching a face image when the user authentication is successful;
and run
In the authentication step, a processed image held by a medium held by a user is acquired, and authentication is performed by matching with the stored processed image.
A service providing method characterized by: A service providing method for providing a service to a user by a computer that stores a processed image that is a processed image of a user's biometric image and a user's face image,
the computer
a step of authenticating a user using the processed image before providing the service;
a step of identifying a user who receives a service in providing the service by matching a face image when the user authentication is successful;
and run
the biometric image is a face image of the user
A service providing method characterized by:

Images