JP6210750B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus having a function of permitting data retrieval from a storage unit based on personal authentication of a user.

  In recent years, information processing services such as image output and copying can be used by using information processing devices such as convenience stores and kiosk terminals installed in public environments.

  When using a service provided by an information processing apparatus, it may take time to exchange data via a network after completion of personal authentication and payment processing and completion of service provision (content printing, download, etc.). In such a case, when the user himself / herself is separated from the front of the information processing apparatus such as a kiosk terminal that is being used, there is a concern that another person may impersonate the user and use the service. In addition, when the user interrupts the work while using the apparatus and temporarily moves, there is a possibility that another person can remove the original or the memory card.

  Therefore, as a countermeasure for the above problem, for example, as a conventional technique, a device that performs user face authentication, logs out when it detects that the user has left the device, and logs in again when it approaches the device is disclosed. (See Patent Document 1).

  As another conventional technique, an automatic transaction apparatus is disclosed that determines whether to enable or stop a transaction by front face authentication based on an image captured by a camera (see Patent Document 2).

JP 2008-146449 A JP 2006-79302 A

  However, in the above-described prior art, when the user leaves the apparatus, log-off is performed. However, authentication registration of the user's face image is required in advance, and a pre-procedure for using the face image authentication function is required. There is a problem that is complicated.

  The present invention has been made in view of the above-described conventional problems. When a service is used in an information processing apparatus installed in a convenience store or a public environment, a user impersonates another person to use the service instead of the user himself / herself. An object of the present invention is to provide an information processing apparatus that can prevent this.

  An information processing apparatus according to the present invention for solving the above-described problems is as follows.

The present invention
In an information processing apparatus having a function of permitting data retrieval from storage means based on personal authentication of a user,
An authentication means for authenticating the user;
Before the user is authenticated, a first imaging means for imaging a user using the information processing apparatus with a camera;
After the user is authenticated, a second imaging unit that captures an image of the user using the information processing apparatus with the camera;
Use of identifying a user who uses the information processing apparatus based on whether or not the user imaged by the first imaging unit and the user imaged by the second imaging unit match Person identification means;
A data usage restricting means for restricting the process of extracting data from the storage means when the user cannot be identified because the user using the information processing device does not match by the user identifying means;
It is characterized by providing.

  According to the present invention, as the configuration of the user appointment recognizing means, an image pickup means (for example, a camera) and an image obtained by picking up an image of the user by the image pickup means are used for a person-recognized pattern shape. It is preferable to provide a user recognition means for recognizing the user so that the user is recognized. The person recognition pattern may be a combination of a plurality of patterns such as a circular shape, a triangular shape, and a rectangular shape.

  Further, the present invention provides an image output unit as the configuration of the information processing apparatus, and the configuration of the data use restriction unit is when the individual who uses the information processing apparatus cannot be identified by the user identification unit. Preferably, an image output prohibiting function for prohibiting output of an image based on data taken out from the storage unit from the image output unit is provided.

  In addition, the present invention includes a display unit as the configuration of the information processing device, and when the user identification unit cannot identify an individual who uses the information processing device as the configuration of the data use restriction unit, It is preferable to provide a data display prohibiting function for prohibiting display of data retrieved from the storage means on the display means.

  Further, the present invention includes a warning unit as the configuration of the information processing apparatus, and when the user identification unit cannot identify an individual who uses the information processing apparatus as the configuration of the warning unit (for example, It is preferable to provide a function for issuing a warning (when a user turns to the side or back while using the apparatus).

  Further, according to the present invention, as the configuration of the warning means, when the individual who uses the information processing apparatus cannot be identified by the user identification means, the individual used before the apparatus use end process (logoff) Preferably has a function of issuing a warning when a different user is detected.

The present invention also provides:
A program executed in an information processing apparatus having a function of permitting data retrieval from a storage unit based on personal authentication of a user,
In the information processing apparatus,
An authentication step for authenticating the user;
A first imaging step of imaging a user using the information processing apparatus with a camera before the user is authenticated;
A second imaging step of imaging the user using the information processing apparatus with the camera after the user is authenticated;
Use of identifying a user who uses the information processing apparatus based on whether or not the user imaged in the first imaging step matches the user imaged in the second imaging step A person identification step;
A data use restriction step for restricting the process of extracting data from the storage means when the user cannot be identified because the user using the information processing apparatus does not match in the user identification step;
Is executed.

  According to the information processing apparatus of the present invention, in the information processing apparatus having a function of permitting the retrieval of data from the storage unit based on the personal authentication of the user, the user who identifies the individual who uses the information processing apparatus A convenience store comprising: an identification unit; and a data use restriction unit that restricts a process of extracting data from the storage unit when the user using the information processing apparatus cannot be identified by the user identification unit. When using a service in an information processing apparatus installed in a public environment, it is possible to prevent others from impersonating and using the service on behalf of the user.

It is a block diagram which shows the whole structure of the information processing system which uses a service using the service provision information processing apparatus which concerns on embodiment of this invention. (A) is explanatory drawing which shows an example of the user's image imaged with the camera in the said service provision information processing apparatus, (b) is explanatory drawing which shows an example of the image which subdivided the said user's image with the mesh, (C) is an explanatory view showing a state in which a human-recognized pattern object roughly matches the shape of an image subdivided by the mesh. (A) is explanatory drawing which shows an example of the image of the user in the conventional personal authentication, (b) is explanatory drawing which shows an example which recognizes the shape of the eye which identifies the said user, (c) is the said user. It is explanatory drawing which shows an example which authenticates the shape of the nose to identify. It is a flowchart which shows the process sequence in the case of performing authentication of the user at the time of using the service in the service provision information processing apparatus of this embodiment using the mounted camera. It is a flowchart which shows a part of process sequence in the case of performing the authentication of the user at the time of using the service in the said service provision information processing apparatus using the security camera in a shop. It is a flowchart which shows the process sequence which authenticates the user who uses the said service provision information processing apparatus following FIG.

Hereinafter, embodiments for implementing an information processing apparatus of the present invention will be described with reference to the drawings.
FIG. 1 is an example of an embodiment for carrying out the invention, and is a block diagram showing an overall configuration of an information processing system that uses a service by using a service providing information processing apparatus according to an embodiment of the present invention.

  As shown in FIG. 1, the information processing apparatus 10 according to the present embodiment is an information processing apparatus that is installed in a store such as a convenience store and provides services such as copying to a user. The personal information processing apparatus 20 functioning as a server and the user terminal 30 are connected to each other to form a part of the information processing system 1 that provides services to users (users). The information processing apparatus 10 is hereinafter referred to as “service providing information processing apparatus 10”.

  The service providing information processing apparatus 10 is an information processing apparatus having a function of permitting the retrieval of data from the storage unit based on the personal authentication of the user, and the configuration of the information processing apparatus according to the present invention is a characteristic configuration. Is adopted.

First, the overall configuration of the information processing system 1 according to the present embodiment will be described.
As shown in FIG. 1, the information processing system 1 according to the present embodiment is mainly connected to a service providing information processing apparatus 10, an information processing apparatus 20 for personal recognition, and a user terminal 30 via a network 50. Has been.

  In the store where the service providing information processing device 10 is installed, a security camera (monitoring camera) 40 is appropriately connected as a monitoring device via a network.

  The service providing information processing apparatus 10 performs communication processing with the personal recognition information processing apparatus 20 that has accumulated data based on an instruction from the user terminal 30 and performs authentication using the personal authentication data that has already been accumulated. It has a service providing function such as taking out data necessary for the service requested by the user from the information processing apparatus 20 for personal recognition and registering the extracted data in a storage device owned by the user such as printing or USB. doing.

  The personal recognition information processing device 20 functions as a server that stores digital data such as photographs and documents registered by the user and data for personal authentication (recognition).

  As shown in FIG. 1, the personal recognition information processing apparatus 20 includes a communication unit 22, a storage unit 24 in which photo data (image data) 241 and document data 242 are stored, and a control unit 25 that controls the functions of each unit. ing. The control unit 25 includes a personal authentication function 251 that verifies personal information and authenticates a user.

  The user terminal 30 is an information processing apparatus such as a PC used by a user to register in advance, and includes a display unit 31, a communication unit 32, an information processing unit 33, a storage unit 34, and a control unit that controls functions of each unit. 35.

Next, a characteristic configuration of the service providing information processing apparatus 10 according to the present embodiment will be described.
FIG. 2A is an explanatory diagram illustrating an example of a user image captured by a camera in the service providing information processing apparatus of the present embodiment, and FIG. 2B is an example of an image obtained by subdividing the user image with a mesh. FIG. 4C is an explanatory diagram showing a state in which a pattern object for human recognition is approximately matched with the shape of an image subdivided by the mesh.

  As shown in FIG. 1, the service providing information processing apparatus 10 according to the present embodiment is an information processing having a function of permitting data retrieval from the storage unit 24 of the information processing apparatus 20 for personal authentication based on personal authentication of a user. A display unit 11 that displays image data; a communication unit 12 that enables communication with an external device via the network 50; an information processing unit (image output unit) 13 that performs fax transmission, image output, and the like; In addition to a storage unit 14 that stores the application 141 and the like, a control unit 15 that controls the function of each unit, a camera (imaging unit) 16 and a warning device 17 are provided.

  The control unit 15 uses the service providing information processing apparatus 10 by the user identifying function 151 functioning as a user identifying means for identifying an individual who uses the service providing information processing apparatus 10 and the user identifying function 151. A data use restriction function 152 that functions as a data use restriction unit that restricts the process of extracting data from the storage unit 24 of the personal authentication information processing apparatus 20 and a user identification function 151 when the individual being identified cannot be identified. A warning instruction function 153 is provided for instructing the warning device 17 to issue a warning when an individual using the service providing information processing apparatus 10 cannot be identified.

  The camera 16 constitutes a part of the user identification means, and is configured to image the user when the user enters an available area of the service providing information processing apparatus 10 and the use of the service is started. ing.

  The user identification function 151 includes a user recognition function 1511 for recognizing a user by matching an image obtained by capturing the user with the camera 16 to a pattern shape for human recognition that does not specify an individual. It is configured to identify the user.

  As shown in FIGS. 2A to 2C, the user recognition function 1511 converts an image of the user captured by the camera 16 into an image G02 that is subdivided with a mesh, and calculates a difference from the default background image. Extract boundaries. Then, it is matched with a human-recognized pattern object (human object) G03 that is a combination of a plurality of shapes such as an elliptical shape, a rectangular shape, and a trapezoidal shape that roughly match the shape of the image G02 subdivided by the mesh. Recognize individuals (users).

  Note that the recognition by the user recognition function 1511 is because, for example, even if the user changes the distance from the camera 16, only the magnification (size) of the pattern object G03 changes and the shape of the object itself does not change. The users are recognized as being the same.

  As the data use restriction function 152, an image output inhibition function 1521 and a data display inhibition function 1522 are provided.

  The image output prohibition function 1521 outputs an image based on the data extracted from the storage unit 24 from the information processing unit 13 when the user identification function 151 cannot identify the individual who uses the service providing information processing apparatus 10. Is prohibited.

  The data display prohibition function 1522 displays an image based on the data extracted from the storage unit 24 on the display unit 11 when the user identification function 151 cannot identify the individual using the service providing information processing apparatus 10. Ban.

  The warning instruction function 153 is used to identify an individual who is using the service providing information processing apparatus 10 by the user identification function 151 or an individual who is using the service providing information processing apparatus 10 by the user identifying function 151. A function is provided for instructing the warning device 17 to issue a warning when a user different from the individual who was used before the device use termination process is detected when the device cannot be identified.

  In addition, the warning instruction function 153 provides a warning when a security camera 40 located in the store separately from the service providing information processing apparatus 10 detects a user who is different from the individual who was used before the apparatus use termination processing. A function for instructing the device 17 to issue a warning is provided.

Here, a user's recognition in the service provision information processing apparatus 10 of this embodiment is demonstrated.
FIG. 3A is an explanatory diagram showing an example of a user image in conventional personal authentication, FIG. 3B is an explanatory diagram showing an example of recognizing the shape of an eye that identifies the user, and FIG. It is explanatory drawing which shows an example which authenticates the shape of the nose which specifies a person.

  Conventional personal authentication includes, for example, as shown in FIGS. 3A to 3C, the interval between the left and right eyes G11 around the contour of the user's face G10, the state of skew from the eyes to the corners of the eyes, It is known to specify an individual by measuring and recognizing facial feature points such as the shape of the nose G12 and the like, and the inclination and distance of a line connecting the points.

  Unlike conventional personal authentication, user authentication in the service providing information processing apparatus 10 according to the present embodiment differs from conventional personal authentication in that an image of a user captured by the camera 16 is used as shown in FIGS. It is characterized by identifying an individual by recognizing it as a humanoid pattern object G03 combining a plurality of shapes such as an elliptical shape, a rectangular shape, a trapezoidal shape, etc. that roughly match the shape of the head, chest, etc. .

  Thereby, even if the user of the service providing information processing apparatus 10 moves back and forth and right and left with respect to the camera 16, the object of each part moves left and right, or the magnification changes only by moving back and forth. Since the shape does not change, the user can be specified.

  In the service providing information processing apparatus 10 according to the present embodiment, for example, when the clothes worn by the user are short-sleeved or long-sleeved, the objects described above are used by using objects corresponding to the clothes. Personal authentication can be performed as a humanoid object added to the above.

  As described above, according to the service providing information processing apparatus 10 of the present embodiment, the distance from the so-called kiosk terminal type information processing apparatus by performing pattern recognition of each object such as the user's head and chest. These processes, including changes in data and movement in the horizontal direction, make it possible to recognize the user himself / herself, thus preventing the so-called “spoofing” of unauthorized use of an information processing device being used by someone other than the user. be able to.

Next, in the service providing information processing apparatus 10 of the present embodiment, a processing procedure for performing user authentication when using a service will be described with reference to a flowchart.
FIG. 4 is a flowchart showing a processing procedure when user authentication is performed using a camera equipped with a service in the service providing information processing apparatus of the present embodiment, and FIG. FIG. 6 is a flowchart showing a part of a processing procedure when a user is authenticated using a security camera in the store, and FIG. 6 is a user authentication using the service providing information processing apparatus following FIG. It is a flowchart which shows the process sequence which performs.

Example 1
As a first embodiment, a case where a user who uses a service providing information processing apparatus 10 is authenticated using a camera 16 mounted on the service providing information processing apparatus 10 will be described with reference to a flowchart.

  As shown in FIG. 1, a user terminal 30 used for registration in advance by a user, and for personal authentication functioning as a server that stores digital data such as photographs and documents registered by the user and data for personal authentication. An information processing apparatus 20 and a kiosk terminal type service providing information processing apparatus 10 installed in a store or the like are connected via a network 50.

  The service providing information processing apparatus 10 performs communication processing with the personal authentication information processing apparatus 20 according to the service requested by the user, authenticates the user using the already stored personal authentication data, and then uses the service. The data requested by the person is taken out from the personal authentication information processing apparatus 20, and a service for printing, storing data, and the like is performed.

  As shown in FIG. 4, when using the service providing information processing apparatus 10 to use a service for printing, storing data, etc., first, a service desired by the user is selected (step S1).

  Then, when the service providing information processing apparatus 10 receives an instruction from the user and starts using the service, the user is imaged by the camera 16 mounted on the service providing information processing apparatus 10 (step S2).

  Before authenticating the user, the service providing information processing apparatus 10 generates a pattern object for human recognition based on the user's image captured by the camera 16 when a service using stored data is selected. It is stored as the user's own pattern object (step S3).

  After storing the user's own pattern object, the service providing information processing apparatus 10 displays a personal authentication login screen on the display unit 11 and accepts the user's login input. Then, it is determined whether or not the user has been authenticated (step S4).

  If it is determined in step S4 that the user has been authenticated, the camera operates to image the user (step S5).

  Then, the user identification function 151 matches the image of the user captured by the camera 16 with the pattern object of the authenticated user himself / herself, and determines whether or not the user is an authenticated user (step). S6).

  If it is determined in step S6 that the user cannot be identified, the warning device 17 warns that the user has moved outside the identifiable range (service usage range) (step S13). Then, the process returns to step S4.

  That is, when the user leaves the range where the camera 16 can be authenticated while providing the service, the service provision is temporarily interrupted. Then, the user is warned that the service provision is to be temporarily stopped by using the display device 11 or a warning device 17 such as a warning light or voice.

  Further, for example, when the user ignores the warning and leaves the range that can be authenticated by the camera 16, in the case of printing, the printing is not performed at the data extraction (reading) stage. You may wait for the personal authentication again. If the printing process is being performed, the printing process may be interrupted and the printing process may not be performed on the pages after the printed page until the personal authentication is performed again.

  In the case where the service is provided by a data storage service or the like, as in the case described above, if the data is in the data extraction stage, the extracted data may not be stored and the personal authentication may be awaited again. If the storage process is once entered, the storage process may be interrupted, and after the stored data is erased, the storage process may not be performed until personal authentication is performed again.

  On the other hand, if it is determined in step S6 that the user is an authenticated user, the process of identifying the user by the imaging by the camera 16 and the user identification function 151 is continued (tracking management) (step S7).

  And it is judged whether it exists in the range (service use range) which a user can identify (step S8). That is, the service is provided while confirming that the authenticated user does not leave the authenticable range of the camera 16.

  If it is determined in step S8 that the user does not exist within the identifiable range (service usage range), the process proceeds to step S13 to indicate that the user has moved outside the identifiable range. Warn by. Then, the process returns to step S4.

  On the other hand, if it is determined in step S8 that the user is within an identifiable range, processing for providing services such as printing, data storage, and thumbnail display of photo data requested by the user is executed. (Step S9). Then, it is determined whether or not the provision of the service has ended (step S10).

  If it is determined in step S10 that the provision of the service has not ended, the process returns to step S5, and imaging by the camera 16 is continued.

  On the other hand, if it is determined in step S10 that the service has been provided, a notification indicating that the service has ended is displayed on the display unit 11 (step S11), and the continuous monitoring of user identification is ended (step S11). S12).

  Here, returning to the description of step S4, if it is determined in step S4 that the user is not authenticated, the provision of the service is stopped (step S14). In step S11, a notification indicating that the service has ended is displayed on the display unit 11, and the continuous monitoring of user identification is terminated (step S12).

  In this way, when the service providing information processing apparatus 10 provides a service to the user, the service can be provided while always authenticating the user.

(Example 2)
As Example 2, when the user who uses the service providing information processing apparatus 10 is authenticated using the camera 16 mounted on the service providing information processing apparatus 10, the security camera 40 in the store is used. A case where a person is authenticated will be described with reference to a flowchart.

  User authentication by the service providing information processing apparatus 10 according to the second embodiment is performed in substantially the same manner as in the first embodiment. The second embodiment is different from the first embodiment in that the service providing information processing apparatus 10 provides a service by capturing the user with a security camera 40 in the store when the user is out of the shooting range of the camera 16. The purpose is to identify whether or not the user who uses the information processing apparatus 10 is an authenticated user.

  As shown in FIG. 5, when using a service that performs printing, data storage, or the like using the service providing information processing apparatus 10, first, a service desired by the user is selected (step S101).

  Then, when the service providing information processing apparatus 10 receives the user's instruction and starts using the service, the user is imaged by the camera 16 mounted on the service providing information processing apparatus 10 (step S102).

  Before authenticating the user, the service providing information processing apparatus 10 generates a pattern object for human recognition based on the user's image captured by the camera 16 when a service using stored data is selected. It is stored as the user's own pattern object (step S103).

  After storing the user's own pattern object, the service providing information processing apparatus 10 displays a personal authentication login screen on the display unit 11 and accepts the user's login input. Then, it is determined whether or not the user has been authenticated (step S104).

  If it is determined in step S104 that the user has been authenticated, the camera operates to image the user (step S105).

  Then, the user identification function 151 matches the image of the user captured by the camera 16 with the pattern object of the authenticated user himself / herself, and determines whether or not the user is an authenticated user (step). S106).

  If it is determined in step S106 that the user cannot be identified, the warning device 17 warns that the user has moved outside the identifiable range (service usage range) (step S113). Refer to the first embodiment for details of the warning by the warning device 17.

  Then, it is determined whether a user other than the user himself / herself has been detected by the camera 16 or the security camera 40 in the store (step S121).

  That is, when the person who uses the service providing information processing apparatus 10 is again imaged by the camera 16 or imaged by the security camera 40 after being out of the identifiable range of the camera 16, the user identification function 151 It is authenticated whether the person who uses the service providing information processing apparatus 10 is the user himself / herself.

  If it is determined in step S121 that a user other than the user himself / herself has not been detected by the camera 16 or the security camera 40 in the store, the process returns to step 102 and the camera 16 performs imaging.

  On the other hand, if it is determined in step S121 that a user other than the user himself / herself has been detected by the camera 16 or the security camera 40 in the store, the device is used by a clerk who manages the service providing information processing device 10 or the like. It is determined whether or not a release operation (specific key input, card authentication, etc.) has been performed (step S122).

  If it is determined in step S122 that a release operation for using the apparatus has been performed, the process returns to step 102, and imaging is performed by the camera 16.

  On the other hand, if it is determined in step S122 that the release operation for using the device has not been performed, a warning sound is issued, a specific notice such as a store cash register is notified of illegal use, etc. 2 is performed (step S123).

  Then, returning to the process in step S106, when it is determined in step S106 that the user is an authenticated user, the process of identifying the user by the imaging by the camera 16 and the user identification function 151 is continued (tracking). Management) (step S107).

  And it is judged whether it exists in the range (service use range) which a user can identify (step S108). That is, the service is provided while confirming that the authenticated user does not leave the authenticable range of the camera 16.

  If it is determined in step S108 that the user is not within the identifiable range (service usage range), the process proceeds to step S113, and the warning device 17 indicates that the user has moved out of the identifiable range. Be warned by. Then, the process proceeds to step S121. Thereafter, the processing described above is performed.

  On the other hand, if it is determined in step S108 that the user is within an identifiable range, processing that provides services such as printing, data storage, and thumbnail display of photo data requested by the user is executed. (Step S109). Then, it is determined whether or not the service has been provided (step S110).

  If it is determined in step S110 that the service has not been completed, the process returns to step S105, and imaging by the camera 16 is continued.

  On the other hand, if it is determined in step S110 that the provision of the service has ended, a notification display indicating that the service has ended is displayed on the display unit 11 (step S111), and the continuous monitoring of user identification is ended (step S111). S112).

  Here, returning to the description of step S104, if it is determined in step S4 that the user is not authenticated, the service provision is stopped (step S114). Then, the process proceeds to step S111, where a notification indicating that the service has ended is displayed on the display unit 11, and the continuous monitoring of user identification is terminated (step S112).

  In this way, when the service providing information processing apparatus 10 provides a service to the user, the user is always imaged by the camera 16 installed in the service providing information processing apparatus 10 and the security camera 40 in the store. Services can be provided while authenticating users.

  With the configuration as described above, according to the present embodiment, the service providing information processing apparatus 10 having a function of permitting data extraction from the storage unit 24 of the information processing apparatus 20 for personal authentication based on the personal authentication of the user. , A display unit 11 that displays image data, a communication unit 12 that enables communication with an external device via the network 50, an information processing unit 13 that performs fax transmission, image output, and the like, a storage unit that stores an application 141, and the like 14. A user that includes a control unit 15 that controls the function of each unit, a camera 16, and a warning device 17, and identifies a person who uses the service providing information processing apparatus 10 as a function of the control unit 15 A user identification function 151 that functions as an identification unit, and a user identification function 151 that uses the service providing information processing apparatus 10 A data use restriction function 152 that functions as a data use restriction means for restricting the process of extracting data from the storage unit 24 of the personal authentication information processing apparatus 20 when the individual cannot be identified. When using a service in an information processing apparatus installed in a public environment, it is possible to prevent another person from impersonating and using the service on behalf of the user.

  Further, according to the present embodiment, the user identification function 151 recognizes a user by matching an image obtained by imaging the user with the camera 16 with a pattern shape for human recognition that does not specify an individual. Since the user recognition function 1511 is provided to identify the user, the user can be authenticated by a simple authentication process without performing a complicated authentication process, so-called kiosk terminal type information processing apparatus. It is possible to recognize the user himself / herself, including changes in the distance to the user and movement in the horizontal direction, thereby preventing other users from impersonating and using the service on behalf of the user.

  Further, according to the present embodiment, since the image output prohibiting function 1521 and the data display prohibiting function 1522 are provided as the data use restricting function 152, the data on the display unit 11 is instructed by an instruction from a person other than the user himself / herself. Display, fax transmission and image output by the information processing unit 13 can be prohibited.

  Further, according to the present embodiment, since the warning instruction function 153 is provided as a function of the control unit 15, a warning is given to the warning device 17 when an individual using the service providing information processing apparatus 10 cannot be identified. Can be emitted.

  In addition, according to the present embodiment, when the warning instruction function 153 cannot identify an individual who is using the service providing information processing apparatus 10, a user who is different from the individual who was used before the apparatus use termination process is identified. Since a warning is issued when it is detected, use by an unauthorized person can be prevented.

  Further, according to the present embodiment, the warning instruction function 153 issues a warning when a security camera 40 in the store detects a user who is different from the individual who was used before the device use termination process. Therefore, it is possible to prevent use by unauthorized persons.

  Here, user recognition in the service providing information processing apparatus 10 of the present embodiment is compared with personal authentication in a conventional information processing apparatus.

  In the case of personal authentication in a conventional information processing apparatus, for example, it is generally used in the case of a user who wears a mask or wears a hat for winter cold epidemics or recent allergy countermeasures In personal authentication using facial feature points such as the distance between the left and right eyes, the state of skew from the eyes to the corners of the eyes, the shape of the nose, and the inclination and distance of the line connecting the points, centering on the face outline, Personal authentication is difficult due to masks and hats worn by users.

  In addition, in order to use a kiosk terminal type information processing device installed in a store or the like, even if a user wears a mask or a hat, it does not require complete personal authentication like ATM. .

  Therefore, according to the authentication processing by the humanoid object by the user identification function 151 in the service providing information processing apparatus 10 of the present embodiment, it is indicated that a part of the humanoid head object is wearing a mask or a hat. Can be provided as a personal authentication object by using a humanoid object wearing a mask or hat as a personal authentication object. it can.

  As a result, the kiosk terminal type information processing apparatus is installed outside the store. For example, even if the service provision is used while wearing a motorcycle helmet or the like, the use of ATM is restricted, or in the store The user can freely use the service provision without being restricted when entering a helmet. In addition, by imposing a warning when leaving the camera's authenticable range, it is possible to prevent “spoofing” in a kiosk terminal type information processing apparatus installed outside the store.

  In addition, there are many people in the world who have similar faces and similar physiques, including twins. When two twins are wearing similar clothes, two people who are similar in front of a conventional kiosk terminal-type information processing device stand back and forth and perform actions such as switching while in use. It is difficult to recognize that.

  However, as a user recognition function in the service providing information processing apparatus 10 of the present embodiment, for example, by providing a function for recognizing the color of each object of the user, the same clothes or the same physique may be used. Even in the case of a similar face, by storing together the color values of each acquired object, by comparing the face color and the color of clothes, "impersonation" in the kiosk terminal type information processing device Can be prevented.

  In addition, this invention is not limited to embodiment mentioned above, A various change is possible in the range shown to the claim. That is, embodiments obtained by combining technical means appropriately changed within the scope not departing from the gist of the present invention are also included in the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Service provision information processing apparatus (information processing apparatus)
11, 31 Display unit 12, 22, 32 Communication unit 13, 33 Information processing unit 14, 24, 34, Storage unit 15, 25, 35 Control unit 16 Camera (imaging means)
17 Warning device (Warning means)
20 Information processing apparatus for personal authentication 30 User terminal 40 Security camera (imaging means)
50 Network 151 User identification function (user identification means)
152 Data use restriction function (Data use restriction means)
153 Warning instruction function 251 Personal authentication function 40 Security camera (imaging means)
1511 User recognition function (user recognition means)
1521 Image output prohibition function (image output prohibition function)
1522 Data display prohibition function (data display prohibition function)
G02 Image G03 Pattern object

Claims (7)

In an information processing apparatus having a function of permitting data retrieval from storage means based on personal authentication of a user,
An authentication means for authenticating the user;
Before the user is authenticated, a first imaging means for imaging a user using the information processing apparatus with a camera;
After the user is authenticated, a second imaging unit that captures an image of the user using the information processing apparatus with the camera;
Use of identifying a user who uses the information processing apparatus based on whether or not the user imaged by the first imaging unit and the user imaged by the second imaging unit match Person identification means;
A data usage restricting means for restricting the process of extracting data from the storage means when the user cannot be identified because the user using the information processing device does not match by the user identifying means;
An information processing apparatus comprising: Pattern object recognition means for recognizing an object from the captured user image and recognizing a pattern object from the recognized object;
The user identification means determines whether the user's pattern object imaged by the first imaging means matches the user's pattern object imaged by the second imaging means. The information processing apparatus according to claim 1, wherein the information processing apparatus is identified . The pattern object recognition means
Recognizing at least an object corresponding to the user's head and chest as the object,
If the user is wearing a mask or hat, recognize as part of the head object,
The information processing apparatus according to claim 2. The information processing apparatus according to any one of claims 1 to 3, wherein the camera is a security camera arranged separately from the information processing apparatus. The information processing apparatus includes a warning unit,
The warning means includes a function of issuing a warning when the user who uses the information processing apparatus cannot be identified by the user identification means. The information processing apparatus described in 1. When the warning means detects a user who is different from the user used before the apparatus use end processing when the user identification means cannot identify the user who is using the information processing apparatus. The information processing apparatus according to claim 5, further comprising a function for issuing a warning. A program executed in an information processing apparatus having a function of permitting data retrieval from a storage unit based on personal authentication of a user,
In the information processing apparatus,
An authentication step for authenticating the user;
A first imaging step of imaging a user using the information processing apparatus with a camera before the user is authenticated;
A second imaging step of imaging the user using the information processing apparatus with the camera after the user is authenticated;
Use of identifying a user who uses the information processing apparatus based on whether or not the user imaged in the first imaging step matches the user imaged in the second imaging step A person identification step;
A data use restriction step for restricting the process of extracting data from the storage means when the user cannot be identified because the user using the information processing apparatus does not match in the user identification step;
A program characterized by having executed.

Images