JP2007287138A - Monitoring device and method, monitoring system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To gather and integrally manage not only customer visit information in respective shops but also customer visit records in the plurality of shops. <P>SOLUTION: A biological information database 22 stores the face images of registered persons registered beforehand; a face image acquisition part 221 acquires the face image of a collation object person, and a similarity degree calculation part 232 calculates the similarity degree of the face image of the collation object person and the face image of the stored registered person and performs collation. A similarity degree judgement part 233 judges whether or not the face image of the collation object is the face image of the registered person by comparing the similarity degree which is the collated result of the similarity degree calculation part 232 with a prescribed threshold. When it is judged that the collation object person is the registered person by the similarity degree judgement part 233, a communication part 224 notifies that the collation object person is the registered person. This invention is applicable to the monitoring system. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a monitoring apparatus and method, a monitoring system, and a program, and more particularly, to a monitoring apparatus and method, a monitoring system, and a program that can easily collect customer visit information.

  Currently, in many stores and public facilities, staff members collect information on customers or visitors by visual inspection.

  However, the above-described method is labor intensive and it is difficult to obtain accurate information. Therefore, as a method of collecting the trends of customers (players) who visit the store without the need for human resources such as employees, customer information such as customer store records is collected using an identification medium such as a registered membership card. The thing is proposed (refer patent document 1).

JP 2002-011215 A

  However, in the case of the customer visit record collection method using the above-mentioned identification card such as a membership card, it is necessary to obtain a member ID in advance, and it is not possible to collect visit records of customers who do not receive a member ID. It was. In addition, since it is necessary to provide a device that reads the member ID and read the member ID, if you forget to carry the member card or if you do not insert the member card into the member ID reader, record customer visits. It was not possible to collect it, and it was impossible to obtain the member information of all the visiting members, so there was a situation that could not be called an effective method.

  In addition, when a company that manages and operates a plurality of stores as affiliate stores collects customer visit records at the affiliate stores, to manage customer visit records at a plurality of stores in an integrated manner, After the store visit record of the store is once generated, it is necessary to perform aggregation for integrated management again based on the store visit information for each store.

  The present invention has been made in view of such a situation, and enables collection and integrated management of customer store records at a plurality of stores as well as customer store information at each store.

  The monitoring apparatus according to the first aspect of the present invention is acquired by an accumulating unit that accumulates a face image as an accumulator's face image in an accumulator database, an acquisition unit that acquires a face image of a person to be collated, and the acquisition unit. The collation means for calculating and comparing the similarity between the face image of the person to be collated and the face image of the accumulator accumulated in the accumulation means, the similarity as the collation result of the collation means, and a predetermined threshold value The similarity determination unit that determines whether or not the face image of the person to be collated is the face image of the accumulator, and the face image of the person to be collated is If it is determined that the face image is a face image, the notifying means for notifying that the person to be collated is the accumulator, and the face image of the person to be collated is not the face image of the accumulator by the similarity determining means. If it is determined that Unaccumulated person registration means for registering a face image as an unaccumulated person, and accumulation determination means for determining whether or not the face image of the unaccumulated person registered by the unaccumulated person registration means has been registered a predetermined number of times or more. Based on the determination result of the accumulation determination unit, the accumulator database is stored so that the face image of the non-accumulator registered by the non-accumulator registration unit more than a predetermined number of times is accumulated as the face image of the accumulator. Updating means for updating.

  An image pickup means for picking up the image, a face image extraction means for extracting the face image of the person to be collated from the image picked up by the image pickup means, and a feature quantity for extracting a feature quantity from the face image of the person to be collated An extraction unit, and the collating unit includes features of the face image of the person to be collated acquired by the acquiring unit and the face image of the registrant accumulated in the accumulating unit. The similarity may be calculated using the amount, and the face image of the person to be collated acquired by the acquisition unit may be collated with the face image of the registrant stored in the storage unit.

  The accumulation determination unit calculates a similarity between a face image of one non-accumulator out of the face images of the non-accumulator registered in the non-accumulator registration unit and a face image of another non-accumulator. A similarity calculation means that further includes a face image of the one unaccumulated person based on the magnitude relationship between the similarity that is the calculation result of the similarity calculation means and a predetermined threshold value. When there are a predetermined number or more of face images of the other non-accumulators recognized to be the same, the one non-accumulator is an unaccumulated person registered more than a predetermined number of times by the non-accumulator registration means. The update unit may be configured to update the accumulator database so that the face image of the one non-accumulator is accumulated as the face image of the accumulator.

  The monitoring method according to the first aspect of the present invention includes an accumulation step of accumulating a face image as an accumulator face image in an accumulator database, an acquisition step of acquiring a face image of a collation target person, and a process of the acquisition step. The degree of similarity between the acquired face image of the person to be collated and the face image of the accumulator accumulated in the accumulating means is calculated and collated, and the similarity that is the collation result in the process of the collation step And a predetermined threshold value to determine whether the face image of the person to be collated is the face image of the accumulator, and the process of the person to be collated by the process of the similarity degree determining step. When it is determined that the face image is the face image of the accumulator, the step of notifying that the person to be collated is the accumulator, and the face image of the person to be collated by the processing of the similarity determination step Is not the accumulator face image, the non-accumulator registration step of registering the face image of the person to be collated as an unaccumulated person and the unregistered person registered by the process of the non-accumulator registration step. The accumulation determination step for determining whether or not the face image of the accumulator has been registered a predetermined number of times or more and the predetermined number of times by the processing of the non-accumulator registration step based on the determination result in the processing of the accumulation determination step Updating the accumulator database so as to accumulate the face image of the non-accumulator who has been stored as the face image of the accumulator.

  The program according to the first aspect of the present invention includes an accumulation step of accumulating a face image as an accumulator's face image, an acquisition step of acquiring the face image of the person to be collated, and a collation target acquired by the processing of the acquisition step A collation step for calculating and collating the similarity between the person's face image and the accumulator's face image stored in the accumulating means, a similarity that is a collation result in the process of the collation step, and a predetermined threshold value The similarity determination step for determining whether or not the face image of the person to be collated is the face image of the accumulator by comparison, and the face image of the person to be collated is stored by the processing of the similarity determination step. When the face image of the person to be collated is determined, the step of notifying that the person to be collated is the accumulator, and the face image of the person to be collated is processed by the similarity determination step. face If it is determined that the face image of the person to be collated is registered as a non-accumulator, the face image of the non-accumulator registered by the process of the non-accumulator registration step is determined. An accumulation determination step for determining whether or not a predetermined number of times have been registered, and a non-accumulator who has been registered for a predetermined number of times by the processing of the non-accumulator registration step based on the determination result in the processing of the accumulation determination step To update the accumulator database so as to accumulate the face image of the accumulator as the accumulator face image.

  A monitoring system according to a second aspect of the present invention is a monitoring system including a monitoring device and a management device that manages an accumulator database used for monitoring processing of the monitoring device, wherein the monitoring device stores a face image. Storing means for accumulating in the accumulator database as a face image of the person, an acquiring means for acquiring the face image of the person to be collated, a face image of the person to be collated acquired by the acquiring means, and the accumulator in the accumulating means The collation means for calculating and comparing the similarity with the face image of the accumulator stored as a database, and comparing the similarity as the collation result of the collation means with a predetermined threshold value, the face image of the person to be collated When the similarity determination unit determines whether the face image of the person to be collated is the face image of the accumulator by the similarity determination unit, A notification means for notifying that the target person is the accumulator, and the similarity determination means when the face image of the person to be collated is not the face image of the person to be collated, Non-accumulator registration means for registering a face image as an unaccumulated person in an unaccumulated person database, and the management apparatus registers the face image of the unaccumulated person registered in the unaccumulated person database more than a predetermined number of times. Accumulation determination means for determining whether or not the image is stored, and based on the determination result of the accumulation determination means, the face image of the non-accumulator who has been registered as the non-accumulator for the predetermined number of times or more is used as the accumulator face image. Updating means for updating the accumulator database so as to accumulate.

  The monitoring apparatus according to the third aspect of the present invention is acquired by an accumulating unit that accumulates a face image as an accumulator's face image in an accumulator database, an acquisition unit that acquires a face image of a person to be collated, and the acquisition unit. The degree of similarity between the face image of the person to be collated and the face image of the accumulator stored as the accumulator database in the accumulator is calculated and collated, and the similarity that is the collation result of the collator And a predetermined threshold value to determine whether the face image of the person to be collated is the face image of the accumulator, and the face image of the person to be collated by the similarity degree judging means Is determined to be a face image of the accumulator, a notification means for notifying that the person to be collated is the accumulator, and a face image of the person to be collated by the similarity determination means It is not the face image of If it is, and a non-accumulating registration means for registering the unaccumulated's database the face image of the collation object person as unaccumulated's.

  The fourth management apparatus of the present invention includes an accumulation determination unit that determines whether or not a face image of an unaccumulated person registered in the unaccumulated person database has been registered a predetermined number of times, and a determination by the accumulation determination unit And updating means for updating an accumulator database so as to accumulate the face image of the non-accumulator as the accumulator face image when it is determined that the image has been registered more than the predetermined number of times based on the result.

  In the monitoring apparatus, method, and program according to the first aspect of the present invention, the face image is accumulated in the accumulator database as the accumulator face image, the face image of the collation target person is acquired, and the collation target person obtained The degree of similarity between the face image of the stored person and the accumulated face image of the accumulator is calculated and collated, and the face image of the person to be collated is stored in the accumulated state by comparing the degree of similarity as a comparison result with a predetermined threshold value. Whether or not the face image of the person to be collated is determined to be the face image of the accumulator, it is notified that the person to be collated is the accumulator. If it is determined that the face image of the collation target person is not the face image of the accumulator, the face image of the collation target person is registered as an unaccumulated person, and the registered face image of the unaccumulated person is a predetermined number of times It is determined whether or not it is registered, Based on the constant result, unaccumulated's face image registered more than a predetermined number of times, the storage's database is updated to be accumulated as the accumulation's face image.

  In the monitoring system according to the second aspect of the present invention, the monitoring device accumulates a face image as an accumulator's face image in the accumulator database, acquires a face image of the person to be collated, and obtains the collation target The similarity between the person's face image and the accumulator's face image stored as the accumulator database is calculated and collated, and the comparison target person is compared by comparing the similarity as a collation result with a predetermined threshold value. It is determined whether the face image of the accumulator is the face image of the accumulator, and when it is determined that the face image of the person to be collated is the face image of the accumulator, the person to be collated is the accumulator. If it is determined that the face image of the person to be collated is not the face image of the accumulator, the face image of the person to be collated is registered as an unaccumulated person in the non-accumulator database, and the management The device It is determined whether or not the face image of the non-accumulator registered in the stacker database has been registered a predetermined number of times or more, and based on the determination result, the unaccumulated person registered as the non-accumulator for the predetermined number of times The accumulator database is updated so as to accumulate the person's face image as the person's face image.

  In the monitoring device according to the third aspect of the present invention, the face image is accumulated in the accumulator database as the accumulator face image, the face image of the collation target person is acquired, the acquired face image of the collation target person, The similarity with the accumulator face image accumulated as the accumulator database is calculated, collated, and the collation target face image is accumulated by comparing the similarity as a collation result with a predetermined threshold value. Whether or not the face image of the person to be collated is determined to be the face image of the accumulator, it is notified that the person to be collated is the accumulator. When it is determined that the face image of the collation target person is not the face image of the accumulator, the face image of the collation target person is registered in the non-accumulator database as an unaccumulated person.

  In the fourth management apparatus of the present invention, it is determined whether or not the face image of the non-accumulator registered in the non-accumulator database has been registered a predetermined number of times, and the predetermined number of times is determined based on the determination result. If it is determined that it has been registered, the accumulator database is updated so that the face image of the non-accumulator is accumulated as the face image of the accumulator.

  In the monitoring system of the present invention, the accumulating means for accumulating the face image as the accumulator's face image in the accumulator database of the monitoring device is, for example, a registered player database, and acquires the face image of the person to be collated For example, the acquiring unit is a face image acquiring unit, and a similarity between the face image of the person to be collated acquired by the acquiring unit and the face image of the accumulator accumulated as the accumulator database in the accumulating unit. The collation means for calculating and collating the degree is, for example, a collation unit, and the face image of the person to be collated is compared with the accumulator by comparing the similarity as the collation result of the collation means with a predetermined threshold value. The similarity determination unit that determines whether or not it is a face image is, for example, a similarity determination unit, and the similarity determination unit determines that the face image of the person to be collated is the face image of the accumulator. Was In this case, the notification means for notifying that the collation target person is the accumulator is a communication unit, and the similarity determination means determines that the face image of the collation target person is not the face image of the accumulator. In this case, the non-accumulator registration means for registering the face image of the person to be collated as an unaccumulated person in the non-accumulator database is an unregistered person database registration unit, and the unregistered person registered in the unaccumulated person database. The accumulation determination unit that determines whether or not the accumulator face image has been registered a predetermined number of times or more is, for example, a DB update determination unit, and based on the determination result of the accumulation determination unit, the accumulation determination unit has not been stored more than the predetermined number of times. The update means for updating the accumulator database so as to accumulate the face image of the non-accumulator registered as the accumulator as the accumulator face image is, for example, a DB update unit.

  That is, the similarity determination unit determines whether or not the similarity between the face image of the person to be verified and the face image of the accumulator accumulated as the registered player database is the same person by comparing with a predetermined threshold. If it is determined that the collation target person is the accumulator, the communication unit notifies that the collation target person is the accumulator, and the collation target person is determined not to be the accumulator. In this case, the unregistered person database registration unit registers the face image of the person to be verified as an unregistered person in the unregistered person database. Further, when the DB update determination unit determines whether or not the registered unregistered face image has been registered a predetermined number of times or more, and determines that it has been registered the predetermined number of times or more based on the determination result The DB update unit registers the face image of the unregistered person in the registrant database as the face image of the registrant.

  As a result, the face image of the person to be registered registered as the face image of the unregistered person more than a predetermined number of times will be registered in the registered player database, so there is no need to manually register the person who came to the store, It is possible to easily collect store visitor information. In addition, if an unregistered person is registered in the same management device even in a plurality of stores, a registrant database can be generated in an integrated manner by the management device, and store visit information of the plurality of stores is managed in an integrated manner. It becomes possible.

  According to the present invention, it is possible to realize not only customer visit information at each store but also collection of customer visit records at a plurality of stores and integrated management.

  Embodiments of the present invention will be described below. Correspondences between the configuration requirements of the present invention and the embodiments described in the detailed description of the present invention are exemplified as follows. This description is to confirm that the embodiments supporting the present invention are described in the detailed description of the invention. Accordingly, although there are embodiments that are described in the detailed description of the invention but are not described here as embodiments corresponding to the constituent elements of the present invention, It does not mean that the embodiment does not correspond to the configuration requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  That is, the monitoring device according to the first aspect of the present invention includes a storage unit (for example, the biometric information DB 22 in FIG. 10) that stores a face image as a face image of the person in the store, and a face image of the person to be collated. The degree of similarity between the acquisition means (for example, the face image acquisition unit 221 in FIG. 10) to be acquired, the face image of the person to be collated acquired by the acquisition means, and the face image of the accumulator accumulated in the accumulation means. The collation means for calculating and collating (for example, the similarity calculation unit 232 in FIG. 10) and the similarity as the collation result of the collation means and a predetermined threshold value are compared, and the face image of the person to be collated is stored in the storage. Similarity determination means (for example, similarity determination unit 233 in FIG. 10) for determining whether or not the face image of the person to be collated and the face image of the person to be collated by the similarity determination means are the face images of the accumulator If it is determined that The notifying means (for example, the communication unit 224 in FIG. 10) for notifying that the target person is the accumulator, and the similarity determination means determine that the face image of the collation target person is not the face image of the accumulator. If registered, it is registered by an unaccumulated person registration means (for example, an unregistered player database registration unit 223 in FIG. 10) and the unaccumulated person registration means for registering the face image of the person to be verified as an unaccumulated person. Based on the determination result of the accumulation determination unit (for example, the number determination unit 243e in FIG. 11) for determining whether or not the face image of the unaccumulated person has been registered a predetermined number of times or more, Update means (for example, the DB update unit 2 in FIG. 11) that updates the accumulator database so as to accumulate the face images of the non-accumulator who have been registered more than a predetermined number of times by the person registration means. Including 2).

  Image capturing means for capturing the image (for example, the camera 38 in FIG. 1) and face image extracting means for extracting the face image of the person to be collated from the image captured by the image capturing means (for example, the face image in FIG. 10). An extraction unit 202) and a feature amount extraction unit (for example, a feature amount extraction unit 231 in FIG. 10) that extracts a feature amount from the face image of the person to be collated. (For example, the similarity calculation unit 232 in FIG. 10) uses a feature amount between the face image of the person to be collated acquired by the acquisition unit and the face image of the registrant stored in the storage unit. By calculating the degree, the face image of the person to be collated acquired by the obtaining unit and the face image of the registrant accumulated in the accumulating unit can be collated.

  The accumulation determination unit (for example, the number determination unit 243e in FIG. 11) includes one unaccumulated person face image registered in the unaccumulated person registration unit and other unaccumulated face images. Similarity calculation means (for example, the similarity determination unit 243d in FIG. 11) for calculating the similarity with the face image of the accumulator can be further included, and the similarity that is the calculation result of the similarity calculation means. When there are a predetermined number or more of the other non-accumulated face images recognized as the same as the one unaccumulated face image based on the magnitude relationship between the degree and the predetermined threshold, The accumulator is regarded as a non-accumulator who has been registered a predetermined number of times or more by the non-accumulator registration means, and the update means (for example, the DB update unit 242 in FIG. 11) And the accumulator face image The storage's database to accumulate may be adapted to update Te.

  According to the monitoring method and program of the first aspect of the present invention, an accumulating step (for example, step S82 in FIG. 16) for accumulating a face image as an accumulator's face image in the accumulator database, and acquiring a face image of the person to be collated The degree of similarity between the acquisition step (for example, step S21 in FIG. 13), the face image of the person to be collated acquired by the processing of the acquisition step, and the face image of the accumulator accumulated in the accumulation means is calculated. By comparing the matching step (for example, step S24 in FIG. 13) to be compared with the similarity that is the matching result in the processing of the matching step and a predetermined threshold, the face image of the person to be collated is A similarity determination step (for example, step S25 in FIG. 13) for determining whether or not the image is a face image, and the face image of the person to be collated is stored by the processing of the similarity determination step. When it is determined that the person is a face image of the person, a notification step (for example, step S28 in FIG. 13) for notifying that the person to be collated is the accumulator, and the process of the similarity degree judgment step A non-accumulator registration step (for example, step S30 in FIG. 13) for registering the face image of the person to be verified as an unaccumulated person when it is determined that the person's face image is not the accumulator's face image; An accumulation determination step (for example, step S66 in FIG. 16) for determining whether or not a face image of an unaccumulated person registered by the process of the unaccumulated person registration step has been registered a predetermined number of times or more. Based on the determination result in the processing, the face image of the non-accumulator who has been registered a predetermined number of times or more by the processing of the non-accumulator registration step is accumulated as the face image of the accumulator Uni updating step of updating the storage's database (e.g., step S62 of FIG. 16) and a.

  A monitoring system according to a second aspect of the present invention is a monitoring system including a monitoring device and a management device that manages an accumulator database used for monitoring processing of the monitoring device, the monitoring device (recognizing biological information in FIG. 10). The apparatus 21) includes a storage unit (for example, the biometric information DB 22 in FIG. 10) that stores a face image as a face image of the store in the store database, and an acquisition unit (for example, FIG. 10) that acquires the face image of the person to be verified. 10 face image acquisition units 221), the degree of similarity between the face image of the person to be collated acquired by the acquisition means and the face image of the accumulator accumulated as the accumulator database in the accumulation means, The face image of the person to be collated is the accumulator by comparing the collation means (for example, the similarity calculation unit 232 in FIG. 10) with the similarity as the collation result of the collation means and a predetermined threshold value. Similarity determination means for determining whether or not the image is a face image (for example, the similarity determination unit 233 in FIG. 10), and the face image of the person to be collated is the face image of the accumulator by the similarity determination means. Is determined, the notifying unit (for example, the communication unit 224 in FIG. 10) for notifying that the person to be collated is the accumulator, and the face image of the person to be collated are accumulated by the similarity determining unit. If it is determined that the face image is not a person's face image, an unaccumulated person registration means (for example, an unregistered player database registration unit 223 in FIG. 10) registers the face image of the person to be collated as an unaccumulated person in the unaccumulated person database. The management device (for example, the biometric information management center 2 in FIG. 1) determines whether or not the face image of the non-accumulator registered in the non-accumulator database has been registered a predetermined number of times or more. Accumulation judgment Based on the determination result of the means (for example, the DB update determination unit 243 in FIG. 11) and the accumulation determination means, the face image of the non-accumulator who has been registered as the non-accumulator more than the predetermined number of times is stored. Update means (for example, the DB update unit 242 in FIG. 11) for updating the accumulator database so as to be accumulated as a face image.

  The monitoring apparatus according to the third aspect of the present invention acquires storage means (for example, the biometric information database 22 in FIG. 10) that stores a face image as an accumulator face image in the accumulator database, and acquires the face image of the person to be collated. Acquisition means (for example, the face image acquisition unit 221 in FIG. 10), the face image of the person to be collated acquired by the acquisition means, and the face image of the accumulator accumulated as the accumulator database in the accumulation means The collation means (for example, the similarity calculation unit 232 in FIG. 10) that calculates and compares the similarity of the face of the person to be collated by comparing the similarity that is the collation result of the collation means with a predetermined threshold value. Similarity determination means (for example, the similarity determination unit 233 in FIG. 10) for determining whether an image is the face image of the accumulator, and the face image of the person to be collated is stored by the similarity determination means. The person's face image If it is determined that the collation target person is the accumulator, the notifying unit (for example, the communication unit 224 in FIG. 10) and the similarity determination unit determine the face image of the collation target person. If it is determined that the face image is not an accumulator face image, an unaccumulated person registration means for registering the face image of the person to be collated as an unaccumulated person in an unaccumulated person database (for example, an unregistered player database registration unit in FIG. 10) 223).

  The fourth management apparatus of the present invention is an accumulation determining means for determining whether or not a face image of an unaccumulated person registered in the unaccumulated person database is registered a predetermined number of times (for example, DB update in FIG. 11). Based on the determination result of the determination unit 243) and the storage determination unit, if it is determined that the predetermined number of times is registered, the face image of the non-accumulator is accumulated so as to be accumulated as the face image of the accumulator. Update means for updating the user database (for example, the DB update unit 242 in FIG. 11).

  FIG. 1 is a diagram showing a configuration of an embodiment of a game shop monitoring system according to the present invention.

  The game stores 1-1 to 1-n are so-called pachinko stores, pachislot stores, or casino stores. These amusement stores 1-1 to 1-n are affiliated stores or member stores of the biometric information management center or the third party amusement store management center, and stores that need to manage a plurality of stores in an integrated manner. It is. The game stores 1-1 to 1-n are connected by a biological information management bus 6 and a third-party game store management bus 7, and the public communication line networks 8 and 9 represented by the bus and the Internet are used. Via each other, biological information and third-party amusement store management information are exchanged. In the following description, when there is no particular need to distinguish each of the game stores 1-1 to 1-n, the game store 1 is simply referred to, and the other configurations are also referred to in the same manner.

  The biometric information management bus 6 mainly functions as a transmission path for distributing biometric information managed by the biometric information recognition device 21 of each game store 1. The third-party game store management bus 7 functions as a transmission path for distributing medium lending management information managed mainly by the medium lending management device 27 of each amusement store 1.

  The biometric information management center 2 is a server used by a business operator who manages and operates the biometric information management center, and is a registered player DB 252 (hereinafter referred to as DB) 3 managed by a biometric information management database (hereinafter also referred to as DB). 11) is updated based on the unregistered player DB 251 (FIG. 11) generated by each gaming store 1, and the updated latest registered player DB 252 is updated to the biometric information recognition device 21 of each gaming store 1. And deliver.

  The third-party amusement store management center 4 is a server used by a business operator that manages and operates the third-party amusement store management center, and the medium lending management managed by the third-party amusement store management database (DB) 5 In addition to updating the information DB based on the information supplied from each game store 1, the updated latest medium lending management information is distributed to the medium lending management device 27 of each game store 1.

  The biometric information recognition apparatus 21 includes image processing units 39-1 to 39 based on images captured by the cameras 38-1 to 38-m, the entrance cameras 40-1 to 40-p, and the in-store cameras 41-1 to 41-q. Based on the face image information extracted by − (m + p + q) and supplied via the biometric information bus 31, the face image registered in advance in the biometric information database 22 is collated. The store visitor's visit is notified to the portable terminal 20 or displayed on the display unit 23 such as a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display). Further, when the face image registered in the biometric information database 22 is collated and does not match, the biometric information recognition device 21 accesses the biometric information management database 3 and registers it in the unregistered player DB 251 as an unregistered person. .

  The game store management device 24 is a so-called hall computer, and monitors the operations of the game machines 36-1 to 36-m via the game store management information bus 30. The game store management device 24 determines a predetermined amount according to the monitoring status such as information on the payout of the game table 36 or the payout of medals, the call information of the players on the game tables 36-1 to 36-m, or the occurrence of an error. The execution result is executed, and the execution result is displayed on the display unit 25 such as a CRT or LCD. The game store management device 24 identifies information supplied from the counter 35, the game machines 36-1 to 36-m, and the game machine peripheral terminals 37-1 to 37-m, respectively. For example, it is managed by the gaming machine management database 26 in association with the gaming machine number.

  The medium lending management device 27 manages the medium lending management information of the rented game media using the medium lending management database 29 based on the information from the payment machine 33 and the lending machine 34, and also the medium lending management database. When the medium lending management information registered in 29 is updated, the updated information is sent to the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9. Further, the medium lending management device 27 acquires the medium lending management information supplied by the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9, and manages the medium lending management. Store in the database 29.

  The lending machine 34 lends a number of game media according to the amount when the player accepts a predetermined amount by cash or a prepaid card when playing on the gaming table 36. At this time, the lending machine 34 supplies information on the number of lent gaming media to the medium lending management device 27 together with information such as the accepted cash and the remaining number of prepaid cards. Thereby, the medium lending management device 27 registers information on the number of lent gaming media in the medium lending management information database 29 together with information such as the received cash and the remaining number of prepaid cards.

  The checkout machine 33 sells prepaid cards with a frequency for borrowing a ball. At this time, the checkout machine 33 supplies the frequency of the prepaid card sold and the amount paid to the medium lending management device 27. Further, the settlement vending machine 33 settles and pays out cash based on the remaining number of game media lent as a frequency such as a prepaid card. At this time, the checkout machine 33 supplies the remaining number of prepaid cards and the amount of cash refunded to the medium lending management device 27.

  The counter 35 counts the number of game media acquired by the player playing on the game table 36, and outputs the counting result as a magnetic card or a receipt.

  The game machines 36-1 to 36-m execute a game when a predetermined operation is performed by the player, and pay out a game ball or a medal according to a so-called small hit or big hit.

  The game console peripheral terminals 37-1 to 37-m are so-called pedestrian machines provided corresponding to the respective game machines 36-1 to 36-m. The same as the lending machine 34) is provided. Further, the gaming machine peripheral terminal 37 acquires biological information such as a face image of the player who plays the gaming machine 36 and transmits it to the biological information recognition device 21 together with the gaming machine identification information (game machine number). FIG. 1 shows an example in which cameras 38-1 to 38-m that acquire a player's face image are provided as a function of acquiring biometric information.

  For example, as shown in FIG. 2, the cameras 38-1 to 38-m are arranged below the table display lamps 61-1 to 61-4 provided on the respective upper sides of the game tables 36-1 to 36-4. As shown in FIG. 3, a face image may be taken so that the player can take an image within the reading range δ. Can be used.

  Further, as shown in FIG. 4, the cameras 38-1 to 38-m are provided with convex portions 71-1 to 71-4 on the gaming machine peripheral terminals 37-1 to 37-4, as shown in FIG. As described above, it may be provided so that a player's face image can be captured within the reading range θ.

  Further, for example, as shown in FIG. 6, the cameras 38-1 to 38-m may be provided at the center of the game table 36 (on the board surface of the game table 36) to take an image. That is, by installing the camera 38 in the installation unit 81 of FIG. 6, the player is imaged within the reading range φ as shown in FIG.

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are installed at entrances and predetermined places in the store of the amusement store 1, and imaged units 39- (m + 1) to 39- (m + p + q).

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are set as shown in FIG. 8, for example. FIG. 8 shows an installation example of the entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q in the game store 1.

  That is, in FIG. 8, entrances 112-1 to 112-3 are provided, and the entrance cameras 40-1 to 40-3 image players who enter the store from each entrance and exit 112. Further, the in-store cameras 41-1 to 41-10 are set at positions at which both surfaces of the island facilities 111-1 to 111-5 can be imaged in a row. The island facilities 111 are provided with game machines 36 on both sides, that is, so as to sandwich the island facilities 111 in the vertical direction in the figure. Since the camera 38, the entrance camera 40, and the in-store camera 41 all have a pan / tilt / zoom function, the in-store cameras 41-1 to 41-10 are arranged as shown in FIG. All players who play at 36 can take an image with any of the in-store cameras 41-1 to 41-10.

  Further, the in-store camera 40-a is provided in front of the lending machine 34, the in-store camera 40-b is provided in front of the checkout machine 33, and the in-store camera 41-c is the counter of the counter 35. It is provided in front, and a player who uses the rental machine 34, the checkout machine 33, and the counter 35 can be imaged.

  That is, as shown in FIG. 8, in the game store 1, a player who visits the store, a player who plays on the game stand 36, and a player who uses the lending machine 34, the checkout machine 33, and the counter 35. The camera 38, the entrance camera 40, and the in-store camera 41 are installed so that almost all of the actions that the player is supposed to take in the gaming store 1 can be monitored.

  Next, a configuration example of the image processing unit 39 will be described with reference to FIG.

  The image acquisition unit 201 acquires an image captured by the camera 38 (or the entrance camera 40 or the in-store camera 41) and supplies it to the face image extraction unit 202. The face image extraction unit 202 extracts a rectangular image composed of a face image from the image supplied from the image acquisition unit 201 using a pattern such as the arrangement of the parts constituting the face, and supplies the rectangular image to the transmission unit 203. The transmission unit 203 transmits the face image to the biometric information recognition device 21.

  Next, a configuration example of the biological information recognition device 21 will be described with reference to FIG.

  The face image acquisition unit 221 acquires the face image supplied from the image processing unit 39 and supplies it to the collation unit 222. The collation unit 222 collates the face image acquired by the face image acquisition unit 221 with the registered player's face image registered in advance in the biometric information DB 22, and if there is a face image that is a candidate with a high degree of similarity. The face images up to the third candidate are displayed on the display unit 23 as the matching result. Further, the collation unit 222 supplies the supplied face image to the unregistered player database registration unit 223 when there is no face image that is a candidate with high similarity.

  More specifically, the feature amount extraction unit 231 of the matching unit 222 extracts a feature amount for identifying a face image, and supplies the feature amount together with the face image to the similarity calculation unit 232. The similarity calculation unit 232 extracts the feature amount of the registered player's face image registered in the biometric information DB 22 and uses the feature amount supplied from the feature amount extraction unit 231 to use the biometric information DB 22. The degree of similarity with the face images of all registered players registered in the face image is obtained, and the face images supplied from the face image acquisition unit 221 and the face images with the third highest degree of similarity are determined by the similarity degree determination unit. 233. More specifically, the similarity calculation unit 232, for example, based on various facial feature amounts such as the ratio between the distance between the eyes, the distance from the chin to the forehead, and the length from the chin to the nose, Each difference sum, average ratio, or ratio sum is obtained as the similarity.

  The similarity determination unit 233 sequentially accumulates the similarities supplied from the similarity calculation unit 232 in the buffer 233a, and with respect to each of the similarities of the top three face images, When the similarity is compared with a predetermined threshold, and the registered face image that is ranked first is similar to the face image supplied from the face image acquisition unit 221 based on the comparison result (similarity When the similarity is higher than the predetermined threshold in the case of similarity indicating that the similarity is higher, or when the similarity is lower than the predetermined threshold in the case of similarity indicating that the similarity is lower as the similarity is lower. Information on the similarity between the face image and the top three is supplied to the display unit 23, and is supplied to the communication unit 224 when displayed. In addition, the similarity determination unit 233 compares the similarity between the face image ranked first and a predetermined threshold value, and the registered face image ranked first is compared with the face image acquisition unit 221 based on the comparison result. When the face image supplied is not similar, the face image supplied from the face image acquisition unit 221 is supplied to the unregistered player database registration unit 223.

  The unregistered player database registration unit 223 registers the face image, which has been supplied as being unregistered by the verification unit 222, in the unregistered player DB 251 of the biometric information management database 3.

  The operation unit 225 includes buttons, a mouse, a keyboard, and the like. The operation unit 225 is operated when any one of the face images displayed on the display unit 23 with the above-mentioned similarity ranked in the top three is selected. Is supplied to the communication unit 224. The communication unit 224 includes a modem or the like, and distributes the selected face image to the mobile terminal 20 based on an operation signal from the operation unit 225.

  Here, for example, the similarity indicates a higher value as it is closer to the face image registered as a registered player as indicated by the ratio sum, and the similarity is a value higher than a predetermined threshold value. In this case, an example will be described in which it is determined that the face image of the registered player corresponding to the similarity is. However, for example, when the similarity is expressed as a difference sum in each feature amount between the captured face image and the face image registered as the registered player, the similarity determination unit 233 determines that the similarity is a threshold value. If it is smaller than that, the captured face image is regarded as a registered player's face image, or in the case of an average ratio or the like, it is greater than or equal to a predetermined value in the range of 0 to 1 and close to 1. If it is a value, it can be considered that they are the same person.

  When a new registered player database 252 (FIG. 11) is distributed from the biometric information management center 2, the database management unit 226 updates the biometric information DB 22 based on the new registered player database 252.

  Next, a configuration example of the biological information management center 2 will be described with reference to FIG.

  The biometric information management center 2 includes a DB distribution unit 241, a DB update unit 242, and a DB update determination unit 243. The registered player DB 252 stored in the biometric information management DB 3 is transferred to the unregistered player DB 251. Update based on. More specifically, the DB update determination unit 243 has a built-in RTC (Real Time Clock) 243a that generates time information, and when a predetermined period has passed based on the built-in RTC 243a, the biological information management DB3 is accessed and it is determined whether or not a new unregistered player is registered in the unregistered player DB 251.

  When an unregistered player is newly registered in the unregistered player DB 251, the DB update determination unit 243 controls the feature amount extraction unit 243 b to register the unregistered player registered in the unregistered player DB 251. The feature amount is extracted from the face image of the player, and the similarity calculation unit 243c is controlled to select one of the face images of the unregistered player registered in the unregistered player DB 251 and other unregistered players. The similarity with the player's face image is calculated. Next, the DB update determination unit 243 controls the similarity determination unit 243d, and based on the comparison between the similarity calculated by the similarity calculation unit 243c and a predetermined threshold, the face of another unregistered player It is determined whether each of the images is similar to the face image of the selected one unregistered player. Then, the DB update determination unit 243 controls the number determination unit 243e so that the number of other unregistered player face images that are similar to the selected one unregistered player face image is equal to or greater than a predetermined number. By determining whether or not the number of times that the degree of similarity has exceeded a predetermined threshold is equal to or greater than a predetermined number of times, if it is equal to or greater than the predetermined number of times, the DB update unit 242 is notified accordingly. The DB update unit 242 accesses the unregistered player DB 251, reads out unregistered players who have been registered a predetermined number of times or more, and registers them in the registered player DB 252. Update. Further, when the registered player DB 252 is updated, the DB update unit 242 notifies the DB distribution unit 241 that it has been updated.

  When notified from the DB update unit 242 that the registered player DB 252 has been updated, the DB distribution unit 241 accesses the biometric information management DB 3 and reads the registered player DB 252 to recognize the biometric information of each gaming store 1. Delivered to the device 21.

  Next, a configuration example of the mobile terminal 20 will be described with reference to FIG.

  The communication unit 271 is configured by a modem or the like, and exchanges data with the biometric information recognition device 21 via a wireless communication network in the game store 1. In addition, the communication unit 271 acquires information indicating that a player with a facial image similar to the facial image supplied from the image processing unit 39, which is distributed from the biometric information recognition device 21, has visited the store. 272.

  The image processing unit 272 is a display constituted by an LCD or the like based on information indicating that a player with a face image similar to the face image supplied from the image processing unit 39 supplied from the communication unit 271 has visited the store. In addition to generating an image to be displayed on the unit 273, the image is displayed on the display unit 273.

  Next, the registered player visit monitoring process will be described with reference to the flowchart of FIG.

  In step S1, the entrance camera 40 determines whether or not the door of the entrance is opened based on the information of the image being captured or the signal from the door of the entrance and exit until the predetermined time elapses. Repeat the process.

  If it is determined in step S <b> 1 that the door is opened, in step S <b> 2, the entrance camera 40 captures an image of the installed range and supplies the captured image to the image processing unit 39. The image acquisition unit 201 of the image processing unit 39 acquires the supplied image and supplies it to the face image extraction unit 202.

  In step S <b> 3, the face image extraction unit 202 extracts a player's face image from the supplied image and supplies the extracted image to the transmission unit 203. More specifically, the face image extraction unit 202 extracts a face image from, for example, an arrangement of a characteristic part such as an eye or a nose, where the skin is exposed from the color of the captured image. To the transmission unit 203.

  In step S <b> 4, the transmission unit 203 transmits the face image supplied from the face image extraction unit 202 to the biological information recognition device 21. At this time, the transmission unit 203 adds information such as a camera ID for identifying each of the camera 38, the entrance camera 40, or the in-store camera 41 and information on the transmission time to the face image and transmits the information to the biometric information recognition apparatus 21. .

  In step S21, the face image acquisition unit 221 of the biological information recognition apparatus 21 acquires a face image. In step S <b> 22, the face image acquisition unit 221 extracts any unprocessed one of the supplied face images and supplies the extracted unprocessed one to the feature amount extraction unit 231.

  In step S23, the feature amount extraction unit 231 of the collation unit 222 extracts the feature amount from the supplied face image, and supplies the feature amount together with the face image to the similarity calculation unit 232.

  In step S24, the similarity calculation unit 232 executes similarity calculation processing.

  Here, the similarity calculation processing will be described with reference to the flowchart of FIG.

  In step S51, the similarity calculation unit 232 extracts a face image of one unprocessed registered player from the face images registered in the registered player DB 252 of the biometric information DB 22, and sets it as a processing target.

  In step S52, the similarity calculation unit 232 extracts a feature amount similar to the feature amount supplied from the feature amount extraction unit 231 from the face image registered in the registered player DB 252 set as the processing target. .

  In step S53, the similarity calculation unit 232 determines the ratio of the eye-to-eye spacing, the length from the chin to the forehead, and the length from the chin to the nose for the face image supplied from the feature amount extraction unit 231. Using the various feature values of the face and the similar feature values in the face image registered in the registered player DB 252 registered in the biometric information DB 22, the difference sum, the average ratio, the ratio sum, etc. Is calculated as the similarity, and in step S54, the similarity with the face image registered in the registered player DB 252 as the calculation result is supplied to the similarity determination unit 233 and registered in the buffer 233a.

  In step S55, the similarity calculation unit 232 determines whether or not an unprocessed registered player face image exists in the registered player DB 252 of the biometric information DB 22, and an unprocessed registered player face image exists. If so, the process returns to step S51. That is, the processes in steps S51 to S55 are repeated until the similarity with the face images of all registered players in the registered player DB 252 is calculated. If it is determined in step S55 that there is no unprocessed registered player face image in the registered player DB 252, the similarity calculation process ends.

  Now, the description returns to the flowchart of FIG.

  In step S25, the similarity determination unit 233 obtains a rank based on the calculation result of the similarity registered in the buffer 233a, and the top three faces among the face images registered in the registered player DB 252. Extract information about image and similarity. Then, the similarity determination unit 233 determines whether or not the highest similarity is greater than a predetermined threshold based on the top three face images and similarity information. That is, the similarity determination unit 233 is a registered player who is most similar (a registered game that is most similar to the facial image acquired by the facial image acquisition unit 221 among facial images registered in the biometric information DB 22). In this case, the similarity of the registered player having the highest similarity is compared with a predetermined threshold.

  Note that, as described above, the similarity between the face image of the registered player who is most similar to the captured face image is not necessarily the highest because of the definition of the similarity. And the threshold value may differ from those in this example.

  If it is determined in step S25 that the highest similarity is greater than a predetermined threshold, in step S26, the similarity determination unit 233 determines that the top third facial image supplied from the similarity calculation unit 232 is the top three. A notification screen 301 indicating that it is a candidate for a registered player's face image is displayed by controlling the display unit 23.

  At this time, for example, a notification screen 301 as shown in FIG. 15 is displayed on the display unit 23.

  In the notification screen 301 of FIG. 15, the camera image display field 311 is provided in the middle left, and the face image supplied from the image processing unit 39 is displayed. Also, on the right side, face image display fields 312-1 to 312-3 of registered players of the top three in the similarity from the first candidate to the third candidate are provided in descending order of similarity. Further, similarity level display fields 313-1 to 313-3 are provided below the face image display fields 312-1 to 312-3 of each registered player, and the level of similarity is displayed. . In FIG. 15, the horizontal length of the area shown in black indicates the magnitude of the similarity.

  Further, ID display fields 314-1 to 314-3 are provided at corresponding positions below the similarity level display fields 313-1 to 313-3, and the face images in the biological information DB 22 of each face image. In FIG. 15, “00051”, “00018”, and “00022” are displayed from the left in FIG.

  Furthermore, below the ID display fields 314-1 to 314-3, confirmation buttons 318-1 to 318-3 operated by the operation unit 225 when each candidate is selected are provided at the corresponding positions. It has been.

  A camera ID display field 315 for identifying the camera that captured the face image is provided under the camera image display field 311. In FIG. 15, the camera 38, the entrance camera 40, and the in-store camera 41 are displayed. “Camera 02” is displayed as a camera ID for identification. Further, a time display field 316 is provided below the camera ID display field 315, and the time taken by the entrance camera 40 is displayed. In FIG. 15, “18:23:32” is displayed. It is shown that the face image in the camera image display field 311 is captured at 18:23:32.

  Furthermore, another person button 317 is provided below the time display field 316, and the face image display fields 312-1 to 312- of the registered player whose face images of the camera image are the first to third candidates. 3 is operated by the operation unit 225 when it is regarded as not similar to any of 3.

  In step S27, the communication unit 224 displays on the display unit 23 whether or not any of the candidate face images has been selected by operating the operation unit 225, for example, the notification screen 301 shown in FIG. If it has been determined, it is determined whether any of the confirmation buttons 318-1 to 318-3 has been operated by the operation unit 225.

  In step S27, for example, when the confirm button 318-1 is operated, it is considered that the face image to be the first candidate has been selected, and in step S28, the communication unit 224 has the selected face image to be the first candidate. And the camera image imaged with the entrance camera 40 is transmitted to the portable terminal 20, and it notifies that the corresponding registered player came to the store.

  In step S41, the communication unit 271 determines whether or not the registered player has been notified of the store visit, and repeats the process until the notification is received. For example, if a registered player's visit is notified in step S41 by the process in step S28, the communication unit 271 notifies the registered player's visit sent from the biometric information recognition device 21 in step S42. , The face image of the registered player and the camera image captured by the entrance camera 40 transmitted together with the notification are supplied to the image processing unit 272. The image processing unit 272 processes information on the selected face image and the camera image captured by the entrance camera 40 into information in a format that can be displayed on the display unit 273, and displays the information on the display unit 273 in step S43. .

  By the above processing, the staff in the game store 1 can recognize the registered player's visit if the portable terminal 20 is possessed.

  In step S29, the face image acquisition unit 221 determines whether or not all of the supplied face images have been processed. If there is an unprocessed face image, the process returns to step S22. That is, the processes in steps S22 to S30 are repeated until the process is performed on all face images. If it is determined that the process has been completed for all face images, the process returns to step S21.

  On the other hand, no candidate face image is selected in step S27. For example, when the other person button 317 on the notification screen 301 in FIG. 15 is pressed, or in step S25, the similarity calculation unit 232 supplies the face image. Based on the information of the top three face images and the similarity, the highest similarity is not greater than a predetermined threshold, that is, even the face image of the most similar registered player If the similarity is less than the predetermined threshold, the similarity determination unit 233 supplies the face image supplied from the image processing unit 39 to the unregistered player database registration unit 223 in step S30. The unregistered player database registration unit 223 accesses the biometric information management database 3 through the biometric management information bus 6 and the public communication line network 8 to register the supplied face image in the unregistered player DB 251.

  If the face image supplied from the image processing unit 39 by the biometric information recognition device 21 is not registered in the biometric information DB 22 by the above processing, the biometric information management managed by the biometric information management center 2 is performed. The face image of the unregistered player is registered in the unregistered player DB 251 in DB3.

  Next, the update process of the registered player DB 252 will be described with reference to the flowchart of FIG.

  In step S61, the DB update determination unit 243 of the biometric information management center 2 inquires the RTC 243a, determines whether or not a predetermined period has elapsed, and repeats the process until the predetermined period elapses. For example, when it is determined in step S61 that the predetermined period has elapsed, in step S62, the DB update determination unit 243 accesses the unregistered player DB 251 of the biometric information management DB 3, and an unregistered player is newly added. It is determined whether or not it is registered, and the processes of steps S61 and S62 are repeated until it is determined that a new unregistered player is registered.

  In step S62, for example, if an unregistered player is newly registered by the process of step S30, the DB update determination unit 243 determines that the unregistered player registered in the unregistered player DB 251 in step S63. Among the face images, one face image of an unprocessed unregistered player is extracted and set as a processing target.

  In step S64, the DB update determination unit 243 controls the feature amount extraction unit 243b to extract the feature amount from the face image of the unregistered player registered in the unregistered player DB 251.

  In step S <b> 65, the DB update determination unit 243 performs the number counting process, and counts the number of times the face image of the unregistered player to be processed registered in the unregistered player DB 251 is captured.

  Here, the number-of-times counting process will be described with reference to the flowchart of FIG.

  In step S91, the DB update determining unit 243 initializes a counter C (not shown) for counting the number of times the face image of the unregistered player who is the processing target is captured to 1.

  In step S92, the DB update determination unit 243 extracts one face image of an unregistered player that is not an unprocessed processing target from the unregistered player DB 251.

  In step S93, the DB update determination unit 243 controls the feature amount extraction unit 243d to extract a feature amount from one of unprocessed unregistered player face images.

  In step S94, the DB update determination unit 243 controls the similarity calculation unit 243c, and the feature amount of the face image of the unregistered player that is the processing target and the unprocessed unprocessed processing target that has not been extracted. The similarity is calculated based on one feature amount of the face image of the registered player. The similarity calculated here may be the same as or similar to the similarity obtained in the process in step S53 described with reference to the flowchart of FIG.

  In step S95, the DB update determination unit 243 controls the similarity determination unit 243d to determine whether or not the obtained similarity is greater than a threshold. For example, if the similarity is greater than or equal to the threshold, processing is performed in step S96. It is assumed that there is a face image of an unregistered player that is not subject to processing, similar to the target unregistered player, and the same unregistered player's face image has been captured multiple times, Counter C is incremented by 1. If the similarity is smaller than the threshold value in step S95, the process in step S96 is skipped.

  In step S97, the DB update determination unit 243 determines whether or not the unregistered player DB 251 includes a face image of an unprocessed unregistered player, for example, the unregistered player DB 251 If there is a face image of an unregistered player that is not the target of processing, the process returns to step S92, and among the face images of unregistered players that are not the target of processing registered in the unregistered player DB 251, Each time a search for the same face image as the face image of an unregistered player that is the target of processing is repeated and the same face image is detected (the processing target that is determined to have a similarity greater than or equal to the threshold is excluded) Counter C is incremented by 1) each time a face image of the unregistered player is detected.

  If it is determined in step S97 that the unregistered player DB 251 does not have an unprocessed unregistered player face image, the process ends.

  Through the above processing, the number of face images that are the same as the face images of the unregistered player to be processed is obtained as the value of the counter C. In other words, the number of times the face image of the unregistered player who is the processing target is registered in the unregistered player DB 251 is obtained as the value of the counter C.

  Now, the description returns to the flowchart of FIG.

  In step S66, the DB update determination unit 243 determines the number of times that the degree of similarity with the unregistered player being processed exceeds the threshold based on whether the value of the counter C is equal to or greater than the predetermined number. It is determined whether or not the number of times is equal to or greater than the number of times, that is, whether or not the number of times the unregistered player to be processed is registered in the unregistered player DB 251 is equal to or greater than a predetermined number.

  In step S66, the counter C is equal to or greater than the predetermined number, that is, the number of times that the similarity with the unregistered player being processed exceeds the threshold is equal to or greater than the predetermined number, and the unregistered target being processed. When the number of times the player has been registered in the unregistered player DB 251 is equal to or greater than the predetermined number, the DB update determination unit 243 updates the registered player DB 252 to the DB update unit 242 in step S67. Notify that it should have entered the state. In response to this, the DB updating unit 242 accesses the unregistered player DB 251 and reads out the facial image information of the unregistered player who has been registered a predetermined number of times or more, and accesses the registered player DB 252. An ID for identifying the face image is attached to the information of the face image of the unregistered player who has been registered a predetermined number of times or more, and is additionally registered in the registered player DB 252 and updated. Furthermore, the DB update unit 242 notifies the DB distribution unit 241 that the registered player DB 252 has been updated.

  In step S <b> 68, the DB update unit 242 has a similarity between the processing target face image additionally registered in the registered player DB 252 and the processing target face image equal to or greater than a threshold value, and is regarded as a face image of the same person. The face image of the unregistered player is deleted from the unregistered player DB 251.

  In step S69, the DB distribution unit 241 accesses and reads the newly updated registered player DB 252 of the biometric information management DB 3, and reads the registered player DB 252 read to the database management unit 226 of the biometric information recognition device 21. To deliver.

  In step S81, the database management unit 226 determines whether or not a new registered player DB 252 updated from the biometric information management center 2 has been distributed, and repeats the processing until it is distributed.

  In step S81, for example, when the newly updated registered player DB 252 is distributed from the DB distribution unit 241 of the biological information management center 2 by the process in step S65, the database management unit 226 distributes in step S82. The biometric information DB 22 is updated based on the information of the registered player DB 252 as well as the registered player DB 252 that is received. More specifically, the database management unit 226 copies and overwrites the newly distributed information of the registered player DB 252 in the biometric information DB 22.

  As a result of the above processing, when one of the gaming stores 1-1 to 1-n is registered in the unregistered player DB 251 as an unregistered player a predetermined number of times or more, it is additionally registered in the registered player DB 252. Since the database is registered in the biometric information DB 22 of any of the biometric information recognition devices 21 of the game stores 1-1 to 1-n, when the images are captured by the entrance camera 40 in a plurality of game stores 1, The visit to the store will be notified as a registered player. In addition, since the registered player DB 252 is updated based on information from each of the game stores 1-1 to 1-n, it is possible to generate customer store records at a plurality of stores, and to integrate customer store records. Management is possible.

  In the above, as shown in the process of step S1 in the flowchart of FIG. 13, the face image in the image captured at the timing when the door of the entrance is opened and the face of the biometric information DB 22 which is the same database as the registered player DB 252 When it is determined whether or not the image has been checked and the store has been visited, if it is not a registered player, it is registered as an unregistered player in the unregistered player DB 251 and registered as an unregistered player a predetermined number of times. Although an example of registration in the registered player DB 252 has been described, the timing at which an image is captured is not limited to this. For example, it is detected that a banknote is jammed in the gaming machine peripheral terminal 37, or a gaming machine 36, the camera 38 and the in-store camera 41 are used at the timing when an abnormal operation such as a ball jam or a medal jam is detected. In this way, by registering a specific player at the time of abnormal operation, for example, when an illegal action is performed using abnormal operation, abnormal operation is performed. Face images of persons who are likely to be cheating by using them are sequentially accumulated in the registered player DB 252 and finally distributed to the biometric information DB 22.

  Therefore, the face image information stored in the biometric information DB 22 changes according to the timing of capturing the face image. In other words, if face images are taken at the time of visiting the store, the biometric information DB 22 can collect the face images of customers who repeatedly visit the store. If the face images are picked up at the time when the abnormal operation is detected, abnormal operations are performed. It is possible to collect face images of persons who are likely to be cheating using them. Similarly, by switching the timing of capturing face images, it is possible to monitor customer visits with the same configuration, or to monitor people who are likely to perform fraudulent acts using abnormal operations. It becomes possible.

  As a result, it is possible to construct a database for various uses by acquiring human face images at the timing when the conditions to be managed as a database are met, and monitoring with face images according to the use Processing can be realized.

  In the above description, as shown in the process of step S1 in the flowchart of FIG. 13, the example in which the face image is extracted at the timing when the door is opened has been described. If a face image is extracted while continuing, it may be collated.

  Furthermore, in the above, the process of updating the biometric information DB 22 by the biometric information recognition device 21 and the biometric information management center 2 of each gaming store 1 has been described, but the biometric information recognition device 21 has the same function as the biometric information DB 22. It may be prepared so that it can be updated in each game store 1.

  FIG. 18 shows the configuration of the biometric information recognition device 21 that allows the biometric information DB 22 to be updated in the game store 1. In the biometric information recognition device 21 in FIG. 18, configurations having the same functions as those in the configuration in the biometric information recognition device 21 in FIG. 10 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  The biometric information recognition apparatus 21 in FIG. 18 is different from the biometric information recognition apparatus 21 in FIG. 10 in that a management database 401 and a biometric information management unit 402 are provided. The management database 401 and the biological information management unit 402 have functions similar to those of the biological information management database 3 and the biological information management center 2, respectively. Therefore, the registered player DB update process is the same as the process described with reference to the flowchart of FIG.

  The biometric information recognition device 21 of FIG. 18 can realize collection of customer store records and integrated management even at each game store 1 alone.

  According to the above, it is possible to realize not only customer visit information at each store but also collection of customer visit records at a plurality of stores and integrated management.

  Incidentally, the series of monitoring processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  FIG. 19 shows a configuration example of a general-purpose personal computer. This personal computer incorporates a CPU (Central Processing Unit) 1001. An input / output interface 1005 is connected to the CPU 1001 via the bus 1004. A ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 are connected to the bus 1004.

  An input / output interface 1005 includes an input unit 1006 including an input device such as a keyboard and a mouse for a user to input an operation command, an output unit 1007 for outputting a processing operation screen and an image of a processing result to a display device, a program and various data. A storage unit 1008 including a hard disk drive to be stored, a LAN (Local Area Network) adapter, and the like, and a communication unit 1009 for performing communication processing via a network represented by the Internet are connected. Also, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (compact disc-read only memory), a DVD (digital versatile disc)), a magneto-optical disk (including an MD (mini disc)), or a semiconductor A drive 1010 for reading / writing data from / to a removable medium 1011 such as a memory is connected.

  The CPU 1001 is read from a program stored in the ROM 1002 or a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, installed in the storage unit 1008, and loaded from the storage unit 1008 to the RAM 1003. Various processes are executed according to the program. The RAM 1003 also appropriately stores data necessary for the CPU 1001 to execute various processes.

  In this specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series in the order described, but of course, it is not necessarily performed in time series. Or the process performed separately is included.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structure of one Embodiment of the monitoring system to which this invention is applied. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the entrance camera and shop camera of FIG. It is a figure explaining the structural example of the image processing unit of FIG. It is a figure explaining the structural example of the biometric information recognition apparatus of FIG. It is a figure explaining the structural example of the biometric information management center and biometric information management DB of FIG. It is a figure explaining the structural example of the portable terminal of FIG. It is a flowchart explaining a registered player visit monitoring process. It is a flowchart explaining a similarity calculation process. It is a figure explaining the example of a display of an alerting | reporting image. It is a flowchart explaining a registration player DB update process. It is a flowchart explaining the count process. It is a figure explaining the other structural example of the biometric information recognition apparatus of FIG. And FIG. 11 is a diagram illustrating a configuration example of a personal computer.

Explanation of symbols

1, 1-1 to 1-n amusement store 2 biometric information management center 3 biometric information management database 4 third party amusement store management center 5 third party amusement store management database 6 biometric information management bus 7 third party amusement store management bus 8, 9 Public communication network 21 Biometric information recognition device 22 Biometric information database 24 Game store management device 26 Game table management database 27 Medium lending management device 29 Medium lending management database 30 Amusement store management information bus 31 Biometric information bus 33 Settling machine 34 Lending machine 35 Counter 36,36-1 thru 36-m Game stand 37,37-1 thru 37-m Game stand peripheral terminal 38,38-1 thru 38-m Camera 39,39-1 thru 39- (m + p + q) Image processing unit 40, 40-1 to 40-p Entrance camera 41, 41-1 to 41-q In-store camera

Claims (8)

Accumulation means for accumulating a face image as an accumulator face image in an accumulator database;
Acquisition means for acquiring a face image of the person to be verified;
A collation means for calculating and collating the similarity between the face image of the person to be collated acquired by the acquisition means and the face image of the accumulator accumulated in the accumulation means;
A similarity determination unit that determines whether or not the face image of the person to be collated is the face image of the accumulator by comparing the similarity that is the collation result of the collation unit and a predetermined threshold;
A notification means for notifying that the collation target person is the accumulator, when the similarity determination means determines that the face image of the collation target person is the accumulator face image;
A non-accumulator registration unit that registers the face image of the collation target person as an unaccumulated person when the similarity determination unit determines that the face image of the collation target person is not the accumulator face image;
Accumulation determination means for determining whether or not the face image of the non-accumulator registered by the non-accumulator registration means is registered a predetermined number of times
Based on the determination result of the accumulation determination unit, the accumulator database is updated so that the face image of the non-accumulator registered by the non-accumulator registration unit more than a predetermined number of times is accumulated as the face image of the accumulator. A monitoring device comprising: An imaging means for capturing an image;
A face image extracting means for extracting the face image of the person to be collated from the image captured by the image capturing means;
Further comprising a feature amount extraction means for extracting a feature amount from the face image of the person to be collated,
The collating unit calculates a similarity using a feature amount between the face image of the person to be collated acquired by the acquiring unit and the face image of the registrant stored in the accumulating unit, and acquires the similarity by the acquiring unit. The monitoring device according to claim 1, wherein the face image of the person to be collated is collated with the face image of the registrant stored in the storage unit. The accumulation determination means includes
A similarity calculation means for calculating a similarity between a face image of one non-accumulator among the face images of the non-accumulator registered in the non-accumulator registration means, and a face image of another non-accumulator Including
Based on the magnitude relationship between the similarity, which is the calculation result of the similarity calculation means, and a predetermined threshold value, the face image of the other non-accumulated person recognized as being identical to the face image of the one non-accumulated person When there is a predetermined number or more, the one unaccumulated person is regarded as an unaccumulated person registered more than a predetermined number of times by the unaccumulated person registration means,
The monitoring apparatus according to claim 1, wherein the updating unit updates the accumulator database so as to accumulate the face image of the one unaccumulated person as the face image of the accumulator. An accumulation step for accumulating a face image as an accumulator face image in an accumulator database;
An acquisition step of acquiring a face image of the person to be verified;
A collation step for calculating and collating the similarity between the face image of the person to be collated acquired by the process of the obtaining step and the face image of the accumulator accumulated in the accumulation unit;
A similarity determination step for determining whether or not the face image of the person to be collated is the face image of the accumulator by comparing the similarity that is the collation result in the process of the collation step with a predetermined threshold;
A notification step of notifying that the person to be collated is the accumulator when the face image of the person to be collated is determined to be the face image of the accumulator by the processing of the similarity determination step;
A non-accumulator registration step of registering the face image of the person to be collated as an unaccumulated person when it is determined that the face image of the person to be collated is not the face image of the accumulator by the processing of the similarity determination step; ,
An accumulation determination step for determining whether or not a face image of an unaccumulated person registered by the process of the unaccumulated person registration step has been registered a predetermined number of times;
Based on the determination result in the process of the accumulation determination step, the face image of the non-accumulator who has been registered a predetermined number of times or more by the process of the non-accumulator registration step is accumulated as the face image of the accumulator. An updating step for updating the accumulator database. An accumulation step for accumulating the face image as an accumulator's face image;
An acquisition step of acquiring a face image of the person to be verified;
A collation step for calculating and collating the similarity between the face image of the person to be collated acquired by the process of the obtaining step and the face image of the accumulator accumulated in the accumulation unit;
A similarity determination step for determining whether or not the face image of the person to be collated is the face image of the accumulator by comparing the similarity that is the collation result in the process of the collation step with a predetermined threshold;
A notification step of notifying that the person to be collated is the accumulator when the face image of the person to be collated is determined to be the face image of the accumulator by the processing of the similarity determination step;
A non-accumulator registration step of registering the face image of the person to be collated as an unaccumulated person when it is determined that the face image of the person to be collated is not the face image of the accumulator by the processing of the similarity determination step; ,
An accumulation determination step for determining whether or not a face image of an unaccumulated person registered by the process of the unaccumulated person registration step has been registered a predetermined number of times;
Based on the determination result in the process of the accumulation determination step, the face image of the non-accumulator who has been registered a predetermined number of times or more by the process of the non-accumulator registration step is accumulated as the face image of the accumulator. A program for causing a computer to execute a process including an update step for updating an accumulator database. In a monitoring system comprising a monitoring device and a management device for managing an accumulator database used for monitoring processing of the monitoring device,
The monitoring device
Accumulating means for accumulating face images in the accumulator database as accumulator face images;
Acquisition means for acquiring a face image of the person to be verified;
A collation means for calculating and collating the similarity between the face image of the person to be collated acquired by the acquisition means and the face image of the accumulator stored as the accumulator database in the accumulation means;
A similarity determination unit that determines whether or not the face image of the person to be collated is the face image of the accumulator by comparing the similarity that is the collation result of the collation unit and a predetermined threshold;
A notification means for notifying that the collation target person is the accumulator, when the similarity determination means determines that the face image of the collation target person is the accumulator face image;
If the similarity determination unit determines that the face image of the person to be collated is not the face image of the person to be collated, an unaccumulated person who registers the face image of the person to be collated as an unaccumulated person in the non-accumulator database Registration means and
The management device
Accumulation determining means for determining whether or not a face image of an unaccumulated person registered in the unaccumulated person database has been registered a predetermined number of times;
An update for updating the accumulator database so as to accumulate the face image of the non-accumulator who has been registered as the non-accumulator a predetermined number of times or more as the accumulator face image based on the determination result of the accumulation determination means. A monitoring system comprising means and Accumulation means for accumulating a face image as an accumulator face image in an accumulator database;
Acquisition means for acquiring a face image of the person to be verified;
A collation means for calculating and collating the similarity between the face image of the person to be collated acquired by the acquisition means and the face image of the accumulator stored as the accumulator database in the accumulation means;
Similarity determination means for determining whether or not the face image of the person to be collated is the face image of the accumulator by comparing the similarity that is the collation result of the collation means with a predetermined threshold;
Notification means for notifying that the collation target person is the accumulator when the similarity determination means determines that the face image of the collation target person is the accumulator face image;
If the similarity determination unit determines that the face image of the person to be collated is not the face image of the person to be collated, an unaccumulated person who registers the face image of the person to be collated as an unaccumulated person in the non-accumulator database A monitoring device including a registration means. Accumulation determination means for determining whether or not a face image of an unaccumulated person registered in the unaccumulated person database has been registered a predetermined number of times;
Update that updates the accumulator database so as to accumulate the face image of the non-accumulator as the accumulator face image when it is determined that the predetermined number of times is registered based on the determination result of the accumulation determination means. A management device including means.

Images