JP2007304984A - Monitoring device, method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To send a mail on services of a game hall to a cell phone carried by a game player when a facial image of the game player registered as a special customer is detected. <P>SOLUTION: When it is determined by a biological information recognition device 21 that a person to be identified matches a game player registered as a special customer, a part 272 for checking members' visit information retrieves the destination of the cell phone 20 of the registered person among those accumulated in the member management DB 18 corresponding to the person to be identified, and a transmitting/receiving part 275 transmits a mail on services to the retrieved cell phone 20 of the game player registered as a special customer corresponding to the person to be identified. This system can be applied to a monitoring system. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a monitoring device, a monitoring method, and a program, and more particularly, to a monitoring device, a method, and a program that can distribute information to a mobile terminal of a customer recognized by a face image.

  In order to promote customer visits, a technology for providing services for encouraging customers to visit stores by distributing information by e-mail using a mobile phone or the like is becoming widespread.

  The information distribution service by e-mail is such that when a customer becomes a member, an e-mail address is registered, and event contents and information are transmitted to the registered e-mail address (see Patent Documents 1 and 2).

  Also, a technology has been proposed in which information around a station is delivered to a preset address as an e-mail when passing through a station ticket gate such as a commuter pass represented by GOPASS (trademark) or the like (Patent Literature) 3).

JP 2000-176134 A JP 2001-321549 A JP 11-0765887

  However, in the information distribution service by e-mail disclosed in Patent Documents 1 and 2, the information is semi-universally distributed by e-mail regardless of whether or not the customer who becomes a member needs information. In other words, for example, even when a member customer is unable to come to the store due to work or housework, or even when the store is not open, such as late at midnight, information distribution by email Will be made. As described above, there is a fear that the information delivery side may inconvenience the customer by ignoring the state of the recipient and delivering the mail.

  In addition, in the case of the information distribution service by e-mail disclosed in Patent Document 3, for example, when the e-mail distribution address is set in advance to a mobile phone or the like possessed by a person different from the person who possesses the commuter pass, Services that should be delivered to customers who have actually visited the store will be delivered to customers who have not actually visited the store, and services that should have been obtained by visiting the store will be provided to customers who have not visited the store. Even there was a risk of providing.

  For this reason, the conventional information distribution service by e-mail can only distribute uniform information to the registered address regardless of the frequency of visits to the store and the condition of the customer. In many cases, it is felt that the information that is used is not useful information with a special advantage by visiting the store, and as a result, it does not lead to an increase in the number of visits, which is the purpose of distributing information by e-mail .

  The present invention has been made in view of such a situation, and in particular, by identifying a person based on biometric authentication based on the face information of the store visitor and distributing information that matches the identified customer's preference by e-mail. It is possible to provide information that is attractive to the customer, and as a result, to increase the number of visits of the customer.

  The monitoring device according to one aspect of the present invention includes a first accumulation unit that accumulates a face image of a registrant registered in advance, an acquisition unit that acquires a face image of a person to be collated, and a collation acquired by the acquisition unit. The similarity between the face image of the subject person and the registrant's face image stored in the first storage means is calculated and collated, the similarity that is the collation result of the collation means, and a predetermined threshold The similarity determination means for determining whether or not the face image of the person to be matched matches the face image of the registrant by comparison with the communication terminal of the registrant in association with the face image of the registrant And when the collation target person is determined to match the registrant by the similarity determination means, the collation target person stored by the second storage means Search for the destination of the communication terminal of the registrant corresponding to A search unit, with respect to the registration of the communication terminal corresponding to the collation object person searched by the searching means, and transmitting means for transmitting predetermined information.

  Image capturing means for capturing an image, face image extracting means for extracting the face image of the person to be collated from the image captured by the image capturing means, and feature amount extraction for extracting a feature amount from the face image of the person to be collated Means for comparing, and the collating means includes a feature amount of the face image of the person to be collated acquired by the acquiring means and the face image of the registrant accumulated in the accumulating means. The degree of similarity can be calculated using, and the face image of the person to be collated acquired by the obtaining unit can be collated with the face image of the registrant accumulated in the first accumulating unit.

  The second storage means matches the registrant's face image in addition to the registrant's communication terminal in addition to the registrant's communication terminal transmission destination in association with the registrant's face image. It is possible to accumulate information at a level corresponding to the number of times and the number of times matching the face image of the person to be collated.

  In the transmission unit, predetermined information corresponding to the preference information registered in association with the face image is transmitted to the communication terminal of the registrant corresponding to the person to be collated searched by the search unit. It can be made to transmit.

  It is determined whether or not the preference information included in the facial image information acquired by the acquisition unit matches the preference information registered for each facial image in the second storage unit. In this case, preference information management means for updating the thought information can be further included.

  Level update means for updating the level according to the number of times of matching with the person to be verified can be included.

  The monitoring method according to one aspect of the present invention is obtained by a first accumulation step of accumulating a registrant's face image registered in advance, an acquisition step of acquiring a face image of the person to be collated, and the processing of the acquisition step. The similarity between the face image of the person to be collated and the face image of the registrant accumulated in the first accumulating means, and the similarity that is the collation result in the process of the collation step A degree-of-similarity determination step for determining whether or not the face image of the person to be matched matches the face image of the registrant by comparing the degree with a predetermined threshold; When the second accumulation step for accumulating the transmission destination of the communication terminal of the registrant and the process of the similarity determination step determines that the collation target person matches the registrant, the second accumulation unit accumulates the destination. Said collation being A search step for searching for a transmission destination of the communication terminal of the registrant corresponding to the person who is registered, and predetermined information for the communication terminal of the registrant corresponding to the person to be searched searched by the processing of the search step Transmitting step.

  The program according to one aspect of the present invention is obtained by a first accumulation step of accumulating a registrant's face image registered in advance, an acquisition step of acquiring a face image of a collation target person, and the processing of the acquisition step. The similarity between the face image of the person to be collated and the registrant face image stored in the first accumulator is calculated and collated, and the similarity that is the collation result in the process of the collation step And a predetermined threshold, a similarity determination step for determining whether the face image of the person to be matched matches the face image of the registrant, and the registration in association with the face image of the registrant A second accumulation step for accumulating the transmission destination of the communication terminal of the user, and when it is determined by the processing of the similarity determination step that the person to be matched matches the registrant, the second accumulation unit accumulates the destination. Said A search step for searching for a transmission destination of the communication terminal of the registrant corresponding to the target person, and predetermined information for the communication terminal of the registrant corresponding to the verification target person searched by the processing of the search step The computer is caused to execute processing including a transmission step of transmitting.

  In the monitoring apparatus and method according to one aspect of the present invention, and a program, a pre-registered registrant face image is accumulated, a collation target person face image is acquired, and the acquired collation target person face image; The similarity with the stored registrant's face image is calculated, collated, and the collation target face image matches the registrant's face image by comparing the similarity as a collation result with a predetermined threshold. Whether or not is determined, the transmission destination of the communication terminal of the registrant is accumulated in association with the face image of the registrant, and is accumulated when it is determined that the collation target person matches the registrant. The transmission destination of the communication terminal of the registrant corresponding to the collation target person is searched, and predetermined information is transmitted to the communication terminal of the registrant corresponding to the searched collation target person.

  In the monitoring apparatus according to one aspect of the present invention, the first accumulation unit that accumulates a pre-registered registrant's face image is, for example, a biometric information database, and an acquisition unit that obtains a collation target person's face image Is, for example, a face image acquisition unit that calculates the similarity between the face image of the person to be verified acquired by the acquisition unit and the face image of the registrant stored in the first storage unit, For example, the collating unit is a collating unit, and whether or not the face image of the person to be collated matches the face image of the registrant by comparing the similarity as a collation result of the collating unit with a predetermined threshold value. The similarity determination unit that determines whether or not is, for example, a similarity determination unit, and is a second storage unit that stores a transmission destination of the communication terminal of the registrant in association with the face image of the registrant. For example, it is a member management DB, and the similarity determination means Search means for searching for a destination of the communication terminal of the registrant corresponding to the person to be collated stored by the second accumulating means when it is determined that the person to be collated matches the registrant; Is, for example, a member information collation unit, and a transmission unit that transmits predetermined information to the communication terminal of the registrant corresponding to the collation target person searched by the search unit is, for example, a transmission unit. is there.

  That is, the similarity determination unit determines whether the similarity between the face image of the person to be verified and the face image of the registrant stored as the registered player database is the same person by comparing with a predetermined threshold. When it is determined that the verification target person is the registrant, the member information verification unit searches the transmission destination of the communication terminal of the registrant corresponding to the verification target person stored in the member management DB. Then, the transmission unit transmits predetermined information to the communication terminal of the registrant corresponding to the searched person to be verified.

  As a result, a predetermined mail is delivered to the registrant's mobile terminal only when the person to be verified is a registrant, so the registrant provides an information distribution service by e-mail only when visiting the store. It becomes possible to receive.

  According to the present invention, it is possible to send an email only to a portable terminal of a person recognized by a face image.

  Embodiments of the present invention will be described below. Correspondences between the configuration requirements of the present invention and the embodiments described in the detailed description of the present invention are exemplified as follows. This description is to confirm that the embodiments supporting the present invention are described in the detailed description of the invention. Accordingly, although there are embodiments that are described in the detailed description of the invention but are not described here as embodiments corresponding to the constituent elements of the present invention, It does not mean that the embodiment does not correspond to the configuration requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  That is, the monitoring device according to one aspect of the present invention acquires first accumulating means (for example, the biometric information DB 22 in FIG. 10) that accumulates registrant face images registered in advance, and the face image of the person to be collated. The similarity between the acquisition unit (for example, the face image acquisition unit 221 in FIG. 10), the face image of the person to be verified acquired by the acquisition unit, and the face image of the registrant stored in the first storage unit The face image of the person to be collated is registered by comparing the collation means (for example, the similarity calculation unit 232 in FIG. 10) that calculates and collates the similarity that is the collation result of the collation means with a predetermined threshold. Similarity determination means (for example, the similarity determination unit 233 in FIG. 10) for determining whether or not the person's face image matches, and transmission of the registrant's communication terminal in association with the registrant's face image Second storage means for storing the destination (for example, the member in FIG. 12) DB 18) and communication of the registrant corresponding to the person to be collated stored by the second accumulating means when the person to be collated is determined to match the registrant by the similarity determination means. A search unit (for example, a member visit information collation unit 272 in FIG. 12) for retrieving a transmission destination of the terminal and a communication terminal of the registrant corresponding to the collation target person searched by the search unit Transmission means for transmitting information (for example, the transmission / reception unit 275 in FIG. 12).

  Image capturing means for capturing an image (for example, the camera 38 in FIG. 1) and face image extracting means for extracting the face image of the person to be collated from the image captured by the image capturing means (for example, face image extraction in FIG. 9). Unit 202) and a feature amount extraction unit (for example, a feature amount extraction unit 231 in FIG. 10) that extracts a feature amount from the face image of the person to be collated can be further included. For example, the similarity calculation unit 232) in FIG. 10 uses the feature amount between the face image of the person to be collated acquired by the acquisition unit and the face image of the registrant stored in the storage unit, and the similarity is calculated. And the face image of the person to be collated obtained by the obtaining unit and the face image of the registrant accumulated in the first accumulating unit can be collated.

  In the second storage means (for example, the member management DB 18 of FIG. 12), in addition to the transmission destination of the registrant's communication terminal, the registrant's preference information, It is possible to accumulate information at a level corresponding to the number of times of matching with the face image of the person to be collated and the number of times of matching with the face image of the person to be collated.

  In the transmission means (for example, the transmission / reception unit 275 in FIG. 12), the communication terminal of the registrant corresponding to the person to be collated searched by the search means is registered in association with the face image. It is possible to transmit predetermined information corresponding to the preference information.

  It is determined whether or not the preference information included in the facial image information acquired by the acquisition unit matches the preference information registered for each facial image in the second storage unit. In this case, preference information management means (for example, the model management unit 281b in FIG. 12) for updating the thought information can be further included.

  Level update means (for example, a customer level management unit 281a in FIG. 12) for updating the level according to the number of times of matching with the person to be verified can be included.

  The monitoring method according to one aspect of the present invention includes a first accumulation step for accumulating a pre-registered registrant face image, an acquisition step for obtaining a collation target person face image (for example, step S221 in FIG. 24), and The collation step for calculating and collating the similarity between the face image of the person to be collated acquired by the process of the obtaining step and the face image of the registrant accumulated in the first accumulation means (for example, FIG. 24). Step S224) and a comparison between the similarity, which is the collation result in the collation process, and a predetermined threshold value, it is determined whether the collation target person's face image matches the registrant's face image. Similarity determination step (for example, step S225 in FIG. 24), a second accumulation step for accumulating the transmission destination of the registrant's communication terminal in association with the registrant's face image, and the similarity determination step Where When it is determined that the verification target person matches the registrant, a search step of searching for a transmission destination of the communication terminal of the registrant corresponding to the verification target person stored by the second storage unit ( For example, step S242 in FIG. 24) and a transmission step (for example, FIG. 24) for transmitting predetermined information to the communication terminal of the registrant corresponding to the person to be collated searched by the processing in the search step. Step S243).

  FIG. 1 is a diagram showing a configuration of an embodiment of a game shop monitoring system according to the present invention.

  The game stores 1-1 to 1-n are so-called pachinko stores, pachislot stores, or casino stores. These amusement stores 1-1 to 1-n are affiliated stores or member stores of the biometric information management center or the third party amusement store management center, and stores that need to manage a plurality of stores in an integrated manner. It is. Each of the game stores 1-1 to 1-n is connected by a biological information management bus 6, a third party game store management bus 7, and a member information management bus 13, and these buses, the public represented by the Internet, etc. Biological information, third-party amusement store management information, and member management information are exchanged with each other via the communication line networks 8, 9, and 12. In the following description, when there is no particular need to distinguish each of the game stores 1-1 to 1-n, the game store 1 is simply referred to, and the other configurations are also referred to in the same manner.

  The biometric information management bus 6 mainly functions as a transmission path for distributing biometric information managed by the biometric information recognition device 21 of each game store 1. The third-party amusement store management bus 7 functions as a transmission path for distributing medium lending management information mainly managed by the medium lending device management device 27 of each amusement store 1. Furthermore, the member information management bus 13 functions as a transmission path for distributing member management information managed mainly by the member management terminal 17 of each game store 1.

  The biometric information management center 2 is a server used by a business operator who manages and operates the biometric information management center. The registered player DB managed by the biometric information management database (hereinafter also referred to as DB) 3 is stored in the biometric information management center 2. In addition to updating based on the unregistered person DB generated by each game shop 1, the latest updated registered player DB is distributed to the biometric information recognition device 21 of each game shop 1.

  The third-party amusement store management center 4 is a server used by a business operator that manages and operates the third-party amusement store management center, and the medium lending management managed by the third-party amusement store management database (DB) 5 In addition to updating the information DB based on the information supplied from each game store 1, the updated latest medium lending management information is distributed to the medium lending management device 27 of each game store 1.

  The member information management center 10 is a server used by a business operator who manages and operates the member information center. The member information management center 10 supplies a DB including member management information managed by the member information management database (DB) 11 from each game shop 1. The updated latest member management information is distributed to the member management terminal 17 of each amusement store 1 as well as being updated based on the received member information. The member referred to here is a registered player registered as a customer who will be described later.

  The member management terminal 17 is registered as a customer with a member registration terminal 16 provided in the game store 1 or a camera-equipped cellular phone (hereinafter also simply referred to as a cellular phone) 20 possessed by the player. In addition to accepting the registered membership of the player, the received member information is displayed on the display unit 19 such as a CRT (Cathode Tube Ray) or LCD (Liquid Crystal Display), and the player's personal information corresponds to the face image At the same time, it is registered in the member management database (DB) 18. In addition, when the member management terminal 17 receives information indicating that the store visit is recognized from the biometric information recognition device 21, the member management terminal 17 displays the information on the display unit 19 and also includes the mobile phone 20 included in the member information of the corresponding face image. Send a service email to the address. Further, the member management terminal 17 supplies information of the member management DB 18 to the member information management center 10 via the member information management bus 13 and the public communication network 12.

  The biometric information recognition apparatus 21 includes image processing units 39-1 to 39 based on images captured by the cameras 38-1 to 38-m, the entrance cameras 40-1 to 40-p, and the in-store cameras 41-1 to 41-q. Based on the face image information extracted by-(m + p + q) and supplied via the biometric information bus 31, the face image registered in advance in the biometric information database 22 is collated and registered if they match. The mobile terminal 42 is notified of the player's visit to the store, and is displayed on the display unit 23 such as a CRT or LCD. The biometric information recognition device 21 compares the face image registered in advance in the biometric information database 22 with the facial image registered as a member, and if it matches, notifies the member management terminal 17 of the visit of the registered player.

  The game store management device 24 is a so-called hall computer, which monitors the operation of the game machines 36-1 to 36-m via the game shop management information bus 30, and starts the game from the game machine 36. When the information shown is supplied, the information is supplied to the biological information recognition device 21. The game store management device 24 determines a predetermined amount according to the monitoring status such as information on the payout of the game table 36 or the payout of medals, the call information of the players on the game tables 36-1 to 36-m, or the occurrence of an error. The execution result is executed, and the execution result is displayed on the display unit 25 such as a CRT or LCD. The game store management device 24 is supplied from each of the checkout vending machine 33, the lending machine 34, the counter 35, the game machines 36-1 to 36-m, and the game machine peripheral terminals 37-1 to 37-m. The incoming information is managed by the gaming machine management database 26 in association with identification information (for example, gaming machine number) for identifying each information.

  The medium lending management device 27 manages the medium lending management information of the rented game media using the medium lending management database 29 based on the information from the payment machine 33, the lending machine 34, and the counting machine 35. When the medium lending management information registered in the medium lending management database 29 is updated, the updated information is sent to the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9. send. Further, the medium lending management device 27 acquires the medium lending management information supplied by the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9, and manages the medium lending management. Store in the database 29.

  The lending machine 34 lends a number of game media according to the amount when the player accepts a predetermined amount by cash or a prepaid card when playing on the gaming table 36. At this time, the lending machine 34 supplies information on the number of lent gaming media to the medium lending management device 27 together with information such as the accepted cash and the remaining number of prepaid cards. Thereby, the medium lending management device 27 registers information on the number of lent gaming media in the medium lending management information database 29 together with information such as the received cash and the remaining number of prepaid cards.

  The checkout machine 33 sells prepaid cards with a frequency for borrowing a ball. At this time, the checkout machine 33 supplies the medium lending management device 27 with the amount paid for the frequency of the prepaid card sold. Further, the settlement vending machine 33 settles and pays out cash based on the remaining number of game media lent as a frequency such as a prepaid card. At this time, the checkout machine 33 supplies the remaining number of prepaid cards and the amount of cash refunded to the medium lending management device 27.

  The counter 35 counts the number of game media acquired by the player playing on the game table 36, and outputs the counting result as a magnetic card or a receipt.

  The game machines 36-1 to 36-m execute a game when a predetermined operation is performed by the player, and pay out a game ball or a medal according to a so-called small hit or big hit.

  The game console peripheral terminals 37-1 to 37-m are so-called pedestrian machines provided corresponding to the respective game machines 36-1 to 36-m. The same as the lending machine 34) is provided. Further, the gaming machine peripheral terminal 37 acquires biological information such as a face image of a player who plays the gaming machine 36 and transmits it to the gaming machine management device 24 together with the gaming machine identification information (game machine number). FIG. 1 shows an example in which cameras 38-1 to 38-m that acquire a player's face image are provided as a function of acquiring biometric information.

  For example, as shown in FIG. 2, the cameras 38-1 to 38-m are arranged below the table display lamps 61-1 to 61-4 provided on the respective upper sides of the game tables 36-1 to 36-4. As shown in FIG. 3, a face image may be taken so that the player can take an image within the reading range δ. Can be used.

  Further, as shown in FIG. 4, the cameras 38-1 to 38-m are provided with convex portions 71-1 to 71-4 on the gaming machine peripheral terminals 37-1 to 37-4, as shown in FIG. As described above, it may be provided so that a player's face image can be captured within the reading range θ.

  Further, for example, as shown in FIG. 6, the cameras 38-1 to 38-m may be provided at the center of the game table 36 (on the board surface of the game table 36) to take an image. That is, by installing the camera 36 in the installation unit 81 of FIG. 6, the player is imaged within the reading range φ as shown in FIG.

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are installed at entrances and predetermined places in the store of the amusement store 1, and imaged units 39- (m + 1) to 39- (m + p + q).

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are set as shown in FIG. 8, for example. FIG. 8 shows an installation example of the entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q in the game store 1.

  That is, in FIG. 8, entrances 112-1 to 112-3 are provided, and the entrance cameras 40-1 to 40-3 image players who enter the store from each entrance and exit 112. Further, the in-store cameras 41-1 to 41-10 are set at positions at which both surfaces of the island facilities 111-1 to 111-5 can be imaged in a row. The island facilities 111 are provided with game machines 36 on both sides, that is, so as to sandwich the island facilities 111 in the vertical direction in the figure. Since the camera 38, the entrance camera 40, and the in-store camera 41 all have a pan / tilt / zoom function, the in-store cameras 41-1 to 41-10 are arranged as shown in FIG. All players who play at 36 can take an image with any of the in-store cameras 41-1 to 41-10.

  Furthermore, the in-store camera 41-a is provided in front of the lending machine 34, the in-store camera 41-b is provided in front of the checkout machine 33, and the in-store camera 41-c is the counter of the counter 35. It is provided in front, and a player who uses the rental machine 34, the checkout machine 33, and the counter 35 can be imaged.

  That is, as shown in FIG. 8, in the game store 1, a player who visits the store, a player who plays on the game stand 36, and a player who uses the lending machine 34, the checkout machine 33, and the counter 35. The camera 38, the entrance camera 40, and the in-store camera 41 are installed so that almost all of the actions that the player is supposed to take in the gaming store 1 can be monitored.

  Next, a configuration example of the image processing unit 39 will be described with reference to FIG.

  When the biometric information recognition apparatus 21 instructs the image acquisition unit 201 to acquire an image, the image acquisition unit 201 acquires an image captured by the camera 38 (or the entrance camera 40 or the in-store camera 41) and supplies the image to the face image extraction unit 202. To do. Note that the image acquisition unit 201 continues to acquire an image captured by the camera 38 (or the entrance camera 40 or the in-store camera 41) even in a state where the instruction from the biometric information recognition device 21 is not received, It can also be supplied to the image extraction unit 202. The face image extraction unit 202 extracts a rectangular image composed of a face image from the image supplied from the image acquisition unit 201 using a pattern such as the arrangement of the parts constituting the face, and supplies the rectangular image to the transmission unit 203. The transmission unit 203 transmits the face image to the biometric information recognition device 21.

  Next, a configuration example of the biological information recognition device 21 will be described with reference to FIG.

  The face image acquisition unit 221 acquires the face image supplied from the image processing unit 39 and supplies it to the collation unit 222. The collation unit 222 collates the face image acquired by the face image acquisition unit 221 with the registered player's face image registered in advance in the biometric information DB 22, and if there is a face image that is a candidate with a high degree of similarity. The face image acquired by the face image acquisition unit 221 and the face image of the player registered as a member are regarded as matching, and the face image regarded as matching is displayed on the display unit 23, and the member It is registered that the registered player is the same as the face image of the player who came to the store by notifying the portable terminal 42 possessed by the attendant of the store via the communication unit 224 that the registered player has visited the store. The face ID of the face image is supplied to the member visit information notification unit 223.

  More specifically, the feature amount extraction unit 231 of the matching unit 222 extracts a feature amount for identifying a face image, and supplies the feature amount together with the face image to the similarity calculation unit 232. The similarity calculation unit 232 extracts the feature amount of the registered player's face image registered in the biometric information DB 22 and uses the feature amount supplied from the feature amount extraction unit 231 to use the biometric information DB 22. The degree of similarity with the face images of all registered players registered in is obtained, and the face image supplied from the face image acquisition unit 221 and the top face image are supplied to the similarity degree determination unit 233. More specifically, the similarity calculation unit 232, for example, based on various facial feature amounts such as the ratio between the distance between the eyes, the distance from the chin to the forehead, and the length from the chin to the nose, Each difference sum, average ratio, or ratio sum is obtained as the similarity.

  The similarity determination unit 233 compares the similarity between the face image with the highest similarity supplied from the similarity calculation unit 232 and a predetermined threshold, and the face registered as a member based on the comparison result When the image is similar to the face image supplied from the face image acquisition unit 221 (in the case of similarity indicating higher similarity, the similarity is higher than a predetermined threshold, In the case of similarity indicating lower similarity, the similarity is lower than a predetermined threshold value), the facial image acquired by the facial image acquisition unit 221 and the registered member's facial image match. Assuming that the information is displayed on the display unit 23, the information is supplied to the communication unit 224 and notified to the portable terminal 42 possessed by the staff of the amusement store 1. Further, at this time, the similarity determination unit 233 supplies the face ID of the face image registered as the same as the face image of the player who has visited the store to the member visit information notification unit 223 and notifies the member management terminal 17 of the face ID. Let

  The member registration unit 225 registers a face image in the biometric information 22 when member registration is requested from the member management terminal 17. At this time, the member registration unit 225 controls the feature amount extraction unit 225a to extract the feature amount from the face image supplied from the member management terminal 17, and controls the similarity calculation unit 225b to already have the biometric information. The similarity with the face image registered in the DB 22 is calculated, the similarity determination unit 225c is controlled, and the face image with a high similarity is displayed on the display unit 23. The presence / absence of duplicate registration is determined from the face image displayed on the display unit 23, and the operation unit 226 is operated by an attendant to register the selected face image. Basically, the feature amount extraction unit 225a, the similarity calculation unit 225b, and the similarity determination unit 225c are the same as the feature amount extraction unit 2331, the similarity calculation unit 232, and the similarity determination unit 233 of the matching unit 222. It has the function of.

  In the biological information DB 22, for example, as shown in FIG. 11, a plurality of face images are registered corresponding to face IDs. FIG. 11 shows an example in which a face ID column is provided on the left, and first face information to third face information are recorded for each face ID.

  Here, for example, the similarity indicates a higher value as it is closer to the face image registered as a registered player as indicated by the ratio sum, and the similarity is a value higher than a predetermined threshold value. In this case, an example will be described in which it is determined that the face image of the registered player corresponding to the similarity is. However, for example, when the similarity is expressed as a difference sum in each feature amount between the captured face image and the face image registered as the registered player, the similarity determination unit 233 determines that the similarity is a threshold value. If it is smaller than that, the captured face image is regarded as a registered player's face image, or in the case of an average ratio or the like, it is greater than or equal to a predetermined value in the range of 0 to 1 and close to 1. If it is a value, it can be considered that they are the same person.

  When information indicating that the game of the gaming table 36 has started is supplied from the gaming table management device 24, the gaming table information acquisition unit 227 identifies information (for example, a gaming table number or a gaming table). ID) is supplied to the imaging instruction unit 228 and the member visit information notification unit 223. The imaging instruction unit 228 instructs the corresponding image processing unit 39 to acquire an image based on the information for identifying the gaming table from the gaming table information acquisition unit 227, and requests the supply of the face image. The member visit information notifying unit 223 notifies the member management terminal 17 that the customer of the corresponding face image has visited the store together with the face ID and the face image.

  Next, a configuration example of the member management terminal 17 will be described with reference to FIG.

  The member visit information receiving unit 271 receives the member visit information supplied from the biometric information recognition device 21 and supplies the face ID included in the member visit information to the member information verification unit 272. Based on the face ID supplied from the member visit information receiving unit 271, the member information collating unit 272 searches and reads the corresponding member information from the member management DB 18, displays it on the display unit 19, and sends the member information to the mail. It supplies to the production | generation part 274, and also supplies the read member information to the member information change part 273.

  The member information changing unit 273 manages the member information supplied from the member information collating unit 272. More specifically, the member information management unit 273 controls the customer level management unit 281a to determine whether it is necessary to change the customer level included in the member information. The member information change processing unit 282 is instructed to update the customer level. The customer level is a level that is set according to the number of visits by registered players. For example, when the number of visits is 1 to 5, the customer level is C, and the number of visits is 6 to In the case of 10 times, the customer level is B, and when the number of visits is 11 times or more, the customer level is A. In addition, the member information management unit 273 controls the model management unit 281b to play the information on the model of the gaming machine 36 that is the player's preference, that is, mainly play the pachinko machine or play the pachislot machine. It is determined whether or not it is necessary to update the information, and the change is instructed to the member information change processing unit 282 as necessary.

  When the member information change processing unit 282 is instructed to change the member information, the member information change processing unit 282 updates the member information registered in the member management DB 18 to the instructed content, and supplies a notification indicating the update to the transmission / reception unit 275. To notify players registered as members.

  The mail generation unit 274 generates a service mail based on information included in the member information supplied from the member information verification unit 272 and time information generated by an RTC (Real Time Clock) 272a. The data is supplied to the transmission / reception unit 275 and transmitted to the mobile phone 20 possessed by the player registered as a member.

  The member registration receiving unit 276 receives member registration from the mobile phone 20 or the member registration terminal 16 and registers the registered contents in the member management DB 18 with a face ID, and causes the member registration requesting unit 277 to store the face ID and face image. Supply. The member registration request unit 277 supplies the face image with the face ID to the biometric information recognition device 21 and requests registration of the face image.

  The member management DB 18 is configured as shown in FIG. 13, for example. In FIG. 13, from the left in the figure, member NO, name, gender, gender, age, e-mail address, customer level, e-mail content (P or PS indicates pachinko or pachislot, respectively) Whether it is mail contents or mail contents for pachislot customers), points, presence / absence of out-of-store mail (whether or not you want to deliver service mail without visiting the store), event E-mail presence / absence, out-of-store email prohibition time (delivery prohibition time when service email distribution is desired without visiting the store), store visit count (month), store ID (identified amusement store 1 registered as a member) ID, which identifies the face image registered in the biological information DB 22), and the latest history (the manufacturer and type of the game machine that was played when the customer visited the store most recently).

  Therefore, in FIG. 13, the player of member NO = 1 has the name “AB”, the gender is male, the age is 20 to 39, and the mail address is “AAA@AA.AA ", Customer level is A, mail content is both pachinko and pachislot, point is" 100 ", mail outside store is required, event mail is requested, mail outside shop “Weekdays 9:00 to 18:00” is set as the prohibited time, the store visit count is “10 times”, the store ID is “0001”, the face ID is “3”, and the latest It is shown that the manufacturer of the game table that was played is “OOO” manufactured by “AA”.

  In addition, a player whose member number is “2” has a name of “CD”, a gender of male, an age of 20 to 39, an email address of “BBB@BB.BB”, and a customer The level is C, the mail content is only pachinko, the point is “5”, no outside mail is requested, no event mail is requested, and no outside mail prohibited time is set Yes, the store visit count is “twice”, the store ID is “0003”, the face ID is “8”, and the manufacturer of the most recent gaming machine is “PPP” made by “BB” It has been shown.

  In addition, a player whose member number is “3” has the name “EF”, the gender is female, the age is 40 to 60 years old, the email address is “CCC@CC.CC”, and the customer The level is B, the mail content is only pachinko, the point is “55”, the mail outside the store is requested, the event mail is not requested, and “all day off” as the mail outside the store prohibition time The store count is “5 times”, the store ID is “0005”, the face ID is “20”, and the manufacturer of the gaming machine that played the most recent game is “CC” QQQ "is shown.

  A player whose member number is 4 has a name of “GH”, a gender of female, an age of 20 to 39, an email address of “DDD@DD.DD”, and a customer level of It is A, the mail content is only pachislot, the point is “122”, the mail outside the store is requested, the event mail is requested, the outside mail prohibition time is not set, and the store visits The count is “15 times”, the store ID is “0009”, the face ID is “120”, and the manufacturer of the most recent game machine is “RRR” manufactured by “DD”. Has been.

  When the member management DB 18 is updated, the member management DB change transmission / reception unit 278 reads the updated member information and transmits it to the member information management center 10. The member information management center 10 updates the member management information DB 11 based on the member information supplied from each store of the amusement store 1 and updated for each store. Furthermore, the member information management center 10 transmits the information in the member management information DB 11 updated based on the member information updated in all stores in a predetermined period to the member management terminal 17 of each game store 1. In response to this, the member management DB change transmission / reception unit 278 of the member management terminal 17 updates the member management DB 18 by overwriting the information in the member information management DB 11 transmitted from the member information management center 10.

  Next, a configuration example of the mobile phone 20 will be described with reference to FIG.

  The operation unit 301 includes a key operation unit 301a and an image acquisition unit 301b. The key operation unit 301a including a keyboard and buttons is operated when inputting various data when registering a member from a remote location outside the store. The image acquisition unit 301b is used when capturing an image, and captures an image according to the operation content of the key operation unit 301a. The operation unit 301 supplies information corresponding to the operation content to the transmission / reception unit 302 and also supplies information corresponding to the operation content or the acquired image to the display unit 306 for display.

  The transmission / reception unit 302 transmits to the member management terminal 17 information when registering the member information supplied from the operation unit 301 and stores the registered member information in the memory 303 when notified of the completion of member registration. Let

  When member registration is performed by the member registration terminal 16 provided in the store, the member registration terminal communication unit 304 receives member information registered at that time from the member registration terminal 16 and stores it in the memory 303.

  Next, a configuration example of the member registration terminal 16 will be described with reference to FIG.

  The operation unit 321 includes a key operation unit 321a and an image acquisition unit 321b. A key operation unit 321a including a keyboard and buttons is operated when inputting various data when registering a member in the amusement store 1. The image acquisition unit 321b is used when capturing an image, and captures an image according to the operation content of the key operation unit 321a. The operation unit 321 supplies information corresponding to the operation content to the transmission / reception unit 322, and also supplies information corresponding to the operation content or the acquired image to the display unit 325 for display.

  The transmission / reception unit 322 transmits information for registration in the member information supplied from the operation unit 321 to the member management terminal 17, and when the completion of member registration is notified, the registered member information is transmitted to the mobile phone communication unit. 323 to be transmitted to the mobile phone 20.

  Next, with reference to FIG. 16, the structural example of the game machine management apparatus 24 is demonstrated.

  When the game table information detection unit 341 obtains information for identifying the game table 36 together with information indicating that the game supplied from the game table 36 has started, the game table information detection unit 341 supplies the information to the game table information transmission unit 342. The game table information transmission unit 342 transmits the information supplied from the game table information detection unit 341 for identifying the game table where the game is started to the biometric information recognition device 21.

  Next, with reference to the flowchart of FIG. 17, the customer information registration process by the mobile phone 20 in a remote place outside the store 1 will be described. The customer is a name indicating the above-mentioned registered member, and a player registered as a member is hereinafter also referred to as a customer.

  In step S1, the operation unit 301 of the mobile phone 20 controls the key operation unit 301a so that the key operation unit 301a is operated by the player to notify that the customer registration is desired at a remote place. It is determined whether or not transmission of (text-free mail) is instructed, and the process is repeated until it is determined that transmission of an empty mail is instructed. In step S1, for example, when the e-mail address of the member management terminal 17 that is managed and operated by the amusement store 1 that is to be registered as a destination is input and the transmission of a blank e-mail is instructed, step S2 Then, the fact is supplied to the transmission / reception unit 302, and an empty mail is transmitted to the member management terminal 17 managed and operated by the amusement store 1 to be registered as a customer.

  In step S31, the member registration receiving unit 276 of the member management terminal 17 determines whether or not an empty mail has been transmitted, and repeats the process until an empty mail is transmitted. In step S31, for example, when a blank mail is transmitted by the process of step S2, the member registration receiving unit 276 receives the blank mail in step S32.

  In step S <b> 33, the member registration receiving unit 276 transmits the mail with the new customer registration format attached to the address of the empty mail transmission source.

  In step S3, the transmission / reception unit 302 determines whether or not the customer registration format has been transmitted, and repeats the processing until it is transmitted. In step S3, for example, when the customer registration format is transmitted by the process of step S33, in step S4, the transmission / reception unit 302 receives the transmitted customer registration format, and in step S5, For example, as shown on the screen 401 in FIG. 18, the information is displayed on the display unit 306 to prompt the user to input necessary items.

  In the screen 401 of FIG. 18, the customer information is shown at the top, and information registered in the member management DB 18 is displayed below the customer information. Field, mail (e-mail address) field, store point field, gaming machine field, non-gaming mail necessity field, event mail necessity field, and mail prohibition time setting items are provided so that each can be entered. It is configured. However, for the member No. and the store visit point, values set in advance by the member registration terminal 17 are input, and the operation unit 301 cannot be operated.

  On the screen 401 in FIG. 18, “AB” as the name is the member number. "1" as email (email address), "AAA@AA.AA", "100" as the point of visit, "Pachinko" as the gaming machine, "necessary" as the necessity of mail outside the gaming store, “Necessary” as the necessity of the event mail indicates that the mail prohibition time is set to “present”, and weekdays from 9:00 to 18:00 are set. Member No. Information other than the store visit point can be input by the player by operating the operation unit 301.

  In step S6, the operation unit 301 determines whether or not an instruction indicating that the input to the customer registration format is completed is input by operating the key operation unit 301a, and the instruction indicating the completion is received. The process is repeated until input. In step S6, for example, when the key operation unit 301a is operated and an instruction indicating that the input to the customer registration format is completed is input, in step S7, the display unit 306 captures a face image. Display a prompt screen.

  In step S8, the operation unit 301 determines whether or not a face image has been captured by operating the image acquisition unit 301b, and the processing is repeated until it is determined that a face image has been captured. For example, if it is determined in step S8 that the image acquisition unit 301b has been operated to capture a face image, in step S9, the operation unit 301 has completed input together with the captured face image. The registration format is supplied to the transmission / reception unit 302. The transmission / reception unit 302 adds the face image to the input customer registration format.

  In step S <b> 10, the transmission / reception unit 302 transmits the input customer registration format to which the face image is added to the member management terminal 17.

  In step S34, the member registration receiving unit 276 of the member management terminal 17 determines whether or not the inputted customer registration format has been transmitted from the mobile phone 20, and repeats the process until it is transmitted. For example, in step S34, when the input customer registration format has been transmitted by the process of step S10, in step S35, the member registration reception unit 276 adds the information of the transmitted customer registration format. Based on this, information for registering in the member management DB 18 is generated. More specifically, the member registration receiving unit 276 adds information that was not included in the customer registration format, and generates information for registration in the member management DB 18. The member registration receiving unit 276 attaches a face ID to the face image attached to the customer registration format.

  In step S36, the member registration receiving unit 276 registers the generated information in the member management DB 18. At this time, the member registration receiving unit 276 displays a screen 411 as shown in FIG.

  In FIG. 19, “customer registration” is displayed at the top, and based on the information of the customer registration format, from the top, the name field, member number. A column, a mail (mail address) column, a customer level column, a gaming machine type column, a non-gaming store mail necessity column, an event mail necessity column, and a mail prohibition time setting item.

  On the screen 411 in FIG. 19, “AB” is the member name. As “1” as email (email address), “AAA@AA.AA” as customer level, “C” as customer level, “pachinko” as gaming machine, “necessary” as necessity of mail outside the game store, “Necessary” as the necessity of the event mail indicates that the mail prohibition time is set to “present”, and weekdays from 9:00 to 18:00 are set.

  A face image registration button 421 is displayed at the lower center of the screen 411, and is operated when a face image registration process is instructed. A return button 422 is displayed on the right side of the face image registration button 421, and is operated when the display of the screen 411 is terminated. The screen 411 is basically displayed when it is displayed for a predetermined time. Therefore, the face image registration button 421 and the return button 422 are buttons that can be operated within a predetermined time when the screen 411 is displayed.

  In step S <b> 37, the member registration receiving unit 276 extracts the face image attached to the customer registration format transmitted from the mobile phone 20 and supplies it to the member registration request unit 277.

  In step S <b> 38, the member registration request unit 277 transmits a notification to the biometric information recognition device 21 to request registration of the face image together with the extracted face image and information on the customer registration format.

  In step S61, the member registration unit 225 determines whether or not the registration of the face image has been requested, and repeats the process until the registration of the face image is requested. In step S61, for example, when there is a request for registration of a face image by the process of step S38, the process proceeds to step S62.

  In step S <b> 62, the member registration unit 225 acquires the face image transmitted from the member management terminal 17. At this time, a face ID is attached to the face image.

  In step S63, the member registration unit 225 controls the feature amount extraction unit 225a to extract the feature amount from the transmitted face image.

  In step S64, the member registration unit 225 controls the feature quantity extraction unit 225a to determine whether or not the feature quantity can be extracted from the face image.

  In step S64, for example, if the feature amount can be extracted from the face image, in step S65, the member registration unit 225 controls the similarity calculation unit 225b to extract the feature amount extracted by the feature amount extraction unit 225a. Based on the above, the similarity for each face image registered in the biological information DB 22 is calculated.

  In step S66, the member registration unit 225 controls the similarity determination unit 225c to extract face images with the highest n-th similarity based on the similarity with the face image registered in the biometric information DB 22. Then, for example, as shown in FIG. 20, a screen 441 for confirming duplicate registration of face images is displayed.

  In the uppermost part of the screen 441 in FIG. 20, “Confirm customer face overlap” is displayed, and the face image transmitted from the member management terminal 17 is displayed in the lower left. In the upper right part of the screen 441, from the customer registration format information, a name column, an e-mail (e-mail address) column, and a customer level column are displayed from above, and in FIG. “AB” indicates that “AAA@AA.AA” is set as the mail (mail address), and “C” is set as the customer level.

  Further, in the middle part of FIG. 20, face images with the top six similarities are displayed. At the bottom, a designation button that is operated by the operation unit 226 when selecting a face image used for registration from among the face images having the top six similarities and the face images requested to be registered. 451 and a return button 452 that is operated when the display of the screen 441 is ended to return to the original state. That is, by this process, if the face image requested for registration has been registered in advance, the registered face image can be registered. As a result, the face image of the same person is registered in duplicate. Is prevented.

  In step S <b> 67, the member registration unit 225 has operated the operation unit 226, and has selected any one of the face images with the highest similarity up to the top six and the face images requested to be registered. The process is repeated until it is determined that the selection has been made.

  In step S67, for example, when the operation unit 226 is operated to select any one of the face images with the highest similarity in the top six and the face images requested to be registered, in step S68. The member registration unit 225 registers the selected face image in the biometric information DB 22 with the notified face ID.

  In step S69, the member registration unit 225 notifies the member management terminal 17 that registration of the requested face image has been completed.

  On the other hand, if it is determined in step S64 that the feature amount cannot be extracted, in step S70, the member registration unit 225 determines that the face image requested for registration is a problematic face image. The member management terminal 17 is notified.

  In step S39, the member registration request unit 277 determines whether or not the face image requested for registration has been notified that there is a problem in registration.

  In step S39, for example, when a notification indicating that the registration of the face image has been completed is received in the process of step S69, in step S40, the member registration request unit 277 indicates that the registration of the customer has been completed. The registration reception unit 276 is notified. Upon receiving this notification, the member registration receiving unit 276 displays that the customer registration has been completed on the display unit 19 as shown in the screen 471 of FIG. Notify that registration is complete.

  In FIG. 21, “Customer update completion notification” is displayed at the top, and based on the information of the customer registration format, from the top, the name column, member number. A column, a mail (mail address) column, a customer level column, a gaming machine type column, a non-gaming store mail necessity column, an event mail necessity column, and a mail prohibition time setting item.

  On the screen 471 in FIG. 21, the name “AB” is the member number. As “1” as email (email address), “AAA@AA.AA” as customer level, “C” as customer level, “pachinko” as gaming machine, “necessary” as necessity of mail outside the game store, “Necessary” as the necessity of the event mail indicates that the mail prohibition time is set to “present”, and weekdays from 9:00 to 18:00 are set.

  In the lower center of the screen 411, “Current customer is 123 people” is displayed, and the number of customers registered in the member management DB 18 is displayed.

  On the other hand, if it is notified in step S39 that the face image requested to be registered has a problem in registration, the member registration request unit 277 sends the face image to the mobile phone 20 in step S41. The member registration receiving unit 276 is instructed to transmit the message. In response to this, the member registration receiving unit 276 notifies the mobile phone 20 to resend the face image again.

  In step S11, the member information receiving unit 305 determines whether or not it has been notified that customer registration has been completed. In step S11, for example, when a notification indicating that the customer registration has been completed is transmitted by the process in step S40, the member information receiving unit 305 has completed the customer registration in step S12. For example, as shown in the screen 491 of FIG. 22, the member information registered in the member management DB 18 input in the customer registration format is stored in the memory 303.

  In the screen 471 of FIG. 22, it is shown at the top of the registration completion mail, and the description information below is the same as the customer information of FIG.

  On the other hand, in step S11, for example, when the retransmission of the face image is notified by the process of step S41, the process returns to step S7, and the subsequent processes are repeated.

  Through the above processing, the face image is registered in the biometric information management device 21 from a remote location outside the amusement store 1 by using the mobile phone 20, and the member information is registered in the member management terminal 17 as a customer. The member information registered as a customer is also stored in the mobile phone 20.

  Next, in-store customer registration processing using the member registration terminal 16 in the store of the amusement store 1 will be described with reference to the flowchart of FIG. The processes in steps S121 to S128 and the processes in steps S151 to S160 in the flowchart of FIG. 23 are the same as the processes in steps S34 to S41 and the processes in steps S61 to S70 in the flowchart of FIG. Shall be omitted.

  In step S91, the operation unit 321 determines whether the key operation unit 321a has been operated and registration of a customer is requested, and the process is repeated until requested. In step S91, for example, when customer registration is requested, the process proceeds to step S92.

  In step S92, the operation unit 321 displays the customer registration format on the display unit 325 and prompts the user to input necessary items.

  In step S93, the operation unit 321 determines whether or not an instruction indicating that the input to the customer registration format is completed is input by operating the key operation unit 321a. The process is repeated until input. In step S93, for example, when the key operation unit 321a is operated and an instruction indicating that the input to the customer registration format is completed is input, in step S94, the display unit 325 captures a face image. Display a prompt screen.

  In step S95, the operation unit 321 determines whether or not a face image has been captured by operating the image acquisition unit 321b, and the process is repeated until it is determined that a face image has been captured. In step S95, for example, when the image acquisition unit 321b is operated and it is determined that a face image has been captured, in step S96, the operation unit 321 has been input with the captured face image. The registration format is supplied to the transmission / reception unit 322. The transmission / reception unit 322 adds a face image to the entered customer registration format.

  In step S97, the transmission / reception unit 322 transmits the input customer registration format to which the face image is added to the member management terminal 17.

  In step S98, the member information receiving unit 324 determines whether or not it has been notified that customer registration has been completed. In step S98, for example, when a notification indicating that the customer registration is completed is transmitted by the process in step S127, in step S99, the member information receiving unit 324 has completed the customer registration. When the notification indicating that the information has been transmitted is received, the member information registered in the member management DB 18 input in the customer registration format is supplied to the mobile phone communication unit 323 and transmitted to the mobile phone 20. 20 is registered. As a result of this processing, the member registration terminal communication unit 304 of the mobile phone 20 receives the member information registered in the member management DB 18 input in the customer registration format and stores it in the memory 303.

  On the other hand, in step S98, for example, when the face image retransmission is notified by the process of step S128, the process returns to step S94, and the subsequent processes are repeated.

  By using the member registration terminal 16 in the store of the game store 1 by the above processing, the face image is registered in the biometric information management device 21 in the game store 1 and the member information is a member as a customer. Member information registered in the management terminal 17 and registered as a customer is also stored in the mobile phone 20. Further, even if the cellular phone 20 does not have a function of capturing an image by this processing, the member information when it is registered as a customer in the memory 303 of the cellular phone 20 is recorded.

  Next, with reference to the flowchart of FIG. 24, a service mail distribution process when a player who has registered a customer visits the store will be described.

  In step S201, the entrance camera 40 determines whether or not the door of the entrance 112 has been opened based on information on the image being captured or a signal from the door of the entrance 112 until a predetermined time has elapsed. Repeat the process.

  If it is determined in step S <b> 201 that the door is opened, in step S <b> 202, the entrance camera 40 captures an image of the installed range and supplies the captured image to the image processing unit 39. The image acquisition unit 201 of the image processing unit 39 acquires the supplied image and supplies it to the face image extraction unit 202.

  In step S <b> 203, the face image extraction unit 202 extracts a player's face image from the supplied image and supplies the extracted image to the transmission unit 203. More specifically, the face image extraction unit 202 extracts a face image from, for example, an arrangement of a characteristic part such as an eye or a nose, where the skin is exposed from the color of the captured image. To the transmission unit 203.

  In step S <b> 204, the transmission unit 203 transmits the face image supplied from the face image extraction unit 202 to the biological information recognition device 21. At this time, the transmission unit 203 adds information such as a camera ID for identifying each of the camera 38, the entrance camera 40, or the in-store camera 41 and information on the transmission time to the face image and transmits the information to the biometric information recognition apparatus 21. .

  In step S221, the face image acquisition unit 221 of the biological information recognition device 21 acquires a face image. In step S <b> 222, the face image acquisition unit 221 extracts any unprocessed one of the supplied face images and supplies the extracted unprocessed one to the feature amount extraction unit 231.

  In step S223, the feature amount extraction unit 231 of the collation unit 222 extracts the feature amount from the supplied face image and supplies it to the similarity calculation unit 232 together with the face image.

  In step 224, the similarity calculation unit 232 determines, for the face image supplied from the feature amount extraction unit 231, the ratio between the distance between eyes, the length from the chin to the forehead, and the length from the chin to the nose. Obtain various facial features, calculate the difference sum, average ratio, or ratio sum of each as the similarity, calculate the similarity ranking as the calculation result, and information on the top face image and similarity Are supplied to the similarity determination unit 233 together with the face image supplied from the feature amount extraction unit 231.

  In step S225, the similarity determination unit 233 determines whether or not the highest similarity is greater than a predetermined threshold based on the highest face image and similarity information supplied from the similarity calculation unit 232. Determine. That is, the similarity determination unit 233 is a registered player registered as the most similar customer (a face image acquired by the face image acquisition unit 221 among the face images registered in the biometric information DB 22). The registered player who is most similar to: The similarity of the registered player having the highest similarity here is compared with a predetermined threshold.

  Note that, as described above, the similarity between the face image of the registered player who is most similar to the captured face image is not necessarily the highest because of the definition of the similarity. And the threshold value may differ from those in this example.

  If it is determined in step S225 that the highest similarity is greater than the predetermined threshold, the similarity determination unit 233 registers the highest facial image supplied from the similarity calculation unit 232 in step S226. The player's face image is displayed by controlling the display unit 23 as an image indicating that the customer has visited the store, and at the same time, the communication unit 224 is controlled to be displayed on the portable terminal 42 possessed by the staff of the game store. Notify me. Further, the similarity determination unit 233 supplies the member ID information 223 with the face ID of the top face image. The member visit information notifying unit 223 notifies the member management terminal 17 that the customer of the corresponding face image has visited the store together with the face ID and the face image.

  On the other hand, if it is determined in step S225 that the highest similarity is not greater than the predetermined threshold, the process of step S226 is skipped.

  In step S227, the face image acquisition unit 221 determines whether or not all of the supplied face images have been processed. If there is an unprocessed face image, the process returns to step S222. That is, the processes in steps S222 to S227 are repeated until the process is performed on all face images. If it is determined that the process has been completed for all face images, the process returns to step S221.

  In step S241, the member visit information receiving unit 271 determines whether or not the customer visit has been notified from the biometric information recognition device 21, and repeats the process until the customer visit is notified. . In step S241, for example, when the customer visit is notified by the processing of step S226, the member visit information receiving unit 271 is attached to the transmitted customer visit information in step S242. The face ID is extracted and supplied to the member information verification unit 272. The member information collating unit 272 collates the member information registered in the member management DB 18 based on the supplied face ID, reads the target member information, and changes the member information changing unit 273 and the mail generating unit 274. To supply.

  In step S243, the mail generation unit 274 generates a service mail to be distributed based on the supplied member information and date / time information generated by the RTC 274a, and supplies the service mail to the transmission / reception unit 275. In the same manner, it is transmitted to the mobile phone 20 possessed by the player who has detected the store visit.

  In step S244, the mail generation unit 274 displays on the display unit 19 a screen 511 as shown in FIG. 25, for example, that the transmission of the service mail when the customer visits the store is completed.

  On the screen 511 in FIG. 25, “Notification of store visit” is displayed at the top, and the face image of the customer who visited the store is displayed on the left side. On the right side, as the member information of the customer who came to the store, from the top, the name column, member number. A column, a mail (mail address) column, a customer level column, a game machine column, and a mail content column are provided. Further, “Mail distribution is completed” is displayed at the bottom of the screen 511, indicating that the service mail has been transmitted.

  On the screen 511 in FIG. 25, “AB” as the name is the member number. “1” as the email (email address) “AAA@AA.AA”, “C” as the customer level, “Pachinko” as the gaming machine, and “Today's event content is a pachinko campaign” "Is shown.

  In step S245, the member information changing unit 273 controls the customer level management unit 281a to increment the store visit count by 1 in the member information, and supplies the incremented store count to the member information change processing unit 282. The member information change processing unit 282 accesses the member management DB 18 and updates the registered store visit count by one.

  In step S246, the member information changing unit 273 controls the customer level management unit 281a to determine whether or not the store visit count is a value for changing the customer level. That is, for example, when the store visit count is 2 times, the customer level is C, when the store visit count is 3 to 9 times, the customer level is B, and when the store visit count is 10 times or more, the customer level is A. When the store visit count is incremented by 1 and becomes 3 times, it is determined that the customer level is a value changed from C to B.

  If it is determined in step S246 that the store visit count is a value for changing the customer level, in step S247, the customer level management unit 281a changes the customer level, and the process returns to step S241.

  On the other hand, if it is determined in step S246 that the store visit count is not a value that changes the customer level, the process in step S247 is skipped.

  In step S261, the transmitting / receiving unit 302 of the mobile phone 20 determines whether or not a service mail has been transmitted from the member management terminal 17, and repeats the process until it is transmitted. In step S261, for example, when a service mail is transmitted by the process of step S243, the transmission / reception unit 302 receives the service mail from the member management terminal 17 in step S262.

  In step S263, the transmission / reception unit 302 causes the display unit 306 to display the received service mail information, for example, a screen 521 as shown in FIG.

  In FIG. 26, “visit store information” is displayed at the top, and “today's event is a pachinko campaign” is displayed after the standard document “Member No. AB”. It can be recognized by a player who is a member who registered today's event as a customer.

  By the above process, the player registered as a customer only enters the store through the entrance / exit 112 of the game store 1, and the service mail as described above is delivered to the mobile phone 20 possessed by the player.

  Next, with reference to the flowchart of FIG. 27, a service mail distribution process at the start of a game of a player who has registered a customer will be described.

  In step S291, the gaming machine information acquisition unit 227 determines whether or not the gaming machine management unit 24 has notified the operation of the gaming machine 36, and repeats the processing until the operating machine is notified. In step S291, for example, when a player who has been registered as a customer starts a game on the game table 36, the game table 36 notifies the game table management device 24 that the game has been started together with information for identifying itself. Notice. As a result, when the gaming table information detection unit 341 of the gaming table management device 24 detects information indicating that the gaming has started together with information identifying the gaming table 36, the information identifying the detected gaming table is used as gaming table information. The data is supplied to the transmission unit 342. The game table information transmission unit 342 transmits information identifying the game table 36 together with information identifying the game table 36 to the biological information recognition device 21. As a result, the gaming machine information acquisition unit 227 receives a notification that the gaming machine has been activated together with information for identifying the gaming machine 36, and the process proceeds to step S292.

  In step S292, the gaming machine information acquisition unit 227 supplies the received information for identifying the gaming machine 36 to the imaging instruction unit 228. The imaging instruction unit 228 instructs the camera 38 corresponding to the gaming machine 36 that has started operation to take an image (acquisition of an image) based on the information for identifying the gaming machine 36.

  In step S311, the camera 38 determines whether or not imaging is instructed, and repeats the processing until the imaging is instructed.

  In step S311, for example, when imaging is instructed by the process of step S292, in step S312, the camera 38 registers an image of the player registered as a customer who is playing the game table 36 where the game is started. Is supplied to the image processing unit 39. The image acquisition unit 201 of the image processing unit 39 acquires the supplied image and supplies it to the face image extraction unit 202.

  In step S <b> 313, the face image extraction unit 202 extracts a player's face image from the supplied image and supplies it to the transmission unit 203.

  In step S <b> 314, the transmission unit 203 transmits the face image supplied from the face image extraction unit 202 to the biological information recognition device 21. At this time, the transmission unit 203 adds information such as a camera ID for identifying each of the camera 38, the entrance camera 40, or the in-store camera 41 and information on the transmission time to the face image and transmits the information to the biometric information recognition apparatus 21. .

  In step S293, the face image acquisition unit 221 of the biological information recognition device 21 acquires a face image. In step S <b> 294, the face image acquisition unit 221 extracts any unprocessed one of the supplied face images and supplies the extracted unprocessed one to the feature amount extraction unit 231.

  In step S295, the feature amount extraction unit 231 of the collation unit 222 extracts the feature amount from the supplied face image and supplies it to the similarity calculation unit 232 together with the face image.

  In step 296, the similarity calculation unit 232 determines, for the face image supplied from the feature amount extraction unit 231, the ratio between the distance between eyes, the length from the chin to the forehead, and the length from the chin to the nose. Obtain various facial features, calculate the difference sum, average ratio, or ratio sum of each as the similarity, calculate the similarity ranking as the calculation result, and information on the top face image and similarity Are supplied to the similarity determination unit 233 together with the face image supplied from the feature amount extraction unit 231.

  In step S297, the similarity determination unit 233 determines whether the highest similarity is greater than a predetermined threshold based on the highest face image and similarity information supplied from the similarity calculation unit 232. Determine. That is, the similarity determination unit 233 compares the similarity of the most similar registered player with a predetermined threshold.

  If it is determined in step S297 that the highest similarity is greater than the predetermined threshold, the similarity determination unit 233 registers the highest facial image supplied from the similarity calculation unit 232 in step S298. The player's face image is displayed by controlling the display unit 23 as an image indicating that the customer has visited the store, and at the same time, the communication unit 224 is controlled to be displayed on the portable terminal 42 possessed by the staff of the game store. Notify me. Further, the similarity determination unit 233 supplies the member ID information 223 with the face ID of the top face image. The member visit information notifying unit 223 notifies the member management terminal 17 that the face ID, the face image, and the information for identifying the game stand are shown together with the corresponding face image customer.

  On the other hand, if it is determined in step S297 that the highest similarity is not greater than the predetermined threshold, the process in step S298 is skipped.

  In step S299, the face image acquisition unit 221 determines whether or not all of the supplied face images have been processed. If there is an unprocessed face image, the process returns to step S294. That is, the processes in steps S294 to S299 are repeated until the process is performed on all the face images. If it is determined that the process has been completed for all face images, the process returns to step S291.

  In step S331, the member store information receiving unit 271 determines whether or not the customer visit has been notified from the biometric information recognition device 21, and repeats the process until the customer visit is notified. . In step S331, for example, when the customer visit is notified by the process of step S298, the member visit information receiving unit 271 is attached to the transmitted customer visit information in step S332. The face ID is extracted and supplied to the member information verification unit 272. The member information collating unit 272 collates the member information registered in the member management DB 18 based on the supplied face ID, reads the target member information, and changes the member information changing unit 273 and the mail generating unit 274. To the member information changing unit 273 based on the information for identifying the gaming table 36.

  In step S333, the member information management unit 281 of the member information change unit 273 controls the member information update processing unit 282, and the information on the model of the gaming machine 36 on which the customer started the game is the latest history in the member management DB 18. Let me record as.

  In step S334, the member information management unit 281 of the member information changing unit 273 causes the customer to play based on the game model information included in the read member information and the information for identifying the game stand 36. It is determined whether or not a game model different from the registered game model is played by comparing with the game model of the existing game table. In step S334, for example, in the member information registered in the member management DB 18, even though “pachinko” is registered as the mail content, the model of the game machine 36 that is playing is “pachislot”. In such a case, it is considered that the game is played with a different game model, and the process proceeds to step S335.

  In step S335, the member information management unit 281 refers to the latest history information included in the member information, and determines whether or not a game machine other than the previously registered game machines has been played. In step S335, for example, when the e-mail content is pachinko but there has been a game of pachislot in the past, a game model other than the game model registered in the past has been played. If it is determined that there is, the process proceeds to step S336.

  In step S <b> 336, the member information management unit 281 controls the mail generation unit 274 to generate a mail inquiring whether or not a game model is additionally registered, and transmits the mail to the customer's mobile phone 20 from the transmission / reception unit 275.

  In step S361, the transmission / reception unit 302 determines whether or not an inquiry mail has been transmitted from the member management terminal 17, and repeats the processing until it is transmitted. In step S361, for example, when a mail inquiring whether or not there is an additional registration of a gaming machine is transmitted by the process in step S336, in step S362, the transmission / reception unit 302 receives an email inquiring whether or not there is additional registration of a gaming machine. And displayed on the display unit 306.

  In step S363, the operation unit 301 determines whether the key operation unit 301a has been operated to request additional registration. When addition is requested in step S363, in step S364, the operation unit 301 controls the transmission / reception unit 302 to send back an email requesting additional registration. On the other hand, if no addition is requested in step S363, the process in step S364 is skipped.

  In step S337, the member information management unit 281 controls the transmission / reception unit 275 to determine whether there is an email requesting additional registration from the mobile phone 20, and requests additional registration through the process of step S364, for example. If it is determined that additional registration is requested by replying the mail, in step S338, the member information update processing unit 282 is controlled so that the mail content of the member information registered in the member management DB 18 is changed. Add and register the contents of different game machines. On the other hand, if additional registration is not requested in step S337, the process in step S338 is skipped.

  In step S339, the member information management unit 281 controls the mail generation unit 274 to generate a mail inquiring whether there is an out-of-store mail, and transmits the mail to the customer's mobile phone 20 from the transmission / reception unit 275.

  In step S365, the transmission / reception unit 302 determines whether or not an inquiry mail has been transmitted from the member management terminal 17, and repeats the process until it is transmitted. In step S365, for example, when a mail for inquiring about the presence / absence of out-of-store mail is transmitted by the processing in step S339, in step S366, the transmission / reception unit 302 receives the mail for inquiring about the presence / absence of out-of-store mail, It is displayed on 306.

  In step S367, the operation unit 301 determines whether or not the key operation unit 301a has been operated to request a mail outside the store. In step S367, when an outside store mail is requested, in step S368, the operation unit 301 controls the transmission / reception unit 302 to send back an email requesting the outside store mail. On the other hand, if the outside mail is not requested in step S367, the process in step S368 is skipped.

  In step S340, the member information management unit 281 controls the transmission / reception unit 275 to determine whether or not there is a mail requesting an out-of-store mail from the mobile phone 20, and for example, the out-of-store mail is processed by the process in step S368. If it is determined that a mail outside the store has been requested by replying the requested mail, the member information update processing unit 282 is controlled in step S342, and among the member information registered in the member management DB 18, Register out-of-store e-mail as “necessary”. On the other hand, if the outside mail is not requested in step S340, the process of step S341 is skipped.

  In step S <b> 342, the member information management unit 281 controls the mail generation unit 274 to generate an update guide email indicating completion of update of member information, and causes the transmission / reception unit 275 to transmit to the customer's mobile phone 20.

  In step S369, the transmission / reception unit 302 determines whether or not an update completion mail has been transmitted from the member management terminal 17, and repeats the processing until it is transmitted. In step S369, for example, when the update completion mail is transmitted by the process of step S342, in step S370, the transmission / reception unit 302 receives the update completion mail, and for example, as shown in FIG. Is displayed on the display unit 306.

  In FIG. 28, “update guide” is displayed at the top, indicating that the mail is a notification of the completion of the update. In addition, “Member No. 1 AB Change Change Accepted” is displayed after that, and below that, the point of visit from the top is “100”, the game model is “Pachislot”, and outside the game store It is shown that there is no email request and no email prohibition time is set.

  Through the above processing, even if a player registered as a customer plays a game model different from the registered game model even if he / she plays without being aware of the type of the game table 36, the member information is different. It is notified that the game model is registered, and further, after confirming the intention to change, it is possible to change the registration by the mobile phone 20 possessed.

  In the above description, the example in which the player has the mobile phone 20 has been described. However, the mobile phone is not limited to the mobile phone 20 as long as the mobile terminal device can receive mail. It goes without saying that a PDA (Personal Digital Assistant) or a portable personal computer may be used instead.

  According to the present invention, it is possible to send an email only to a portable terminal of a person recognized by a face image.

  Incidentally, the series of monitoring processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  FIG. 29 shows a configuration example of a general-purpose personal computer. This personal computer incorporates a CPU (Central Processing Unit) 1001. An input / output interface 1005 is connected to the CPU 1001 via the bus 1004. A ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 are connected to the bus 1004.

  An input / output interface 1005 includes an input unit 1006 including an input device such as a keyboard and a mouse for a user to input an operation command, an output unit 1007 for outputting a processing operation screen and an image of a processing result to a display device, a program and various data. A storage unit 1008 including a hard disk drive to be stored, a LAN (Local Area Network) adapter, and the like, and a communication unit 1009 for performing communication processing via a network represented by the Internet are connected. Also, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (compact disc-read only memory), a DVD (digital versatile disc)), a magneto-optical disk (including an MD (mini disc)), or a semiconductor A drive 1010 for reading / writing data from / to a removable medium 1011 such as a memory is connected.

  The CPU 1001 is read from a program stored in the ROM 1002 or a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, installed in the storage unit 1008, and loaded from the storage unit 1008 to the RAM 1003. Various processes are executed according to the program. The RAM 1003 also appropriately stores data necessary for the CPU 1001 to execute various processes.

  In this specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series in the order described, but of course, it is not necessarily performed in time series. Or the process performed separately is included.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structure of one Embodiment of the monitoring system to which this invention is applied. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the entrance camera and shop camera of FIG. It is a figure explaining the structural example of the image processing unit of FIG. It is a figure explaining the structural example of the biometric information recognition apparatus of FIG. It is a figure explaining the example of a biometric information database. It is a figure explaining the structural example of the member management terminal of FIG. It is a figure explaining the example of member management DB. It is a figure explaining the structural example of the mobile telephone of FIG. It is a figure explaining the structural example of the member registration terminal of FIG. It is a figure explaining the structural example of the game machine management apparatus of FIG. It is a flowchart explaining a remote customer registration process. It is a figure explaining the display image in a remote customer registration process. It is a figure explaining the display image in a remote customer registration process. It is a figure explaining the display image in a remote customer registration process. It is a figure explaining the display image in a remote customer registration process. It is a figure explaining the display image in a remote customer registration process. It is a flowchart explaining an in-store customer registration process. It is a flowchart explaining a service mail delivery process at the time of a store visit. It is a figure explaining the display image in the service mail delivery process at the time of a store visit. It is a figure explaining the display image in the service mail delivery process at the time of a store visit. It is a flowchart explaining a service mail delivery process at the time of game start. It is a figure explaining the display image in the service mail delivery process at the time of a game start. It is a figure explaining a medium.

Explanation of symbols

1, 1-1 to 1-n amusement store 2 biometric information management center 3 biometric information management database 4 third party amusement store management center 5 third party amusement store management database 6 biometric information management bus 7 third party amusement store management bus 8, 9 Public communication line network 10 Member information management center 11 Member information management database 16 Member registration terminal 17 Member management terminal 18 Member management database 21 Biometric information recognition device 22 Biometric information database 24 Game store management device 26 Game stand management database 27 Medium Lending management device 29 Medium lending management database 30 Game store management information bus 31 Biological information bus 33 Settlement machine 34 Lending machine 35 Counter 36, 36-1 to 36-m Game table 37, 37-1 to 37-m Game table periphery Terminal 38,38-1 thru | or 38-m Camera 39,39-1 thru | or 39- (m + + Q) image processing unit 40,40-1 to 40-p entrance camera 41,41-1 to 41-q store camera

Claims (8)

First accumulating means for accumulating face images of registrants registered in advance;
Acquisition means for acquiring a face image of the person to be verified;
Collation means for calculating and collating the similarity between the face image of the person to be collated acquired by the acquisition means and the face image of the registrant accumulated in the first accumulation means;
A similarity determination unit that determines whether or not the face image of the person to be matched matches the face image of the registrant by comparing the similarity that is the matching result of the matching unit and a predetermined threshold;
Second storage means for storing a transmission destination of the registrant's communication terminal in association with the registrant's face image;
When it is determined by the similarity determination means that the person to be verified matches the registrant, the transmission destination of the communication terminal of the registrant corresponding to the person to be verified stored by the second storage means A search means for searching;
A monitoring device comprising: transmitting means for transmitting predetermined information to the communication terminal of the registrant corresponding to the person to be collated searched by the searching means. An imaging means for capturing an image;
A face image extracting means for extracting the face image of the person to be collated from the image captured by the image capturing means;
Further comprising a feature amount extraction means for extracting a feature amount from the face image of the person to be collated,
The collating unit calculates a similarity using a feature amount between the face image of the person to be collated acquired by the acquiring unit and the face image of the registrant stored in the accumulating unit, and acquires the similarity by the acquiring unit. The monitoring apparatus according to claim 1, wherein the face image of the person to be collated is collated with the face image of the registrant accumulated in the first accumulation unit. The second storage means is associated with the registrant's face image, in addition to the registrant's communication terminal transmission destination, the registrant's preference information, and the number of times the registrant's face image matches. The monitoring device according to claim 1, wherein information of a level corresponding to the number of times of matching with the face image of the person to be collated is accumulated. The transmission means transmits predetermined information corresponding to the preference information registered in association with the face image to the communication terminal of the registrant corresponding to the person to be collated searched by the search means. The monitoring device according to claim 3. It is determined whether or not the preference information included in the facial image information acquired by the acquisition unit matches the preference information registered for each facial image in the second storage unit. The monitoring apparatus according to claim 3, further comprising preference information management means for updating the thinking information. The monitoring apparatus according to claim 3, further comprising level update means for updating the level according to the number of times of matching with the person to be verified. A first accumulation step for accumulating a pre-registered registrant's face image;
An acquisition step of acquiring a face image of the person to be verified;
A collation step for calculating and collating the similarity between the face image of the person to be collated acquired by the processing of the acquisition step and the face image of the registrant accumulated in the first accumulation unit;
A similarity determination step of determining whether or not the face image of the person to be matched matches the face image of the registrant by comparing the similarity that is the result of the matching in the process of the matching step with a predetermined threshold;
A second accumulating step of accumulating the transmission destination of the registrant's communication terminal in association with the registrant's face image;
When it is determined by the similarity determination step that the collation target person matches the registrant, transmission of the communication terminal of the registrant corresponding to the collation target person stored by the second storage unit A search step to search for destinations;
A monitoring method comprising: a transmission step of transmitting predetermined information to the communication terminal of the registrant corresponding to the person to be collated searched by the processing of the search step. A first accumulation step for accumulating a pre-registered registrant's face image;
An acquisition step of acquiring a face image of the person to be verified;
A collation step for calculating and collating the similarity between the face image of the person to be collated acquired by the processing of the acquisition step and the face image of the registrant accumulated in the first accumulation unit;
A similarity determination step of determining whether or not the face image of the person to be matched matches the face image of the registrant by comparing the similarity that is the result of the matching in the process of the matching step with a predetermined threshold;
A second accumulating step of accumulating the transmission destination of the registrant's communication terminal in association with the registrant's face image;
When it is determined by the similarity determination step that the collation target person matches the registrant, transmission of the communication terminal of the registrant corresponding to the collation target person stored by the second storage unit A search step to search for destinations;
A program that causes a computer to execute a process including a transmission step of transmitting predetermined information to a communication terminal of a registrant corresponding to the person to be collated searched by the process of the search step.

Images