JP2008023097A - Apparatus, method and program for monitoring - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To monitor visiting of a person who has not left a game saloon yet (no-leaving person). <P>SOLUTION: A saloon-entering registration part 217a accumulates face images of persons who have entered the game saloon (entering persons). A saloon-leaving person calculation part 232b calculates and collates the similarity between the face image of a person who leaves the saloon (leaving persons) and the accumulated face images of the entering persons. A leaving person judging part 233b compares the similarity being the collated result with a prescribed threshold to judge whether or not the face image of the leaving person is that of one of the entering persons. When the leaving person is judged to be one of the entering person, a leaving registering part 217b coordinates the leaving person with the accumulated face images of the entering persons and registers the leaving person. A communication part 214 reports a face image which is accumulated only as the face image of an entering person at a time when closing of the saloon is indicated. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a monitoring device, a monitoring method, and a program, and more particularly, to a monitoring device, a method, and a program that support a closing process, and that can monitor the presence or absence of a person who has not left the store and the visit of a resident.

  In general, a technique for monitoring whether or not all unspecified customers such as amusement stores have closed after the closing time has been reached, and assisting the closing process by an attendant is becoming widespread.

  As a technology to support the closing process by the staff, the number of both people is counted by the sensors that detect the store entrance and the exit, and the difference is taken to grasp the number of people in the store, and it exists in the store at the closing process When the number of people is not 0, what is notified by a warning is proposed (refer to patent documents 1).

JP-A-8-182842

  By the way, in a game store represented by a pachinko store or a pachislot store, there are those who engage in fraud among the players who visit the store. Although this fraudulent act may be fraudulent during the game, it will remain in the game shop even after the closing time has passed, and it will not only act to collect money when the number of employees decreases, There are many frauds after closing, such as remodeling.

  For this reason, an attendant at the game store needs to visually check whether all the players have left the store after the closing time has elapsed. As a result, collection work and cleaning work that should be started immediately after closing the store are delayed, and the store closing process may not be performed efficiently.

  In addition, because of the visual confirmation by the staff, if an unauthorized person lurking in the amusement store cannot be found without closing after the store is closed, an illegal act is actually performed. At this time, although an unauthorized person can be confirmed by a normal monitoring camera, if an unauthorized act is performed with a face hidden by a mask or the like, it is not possible to identify who the unauthorized person is.

  Furthermore, in the above example, since only the number of entrances and exits is managed, it has not been possible to identify the position of an unauthorized person who seems to remain in the amusement store and who is the unauthorized person. Moreover, if an unauthorized person lurking in the amusement store cannot be found without closing after the store is closed, the staff will be exposed to danger such as being attacked by the unauthorized person.

  In addition, when an unauthorized person runs away, there is no material for identifying the unauthorized person, and there is a possibility that recurrence of damage by the same unauthorized person cannot be prevented.

  The present invention has been made in view of such a situation, and supports the closing process, and enables monitoring of the presence or absence of a person who has not left the store and the visit of a resident.

  The monitoring apparatus according to one aspect of the present invention includes a store visitor storage unit that stores a store visitor's face image, a store exit's face image, and a store visitor's face image stored in the store store storage unit. The face image of the store clerk is the face image of the store clerk by comparing a matching means for calculating and comparing the similarity with a predetermined threshold value and the similarity obtained by the matching means. A similarity degree determination means for determining whether or not the store clerk is determined to be the store entrant by the similarity determination means and the face of the store entrant accumulated in the store entrant accumulation means A registration means for registering a store clerk in association with an image, and a face image in which only the face image of the store clerk is stored in the storage means at the time when closing is instructed, And store exit notification means.

  An image pickup means for picking up an image, a face image extraction means for extracting a face image of the store clerk or the store clerk from the image picked up by the image pickup means, and a feature amount from the face image of the store keeper And a feature amount extracting means for extracting the store image, and the store visitor storage means stores the face image of the store visitor extracted by the face image extraction means. The collation means is similar using the feature amount of the face image of the store clerk extracted by the face image extraction means and the face image of the store keeper accumulated in the store entrance storage means. It is possible to calculate the degree and to collate the face image of the store clerk with the face image of the store entrant accumulated in the store entrant accumulation means.

  A survivor accumulating means for accumulating the face image of the store clerk determined as the unleaved person as the face image of the survivor can be further included.

  The collation unit can further calculate the similarity between the face image of the shopkeeper and the face image of the remnant accumulated in the remnant accumulation unit, and can collate the image. Further, the similarity determination unit is configured to determine whether the face image of the shopkeeper is a face image of a survivor by comparing the similarity as a comparison result of the verification unit with a predetermined threshold value. In the case where it is determined that the resident is the resident, the resident registration notification means for notifying that the resident is a resident is further included. it can.

  The monitoring method according to one aspect of the present invention includes a store visitor storage step of storing a store visitor's face image, a store exit's face image, and a store visitor's face image stored in the store store storage means. And a collation step for calculating and comparing the similarity, and the similarity that is the collation result in the processing of the collation step is compared with a predetermined threshold value, whereby the face image of the store clerk is the face of the store clerk When the similarity determination step for determining whether or not the image is an image and the processing of the similarity determination step determine that the store clerk is the store entrant, the store is stored by the processing of the store entrance storage step A registration step of registering the store clerk in association with the face image of the store entrant, and a face image in which only the face image of the store clerk is stored in the storage means at the time when the store closing is instructed. A non-leaving store notification step of notifying as a store exit.

  The program of one aspect of the present invention includes a store visitor storage step for storing a store visitor's face image, a store exit's face image, and a store visitor's face image stored in the store store storage means. The face image of the store clerk is the face image of the store clerk by comparing the matching step for calculating and comparing the similarity and the similarity that is the result of the matching in the processing of the matching step with a predetermined threshold value. If it is determined by the similarity determination step that determines whether or not the store clerk is the store visitor by the processing of the similarity determination step, it is accumulated by the processing of the store entrant accumulation step. A registration step of registering the store clerk in association with the store visitor's face image, and a face image in which only the store visitor's face image is stored in the storage means at the time when the store closing is instructed. Completing a process including a not-to-store notification step for notifying as a store owner To be executed by the data.

  In the monitoring apparatus and method according to one aspect of the present invention, and a program, a store visitor's face image is accumulated, and a similarity between the store exit's face image and the stored store visitor's face image is calculated. Then, by comparing the similarity as a comparison result with a predetermined threshold, it is determined whether or not the face image of the store clerk is the face image of the store entrant, If it is determined that the person is an entry store, the store exit is registered in association with the stored face image of the store visitor, and only the face image of the store entrance is stored at the time when the store is instructed to close. Face image is notified as a person who has not left the store.

  In the monitoring device of the present invention, the store visitor storage means for storing the store visitor's face image is, for example, a store registration unit, and stores the store exit face image and the store visitor storage means. The matching means for calculating and comparing the similarity with the face image of the store clerk is, for example, a store clerk calculation unit, and by comparing the similarity that is the matching result of the matching means with a predetermined threshold, The similarity determination unit that determines whether or not the face image of the store clerk is the face image of the store entrant is, for example, a store exit determination unit, and the store clerk is determined by the similarity determination unit. If the store is determined to be the store visitor, the registration unit that registers the store exit in association with the face image of the store store stored in the store store storage unit is, for example, a store exit registration unit At the time when closing is instructed, a face image in which only the face image of the store clerk is stored in the storage means is not stored. The non-withdrawal store's notification means for notifying a store's, for example, a communication unit.

  The face image of the store visitor and the face image of the store exit are registered, and the face image in which only the face image of the store visitor is stored is notified as an unleaved store at the time when the store closing is instructed. Thus, it is possible to suppress fraudulent behaviors lurking in the store after the closing time. Further, by accumulating face images determined as unleaved persons as survivors, even if the face images of persons who have been determined as unleaved persons cannot be secured, By registering as an image, it is possible to monitor the visits of survivors. Furthermore, it becomes possible to support the closing process depending on the presence / absence of a person who has not left the store.

  According to the present invention, it is possible to support the closing process, to detect a person who has not left the store, and to monitor a store visit by a survivor.

  Embodiments of the present invention will be described below. Correspondences between the configuration requirements of the present invention and the embodiments described in the detailed description of the present invention are exemplified as follows. This description is to confirm that the embodiments supporting the present invention are described in the detailed description of the invention. Accordingly, although there are embodiments that are described in the detailed description of the invention but are not described here as embodiments corresponding to the constituent elements of the present invention, It does not mean that the embodiment does not correspond to the configuration requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  That is, the monitoring device according to one aspect of the present invention includes a store store storage unit (for example, store store registration unit 217a in FIG. 10) that stores a store visitor's face image, a store store's face image, and the store entrance image. The similarity that is the collation result of the collation means (for example, the store exit calculator 232b in FIG. 10) and the collation means for calculating and collating the similarity with the face image of the store entrant accumulated in the store accumulation means. Similarity determination means for determining whether or not the face image of the store clerk is the face image of the store clerk by comparing the degree with a predetermined threshold (for example, the store exit determination unit 233b in FIG. 10) When the similarity determination unit determines that the store clerk is the store entrant, the store clerk is registered in association with the face image of the store entrant stored in the store entrant storage unit. The registration means (for example, the store exit registration unit 217b in FIG. 10) and the time at which closing is instructed, Not withdrawal store's notification means for notifying the face images only person entering the face image to the product unit is accumulated as the non-regression shop's (e.g., the communication unit 214 of FIG. 10) and a.

  An image pickup means (for example, the entrance camera 40 in FIG. 1) for picking up an image and a face image extraction means (for example, a face image extraction means for extracting the face image of the store entrant or the store clerk from the image picked up by the image pickup means) 9, and a feature amount extraction unit (for example, feature amount extraction unit 231 in FIG. 10) that extracts a feature amount from the face image of the store clerk extracted by the face image extraction unit. Can be further included, and the store visitor storage means can store the face image of the store visitor extracted by the face image extraction means, and the collation means (for example, The store exit calculation unit 232b) of FIG. 10 calculates the similarity by using the feature amount of the face image of the store exit and the face image of the store entrance stored in the store entrance storage means. Store the face image of the store clerk and the store store storage means. Has been a person entering the face image can be made to be matched.

  It is possible to further include a survivor accumulation means (for example, a remnant DB management unit 219 in FIG. 10) that accumulates the face image of the store clerk determined as the unleaved person as the face image of the remnant. .

  The collation means (for example, the store exit calculator 232b in FIG. 10) further calculates the similarity between the face image of the store clerk and the face image of the remnant stored in the remnant accumulation means. The similarity determination unit (for example, the store exit determination unit 233b in FIG. 10) further includes a similarity that is a comparison result of the verification unit and a predetermined threshold value. It is possible to determine whether or not the face image of the shopkeeper is a face image of a remnant by comparing the above, and when it is determined that the shopkeeper is the remnant, Resident entry notification means (for example, the communication unit 213 in FIG. 10) for notifying that the person is a store visitor can be further included.

  According to the monitoring method of one aspect of the present invention, a store visitor storage step (for example, step S31 in FIG. 14) for storing a store visitor's face image, a store exit face image, and the store store storage means are provided. The collation step (for example, step S32 in FIG. 14) for calculating and collating the similarity with the accumulated face image of the store visitor, the similarity that is the collation result in the collation step processing, and a predetermined threshold value The similarity determination step (for example, step S33 in FIG. 14) for determining whether or not the face image of the store clerk is the face image of the store clerk by the comparison, and the processing of the similarity determination step When it is determined that the store exit is the store entrance, a registration step (for example, registering the store exit in association with the face image of the store entrance accumulated in the processing of the store entrance accumulation step (for example, Step S35 in FIG. 14 and closing instructions were given In time, and a non-regression shop party notification step of notifying the face images only person entering the face image in the storage means is stored as a non-regression shop's (e.g., step S98 of FIG. 17).

  FIG. 1 shows an example of a monitoring system for monitoring a store who has not left the store without closing after the amusement store is closed according to the present invention, and a visitor of a remnant who has been determined to have not left the store in the past. It is a figure which shows the structure of embodiment.

  The game stores 1-1 to 1-n are so-called pachinko stores, pachislot stores, or casino stores. These amusement stores 1-1 to 1-n are affiliated stores or member stores of a biometric information management center or a third party amusement store management center, and stores that need to manage a plurality of stores in an integrated manner. It is. Each of the game stores 1-1 to 1-n is connected by a biological information management bus 6 and a third party game store management bus 7, and the public communication line networks 8 and 9 represented by the bus and the Internet are used. Via each other, biological information and third party game store management information are exchanged. In the following description, when there is no particular need to distinguish each of the game stores 1-1 to 1-n, the game store 1 is simply referred to, and the other configurations are also referred to in the same manner.

  The biometric information management bus 6 mainly functions as a transmission path for distributing biometric information managed by the biometric information recognition device 20 of each game store 1. The third-party game store management bus 7 functions as a transmission path for distributing medium lending management information managed mainly by the medium lending management device 27 of each amusement store 1.

  The security information management center 2 is a server used by a business operator who manages and operates the security information management center, and is a registered survivor DB 252 (hereinafter referred to as DB) 3 managed by the security information management database (hereinafter also referred to as DB). 11) is updated based on the unregistered survivor DB 251 (FIG. 11) generated by each gaming store 1, and the updated latest registered survivor DB 252 is updated to the biometric information recognition device 20 of each gaming store 1. And deliver.

  The third-party amusement store management center 4 is a server used by a business operator that manages and operates the third-party amusement store management center, and the medium lending management managed by the third-party amusement store management database (DB) 5 In addition to updating the information DB based on the information supplied from each game store 1, the updated latest medium lending management information is distributed to the medium lending management device 27 of each game store 1.

  The security security company server 10 is a server that is used by a business operator that manages and operates a security security company, and indicates that there are unleaved persons or survivors from the biometric information recognition device 20 of each amusement store 1. When the message is received, the notification is displayed on the display unit 11 formed of a CRT or LCD, and security guards of the security company are arranged based on the notification. The operation unit 12 is composed of a keyboard, buttons, etc., and is required by a security guard arranged by a person who has not left the store or a survivor, or is notified of a false report by telephone or the like. Accordingly, it is operated when permitting automatic closing processing of the game store 1.

  The biological information recognition apparatus 20 includes image processing units 39-1 to 39 based on images captured by the cameras 38-1 to 38-m, the entrance cameras 40-1 to 40-p, and the in-store cameras 41-1 to 41-q. Based on the facial image information extracted by-(m + p + q) and supplied via the biological information bus 31, the facial image registered in the store / buyer information database 21 is collated, Both the face image and the face image at the time of leaving the store are registered and collated with the face images registered in the remnant DB 22, and if they match, the mobile terminal 17 is notified of the visit of the registered player registered as a remnant. Or displayed on a display unit 23 such as a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display).

  Further, the biometric information recognition device 20 has a face image of the store visitor and the store exit based on the information of the face image of the store entrance and the store exit registered in the store entrance / exit store information database 21. The face image of the person who has not left the store is detected. Furthermore, the biometric information recognition apparatus 20 accesses the security information management database 3 and registers it in the unregistered survivor DB 251 as an unregistered survivor while registering the face image detected as an unsaved person in the survivor DB 22. .

  Furthermore, the biometric information recognition device 20 can be used when the locking is completed based on signals from the door lock sensors 18-1 to 18-t that detect the locked state of the entrance 112 (FIG. 8) of the gaming store 1. 1 is closed, and at this time, when it is determined that there is a person who has not left the store, the person detection sensors 19-1 to 19-s for detecting a person are controlled to leave the store in the amusement store 1. The position where the person exists is detected.

  The game store management device 24 is a so-called hall computer, and monitors the operations of the game machines 36-1 to 36-m via the game store management information bus 30. The game store management device 24 determines a predetermined amount according to the monitoring status such as information on the payout of the game table 36 or the payout of medals, the call information of the players on the game tables 36-1 to 36-m, or the occurrence of an error. The execution result is executed, and the execution result is displayed on the display unit 25 such as a CRT or LCD. The game shop management device 24 is supplied with information from the settlement machine 33, the lending machine 34, the counter 35, the game machines 36-1 to 36-m, and the game machine peripheral terminals 37-1 to 37-m. Are managed by the gaming machine management database 26 in association with identification information (for example, gaming machine number) for identifying each.

  The medium lending management device 27 manages the medium lending management information of the rented game media using the medium lending management database 29 based on the information from the payment machine 33, the lending machine 34, and the counting machine 35. When the medium lending management information registered in the medium lending management database 29 is updated, the updated information is sent to the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9. send. Further, the medium lending management device 27 acquires the medium lending management information supplied by the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9, and manages the medium lending management. Store in the database 29.

  The lending machine 34 lends a number of game media according to the amount when the player accepts a predetermined amount by cash or a prepaid card when playing on the gaming table 36. At this time, the lending machine 34 supplies information on the number of lent gaming media to the medium lending management device 27 together with information such as the accepted cash and the remaining number of prepaid cards. Accordingly, the medium lending management device 27 registers information on the number of lent gaming media in the medium lending management information database 29 together with information such as the accepted cash and the remaining number of prepaid cards.

  The checkout machine 33 sells prepaid cards with a frequency for borrowing a ball. At this time, the checkout machine 33 supplies the frequency of the prepaid card sold and the amount paid to the medium lending management device 27. Further, the settlement vending machine 33 settles and pays out cash based on the remaining number of game media lent as a frequency such as a prepaid card. At this time, the checkout machine 33 supplies the remaining number of prepaid cards and the amount of cash refunded to the medium lending management device 27.

  The counter 35 counts the number of game media acquired by the player playing on the game table 36, and outputs the counting result as a magnetic card or a receipt.

  The game machines 36-1 to 36-m execute a game when a predetermined operation is performed by the player, and pay out a game ball or a medal according to a so-called small hit or big hit.

  The gaming machine peripheral terminals 37-1 to 37-m are so-called inter-story machines provided corresponding to the gaming machines 36-1 to 36-m. Further, the gaming machine peripheral terminal 37 acquires biological information such as a face image of the player who plays the gaming machine 36 and transmits it to the biological information recognition device 20 together with the gaming machine identification information (game machine number). FIG. 1 shows an example in which cameras 38-1 to 38-m that acquire a player's face image are provided as a function of acquiring biometric information.

  For example, as shown in FIG. 2, the cameras 38-1 to 38-m are arranged below the table display lamps 61-1 to 61-4 provided on the respective upper sides of the game tables 36-1 to 36-4. As shown in FIG. 3, a face image may be taken so that the player can take an image within the reading range δ. Can be used.

  Further, as shown in FIG. 4, the cameras 38-1 to 38-m are provided with convex portions 71-1 to 71-4 on the gaming machine peripheral terminals 37-1 to 37-4, as shown in FIG. As described above, it may be provided so that a player's face image can be captured within the reading range θ.

  Further, for example, as shown in FIG. 6, the cameras 38-1 to 38-m may be provided at the center of the game table 36 (on the board surface of the game table 36) to take an image. That is, by installing the camera 36 in the installation unit 81 of FIG. 6, the player is imaged within the reading range φ as shown in FIG.

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are installed at entrances and predetermined places in the store of the amusement store 1, and imaged units 39- (m + 1) to 39- (m + p + q).

  The entrance cameras 40-1 to 40-p, the in-store cameras 41-1 to 41-q, the human detection sensors 19-1 to 19-s, and the door lock sensors 18-1 to 18-t are illustrated in FIG. Set as shown. FIG. 8 shows entrance cameras 40-1 to 40-p and in-store cameras 41-1 to 41-q, person detection sensors 19-1 to 19-s, and door lock sensors 18-1 to 18-18 in the game store 1. An installation example of -t is shown.

  That is, in FIG. 8, entrances 112-1 to 112-3 for entering and leaving the game store 1 are provided, and the entrance cameras 40-1 to 40-6 are connected to the entrances 112. A player who enters the store (enters the store) and a player who exits the store (store exit) are imaged. Further, an employee entrance 113 used only by employees of the amusement store 1 is also provided separately from the entrance 112.

  More specifically, in the example of FIG. 8, the entrance cameras 40-1, 40-3, and 40-5 whose imaging direction is directed toward the outside of the store images the store entrant, and the imaging direction is the in-store direction. The entrance cameras 40-2, 40-4, and 40-6 that are pointed at take images of the store exits. That is, the entrance camera 40 is provided for each of the entrances and exits 112 in the direction of entering and exiting. When entering and exiting at any of the entrances and exits 112, The face image and the face image at the time of leaving the store are respectively captured.

  Further, the in-store cameras 41-1 to 41-10 are set at positions at which both surfaces of the island facilities 111-1 to 111-5 can be imaged in a row. The island facilities 111 are provided with game machines 36 on both sides, that is, so as to sandwich the island facilities 111 in the vertical direction in the figure. Since the camera 38, the entrance camera 40, and the in-store camera 41 all have a pan / tilt / zoom function, the in-store cameras 41-1 to 41-10 are arranged as shown in FIG. All players who play at 36 can take an image with any of the in-store cameras 41-1 to 41-10.

  Furthermore, the in-store camera 41-a is provided in front of the lending machine 34, the in-store camera 41-b is provided in front of the checkout machine 33, and the in-store camera 41-c is the counter of the counter 35. It is provided in front, and a player who uses the rental machine 34, the checkout machine 33, and the counter 35 can be imaged.

  That is, as shown in FIG. 8, in the game store 1, a player who visits the store, a player who plays on the game stand 36, and a player who uses the lending machine 34, the checkout machine 33, and the counter 35. The camera 38, the entrance camera 40, and the in-store camera 41 are installed so that almost all of the actions that the player is supposed to take in the gaming store 1 can be monitored.

  Further, door lock sensors 18-1 to 18-3 are provided at the respective entrances 112-1 to 112-3. The door lock sensors 18-1 to 18-3 are sensors linked to the locking facilities of the entrances 112-1 to 112-3. When the door lock sensors 18-1 to 18-3 enter the locked state, a signal indicating the locked state is recognized as biometric information. Supply to device 20. Further, in the store, there are provided human detection sensors 19-1 to 19-3 in order to detect the presence of a person, which cannot be imaged by the cameras 38, 40, 41, etc. In FIG. Is provided inside. When a human approaches, the human detection sensor 19 detects its presence and supplies a signal to that effect to the biological information recognition device 20.

  Next, a configuration example of the image processing unit 39 will be described with reference to FIG.

  The image acquisition unit 201 acquires an image captured by the camera 38 (or the entrance camera 40 or the in-store camera 41) and supplies it to the face image extraction unit 202. The face image extraction unit 202 extracts a rectangular image composed of a face image from the image supplied from the image acquisition unit 201 using a pattern such as the arrangement of the parts constituting the face, and supplies the rectangular image to the transmission unit 203. The transmission unit 203 transmits the face image to the biometric information recognition device 20.

  Next, a configuration example of the biological information recognition device 20 will be described with reference to FIG.

  The face image acquisition unit 211 acquires the face image supplied from the image processing unit 39 and supplies it to the collation unit 212. The collation unit 212 collates the face image acquired by the face image acquisition unit 211 with the face image of the remnant registered in the remnant DB 22, and if there is a face image that is a candidate with a high degree of similarity, The face image up to the candidate is displayed on the display unit 23 as a matching result.

  In addition, when there is no face image registered in the survivor DB 22 and a face image that is a candidate with a high degree of similarity, the collation unit 212 is registered in the supplied face image and the store entrance / exit information DB 21. The face image of the player registered as a store visitor is collated, and if there is a face image that is a candidate with a high degree of similarity, the face image up to the third candidate is displayed on the display unit 23 as a collation result. . If there is no candidate face image that has a high similarity to the face image registered in the store entrance / exit store information DB 21, the collation unit 212 supplies the supplied face image to the entrance / exit management unit 217. When a face image that is a candidate having a high similarity to the face image registered in the store entrance / exit store information DB 21 exists in addition to being registered in the store entrance / exit store information DB 21 as a store owner, the store enters a store with a high similarity. In association with the person's face image, it is registered in the store entrance / exit information DB 21 as a store exit.

  More specifically, the feature amount extraction unit 231 of the collation unit 212 extracts a feature amount for identifying a face image and supplies the feature amount together with the face image to the similarity calculation unit 232. The similarity calculation unit 232 extracts the feature amount of the registered player's face image registered in the store / buyer information DB 21 or the residence DB 22 and uses the feature amount supplied from the feature amount extraction unit 231. Using the facial images obtained from the facial image acquisition unit 211 and the facial images with the top three most similarities, the similarity between the facial images of all registered players registered in the remaining DB 22 is obtained. Is supplied to the similarity determination unit 233. More specifically, the remnant calculation unit 232a or the store vacancy calculation unit 232b of the similarity calculation unit 232 has, for example, the interval between eyes, the length from the chin to the forehead, and the length from the chin to the nose. Based on various facial feature quantities such as ratios, face images that have been supplied with their respective difference sums, average ratios, or ratio sums, and faces registered as shoppers in the store / buyer information DB 21 It is obtained as a similarity to an image or a face image registered in the remnant DB 22.

  The remnant determining unit 233a of the similarity determining unit 233 includes each of the face images having the top three similarities with the remnants registered in the remnant DB 22 supplied from the remnant calculating unit 232a of the similarity calculating unit 232. The similarity between the face image ranked first and the predetermined threshold value is compared, and the face image of the survivor ranked first is supplied from the face image acquisition unit 211 based on the comparison result. When the face image is similar (when the similarity is higher, the similarity is higher, when the similarity is higher than a predetermined threshold, or when the similarity is lower, the similarity is similar) If the similarity is lower than a predetermined threshold value), information on the top three face images and similarity is supplied to the display unit 23 and displayed to the communication unit 214. . Here, the survivor refers to a player who has been detected a predetermined number of times or more as a person who has not left the store after the closing time has passed in the past.

  The store exit determination unit 233b of the similarity determination unit 233 has the highest similarity degree with the store entrance in the store entrance / exit information DB 21 supplied from the store exit calculation unit 232b of the similarity calculation unit 232. The similarity between the face image that is the first and the predetermined threshold value is compared with the predetermined threshold value, and the registered face image that is the first is the face image acquisition unit based on the comparison result. When the face image supplied from 211 is not similar (in the case of similarity indicating that the similarity is higher when the similarity is higher, the similarity is lower when the similarity is lower than the predetermined threshold). If the similarity is higher than a predetermined threshold value), the face image is supplied to the entrance / exit management unit 217, and the entrance registration unit 217a enters the entrance / exit store information DB 21. To register as a person's face image. Furthermore, when it is similar to the supplied face image (in the case of similarity indicating that the similarity is higher as the similarity is higher, the similarity is higher when the similarity is lower than the predetermined threshold) If the similarity is lower than a predetermined threshold value), the store exit determining unit 233b supplies the face image to the store entrance / exit management unit 217 and the store exit registering unit 217b. The store exit information DB 21 is registered as a store exit face image in association with the store entrance face image.

  The residence DB management unit 219 compares the face image of the store visitor registered with the store entrance / exit information DB 21 by the search unit 218 at the timing after the closing time has elapsed, and enters the store. The person of the face image in which only the person's face image is registered is regarded as a person who has not left the store, and the face image in which only the person in the store is registered is controlled by the in-store registration unit 219a to be registered in the residence DB 22. Then, the center registration unit 219b is controlled to be registered in the unregistered survivor DB 251 of the security information management database 3.

  The operation unit 215 includes buttons, a mouse, a keyboard, and the like. The operation unit 215 is operated when any one of the face images displayed on the display unit 23 with the above-mentioned similarity ranked in the top three is selected. Is supplied to the communication unit 214. The communication unit 214 includes a modem or the like, and distributes the selected face image to the mobile terminal 17 based on an operation signal from the operation unit 215. In addition, when instructing the closing process, the operation unit 215 instructs to lock the entrance 112 (FIG. 8) and notifies the search unit 218 and the door lock sensor detection unit 220 to that effect. Based on this notification, the door lock sensor detection unit 220 supplies the detection result from each door lock sensor 18 to the search unit 218. The search unit 218 recognizes that the store is closed by recognizing that the door is locked based on the detection result from the door lock sensor detection unit 220. When the search unit 218 recognizes that the store is closed, the search unit 218 accesses the store / buyer information DB 21 to search for the store entrance face image and the store exit face image, and finds a face image in which only the store entrance face image is registered. Search as an unleavened person. When the search unit 218 searches for a person who has not left the store, the search unit 218 supplies the search result to the remaining DB management unit 219 and also to the communication unit 213.

  The communication unit 213 transmits the detection result from each human detection sensor 19 detected by the human detection sensor management unit 221 to the security company server 10 along with the presence of the unleashed store. In addition, when the communication unit 213 receives a notice of automatic closing processing permission from the security company server 10, the communication unit 213 supplies the automatic closing instruction unit 222 to the automatic store closing instruction unit 222, and prompts the game store management device 24 to perform automatic closing processing.

  Here, the similarity is, for example, indicated by a sum of ratios, and indicates a higher value as the face image registered as a resident or a shopkeeper is closer. An example will be described in which, when the value is higher than a predetermined threshold, it is determined that the image is a face image of a survivor or a store clerk corresponding to the similarity. However, for example, when the similarity is expressed as a difference sum in each feature amount between the captured face image and the registered survivor or shopkeeper's face image, the residue determination unit of the similarity determination unit 233 If the degree of similarity is smaller than the threshold value, 223a and the store exit determination unit 223b will regard the captured face image as a face image of a survivor or a store entrant, or in the case of an average ratio, etc. If the value is greater than or equal to a predetermined value in the range of 0 to 1 and close to 1, it can be regarded as the same person.

  When a new registered survivor database 252 (FIG. 11) is distributed from the security information management center 2, the database management unit 216 updates the survivor DB 22 based on the new registered survivor database 252.

  The automatic closing instruction unit 222 is in the case where there is no unleaved person or the case where there is a non-leaved person from the search unit 218, and then automatically from the security company server 10 via the communication unit 213. When the permission of the closing process is notified, an instruction is transmitted to the game shop management device 24 so as to execute the automatic closing process.

  Next, a configuration example of the security information management center 2 will be described with reference to FIG.

  The security information management center 2 includes a DB distribution unit 241, a DB update unit 242, and a DB update determination unit 243. The registered survivor DB 252 stored in the security information management DB 3 is changed to an unregistered survivor DB 251. Update based on. More specifically, the DB update determination unit 243 has a built-in RTC (Real Time Clock) 243a that generates time information. When a predetermined time elapses based on the built-in RTC 243a, the security information management DB3 is accessed and it is determined whether or not a new unregistered survivor is registered in the unregistered survivor DB 251.

  When a new unregistered survivor is registered in the unregistered survivor DB 251, the DB update determination unit 243 notifies the DB update unit 242 to that effect. The DB update unit 242 accesses the unregistered survivor DB 251, determines whether there are unregistered survivors who are registered a predetermined number of times or more among registered unregistered survivors, and the predetermined number of times or more. When there is an unregistered survivor registered as an unregistered survivor, the registered survivor DB 252 is read, and an unregistered survivor registered for a predetermined number of times or more is registered in the registered survivor DB 252 and updated. Furthermore, when the registered remnant DB 252 is updated, the DB update unit 242 notifies the DB distribution unit 241 that it has been updated.

  When notified by the DB update unit 242 that the registered survivor DB 252 has been updated, the DB distribution unit 241 accesses the security information management DB 3 and reads the registered survivor DB 252 to recognize the biometric information of each amusement store 1. Delivered to the device 20.

  Next, a configuration example of the mobile terminal 17 will be described with reference to FIG.

  The communication unit 271 is configured by a modem or the like, and exchanges data with the biometric information recognition apparatus 20 via a wireless communication network in the game store 1. In addition, the communication unit 271 acquires information indicating that a player with a facial image similar to the facial image supplied from the image processing unit 39, which is distributed from the biological information recognition apparatus 20, has visited the store. 272.

  The image processing unit 272 uses an LCD or the like on the basis of information indicating that a remnant or a visitor of a face image similar to the face image supplied from the image processing unit 39 supplied from the communication unit 271 has visited the store. In addition to generating an image to be displayed on the configured display unit 273, the image is displayed on the display unit 273.

  Next, a configuration example of the game shop management device 24 will be described with reference to FIG.

  The control unit 281 is configured by a so-called computer including a CPU, a ROM, and a RAM, and controls the entire operation of the game shop management device 24.

  The control unit 281 controls the communication unit 282 to control the gaming machine start / stop management unit 285 to stop the power supply of the gaming machine 36 when the biological information management device 20 instructs an automatic closing process. Further, when the closing process is instructed, the control unit 281 controls the medium lending instruction unit 283 to acquire the sales information of the day from the medium lending management device 27 and controls the balance calculation unit 281a to The balance calculation is executed and the balance result report is displayed on the display unit 25, and the medium lending instruction unit 283 is controlled to prohibit the gaming medium management device 27 from lending game media at the gaming machine peripheral terminal 37. Let Then, the control unit 281 finally controls the power supply control unit 284 to shut down the power supply of all devices related to the game including the game stand 36 in the game store 1.

  Next, the store visit monitoring process will be described with reference to the flowchart of FIG.

  In step S1, the entrance camera 40 determines whether or not the door of the entrance is opened based on the information of the image being captured or the signal from the door of the entrance and exit until the predetermined time elapses. Repeat the process.

  If it is determined in step S <b> 1 that the door is opened, in step S <b> 2, the entrance camera 40 captures an image of the installed range and supplies the captured image to the image processing unit 39. The image acquisition unit 201 of the image processing unit 39 acquires the supplied image and supplies it to the face image extraction unit 202.

  In step S <b> 3, the face image extraction unit 202 extracts a player's face image from the supplied image and supplies the extracted image to the transmission unit 203. More specifically, the face image extraction unit 202 extracts a face image from, for example, an arrangement of a characteristic part such as an eye or a nose, where the skin is exposed from the color of the captured image. To the transmission unit 203.

  In step S <b> 4, the transmission unit 203 transmits the face image supplied from the face image extraction unit 202 to the biological information recognition apparatus 20. At this time, the transmission unit 203 adds a camera ID for identifying each of the camera 38, the entrance camera 40, or the in-store camera 41, transmission time information, and the like to the face image and transmits them to the biological information recognition apparatus 20.

  In step S21, the face image acquisition unit 211 of the biological information recognition apparatus 20 acquires a face image. In step S <b> 22, the face image acquisition unit 211 extracts any unprocessed one of the supplied face images and supplies the extracted unprocessed one to the feature amount extraction unit 231.

  In step S <b> 23, the feature amount extraction unit 231 of the collation unit 212 extracts a feature amount from the supplied face image and supplies the feature amount together with the face image to the similarity calculation unit 232.

  In step S24, the survivor calculation unit 232a of the similarity calculation unit 232 determines the interval between eyes, the length from the chin to the forehead, and from the chin to the nose for the face image supplied from the feature amount extraction unit 231. Difference ratios and average ratios using various facial feature quantities such as length ratios and similar feature quantities in the registered survivor DB 252 registered in the remnant DB 22 Or the ratio sum or the like is calculated as the similarity, and the ranking of the similarity with the face image registered in the remaining DB 22 as the calculation result is obtained, and the top three of the face images registered in the remaining DB 22 are obtained. The information on the degree of similarity with the face image is supplied to the similarity degree determination unit 233 together with the face image supplied from the feature amount extraction unit 231.

  In step S25, the remnant determination unit 233a of the similarity determination unit 233 determines the highest rank based on the top three face images and similarity information supplied from the remnant calculation unit 232a of the similarity calculation unit 232. It is determined whether the similarity is greater than a predetermined threshold. In other words, the residue determination unit 233a of the similarity determination unit 233 is the most similar registered survivor (the face image registered in the residue DB 22 is most similar to the face image acquired by the face image acquisition unit 211. The registered player: Here, the similarity of the registered player having the highest similarity is compared with a predetermined threshold.

  Note that, as described above, the similarity between the face image of the registered player who is most similar to the captured face image is not necessarily the highest because of the definition of the similarity. And the threshold value may differ from those in this example.

  If it is determined in step S25 that the highest similarity is not greater than the predetermined threshold, that is, if it is determined that the face image of the player registered as a survivor is not present, the store is closed in step S30. Based on the camera ID attached to the supplied face image, the person determination unit 233b determines whether the supplied face image is a face image captured at the time of leaving the store. That is, as shown in FIG. 8, the entrance / exit 112 is provided with entrance cameras 40-1, 40-3, and 40-5 for imaging the store entrance, respectively, and entrance cameras 40-2 and 40-2 for capturing the store exit. 40-4 and 40-6 are provided. Therefore, in the case of FIG. 8, it is determined based on the camera ID whether or not the face image is attached with the camera ID indicating the entrance cameras 40-2, 40-4, and 40-6 that images the store clerk. The

  If it is determined in step S30 that the supplied face image is not the one at the time of store exit, the store exit determination unit 233b supplies the face image to the store entrance / exit management unit 217 in step S31. The entrance / exit management unit 217 controls the entrance registration unit 217a to register the face image information in the entrance / exit store information DB 21 as a store entrance person.

  On the other hand, when it is determined in step S30 that the store is closed, that is, in the case of FIG. 8, when it is determined that the face image is captured by the entrance cameras 40-2, 40-4, and 40-6. In step S32, the store exit determination unit 233b notifies the similarity calculation unit 232 that the image is a face image at the time of store exit. In response to this, the store exit calculation unit 232b determines the distance between the eyes, the distance from the chin to the forehead, and the length from the chin to the nose for the face image supplied from the feature amount extraction unit 231. Using various facial feature quantities such as ratios and facial image feature quantities registered only in the store entrance / existing person information DB 21, the difference sum, average ratio, or ratio sum is similar to each other. The degree of similarity with the face image registered in the entrance / exit store information DB 21 as the calculation result is obtained, and the face image registered only as the store entrance in the entrance / exit store information DB 21 is obtained. Information on the similarity between the top three face images and the face image supplied from the feature amount extraction unit 231 is supplied to the similarity determination unit 233.

  In step S33, the store exit determination unit 233b of the similarity determination unit 233 determines that the top third face image supplied from the store exit calculation unit 232b of the similarity calculation unit 232 is a candidate for the face image of the store visitor. The display screen is controlled by the display unit 23 to indicate that this is the case.

  In step S34, the entrance / exit management unit 217 determines whether any of the candidate face images has been selected by operating the operation unit 215. In step S34, for example, when any face image is selected, in step S35, the entrance / exit management unit 217 controls the store exit registration unit 217b to display the selected face image, for example, FIG. As shown in the above, it is registered as a store exit in the store entrance / exit store information DB 21.

  In FIG. 15, the face registration number (face registration number), the store visitor, and the store exit are registered from the left. Registration numbers 1 to 2986 are registered, and in each case, the face image of the shopkeeper is registered. On the other hand, with respect to the person leaving the store, the face registration number 2, 2985 has no registered face image of the person leaving the store, indicating that the player with the face registration number 2, 2985 exists in the store. Has been. The face image of the store visitor is registered by the process in step S31 described above.

  On the other hand, if none of the face images are selected in step S34, that is, if any face image cannot be recognized as the face image registered as the face image of the shopkeeper, the process proceeds to step S31. Proceed to That is, it is considered that the face image cannot be captured by the entrance camera 40 as a new store visitor, and the face image is registered as the store entrance in step S31.

  In step S36, the face image acquisition unit 211 determines whether or not all of the supplied face images have been processed. If there is an unprocessed face image, the process returns to step S22. That is, the processes in steps S22 to S36 are repeated until the process is performed on all face images. If it is determined that the process has been completed for all face images, the process returns to step S21.

  In step S25, the highest similarity is greater than a predetermined threshold based on the top three face images and similarity information supplied from the survivor calculation unit 232a of the similarity calculation unit 232. In step S26, the survivor determining unit 233a of the similarity determining unit 233 determines that the top three face images supplied from the survivor calculating unit 232a of the similarity calculating unit 232 are the face images of the survivors. The display unit 23 is controlled to display a notification screen indicating that it is a candidate.

  At this time, for example, a notification screen 301 as shown in FIG. 14 is displayed on the display unit 23.

  In the notification screen 301 of FIG. 16, a camera image display field 311 is provided in the middle left, and the face image supplied from the image processing unit 39 is displayed. Further, on the right side, face image display fields 312-1 to 312-3 of the top three survivors of similarities from the first candidate to the third candidate are provided in descending order of similarity. Furthermore, similarity level display columns 313-1 to 313-3 are provided below the face image display columns 312-1 to 312-2 of each survivor, and the level of similarity is displayed. In FIG. 16, the horizontal length of the area shown in black indicates the magnitude of similarity.

  Further, ID display fields 314-1 to 314-3 are provided at corresponding positions below the similarity level display fields 313-1 to 313-3, and the face images in the remaining DB 22 of each face image are displayed. IDs for identification are displayed. In FIG. 16, “00051”, “00018”, and “00022” are displayed from the left.

  Furthermore, below the ID display fields 314-1 to 314-3, confirmation buttons 318-1 to 318-3 that are operated by the operation unit 215 when each candidate is selected are provided at corresponding positions. It has been.

  A camera ID display field 315 for identifying the camera that captured the face image is provided under the camera image display field 311. In FIG. 16, the camera 38, the entrance camera 40, and the in-store camera 41 are displayed. “Camera 02” is displayed as a camera ID for identification. Furthermore, a time display field 316 is provided below the camera ID display field 315, and the time taken by the entrance camera 40 is displayed. In FIG. 16, “18:23:32” is displayed. It is shown that the face image in the camera image display field 311 is captured at 18:23:32.

  Furthermore, another person button 317 is provided below the time display field 316, and the face image display fields 312-1 to 312- of the registered player whose face images of the camera image are the first to third candidates. 3 is operated by the operation unit 215 when it is regarded as not similar to any of 3.

  In step S27, the communication unit 214 displays on the display unit 23 whether or not any of the candidate face images has been selected by operating the operation unit 215, that is, for example, the notification screen 301 shown in FIG. If it has been determined, it is determined whether any of the confirmation buttons 318-1 to 318-3 has been operated by the operation unit 215.

  In step S27, for example, when the confirm button 318-1 is operated, it is considered that the face image that is the first candidate of the survivor is selected, and in step S28, the communication unit 214 determines that the selected first candidate is selected. The face image and the camera image taken by the entrance camera 40 are transmitted to the mobile terminal 17 and the security company server 10 to notify that the corresponding survivor has visited the store.

  In step S51, the communication unit 271 of the mobile terminal 17 determines whether or not a visitor's visit has been notified, and repeats the processing until the notification is received. For example, in step S51, when a visitor's visit is notified by the process of step S28, in step S52, the communication unit 271 notifies the registered player's visit notification transmitted from the biometric information recognition device 20. In addition to receiving, the image processing unit 272 is supplied with the face image of the survivor and the camera image captured by the entrance camera 40 transmitted together with the notification. The image processing unit 272 processes the information of the selected face image and the camera image captured by the entrance camera 40 into information in a format that can be displayed on the display unit 273, and displays the information on the display unit 273 in step S53. .

  Further, in step S71, a communication unit (not shown) of the security company server 10 determines whether or not a visitor's visit has been notified, and repeats the process until the notification is received. For example, in step S71, when a visitor's visit is notified by the process of step S28, the security company server 10 controls the communication unit and is transmitted from the biological information recognition device 20 in step S72. In addition to receiving the notification of the visitor's visit, a display screen that displays information indicating that the survivor has visited the store is generated, and the display screen is displayed on the display unit 11 in step S73.

  In step S74, the security company server 10 causes the display unit 11 to display a screen for requesting the game store 1 where the survivor has visited to arrange security guards, and the process returns to step S71.

  Through the above processing, the staff in the game store 1 can recognize the visit of the resident if the portable terminal 17 is possessed. Furthermore, the security company server 10 can quickly recognize that a player registered in the residence DB 22 has visited the store, and can quickly arrange security guards.

  In step S29, the face image acquisition unit 211 determines whether or not all of the supplied face images have been processed. If there is an unprocessed face image, the process returns to step S22. That is, the processes in steps S22 to S29 are repeated until the process is performed on all face images. If it is determined that the process has been completed for all face images, the process returns to step S21.

  On the other hand, in step S27, no candidate face image is selected. For example, when the other person button 317 on the notification screen 301 in FIG. 16 is pressed, or in step S25, the similarity calculation unit 232 supplies the face image. Based on similarity information with the top three face images coming up, if the highest similarity is not greater than a predetermined threshold, that is, even the face image of the most similar survivor If the degree is less than the predetermined threshold, the process proceeds to step S30. In other words, it is considered that no survivor has been detected.

  In addition, if the face image supplied from the image processing unit 39 by the biometric information recognition apparatus 20 is registered in the remaining DB 22 by the above processing, the remaining person, that is, a predetermined number of times in the past, after the closing time. It is reported that a player who has been registered as a survivor who has been regarded as a non-leaving person who has existed in the game store 1 has visited the store. Further, if it is considered that the store is not registered in the residence DB 22, it is registered as a store visitor in the store / buyer information DB 21 if it is a store store, and is compared with the face image of the store store store if it is a store exit. Thus, it is registered as a store clerk in association with the face image of the matching store entrant.

  Next, the store closing support process will be described with reference to the flowchart of FIG.

  In step S91, the search unit 218 controls the door lock sensor detection unit 220 to detect whether all the door lock sensors 18 indicate the locked state, and all the door lock sensors 18 indicate the locked state. The process is repeated until it is determined that the

  If it is determined in step S91 that the store closing time has passed and a series of store closing operations have been performed by an attendant, all the keys of the entrance 112 have been locked, and all the door lock sensors 18 have recognized the locked state. In S92, the search unit 218 accesses the store / entrance store information DB 21 and reads out and refers to the store / store store information registered in the store / entrance store information DB 21.

  In step S93, based on the information read from the store entrance / exit store information DB 21, the search unit 218 determines whether or not there are store exits. More specifically, the search unit 218 stores the face image as the store entrant among the store entrant and store exit information read from the store entrance / exit store information DB 21, but the store clerk's face It is determined whether there is a face image for which no image is registered. In step S93, for example, in the case of the store entrance / exit information DB 21 of FIG. 15, the players of the face images with face registration numbers 2 and 2985 are extracted as non-existing stores, so there are no store exits. Then, the process proceeds to step S94.

  In step S94, the search unit 218 causes the display unit 23 to display the extracted face image of the person who has not left the store, and for example, a notification screen as shown in FIG. Is displayed. In FIG. 18, “Unleashed store display” is displayed at the top, and “Door lock detected, but there are unleaved stores” is displayed below, and further below that. The face image of the person who has not left the store is displayed, indicating that it is a display screen for the face image of the person who has not left the shop. Below that, “Registration in the Remaining DB and ** We will contact the security company” is displayed. Registration in the Remaining DB 22 and the security company server 10 which will be described later. It is suggested that notifications to be made.

  In step S <b> 95, the search unit 218 supplies information about the unleaved store to the remaining DB management unit 219. The remnant DB management unit 219 controls the in-store registration unit 219a to register the information of unsaved customers in the remnant DB 22 as remnants.

  In step S96, the residence DB management unit 219 controls the center registration unit 219b to register in the unregistered survivor DB 251 of the security information management DB 3 managed and operated by the security information management center 2.

  In step S <b> 97, the search unit 218 supplies the extracted information about the face image of the unstored person to the communication unit 213. The communication unit 213 controls the human detection sensor management unit 221 on the basis of the information on the store clerk and collects information on the presence / absence of human detection from the human detection sensor 19.

  In step S98, the communication unit 213 receives the detection result from the human detection sensor 19 supplied from the human detection sensor management unit 221 and the information of the face image detected as a non-stored person from the mobile terminal 17 and the security company. 10 to send.

  In step S <b> 111, the communication unit 271 of the mobile terminal 17 determines whether or not the occurrence of a person who has not left the store has been notified, and repeats the process until the notification is received. For example, in step S111, when the occurrence of a non-stored person has been notified by the process of step S98, the communication unit 271 sends the non-stored person's store that has been transmitted from the biometric information recognition device 20 in step S112. In addition to receiving the notification, the face image of the person who has not left the store and the camera image taken by the entrance camera 40 transmitted together with the notification are supplied to the image processing unit 272. The image processing unit 272 processes the information of the selected face image and the camera image captured by the entrance camera 40 into information in a format that can be displayed on the display unit 273. In step S113, the image processing unit 272 displays the information on the display unit 273, for example, The display screen is displayed as shown in FIGS.

  In the display screen of FIG. 19, “The person has been detected in the northwest toilet” is displayed at the top, and based on the detection information of the human detection sensor 19, there is a person who has not left the store. A screen showing the estimated position is displayed. In FIG. 19, the screen for displaying the position is generated according to the display of FIG. 8, and a person is detected by the human detection sensor 18-3 (FIG. 8). This indicates that the presence of is detected.

  Further, in step S131, a communication unit (not shown) of the security company server 10 determines whether or not the occurrence of a non-stored person has been notified, and repeats the process until notified. For example, in step S131, when a store visitor's visit is notified by the process of step S98, the security company server 10 controls the communication unit and transmits it from the biological information recognition device 20 in step S132. In addition to receiving the notification of the occurrence of the unleaved store, information indicating that the unopened store has occurred is displayed on the display unit 11 as shown in FIGS. 18 and 19, for example. .

  In step S133, the security company server 10 determines whether or not the automatic closing has been permitted by operating the operation unit 12, and the process is repeated until it is determined to be permitted. That is, as a result of the processing in step S132, for example, a security guard is dispatched to the corresponding game store 1 and predetermined processing is performed on a person who has not left the store, so that it is determined that there is no problem in closing the store. If it is clear that it is a false alarm or the like, an operation section 12 is operated by a security company staff member to permit automatic closing.

  In step S133, for example, when it is determined that the operation unit 12 has been operated so as to permit automatic closing, in step S134, the security company server 10 controls a communication unit (not shown) to permit automatic closing. It transmits to the biological information recognition device 20 of the corresponding game store 1.

  In step S99, the automatic closing instruction unit 222 controls the communication unit 213 to determine whether or not automatic closing permission is notified from the security company 10 and, for example, the automatic closing permission is instructed by the process of step S134. Then, the automatic closing instruction unit 222 instructs the amusement shop management device 24 to perform automatic closing processing, and displays, for example, a screen as shown in FIG.

  In FIG. 20, “Start of automatic closing process” is displayed at the top, indicating that the automatic closing process has been started. Below that, “All game doors have been locked. The store will close because there are no unleashed stores” is displayed. All doors of the entrance 112 are locked, It is shown that the automatic closing process is started because it does not exist. At the bottom, a completion status bar is shown, indicating the progress of the automatic closing process.

  In step S141, the control unit 281 controls the communication unit 282 to determine whether or not an instruction for automatic closing processing has been received, and the processing is repeated until it is determined that the instruction has been received. In step S141, for example, when the automatic closing process is instructed by the process in step S99, in step S142, the control unit 281 controls the gaming machine start / stop management unit 285 to stop the operation of the gaming machine 36. , Terminate the management.

  In step S143, the control unit 281 controls the medium lending instruction unit 283 to end the operation of the medium lending management device 27.

  In step S144, the control unit 281 controls the balance calculation unit 281a based on the balance information of the medium supplied from the medium lending management device 27 via the medium lending instruction unit 283, and calculates the balance result. It displays on the display part 25 as a balance result report.

  In step S145, the control unit 281 controls the power supply control unit 284 to shut down the power supply of the gaming equipment in the gaming store 1.

  If it is determined in step S93 that there is no unleashed store, the processes in steps S94 to S98 are skipped, and the process proceeds to step S99. Therefore, the processing of steps S111 to S113 and the processing of steps S131 to S134 are also skipped. In other words, if there is no person who has not left the store, the automatic closing process is immediately instructed.

  When the door of the entrance / exit 112 is locked by the above processing, the presence / absence of a non-leaving store is determined, and if there is a non-leaving store, the mobile terminal 17 and the security company server 10 are notified. Therefore, the clerk present in the amusement store 1 can grasp the location of the store as well as the presence of the store clerk, so that a situation in which an unauthorized act is performed by the store keeper is prevented. It becomes possible. In addition, since the clerk possessing the portable terminal 17 can grasp the position of the person who has not left the store, it is possible to predict or avoid an unexpected attack. Furthermore, since the presence of a person who has not left the store is quickly notified to the security company server 10, it is possible to increase the possibility of promptly securing the person who has not left the store.

  Furthermore, since it is possible for a non-stored person to be registered in the remnant DB 22 at the amusement store 1 regardless of whether it is intentional or not, it cannot be secured by security guards of the security company. Even if a situation occurs, if the customer visits the store in the future, the store visit can be recognized by the store visit monitoring process described above. Further, since the unstored person is also registered in the unregistered survivor DB 251 of the security information management DB 3 of the security information management center 2, the game shop 1-1 is executed by the process described later with reference to FIG. To 1-n, if a chain store or the like is registered in any of the game stores 1, it can be detected as a survivor in other game stores 1 as well. It is possible to suppress fraud due to the residence after the closing time in all the game stores.

  Next, the update process of the registered survivor DB 252 will be described with reference to the flowchart of FIG.

  In step S161, the DB update determination unit 243 of the security information management center 2 makes an inquiry to the RTC 243a to determine whether or not a predetermined time has elapsed, and repeats the process until the predetermined time has elapsed. For example, when it is determined in step S161 that the predetermined time has elapsed, in step S162, the DB update determination unit 243 accesses the unregistered survivor DB 251 of the security information management DB 3, and the unregistered survivor newly It is determined whether or not it is registered, and the processes of steps S161 and S162 are repeated until it is determined that a new unregistered survivor is registered.

  In step S162, for example, when a new unregistered survivor has been registered by the process of step S96, the DB update determination unit 243 determines that the unregistered game newly registered in the unregistered survivor DB 251 in step S163. It is determined whether or not one of the persons has been registered a predetermined number of times or more. If not, the process returns to step S161.

  On the other hand, in step S163, for example, when it is determined that there is an unregistered survivor registered in the unregistered survivor DB 251 a predetermined number of times, the DB update determination unit 243 determines that the DB update unit 242 The registered survivor DB 252 is notified that it should be updated. In response to this, the DB update unit 242 accesses the unregistered survivor DB 251 and reads out all the facial image information of unregistered survivors who have been registered more than a predetermined number of times, and accesses the registered survivor DB 252. Then, an ID for identifying the face image is attached to the information of the face image of the unregistered survivor who has been registered a predetermined number of times or more, and is additionally registered in the registered survivor DB 252 and updated. Furthermore, the DB update unit 242 notifies the DB distribution unit 241 that the registered survivor DB 252 has been updated. Note that, when the update of the registered survivor DB 252 is completed, unregistered survivors who have been registered a predetermined number of times or more are deleted from the unregistered survivor DB 251.

  In step S165, the DB distribution unit 241 accesses and reads the newly updated registered survivor DB 252 of the security information management DB 3, and reads the registered survivor DB 252 read to the database management unit 216 of the biological information recognition apparatus 20. To deliver.

  In step S181, the database management unit 216 determines whether or not a new registered survivor DB 252 updated from the security information management center 2 has been distributed, and repeats the processing until it is distributed.

  In step S181, for example, when the newly updated registered survivor DB 252 is distributed from the DB distribution unit 241 of the security information management center 2 by the process in step S165, the database management unit 216 distributes in step S182. In addition to acquiring the registered survivor DB 252, the survivor DB 22 is updated based on the information of the registered survivor DB 252. More specifically, the database management unit 216 copies and overwrites the newly distributed registered survivor DB 252 information in the survivor DB 22.

  As a result of the above processing, if one of the gaming stores 1-1 to 1-n is registered in the unregistered survivor DB 251 as an unregistered survivor for a predetermined number of times, it is additionally registered in the registered survivor DB 252. Since a database is registered in the remaining DB 22 of any of the biological information recognition devices 20 of the game stores 1-1 to 1-n, if a plurality of game stores 1 are captured by the entrance camera 40, they remain. The store visit will be notified as a person.

  In the above description, as shown in the process of step S1 in the flowchart of FIG. 13, the example in which the face image is extracted at the timing when the door is opened has been described. If a face image is extracted while continuing, it may be collated.

  According to the above, it is possible to realize not only customer visit information at each store but also collection of customer visit records at a plurality of stores and integrated management.

  Incidentally, the series of monitoring processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  FIG. 22 shows a configuration example of a general-purpose personal computer. This personal computer incorporates a CPU (Central Processing Unit) 1001. An input / output interface 1005 is connected to the CPU 1001 via the bus 1004. A ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 are connected to the bus 1004.

  The input / output interface 1005 includes an input unit 1006 including an input device such as a keyboard and a mouse for a user to input an operation command, an output unit 1007 for outputting a processing operation screen and an image of a processing result to a display device, a program and various data. A storage unit 1008 including a hard disk drive for storing data, a LAN (Local Area Network) adapter, and the like, and a communication unit 1009 for performing communication processing via a network represented by the Internet are connected. Also, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc)), a magneto-optical disk (including an MD (Mini Disc)), or a semiconductor A drive 1010 for reading / writing data from / to a removable medium 1011 such as a memory is connected.

  The CPU 1001 is read from a program stored in the ROM 1002 or a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, installed in the storage unit 1008, and loaded from the storage unit 1008 to the RAM 1003. Various processes are executed according to the program. The RAM 1003 also appropriately stores data necessary for the CPU 1001 to execute various processes.

  In this specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series in the order described, but of course, it is not necessarily performed in time series. Or the process performed separately is included.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structure of one Embodiment of the monitoring system to which this invention is applied. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the entrance camera and shop camera of FIG. It is a figure explaining the structural example of the image processing unit of FIG. It is a figure explaining the structural example of the biometric information recognition apparatus of FIG. It is a figure explaining the structural example of the security information management center and security information management DB of FIG. It is a figure explaining the structural example of the portable terminal of FIG. It is a figure explaining the structural example of the game machine management apparatus of FIG. It is a flowchart explaining a store visit monitoring process. It is a figure explaining the structural example of entrance / exit store management DB. It is a figure explaining the example of a display of an alerting | reporting image. It is a flowchart explaining a closing support process. It is a figure explaining the example of a display of a notification image. It is a figure explaining the example of a display of an alerting | reporting image. It is a figure explaining the example of a display of an alerting | reporting image. It is a flowchart explaining a registration player DB update process. And FIG. 11 is a diagram illustrating a configuration example of a personal computer.

Explanation of symbols

1, 1-1 to 1-n amusement store 2 security information management center 3 security information management database 4 third party amusement store management center 5 third party amusement store management database 6 biological information management bus 7 third party amusement store management bus 8, 9 Public communication network 21 Biometric information recognition device 22 Biometric information database 24 Game store management device 26 Game table management database 27 Medium lending management device 29 Medium lending management database 30 Amusement store management information bus 31 Biometric information bus 33 Settling machine 34 Lending machine 35 Counter 36,36-1 thru 36-m Game stand 37,37-1 thru 37-m Game stand peripheral terminal 38,38-1 thru 38-m Camera 39,39-1 thru 39- (m + p + q) Image processing unit 40, 40-1 to 40-p Entrance camera 41, 41-1 to 41-q In-store camera

Claims (6)

Store store means for storing the store's face image;
Collating means for calculating and collating the similarity between the face image of the store clerk and the face image of the store entrant accumulated in the store accumulating means;
A similarity determination unit that determines whether the face image of the store clerk is the face image of the store clerk by comparing the similarity that is the collation result of the collation unit with a predetermined threshold;
When the similarity determination means determines that the store exit is the store visitor, registration for registering the store exit in association with the face image of the store visitor stored in the store entrance storage means Means,
A non-leaving store notification means for notifying a face image in which only the face image of a store clerk is stored in the storage means as a non-leaving store at a time when closing is instructed. An imaging means for capturing an image;
A face image extracting means for extracting a face image of the store clerk or the store clerk from an image captured by the image capturing means;
A feature amount extracting means for extracting a feature amount from the face image of the store clerk,
The store visitor storage means stores the store visitor's face image extracted by the face image extraction means,
The collation means calculates a similarity by using a feature amount between the face image of the store clerk extracted by the face image extraction means and the face image of the store keeper accumulated in the store visitor accumulation means. The monitoring device according to claim 1, wherein the face image of the store clerk and the face image of the store entrant accumulated in the store entrant accumulation unit are collated. The monitoring apparatus according to claim 1, further comprising a survivor accumulating unit that accumulates a face image of the store clerk determined as the unleaved person as a face image of the survivor. The collation means further calculates and compares the similarity between the face image of the shopkeeper and the face image of the remnant stored in the remnant accumulation means,
The similarity determination unit further determines whether the face image of the store clerk is a face image of a survivor by comparing the similarity that is the collation result of the collation unit with a predetermined threshold value,
The monitoring apparatus according to claim 3, further comprising a resident entry notification unit that notifies that the resident is a resident if the resident is determined to be the resident. Store store step for storing store face images,
A collation step for calculating and collating the similarity between the face image of the store clerk and the face image of the store entrant accumulated in the store accumulating means;
A similarity determination step of determining whether or not the face image of the store clerk is the face image of the store clerk by comparing the similarity that is the result of the collation in the process of the collation step with a predetermined threshold; ,
When it is determined by the similarity determination step that the store clerk is the store entrant, the store clerk is associated with the store visitor's face image accumulated by the store entrant accumulation step. A registration step to register
A non-stored person notification step of notifying a face image in which only the face image of the store clerk is stored in the storage means as a non-stored person at the time when closing is instructed. Store store step for storing store face images,
A collation step for calculating and collating the similarity between the face image of the store clerk and the face image of the store entrant accumulated in the store accumulating means;
A similarity determination step of determining whether or not the face image of the store clerk is the face image of the store clerk by comparing the similarity that is the result of the collation in the process of the collation step with a predetermined threshold; ,
When it is determined by the similarity determination step that the store clerk is the store entrant, the store clerk is associated with the store visitor's face image accumulated by the store entrant accumulation step. A registration step to register
A program for causing a computer to execute a process including a non-leaving store notification step of notifying a face image in which only the face image of a store clerk is stored in the storage means as a non-leaving store at a time when closing is instructed. .

Images