JP2019009529A - Face authentication apparatus, person tracking system, person tracking method, and person tracking program - Google Patents

Abstract

To provide a face authentication apparatus, a person tracking system, a person tracking method, and a person tracking program capable of tracking and monitoring a person other than a person registered in advance.SOLUTION: A face authentication apparatus 21 includes a person information management unit 7 for storing a list of face images of people and an image analysis unit 8 that outputs an identifier of a detected face image when the face image included in the list has been detected from the received image information, and outputs an identifier of an added face image while adding a face image of a person who satisfies a predetermined criterion to the list when the person who satisfies the predetermined criteria, which is not included in the list has been detected.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a face authentication device, a person tracking system, a person tracking method, and a person tracking program, and more particularly to a device for tracking a person using face authentication, a person tracking system, a person tracking method, and a person tracking program. .

  Patent Document 1 discloses a tracking device that predicts the location of a wanted criminal. This device extracts “time, position, probability” of a wanted crime from an image taken by a security camera, and calculates a possible escape area for the wanted crime based on the data.

  Patent Document 2 discloses a monitoring device that monitors a monitoring area using a monitoring robot. This apparatus extracts a specific person from an image of a camera installed in a monitoring area, selects a priority monitoring point from the position information of the camera, and transmits patrol request information to the monitoring robot.

JP 2014-215747 A JP 2012-079950 A1

  The apparatus disclosed in Patent Literature 1 extracts a wanted crime registered in advance from a camera image and tracks the wanted crime. The apparatus disclosed in Patent Document 2 extracts a specific person registered in advance from a camera image and monitors the specific person.

  Neither device is subject to tracking or monitoring except for pre-registered persons. However, there are cases where it is desired to track or monitor a person who is not registered in advance. For example, there is a case where it is desired to track or monitor a person who performs suspicious behavior at a store or an airport. None of the devices disclosed in the above documents can satisfy such a requirement.

  It is an object of the present invention to provide a face authentication device, a person tracking system, a person tracking method, and a person tracking program that can satisfy the above requirements.

According to one embodiment of the present invention, a face authentication apparatus detects a face information included in a list from person information management means for storing a list of face images of a person and received image information. 2) outputting an identifier of a face image, and 2) adding the face image of the person satisfying the predetermined criterion to the list and adding the face image when the person who satisfies the predetermined criterion but is not included in the list is detected. The person tracking method according to an embodiment of the present invention includes: 1) an image analysis unit that outputs an identifier; and 1) detecting the face image included in a list of face images of a person from the received image information. Outputting an identifier of a face image, and 2) adding the face image of the person satisfying the predetermined criterion to the list when the person who does not belong to the list but satisfies the predetermined criterion is detected. The identifier of the added face image is output.

  The person tracking program according to the embodiment of the present invention outputs an identifier of the detected face image when the face image included in the list of stored face images of the person is detected from the received image information. 2) When the person who does not belong to the list but satisfies the predetermined criterion is detected, the face image of the person satisfying the predetermined criterion is added to the list and the identifier of the added face image is output. Let the computer run.

  The person tracking system according to the present invention can make a person other than a person registered in advance a target for tracking and monitoring.

FIG. 1 is a configuration diagram of a person tracking system 30 according to the first embodiment. FIG. 2 is a configuration diagram of the computer device 60. FIG. 3 is an operation flowchart of the face authentication device 21. FIG. 4 is an operation flowchart of the analyzer 22. FIG. 5 is a configuration diagram of the face authentication apparatus 21 according to the second embodiment.

<First embodiment>
<Overview>
The person tracking system 30 detects a specific person such as a wanted criminal from the photographed image information obtained from the monitoring cameras 20 arranged in various places, and predicts and displays actions after the detection time point. Police agencies, etc. secure and protect the specific person with reference to the information.

<Configuration>
FIG. 1 is a configuration diagram of a person tracking system 30 according to the present embodiment. The person tracking system 30 includes a monitoring camera 20, a face authentication device 21, and an analysis device 22. The face authentication device 21 is connected to the monitoring camera 20 and the analysis device 22. The analysis device 22 is connected to the external police organization server device 14, the external big data server device 15, and the external terminal device 16.

  The monitoring camera 20 is installed in a commercial facility, a public facility, a shopping street, or the like, and shoots a nearby moving image or still image (hereinafter collectively referred to as an image) and transmits it to the face authentication device 21. The face authentication device 21 stores a list of face photos of a specific person such as a wanted criminal, and when a face photo of the specific person is detected from an image acquired by the monitoring camera 20, the face photo information is sent to a predetermined terminal device. A warning notification including “” is reported, or analysis is requested to the analysis device 22. Further, when the face authentication device 21 detects a suspicious person who is not registered in the face photograph list of the specific person from the image obtained from the monitoring camera 20, the face authentication apparatus 21 uses the face photograph of the suspicious person as the face of the specific person. Register to the photo list.

  The analysis device 22 predicts a place where the specific person is likely to appear next based on the place, time, and other information on which the specific person appears, reports it to a predetermined terminal device, and is located near the predicted place. The imaging cooperation request of the specific person is transmitted to the external terminal device 16 that is currently on. The external terminal device 16 is a portable terminal device possessed by persons involved in investigation.

  Further, the face authentication device 21 or the analysis device 22 acquires information useful for the above detection and prediction from the external police organization server device 14 and the external big data server device 15.

<Monitoring camera 20>
The monitoring camera 20 includes a video photographing unit 1, a position / time information holding unit 2, a photographing data recording unit 3, and a data transmission unit 4. The video imaging unit 1 always captures an image in the field of view of the installed camera lens. The position / time information holding unit 2 records the position where the monitoring camera 20 is installed and the time at which the image was taken. The shooting data recording unit 3 stores video data obtained by combining the image shot by the video shooting unit 1 and the position / time information obtained by the position / time information holding unit 2. The data transmission unit 4 transmits information of the photographing data recording unit 3 to the face authentication device 21.

  <Face Authentication Device 21> The face authentication device 21 includes a data reception unit, for example, a data reception unit 5, a photographing data recording unit, for example, a photographing data recording unit 6, a personal information management unit, for example, a personal information management unit 7, an image analysis unit, For example, an image analysis unit 8 and data transmission means, for example, a data transmission unit 9 are provided.

  The data receiving unit 5 receives the video data sent from the monitoring camera 20 and stores it in the photographing data recording unit 6. The data receiver 5 can also receive the image, position, and time information transmitted from the external terminal device 16. The external terminal device 16 transmits an image of a person in response to the above-described photographing cooperation request.

  The person information management unit 7 holds information as exemplified below.

1) List of face images of a specific person This is a list of face pictures of a specific person such as a wanted crime, a missing person or a cunning elderly person owned by a specific institution such as the police.

2) Criminal psychology / behavior information This is behavior pattern information that is easily seen by criminals. These pieces of information are information possessed by a police specialized institution and are obtained from, for example, the external police institution server device 14.

3) Specific person action information This is information such as the features (gender, age, appearance, etc.) of each person in the face image list, past crime information of the specific person, history of past locations / times, features, etc. including.

4) Facility / Map information This includes map information and detailed information on buildings and facilities corresponding to the map.

5) General Person Behavior Information This is information on behavior trends of an unspecified number of general persons, and is obtained from the external big data server device 15, for example. When a specific person is discovered, the behavior prediction unit 13 of the analysis device 22 is compared with information on a general person having a similar behavior tendency, for example, in comparison with the discovered time / position (facility) / feature. The behavior of a specific person after being discovered is predicted.

6) Traffic information This is information on traffic jams at a certain point in time, routes such as walking, cars, trains, and travel times.

7) Location of the external terminal device 16 This is the current or previous location information transmitted by the external terminal device 16, which is a pre-registered portable terminal device, and is updated periodically or at a predetermined opportunity. Yes.

  The person information management unit 7 of the face authentication device 21 and the person information management unit 12 of the analysis device 22 store the same information. This is because the data entities of the person information management unit 7 and the person information management unit 12 are stored on a disk device accessible by both the face authentication device 21 and the analysis device 22, and both devices respectively store the person information management unit 7 and the person information. This is realized by converting the access path into the actual data when the management unit 12 is accessed. Alternatively, both the face authentication device 21 and the analysis device 22 may have a data synchronization function such as transmitting update information generated in the own device to the partner device.

  When the image analysis unit 8 analyzes the image and detects a face image included in the list of face images of the specific person stored in the person information management unit 7 from the image information received from the monitoring camera 20, a warning notification (Including identification information of the face image) is output. When the image analysis unit 8 detects from the image information a person that is not included in the list but satisfies the predetermined criterion, the image analysis unit 8 adds the face image of the person that satisfies the predetermined criterion to the list of face images of the specific person, and outputs a warning notification. . Here, the predetermined standard is a standard for determining a sign of causing a crime from the characteristics of a person, and a specific example will be described later.

  The data transmission unit 9 transmits necessary information to the analysis device 22.

  The analysis device 22 includes system monitoring means such as a system monitoring unit 10, data receiving means such as a data receiving unit 11, person information managing means such as a person information managing unit 12, and behavior predicting means such as a behavior predicting unit 13. .

  The system monitoring unit 10 monitors cooperation between devices (the monitoring camera 20, the face authentication device 21, and the analysis device 22) that construct the person tracking system 30.

  The data receiving unit 11 receives specific person information transmitted from the face authentication device 21. Further, the data receiving unit 11 receives data transmitted by the external police organization server device 14, the external big data server device 15, and the external terminal device 16 and stores the data in the person information management unit 12.

  The person information management unit 12 stores the same information as the person information management unit 7 of the face authentication device 21 as described above. This is realized when the face authentication device 21 and the analysis device 22 access the same data on the shared disk device, or both devices implement the synchronization function of the person information management unit 12 and the person information management unit 7.

  The behavior prediction unit 13 predicts a place to be visited after the discovery from the past position / time / feature information of the specific person notified from the face authentication device 21 and an example of behavior of the general person, building / position information, and the like, and the prediction result Is displayed on a map or the like. The behavior prediction unit 13 also notifies the imaging request to the external terminal device 16 carried by the investigator or the user near the predicted location when displaying the prediction result. The investigator or user who has received the notification of the shooting request takes a still image or a moving image of a specific person, and then uploads the shooting data to a designated destination to cooperate with the search.

  The external police organization server device 14 is a server device of a police organization that holds information (age, face, features, etc.) that is limited to the public, such as personal information of a specific person. The external police organization server device 14 further holds criminal psychology data and the like possessed by a police organization.

  The external big data server device 15 is a server device that holds a large amount of generally available information such as buildings, traffic, and general public behavior.

  The external terminal device 16 is a portable terminal device, such as a smartphone, possessed by registered people or investigators. The external terminal device 16 has a shooting function, a shooting time notification function, a position notification function, and a function of connecting to a network.

  Here, the data reception unit 5, the image analysis unit 8, and the data transmission unit 9 of the face authentication device 21 are configured by a logic circuit, or a dedicated processor and firmware. The photographing data recording unit 6 and the person information management unit 7 are configured by a storage device such as an HDD (Hard Disk Drive) or an SDD (Solid State Drive).

  The data receiving means, photographing data recording means, person information management means, image analysis means, and data transmission means of the face authentication device 21 may have other configurations.

  Further, the face authentication device 21 may be configured by a computer device 60. FIG. 2 is a configuration diagram of the computer device 60. The computer device 60 includes a processor 61, a main storage unit 63, and an external storage device 62 that are connected to each other via a bus 64. The processor 61 reads and writes data from and to the main storage unit 63 and the external storage device 62 via the bus 64.

  Further, the processor 61 executes a program 65 stored in the main storage unit 63. Note that the program 65 is initially stored in the external storage device 62, and the processor 61 may load the main storage unit 63 from the external storage device 62 when the computer device 60 is initially set.

  Here, the main storage unit 63 is a semiconductor memory device. The external storage device 62 is a storage device such as an HDD or an SDD.

  The processor 61 of the face authentication device 21 functions as the data reception unit 5, the image analysis unit 8, and the data transmission unit 9 by executing the program 65. In other words, the processor 61 executes the process performed by the data reception unit 5, the image analysis unit 8, and the data transmission unit 9 by executing the program 65.

  The external storage device 62 may be used as the photographing data recording unit 6 and the person information management unit 7.

  The system monitoring unit 10, the data receiving unit 11, and the behavior predicting unit 13 of the analysis device 22 are configured by a logic circuit or a dedicated processor and firmware. The person information management unit 12 is configured by a storage device such as an HDD or an SDD.

  The system monitoring unit, the data receiving unit, the person information management unit, and the behavior prediction unit of the analysis device 22 may have other configurations.

  The analysis device 22 may be configured by a computer device 60. In this case, the processor 61 of the analysis device 22 functions as the system monitoring unit 10, the data receiving unit 11, and the behavior prediction unit 13 by executing the program 65. That is, the processor 61 executes the process performed by the system monitoring unit 10, the data receiving unit 11, and the behavior predicting unit 13 by executing the program 65. The external storage device 62 may be used as the person information management unit 12.

<Operation>
FIG. 3 is an operation flowchart of the face authentication device 21.

  First, the data receiving unit 5 of the face authentication device 21 inputs the image information, the shooting time, and the position information of the taken monitoring camera 20 from the monitoring camera 20 and stores them in the shooting data recording unit 6.

  The image analysis unit 8 extracts a face image from the image information stored in the photographing data recording unit 6 and sequentially compares it with the face image in the face image list of the specific person registered in the person information management unit 7. Go (S1).

  When any face image in the face image list of the specific person matches the face image extracted from the image information (Yes in S2), the image analysis unit 8 causes the face image in the face image list of the matched specific person. The shooting time of the image information and the position information of the taken surveillance camera 20 are registered (S3). The registration destination is specific person action information stored in the person information management unit 7. Here, the time and position at which the person is specified are accumulated in time series. Here, “matching” two face images means that it is possible to determine that they are the same person.

  Thereafter, the image analysis unit 8 outputs a warning notification including the identifier of the face image in the face image list of the specific person (S4), and ends the process. The warning notification is output to a predetermined terminal device such as the police headquarters and the analysis device 22.

  If any face image in the face image list of the specific person does not match the face image extracted from the image information (No in S2), the image analysis unit 8 determines the person from the image information stored in the shooting data recording unit 6. An image is extracted, and it is determined whether or not a predetermined criterion is satisfied (S5). If the person image of any person extracted from the image information satisfies a predetermined criterion (Yes in S6), the image analysis unit 8 adds the face image of the person to the face image list of the specific person (S7). ), S3 and S4 are performed, and the process is terminated. If any person image extracted from the image information does not satisfy the predetermined standard (No in S6), the image analysis unit 8 ends the process.

  Here, the process of S5 will be described in detail.

  First, the image analysis unit 8 extracts criminal psychology / behavior information from the person information management unit 7. The criminal psychology / behavior information describes various behavior patterns that serve as clues for identifying criminals in correspondence with crime categories. For example, when the crime category is shoplifting, the following behavior pattern is described.

Pattern a) A person is in the vicinity of a predesignated product even after a predetermined time has elapsed within a predetermined time zone.
Here, the predetermined time zone is a time zone in which crime is likely to occur statistically, for example, a midnight time zone. The predesignated product is a product that is statistically prone to shoplifting. For example, the external police organization server device 14 calculates the information from the crime record data and transmits the information to the face authentication device 21 as a part of the action pattern.

Pattern b) The frequency of the person turning his / her face in a direction other than the product while in the vicinity of the product is higher than a predetermined value. This indicates that there is a high possibility that the store clerk is confirmed, for example.
Pattern c) A person has a possessed item whose opening is a predetermined size or larger, such as a bag or bag, with the opening being open. This indicates that the possibility of carrying away is high.

  Next, the image analysis unit 8 determines whether or not the person image extracted from the image information satisfies the above behavior patterns. When the sum of the suspicion evaluation values determined according to the action pattern satisfied by the person image extracted from the image information exceeds a predetermined threshold, the image analysis unit 8 It is determined that

  The procedure for determining the suspicion evaluation value according to the behavior pattern is given from the external police institution server device 14 along with the behavior pattern. The evaluation value of suspicion may be a fixed value or may be determined depending on the parameter value in the behavior pattern. For example, in the case of the above-mentioned pattern a, the evaluation value of suspicion is determined depending on the type of product. In the case of the pattern b, the evaluation value of the suspicion is determined depending on the frequency with which the person turns the face in a direction other than the product.

  When the crime category is a stalker, the following behavior pattern is described. In this case, as in the case of shoplifting, the image analysis unit 8 also determines that the sum of the suspicion evaluation values determined according to the action pattern satisfied by the person image extracted from the image information exceeds a predetermined threshold value. If it is, the person is determined to satisfy the above-mentioned predetermined standard.

  Pattern x) The moving direction / moving speed of the person is changed to a predetermined frequency or higher. That is, the frequency of direction change or pause in the movement of the person is equal to or greater than a predetermined threshold. This is a feature that occurs because a person hides behind a victim and follows. The evaluation value of the suspicion of this pattern is determined depending on the frequency.

  Pattern y) The ratio of the person's face covered is equal to or greater than a predetermined threshold. That is, it is a pattern in which the face is covered with a mask or a hat at a predetermined rate or more. This is a feature that arises from hiding features behind victims. The evaluation value of the suspicion of this pattern is determined depending on the coverage ratio.

  FIG. 4 is an operation flowchart of the analyzer 22.

  The analysis device 22 is activated when the data receiving unit 11 receives a warning notification from the face authentication device 21 (S11). After that, the behavior prediction unit 13 is based on the position and time stored in the person information management unit 12 in association with the face image of the identifier notified and included in the warning notification. Is predicted (S12).

  The process of S12 will be described in detail.

  First, the behavior predicting unit 13 takes out the latest shooting position and shooting time associated with the face image of the notified identifier, and from the difference between the shooting time and the current time (that is, the elapsed time), walking, bicycle, or Calculate the distance that can be moved by car. Then, the behavior prediction unit 13 predicts a facility that satisfies a predetermined condition as a position where a person in the face image appears within the distance from the latest photographing position. The behavior prediction unit 13 may output a plurality of prediction results.

  Here, when the information on the means of transportation used by the person of the face image in the past crime exists in the specific person behavior information stored in the person information management unit 12, the behavior prediction unit 13 walks from the information. The travel distance A is calculated by selecting either a bicycle or a car. In addition, the behavior prediction unit 13 determines the facility conditions from past crime information of the person in the face image. If the person has executed shoplifting at a convenience store in the past, a store that is a convenience store and satisfies the condition of being away from the main street is set as the prediction result. The behavior prediction unit 13 acquires the facility condition from the facility / map information stored in the person information management unit 12.

  The behavior prediction unit 13 is within a distance up to a predetermined multiple of the movement distance A described above when there is a place that has appeared many times in the past in the specific person behavior information stored in the person information management unit 12. Such a facility may be output as a prediction result.

  Further, the behavior prediction unit 13 may predict where the person at the latest shooting position is after the elapsed time that is the difference between the shooting time and the current time based on general statistical information. In this case, the behavior prediction unit 13 acquires the statistical information from, for example, general human behavior information stored in the person information management unit 12.

  After predicting the position where the person of the face image appears (S12), the behavior prediction unit 13 notifies the terminal device registered in advance (S13). The terminal device registered in advance is, for example, a terminal device installed at the police headquarters.

  Next, the behavior prediction unit 13 transmits a shooting request with the face image of the notified identifier attached to the external terminal device 16 existing in the vicinity of the predicted position (S14), and ends the process. At this time, the behavior prediction unit 13 specifies the external terminal device 16 existing in the vicinity of the predicted position from the position information of the external terminal device 16 stored in the person information management unit 12.

  When the owner of the external terminal device 16 receives a shooting request, the owner searches for a person in the face image attached to the shooting request, and if it finds such a person, takes a picture and sends the image information to the face authentication device 21. To do. In this case, the data receiving unit 5 of the face authentication device 21 receives the image information and executes the process of the flowchart of FIG.

<Effect>
<First effect>
The person tracking system 30 according to the present embodiment can target a person other than a registered person as a tracking target. The reason is that if the image analysis unit 8 of the face authentication device 21 detects a suspicious person who does not belong to the list of face images of a specific person such as a wanted criminal but satisfies a predetermined standard, the face image of the person is identified. It is because it adds to the list of face images. Thereafter, the person tracking system 30 continuously tracks the person added to the list of face images of the specific person.

<Second effect>
The person tracking system 30 according to the present embodiment facilitates discovery of a person to be tracked. The reason is that the behavior prediction unit 13 of the analysis device 22 predicts the behavior of the person to be tracked and reports the position where the person is likely to appear.

<Third effect>
The person tracking system 30 according to the present embodiment improves the accuracy of specifying the location of the person to be tracked. This is because the behavior prediction unit 13 of the analysis device 22 transmits a photographing request to the external terminal device 16 near the position where the person is likely to appear. Furthermore, the face authentication device 21 determines from the image information transmitted by the external terminal device 16 whether the photographed person is registered in the list of face images of the specific person.

<Modification>
The person tracking system 30 may not include the analysis device 22. When the person tracking system 30 does not include the analysis device 22, the face authentication device 21 sends a warning notification to a predetermined terminal device such as the police headquarters in S4 of FIG. Output only.

<Second Embodiment>
FIG. 5 is a configuration diagram of the face authentication apparatus 21 according to the second embodiment.

  The face authentication device 21 includes person information management means 17 and image analysis means 18.

  The person information management means 17 stores a list of person face images. The image analysis means 18 outputs 1) an identifier of the detected face image when detecting a face image included in the list from the received image information, and 2) predetermined when detecting a person not included in the list but satisfying a predetermined criterion. A face image of a person meeting the criteria is added to the list and an identifier of the added face image is output.

  Here, the person information management unit 17 is, for example, the person information management unit 7, and the image analysis unit 18 is the image analysis unit 8. The person information management means 17 and the image analysis means 18 may have other configurations that perform equivalent functions. The other constituent means in the face authentication device 21 and the other constituent means in the analysis device 22 are the same.

  The face authentication device 21 according to the present embodiment can target a person other than a person registered in advance as a tracking target. The reason is that if the image analysis unit 8 detects a suspicious person who does not include the specific person's face image such as a wanted criminal but satisfies a predetermined criterion, the person's face image is selected as the list of the specific person's face images. It is because it adds to. Thereafter, the face authentication device 21 continuously tracks the person added to the list of face images of the specific person.

  The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Image | video imaging | photography part 2 Position / time information holding part 3 Shooting data recording part 4 Data transmission part 5 Data receiving part 6 Shooting data recording part 7 Person information management part 8 Image analysis part 9 Data transmission part 10 System monitoring part 11 Data receiving part DESCRIPTION OF SYMBOLS 12 Person information management part 13 Action prediction part 14 External police organization server apparatus 15 External big data server apparatus 16 External terminal apparatus 17 Person information management means 18 Image analysis means 20 Surveillance camera 21 Face authentication apparatus 22 Analysis apparatus 30 Person tracking system 60 Computer Device 61 Processor 62 External storage device 63 Main storage unit 64 Bus 65 Program

Claims (10)

Personal information management means for storing a list of human face images;
From the received image information, 1) When the face image included in the list is detected, an identifier of the detected face image is output. 2) When the person not included in the list but satisfying a predetermined criterion is detected, the predetermined image is output. And a face analyzing apparatus that adds the face image of the person satisfying a criterion to the list and outputs an identifier of the added face image.   The image analysis means determines whether or not the person detected from the image information satisfies the predetermined criterion. A) Whether or not the person is in the vicinity of a predesignated product even after a predetermined time has elapsed within a predetermined time zone. Or b) comparing the threshold value with an evaluation value determined based on the frequency at which the person turns his face in a direction other than the product while being in the vicinity of the product, and d) the personal belongings of the person. The face authentication apparatus according to claim 1, which is determined.   The image analysis means determines whether the person detected from the image information satisfies the predetermined criteria, a) frequency of direction change or pause in movement of the person, and b) face of the person The face authentication apparatus according to claim 1, which is determined by comparing an evaluation value determined based on a ratio of covering with a threshold value. The image analysis means receives the image information and shooting position information and time information, and detects or adds the face image included in the list, or adds the face image to the list. The position information and the time information are stored in the person information management means in time series in association with the face image that has been made,
4. The face authentication device according to claim 1, wherein the person information management unit stores the position information of the portable terminal device in association with the portable terminal device;
From the position information and the time information accumulated in association with the face image, a position where the person of the face image of the identifier notified from the face authentication device appears is predicted, and in the vicinity of the predicted position A person tracking system comprising: an analysis device including an action prediction unit that identifies the portable terminal device that exists and transmits a photographing request with the face image attached to the identified portable terminal device.   The person of the face image appears at a location of a facility that satisfies a predetermined condition within a distance determined based on an elapsed time from the time information from the location indicated by the latest location information. 5. The person tracking system of claim 4, wherein the person tracking system predicts a location. A monitoring camera that is provided in the facility or on the street and that transmits the image information obtained by photographing the vicinity, time information at the time of photographing, and the position information to the face authentication device,
Further including the portable terminal device that transmits the position information, receives the photographing request, and transmits the image information photographed by the camera of the device itself;
The person tracking system according to any one of claims 4 to 5, wherein the analysis device includes the position information of the portable terminal device and a reception unit that receives the image information and stores the received image information in the person information management unit. .   1) When the face image included in the list of face images of the person is detected from the received image information, an identifier of the detected face image is output, and 2) the person not included in the list but satisfying a predetermined criterion is output. A person tracking method that, when detected, adds the face image of the person satisfying the predetermined criterion to the list and outputs an identifier of the added face image.   Whether the person detected from the image information satisfies the predetermined criteria, a) whether the person is in the vicinity of a predesignated product even after a predetermined time has elapsed within a predetermined time zone, b) the product The evaluation value determined based on the frequency with which the person turns the face in a direction other than the product while being in the vicinity and the personal belongings of the person and the threshold value are determined by comparing with a threshold value. Person tracking method.   From the received image information, 1) When the face image included in the list of stored human face images is detected, an identifier of the detected face image is output. 2) Although not included in the list, a predetermined criterion is used. A person tracking program for causing a computer to execute a process of adding the face image of the person satisfying the predetermined criterion to the list and outputting the identifier of the added face image when detecting the person who satisfies the condition.   Whether the person detected from the image information satisfies the predetermined criteria, a) whether the person is in the vicinity of a predesignated product even after a predetermined time has elapsed within a predetermined time zone, b) the product A process of comparing the evaluation value determined based on the frequency with which the person turns his / her face in a direction other than the product while being in the vicinity, and the personal belongings of the person with a threshold, and determining the threshold The person tracking program according to claim 9, which is executed.

Images