JP2020135408A - Information processing device, information processing method, and program - Google Patents

Abstract

To provide an information processing device, information processing method, and program, which allow for flexibly determining if a person is eligible or not.SOLUTION: An information processing device is provided, comprising an image acquisition unit for acquiring an image of an establishment, a human detection unit for detecting a person in the image of the establishment, and a determination unit configured to determine if the person is an eligible person or not based on an attribute of the person and the image of the establishment.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing device, an information processing method and a program.

In Patent Document 1, a detection means for detecting person information including face information from the acquired image of the target person, and whether or not the target person is a certain age-restricted target person are specified based on the person information. An age confirmation device having means is described. Further, Patent Document 2 describes an age authentication system that authenticates the age of a visitor based on a face image of a visitor who visits a store for which a limit age is set.

JP-A-2008-176689 JP-A-2009-217735

However, all of the techniques described in Patent Documents 1 and 2 allow admission to places such as stores with age restrictions based on the age specified in the person information including the face information or the age estimated based on the face image. It only determines whether to forgive or not. Therefore, in the techniques described in Patent Documents 1 and 2, it is possible to flexibly determine whether or not the person is a subject who should be permitted to enter or not, taking into consideration factors other than age such as the presence or absence of a companion. Is difficult. Here, the target person is, for example, a person who should be permitted to enter a facility such as a store, or a person who should be permitted to purchase, rent, or borrow a specific product or service.

An object of the present invention is to provide an information processing device, an information processing method, and a program capable of flexibly determining whether or not an object is a subject in view of the above-mentioned problems.

According to one aspect of the present invention, an image acquisition unit that acquires a place image, a person detection unit that detects a person included in the place image, and a target person for the person based on the attributes of the person and the place image. An information processing device including a determination unit for determining whether or not the above is provided.

According to another aspect of the present invention, a place image is acquired, a person included in the place image is detected, and whether or not the person is a target person is determined based on the attributes of the person and the place image. Information processing methods are provided.

According to still another aspect of the present invention, the computer acquires a place image, detects a person included in the place image, and is the target person for the person based on the attributes of the person and the place image. A program is provided that executes the determination of whether or not.

According to the present invention, it is possible to flexibly determine whether or not the subject is a subject.

FIG. 1 is a schematic view showing a configuration of a subject determination system according to the first embodiment of the present invention. FIG. 2 is a block diagram showing a configuration of a determination server in the subject determination system according to the first embodiment of the present invention. FIG. 3 is a block diagram showing a configuration of a store terminal in the target person determination system according to the first embodiment of the present invention. FIG. 4 is a flowchart showing the operation of the determination server in the subject determination system according to the first embodiment of the present invention. FIG. 5 is a schematic view showing an example of a place image acquired in the subject determination system according to the first embodiment of the present invention. FIG. 6 is a schematic view showing another example of the location image acquired in the subject determination system according to the first embodiment of the present invention. FIG. 7 is a schematic view showing an example of a registrant information DB in the subject determination system according to the first embodiment of the present invention. FIG. 8 is a schematic view showing an example of a determination result information DB in the subject determination system according to the first embodiment of the present invention. FIG. 9 is a flowchart showing the operation of the store terminal in the target person determination system according to the first embodiment of the present invention. FIG. 10 is a flowchart showing a process of changing the range of the target age by the determination server in the subject determination system according to the second embodiment of the present invention. FIG. 11 is a block diagram showing a configuration of a guardian terminal in the target person determination system according to the third embodiment of the present invention. FIG. 12 is a flowchart showing the operation of the guardian terminal in the target person determination system according to the third embodiment of the present invention. FIG. 13 is a block diagram showing a configuration of an information processing apparatus according to another embodiment.

[First Embodiment]
The information processing apparatus and the information processing method according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 7.

First, the overall configuration of the target person determination system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a schematic view showing the configuration of the target person determination system 1 according to the present embodiment.

As shown in FIG. 1, the target person determination system 1 according to the present embodiment is an information processing system, and includes a surveillance camera 10, a determination server 20, a store terminal 30, a notification device 40, and a guardian terminal 50. Includes. The guardian terminal 50 will be described in the third embodiment described later.

The target person determination system 1 according to the present embodiment is a permission target for admitting a person detected in a place image taken by a surveillance camera 10 in a store S, which is a facility where an age limit is set for admission. Judge whether or not the person is a person. The place image is an image of a specific place in the store S. The age limit set in the store S allows the admission of the age group within the target age range and prohibits the admission of the age group outside the target age range. The age limit of the store S is not particularly limited, but for example, the target age is 20 years or older. The place image is not limited to the image of a specific place in the store S, but may be an image of a place where a person who should be determined whether or not the person is a permission target can be photographed.

The store S, which is a facility with age-based admission restrictions, is not particularly limited. For example, all or part of the available time zone of pachinko parlors, amusement facilities, movie theaters, restaurants, etc. It is a facility with an age limit for admission during the time period. Amusement facilities include, for example, arcades. The facility for which admission is restricted according to age is not limited to a commercial facility where commercial activities are carried out, such as store S, and may be, for example, a public facility, and may be any facility.

The target person determination system 1 according to the present embodiment is a registered target age person who is an estimated target age person who is an age within the target age range and a person who is registered as an age person within the target age range. Judges a person as a person to be permitted. Information about the age group to be registered is registered in the registrant information database (Database, DB) 206a described later.

In addition, the admission restriction of the store S is such that even a person whose age is outside the target age range is allowed to enter on the condition that a person within the target age range is accompanied. Therefore, the target person determination system 1 according to the present embodiment is an age outside the target age range when accompanied by an estimated target age person or a registration target age person even if the person is an age outside the target age range. Is determined to be the person to be permitted.

In the present embodiment, the case where the target person determination system 1 determines whether or not the person included in the place image is a permitted person who should be permitted to enter the store S will be described. It is not limited to this. The target person determination system 1 according to the present embodiment is a licensed person who should permit the person included in the place image to perform an act with age restrictions such as purchase, rent, or borrowing of a specific product or service. It is also possible to determine whether or not there is.

The surveillance camera 10, the determination server 20, the store terminal 30, and the notification device 40 are connected to the network NW. The network NW is composed of, for example, a LAN (Local Area Network), a WAN (Wide Area Network), a mobile communication network, and the like. The determination server 20, the surveillance camera 10, the store terminal 30, and the notification device 40 can communicate with each other via the network NW.

One or a plurality of surveillance cameras 10 are installed, for example, on the ceiling of the store S, which is a facility where admission is restricted according to age. The determination server 20 is installed in the store S, for example, in the backyard Sb of the store S. Further, the determination server 20 may be installed, for example, in the facility of the business operator that provides the service by the target person determination system 1. One or a plurality of store terminals 30 are installed in a place that can be used by a store clerk such as the backyard Sb of the store S. Further, the store terminal 30 may be a mobile terminal such as a smartphone or a tablet terminal carried by a clerk of the store S. The notification device 40 is installed at a place where a clerk is located in the store S, such as the backyard Sb of the store S.

Next, each element of the surveillance camera 10, the determination server 20, the store terminal 30, and the notification device 40 included in the target person determination system 1 according to the present embodiment will be further described in detail with reference to FIGS. 2 and 3. FIG. 2 is a block diagram showing the configuration of the determination server 20 in the target person determination system 1 according to the present embodiment. FIG. 3 is a block diagram showing the configuration of the store terminal 30 in the target person determination system 1 according to the present embodiment.

The surveillance camera 10 is, for example, a photographing device such as a network camera (IP camera). One or a plurality of surveillance cameras 10 are installed so as to photograph a specific place in the store S. For example, the surveillance camera 10 is installed so as to photograph the entrance / exit Sd of the store S as a specific place in the store S. The surveillance camera 10 can be installed so as to photograph various places in the store S in addition to the entrance / exit Sd.

The surveillance camera 10 continuously photographs a specific place in the store S such as the entrance / exit Sd and outputs an image. The video output by the surveillance camera 10 includes a plurality of place images that are images taken at a specific place in succession in time. The determination server 20 can acquire images including a plurality of temporally continuous location images output by the surveillance camera 10 via the network NW in real time or almost in real time. The location image may include a person who is about to enter the store S or a person who is entering the store S.

The determination server 20 determines whether or not the person included in the location image, which is an image of a specific location in the store S taken by the surveillance camera 10, is a permitted person who should be permitted to enter the store S. It is an information processing device. The determination server 20 executes a notification process for notifying the store terminal 30 and the like according to the determination result of whether or not the person is the permission target person. The function of the determination server 20 may be realized by a single server or by a plurality of servers.

As shown in FIG. 2, the determination server 20 includes a CPU (Central Processing Unit) 202, a RAM (Random Access Memory) 204, a storage unit 206, and a communication unit 208. The CPU 202, the RAM 204, the storage unit 206, and the communication unit 208 are connected to the common bus 210.

The CPU 202 operates by executing the program stored in the storage unit 206, and functions as a control unit that controls the operation of the entire determination server 20. Further, the CPU 202 executes the program stored in the storage unit 206 to execute various processes as the determination server 20. The RAM 204 provides a memory area required for the operation of the CPU 202.

More specifically, the CPU 202 functions as an image acquisition unit 202a, a person detection unit 202b, a determination unit 202c, a result processing unit 202d, a transmission unit 202e, a registration processing unit 202f, and a learning unit 202g by executing a program. ..

The image acquisition unit 202a acquires an image output from the surveillance camera 10 via the network NW in real time or almost in real time, and acquires a plurality of places images that are continuous in time at regular time intervals from the acquired image. The image acquisition unit 202a continuously acquires a location image while the target person determination system 1 is operating. The image acquisition unit 202a can specify, for example, the shooting date and time when the location image was taken by the surveillance camera 10 based on the date and time information acquired from the system clock.

The person detection unit 202b attempts to detect a person in the place image for each of the place images acquired by the image acquisition unit 202a. The person detection unit 202b is not particularly limited, but can detect a person in a place image based on a feature amount such as a HOG (Histogram of Oriented Gradients) feature amount. The person detection unit 202b acquires a person image including the face of the detected person who is the person detected in the place image and a part or all of the body other than the face. The portrait image includes appearance features such as height, body shape, hairstyle, and clothing of the detected person. The person image is, for example, an upper body image or a whole body image of the detected person which is a part of the place image. Further, the person image may be, for example, the place image itself including the detected person.

In addition, the person detection unit 202b detects the face of the detected person who is the person detected in the place image. The person detection unit 202b is not particularly limited, but can detect the face of the detected person based on a feature amount such as a Haar-Like feature amount. The person detection unit 202b acquires a face image which is an image of the detected face.

The person detection unit 202b can detect a plurality of persons as detection persons from a single place image or from a plurality of place images. The determination server 20 can execute the same process for each of the plurality of detected persons.

The determination unit 202c determines whether or not the detected person detected by the person detection unit 202b is a permitted person who should be permitted to enter the store S. Therefore, the determination unit 202c is an attribute estimation unit that estimates attributes such as the age of the detection person, a companion determination unit that determines the presence or absence of a specific person accompanying the detection person, and registration registered in the detection person and the registrant information DB 206a. Includes a function as a collation unit that performs face collation with a person.

More specifically, the determination unit 202c functions as an attribute estimation unit and estimates attributes such as the age and gender of the detected person. The determination unit 202c can estimate attributes such as the age and gender of the detected person based on either or both of the face image and the person image of the detected person acquired by the person detection unit 202b.

The determination unit 202c may be used as long as it estimates at least the age of the detected person. The determination unit 202c can estimate a specific age as the age of the detected person, for example, "30 years old", or detect in a wide range of ages, such as "16 to 18 years old". The age of a person can be estimated.

The determination unit 202c is not particularly limited, but can estimate attributes such as age and gender using, for example, an attribute estimation model such as an age estimation model and a gender estimation model learned by machine learning. As will be described later, the determination unit 202c can estimate the age of the detected person by using, for example, the age estimation model learned by the learning unit 202g.

The determination unit 202c determines whether or not the estimated age of the detected person is within the range of the target age. For example, as the age limit of the store S, an age limit in which a specific age is set as a threshold value, an age below the threshold value is outside the target age range, and an age above the threshold value is within the target age range is exemplified. In this case, the determination unit 202c determines whether or not the estimated age of the detection person is equal to or greater than the threshold value.

When the determination unit 202c determines that the estimated age of the detected person is within the range of the target age, the determination unit 202c determines that the detected person is an estimated target age person who should be permitted to enter the store S. To do.

In addition, the determination unit 202c sends the detected person to the store S based on the appearance characteristics of the detected person extracted from the person image acquired by the person detecting unit 202b or in consideration of the appearance characteristics in the above age estimation. It is also possible to determine whether or not the person is permitted to enter. The determination unit 202c can extract features such as height, body shape, hairstyle, and clothes of the detected person from the person image as external features of the detected person.

For example, when the target age of the store S is 20 years or older, the determination unit 202c permits the detected person to enter the store S when the school uniform is extracted from the person image as an external feature of the detected person. It can be determined that the person is an unauthorized person who should not be. Further, for example, in the same case where the target age is 20 years or older, when the determination unit 202c detects a height below the threshold value as an appearance feature of the detected person from the person image, the detected person is regarded as an unauthorized target person. Can be determined. The height threshold is set from, for example, the average height of a specific age or age range. In this way, the determination unit 202c can also determine whether or not the detected person is a permitted person who should be permitted to enter the store S based on the appearance characteristics of the detected person extracted from the person image. ..

Further, when the determination unit 202c determines that the estimated age of the detected person is out of the range of the target age, the determination unit 202c functions as a companion determination unit and determines the presence or absence of a specific person accompanying the detected person based on the location image. .. Here, the specific person is an estimated target age person or a registration target age person. The determination unit 202c can determine the presence or absence of a specific person who is a companion according to the following criteria.

For example, the determination unit 202c detects another person determined to be the estimated target age person or the registration target age person in the place image in which the detected person is detected, and the detected person and the other person in the place image Is determined to have a specific person accompanying the detected person when is in a predetermined positional relationship. The case where the detected person and another person in the place image have a predetermined positional relationship is, for example, when the distance between the detected person and the other person is less than a predetermined distance and they are close to each other. This is the case where the detected person and another person are in contact with each other, such as holding hands. When the distance between the detected person and another person is less than or equal to the predetermined distance, the distance between both people in the real space and the distance between both people on the place image are less than or equal to the predetermined distance. This may be the case, or the distance of either one may be less than or equal to a predetermined distance. In addition to the above, when the detected person in the place image and the other person have a predetermined positional relationship, when both people are arranged side by side instead of front and back in the place image, the positional relationship between the two people is time. This is the case where the series is continuous, that is, the positional relationship between the two persons is continuous in a moving manner.

Further, for example, in the determination unit 202c, another person who is determined to be the estimated target age person or the registration target age person in another place image before and after the detected place image at a predetermined time interval is included in the determination unit 202c. When it is detected, it is determined that there is a specific person accompanying the detected person.

In addition to the above, the determination unit 202c may determine the presence or absence of a specific person accompanying the detected person according to various criteria based on the relationship between the detected person and the other person that can be extracted from the one or more place images. it can.

In this way, the determination unit 202c determines whether or not the detection person is a permission target person by determining the presence or absence of a specific person accompanying the detection person based on the location image taken by the surveillance camera 10. When the determination unit 202c determines that there is a specific person accompanying the detection person, the determination unit 202c determines that the detection person is a permission target person who should be permitted to enter the store S. In this case, the detected person is a person who is presumed to be an age outside the target age range, but is a person to be permitted because it is determined that a specific person, an estimated target age person or a registered target age person, accompanies the person. Is determined. In the present embodiment, not only the result of estimating the age of the detected person but also the presence or absence of a companion based on the place image is used to determine whether or not the person is a permitted person who should be permitted to enter the store S. It is possible to flexibly determine whether or not it is.

The determination unit 202c determines that there is no specific person accompanying the detection person when it does not correspond to any of the cases where it is determined that there is a specific person accompanying the detection person. In addition, the determination unit 202c can determine the presence or absence of a specific person accompanying a single criterion or a combination of a plurality of criteria.

Further, the determination unit 202c functions as a face matching unit when it is determined that there is no specific person accompanying the detected person, and performs face matching for matching the face image of the detected person with a plurality of registered face images at a ratio of 1: N. Do. The plurality of registered face images are face images of a plurality of registrants registered in the registrant information DB 206a of the storage unit 206. The determination unit 202c can collate both face images by collating the face feature amount extracted from the face image of the detected person with the face feature amount extracted from the registered face image at the time of face matching. The determination unit 202c registers the face image of the detected person with the face image of the detected person when the collation score indicating the similarity between the face image of the detected person and the registered face image exceeds a predetermined threshold and both face images show a high degree of similarity. It can be determined that they match the face image.

If the face matching result does not find a registered face image that matches the face image of the detected person, the determination unit 202c determines that the detected person does not correspond to the registrant. In this case, the determination unit 202c determines that the detected person is an unauthorized person who should not be allowed to enter the store S.

Further, when the determination unit 202c finds a registered face image that matches the face image of the detected person as a result of face matching, the determination unit 202c determines that the detected person corresponds to the registrant corresponding to the registrant information including the registered face image. To do.

Further, when the determination unit 202c determines that the detection person corresponds to the registrant, the determination unit 202c determines whether or not the age of the corresponding registrant who is the registrant determined to correspond to the detection person is within the range of the target age. The determination unit 202c can obtain the age associated with the registered face image that matches the face image of the detected person as the age of the registrant by referring to the registrant information DB 206a. The determination unit 202c can determine whether or not the age of the relevant registrant is within the range of the target age in the same manner as the determination of whether or not the estimated age of the detected person is within the range of the target age. it can.

When the determination unit 202c determines that the age of the registrant is within the range of the target age, the determination unit 202c is a permission target person who should permit the detection person who is determined to correspond to the registrant to enter the store S. Judged as a person of the age to be registered.

Further, when the determination unit 202c determines that the age of the relevant registrant is outside the range of the target age, the determination unit 202c determines whether or not the companion information is included in the registrant information of the relevant registrant. The companion information is information that identifies the registrant information of a person who is a guardian or the like who can accompany a registrant whose age is outside the target age range and is registered in the registrant information DB 206a as a registration target age person. ..

When the determination unit 202c determines that the registrant information of the registrant does not include the accompanying information, the determination unit 202c determines that the detected person is a non-permitted person who should not be allowed to enter the store S.

On the other hand, when the determination unit 202c determines that the registrant information of the corresponding registrant includes the companion information, the registration target specified by the companion information from the permitted persons who are permitted to enter the store S. Search for age people.

The determination unit 202c performs face matching for collating the face image of the registration target age person specified by the accompanying information with the face image of the permission target person registered in the determination result information DB 206b described later, and thereby the registration target. You can search for age people. The determination unit 202c can extract the face image from the registrant information of the registration target age person specified by the accompanying information as the face image of the registration target age person with reference to the registrant information DB 206a.

When searching for a person of the age to be registered, the determination unit 202c performs face matching of the person to be permitted detected in the place image taken within a predetermined time zone including the time when the place image in which the detected person was detected was taken. Can be the target of. At the time of face matching, the determination unit 202c collates both face images by collating the face feature amount extracted from the face image of the registration target age person with the face feature amount extracted from the face image of the permission target person. Can be done. The determination unit 202c is a registration target when the collation score indicating the degree of similarity between the face image of the person to be registered and the face image of the person to be permitted exceeds a predetermined threshold and both face images show a high degree of similarity. It can be determined that the face image of the elderly person and the face image of the person to be permitted match.

When the determination unit 202c finds the face image of the permitted target person that matches the face image of the registered target age person specified by the companion information as a result of face matching, the registered target age person as a companion to accompany the detected person. Judge that there is. Further, when the determination unit 202c determines that there is a registration target age person as a companion accompanying the detection person, the determination unit 202c determines that the detection person is a permission target person who should be permitted to enter the store S. In this case, the detected person is a person whose age is outside the target age range, but is determined to be a person to be permitted because it is determined that the person to be registered is accompanied by the person to be registered.

Further, when the determination unit 202c does not find the face image of the permitted person who matches the face image of the registered target age person specified by the companion information as a result of the face collation, the determination unit 202c acts as a companion to accompany the detected person. It is judged that there is no person of the age to be registered. Further, when the determination unit 202c determines that there is no registered target age person as a companion accompanying the detected person, the determination unit 202c determines that the detected person is a non-permitted target person who should not be permitted to enter the store S. ..

In addition, the determination unit 202c determines that the estimated target age person or the registration target age person is accompanied by the companion, and the detection person who is determined to be the permission target person is subsequently associated with the companion for a long time of a predetermined time or longer. It is possible to determine whether or not they are separated. In this case, the determination unit 202c monitors the detected person and the companion in the image output by one or more surveillance cameras 10 installed in the store S, and determines whether or not the person is away from the companion for a long time. Can be determined. Further, the determination unit 202c can track and monitor the detected person and the companion detected by the person detection unit 202b from the images output by one or more surveillance cameras 10. When the determination unit 202c determines that the detection person is away from the companion for a long time of a predetermined time or longer, the determination unit 202c notifies the store terminal 30, the notification device 40, and the guardian terminal via the network NW to notify the fact. It can be transmitted to 50 mag.

The result processing unit 202d stores the determination result information stored in the storage unit 206, which is information on the determination result in which the determination unit 202c determines whether the detected person is a permitted person or a non-permitted person. Register in the information DB 206b.

The result processing unit 202d registers the determination result information for each detected person. The determination result information relates to, for example, an ID (identification) that uniquely identifies the detected person, a determination result indicating whether the person is a permitted person or a non-permitted person, the age, the shooting date and time of the detected person, and the detected person. Includes images, etc. The age is the age of the detected person estimated by the determination unit 202c or the age of the corresponding registrant determined to correspond to the detected person by the determination unit 202c. The image relating to the detected person is at least one of the person image and the face image of the detected person acquired by the person detection unit 202b. In addition, the result processing unit 202d is a detection person who is outside the range of the target age and is determined to have a companion estimated target age person or a registration target age person and is determined to be a permission target person. The determination result information can include information about the companion. The result processing unit 202d registers various information included in the determination result information in the determination result information DB 206b in association with each other.

From the viewpoint of privacy protection and the like, the result processing unit 202d can delete the determination result information from the determination result information DB 206b after a predetermined period has elapsed from the shooting date and time of the detected person, for example. Further, from the same viewpoint, the result processing unit 202d can delete the determination result information from the determination result information DB 206b, for example, every time a predetermined time arrives. For example, the result processing unit 202d can delete the determination result information registered at that time from the determination result information DB 206b each time the end time of the available time of the day of the store S arrives.

The transmission unit 202e functions as a notification unit for notifying the result of the determination by the determination unit 202c, and when the determination unit 202c determines that the detection person is the unauthorized target person, the transmission unit 202e is sent to the store S of the unauthorized target person. A notification indicating admission is transmitted to the store terminal 30 via the network NW. The notification indicates that the unauthorized person is trying to enter the store S or is entering the store S. The transmission unit 202e can transmit the notification to one specific store terminal 30, or can transmit the notification to a plurality of store terminals 30 all at once.

In addition, the transmission unit 202e can transmit a notification including personal information which is information about the detected person determined to be the non-permitted target person as a notification indicating the admission of the non-permitted target person to the store S. The person information includes, for example, the shooting date and time of the detected person, the age estimated by the determination unit 202c or the age of the corresponding registrant, an image related to the detected person, and the like. The image relating to the detected person is at least one of the person image and the face image of the detected person acquired by the person detection unit 202b.

Further, the transmission unit 202e can transmit a notification to the store terminal 30, or instead, transmit a notification indicating entry of the unauthorized person to the store S to the notification device 40 via the network NW. ..

The registration processing unit 202f registers the registrant information in the registrant information DB 206a stored in the storage unit 206. The registrant information is transmitted from the store terminal 30 to the determination server 20 via the network NW, as will be described later.

The learning unit 202g learns an age estimation model for estimating the age of the detected person by machine learning such as deep learning. The learning unit 202g can perform machine learning using the combination of the face image of the registrant information registered in the registrant information DB 206a and the age as correct answer data. The determination unit 202c can estimate the age of the detected person by using the age estimation model learned by the learning unit 202g.

The storage unit 206 is composed of a storage medium such as a flash memory or a non-volatile memory such as a hard disk drive. The storage unit 206 stores a program executed by the CPU 202, data referred to by the CPU 202 when the program is executed, and the like.

In addition, the storage unit 206 stores the registrant information DB 206a in which the registrant information is registered. The registrant information is information about a registrant who has obtained consent for registration or who wishes to register. The registrant information includes, for example, an ID that uniquely identifies the registrant, a name, age, contact information of the registrant, an image of the registrant, and the like. The image relating to the registrant is at least one of the registrant's face image and person image. The registrant information can be information on either a person whose age is within the target age range or a person whose age is outside the target age range. In addition, the registrant information may include companion information when it is information about a person outside the target age range. The companion information is information that identifies the registrant information of a person who is a guardian or the like who can accompany a person whose age is outside the range of the target age and is registered in the registrant information DB 206a as the registration target age person. The accompanying information is, for example, an ID of registrant information. Various types of information included in the registrant information are associated with each other.

Further, the storage unit 206 stores the determination result information DB 206b in which the determination result information regarding the determination result as to whether the detection person by the determination unit 202c is the permission target person or the non-permission target person is registered. As described above, the result processing unit 202d registers the determination result information in the determination result information DB 206b.

The communication unit 208 communicates with external devices such as the surveillance camera 10, the store terminal 30, the notification device 40, and the guardian terminal 50 via the network NW under the control of the CPU 202. The communication standard, method, etc. of the communication unit 208 are not particularly limited, and may be a wired method or a wireless method.

In this way, the determination server 20 is configured.

The store terminal 30 is an information processing device that receives notifications from the determination server 20, displays notifications, accepts input of registrant information by a clerk of store S, etc., and transmits registrant information to the determination server 20. .. The function of the store terminal 30 may be realized by a single terminal or may be realized by a plurality of terminals.

As shown in FIG. 3, the store terminal 30 has a CPU 302, a RAM 304, a storage unit 306, an input unit 308, a display unit 310, and a communication unit 312. The CPU 302, RAM 304, storage unit 306, input unit 308, display unit 310, and communication unit 312 are connected to the common bus 314.

The CPU 302 operates by executing the program stored in the storage unit 306, and functions as a control unit that controls the operation of the entire store terminal 30. Further, the CPU 302 executes the program stored in the storage unit 306 to execute various processes as the store terminal 30. The RAM 304 provides a memory area required for the operation of the CPU 302.

More specifically, the CPU 302 functions as a receiving unit 302a, a notification output unit 302b, a receiving unit 302c, and a transmitting unit 302d by executing the program.

When the determination server 20 transmits a notification indicating that the unauthorized person has entered the store S, the receiving unit 302a receives the notification indicating that the unauthorized person has entered the store S. The receiving unit 302a can receive the person information about the detected person included in the notification.

The notification output unit 302b outputs a notification indicating the entrance of the unauthorized person to the store S received by the reception unit 302a to the display unit 310 and displays it on the display unit 310. When displaying the notification on the display unit 310, the notification output unit 302b indicates that the unauthorized person is trying to enter the store S or is entering the store S, a part or all of the person information included in the notification, etc. Can be displayed. The notification output unit 302b can display, for example, a person image or a face image of a detected person determined to be an unauthorized target person on the display unit 310 as person information.

Further, the notification output unit 302b can display the notification on the display unit 310, or instead, output the notification to a built-in or external speaker (not shown) to output the notification as a notification voice or a notification sound. .. For example, the notification output unit 302b can output a notification voice or a notification sound indicating that the unauthorized target person is about to enter the store S or is entering the store S from the speaker.

The clerk of the store S can search for the detected person determined to be the non-permitted target person by receiving the notification indicating the admission of the non-permitted target person to the store S displayed on the display unit 310. The clerk can use the person image or face image displayed on the display unit 310 as a clue when searching for the detected person. The portrait image includes the appearance features of the detected person in addition to the face of the detected person as described above. Therefore, the clerk can easily search for the detected person by using the person image as a clue.

The clerk who finds the detected person can perform age confirmation to confirm the age of the detected person, and can confirm whether or not the detected person is an unauthorized person as notified. When confirming the age, the clerk can ask the detecting person to present an identification card or the like to confirm the age of the detecting person more accurately.

The clerk who confirmed the age of the detected person further, in order to register the detected person in the registrant information DB206a, with the consent of the detected person, the name, age, date of birth, contact information, etc. of the detected person, etc. Personal information can be obtained from the detected person. Since the clerk registers in the registrant information DB 206a, the acquired personal information of the detected person can be input to the store terminal 30 via the input unit 308.

The detected person who was determined to be an unauthorized person and was subject to notification, but was confirmed by the clerk to be an age within the target age range, is registered in the registrant information DB206a. When entering the store S from the next time onward, it will not be determined that the person is an unauthorized person. Therefore, according to the present embodiment, it is possible to prevent the clerk from confirming the age of the detected person who is the target age person a plurality of times.

In addition, the clerk may receive personal information such as name, age, date of birth, contact information, face image, etc. from not only the detected person but also the registration applicant who wishes to register in the registrant information DB206a. it can. Since the clerk registers in the registrant information DB 206a, the personal information of the registered applicant who has been provided can be input to the store terminal 30 via the input unit 308.

In addition, the guardian of a relative whose age is within the target age range must be registered in the registrant information DB 206a as a registration applicant together with the protected person such as the child whose age is outside the target age range. Can be done. In this case as well, since the store clerk registers in the registrant information DB 206a, the personal information of the guardian and the protected guardian who received the information can be input to the store terminal 30 via the input unit 308, respectively.

The reception unit 302c receives the personal information input by the clerk via the input unit 308 and generates the registrant information including the personal information. In the case of a detected person whose age has been confirmed by a clerk, the reception unit 302c obtains an ID that uniquely identifies the detected person, personal information of the detected person, a person image or a face image included in the notification received from the determination server 20, and the like. It is possible to generate registrant information including. Further, in the case of a registration applicant, the reception unit 302c generates registrant information including an ID that uniquely identifies the registration applicant, personal information of the registration applicant, and the like. The registrant information of the applicant for registration includes the face image of the applicant for registration provided.

Further, the reception unit 302c can include accompanying information in the registrant information when the applicant for registration is a person outside the target age range. The companion information is information that identifies the registrant information of a person who is a guardian or the like who can accompany a registration applicant who is an age outside the target age range and is registered in the registrant information DB 206a as a registration target age person. is there. The accompanying information is, for example, an ID of registrant information such as a guardian. Various types of information contained in the registration information are associated with each other.

The transmission unit 302d transmits the registrant information generated by the reception unit 302c to the determination server 20 via the network NW.

The storage unit 306 is composed of a storage medium such as a flash memory or a non-volatile memory such as a hard disk drive. The storage unit 306 stores a program executed by the CPU 302, data referred to by the CPU 302 when the program is executed, and the like. For example, the storage unit 306 can store the notification received by the reception unit 302a, the personal information received by the reception unit 302c, the registrant information generated by the reception unit 302c, and the like.

The input unit 308 accepts an operation of inputting information, instructions, etc. from the clerk to the store terminal 30. The clerk can input various information or an instruction to execute the process to the store terminal 30 via the input unit 308. The input unit 308 is composed of, for example, a keyboard, a mouse, and the like. Further, the input unit 308 may be configured by, for example, a touch panel incorporated in the display unit 310.

The display unit 310 displays various screens such as a program execution screen according to the control by the CPU 302. More specifically, the display unit 310 displays a notification screen for displaying the notification received from the determination server 20, an input screen for inputting the registrant information, and the like. The display unit 310 is composed of, for example, a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or the like. The display unit 310 may be configured as a touch panel display together with the input unit 308, for example.

The communication unit 312 communicates with an external device such as the determination server 20 via the network NW under the control of the CPU 302. The communication standard, method, etc. of the communication unit 312 are not particularly limited, and may be a wired method or a wireless method.

In this way, the store terminal 30 is configured.

The notification device 40 is a device that notifies the clerk of the store S of the notification when the determination server 20 receives a notification indicating that the unauthorized person has entered the store S. The notification device 40 can notify the clerk of a notification indicating that the unauthorized person has entered the store S, for example, by lighting the notification lamp, outputting the notification voice or the notification sound, and the like. In addition, the notification device 40 may notify the clerk of the store S, or instead, notify the non-permitted person to enter the store S toward the inside of the store S. For example, the notification lamp of the notification device 40 can be installed at the entrance / exit Sd of the store S so that the notification lamp lights up based on the notification indicating the entry of the unauthorized person into the store S. With such a configuration, it is possible to deter non-permitted persons such as minors from entering the store S.

In the target person determination system 1 according to the present embodiment, the determination server 20 estimates the age of the detected person detected in the location image taken by the surveillance camera 10 by the determination unit 202c, and is the authorized person. Judge whether or not. Further, the determination server 20 performs face matching with the registrant by the determination unit 202c for the detected person, and determines whether or not the detected person is a permitted person. On the other hand, the information about the detected person whose age has been confirmed by the clerk based on the notification transmitted from the determination server 20 to the store terminal 30 is registered in the registrant information DB 206a with the consent of the detected person. Therefore, according to the present embodiment, it is possible to avoid multiple age confirmations by the clerk for the detected person.

Further, the determination server 20 determines whether or not there is an estimated target age person or a registration target age person who accompanies the detected person by the determination unit 202c based on the place image taken by the surveillance camera 10, so that the detected person is permitted. Judge whether or not the person is a person. Therefore, according to the present embodiment, since factors other than age, such as the presence or absence of a companion, are taken into consideration, it is possible to flexibly determine whether or not the detected person is a permitted person.

Further, the determination server 20 can also determine whether or not the detected person is a permitted person based on the appearance characteristics of the detected person extracted from the person image of the detected person. Therefore, according to the present embodiment, it is possible to consider factors other than age, such as appearance characteristics, so that it is possible to more flexibly determine whether or not the detected person is a permitted person.

Hereinafter, the operations of the determination server 20 and the store terminal 30 in the target person determination system 1 according to the present embodiment will be further described with reference to FIGS. 4 to 9. FIG. 4 is a flowchart showing the operation of the determination server 20 in the target person determination system 1 according to the present embodiment. 5 and 6 are schematic views showing an example of a location image acquired by the subject determination system 1 according to the present embodiment. FIG. 7 is a schematic view showing an example of the registrant information DB 206a in the target person determination system 1 according to the present embodiment. FIG. 8 is a schematic view showing an example of the determination result information DB 206b in the subject determination system 1 according to the present embodiment. In the registrant information DB 206a shown in FIG. 7 and the determination result information DB 206b shown in FIG. 8, the display of data of some items is omitted for the sake of simplicity. FIG. 9 is a flowchart showing the operation of the store terminal 30 in the target person determination system 1 according to the present embodiment. When the determination server 20 and the store terminal 30 operate, the information processing method according to the present embodiment is executed.

The determination server 20 acquires a video including a plurality of temporally continuous location images output by the surveillance camera 10 via the network NW in real time or almost in real time during business hours, which is the available time of the store S.

As shown in FIG. 4, in the determination server 20, the image acquisition unit 202a acquires the image output from the surveillance camera 10 via the network NW in real time or almost in real time, and places from the acquired image at regular time intervals. Acquire an image (step S102).

Next, the person detection unit 202b attempts to detect a person in the place image with respect to the place image acquired by the image acquisition unit 202a (step S104). When a person is not detected in the place image (step S106, NO), the person detection unit 202b repeats an attempt to detect the person for a plurality of place images acquired by the image acquisition unit 202a at regular time intervals.

When the person detection unit 202b detects a person in the place image (step S106, YES), the person detection unit 202b acquires the person image of the detected person (step S108). The person image is, for example, an upper body image or a whole body image of the detected person, a place image itself, etc., which is a part of the place image, and includes appearance features such as height, body shape, hairstyle, and clothes of the detected person.

Further, the person detection unit 202b detects the face of the detected person and acquires the face image of the detected person (step S110).

5 and 6 are schematic views showing examples of location images P1 and P2 acquired from images of a surveillance camera 10 that captures the entrance / exit Sd of the store S, respectively. A single or a plurality of detected persons can be detected in the place images P1 and P2. That is, as shown in FIG. 5, a single detection person B1 is detected in the location image P1. Further, as shown in FIG. 6, a plurality of detected persons B2 and B3 are detected in the location image P2. As shown in FIGS. 5 and 6, the person detection unit 202b detects the faces of the detected persons B1, B2, and B3, respectively, and acquires the respective face images F1, F2, and F3.

Next, the determination unit 202c estimates attributes such as age and gender of the detected person based on either or both of the face image and the person image of the detected person acquired by the person detecting unit 202b (step S112). The determination unit 202c may be used as long as it estimates at least the age as an attribute of the detected person.

Next, the determination unit 202c determines whether or not the estimated age of the detection person is within the range of the target age (step S114). For example, in the case of an age limit in which a specific age is set as a threshold value, an age below the threshold value is outside the target age range, and an age above the threshold value is within the target age range, the determination unit 202c determines that the estimated age of the detected person is above the threshold value. It is possible to determine whether or not it is within the range of the target age.

When the determination unit 202c determines that the estimated age of the detected person is within the range of the target age (step S114, YES), the determination unit 202c determines that the detected person is an authorized target person who should be permitted to enter the store S. Determined to be an elderly person. In this case, the result processing unit 202d registers the determination result information of the detection person determined to be the estimated target age person who is the permission target person in the determination result information DB 206b (step S116).

The determination unit 202c extracts the appearance characteristics of the detected person from the person image acquired by the person detection unit 202b, and the detection person should be permitted to enter the store S based on the extracted appearance characteristics. It is also possible to determine whether or not the person is a person.

On the other hand, when the determination unit 202c determines that the estimated age of the detected person is out of the range of the target age (step S114, NO), the estimated target age person or the registered target age person who is a specific person accompanying the detected person. (Step S118).

For example, when a plurality of detected persons B2 and B3 are detected in the location image P2 as shown in FIG. 6, the determination unit 202c between the detected person B2 and another detected person B3 determined to be a specific person. Based on the distance, it is possible to determine the presence or absence of a specific person accompanying the detected person B2. More specifically, in the determination unit 202c, when the distance between the detection person B2 and the other detection person B3 is less than or equal to a predetermined distance, or when the detection person B2 and the other detection person B3 are in contact with each other. It can be determined that there is a specific person to accompany.

When the determination unit 202c determines that there is an estimated target age person or a registration target age person accompanying the detection person (step S120, YES), the determination unit 202c is a permission target person who should allow the detection person to enter the store S. judge. In this case, the result processing unit 202d registers the determination result information of the detection person determined to be the permission target person in the determination result information DB 206b because there is an estimated target age person or a registration target age person to accompany the person (step S116). ..

On the other hand, when the determination unit 202c determines that there is no specific person accompanying the detected person (step S120, NO), the determination unit 202c performs face matching for collating the face image of the detected person with a plurality of registered face images at a ratio of 1: N. (Step S122). The plurality of registered face images are face images of a plurality of registrants registered in the registrant information DB 206a.

In the registrant information DB 206a, as shown in FIG. 7, registrant information regarding each registrant is registered for each ID which is information that uniquely identifies each of the plurality of registrants. The registrant information registered in the registrant information DB 206a includes the registrant's ID, name, age, date of birth, contact information, image of the registrant, companion ID as companion information, and the like. The image relating to the registrant is at least one of the registrant's face image and person image. The face image is a face image acquired by the person detection unit 202b or a face image provided by the registrant. The person image is acquired by the person detection unit 202b. The companion ID is an ID included in the registrant information of a person who is a guardian or the like who can accompany a registration applicant who is an age outside the target age range and is registered in the registrant information DB 206a as a registration target age person. Is. Various information such as ID, name, age, date of birth, contact information, image, companion ID, etc. included in the registrant information are associated with each other.

At the time of face matching, the determination unit 202c can extract a face image as a registered face image from the registrant information of the registrant information DB 206a and collate the extracted registered face image with the face image of the detected person.

When a registered face image matching the face image of the detected person is found as a result of face matching, the determination unit 202c determines that the detected person corresponds to the registrant corresponding to the registrant information including the matched registered face image. (Step S124, YES).

On the other hand, if the face matching result does not find a registered face image that matches the face image of the detected person, the determination unit 202c determines that the detected person does not correspond to the registrant (step S124, NO). Further, the determination unit 202c determines that the detected person is an unauthorized person who should not be permitted to enter the store S.

When it is determined that the detected person does not correspond to the registrant and is an unauthorized person (step S124, NO), the result processing unit 202d outputs the determination result information of the detected person determined to be an unauthorized person. Register in the determination result information DB 206b (step S134). Further, in this case, the transmission unit 202e transmits a notification indicating that the unauthorized person has entered the store S to the store terminal 30 via the network NW (step S136). In addition, step S134 and step S136 may be executed at the same time regardless of each other's future.

Further, when the determination unit 202c determines that the detection person corresponds to the registrant (step S124, YES), is the age of the corresponding registrant who is the registrant determined to correspond to the detection person within the range of the target age? Whether or not it is determined (step S126). The determination unit 202c can obtain the age associated with the registered face image that matches the face image of the detected person as the age of the registrant by referring to the registrant information DB 206a.

When the determination unit 202c determines that the age of the registrant is within the range of the target age (step S126, YES), the determination unit 202c should allow the detection person determined to correspond to the registrant to enter the store S. It is determined that the person is a person of the age to be registered who is a person to be permitted. In this case, the result processing unit 202d registers the determination result information of the detection person determined to be the registration target age person who is the permission target person in the determination result information DB 206b (step S116).

On the other hand, when the determination unit 202c determines that the age of the relevant registrant is outside the range of the target age (step S126, NO), the determination unit 202c determines whether or not the registrant information of the relevant registrant includes accompanying information. (Step S128).

When the determination unit 202c determines that the registrant information of the registrant does not include the accompanying information (step S128, NO), the determination unit 202c determines that the detected person is a non-permitted person who should not be allowed to enter the store S. judge.

If the registrant information does not include companion information and it is determined that the detected person is an unauthorized person (step S128, NO), the result processing unit 202d determines the detected person who is determined to be an unauthorized person. The result information is registered in the determination result information DB 206b (step S134). Further, in this case, the transmission unit 202e transmits a notification indicating that the unauthorized person has entered the store S to the store terminal 30 via the network NW (step S136).

On the other hand, when the determination unit 202c determines that the registrant information of the corresponding registrant includes the companion information (step S128, YES), the determination unit 202c uses the companion information from among the permitted persons who are permitted to enter the store S. Search for a person of the age to be registered as a specified companion (step S130). The determination unit 202c performs face matching to match the face image of the registration target age person specified by the accompanying information with the face image of the permission target person registered in the determination result information DB 206b, thereby performing the registration target age person. Can be searched.

When the determination unit 202c finds the face image of the permission target person that matches the face image of the registration target age person specified by the companion information as a result of face matching (step S132, YES), the determination unit 202c as a companion to accompany the detected person. Judge that there is a person of the age to be registered. Further, when the determination unit 202c determines that there is a registration target age person as a companion accompanying the detection person, the determination unit 202c determines that the detection person is a permission target person who should be permitted to enter the store S. In this case, the result processing unit 202d registers the determination result information of the detection person determined to be the permission target person in the determination result information DB 206b because there is an accompanying registration target age person (step S116).

On the other hand, if the determination unit 202c does not find the face image of the permission target person that matches the face image of the registration target age person specified by the companion information as a result of the face matching (step S132, NO), the determination unit 202c accompanies the detection person. It is determined that there is no person of the age to be registered as a companion. Further, when the determination unit 202c determines that there is no registered target age person as a companion accompanying the detected person, the determination unit 202c determines that the detected person is a non-permitted target person who should not be permitted to enter the store S. ..

When it is determined that there is no accompanying registration target age person and the detected person is an unauthorized target person (step S132, NO), the result processing unit 202d determines the detected person determined to be an unauthorized target person. The result information is registered in the determination result information DB 206b (step S134). Further, in this case, the transmission unit 202e transmits a notification indicating that the unauthorized person has entered the store S to the store terminal 30 via the network NW (step S136).

In this way, for each of the detected persons detected in the place image taken by the surveillance camera 10, the determination server 20 determines whether the person is a permitted person or a non-permitted person as described above. The determination result information indicating the determination result is registered in the determination result information DB 206b.

As shown in FIG. 8, in the determination result information DB 206b, determination result information regarding each detection person is registered for each ID which is information that uniquely identifies each of the plurality of detection persons. The judgment result information registered in the judgment result information DB 206b includes the ID of the detected person, the judgment result indicating whether the person is a permitted person or a non-permitted person, the age, the shooting date and time of the detected person, and an image related to the detected person. , Includes information about companions, etc. The age is the age of the detected person estimated by the determination unit 202c or the age of the corresponding registrant determined to correspond to the detected person by the determination unit 202c. The image relating to the detected person is at least one of the person image and the face image of the detected person acquired by the person detection unit 202b. The information about the companion is an ID included in the determination result information of the detected person who is the estimated target age person or the registered target age person who accompanies the detected person outside the range of the target age. Various information such as ID, determination result, age, shooting date and time, image, and information about a companion included in the determination result information are associated with each other.

On the other hand, the store terminal 30 can receive a notification from the determination server 20 indicating that the unauthorized person has entered the store S, and can also accept the input of the registrant information by the clerk as necessary. It should be noted that the single store terminal 30 does not necessarily have to receive the notification and accept the input of the registrant information. The store terminal 30 that receives the notification and the store terminal 30 that receives the input of the registrant information may be separate terminals from each other.

As shown in FIG. 9, in the store terminal 30, the receiving unit 302a continuously determines whether or not the determination server 20 has transmitted a notification indicating that the unauthorized person has entered the store S (step S202). .. In this way, the receiving unit 302a waits until the notification is transmitted from the determination server 20 (step S202, NO).

When the receiving unit 302a determines that the determination server 20 has transmitted the notification indicating the entrance of the unauthorized person to the store S (steps S202, YES), the receiving unit 302a sends the notification indicating the entrance of the unauthorized person to the store S. Receive (step S204). The receiving unit 302a can receive the person information about the detected person included in the notification. The person information includes, for example, the shooting date and time of the detected person, the age estimated by the determination unit 202c or the age of the corresponding registrant, an image related to the detected person, and the like. The image relating to the detected person is at least one of the person image and the face image of the detected person acquired by the person detection unit 202b.

Next, the notification output unit 302b outputs a notification indicating the entrance of the unauthorized person to the store S received by the reception unit 302a to the display unit 310 and displays it on the display unit 310 (step S206). The notification output unit 302b can display a part or all of the person information included in the notification on the display unit 310 to the effect that the unauthorized person is trying to enter the store S or is entering the store S. .. The notification output unit 302b can display the person image or face image of the detected person determined to be the unauthorized target person on the display unit 310 as the person information. The notification output unit 302b can display the notification on the display unit 310, or instead, output the notification to a built-in or external speaker (not shown) to output the notification as a notification voice or a notification sound. ..

The clerk of the store S receives the notification indicating the entrance of the unauthorized person to the store S displayed on the display unit 310, and uses the person image or the face image displayed on the display unit 310 as a clue to be the object of the unauthorized person. It is possible to search for a detected person who has been determined to be a person. The clerk who finds the detected person can confirm whether or not the detected person is an unauthorized person by performing an age confirmation to confirm the age of the detected person by using an identification card or the like.

The clerk who confirmed the age of the detected person obtained personal information such as the name, age, date of birth, and contact information of the detected person from the detected person with the consent of the detected person. Personal information can be input to the store terminal 30 via the input unit 308.

The reception unit 302c determines whether or not the personal information of the detected person has been input by the clerk (step S208), and waits for the input of the personal information (step S208, NO).

When the reception unit 302c determines that the personal information of the detected person has been input by the clerk (step S208, YES), the reception unit 302c generates registrant information including the personal information (step S210). The reception unit 302c can generate registrant information including an ID that uniquely identifies the detected person, personal information of the detected person, a person image or a face image included in the notification received from the determination server 20.

Next, the transmission unit 302d transmits the registrant information generated by the reception unit 302c to the determination server 20 via the network NW (step S212).

In the determination server 20, the registration processing unit 202f registers the registrant information in the registrant information DB 206a every time the registrant information transmitted from the store terminal 30 is transmitted. In the registrant information DB 206a, registrant information including a combination of a face image and an age used as correct answer data for learning the age estimation model by the learning unit 202g is collected. Therefore, in the present embodiment, correct answer data can be easily prepared for learning the age estimation model.

As described above, according to the present embodiment, it is determined whether or not the detected person is a permitted person based on the place image taken by the surveillance camera 10 in consideration of factors other than the age of the presence or absence of a companion. .. Therefore, according to the present embodiment, it is possible to flexibly determine whether or not the detected person is a permitted person.

[Second Embodiment]
The information processing apparatus and the information processing method according to the second embodiment of the present invention will be described with reference to FIG. The same components as those of the information processing apparatus and the information processing method according to the first embodiment are designated by the same reference numerals, and the description thereof will be omitted or simplified.

Depending on the type of the store S, the range of the target age in the age limit provided in the store S may be changed according to the time zone in the business hours which is the available time. For example, of the business hours of store S from 10:00 to 22:00, the target age range of the time zone from 10:00 to 18:00 is all ages or 10 years or older, and the time zone from 18:00 to 22:00. The target age range is subject to change, such as 16 years or older.

The configuration of the target person determination system 1 according to the present embodiment is the same as that of the first embodiment. In the present embodiment, the determination unit 202c in the determination server 20 changes the target age range according to the time zone in response to the change according to the time zone of the target age range in the age limit provided in the store S. The case of doing so will be described.

In the present embodiment, the business hours of the store S are divided into two time zones, a first time zone and a second time zone following the first time zone, and the target age of the first time zone. The case where the range of is set to the first age range and the range of the target age of the second time zone is set to the second age range will be described. The lower limit of the second age range is higher than the lower limit of the first age range. For example, the business hours of store S are from 10:00 to 22:00, and the target age range of the first time zone from 10:00 to 18:00 is all ages, and the second from 18:00 to 22:00. The target age range for the time zone is 16 years or older.

The time zone for changing the target age range is not limited to two, and different target age ranges can be set according to the time zone for three or more different time zones. it can.

Hereinafter, the process of changing the range of the target age by the determination server 20 in the target person determination system 1 according to the present embodiment will be described with reference to FIG. FIG. 10 is a flowchart showing a target age range change process by the determination server 20 in the target person determination system 1 according to the present embodiment. The change process shown in FIG. 10 shall be started before the first time zone. When the determination server 20 operates, the information processing method according to the present embodiment is executed.

As shown in FIG. 10, in the determination server 20, the determination unit 202c acquires time information indicating the time from, for example, date and time information acquired from the system clock (step S302).

Next, the determination unit 202c determines whether or not the start time of the first time zone has arrived and the first time zone has started based on the acquired time information (step S304). When the determination unit 202c determines that the first time zone has not started (step S304, NO), the determination unit 202c shifts to step S304 and waits for the start of the first time zone.

When the determination unit 202c determines that the first time zone has started (step S304, YES), the determination unit 202c sets the target age range to the first age range (step S306).

In step S114 shown in FIG. 4, the determination unit 202c can determine whether or not the estimated age of the detected person is within the target age range, with the first age range as the target age range. Further, in step S126 shown in FIG. 4, the determination unit 202c can determine whether or not the age of the registrant is within the target age range, with the first age range as the target age range.

Subsequently, the determination unit 202c acquires time information indicating the time from the date and time information acquired from, for example, the system clock (step S308).

Next, the determination unit 202c determines whether or not the start time of the second time zone has arrived and the second time zone has started based on the acquired time information (step S310). When the determination unit 202c determines that the second time zone has not started (step S310, NO), the determination unit 202c proceeds to step S308 and waits for the start of the second time zone.

When the determination unit 202c determines that the second time zone has started (step S310, YES), the determination unit 202c sets the target age range to the second age range (step S312).

In step S114 shown in FIG. 4, the determination unit 202c can determine whether or not the estimated age of the detected person is within the target age range, with the second age range as the target age range. Further, in step S126 shown in FIG. 4, the determination unit 202c can determine whether or not the age of the registrant is within the target age range, with the second age range as the target age range.

In this way, the determination server 20 can change the range of the target age according to the time zone.

As described above, according to the present embodiment, since the range of the target age is changed according to the time zone, it is possible to flexibly determine whether or not the target person should be allowed to enter the store S.

[Third Embodiment]
The information processing apparatus and the information processing method according to the third embodiment of the present invention will be described with reference to FIGS. 11 and 12. The same components as those of the information processing apparatus and the information processing method according to the first and second embodiments are designated by the same reference numerals, and the description thereof will be omitted or simplified.

In the first embodiment, when the registrant information of the corresponding registrant corresponding to the detected person outside the range of the target age without a companion includes the companion information (step S128, YES), the companion specified by the companion information A person of the age to be registered as a person is searched (step S130). If a person of the age to be registered can be searched, or instead of the search, the person of the age to be registered who is the guardian of the detected person who is the protected person can be notified of the admission of the protected person without a companion. It helps to resolve the situation of a potential detective alone without a companion at an early stage.

The configuration of the target person determination system 1 according to the present embodiment is the same as that of the first embodiment. In the present embodiment, when a detected person outside the range of the target age without a companion is detected, the determination server 20 refers to the guardian terminal 50 of the registered target age person who is the guardian specified by the companion information. , A case of giving a notification indicating admission to the store S of a protected person without a companion will be described. In addition to the guardian terminal 50 used by the guardian, the target person determination system 1 is used for all notification destination terminals such as terminals used by the clerk of the store S, guardians and terminals used by persons other than the clerk. It can also be configured to give similar notifications. The notification destination terminal may be a mobile terminal carried and used by the user, or may be a stationary terminal installed at a specific place.

In the determination server 20, the transmission unit 202e is attached to the guardian terminal 50 of the registration target age person specified by the companion information included in the registrant information of the corresponding registrant corresponding to the detection person outside the target age range without a companion. In response, a notification is sent via the network NW. The registrant information of the registration target age person registered in the registrant information DB 206a includes the destination information for specifying the destination for transmitting the notification to the guardian terminal 50 used by the registration target age person. .. The transmission unit 202e can transmit a notification to the guardian terminal 50 by using the destination information included in the registrant information of the person to be registered.

The notification transmitted by the transmission unit 202e to the guardian terminal 50 indicates that the protected person without a companion has entered the store S. That is, the notification indicating the admission of the protected person without a companion to the store S is not accompanied by the detection person corresponding to the registered registrant including the companion information including the companion information of the person of the age to be registered. Indicates that you are about to enter the store S or you are entering the store S.

The transmission unit 202e can transmit a notification including personal information, which is information about the detected person, as a notification indicating that the protected person without a companion has entered the store S. The person information includes, for example, the shooting date and time of the detected person, the age of the registrant, an image related to the detected person, and the like. The image relating to the detected person is at least one of the person image and the face image of the detected person acquired by the person detection unit 202b.

Next, the configuration of the guardian terminal 50 will be described with reference to FIG. FIG. 11 is a block diagram showing the configuration of the guardian terminal 50 in the target person determination system 1 according to the present embodiment.

The guardian terminal 50 is an information processing device that receives notifications from the determination server 20, displays notifications, and the like. The guardian terminal 50 is an information processing device as a user terminal used by a guardian who is a registered target age person registered in the registrant information DB 206a. The guardian terminal 50 is, for example, a mobile terminal such as a smartphone or a tablet terminal.

As shown in FIG. 11, the guardian terminal 50 includes a CPU 502, a RAM 504, a storage unit 506, an input unit 508, a display unit 510, and a communication unit 512. The CPU 502, RAM 504, storage unit 506, input unit 508, display unit 510, and communication unit 512 are connected to the common bus 514.

The CPU 502 operates by executing the program stored in the storage unit 506, and functions as a control unit that controls the operation of the entire guardian terminal 50. Further, the CPU 502 executes the program stored in the storage unit 506 to execute various processes as the guardian terminal 50. The RAM 504 provides a memory area required for the operation of the CPU 502.

More specifically, the CPU 502 functions as a receiving unit 502a and a notification output unit 502b by executing the program. As a program, the CPU 502 executes an application program for receiving a notification from the store S.

When the determination server 20 transmits a notification indicating that the protected person without a companion has entered the store S, the receiving unit 502a receives a notification indicating that the protected person without a companion has entered the store S. .. The receiving unit 502a can receive the person information about the detected person included in the notification.

The notification output unit 502b outputs the notification indicating the entrance of the protected person without a companion to the store S received by the reception unit 502a to the display unit 510 and displays it on the display unit 510. When displaying the notification on the display unit 510, the notification output unit 502b indicates that the protected person is trying to enter the store S or is entering the store S without a companion, or a part of the person information included in the notification or All etc. can be displayed. The notification output unit 502b can display, for example, a person image or a face image of a detected person who is a protected person on the display unit 510 as person information. The notification output unit 502b displays the notification on the display unit 510 in a display mode such as display in the program, pop-up display, display in the notification area, etc. via the application program installed in the parent terminal 50, for example. Can be made to.

Further, the notification output unit 502b can display the notification on the display unit 510, or instead, output the notification to a built-in speaker (not shown) or the like to output the notification as a notification voice or a notification sound. For example, the notification output unit 502b can output a notification voice or a notification sound indicating that the unauthorized person is about to enter the store S or is entering the store S from the speaker.

The storage unit 506 is composed of a storage medium such as a flash memory or a non-volatile memory such as a hard disk drive. The storage unit 506 stores a program executed by the CPU 502, data referred to by the CPU 502 when the program is executed, and the like. For example, the storage unit 506 can store the notification or the like received by the reception unit 502a.

The input unit 508 accepts input operations such as information and instructions from the guardian to the guardian terminal 50. The guardian can input various information or an instruction to execute the process to the guardian terminal 50 via the input unit 508. The input unit 508 is composed of, for example, a touch panel incorporated in the display unit 510.

The display unit 510 displays various screens such as a program execution screen according to the control by the CPU 502. More specifically, the display unit 510 displays a notification screen or the like that displays the notification received from the determination server 20. The display unit 510 is composed of, for example, a liquid crystal display, an OLED display, or the like. The display unit 510 is configured as a touch panel display together with the input unit 508, for example.

The communication unit 512 communicates with an external device such as the determination server 20 via the network NW under the control of the CPU 502. The communication standard, method, etc. of the communication unit 512 are not particularly limited, and may be a wireless method or a wired method.

In this way, the guardian terminal 50 is configured.

Next, the operations of the determination server 20 and the guardian terminal 50 in the target person determination system 1 according to the present embodiment will be further described with reference to FIG. FIG. 12 is a flowchart showing the operation of the guardian terminal 50 in the target person determination system 1 according to the present embodiment. When the determination server 20 and the guardian terminal 50 operate, the information processing method according to the present embodiment is executed.

In the present embodiment, the determination server 20 operates in substantially the same manner as in the case of the first embodiment shown in FIG. In this embodiment as well, the determination server 20 can change the range of the target age according to the time zone as in the second embodiment. In the present embodiment, further, when the companion information is included in the registrant information of the corresponding registrant corresponding to the detected person outside the range of the target age without a companion (step S128, YES), the transmission unit 202e Notifies the protected person without a companion to enter the store S.

The transmission unit 202e is a network NW for the guardian terminal 50 of the registration target age person specified by the companion information included in the registrant information of the corresponding registrant corresponding to the detection person outside the range of the target age without a companion. A notification indicating admission to the store S of the protected person without a companion is transmitted via. The transmission unit 202e can transmit a notification including personal information, which is information about the detected person, as a notification indicating that the protected person without a companion has entered the store S.

On the other hand, the guardian terminal 50 can receive a notification from the determination server 20 indicating that the protected person without a companion has entered the store S.

As shown in FIG. 12, in the guardian terminal 50, the receiving unit 502a continuously determines whether or not the determination server 20 has transmitted a notification indicating admission of the protected person without a companion to the store S ( Step S402). In this way, the receiving unit 502a waits until the notification is transmitted from the determination server 20 (step S402, NO).

When the receiving unit 502a determines that the determination server 20 has transmitted a notification indicating admission to the store S of the protected person without a companion (steps S402, YES), the receiving unit 502a enters the store S of the protected person without a companion. (Step S404). The receiving unit 502a can receive the person information about the detected person included in the notification. The person information includes, for example, the shooting date and time of the detected person, the age of the registrant, an image related to the detected person, and the like. The image relating to the detected person is at least one of the person image and the face image of the detected person acquired by the person detection unit 202b.

Next, the notification output unit 502b outputs the notification indicating the entrance of the protected person without a companion to the store S received by the reception unit 502a to the display unit 510 and displays it on the display unit 510 (step S406). The notification output unit 502b can display a part or all of the person information included in the notification on the display unit 510 to the effect that the protected person is about to enter the store S or has entered the store S. The notification output unit 502b can display a person image or a face image of the detected person on the display unit 510 as the person information. The notification output unit 502b can display the notification on the display unit 510, or instead, output the notification to a built-in speaker (not shown) or the like to output the notification as a notification voice or a notification sound.

The registration target age person who is the guardian who received the notification from the determination server 20 on the guardian terminal 50 can search for the detected person who is the protected person by receiving the notification displayed on the display unit 510. ..

As in the present embodiment, in addition to notifying the store terminal 30, it is also possible to notify the guardian terminal 50.

In addition, the guardian of the relative who uses the guardian terminal 50 registers the protected person such as the child in the registrant information DB 206a even when the store S is a facility that the protected person such as the child does not want to enter and exit. Can be done. In this case, the determination server 20 refers to the guardian terminal 50 of the guardian who does not necessarily enter the store S when the protected person is detected alone as the detected person in the place image. Notification can be given in the same manner as above.

According to the present embodiment, by notifying the guardian terminal 50 of the admission of the protected person, it is possible to provide the guardian with a service including a watching function for watching the behavior of the protected person.

[Other Embodiments]
According to another embodiment, the information processing apparatus described in the above embodiment can also be configured as shown in FIG. FIG. 13 is a block diagram showing a configuration of an information processing apparatus according to another embodiment.

As shown in FIG. 13, the information processing apparatus 1000 according to another embodiment has an image acquisition unit 1002 for acquiring a place image and a person detection unit 1004 for detecting a person included in the place image. In addition, the information processing device 1000 has a determination unit 1006 that determines whether or not a person is a target person based on the attributes and location images of the person.

According to the information processing apparatus 1000 according to another embodiment, since it is determined whether or not the person is the target person based on the attribute and the place image of the person, it is possible to flexibly determine whether or not the person is the target person. ..

[Modification Embodiment]
The present invention is not limited to the above embodiment, and various modifications are possible.

For example, in the above embodiment, the case of determining whether or not the person is the authorized person who should be permitted to enter the store S has been described as an example, but the present invention is not limited to this. In addition to entering the store S, the determination server 20 can determine whether or not the person is a target person who should be permitted to perform various acts with restrictions according to the attributes of the person such as age.

Further, in the above embodiment, the case of determining whether or not the person is a licensed person based on the age as an attribute of the person has been described as an example, but the present invention is not limited to this. The determination server 20 can determine whether or not the person is a licensed person based on various attributes of the person in addition to the age.

In addition, the first to third embodiments can be carried out in combination in any manner, or can be carried out individually.

Further, there is also a processing method in which a program for operating the configuration of the embodiment is recorded on a recording medium so as to realize the functions of the above-described embodiments, the program recorded on the recording medium is read out as a code, and the program is executed by a computer. It is included in the category of each embodiment. That is, a computer-readable recording medium is also included in the scope of each embodiment. Further, not only the recording medium on which the above-mentioned computer program is recorded, but also the computer program itself is included in each embodiment.

As the recording medium, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a non-volatile memory card, or a ROM can be used. In addition, the program recorded on the recording medium is not limited to the one that executes the process by itself, and operates on the OS (Operating System) to execute the process in cooperation with other software and the functions of the expansion board. Those are also included in the category of each embodiment.

Some or all of the above embodiments may also be described, but not limited to:

(Appendix 1)
The image acquisition unit that acquires the location image and
A person detection unit that detects a person included in the location image,
An information processing device having a determination unit that determines whether or not the person is a target person based on the attributes of the person and the location image.

(Appendix 2)
The determination unit estimates the age of the person as an attribute of the person, and if the estimated age of the person is within the range of the target age, the determination unit determines that the person is the target person. Information processing equipment.

(Appendix 3)
The information processing device according to Appendix 2, wherein the determination unit determines that the person is the target person when the registered age of the person is within the range of the target age.

(Appendix 4)
The information processing device according to Appendix 2 or 3, wherein the determination unit changes the range of the target age according to a time zone.

(Appendix 5)
The determination unit determines whether or not there is a companion who accompanies the person based on the location image, and determines whether or not the person is the target person based on the presence or absence of the companion. The information processing device described.

(Appendix 6)
The information processing according to Appendix 5 for determining the presence or absence of a companion based on the positional relationship between the person detected in the place image and another person detected in the place image. apparatus.

(Appendix 7)
The information processing device according to any one of Supplementary note 1 to 6, wherein the determination unit determines whether or not the person is the target person based on the registered information about the companion accompanying the person.

(Appendix 8)
The information processing device according to any one of Supplementary note 1 to 7, wherein the determination unit determines whether or not the person is the target person based on the information extracted from the location image.

(Appendix 9)
The information processing device according to Appendix 8, wherein the information extracted from the place image is information on the appearance characteristics of the person.

(Appendix 10)
The information processing device according to any one of Supplementary note 1 to 8, which has a notification unit for notifying the result of determination by the determination unit.

(Appendix 11)
Get the location image,
Detecting the person included in the place image,
An information processing method for determining whether or not a person is a target person based on the attributes of the person and the location image.

(Appendix 12)
On the computer
Get the location image,
Detecting the person included in the place image,
A program for determining whether or not a person is a target person based on the attributes of the person and the location image.

(Appendix 13)
Including a photographing device, an information processing device, and a terminal,
The imaging device captures a specific location and outputs a location image.
The information processing device
An image acquisition unit that acquires the location image and
A person detection unit that detects a person included in the location image,
A determination unit that determines whether or not the person is a target person based on the attributes of the person and the location image, and
It has a notification unit that notifies the result of the determination by the determination unit.
The terminal is an information processing system that receives notifications from the notification unit.

1 ... Target person judgment system 10 ... Surveillance camera 20 ... Judgment server 30 ... Store terminal 40 ... Notification device 50 ... Parent terminal

Claims (10)

The image acquisition unit that acquires the location image and
A person detection unit that detects a person included in the location image,
An information processing device having a determination unit that determines whether or not the person is a target person based on the attributes of the person and the location image. The determination unit estimates the age of the person as an attribute of the person, and determines that the person is the target person when the estimated age of the person is within the range of the target age. The information processing device described. The information processing device according to claim 2, wherein the determination unit determines that the person is the target person when the registered age of the person is within the range of the target age. The information processing device according to claim 2 or 3, wherein the determination unit changes the range of the target age according to a time zone. The determination unit determines whether or not there is a companion who accompanies the person based on the location image, and determines whether or not the person is the target person based on the presence or absence of the companion. The information processing device according to item 1. The information according to claim 5, wherein the determination unit determines the presence or absence of the companion based on the positional relationship between the person detected in the place image and another person detected in the place image. Processing equipment. The information processing device according to any one of claims 1 to 6, wherein the determination unit determines whether or not the person is the target person based on the registered information about the companion accompanying the person. The information processing device according to any one of claims 1 to 7, wherein the determination unit determines whether or not the person is the target person based on the information extracted from the place image. Get the location image,
Detecting the person included in the place image,
An information processing method for determining whether or not a person is a target person based on the attributes of the person and the location image. On the computer
Get the location image,
Detecting the person included in the place image,
A program for determining whether or not a person is a target person based on the attributes of the person and the location image.