JP2023035068A - Information processing apparatus, information processing method, and information processing program - Google Patents

Abstract

To provide an information processing apparatus, an information processing method, and an information processing program that do not recognize a user as an authority holder if the user is an authority non-holder.SOLUTION: In an information processing system, a software configuration of an information processing apparatus 1 comprises: an acquisition unit 11 for acquiring medium information stored in a medium and acquiring biometric information and attribute information from a user; a feature data extraction unit 112 for extracting input feature data from the biometric information; an attribute data extraction unit 113 for extracting input attribute data from the attribute information; and an output control unit 114 for comparing registered feature data and the input feature data stored in the storage unit 12, and registered attribute data and the input attribute data stored in the storage unit 12, respectively, determining whether or not authorization information included in the medium information satisfies a predetermined condition and whether or not the collation result is collation match, and outputting information indicating that the user is an authorized person if the authorization information included in the medium information satisfies the predetermined condition and the collation result is collation match.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

When a user is provided with some kind of service, it is necessary to confirm whether the user is really a qualified person who can use the service. For example, when using a ticket with a discounted fee as such a service, it is necessary to confirm whether the user is a discount holder.

For example, Cited Document 1 discloses a technique of acquiring a face image of a user and confirming whether the user is a discount qualification holder using information such as age and gender extracted from the face image information. ing.

Japanese Patent No. 6567369

However, if the user resembles the discount qualification holder because the user is a relative, etc., the user is judged to be the discount qualification holder and the discount ticket is issued even though the user is not the discount qualification holder. There were cases where it was possible to use

The subject of this invention has been made in view of the above circumstances, and its purpose is to provide an authority that the user who uses the authority including the service such as discount is not the authority holder including the service qualification holder. To provide a technique for not recognizing that a non-holder is an authority holder.

One aspect of the present invention to solve the above problems is an information processing apparatus comprising: an acquisition unit that acquires medium information stored in a medium, and acquires biometric information and attribute information from a user who uses the medium; a feature data extraction unit for extracting input feature data that is significant data for identifying the user from the biometric information; and attribute data for extracting input attribute data representing attributes to which the user belongs from the attribute information. An extraction unit compares registered feature data stored in a storage unit with the input feature data, and registered attribute data stored in the storage unit with the input attribute data, and performs matching according to the comparison result. Alternatively, a comparison unit that outputs a collation result including collation mismatch, a determination unit that determines whether the authorization information included in the medium information satisfies a predetermined condition and whether the collation result is a collation match, and the medium information and an output unit for outputting information indicating that the user is an authorized person when the authority information included in the above satisfies the predetermined condition and the collation result is matching. is.

FIG. 1 is a diagram illustrating an example of an information processing system according to the first embodiment. FIG. 2 is a block diagram showing the software configuration of the information processing apparatus in advance preparation of the first embodiment in association with the hardware configuration shown in FIG. FIG. 3 is a flow chart showing an example of the preparatory processing operation of the information processing apparatus. FIG. 4 is a block diagram showing the software configuration of the information processing apparatus in the authority determination process of the first embodiment in association with the hardware configuration shown in FIG. FIG. 5 is a flow chart showing an example of the authority determination processing operation of the information processing apparatus. FIG. 6 is a block diagram showing the software configuration of the information processing apparatus in the authority determination process of the second embodiment in association with the hardware configuration shown in FIG. FIG. 7 is a flow chart showing an example of the authority determination processing operation of the information processing device.

Embodiments according to the present invention will be described below with reference to the drawings. Elements that are the same as or similar to elements that have already been explained are denoted by the same or similar reference numerals, and overlapping explanations are basically omitted.

[First embodiment]
(composition)
FIG. 1 is a diagram illustrating an example of an information processing system according to the first embodiment.
The information processing system also includes an information processing device 1 , an input device 2 , an output device 3 , a biological information acquisition device 4 , an attribute information acquisition device 5 and a medium 6 .

FIG. 1 also shows an example of the hardware configuration of the information processing apparatus 1. As shown in FIG. The information processing device 1 is realized by a computer such as a PC (Personal Computer). The information processing device 1 includes a control unit 11 , a storage unit 12 and an input/output interface 13 . The control unit 11, the storage unit 12, and the input/output interface 13 are communicably connected to each other via a bus.

The control unit 11 controls the information processing device 1 . The control unit 11 includes a hardware processor such as a central processing unit (CPU).

The storage unit 12 is a storage medium. The storage unit 12 includes, for example, a non-volatile memory such as a HDD (Hard Disk Drive) or SSD (Solid State Drive) that can be written and read at any time, a non-volatile memory such as a ROM (Read Only Memory), and a RAM (Random Access Memory). ) and other volatile memories. The storage unit 12 has a program storage area and a data storage area in its storage area. The program storage area stores an OS (Operating System), middleware, and application programs necessary for executing various processes.

The input/output interface 13 is an interface that enables transmission and reception of information between the input device 2 , the output device 3 , the biometric information acquisition device 4 and the attribute information acquisition device 5 . The input/output interface 13 may comprise a wired or wireless communication interface. That is, the information processing device 1, the input device 2, the output device 3, the biometric information acquisition device 4, and the attribute information acquisition device 5 may transmit and receive information via a network such as a LAN or the Internet. Note that the example shown in FIG. 1 is only an example, and the input device 2, the output device 3, the biometric information acquisition device 4, and the attribute information acquisition device 5 may of course be arranged in the information processing device 1. is.

Further, when the information processing apparatus 1 is a gate apparatus such as an automatic ticket gate, it is of course possible to include a gate or the like for physically blocking the passage of the user.

The medium 6 is an IC card, a QR code (registered trademark) card, a mobile terminal, or the like. The medium 6 is capable of transmitting/receiving medium information including identification information and authorization information to/from the input device 2 . Here, the identification information is information for identifying the medium 6, and the authority information is information indicating authority. The authority indicates that the user has the right to receive the prescribed service. For example, the authority information includes information such as whether the user of the medium 6 can receive a discount, can charge, or can pass through a specific lane. Note that the authority information may include information indicating that it is possible to receive services within a specific range. For example, the authority information may be information such as from what time to what time it is possible to receive a discount. That is, the authority information includes information indicating that the user can receive a predetermined service or information indicating that the user can receive a predetermined service within a specific range.

Input device 2 includes a reader capable of obtaining medium information from medium 6 . The reader may be, for example, an IC card reader, a QR code reader, an NFC (Near Field Communication) reader, or the like, which can acquire medium information wirelessly or optically. For example, the input device 2 acquires medium information from the medium 6 when the user holds the medium 6 over a predetermined reader. Then, the input device 2 outputs the medium information and the date/time information including the date and time when the medium information was acquired to the information processing apparatus 1 . Furthermore, the input device 2 may include a keyboard, pointing device, etc. for the user to input various information. The input device 2 may also include a reader for reading data to be stored in the storage unit 12 from a memory medium such as a USB memory, or a disk device for reading such data from a disk medium.

The output device 3 includes a display that displays output data to be presented to the user from the information processing device 1 . The output device 3 also includes a writer for writing data to be input to another information processing device 1 such as a PC or a smart phone into a memory medium such as a USB memory, or a disk drive for writing such data to a disk medium. may include equipment.

The biometric information acquisition device 4 includes a camera, a fingerprint sensor, a vein sensor, an iris sensor, a microphone, and the like for acquiring biometric information from the user holding the medium 6 . Here, biometric information is information that can identify a user using a part of the user such as face, fingerprint, vein, iris, voice, or similar. The biometric information acquisition device 4 can acquire fingerprint information, which is biometric information, by touching a fingerprint sensor with a user's finger, for example. The biometric information acquisition device 4 can output the biometric information and the date and time of acquisition of the biometric information to the information processing device 1 . Further, the biometric information acquisition device 4 may include a storage unit that stores the date and time of acquisition and the biometric information. Furthermore, the biometric information acquisition device 4 may acquire the biometric information multiple times in time series. Note that the biometric information acquisition device 4 is not limited to these, and any device that can acquire biometric information may be used as a matter of course.

The attribute information acquisition device 5 includes a camera, a distance sensor, etc. for acquiring user attribute information. Here, the attribute information is information representing attributes belonging to the user that can be acquired from the appearance of the user, for example, information including age, sex, height, etc. of the user. The attribute information acquisition device 5 acquires, as attribute information, for example, a photographed image of the user's face captured by a camera, a photographed image of the user's whole body captured by the whole body, or a three-dimensional position of the user's head using a distance sensor. is possible. Then, the attribute information acquisition device 5 can output the attribute information and the date and time of acquisition of the attribute information to the information processing device 1 . Also, the attribute information acquisition device 5 may include a storage unit that stores the date and time of acquisition and the attribute information. Note that the attribute information acquisition device 5 is not limited to these, and any device may be used as long as it is capable of acquiring attribute information.

·Advance preparation
In the first embodiment, the information processing apparatus 1 needs to obtain various pieces of information in advance in order to determine whether the user is an authority holder. The configuration and operation of the information processing apparatus 1 in advance preparation will be described below.

(Software configuration in preparation)
FIG. 2 is a block diagram showing the software configuration of the information processing apparatus 1 in advance preparation of the first embodiment in association with the hardware configuration shown in FIG.
The storage unit 12 includes an acquired data storage unit 121 and an extracted data storage unit 122 .

The acquired data storage unit 121 stores acquired data acquired by the acquiring unit 111 described later of the control unit 11 . Acquired data will be described later.

The extracted data storage unit 122 stores data extracted by the feature data extraction unit 112 and the attribute data extraction unit 113 of the control unit 11, which will be described later. Note that the extracted data will be described later.

The control unit 11 includes an acquisition unit 111 , a feature data extraction unit 112 , an attribute data extraction unit 113 and an output control unit 114 . These functional units are implemented by the hardware processor executing application programs stored in the storage unit 12 .

Acquisition unit 111 includes medium information acquisition unit 1111 , biometric information acquisition unit 1112 , and attribute information acquisition unit 1113 .

The medium information acquisition unit 1111 acquires medium information and date/time information received from the input device 2 . The medium information acquisition unit 1111 outputs the identification information and date/time information included in the acquired medium information to the biometric information acquisition unit 1112 and the attribute information acquisition unit 1113 . Furthermore, the medium information acquisition unit 1111 may cause the acquired data storage unit 121 to store the medium information and the date and time information.

The biometric information acquisition unit 1112 acquires the biometric information received from the biometric information acquisition device 4 . The biometric information acquisition unit 1112 outputs the acquired biometric information and identification information to the feature data extraction unit 112 . Further, the biometric information acquisition unit 1112 may request biometric information of the date and time corresponding to the date and time information received from the medium information acquisition unit 1111 and acquire the biometric information. Note that the biometric information acquisition unit 1112 may store the acquired biometric information in the acquired data storage unit 121 .

The attribute information acquisition unit 1113 acquires attribute information received from the attribute information acquisition device 5 . The attribute information acquisition section 1113 outputs the acquired attribute information and identification information to the attribute data extraction section 113 . Note that the attribute information acquisition unit 1113 may cause the acquired data storage unit 121 to store the acquired attribute information and identification information.

A feature data extraction unit 112 extracts feature data that is significant for identifying a user from biometric information. The feature data extraction unit 112 extracts feature data from biometric information using a feature extraction filter algorithm, a feature extraction neural network algorithm, or the like. The feature data extraction unit 112 may extract feature data from biometric information by using a combination of these algorithms. Further, when there is a plurality of biometric information, the feature data extraction unit 112 selects one or a plurality of biometric information based on conditions such as data stability and low noise among the plurality of biometric information, Feature data may be extracted using the selected biometric information. Furthermore, the feature data to be extracted is not limited to one, and the feature data extraction unit 112 may extract a plurality of feature data from one or a plurality of pieces of biometric information. The feature data extraction unit 112 associates the extracted feature data with the identification information of the medium information acquired by the medium information acquisition unit 1111 . Then, the feature data extraction unit 112 stores the feature data associated with the identification information in the extraction data storage unit 122 as registered feature data.

The attribute data extraction unit 113 extracts attribute data, which is the personal attribute of the user, from the attribute information. For example, the user's age and sex are extracted as personal attributes from the face image included in the attribute information acquired from the attribute information acquisition device 5 . The attribute data extraction unit 113 extracts attribute data from the attribute information using, for example, a filter algorithm for attribute feature extraction, a neural network algorithm for attribute feature extraction, or the like. The attribute data extraction unit 113 may extract attribute data from attribute information by using a combination of these algorithms. Also, the height of the user may be used as the personal attribute. In this case, the attribute data extraction unit 113 obtains the height of the user from the whole-body photographed image included in the attribute information. The attribute data extracting unit 113 detects, for example, the position of a specific part (parietal region, eyes and nose position, etc.) in the input image on the image plane, and compares the position in the two-dimensional image obtained in advance with the height. Height is calculated by converting according to the correspondence table. Alternatively, the attribute data extraction unit 113 may estimate the height from the three-dimensional position of the user's head measured by a distance sensor. Note that the attribute data extraction unit 113 may estimate the age and height within a certain range. For example, the age of the user may be estimated as being in their teens, or as being in their early twenties, mid-twenties, late twenties, or the like. Similarly, when estimating the height, the attribute data extraction unit 113 may estimate the height to be around 160 cm, or may estimate it to be the first half of 170 cm, the middle of 170 cm, and the latter half of 170 cm. Of course, these widths may be determined arbitrarily.

The attribute data extraction unit 113 associates the extracted attribute data with identification information. Then, the attribute data extraction unit 113 causes the extraction data storage unit 122 to store the attribute data associated with the identification information. The attribute data extraction unit 113 may store the attribute data including date and time information in the extraction data storage unit 122 .

Further, when various data are stored in the extracted data storage unit 122 , the output control unit 114 may output information to the effect that preparation has been completed to the output device 3 via the input/output interface 13 .

(Advance preparation processing operation)
FIG. 3 is a flowchart showing an example of the preparatory processing operation of the information processing apparatus 1. As shown in FIG.
The operation of this flow chart is realized by the control unit 11 of the information processing device 1 reading out and executing the program stored in the storage unit 12 .

The operation starts when the input device 2 acquires the medium information of the medium 6 . It should be noted that the operation may be started by the user performing an operation to the input device 2 indicating that he or she wishes to make advance preparations. In this case, the output device 3 prompts the user to hold the medium 6 over a predetermined position of the input device 2 , and the input device 2 acquires the medium information of the medium 6 .

The medium information acquisition unit 1111 acquires medium information and date/time information from the input device 2 through the input/output interface 13 (step ST11). The medium information includes identification information and authorization information of the medium 6 . The medium information acquisition unit 1111 may cause the acquired data storage unit 121 to store the medium information and the date and time information. The medium information acquisition unit 1111 also outputs the identification information and date/time information included in the medium information to the biometric information acquisition unit 1112 and the attribute information acquisition unit 1113 .

The biometric information acquisition unit 1112 acquires biometric information from the biometric information acquisition device 4 through the input/output interface 13 (step ST12). The biometric information acquisition unit 1112 receives the biometric information transmitted from the biometric information acquisition device 4 . Alternatively, the biometric information acquisition unit 1112 outputs a request for acquiring biometric information corresponding to the date and time information received from the medium information acquisition unit 1111 to the biometric information acquisition device 4, and acquires the biometric information from the biometric information acquisition device 4. You can make it work. For example, the biometric information acquisition unit 1112 may acquire biometric information corresponding to date and time information in chronological order. That is, the biometric information acquisition unit 1112 may acquire a plurality of biometric information. Also, the biometric information acquisition unit 1112 may acquire a plurality of types of biometric information. For example, the biometric information acquisition unit 1112 may acquire fingerprint data and iris data as biometric information. The biometric information acquisition unit 1112 outputs the acquired biometric information, identification information, and date/time information to the feature data extraction unit 112 . Here, a plurality of biometric information described below means a plurality of single types of biometric information, a plurality of types of biometric information, or both of these biometric information. The biometric information acquisition unit 1112 outputs the acquired biometric information, identification information, and date/time information to the feature data extraction unit 112 . Note that the biometric information acquisition unit 1112 may associate the acquired biometric information with the identification information and store it in the acquired data storage unit 121 .

The feature data extraction unit 112 extracts feature data based on the biometric information (step ST13). Here, the feature data is data that is significant for identifying the user. For example, the feature data extraction unit 112 extracts feature data from biometric information using a feature extraction filter algorithm, a feature extraction neural network algorithm, or the like. The feature data extraction unit 112 extracts one or more feature data from one or more pieces of biometric information. That is, the feature data extraction unit 112 may extract one or more feature data from one piece of biometric information, or may extract one or more feature data from a plurality of pieces of biometric information.

The feature data extraction unit 112 associates the extracted feature data with identification information. Then, the feature data extraction unit 112 stores the feature data associated with the identification information in the extraction data storage unit 122 as registered feature data. The feature data extraction unit 112 may include the date and time information in the registered feature data and store it in the extraction data storage unit 122 . It goes without saying that the feature data extraction unit 112 may use the biometric information stored in the acquired data storage unit 121 instead of using the biometric information received from the biometric information acquisition unit 1112 .

The attribute information acquisition unit 1113 acquires attribute information from the attribute information acquisition device 5 through the input/output interface 13 (step ST14). The attribute information acquisition unit 1113 receives attribute information transmitted from the attribute information acquisition device 5 . Alternatively, the attribute information acquisition unit 1113 may transmit a request for acquiring medium information corresponding to the date and time information received from the medium information acquisition unit 1111 to the attribute information acquisition device 5 to acquire attribute information. . For example, the attribute information acquisition unit 1113 may acquire attribute information corresponding to the date and time of the date and time information in chronological order. That is, the attribute information acquisition unit 1113 may acquire a plurality of pieces of attribute information. Also, the attribute information acquisition unit 1113 may acquire multiple types of attribute information. For example, the attribute information acquisition unit 1113 may acquire a face image and a whole body image as attribute information. Here, a plurality of pieces of attribute information described below means a plurality of single types of attribute information, a plurality of types of biometric information, or both of these types of attribute information. The attribute information acquisition unit 1113 outputs the acquired attribute information, identification information, and date/time information to the attribute data extraction unit 113 . Note that the attribute information acquisition unit 1113 may store the acquired attribute information in the acquired data storage unit 121 in association with the identification information.

The attribute data extraction unit 113 extracts attribute data based on the attribute information (step ST15). Here, the attribute data is data representing attributes of the user. The attribute data extraction unit 113 extracts attribute data from the attribute information using, for example, a filter algorithm for attribute feature extraction, a neural network algorithm for attribute feature extraction, or the like. The attribute data extraction unit 113 extracts one or more pieces of attribute data from one or more pieces of attribute information. That is, the attribute data extraction unit 113 may extract one or more attribute data from one piece of attribute information, or may extract one or more attribute data from more than one piece of attribute information.

The attribute data extraction unit 113 associates the extracted attribute data with identification information. Then, the attribute data extraction unit 113 causes the extracted data storage unit 122 to store the attribute data associated with the identification information as registered attribute data. The attribute data extraction unit 113 may store the registration attribute data including the date and time information in the extraction data storage unit 122 . It goes without saying that the attribute data extraction unit 113 may use the attribute information stored in the acquired data storage unit 121 instead of using the attribute information received from the attribute information acquisition unit 1113 .

Further, when the registered feature data and the registered attribute data are stored in the extracted data storage unit 122, the output control unit 114 outputs information to the effect that preparation has been completed to the output device 3 via the input/output interface 13. , may be communicated to the user.

It should be noted that step A0 combining steps ST12 and ST13 and step B0 combining steps ST14 and ST15 may be performed in any order. That is, step A0 and step B0 are interchangeable and may be processed in parallel.

By the above preprocessing operation, necessary data is stored in the storage unit 12, and the information processing apparatus 1 can determine whether or not the user is an authorized person.

・Authority judgment processing
Next, in the first embodiment, the configuration and operation of the information processing apparatus 1 for determining whether or not the user is an authorized person will be described. Here, the information processing device 1 that performs the preparation operation and the information processing device 1 that performs the authority determination processing operation may be the same or different devices. If the devices are different, the information stored in the storage unit 12 in the preparation operation is transmitted to the information processing device 1 that performs the authority determination processing via a network or the like, and is sent to the storage unit 12 of the information processing device 1 that performs the authority determination processing operation. It suffices if the information is stored. For example, it may be the ticket vending machine that performs the preparation operation, and the ticket gate that performs the authority determination processing operation.

(Software configuration for authority determination processing)
FIG. 4 is a block diagram showing the software configuration of the information processing apparatus 1 in the authority determination process of the first embodiment in association with the hardware configuration shown in FIG.
The control unit 11 further includes a feature data comparison unit 115, an attribute data comparison unit 116, an authority determination unit 117, and an authority holder determination unit 118 in addition to the units described in the preparation. These functional units are implemented by the hardware processor executing application programs stored in the storage unit 12 .

Moreover, the storage unit 12 further includes a condition storage unit 123 in addition to the units described in the preparation.

The condition storage unit 123 stores conditions under which the user can receive a discount or the like. Note that the conditions are stored in the condition storage unit 123 in advance by an administrator or the like who manages the information processing apparatus 1 .

The medium information acquisition unit 1111 receives medium information and date/time information from the biometric information acquisition device 4 and outputs identification information and date/time information included in the medium information to the biometric information acquisition unit 1112 and the attribute information acquisition unit 1113 . Furthermore, the medium information acquisition unit 1111 outputs the authority information and the date/time information to the authority determination unit 117 .

The feature data extraction unit 112 extracts feature data from the biometric information in the same manner as in advance preparation. Then, feature data extraction section 112 associates the extracted feature information with the identification information and outputs them to feature data comparison section 115 as input feature data.

The attribute data extraction unit 113 extracts attribute data from the attribute information in the same manner as in advance preparation. Then, attribute data extraction section 113 outputs the extracted attribute data to attribute data comparison section 116 as input attribute data.

The feature data comparison unit 115 compares the input feature data with registered feature data stored in the extraction data storage unit 122 . For example, the feature data comparison unit 115 obtains a distance measure such as Euclidean distance, Mahalanobis distance, block distance, etc., or a similarity measure such as Cosine similarity, in order to compare the input feature data and the registered feature data. Then, the feature data comparison unit 115 compares the obtained scale with a preset threshold to determine whether the input feature data and the registered feature data match or disagree with each other. Further, when a plurality of pieces of input feature data are received from the feature data extraction unit 112, the feature data comparison unit 115 compares each of the input feature data with the registered feature data, and statistically processes the comparison results. , matching or non-matching between the input feature data and the registered feature data. Here, the statistical processing may be processing using, for example, the average distance or similarity, the mode, the minimum distance, the maximum similarity, or the like.

Furthermore, the feature data comparison unit 115 outputs the comparison result to the authority holder determination unit 118 as the authority holder verification result. Note that the authority holder matching result may include a similarity index indicating the degree of matching (distance scale or similarity scale) instead of only matching or mismatching.

The attribute data comparison unit 116 compares input attribute data with registered attribute data stored in the extracted data storage unit 122 . At the time of comparison, the attribute data is not limited to one, and multiple types of attribute data may be used. For example, the attribute data comparison unit 116 may compare attribute data such as height, sex, and age. For example, when comparing height or age, the attribute data comparison unit 116 determines whether the input attribute data is within the range of the registered attribute data. Also, the attribute data comparison unit 116 may calculate the degree of similarity between the input attribute data and the registered attribute data.

Furthermore, the attribute data comparison unit 116 outputs the comparison result to the authority holder determination unit 118 as an attribute data comparison result. Note that the attribute data comparison result may include a similarity attribute index indicating the degree of similarity or the like instead of including only matching or mismatching.

Authority determination unit 117 determines whether the authority information included in the medium information satisfies a predetermined condition stored in condition storage unit 123 . Here, the predetermined conditions stored in the condition storage unit 123 are, for example, the service level used, the price range, the time period used, and the like. Further, when it is determined that the authority information satisfies the predetermined condition, the authority determination unit 117 outputs an authority determination result indicating that the authority information satisfies the predetermined condition, that is, the user is the authority holder. Output to determination unit 118 . On the other hand, when it is determined that the authority information does not satisfy the predetermined condition, authority determination section 117 outputs to output control section 114 information indicating that the user is a non-authorization person.

The authority holder determination unit 118 determines whether the user is an authority holder based on the authority holder verification result and the attribute data comparison result. For example, when the authority holder verification result indicates matching and the attribute data comparison result indicates matching, the authority holder determination unit 118 determines that the user is the authority holder. That is, the authority holder determination unit 118 determines that the user is the authority holder when the input feature data and the input attribute data are valid. Conversely, if either the input feature data or the input attribute data is invalid, the authority holder determination unit 118 determines that the user is a non-authority holder. Also, the authority holder determination unit 118 outputs the determination result to the output control unit 114 .

Further, instead of judging that the user is an authority holder based only on the judgment result as described above, the authority holder judgment unit 118 evaluates again the similarity index and the attribute index included in the judgment result to determine whether the user has authority. You may determine whether or not you are a person. For example, if the similarity index and attribute specifications are equal to or less than a predetermined threshold, the authority holder determination unit 118 outputs to the output control unit 114 information indicating that the user needs to re-enter the biometric information and attribute information. can be The output control unit 114 outputs the information to the output device 3 based on the information. As a result, the biometric information acquisition device 4 acquires the user's biometric information again.

(Operation in authority judgment processing)
FIG. 5 is a flow chart showing an example of the authority determination processing operation of the information processing device 1 .
The operation of this flow chart is realized by the control unit 11 of the information processing device 1 reading out and executing the program stored in the storage unit 12 .

The operation starts when the input device 2 acquires the medium information of the medium 6 . It should be noted that the operation may be started by the user performing an operation to the input device 2 indicating that he or she wishes to make advance preparations. In this case, the output device 3 prompts the user to hold the medium 6 over a predetermined position of the input device 2 , and the input device 2 acquires the medium information of the medium 6 .

The medium information acquisition unit 1111 acquires medium information and date/time information from the input device 2 through the input/output interface 13 (step ST21). The medium information acquisition unit 1111 may cause the acquired data storage unit 121 to store the medium information. The medium information acquisition unit 1111 also outputs the identification information and date/time information included in the medium information to the biometric information acquisition unit 1112 and the attribute information acquisition unit 1113 . Furthermore, the medium information acquisition unit 1111 outputs the authority information and date/time information included in the medium information to the authority determination unit 117 .

Authority determination section 117 determines whether or not the authority information satisfies a predetermined condition stored in condition storage section 123 (step ST22). For example, the authority information indicates that it is possible to receive a discount, the date and time information (that is, the date and time when the information was acquired from the medium) is 11:00 am, and the predetermined condition stored in the condition storage unit 123 is used. If it is possible to receive a discount during the time period (from 10:00 am to 4:00 pm), the authority determination unit 117 determines that the authority information has a condition. Further, when the authority information includes information that allows the user to receive a predetermined service within a specific range, the authority determination unit 117 determines whether the authority information and the date and time information are obtained without using the conditions stored in the condition storage unit 123 . It may be determined whether or not the predetermined condition is satisfied only by If it is determined that the authority information satisfies the predetermined condition, authority determination section 117 outputs an authority determination result indicating that the user is an authority holder to authority holder determination section 118, and the process proceeds to step ST23. proceed to On the other hand, when it is determined that the authority information does not satisfy the predetermined condition, authority determination section 117 outputs information indicating that the user is a non-authorized person to output control section 114, and the process proceeds to step ST31. proceed to

The biometric information acquisition unit 1112 acquires biometric information from the biometric information acquisition device 4 through the input/output interface 13 (step ST23). As in the preparation process, the biometric information acquisition unit 1112 acquires biometric information. The biometric information acquisition unit 1112 outputs the acquired biometric information, identification information, and date/time information to the feature data extraction unit 112 . Note that the biometric information acquisition unit 1112 may associate the acquired biometric information with the identification information and store it in the acquired data storage unit 121 .

The feature data extraction unit 112 extracts feature data based on the biometric information (step ST24). As in the preparation process, the feature data extraction unit 112 extracts feature data based on biometric information. Then, feature data extraction section 112 outputs the extracted feature data as input feature data to feature data comparison section 115 together with the identification information.

The feature data comparison section 115 compares the input feature data and the registered feature data (step ST25). Feature data comparison section 115 acquires registered feature data stored in extraction data storage section 122 based on the identification information received from feature data extraction section 112 . Then, the feature data comparison unit 115 compares the input feature data and the registered feature data. The feature data comparison unit 115 outputs the comparison result to the authority holder determination unit 118 as the authority holder verification result. Note that the authority holder verification result may include a similarity index.

The attribute information acquisition unit 1113 acquires attribute information from the attribute information acquisition device 5 through the input/output interface 13 (step ST26). As in the preparation process, the attribute information acquisition unit 1113 acquires attribute information. The attribute information acquisition unit 1113 outputs the acquired attribute information, identification information, and date/time information to the attribute data extraction unit 113 . Note that the attribute information acquisition unit 1113 may store the acquired attribute information in the acquired data storage unit 121 in association with the identification information.

The attribute data extraction unit 113 extracts attribute data based on the attribute information (step ST27). As in the preparation process, the attribute data extraction unit 113 extracts attribute data based on attribute information. Then, the attribute data extraction unit 113 outputs the extracted attribute data as input attribute data to the attribute data comparison unit 116 together with the identification information.

The attribute data comparing section 116 compares the input attribute data and the registered attribute data (step ST28). Attribute data comparison section 116 acquires registered attribute data stored in extraction data storage section 122 based on the identification information received from attribute data extraction section 113 . Then, the attribute data comparison unit 116 compares the input attribute data and the registered attribute data. The attribute data comparison unit 116 outputs the comparison result to the authority holder determination unit 118 as an attribute data comparison result. Note that the attribute data comparison result may include a similar attribute index.

The authority holder determination unit 118 determines whether the authority holder verification result and the attribute data comparison result both match (step ST29). If both the authority holder verification result and the attribute data comparison result indicate matching, the authority holder determination unit 118 determines that the user is the authority holder. In this case, authority holder determination section 118 outputs authority holder information indicating that the user is the authority holder to output control section 114 . On the other hand, if at least one of the authority holder verification result and the attribute data comparison result does not match, the authority holder determination unit 118 determines that the user is a non-authority holder. In this case, the authority determination unit 118 outputs to the output control unit 114 authority non-ownership information indicating that the user is not an authority holder.

When the authority holder information is received, the output control section 114 transmits information indicating that the user is the authorized authority holder to the output device 3 through the input/output interface 13 (step ST30). The output device 3 may display that the user is a legitimate authority holder according to the information.

If the information processing device 1 is a ticket gate or the like, the control unit 11 may of course open a gate or the like to allow the user to pass through.

On the other hand, when receiving information indicating that the user is not an authority holder from the authority determination section 117 or the authority determination section 118, the output control section 114 determines through the input/output interface 13 that the user is not a legitimate authority holder. Information to that effect is output to the output device 3 (step ST31). In this case, for example, it is also possible to output information prompting the user to hold the medium over the predetermined position of the input device 2 again and cause the input device 2 to acquire the medium information.

Step A1 combining steps ST21 and ST22, step B1 combining steps ST23 to ST25, and step C1 combining steps ST26 to ST28 may be performed in any order. That is, step A1, step B1, and step C1 are interchangeable, and may be processed in parallel.

(Action and effect of the first embodiment)
According to the first embodiment, it is possible to provide a technique for not recognizing a user as an authority holder when the user is a non-authority holder.

[Second embodiment]
(composition)
Since the hardware configuration in the second embodiment is the same as in the first embodiment, the description is omitted. Also, since the software configuration and the preparation processing operation in the preparation are the same as those in the first embodiment, the description is omitted.

・Authorization judgment processing (software configuration for authorization judgment processing)
FIG. 6 is a block diagram showing the software configuration of the information processing apparatus 1 in the authority determination process of the second embodiment in association with the hardware configuration shown in FIG.

A different point from the software configuration of the first embodiment is that the control unit 11 is provided with an identification information comparison unit 119 . This functional unit is implemented by the hardware processor executing the application program stored in the storage unit 12 .

The feature data extraction unit 112 extracts feature data based on biometric information, as in the first embodiment. Then, the extracted feature data is output to feature data comparison section 115 as input feature data, and the identification information is output to identification information comparison section 119 .

A feature data comparison unit 115 compares the input feature data and the registered feature data. Here, in the first embodiment, the feature data comparison unit 115 compares registered feature data and input feature data based on identification information. However, in the second embodiment, the feature data comparison unit 115 compares all or part of the input feature data and the registered feature data stored in the extraction data storage unit 122 . When comparing a part, for example, the feature data comparison unit 115 determines the similarity range of the input feature data, acquires registered feature data corresponding to the similarity range from the extracted data storage unit 122, and compares them. The similarity range may be calculated by multiplying the input feature data by a predetermined coefficient, may be determined by a predetermined threshold value, or may be obtained by dividing the registered feature data into partial data by performing predetermined statistical processing in advance. A method of classifying and limiting to partial data having high similarity with the representative value of each class may be used. Also, the order of comparison may be in each registration order or in a random order. Feature data comparison section 115 outputs identification information corresponding to registered feature data that is most similar to input feature data to identification information comparison section 119 . It should be noted that the feature data comparison unit 115 compares not only the identification information corresponding to the registered feature data most similar to the input feature data, but also the identification information corresponding to the registered feature data from the top to a predetermined range. You can output to

Identification information comparison section 119 compares the identification information received from feature data extraction section 112 (that is, the identification information corresponding to the input feature data) and the identification information received from feature data comparison section 115 . Then, the comparison result is output to the authority holder determination unit 118 as the authority holder verification result.

(Operation in authority judgment processing)
FIG. 7 is a flow chart showing an example of the authority determination processing operation of the information processing device 1 .
The operation of this flow chart is realized by the control unit 11 of the information processing device 1 reading out and executing the program stored in the storage unit 12 .

The operation starts when the input device 2 acquires the medium information of the medium 6 . It should be noted that the operation may be started by the user performing an operation to the input device 2 indicating that he or she wishes to make advance preparations. In this case, the output device 3 prompts the user to hold the medium 6 over a predetermined position of the input device 2 , and the input device 2 acquires the medium information of the medium 6 .

Steps ST21 to ST23 are the same as the operation of the authority determination process of the first embodiment described with reference to FIG. 5, so description thereof will be omitted here.

The feature data extraction unit 112 extracts feature data based on the biometric information (step ST41). As in the first embodiment, the feature data extraction unit 112 extracts feature data based on biometric information. Then, feature data extraction section 112 outputs the extracted feature data to feature data comparison section 115 as input feature data, and outputs identification information corresponding to the input feature data to identification information comparison section 119 as input identification information.

The feature data comparison section 115 compares the input feature data and the registered feature data (step ST42). The feature data comparison unit 115 compares all or part of the input feature data and the registered feature data stored in the extraction data storage unit 122 . Feature data comparison section 115 outputs identification information corresponding to registered feature data that is most similar to input feature data to identification information comparison section 119 as registered identification information. Note that the feature data comparison unit 115 stores not only the identification information corresponding to the registered feature data most similar to the input feature data, but also a plurality of pieces of identification information corresponding to the registered feature data from the top to a predetermined range as the registered identification information. , may be output to the identification information comparison unit 119 .

The identification information comparing section 119 compares the input identification information and the registered identification information (step ST43). The identification information comparison unit 119 compares registered identification information corresponding to similar registered characteristic data received from the characteristic data comparison unit 115 and input identification information corresponding to the input characteristic data received from the characteristic data extraction unit 112, and Determine whether these pieces of information match. It should be noted that when identification information comparison section 119 receives a plurality of pieces of registered identification information from feature data comparison section 115, identification information comparison section 119 may determine that these pieces of information match if any of the registration identification information matches input identification information. . Further, the identification information comparison section 119 outputs the comparison result to the authority holder determination section 118 as the authority holder verification result. Note that the authorization holder verification result includes information about the comparison result of identification information matching or non-matching.

Steps ST26 to ST28 are the same as the operation of the authority determination process of the first embodiment described with reference to FIG. 5, so description thereof will be omitted here.

The authority holder determination unit 118 determines whether both the authority holder verification result and the attribute data comparison result match (step ST44). Here, in the first embodiment, the verification result is whether or not the authorization holder verification result matches the feature data, but in the second embodiment, the verification result is whether or not the identification information matches. be. If both the authority holder verification result and the attribute data comparison result indicate matching, the authority holder determination unit 118 determines that the user is the authority holder. In this case, authority holder determination section 118 outputs authority holder information indicating that the user is the authority holder to output control section 114 . On the other hand, if at least one of the authority holder verification result and the attribute data comparison result does not match, the authority holder determination unit 118 determines that the user is a non-authority holder. In this case, the authority determination unit 118 outputs to the output control unit 114 authority non-ownership information indicating that the user is not an authority holder.

Steps ST30 to ST31 are the same as the operation of the authority determination process of the first embodiment described with reference to FIG. 5, so description thereof will be omitted here.

Step A2 combining steps ST21 and ST22, step B2 combining steps ST23 and steps ST41 to ST43, and step C2 combining steps ST26 to ST28 may be performed in any order. That is, step A2, step B2, and step C2 are interchangeable, and may be processed in parallel.

(Action and effect of the second embodiment)
According to the second embodiment, by comparing input biometric information using all or part of the registered feature data, it is possible to more reliably determine whether the user is a non-authorized person. It becomes possible to provide a technology for not recognizing the owner.

[Other embodiments]
In addition, this invention is not limited to the said embodiment. For example, the present invention is assumed to be used in station service equipment and the like, but can be used arbitrarily in other situations where personal identification is required. For example, it can be used for personal identification in an online test.

In addition, the method described in the above embodiment can be executed by a computer (computer) as a program (software means), such as a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), an optical disk (CD-ROM, DVD , MO, etc.), semiconductor memory (ROM, RAM, flash memory, etc.), etc., or can be transmitted and distributed via a communication medium. The programs stored on the medium also include a setting program for configuring software means (including not only execution programs but also tables and data structures) to be executed by the computer. A computer that realizes this apparatus reads a program stored in a storage medium, and in some cases, constructs software means by a setting program, and executes the above-described processes by controlling the operation of the software means. Note that the storage medium referred to in this specification includes storage media such as magnetic disks, semiconductor memories, etc. provided in computers or devices connected via a network, without being limited to those for distribution.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.

REFERENCE SIGNS LIST 1 information processing device 2 input device 3 output device 4 biometric information acquisition device 5 attribute information acquisition device 6 medium 11 control unit 111 acquisition unit 1111 medium information acquisition unit 1112 biometric information acquisition unit 1113 Attribute information acquisition unit 112 Feature data extraction unit 113 Attribute data extraction unit 114 Output control unit 115 Feature data comparison unit 116 Attribute data comparison unit 117 Authority determination unit 118 Authority holder determination unit 119 Identification information comparison Unit 12 Storage unit 121 Obtained data storage unit 122 Extracted data storage unit 123 Condition storage unit 13 Input/output interface

Claims (9)

an acquisition unit that acquires medium information stored in a medium and acquires biometric information and attribute information from a user who uses the medium;
a feature data extraction unit that extracts input feature data from the biometric information;
an attribute data extraction unit for extracting input attribute data from the attribute information;
The registered feature data stored in the storage section and the input feature data are compared with the registered attribute data stored in the storage section and the input attribute data, and matching or non-matching is determined according to the result of the comparison. a comparison unit that outputs a matching result including
a determination unit that determines whether or not the authorization information included in the medium information satisfies a predetermined condition and whether or not the matching result is matching;
an output unit that outputs information indicating that the user is an authorized person when the authorization information included in the medium information satisfies the predetermined condition and the collation result is a match;
An information processing device. The medium information further includes identification information,
2. The information processing apparatus according to claim 1, wherein said comparison unit compares registered feature data corresponding to said identification information with said input feature data. 2. The comparing unit obtains a distance scale or a similarity scale of the registered feature data and the input feature data, compares the obtained scale with a preset threshold value, and outputs the matching result. 3. The information processing device according to 2. The input feature data are a plurality of data or a plurality of types of data,
4. The method according to claim 1, wherein said comparison unit compares each of said input feature data with said registered feature data, and outputs said matching result based on a statistical result obtained by statistically processing said comparison result. The information processing apparatus according to any one of items 1 and 2. 2. The information processing apparatus according to claim 1, wherein said comparison unit compares said input feature data with part or all of registered feature data stored in said storage unit. The medium information further includes input identification information,
6. The comparing unit according to claim 5, wherein, as a result of the comparison, the input identification information is compared with registered identification information corresponding to the registered feature data that is most similar to the input characteristic data, and outputs the collation result. The information processing device described. The medium information further includes input identification information,
The comparison unit compares the input identification information with the registered identification information corresponding to the registered feature data within a predetermined range in order from the registered feature data most similar to the input feature data as a result of the comparison. 6. The information processing apparatus according to claim 5, which outputs said matching result. An information processing method executed by an information processing device comprising a processor and a memory,
obtaining medium information stored by the medium;
Acquiring biometric information and attribute information from a user who uses the medium;
extracting input feature data, which is significant data for identifying the user, from the biometric information;
Extracting input attribute data representing attributes to which the user belongs from the attribute information;
comparing registered feature data stored in a storage unit with the input feature data and registered attribute data stored in the storage unit with the input attribute data;
outputting a matching result including matching match or matching mismatch depending on the result of the comparison;
Determining whether the authority information included in the medium information satisfies a predetermined condition and whether the matching result is matched;
outputting information indicating that the user is an authorized person when the authority information included in the medium information satisfies the predetermined condition and the collation result is coincidence;
A method of processing information, comprising: An information processing program that causes a processor to function as each part of the information processing apparatus according to any one of claims 1 to 7.

Images