JP6668013B2 - Judgment device, judgment method and program - Google Patents

Description

  The present invention relates to a determination device, a determination method, and a program.

2. Description of the Related Art There is known a technology for detecting a gesture of a user and comparing the detected gesture with a predetermined pattern to authenticate an individual or detect an illegal act.
[Prior art documents]
[Patent Document]
[Patent Document 1] JP-A-2004-302881 [Patent Document 2] JP-A-2004-302881

  In order to improve the authentication accuracy or the detection accuracy, it is necessary to register the operation of various patterns in the prior art in advance, which is troublesome.

  In a first aspect of the present invention, a determination device is provided. The above-described determination device includes an identification information acquisition unit that acquires identification information for identifying a tangible object from the tangible object. The above-described determination device includes a first operation information acquisition unit that acquires first operation information indicating an operation when a person carrying the tangible object is using the tangible object. The above-described determination device includes a second operation information acquisition unit that acquires second operation information indicating an operation when the tangible object has been used in the past, which is recorded in association with the identification information of the tangible object. The above-described determination device includes a determination unit that determines the legitimacy of the person carrying the tangible object based on the first operation information and the second operation information.

  In the above-described determination device, the first operation information may include: (i) a locus, (ii) a moving speed, It may include information on at least one of (iii) shape or size, (iv) orientation, and (v) positional relationship with other parts of the wearer's body. In the above-described determination device, the second operation information may include: (i) a locus, (ii) a moving speed, and (iii) a specific part of the body of the carrier during at least a part of a period in which the tangible object has been used in the past. It may include information on at least one of the shape, (iv) orientation, and (v) positional relationship with other parts of the body of the carrier. In the above determination device, the specific part of the body may include at least one of a head, an arm, a hand, and a finger.

  In the above-described determination device, at least one of the operation when the person carrying the tangible object uses the tangible object and the operation when the tangible object has been used in the past includes: An operation of taking out a tangible object from the accommodating space to be accommodated, (ii) an operation in which a person carrying the tangible object approaches or inserts the tangible object to the identification information acquisition unit, and (iii) a person carrying the tangible object in the identification information acquisition unit An operation while waiting for the completion of the acquisition process of the identification information, (iv) an operation in which the tangible person's carrier receives a service using the tangible object, and (v) a tangible object's accommodating the tangible object It may include at least one operation of storing in a space.

  The above-described determination device may include an input unit that receives an input from a person carrying the tangible object. The above-described determination device may include a third operation information obtaining unit that obtains third operation information indicating an operation when the tangible person is inputting to the input unit. The above-described determination device obtains fourth operation information, which is recorded in association with the identification information of the tangible object and indicates the operation of the tangible object when it was previously input to the input unit by the fourth operation information. May be provided. In the above determination device, the determination unit may determine the legitimacy of the person carrying the tangible object based on the third operation information and the fourth operation information.

  In the above-described determination device, when the determination unit determines that the person carrying the tangible object is not a valid person carrying the tangible object, the determination unit notifies the determination result to at least one of the person carrying the tangible object and the valid person carrying the tangible object. A notification unit may be further provided. In the above determination device, the notification unit, when the determination unit determines that the person carrying the tangible object is not a legitimate person carrying the tangible object, information about the physical characteristics of the person carrying the tangible object, the legitimate person carrying the tangible object May be transmitted to the communication terminal. In the above-described determination device, the determination unit obtains, from the communication terminal of the legitimate carrier of the tangible object, information on the legitimacy of the person carrying the tangible object, and in the information on the legitimacy, the legitimacy of the person carrying the tangible object is confirmed. If information indicating that the tangible object is included, the tangible person may be determined to be a valid person.

  According to a second aspect of the present invention, there is provided a determination method. The above determination method includes an identification information acquiring step in which the computer acquires identification information for identifying a tangible object from the tangible object. The above-described determination method includes a first operation information obtaining step in which the computer obtains first operation information indicating an operation when the person carrying the tangible object uses the tangible object. The above-described determination method includes a second operation information obtaining step in which the computer obtains second operation information, which is recorded in association with the identification information of the tangible object and indicates the operation when the tangible object has been used in the past. . The above determination method includes a determination step in which the computer determines the legitimacy of the person carrying the tangible object based on the first operation information and the second operation information.

  In a third aspect of the present invention, a program is provided. The above program may be a program for causing a computer to function as the above-described determination device. The above program may be a program for causing a computer to execute the above determination method. A non-transitory computer-readable recording medium that records the above program may be provided.

  The above summary of the present invention does not list all of the necessary features of the present invention. Further, a sub-combination of these feature groups can also be an invention.

1 schematically shows an example of a system configuration of a security system 100. An example of the system configuration of the ATM 110 is schematically shown. An example of the card reader 230 is schematically shown. An example of the system configuration of the output control unit 268 is schematically shown. An example of the data table 500 is schematically shown. An example of the information processing in the authentication unit 266 is schematically shown. Another example of the information processing in the authentication unit 266 is schematically shown. An example of information processing in the output control unit 268 is schematically shown. Another example of the information processing in the output control unit 268 is schematically shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all combinations of the features described in the embodiments are necessarily essential to the solution of the invention. In the drawings, the same or similar portions are denoted by the same reference numerals, and duplicate description may be omitted.

  FIG. 1 schematically shows an example of a system configuration of the security system 100. The security system 100 includes an ATM 110 and a management server 120. The management server 120 includes, for example, an information storage unit 122 and a system management unit 124. In the present embodiment, the security system 100 and the ATM 110 may be an example of a determination device or an input support device. The information storage unit 122 may be an example of a storage unit. The system management unit 124 may be an example of a notification unit.

  Each unit of the security system 100 may be realized by hardware, may be realized by software, or may be realized by a combination of hardware and software. For example, by executing the program, one or more computers function as each unit of the security system 100.

  The above software or program may be stored in a computer-readable medium such as a CD-ROM, a DVD-ROM, a memory, and a hard disk, or may be stored in a storage device connected to a network. The software or the program may be installed on each computer of the security system 100 from a computer-readable medium or a storage device connected to a network.

  The program that causes a computer to function as each unit of the security system 100 may include a module that defines the operation of each unit of the security system 100. These programs or modules act on a processor, a communication interface, and the like to function as each unit of the security system 100 or to execute an information processing method in each unit of the security system 100.

  When the information processing described in these programs is read into a computer, the software functions as a specific means in which the software and the hardware resources of the security system 100 cooperate. By realizing the calculation or processing of the information according to the purpose of use of the computer in the present embodiment by these specific means, it is possible to construct the security system 100 according to the purpose of use.

  Each unit of the security system 100 may be realized by activating software or a program that defines the operation of each unit of the security system 100 in an information processing apparatus having a general configuration. An information processing device used as the security system 100 or a part thereof includes a processor such as a CPU, a data processing device having a ROM, a RAM, a communication interface, an input device such as a keyboard, a touch panel, a microphone, a liquid crystal display, and a transmission type. A display device such as a display or a projector, an output device such as a speaker, and a storage device such as a memory or an HDD may be provided. The above data processing device or storage device may store the above software or program.

  The ATM 110 is an automated teller machine, and sends and receives information to and from the management server 120 via the communication network 10. The ATM 110 reads the identification information recorded in the recording unit provided on the user's cash card (also referred to as a bank card or the like) and transmits the identification information to the management server 120. The recording unit may be a memory such as a magnetic tape or an IC chip. The ATM 110 receives an input from the user and transmits the input information to the management server 120. The ATM 110 receives an instruction from the management server 120, and provides a financial service to the user based on the instruction.

  A cash card may be an example of a tangible object. The identification information recorded in the recording unit of the cash card may be identification information for identifying each cash card or identification information for identifying each user.

  The communication network 10 may be a transmission path for wireless communication, a transmission path for wired communication, or a combination of a transmission path for wireless communication and a transmission path for wired communication. Examples of the communication network 10 include a mobile communication network, a wireless packet communication network, the Internet, a dedicated line, and a combination thereof.

  In the present embodiment, the ATM 110 determines the legitimacy of the cash card carrier based on the operation when the cash card carrier uses the cash card. The ATM 110 compares, for example, the current carrier's behavior or operation pattern of the cash card with the carrier's current behavior or behavior pattern recorded when the cash card was used in the past. The ATM 110 determines the validity of the current carrier of the cash card based on the comparison result. For example, if the current carrier's motion or operation pattern and the past carrier's motion or operation pattern are substantially the same, or if both are similar, the ATM 110 determines that the current carrier of the cash card is legitimate. Is determined to be a good carrier.

  When judging the legitimacy of the bearer of the cash card, the ATM 110 is a service provider that provides services using the cash card, or a person who has transferred or lent the cash card from the service provider. (In some cases, the information may be referred to as a user or a legitimate carrier.). Further, the ATM 110 may transmit the determination result to the management server 120.

  According to the present embodiment, for example, after the bearer of the cash card approaches the ATM 110, the carrying of the cash card is performed based on the operation of the bearer during at least a part of the period until the ATM 110 reads the identification information from the cash card. The legitimacy of the person can be determined. Therefore, illegal use of the cash card can be effectively prevented.

  Further, according to the present embodiment, the legitimacy of the carrier can be determined based on the past motion pattern of the same person or the past motion patterns of a plurality of persons who have performed the same kind of operation. Therefore, it is possible to omit the trouble of registering a plurality of patterns of operations corresponding to various operations in advance. In addition, the legitimacy of the person carrying the cash card can be determined based on the operation of making the user unconscious. Further, information on the variation in operation can be obtained, so that the determination accuracy can be improved.

  In the present embodiment, the ATM 110 detects a user's operation, and determines at least one of the type of information and the type of output mode for supporting the user's input operation based on the detected operation. When the user does not know the operation method of the ATM 110, the user's operation includes, for example, (i) stopping the operation, (ii) slowing down the operation speed, (iii) the trajectory of the fingertip is not stable, shaking the neck, and holding the arm. Examples of such operations include assembling, bringing a hand to the face, frowning, frowning, looking into the screen, and wearing glasses. When such an operation is detected, the ATM 110 executes a process for assisting the user's operation. Thereby, a user-friendly interface can be provided.

  The management server 120 provides various services to the user. In the present embodiment, the management server 120 provides a financial service to the user via the ATM 110. The management server 120 sends and receives information between the user terminal 20 and the ATM 110 via the communication network 10.

  The user terminal 20 may be any device that can transmit and receive information to and from the management server 120, and details are not particularly limited. The user terminal 20 may be a personal computer, a mobile terminal, a wireless terminal, and a combination thereof. Examples of the mobile terminal include a mobile phone or a smartphone, a notebook computer or a laptop computer, a PDA, a tablet terminal, and a wearable computer. Examples of the wearable computer include an information processing apparatus of an eyewear type, a wristband type, a ring type, and the like.

  In one embodiment, the information storage unit 122 stores information about the user. The information on the user includes identification information recorded on the cash card, personal information of the user, information indicating characteristics of the operation when the user uses the cash card or the ATM (when the information indicating the characteristics of the operation is referred to as an operation pattern). And the like.). The information storage unit 122 may store an operation pattern unique to the user for each type of operation of the user.

  Examples of the identification information recorded on the cash card include an account number, a number unique to the cash card, and the like. The account number may be an example of a user ID for identifying the user in the service provided by the management server 120. The identification information recorded on the cash card may be information printed on the surface of the cash card, or may be information stored in a storage device arranged on the cash card. Examples of the storage device include a magnetic tape and an IC chip.

  Examples of the personal information of the user include a name, an address, a telephone number, an e-mail address, authentication information for using a cash card, and the like. Examples of the authentication information include a password and biometric information. Examples of the biological information include a blood vessel pattern such as a fingerprint, a palm shape, a palm print, a voice print, a palm, and a retina, an iris pattern, and a face pattern. The above-mentioned authentication information may be an example of information used for authentication processing of a user ID.

  In another embodiment, the information storage unit 122 stores, for each type of operation of the ATM 110, one or more operation patterns indicating characteristics of a typical operation in the operation. For example, the information storage unit 122 stores one or more operation patterns indicating characteristics of an operation for causing the ATM 110 to output information (sometimes referred to as guide information) for supporting a user's input operation. The information storage unit 122 may store one or more operation patterns indicating characteristics of an operation for causing the ATM 110 to output guide information in association with the help operation of the ATM 110.

  The guide information may be information displayed on a part of the input screen of the ATM 110, may be a second input screen different from the default input screen, may be audio information, and may be light information. It may be blinking. Examples of the second input screen include a screen in which information relating to an operation method is emphasized, a screen in which a region for instructing language selection is emphasized, and a screen in which a region for inputting characters, symbols, or numbers is emphasized. Can be exemplified.

  The system management unit 124 manages the security system 100. For example, the system management unit 124 receives the identification information and the password of the cash card from the ATM 110 and executes an authentication process. Further, the system management unit 124 receives an instruction input to the ATM 110 by the user, and executes a process according to the instruction. After the user authentication process is completed, the system management unit 124 acquires information indicating the operation of the user associated with the current operation from the ATM 110, and associates the information with the identification information of the cash card in the information storage unit. 122.

  In the present embodiment, the system management unit 124 determines, from the ATM 110, information indicating that the current carrier of the cash card may not be a valid carrier, or determines the validity of the carrier of the cash card. When the information indicating that the cash card cannot be used is received, a message regarding the determination result is notified to the user terminal 20 of the legitimate carrier of the cash card. As a result, unauthorized use of the cash card can be prevented.

  The system management unit 124 may notify the user terminal 20 of the message, or alternatively, may notify the current carrier of the cash card of the message. For example, the system management unit 124 displays the message on the display unit of the ATM 110, thereby notifying the current carrier of the cash card of the message.

  When notifying the message to the user terminal 20 of the legitimate carrier, the system management unit 124 attaches information on the physical characteristics of the current carrier to the message and makes the current carrier a legitimate carrier. It may be inquired whether to approve. Thereby, for example, (i) when the user performs an operation different from usual when using the ATM 110, or (ii) a related person of the user uses the ATM 110 by using the cash card of the user. Even in this case, when the user approves the current carrier as a valid carrier, the carrier can continue using the ATM 110. The user's family can be exemplified by the user's family, relatives, friends, acquaintances, and the like.

  FIG. 2 schematically illustrates an example of a system configuration of the ATM 110. In the present embodiment, the ATM 110 includes a proximity sensor 210, a three-dimensional scanner 220, a card reader 230, a touch panel display 240, a speaker 250, and a control unit 260. In the present embodiment, the control unit 260 includes a communication control unit 262, a memory 264, an authentication unit 266, and an output control unit 268. The ATM 110 may include a plurality of three-dimensional scanners 220.

  The three-dimensional scanner 220 may be an example of at least one of a first motion information acquisition unit, a third motion information acquisition unit, a motion detection unit, an input unit, and a proximity sensor. The card reader 230 may be an example of an identification information acquisition unit. The touch panel display 240 may be an example of at least one of an input unit and an output unit. The speaker 250 may be an example of an output unit. The control unit 260 may be an example of at least one of the determination device and the input support device. The communication control unit 262 may be an example of at least one of the second operation information acquisition unit and the fourth operation information acquisition unit. The memory 264 may be an example of a storage unit. The authentication unit 266 is an example of at least one of a determination unit, an identification information acquisition unit, a first operation information acquisition unit, a second operation information acquisition unit, a third operation information acquisition unit, a fourth operation information acquisition unit, and a determination device. It may be.

  The proximity sensor 210 detects the proximity of the person carrying the cash card. The proximity sensor 210 may detect the proximity of a cash card carrier by detecting the proximity of a cash card. When the proximity sensor 210 detects the proximity of the bearer of the cash card, the proximity sensor 210 transmits information indicating the proximity of the bearer to the control unit 260. Examples of the proximity sensor 210 include a pressure sensor, an infrared sensor, an ultrasonic sensor, a magnetic sensor, a beacon receiving device, an imaging device, and an input device. Examples of the input device include a keyboard, a pointing device, a touch panel, operation buttons, and a three-dimensional input device.

  The three-dimensional scanner 220 acquires information indicating the operation of the bearer of the cash card. Examples of the three-dimensional scanner 220 include a three-dimensional input device such as Leap Motion manufactured by Leap Motion. The three-dimensional scanner 220 may transmit the acquired information to the control unit 260.

  According to one embodiment, the three-dimensional scanner 220 detects a user's movement near the touch panel display 240. According to another embodiment, the three-dimensional scanner 220 acquires information indicating an operation when a cash card carrier uses a cash card.

  The information indicating the operation when using the cash card includes the (i) of a specific part of the body of the current person of the cash card during at least a part of the period of using the cash card. ) May include information about at least one of: a trajectory, (ii) a moving speed, (iii) a shape or size, (iv) an orientation, and (v) a positional relationship with another part of the body of the carrier. . Particular parts of the body may include at least one of a head, arms, hands and fingers.

  The information indicating the operation when the cash card is used includes: (i) an operation in which the current bearer of the cash card takes out the cash card from the accommodation space accommodating the cash card; An operation in which the carrier brings the cash card close to or into the card reader 230, and (iii) an operation while the current carrier waits for completion of the identification information acquisition processing in the card reader 230; The information may include (iv) an operation of the current carrier operating the ATM 110, and (v) information of at least one of an operation of the current carrier storing the cash card in the accommodation space. Examples of the accommodation space include a bag, a wallet, a pocket, and the like. The information acquired by the three-dimensional scanner 220 may be an example of the first operation information or the third operation information. The operation of the cash card carrier operating the ATM 110 may be an example of an operation for the carrier to receive the provision of the service.

  The card reader 230 acquires identification information for identifying a cash card from the cash card. The card reader 230 may transmit the obtained identification information to the control unit 260. The touch panel display 240 displays various screens such as an input screen and a guide screen. In addition, the touch panel display 240 accepts input from a cash card carrier or a user. The speaker 250 outputs, for example, a voice such as a voice guide. The control unit 260 controls the ATM 110. The memory 264 stores various types of information.

  The communication control unit 262 controls communication between the control unit 260 and other components of the ATM 110 or the management server 120. The communication control unit 262 may be a communication interface. The communication control unit 262 receives information transmitted by the proximity sensor 210, the three-dimensional scanner 220, the card reader 230, or the touch panel display 240, and stores the information in the memory 264. The communication control unit 262 controls the touch panel display 240 or the speaker 250 to output information.

  The communication control unit 262 accesses the management server 120 and acquires information stored in the information storage unit 122 in association with the identification information of the cash card. The communication control unit 262 may store the acquired information in the memory 264. In one embodiment, the communication control unit 262 accesses the management server 120 and acquires an operation pattern stored in association with the type of operation of the ATM 110.

  In another embodiment, the communication control unit 262 acquires information indicating an operation when the cash card has been used in the past, which is recorded in association with the identification information of the cash card. In still another embodiment, the communication control unit 262 determines that the carryer of the cash card, which has been recorded in association with the identification information of the cash card, has been operated by one of the one or more ATMs 110 in the past. By operating the display 240 or the like, information indicating an operation when an instruction is input is acquired.

  The information obtained by the communication control unit 262 includes (i) a locus, and (ii) a moving speed of a specific part of the body of the bearer at the time of the cash card in at least a part of a period in which the cash card was used in the past. , (Iii) shape or size, (iv) orientation, and (v) positional information with respect to other parts of the wearer's body at that time. Particular parts of the body may include at least one of a head, arms, hands and fingers.

  The information acquired by the communication control unit 262 includes: (i) an operation in which the person carrying the cash card at the time removes the cash card from the accommodation space accommodating the cash card; Information relating to at least one of an operation of bringing a cash card close to or inserting the card reader 230 and (iii) an operation while the carrier at that time is waiting for completion of a process of acquiring identification information in the card reader 230. May be included. The information acquired by the communication control unit 262 may be an example of the second operation information or the fourth operation information.

  The authentication unit 266 determines the legitimacy of the current carrier of the cash card based on the information acquired by the three-dimensional scanner 220 and the information acquired by the communication control unit 262. The authentication unit 266 may acquire these pieces of information from the memory 264 or directly from the three-dimensional scanner 220 and the management server 120.

  The authentication unit 266 may normalize the operation of the bearer of the cash card. For example, the authentication unit 266 extracts a part whose size is known from the information acquired by the three-dimensional scanner 220. Examples of the portion having a known size include a distance between two specific locations of the ATM 110, a specific member, a cash card, and the like. The authentication unit 266 normalizes the operation of the cash card carrier based on the known size. The authentication unit 266 may determine the validity of the current bearer of the cash card based on the normalized operation. The authentication unit 266 may store information on the normalized operation in the memory 264.

  When the authentication unit 266 determines that the current carrier is not a valid carrier, for example, the authentication unit 266 notifies information indicating the determination result to at least one of the current carrier and the valid carrier. In one embodiment, the authentication unit 266 transmits information indicating the determination result to the system management unit 124 of the management server 120. As a result, a message including the determination result is transmitted to the user terminal 20 via the management server 120. Note that the authentication unit 266 may transmit the message to the user terminal 20 without passing through the management server 120. In another embodiment, the authentication unit 266 causes the touch panel display 240 to display a message including the determination result in cooperation with the output control unit 268.

  When transmitting the message including the determination result to the user terminal 20, the authentication unit 266 associates the message with the message and inquires whether the current carrier can be determined as a valid carrier by the user terminal 20. 20. When transmitting these messages to the user terminal 20, the authentication unit 266 may transmit information indicating the physical characteristics of the current person to the user terminal 20 in association with these messages. The information indicating the physical characteristics of the current carrier may be an image of the current carrier's face acquired by a camera, a three-dimensional scanner 220, or the like.

  The authentication unit 266 acquires, from the user terminal 20, information on the validity of the current carrier of the cash card as a response to the above inquiry. If the response includes the information indicating that the validity of the current carrier of the cash card has been confirmed, the authentication unit 266 determines that the current carrier is a valid carrier. The authentication unit 266 may determine the current carrier as a second legitimate carrier different from the first legitimate carrier carrying the user terminal 20.

  If the authentication unit 266 determines that the current carrier is a legitimate carrier, the authentication unit 266 performs authentication processing of the current carrier. For example, the authentication unit 266 acquires the password of the cash card from the current carrier of the cash card in cooperation with the output control unit 268 and the touch panel display 240. The authentication unit 266 transmits the obtained password to the management server 120 and requests an authentication process. The authentication unit 266 receives the result of the authentication process from the management server 120. When the current carrier of the cash card is authenticated by the management server 120, the ATM 110 starts providing a service to the current carrier.

  If the authentication unit 266 determines that the current person is a valid person, the authentication unit 266 may store the information about the current person acquired by the three-dimensional scanner 220 in the memory 264. The authentication unit 266 may store the information on the current carrier in the memory 264 so as to be distinguished from the information on the first legitimate carrier carrying the user terminal 20. The authentication unit 266 may store information on the current carrier in the memory 264 in association with the identification information of the cash card.

  The output control unit 268 controls at least one of the touch panel display 240 and the speaker 250. In one embodiment, the output control unit 268 controls the type of information to be output and the type of information output mode. In another embodiment, the output control unit 268 determines at least one of the type of information and the type of output mode for supporting the user's input operation based on the user's operation detected by the three-dimensional scanner 220. Output to the output unit. Thereby, a user-friendly interface can be provided.

  The output control unit 268 may control information transmitted from the ATM 110 to the management server 120 in cooperation with the communication control unit 262. For example, the output control unit 268 may use the three-dimensional scanner 220 or the memory 264 to perform the operation of the cash card carrier involved in various operations from the three-dimensional scanner 220 or the memory 264 after the current carrier's legitimacy determination process or the certification process is completed. The acquired information is transmitted to the system management unit 124. When there are a plurality of valid carriers, the output control unit 268 may transmit information indicating an operation of each valid carrier to the system management unit 124. As a result, the above information can be stored in the information storage unit 122 and used for the next and subsequent determinations.

  In the present embodiment, a case has been described in which the tangible entity on which the identification information is recorded is a cash card, and the ATM 110 uses the card reader 230 to acquire the identification information recorded on the magnetic tape or the IC chip. However, the tangible entity and the ATM 110 are not limited to this embodiment.

  In another embodiment, the tangible object may be an object having a contactless communication function, such as a mobile terminal or an IC card. In this case, the ATM 110 acquires the identification information recorded in the memory of the portable terminal by using a non-contact communication technique such as a short-range wireless communication and an infrared communication. Examples of the communication scheme of the short-range wireless communication include infrared communication, wireless LAN, Bluetooth (registered trademark), Zigbee (registered trademark), and RFID.

  In another embodiment, the tangible object may be an object having a display device, such as a mobile terminal. In this case, the ATM 110 acquires the identification information displayed on the display device of the mobile terminal using a reading device such as a camera or a scanner. The identification information displayed on the display device may be character string information or image information, or may be encoded information such as a barcode (registered trademark) or a QR code (registered trademark).

  In still another embodiment, the tangible object may be an object on which identification information is printed. In this case, the ATM 110 acquires the identification information using a reading device such as a camera or a scanner, for example. The printed identification information may be character string information or image information, or may be encoded information such as a barcode (registered trademark) or a QR code (registered trademark).

  In still other embodiments, the tangible object may be a part of the body of the user. In this case, the identification information may be biometric information of the user. Examples of the biological information include a blood vessel pattern such as a fingerprint, a palm shape, a palm print, a voice print, a palm, and a retina, an iris pattern, and a face pattern. The ATM 110 acquires the biological information of the user by using a reading device such as a camera and a scanner, for example.

  In the present embodiment, the case where the ATM 110 acquires the identification information has been described. However, the security system 100 is not limited to this embodiment. In other embodiments, the identification information may be obtained by a device located at a physically different location than the ATM 110. For example, a reading device for identification information having a short-range wireless communication function is installed at the entrance of a bank store, and when the user enters the store, the reading device reads the user's cash card, mobile terminal, or the like. , The identification information may be obtained. The above reading device may transmit the acquired identification information to the ATM 110 or the management server 120.

  In the present embodiment, a case has been described in which the three-dimensional scanner 220 is used to acquire information on the operation of the person carrying the cash card. However, the method for acquiring information on the operation of the bearer of the cash card is not limited to this embodiment. In other embodiments, the ATM 110 may use an imaging device, such as a video camera, to obtain information regarding the operation of the cash card carrier. In the present embodiment, the case where the authentication unit 266 is provided in the ATM 110 has been described. However, in another embodiment, the authentication unit 266 may be provided in the management server 120.

  FIG. 3 schematically illustrates an example of the card reader 230. In the present embodiment, the card reader 230 includes a card insertion slot 310 into which a cash card is inserted, a guide light 320, and a reading unit 330 that reads identification information of the cash card from the cash card. The guide light 320 is turned on or off based on an instruction from the output control unit 268. The output control unit 268 illuminates or blinks the guide light 320, for example, to indicate the position of the card insertion slot 310 and prompt the user to insert a card. Turning on or blinking the guide light 320 may be an example of information for assisting the user to perform an input operation.

  FIG. 4 schematically illustrates an example of a system configuration of the output control unit 268. In the present embodiment, the output control unit 268 includes an operation pattern detection unit 402, a determination unit 404, and an operation pattern generation unit 406. The determination unit 404 may be an example of an output determination unit.

  The operation pattern detection unit 402 detects a user operation near the touch panel display 240. The operation pattern detection unit 402 may detect a user operation by detecting a specific operation pattern from among the user operations detected by the three-dimensional scanner 220. For example, the motion pattern detection unit 402 compares the user's motion detected by the three-dimensional scanner 220 with one or more motion patterns associated with a specific operation, and compares at least one of the one or more motion patterns. Detect presence / absence. One or more operation patterns associated with a specific operation may be stored in the information storage unit 122, the memory 264, or the like.

  In one embodiment, one or more operation patterns associated with a specific operation are generated by analyzing the operations of a plurality of users in the same operation. In another embodiment, one or more operation patterns associated with a specific operation are stored for each user in association with identification information of each user. In this case, one or more operation patterns associated with a specific operation are generated by analyzing the operation when each user performs each operation.

  When one or more operation patterns associated with a specific operation are stored for each user, the operation pattern detection unit 402 may detect the user's operation using the operation pattern for each user. The authentication of the user may be performed by the authentication unit 266. The authentication unit 266 may perform an authentication process using a known method. For example, the authentication unit 266 performs an authentication process using the identification information recorded on the cash card and the authentication information obtained from the user. The authentication unit 266 may perform an authentication process using a biometric authentication technology.

  The operation pattern detection unit 402 may obtain information on the user's operation detected by the three-dimensional scanner 220 from the three-dimensional scanner 220 or from the memory 264. The operation pattern detection unit 402 may acquire at least one of one or more operation patterns associated with a specific operation from the information storage unit 122 of the management server 120 or may acquire from the memory 264.

  In one embodiment, the operation pattern detection unit 402 stores, in association with each of one or more types of operations, the characteristic of a typical operation in the operation, which is stored in the information storage unit 122 or the memory 264. The presence or absence of at least one of the above operation patterns is detected. As a result, a person (for example, a user) or an object around the ATM 110 performs a specific operation or operation corresponding to the detected operation pattern, or attempts to perform the specific operation or operation. Can be detected.

  If no operation pattern corresponding to the specific operation is detected, it is determined that a person or an object around the ATM 110 is performing an operation or operation other than the specific operation, or that the specific operation is not performed. It is possible to detect that another operation or operation is going to be performed. For example, when an operation pattern corresponding to the help operation is not detected, it can be detected that the user is performing an operation or an operation other than the help operation (for example, a payment operation).

  When an operation pattern corresponding to all the operations of the ATM 110 (including an illegal operation on the ATM 110) is not detected, the operation pattern detection unit 402 causes a person or an object around the ATM 110 to perform an operation different from a normal operation. Can be detected. In this case, according to an embodiment, the operation pattern detection unit 402 detects that the user needs or will need the assistance of the input operation. According to another embodiment, the operation pattern detection unit 402 detects that a person around the ATM 110 is performing an illegal operation on the ATM 110 or intends to perform the illegal operation. Note that all operations of the ATM 110 may mean all operations in which an operation pattern corresponding to the operation is registered or stored.

  For example, a person who attempts fraud (sometimes referred to as a suspicious person) may attach a skimming device to the body of the ATM 110 or attach a surveillance camera around the ATM 110. In such a case, when the suspicious individual approaches the ATM 110, the proximity sensor 210 detects the approach of the suspicious individual. When the proximity sensor 210 detects the approach of a suspicious individual, the three-dimensional scanner 220 starts a process of acquiring information indicating the operation of the suspicious individual. As a result, information indicating the operation of the suspicious person attaching the skimming device to the main body of the ATM 110 or attaching the monitoring camera around the ATM 110 is obtained.

  The operation pattern detection unit 402 compares the operation pattern of the operation acquired by the three-dimensional scanner 220 with the operation pattern registered in association with various operations of the ATM 110, and determines the operation acquired by the three-dimensional scanner 220. The corresponding operation type of the ATM 110 is determined. When an operation corresponding to the operation acquired by the three-dimensional scanner 220 is not detected, the operation pattern detection unit 402 determines that a person around the ATM 110 is performing an illegal operation on the ATM 110, or Detect that you are about to perform an operation. In this case, the operation pattern detection unit 402 may store the operation pattern of the operation acquired by the three-dimensional scanner 220 in the memory 264 as an operation pattern corresponding to an unauthorized operation.

  In another embodiment, the operation pattern detection unit 402 detects the presence or absence of an operation pattern indicating a feature of an operation for outputting guide information. Examples of the operation for outputting the guide information include a help operation and a cancel operation. Thereby, it is possible to detect that the user needs the assistance of the input operation. The guide information may be output by at least one of the touch panel display 240 and the speaker 250.

  The determination unit 404 determines at least one of the type of information to be output and the type of information output mode based on the detection result of the operation pattern detection unit 402. For example, when the operation pattern detection unit 402 detects an operation pattern indicating a feature of an operation to output guide information, the determination unit 404 determines at least one of the type of information to be output and the type of information output mode. To determine. The operation for outputting the guide information may be (i) an operation when the user inputs an instruction (sometimes referred to as a help operation) for requesting the ATM 110 to output the guide information, (Ii) The operation may be performed when the user inputs to the ATM 110 an instruction to stop providing a service or an instruction to cancel an advance operation (sometimes referred to as a cancel operation).

  The determination unit 404 determines that the operation pattern detection unit 402 does not detect an operation pattern corresponding to all operations of the ATM 110 (including an illegal operation on the ATM 110) other than at least one of the help operation and the cancel operation. In addition, at least one of the type of information to be output and the type of information output mode may be determined. In these cases, all operations of the ATM 110 mean all operations in which an operation pattern corresponding to the operation is registered.

  In one embodiment, the type of information to be output may include at least one of the type of information displayed on the input screen and the type of language displayed on the input screen. The type of information output mode may include at least one of the information position, size, range, shape, color, pattern, and type of enhancement processing on the input screen. The above information may include guide information.

  Thus, when the user needs assistance in input operation, it is possible to output a second input screen different from the default input screen, output a voice guide, and blink a light. As the second input screen, (i) an input screen for foreigners in which the language selection button is emphasized, (ii) a screen for beginners with fewer selection buttons compared to the default input screen, (iii) a default screen (Iv) a screen for elderly people whose characters (including symbols and numbers) are larger than those of the default input screen; (V) As compared with the default input screen, an input error prevention screen in which an area for inputting characters is emphasized, and a combination thereof can be exemplified. According to the present embodiment, it is possible to estimate the situation of the user based on the operation of the user, and to output an input screen that seems appropriate.

  The input screen to be output may be determined based on the operation of the card carrier detected by analyzing the operation pattern, the speed of the operation of the card carrier, the physical characteristics of the card carrier, and a combination thereof. For example, when an operation pattern indicating a feature of the help operation is detected, an input screen having the above-described features (i) to (iii) is output. If the operating speed of the bearer of the cash card is lower than a specific threshold value, an input screen having the feature (iv) may be output. If an operation pattern indicating the feature of the cancel operation is detected, an input screen having the feature (v) may be output. If there is a high possibility of being a foreigner based on the characteristics of the face of the card carrier, an input screen having the characteristic (i) may be output.

  In another embodiment, the type of the information output mode may include at least one of the information output speed and the output interval. Thereby, for example, when the user needs input operation support, the voice of the input guide is output more slowly than usual, or the time until the information for prompting the next operation is output is made longer than usual. You can set it longer.

  The operation pattern generation unit 406 generates an operation pattern corresponding to a specific operation based on the user's operation acquired by the three-dimensional scanner 220. In one embodiment, for example, when the touch panel display 240 receives an instruction (sometimes referred to as a help operation) requesting output of guide information, the operation pattern generation unit 406 records the three-dimensional scanner 220 From the information, a record related to the user's operation in a predetermined period including the time when the touch panel display 240 receives the instruction is extracted. For example, a record is extracted from a period of 30 seconds before the touch panel display 240 receives the help operation to a period from the touch panel display 240 receiving the help operation.

  Next, the operation pattern generation unit 406 generates information indicating characteristics of the extracted operation. The information indicating the feature of the motion includes (i) a trajectory, (ii) a moving speed, (iii) a shape or size, (iv) an orientation, and (v) a user's body of a specific part of the user's body. It may include information on at least one of the positional relationships with other parts. Particular parts of the body may include at least one of a head, arms, hands and fingers. The operation pattern generation unit 406 may store the generated information in the memory 264 or the information storage unit 122 as an operation pattern associated with the help operation.

  For other operations, corresponding operation patterns can be generated by the same procedure. For example, when the touch panel display 240 receives an instruction to stop providing a service or an instruction to cancel a prior operation (sometimes referred to as a cancel operation), an operation pattern associated with the cancel operation is generated. can do.

  FIG. 5 schematically shows an example of the data table 500. In the present embodiment, the data table 500 indicates a card ID 502 as an example of identification information of a cash card, a notification destination address 504 indicating a contact address of a user of the card identified by the card ID 502, and an operation type of the ATM 110. The operation type 506 is stored in association with a URI 508 of operation pattern data in which a user's operation pattern before and after the operation identified by the operation type 506 is stored.

  According to the present embodiment, the data table 500 stores the URIs of the operation pattern data of a plurality of valid carriers including the first registrant 512 and the second registrant 514. The operation pattern data of each of a plurality of valid carriers may be stored as separate data files, or may be stored in one data file for each card ID.

  In one embodiment, the first registrant 512 and the second registrant 514 are pre-registered by the service provider as valid credit card carriers. In another embodiment, the first registrant 512 is pre-registered by the service provider as a legitimate carrier of the cash card, and the second registrant 514 is authorized by the first registrant 512 as a legitimate carrier. It is registered by doing.

  Depending on the service, there are cases where not only the contractor himself / herself but also its related parties can use it. For example, a financial institution may provide financial services by issuing a plurality of cash cards or credit cards (sometimes referred to as corporate cards, family cards, etc.) to one bank account. . According to the present embodiment, since the operation patterns of a plurality of valid carriers can be registered, even in such a case, the ATM 110 determines that the current carrier of the cash card card is a valid carrier. It can be determined whether or not there is.

  In this embodiment, the case where the tangible object is a cash card for receiving provision of a financial service and the registrant is a person has been described. However, registrants are not limited to people. The registrant may be an object such as an animal depending on a service provided using a tangible object.

  FIG. 6 schematically illustrates an example of information processing in the authentication unit 266. According to the present embodiment, an example of the process of determining the validity of the user and the process of authenticating the user are shown. First, in step 602 (the step may be abbreviated as S), the proximity sensor 210 detects the proximity of the person carrying the cash card. Proximity sensor 210 notifies control unit 260 of information indicating that the carrier has approached ATM 110. In step S604, the control unit 260 activates the three-dimensional scanner 220 and records the operation of the carrier. The control unit 260 stores the information acquired by the three-dimensional scanner 220 in the memory 264.

  Next, in S606, when the bearer of the cash card inserts the cash card into the insertion slot of the card reader 230, the card reader 230 reads the identification information of the cash card. The card reader 230 notifies the control unit 260 of the identification information of the cash card. In step S608, the communication control unit 262 transmits the identification information acquired by the card reader 230 to the management server 120, and indicates an operation of the carrier when the cash card identified by the identification information has been used in the past. Request information. The communication control unit 262 stores information acquired from the management server 120 in the memory 264. In addition, the authentication unit 266 determines the validity of the current carrier of the cash card based on the information acquired by the three-dimensional scanner 220 and the information acquired by the communication control unit 262.

  If the authentication unit 266 determines that the current carrier of the cash card is not a valid carrier of the cash card (NO in S610), in S612, the authentication unit 266 transmits information indicating the determination result to the management server. 120. The management server 120 transmits, for example, a message including the determination result and the image of the face of the current person to the contact (for example, the user terminal 20) stored in the notification destination address 504 of the data table 500. Inquires whether the current carrier can be determined to be a valid carrier.

  In S614, the authentication unit 266 receives a response to the above message from the user terminal 20. When the above response includes information indicating that the validity of the current carrier of the cash card has been confirmed (in the case of YES in S614), the authentication unit 266 sets the current carrier as a valid carrier. Is determined. On the other hand, if the response does not include information indicating that the validity of the current carrier of the cash card has been confirmed (NO in S614), the ATM 110 may, for example, inform the touch panel that the transaction will be stopped. The result is displayed on the expression display 240, and the process ends.

  When the authentication unit 266 determines that the current carrier of the cash card is a valid carrier of the cash card (YES in S610 and YES in S614), the authentication unit 266 performs an authentication process. I do. Thereafter, the ATM 110 provides a service based on a user's instruction.

  FIG. 7 schematically illustrates another example of the information processing in the authentication unit 266. 7, processes that are the same as or similar to the information processing in FIG. 6 are denoted by the same reference numerals, and detailed description is omitted. According to the present embodiment, an example of a process when a user inputs an instruction regarding an operation of the ATM 110 is shown.

  First, in S606, the card reader 230 acquires the identification information of the cash card, and after the user authentication processing in S620 is completed, in S704, the three-dimensional scanner 220 records the operation of the person carrying the cash card. The control unit 260 stores the information acquired by the three-dimensional scanner 220 in the memory 264. In step S706, the touch panel display 240 receives a user instruction regarding the operation of the ATM 110.

  In step S708, the communication control unit 262 transmits the identification information acquired by the card reader 230 and information on the type of operation corresponding to the instruction acquired by the touch panel display 240 to the management server 120, and the communication control unit 262 identifies the identification information. When the cash card used in the past has been used in the past, the touch panel display 240 requests information indicating an operation of the carrier when an operation corresponding to the acquired instruction is performed. The communication control unit 262 stores information acquired from the management server 120 in the memory 264.

  In addition, the authentication unit 266 performs, based on the information obtained by the three-dimensional scanner 220 before and after the time when the touch panel display 240 receives the instruction, and the information obtained by the communication control unit 262, the current carrier of the cash card. Is determined. If the authentication unit 266 determines that the current carryer of the cash card is a valid carryer of the cash card (YES in S610 and YES in S614), the control unit 260 determines in S720 that the user is An instruction is received, and a process corresponding to the instruction is executed. As a result, even if unauthorized use cannot be prevented by the user authentication process, unauthorized use of the cash card can be prevented.

  FIG. 8 schematically illustrates an example of information processing in the output control unit 268. According to the present embodiment, a method for generating an input screen including guide information is shown. First, in S802, the three-dimensional scanner 220 detects a user operation of the ATM 110. In step S804, the communication control unit 262 transmits the identification information acquired by the card reader 230 to the management server 120, and acquires an operation pattern associated with the identification information. The communication control unit 262 stores information acquired from the management server 120 in the memory 264. The authentication unit 266 determines whether the user needs the guide information based on the information acquired by the three-dimensional scanner 220 and the information acquired by the communication control unit 262.

  If the authentication unit 266 determines that the user needs guide information, the output control unit 268 determines the type of information to be output as guide information in S806. In step S808, the output control unit 268 determines the type of output mode of information to be output as guide information. Thereafter, the output control unit 268 generates an input screen including guide information based on the determined information type and output mode, and causes the touch panel display 240 to output the input screen.

  FIG. 9 schematically illustrates another example of the information processing in the output control unit 268. According to the present embodiment, an example of a process of generating an operation pattern is shown. First, in S902, the three-dimensional scanner 220 detects a user operation of the ATM 110. The three-dimensional scanner 220 records the detected operation in the memory 264. In step S904, the touch panel display 240 receives an instruction from the user regarding the operation of the ATM 110. Next, in step S906, the operation pattern generation unit 406 searches for information recorded in the memory 264, and determines the operation of the user during a predetermined period including a time point when the touch panel display 240 receives an instruction from the user. Extract records. Next, the operation pattern generation unit 406 processes the record regarding the extracted user operation, and generates an operation pattern corresponding to the above operation.

  As described above, the present invention has been described using the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent to those skilled in the art that various changes or improvements can be made to the above embodiment. In addition, matters described in a specific embodiment can be applied to other embodiments within a technically consistent range. It is apparent from the description of the appended claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

  The execution order of each processing such as operation, procedure, step, and stage in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before”, “before”. It should be noted that they can be realized in any order as long as the output of the previous process is not used in the subsequent process. Even if the operation flow in the claims, the specification, and the drawings is described using “first,” “second,” or the like for convenience, it means that it is essential to perform the operation in this order. Not something.

In addition, this specification discloses the following matters.
[Item 1]
An operation detection unit that detects the operation of the user in the vicinity of the input unit that receives input from the user;
An output control unit configured to determine at least one of a type of information and a type of output mode for supporting a user's input operation based on the operation of the user detected by the operation detection unit, and to output the information to an output unit;
An input support device comprising:
[Item 2]
The type of the output mode includes at least one of an output speed and an output interval of information for supporting the input operation of the user,
Item 1. The input support device according to Item 1.
[Item 3]
The output unit has a display unit that displays an input screen,
The type of information for supporting the user's input operation includes at least one of a type of information displayed on the input screen and a type of language displayed on the input screen.
The input support device according to item 1 or item 2.
[Item 4]
The type of the output mode includes at least one of a position, a size, a range, a shape, a color, a pattern, and a type of enhancement processing of information for supporting the user's input operation on the input screen.
The input support device according to any one of items 1 to 3.
[Item 5]
The physical movement of the user includes at least one of a trajectory, a moving speed, a shape or a size, an orientation of a specific part of the user's body, and a positional relationship with another part of the user's body.
The input support device according to any one of items 1 to 4.
[Item 6]
A storage unit that stores one or more first operation patterns indicating characteristics of an operation for causing the output unit to output information for supporting the user's input operation;
The output control unit includes:
An operation pattern detection unit that compares the operation of the user detected by the operation detection unit with the first operation pattern stored in the storage unit and detects the presence or absence of the first operation pattern;
A determining unit that determines to output information for supporting the user's input operation when the first operation pattern is detected;
Having,
6. The input support device according to any one of items 1 to 5.
[Item 7]
The output control unit further includes an operation pattern generation unit that generates the first operation pattern,
The operation pattern generation unit includes:
When the input unit receives an instruction for requesting output of information for supporting the user's input operation, the input unit receives the instruction for a predetermined period including a time when the input unit receives the instruction. Extract the behavior,
Creating information indicating the characteristics of the extracted user action,
Storing the first operation pattern in the storage unit;
Item 6. The input support device according to Item 6.
[Item 8]
The storage unit further stores, for each type of operation, one or more second operation patterns indicating characteristics of a typical operation in the operation,
The operation pattern detection unit compares the operation of the user detected by the operation detection unit with the second operation pattern stored in the storage unit to detect the presence or absence of the second operation pattern. ,
The determining unit determines to output information for supporting the input operation of the user when the second operation pattern is not detected,
The input support device according to item 6 or 7.
[Item 9]
A storage unit for storing, for each type of operation, one or more second operation patterns indicating characteristics of a typical operation in the operation;
The output control unit includes:
An operation pattern detection unit that compares the operation of the user detected by the operation detection unit with the second operation pattern stored in the storage unit and detects the presence or absence of the second operation pattern;
A determining unit that determines to output information for assisting the user's input operation when the second operation pattern is not detected;
Having,
6. The input support device according to any one of items 1 to 5.
[Item 10]
The operation includes an unauthorized operation on the device including the input unit,
The input support device according to item 8 or 9.
[Item 11]
A computer detecting an operation of the user in the vicinity of the input device that receives input from the user;
A computer determines at least one of a type and an output mode of information for supporting a user's input operation based on the operation of the user detected by the operation detection unit, and determines the determined type and output mode of the information. An output control step of controlling the output device based on at least one of:
An input support method comprising:
[Item 12]
A program for causing a computer to function as the input support device according to any one of items 1 to 10.

  Reference Signs List 10 communication network, 20 user terminal, 100 security system, 110 ATM, 120 management server, 122 information storage unit, 124 system management unit, 210 proximity sensor, 220 three-dimensional scanner, 230 card reader, 240 touch panel display, 250 speaker, 260 control unit, 262 communication control unit, 264 memory, 266 authentication unit, 268 output control unit, 310 card slot, 320 guide light, 330 reading unit, 402 operation pattern detection unit, 404 determination unit, 406 operation pattern generation unit , 500 data table, 502 card ID, 504 notification destination address, 506 operation type, 508 URI, 512 first registrant, 514 second registrant

Claims (12)

An identification information acquisition unit that acquires identification information for identifying a tangible object from the tangible object,
A first operation information acquisition unit that acquires first operation information indicating an operation when the person carrying the tangible object uses the tangible object;
A second operation information acquisition unit that acquires second operation information indicating an operation when the tangible object has been used in the past, which is recorded in association with the identification information of the tangible object,
A determining unit that determines the legitimacy of the person carrying the tangible object based on the first operation information and the second operation information;
When the determining unit determines that the person carrying the tangible object is not a valid person carrying the tangible object, the determination unit notifies the result of the determination to at least one of the person carrying the tangible object and the valid person carrying the tangible object. Notification section,
Bei to give a,
The notification unit, when the determination unit determines that the person carrying the tangible object is not a legitimate person carrying the tangible object, the information on the physical characteristics of the person carrying the tangible object, the legitimate person carrying the tangible object To the communication terminal of
The information on the physical characteristics includes a face image,
Judgment device. The first motion information includes (i) a trajectory, (ii) a moving speed, and (iii) of a specific part of the body of the tangible object during at least a part of a period in which the tangible object carrier uses the tangible object. And / or (v) information about at least one of: shape or size, (iv) orientation, and (v) positional relationship with other parts of the body of the carrier.
The second motion information includes: (i) a trajectory, (ii) a moving speed, (iii) a shape or a size of a specific part of the body of the carrier during at least a part of a period in which the tangible object has been used in the past. And (v) information about at least one of orientation and (v) positional relationship with other parts of the body of the carrier.
The determination device according to claim 1. The particular part of the body includes at least one of a head, an arm, a hand and a finger;
The determination device according to claim 2. At least one of the operation when the person carrying the tangible object uses the tangible object and the operation when the person using the tangible object has been used in the past includes: (i) the person carrying the tangible object contains the tangible object; (Ii) the carrier of the tangible object brings the tangible object closer to or inserts into the identification information acquisition unit; and (iii) the carrier of the tangible object An operation during which the tangible object is brought into close proximity to or inserted into the identification information acquisition unit and then waits for completion of the acquisition processing of the identification information in the identification information acquisition unit; (iv) the carrier of the tangible object is: (V) the carrier of the tangible object performs at least one of an operation of receiving the provision of a service using the tangible object and storing the tangible object in the storage space. No,
The determination device according to any one of claims 1 to 3. An input unit for receiving input from a carrier of the tangible object,
A third operation information acquisition unit that acquires third operation information indicating an operation when the tangible person is inputting to the input unit;
A fourth operation information acquisition unit configured to acquire fourth operation information indicating an operation performed when the person carrying the tangible object has previously input to the input unit, which is recorded in association with the identification information of the tangible object; and ,
With
The determination unit determines the legitimacy of the person carrying the tangible object based on the third operation information and the fourth operation information,
The determination device according to claim 1. The determination unit includes:
From the communication terminal of the legitimate carrier of the tangible object, obtain information on the legitimacy of the tangible person's carrier,
When the information on the legitimacy includes information indicating that the legitimacy of the person carrying the tangible object has been confirmed, the person carrying the tangible object is determined to be a valid person.
The determination device according to claim 1 .   An operation detection unit that detects an operation of the user in the vicinity of an input unit that receives an input from a user;
  Based on the user's motion detected by the motion detection unit, at least one of a type of information and a type of output mode for supporting a user's input operation is determined, and an output unit assists the user's input operation. An output control unit that outputs the information for performing
  Comprising,
  The determination device according to any one of claims 1 to 6.   The output control unit includes:
  The operation detecting unit detects the operation by referring to a storage unit that stores one or more first operation patterns indicating characteristics of an operation that should cause the output unit to output information for supporting the user's input operation. An operation pattern detection unit that compares the operation of the user with the first operation pattern stored in the storage unit and detects the presence or absence of the first operation pattern;
  A determining unit that determines to output information for supporting the user's input operation when the first operation pattern is detected;
  Having,
  The determination device according to claim 7.   The output control unit further includes an operation pattern generation unit that generates the first operation pattern.
  The determination device according to claim 8. Computer, identification information acquisition step of acquiring identification information for identifying a tangible object from the tangible object,
A first operation information acquisition step in which the computer acquires first operation information indicating an operation when the person carrying the tangible object uses the tangible object;
A second operation information acquisition step in which the computer acquires second operation information indicating an operation when the tangible object has been used in the past, which is recorded in association with the identification information of the tangible object,
A determination step in which the computer determines the legitimacy of the person carrying the tangible object based on the first operation information and the second operation information;
In the determining step, when it is determined that the person carrying the tangible object is not a valid person carrying the tangible object, at least one of the person carrying the tangible object and the valid person carrying the tangible object is notified of the result of the judgment. Notification stage to
Bei to give a,
The notifying step, in the determining step, when it is determined that the person carrying the tangible object is not a legitimate person carrying the tangible object, information on the physical characteristics of the person carrying the tangible object, the legitimate carrying of the tangible object Transmitting to the communication terminal of the user,
The information on the physical characteristics includes a face image,
A determination method comprising:   An operation detecting step in which the computer detects an operation of the user in the vicinity of an input unit that receives an input from the user,
  The computer determines at least one of a type of information and a type of output mode for supporting a user's input operation based on the user's operation detected in the operation detection step, and outputs the user's An output control step of outputting the information to assist an input operation;
  Further having
  The method according to claim 10.   A program for causing a computer to function as the determination device according to any one of claims 1 to 9.