WO2023021599A1 - Dispositif, système et procédé de recommandation et support à lecture informatique - Google Patents

Dispositif, système et procédé de recommandation et support à lecture informatique Download PDF

Info

Publication number
WO2023021599A1
WO2023021599A1 PCT/JP2021/030140 JP2021030140W WO2023021599A1 WO 2023021599 A1 WO2023021599 A1 WO 2023021599A1 JP 2021030140 W JP2021030140 W JP 2021030140W WO 2023021599 A1 WO2023021599 A1 WO 2023021599A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
information
authentication
service providing
recommendation
Prior art date
Application number
PCT/JP2021/030140
Other languages
English (en)
Japanese (ja)
Inventor
ほなみ 幸
憲由 平本
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2023542078A priority Critical patent/JPWO2023021599A5/ja
Priority to PCT/JP2021/030140 priority patent/WO2023021599A1/fr
Publication of WO2023021599A1 publication Critical patent/WO2023021599A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services

Definitions

  • the present invention relates to recommendation devices, systems and methods, and computer-readable media. More particularly, the present invention relates to a recommendation device, system, method, and computer-readable medium for making a recommendation to a user when using a service providing device that provides services upon successful authentication.
  • Patent Literature 1 discloses a technique related to a measurement system that analyzes a user's face image and measures the user.
  • the measurement system according to Patent Literature 1 measures at least one of a user's pulse rate, blood pressure, stress level, and nutritional deficiencies, based on the user's face image.
  • face authentication terminals have become widespread, and face authentication terminals are used in various places such as gate devices for managing entry and exit.
  • An object of the present disclosure is to provide a recommendation device, system, method, and program for recommending appropriate information according to the user's condition in view of the above-described problems.
  • a recommendation device includes: registration means for registering user-related information related to the user obtained when a predetermined user succeeds in first authentication performed when the user uses the first service providing apparatus, in association with the user; identifying means for identifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful; determining means for determining recommended information when using the second service providing device based on the user-related information and the function provided by the second service providing device; notification means for notifying the user of the recommended information; Prepare.
  • a recommendation system includes: a first service providing device that makes the service available in response to the success of the first authentication; a second service providing device that makes the service available in response to the success of the second authentication; a recommendation device;
  • the recommendation device is registration means for registering user-related information related to the user obtained when the first authentication performed by the predetermined user succeeds when the user uses the first service providing apparatus, in association with the user; , identifying means for identifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful; determining means for determining recommended information when using the second service providing device based on the user-related information and the function provided by the second service providing device; notification means for notifying the user of the recommended information; Prepare.
  • a recommendation method includes: the computer Registering user-related information related to the user acquired when the predetermined user succeeds in first authentication performed when the user uses the first service providing device, in association with the user, identifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing device is successful; determining recommended information for using the second service providing device based on the user-related information and the function provided by the second service providing device; The recommended information is notified to the user.
  • a recommendation program includes: a registration process of registering user-related information related to the user obtained when the first authentication performed by the predetermined user is successful when using the first service providing apparatus, in association with the user; a specifying process of specifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful; a determination process of determining recommended information when using the second service providing device based on the user-related information and the function provided by the second service providing device; a notification process for notifying the user of the recommended information; run on the computer.
  • FIG. 1 is a block diagram showing the configuration of a recommendation device according to the first embodiment;
  • FIG. 4 is a flow chart showing the flow of a recommendation method according to the first embodiment;
  • FIG. 11 is a block diagram showing the overall configuration of a recommendation system according to a second embodiment;
  • FIG. 9 is a block diagram showing the configuration of a user terminal according to the second embodiment;
  • FIG. FIG. 11 is a block diagram showing the configuration of an authentication device according to the second embodiment;
  • FIG. 9 is a flow chart showing the flow of face information registration processing by the authentication device according to the second embodiment;
  • FIG. 9 is a block diagram showing the configuration of an authentication terminal according to the second embodiment;
  • FIG. FIG. 11 is a block diagram showing the configuration of a recommendation device according to a second embodiment;
  • FIG. 10 is a flow chart showing the flow of user-related information registration processing according to the second embodiment; 9 is a flow chart showing the flow of face authentication processing according to the second embodiment; 13 is a flowchart showing the flow of recommendation processing according to the second embodiment; FIG. 11 is a diagram showing a display example of recommendation information according to the second embodiment; FIG. 11 is a diagram showing a display example of recommendation information according to the second embodiment;
  • FIG. 1 is a block diagram showing the configuration of a recommendation device 1 according to the first embodiment.
  • the recommendation device 1 recommends a user who has been successfully authenticated when using a service providing device (not shown) based on the user-related information accumulated when authentication was successful in the past and the function provided by the service providing device that has been successfully authenticated this time.
  • the service providing device includes, but is not limited to, an entrance/exit gate device, a vending machine, a multi-function device such as a printer, and the like.
  • each service providing device provides a service by the providing function of the device when the authentication is successful.
  • the first service providing device makes available the service related to the providing function in response to the success of the first authentication.
  • the second service providing device makes available the service related to the providing function according to the success of the second authentication.
  • the functions to be provided include, for example, unlocking entrance/exit gates, payment for sales of products, printing, and the like, but are not limited to these.
  • an authentication terminal is connected to each service providing device.
  • each service providing device may have a built-in authentication terminal.
  • the authentication terminal acquires personal authentication information from the user who intends to use the provided function of the connected service providing device, and transmits the personal authentication information to the recommendation device 1 or the authentication device. Therefore, the user who uses the service providing apparatus needs to register his/her personal authentication information (for registration) in the authentication apparatus in advance. Then, the authentication terminal receives the authentication result, and when the authentication is successful, notifies the service providing apparatus of the fact, and provides the service corresponding to the function.
  • the “authentication information” is information used for authentication of identity verification, and is information for uniquely specifying (identifying) the person.
  • the personal authentication information is, for example, biometric information, information on an identification card, display information in which a personal number is coded, and the like. However, the personal authentication information is not limited to these.
  • the recommendation device 1 is connected to each authentication terminal via a communication network (not shown, hereinafter the communication network is also simply referred to as a network) or predetermined wireless communication. It does not matter whether the network is wired or wireless, and the type of communication protocol does not matter.
  • the recommendation device 1 performs first authentication when a predetermined user uses the first service providing device and second authentication when the user uses the second service providing device. and may be controlled. Then, the recommendation device 1 acquires the user authentication information (for authentication) from the authentication terminal described above, and compares the user authentication information for authentication with the authentication information for registration registered in the authentication device. , to control authentication. Alternatively, the authentication terminal may transmit the acquired personal authentication information to the authentication device and transmit the received authentication result to the recommendation device 1 . That is, the recommendation device 1 may receive the authentication results of the first authentication and the second authentication, and perform processing according to the received authentication results.
  • the recommendation device 1 includes a registration unit 11, a specification unit 12, a determination unit 13, and a notification unit 14.
  • the registration unit 11 registers user-related information associated with a user, which is acquired when a predetermined user succeeds in first authentication performed when the user uses the first service providing apparatus, in association with the user.
  • the user-related information is information acquired when the user authenticates or uses the first service providing apparatus.
  • the user-related information includes, for example, an authentication result, physical condition information of the user, operation information (operation history) of the first service providing apparatus, and the like.
  • the authentication result includes, for example, time information (authentication time, etc.), authentication location, type of the first service providing device, installation location of the first service providing device, and the like.
  • the physical condition information is information indicating the health condition of the user.
  • the physical condition information includes, for example, the body surface temperature measured by the user, flag information indicating whether the user is in good physical condition, and the like.
  • the registration unit 11 associates user-related information with (identification information of) a user and registers them in an internal or external storage device.
  • the specifying unit 12 specifies the user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful. That is, the specifying unit 12 acquires user-related information associated with the identification information of the user specified when the second authentication is successful, from the storage device.
  • the determining unit 13 determines recommended information for using the second service providing device based on the specified user-related information and the provided functions of the second service providing device.
  • the recommendation information is information for recommending (providing) to the user who has succeeded in the second authentication.
  • the recommendation information may be information indicating a product that is recommended as more appropriate considering the physical condition of the user among the products that can be purchased by the second service providing apparatus.
  • the recommendation information may be privilege information applicable when using the second service providing apparatus.
  • the recommended information is not limited to these.
  • the determination unit 13 may determine recommendation information using a recommendation model that inputs user-related information, provided functions, and the like and outputs recommendation information based on a predetermined logic.
  • the recommendation model can be machine-learned using teacher data in which user-related information and the like are used as input data and the adoption result of the recommended information is used as correct answer data.
  • the determination unit 13 may derive the first information from the user-related information, the provided function, and the like, and determine the recommended information by a predetermined logic or the like based on the determination result of the first information.
  • the notification unit 14 notifies the user of the recommended information.
  • the notification unit 14 notifies (transmits) the recommendation information to the second service providing device, the authentication terminal connected to or built into the second service providing device, or the user terminal owned by the user.
  • the specifying unit 12 may specify user-related information upon successful authentication of two or more service providing apparatuses used before using the second service providing apparatus when the second authentication is successful.
  • the specifying unit 12 may specify the user-related information at the time of successful authentication of the service providing device used in the past, not immediately before the second service providing device, when the second authentication is successful. For example, it is assumed that a user uses a plurality of service providing apparatuses requiring authentication in the following order: (1) entrance gate, (2) vending machine, and (3) multifunction machine. Then, the recommendation device 1 registers the user-related information D1 and D2 of (1) and (2) in association with the user.
  • the recommendation device 1 specifies (1) the user-related information D1 at the time of successful authentication at the entrance gate (without using the immediately preceding D2). ) D1 may be used to determine recommended information.
  • the (2) vending machine that was used just before (3) when using the MFP does not necessarily have to be the "first service providing apparatus".
  • the recommendation device 1 identifies (1) the entrance gate and (2) the user-related information D1 and D2 upon successful authentication of the vending machine. , D1 and D2, the recommended information may be determined.
  • FIG. 2 is a flow chart showing the flow of the recommendation method according to the first embodiment.
  • the registration unit 11 associates user-related information related to a user, which is acquired when the first authentication performed when a predetermined user uses the first service providing apparatus is successful, with the user. Register (S11).
  • the specifying unit 12 specifies user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful (S12). Then, the determining unit 13 determines recommendation information for using the second service providing device based on the user-related information and the function provided by the second service providing device (S13). After that, the notification unit 14 notifies the user of the recommended information (S14).
  • the recommendation device 1 based on the information acquired at the time of authentication when using the first service providing device, adds the function to be provided when the authentication of the second service providing device is successful. Determine and notify recommendation information. In other words, using information acquired at the time of authentication at one authentication terminal, it is possible to provide useful information at the time of using another authentication terminal. Therefore, the recommendation device 1 can recommend appropriate information according to the state of the user.
  • the recommendation device 1 includes a processor, a memory, and a storage device (not shown). Further, the storage device stores a computer program in which the processing of the recommendation method according to the present embodiment is implemented. Then, the processor loads the computer program from the storage device into the memory and executes the computer program. Thereby, the processor implements the functions of the registration unit 11 , the identification unit 12 , the determination unit 13 and the notification unit 14 .
  • each component of the recommendation device 1 may be realized by dedicated hardware.
  • part or all of each component of each device may be implemented by general-purpose or dedicated circuitry, processors, etc., or combinations thereof. These may be composed of a single chip, or may be composed of multiple chips connected via a bus.
  • a part or all of each component of each device may be implemented by a combination of the above-described circuits and the like and programs.
  • a processor a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), or the like can be used.
  • the plurality of information processing devices, circuits, etc. may be centrally arranged or distributed. may be placed.
  • the information processing device, circuits, and the like may be implemented as a form in which each is connected via a communication network, such as a client-server system, a cloud computing system, or the like.
  • the functions of the recommendation device 1 may be provided in a SaaS (Software as a Service) format.
  • FIG. 3 is a block diagram showing the overall configuration of a recommendation system 1000 according to the second embodiment.
  • the recommendation system 1000 notifies the user of recommended information when authentication for use of another service providing apparatus succeeds based on the authentication history or the like when using a plurality of service providing apparatuses installed in the building 20.
  • information system Note that the recommendation system 1000 is not limited to the service providing apparatus installed in the building 20, and may notify recommendation information when using a plurality of service providing apparatuses installed in various facilities and areas.
  • the recommendation system 1000 includes a user terminal 100, authentication terminals 200-1 to 200-3, a gate device 300-1, a vending machine 300-2, a multifunction device 300-3, an authentication device 400, and a recommendation device 500.
  • User terminal 100, authentication terminals 200-1 to 200-3, gate device 300-1, vending machine 300-2, multifunction device 300-3, authentication device 400, and recommendation device 500 are connected via network N.
  • the network N is a wired or wireless communication line such as the Internet.
  • identity authentication information is information used for authentication of identity confirmation (personal authentication, identity identification processing, etc.), and is information for uniquely identifying (identifying) the person.
  • personal authentication will be described as face authentication, which is an example of biometric authentication
  • personal authentication information personal identification information
  • facial feature information which is an example of biometric information.
  • biometric authentication and biometric information can be applied to other techniques that use a photographed image of a person.
  • biometric information may be data (feature amounts) calculated from physical features unique to an individual, such as fingerprints, voiceprints, veins, retinas, irises, and palm patterns.
  • biometric authentication instead of biometric authentication, other personal authentication may be applied, and the biometric information may also be other personal authentication information.
  • personal authentication information includes a user ID, a combination of an ID and a password, the contents of an identification card such as my number or driver's license (identification number and password), an electronic certificate, code information, and the like. , but not limited to.
  • the code information may be a two-dimensional code such as a QR code (registered trademark).
  • the user terminal 100 is an information terminal that the user U1 possesses, carries, operates, or wears, and that transmits and receives data to and from the recommendation device 500 via the network N by wireless communication. Note that each of the users U2 and U3 may also possess a terminal having functions equivalent to those of the user terminal 100.
  • FIG. The user terminal 100 is a mobile phone terminal, a smart phone, a tablet terminal, a wearable terminal, or the like.
  • the user terminal 100 performs short-range wireless communication with a wearable device worn by the user U1 or an insole sensor embedded in the shoe of the user U1, and obtains a detection result or a measurement result from the wearable device or the insole sensor. good too.
  • the user terminal 100 regards the acquired detection result or measurement result as at least part of the user's physical condition information.
  • FIG. 4 is a block diagram showing the configuration of the user terminal 100 according to the second embodiment.
  • User terminal 100 includes camera 110 , storage unit 120 , memory 130 , communication unit 140 , input/output unit 150 and control unit 160 .
  • the camera 110 is an imaging device that performs imaging under the control of the control unit 160 .
  • the storage unit 120 is an example of a storage device including non-volatile memory such as flash memory and SSD (Solid State Drive).
  • the storage unit 120 stores a program 121 , location information 122 , personal authentication information 123 and physical condition information 124 .
  • the program 121 is a computer program in which processes including a user registration process, a user's physical condition information acquisition process, a physical condition information transmission process, a recommended information display process, and the like, which will be described later, are implemented.
  • the location information 122 is GPS (Global Positioning System) information or the like, and is information indicating the current location of the user terminal 100 .
  • the personal authentication information 123 is identification information for specifying the user carrying the user terminal 100 .
  • the personal authentication information 123 may be biometric information such as a facial image, facial feature information, or other personal authentication information described above.
  • the physical condition information 124 includes the above-described detection result or measurement result, input information (text, flag, etc.) of the health condition by the user U1, or the like. Note that the storage unit 120 does not necessarily need to store the location information 122 , the personal authentication information 123 and the physical condition information 124 .
  • the memory 130 is a volatile storage device such as RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 160 operates.
  • the communication unit 140 is a communication interface with the network N. FIG. The communication unit 140 may also communicate with GPS satellites.
  • the input/output unit 150 includes a display device (display unit) such as a screen and an input device (input unit). The input/output unit 150 is, for example, a touch panel.
  • the control unit 160 is a processor that controls hardware of the user terminal 100 .
  • the control unit 160 loads the program 121 from the storage unit 120 into the memory 130 and executes it. Thereby, the control unit 160 realizes the functions of the registration unit 161 , the acquisition unit 162 and the display control unit 163 .
  • the registration unit 161 performs user information registration processing. Specifically, the registration unit 161 receives the face image and personal information of the user U1 input by the user U1. The registration unit 161 transmits a registration request for user information including the received face image and personal information to the recommendation device 500 via the network N. FIG. Note that the registration unit 161 may include other personal authentication information for registration in the user information registration request instead of the face image. The registration unit 161 may receive the user ID issued at the time of registration of the user information from the recommendation device 500 via the network N and register it in the storage unit 120 as the personal authentication information 123 .
  • the registration unit 161 performs processing for acquiring physical condition information of the user and processing for transmitting physical condition information. Specifically, the registration unit 161 sends a registration request including the physical condition information, the current position, and the face image (personal authentication information) acquired by the acquisition unit 162 as described later via the network N at any timing. and transmits it to the recommendation device 500 .
  • the registration unit 161 may include other personal authentication information in the physical condition information registration request for authentication instead of the face image. That is, the registration unit 161 does not necessarily need to transmit a face image each time physical condition information is transmitted.
  • the registration unit 161 may transmit the physical condition information to the authentication terminal 200 when a short-range wireless communication connection is established with the authentication terminal 200 . In that case, the physical condition information is transmitted from the authentication terminal 200 to. Alternatively, the registration unit 161 may transmit the physical condition information to the recommendation device 500 via the network N.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • the registration unit 161 receives information (adoption result) input by the user U1 indicating whether or not the recommendation information displayed on the display control unit 163, which will be described later, is adopted, and sends the adoption result to the recommendation device via the network N. 500.
  • the acquisition unit 162 performs a process of acquiring physical condition information of the user.
  • the physical condition information includes the user's health condition and the like.
  • the acquisition unit 162 acquires measured values (vital data) such as the user's body temperature, pulse rate, heart rate, etc., as the state of health.
  • the acquisition unit 162 acquires a measured value as physical condition information from a health measuring instrument.
  • the health condition measuring instrument may be built in the user terminal 100 when the user terminal 100 is a wearable terminal.
  • a sensor such as a wearable terminal worn by the user may acquire the measured value of the user's health condition
  • the acquiring unit 162 may acquire the measured value as physical condition information from the wearable terminal or the like by short-range wireless communication.
  • the health condition may be gait information of the user detected by a detection device (insole sensor) embedded in the insole (insole of the shoe) worn by the user.
  • the gait information includes information indicating stride length, walking speed, ground contact angle, outside turning distance (toe direction, foot lift height), take-off angle, and the like.
  • the acquisition unit 162 may acquire the detected value of the gait information from the insole sensor as the state of health, that is, the physical condition information by short-range wireless communication.
  • the acquisition unit 162 may also acquire, as the health condition, an input value from the user on the health condition report screen.
  • the input value may be, for example, health information such as body temperature, or an answer (selected value such as physical condition, degree of fatigue, etc., or text information) displayed on the report screen.
  • the acquisition unit 162 may perform the state information acquisition process periodically. Periodic means, for example, every hour or once a day, but the interval is not limited to these.
  • the acquisition unit 162 acquires GPS information indicating the current position of the user terminal 100 via the communication unit 140 as position information, and stores it in the storage unit 120 as position information 122 . Further, the acquisition unit 162 may acquire a captured image of the user captured by the camera 110 and store it in the storage unit 120 as the personal authentication information 123 .
  • the display control unit 163 When the display control unit 163 receives recommendation information from the recommendation device 500 via the network N, the display control unit 163 displays the recommendation information on the input/output unit 150 .
  • the authentication device 400 is an information processing device that manages user's facial feature information.
  • the authentication device 400 compares the face image or face feature information included in the request with the face feature information of each user, and requests the matching result (authentication result). Reply to original.
  • FIG. 5 is a block diagram showing the configuration of the authentication device 400 according to the second embodiment.
  • the authentication device 400 includes a face information DB (DataBase) 410 , a face detection section 420 , a feature point extraction section 430 , a registration section 440 and an authentication section 450 .
  • the face information DB 410 associates and stores a user ID 411 and face feature information 412 of the user ID.
  • the facial feature information 412 is a set of feature points extracted from the facial image.
  • the authentication device 400 may delete the facial feature information 412 in the facial feature DB 410 in response to a request from a user or the like corresponding to the facial feature information 412 .
  • authentication device 400 may delete facial feature information 412 after a certain period of time has passed since registration.
  • the face detection unit 420 detects a face area included in a registration image for registering face information, and outputs it to the feature point extraction unit 430 .
  • Feature point extraction section 430 extracts feature points from the face area detected by face detection section 420 and outputs facial feature information to registration section 440 . Further, the feature point extraction unit 430 extracts feature points included in the face image received from the recommendation device 500 or the like, and outputs face feature information to the authentication unit 450 .
  • the registration unit 440 newly issues a user ID 411 when registering facial feature information.
  • the registration unit 440 associates the issued user ID 411 with the facial feature information 412 extracted from the registered image and registers them in the facial information DB 410 .
  • Authentication unit 450 performs face authentication using facial feature information 412 . Specifically, the authentication unit 450 collates the facial feature information extracted from the facial image with the facial feature information 412 in the facial information DB 410 . If the verification is successful, the authentication unit 450 identifies the user ID 411 associated with the verified facial feature information 412 .
  • the authenticating unit 450 replies to the requester as a face authentication result indicating whether or not the facial feature information matches. Whether the facial feature information matches or not corresponds to the success or failure of the authentication. Note that matching of facial feature information (matching) means a case where the degree of matching is equal to or greater than a threshold. Also, the face authentication result shall include the specified user ID when the face authentication is successful.
  • FIG. 6 is a flow chart showing the flow of face information registration processing by the authentication device according to the second embodiment.
  • the information registration terminal (not shown) photographs the user's body including the face, and transmits a face information registration request including the photographed image (registered image) to the authentication device 400 via the network N.
  • the information registration terminal is, for example, an information processing device such as a personal computer, a smart phone, or a tablet terminal.
  • the information registration terminal may be the user terminal 100 or the like.
  • the information registration terminal is the recommendation device 500 that has received a registration request from the user terminal 100 or the like.
  • the authentication device 400 receives a face information registration request (S201). For example, the authentication device 400 receives a face information registration request via the network N from the recommendation device 500 .
  • the face detection unit 420 detects a face area from the face image included in the face information registration request (S202). Then, the feature point extraction unit 430 extracts feature points (facial feature information) from the face area detected in step S202 (S203). Then, the registration unit 440 issues a user ID 411 (S204). Then, the registration unit 440 associates the extracted facial feature information 412 with the issued user ID 411 and registers them in the facial information DB 410 (S205). After that, the registration unit 440 returns the issued user ID 411 to the request source (information registration terminal, for example, the recommendation device 500) (S206).
  • the request source information registration terminal, for example, the recommendation device 500
  • Gate device 300 - 1 , vending machine 300 - 2 and multi-function device 300 - 3 are examples of service providing devices installed in building 20 .
  • the gate device 300-1, the vending machine 300-2, and the multifunction device 300-3 may be simply referred to as the "service providing device 300" when there is no particular need to distinguish them.
  • the service providing device 300 can also be applied to devices such as lockers, cash register terminals, digital signage, etc., which are used together with authentication terminals.
  • the recommendation system 1000 includes at least a plurality of service providing devices 300 having different providing functions.
  • the gate device 300-1 is a control device for an entrance/exit gate installed at the entrance of the building 20.
  • the gate device 300-1 unlocks the gate upon successful authentication by the connected or built-in authentication terminal 200-1. For example, when user U1 is successfully authenticated by authentication terminal 200-1, the gate is unlocked by gate device 300-1, so that user U1 can enter building 20.
  • FIG. The result of authentication by the authentication terminal 200-1, particularly the successful authentication time, may be used to record the attendance and leaving of the company's employees.
  • the entrance/exit gate may be a flapper gate or without a flapper (so-called gateless).
  • the vending machine 300-2 is a device (merchandise vending machine) that sells commodities upon successful authentication by the connected or built-in authentication terminal 200-2.
  • Vending machine 300-2 may be, for example, a multi-food vending machine. For example, when user U2 is successfully authenticated by authentication terminal 200-2, vending machine 300-2 displays a group of commodities that can be sold to user U2, and makes payment for the commodities selected by user U2. , to output the product.
  • the multi-function device 300-3 is a service providing device capable of providing the functions of multiple devices such as copiers, printers (printing machines), scanners, and FAX machines.
  • the multi-function device 300-3 accepts the operation of the user U3 and provides services (processing) by each function when the authentication terminal 200-3 connected to or incorporated therein succeeds in authentication. For example, when user U3 is successfully authenticated by authentication terminal 200-3, multifunction device 300-3 accepts a copy operation from user U3 and performs copy processing (outputs a copy result). Also, the multi-function device 300-3 prints electronic data according to instructions from a PC or the like. At this time, the authentication may be performed by either or both of the authentication terminal 200-3 and the PC.
  • the user uses a PC or the like to specify the multifunction peripheral 300-3 as the print output destination and issue a print instruction. Then, when the user selects printing of the digitized document in the multifunction device 300-3, the authentication terminal 200-3 photographs the user's face, and compares the photographed face and the pre-registered face. Confirm identity by authentication. If the identity verification is successful, the multi-function device 300-3 prints and outputs the electronic manuscript.
  • FIG. 7 is a block diagram showing the configuration of the authentication terminal 200 according to the second embodiment.
  • Authentication terminal 200 includes camera 210 , storage unit 220 , memory 230 , communication unit 240 , input/output unit 250 and control unit 260 .
  • the camera 210 is an imaging device that performs imaging under the control of the control section 260 .
  • the storage unit 220 is an example of a storage device including non-volatile memory such as flash memory and SSD (Solid State Drive).
  • Storage unit 220 stores program 221 .
  • the program 221 is a computer program in which processing including authentication request processing for starting service providing processing, which will be described later, is implemented.
  • program 221 includes a client application corresponding to service providing apparatus 300 .
  • the memory 230 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 260 operates.
  • the communication unit 240 is a communication interface with the network N.
  • the input/output unit 250 includes a display device (display unit) such as a screen and an input device (input unit).
  • the input/output unit 250 is, for example, a touch panel.
  • the control unit 260 is a processor that controls hardware of the authentication terminal 200 .
  • the control unit 260 loads the program 221 from the storage unit 220 into the memory 230 and executes it. Thereby, the control unit 260 realizes the functions of the display control unit 261 , the authentication requesting unit 262 and the processing control unit 263 .
  • the display control unit 261 causes the input/output unit 250 to display the screen generated by executing the program 221 .
  • the display control unit 261 may display a message prompting the user to photograph the face for face authentication.
  • the display control unit 261 may display a message prompting the user to enter user-related information when face authentication is successful.
  • the display control unit 261 may display a message prompting input of physical condition information.
  • the display control unit 261 may display the recommendation information notified by the recommendation device 500 .
  • the display control unit 261 displays a group of products that can be sold.
  • the display control unit 261 displays the menu of the multifunction device.
  • the authentication requesting unit 262 extracts, as a face image, a face region of a person detected from an image of the user captured by the camera 210, and performs authentication including the face image, time information, terminal location information, or the type of the service providing device 300. A request is sent to the recommendation device 500 . Note that the authentication request may not include the time information. Note that the authentication requesting unit 262 may transmit a face authentication request including a face image to the authentication device 500 and receive a face authentication result from the authentication device 500 . Then, when the face authentication result indicates success, the authentication requesting unit 262 extracts the user ID included in the face authentication result, and sends information including the user ID, time information, the type of the service providing device 300, and the like to the recommending device. 500.
  • the authentication requesting unit 262 may acquire biometric information or other personal authentication information from the user in addition to or instead of the facial image, and include the acquired personal authentication information in the authentication request.
  • the authentication terminal 200 may establish short-range wireless communication with the user terminal 100 of a nearby user and acquire personal authentication information from the user terminal 100 .
  • the authentication terminal 200 may acquire the personal authentication information by reading code information on which a code corresponding to the personal authentication information is printed.
  • the authentication terminal 200 may acquire personal authentication information from an employee ID or the like in which an IC (Integrated Circuit) chip is embedded.
  • the processing control unit 263 controls processing specific to the service providing device 300 connected to the authentication terminal 200. For example, processing control unit 263 outputs an unlocking instruction to gate device 300-1 when authentication is successful. Further, when the authentication is successful, the processing control unit 263 outputs a product selection or purchase permission signal to the vending machine 300-2. Further, when the authentication is successful, the processing control unit 263 outputs a use permission signal for the function of the multifunction device to the multifunction device 300-3.
  • the processing control unit 263 acquires user-related information before authentication or upon successful authentication, and transmits a registration request including the user-related information and personal authentication information to the recommendation device 500 .
  • the processing control unit 263 acquires physical condition information input by the user as user-related information.
  • the processing control unit 263 may establish short-range wireless communication with the user terminal 100 of a nearby user and acquire physical condition information from the user terminal 100 .
  • the processing control unit 263 may acquire, as the user-related information, a measurement value from the user by a measuring device installed near or built in the service providing device 300 .
  • the measuring device may be, for example, a thermo camera or the like that measures the body surface temperature of the user.
  • the processing control unit 263 may acquire information on products purchased by the user and payment information as user-related information in response to successful authentication. Note that even when the service providing apparatus 300 is a payment terminal (cash register terminal) that performs payment by face authentication, the processing control unit 263 acquires product information and payment information purchased by the user in response to successful authentication as user-related information. do it. Further, when the service providing apparatus 300 is the multifunction device 300-3, the processing control unit 263 acquires operation information such as operation details and functions of the multifunction device input in response to successful authentication as user-related information. good too.
  • the processing control unit 263 when receiving recommendation information notified by the recommendation device 500 , the processing control unit 263 outputs the recommendation information to the display control unit 261 . Further, when receiving recommendation information notified by the recommendation device 500 , the processing control unit 263 may output the recommendation information to the service providing device 300 connected to the authentication terminal 200 . For example, when the recommendation information indicates a product recommended for purchase, processing control unit 263 outputs information recommending purchase of the product to vending machine 300-2.
  • the recommendation device 500 is an example of the recommendation device 1 described above.
  • the recommendation device 500 is an information processing device that performs user registration processing, user-related information registration processing, recommendation processing, and the like (recommendation method according to the second embodiment).
  • the recommendation device 500 may be made redundant by a plurality of servers, and each functional block may be implemented by a plurality of computers.
  • FIG. 8 is a block diagram showing the configuration of the recommendation device 500 according to the second embodiment.
  • the recommendation device 500 includes a storage unit 510 , a memory 520 , a communication unit 530 and a control unit 540 .
  • Storage unit 510 is an example of a storage device such as a hard disk, flash memory, or SSD.
  • the storage unit 510 stores a program 511 , user information 512 and service providing device information 513 .
  • a program 511 is a computer program in which the processing of the recommendation method according to the second embodiment is implemented.
  • the user information 512 is information for managing users of the recommendation system 1000 .
  • the user information 512 is information in which a user ID 5121, personal information 5122, terminal information 5123, and user related information 5124 are associated with each other.
  • User ID 5121 is user identification information.
  • the user ID 5121 is information identically or uniquely corresponding to the user ID 411 managed in association with the facial feature information 412 in the face information DB 410 of the authentication device 400 . Therefore, the user information 512 can be said to be information associated with the personal authentication information for registration of the user via the user ID 5121 .
  • the personal information 5122 may include the user's name, gender, date of birth, address, nationality, contact information, payment information, and the like.
  • the personal information 5122 may also include the user's medical information (medical history), health information (allergy information), hobbies and preferences, and the like.
  • personal information 5122 may also include information on the user's family.
  • the terminal information 5123 is information that serves as a notification destination for the user terminal 100 owned by the user.
  • the terminal information 5123 is, for example, a mobile phone number, an e-mail address, an application user ID, a social network service account, and the like.
  • the user-related information 5124 includes at least an authentication result 51241, physical condition information 51242, and operation information 51243.
  • the authentication result 51241 includes time information and at least one of terminal position information, the type of the service providing device 300, and the installation position of the service providing device 300.
  • FIG. The time information includes the time when the authentication terminal 200 acquires the personal authentication information, the time when the authentication request is sent and received, the time when the authentication is successful (authentication time, authentication success time), and the like.
  • the terminal location information is identification information of the authentication terminal 200 that has transmitted the authentication request. It is assumed that the terminal location information is associated with the device ID and device type of the service providing device, which will be described later.
  • the type of the service providing device 300 is information indicating the device type of the service providing device, which will be described later.
  • the installation location of the service providing device 300 is location information or the like for specifying the installation location of the service providing device 300 .
  • the physical condition information 51242 includes the user's detection result or measurement result at the time of authentication, and the user's health condition input information.
  • the operation information 51243 is the contents of operations performed by the user on the service providing apparatus 300 at the time of authentication, functions used, and the like. Also, the operation information 51243 may include the data content (text, etc.) printed using the MFP 300-3. Also, the user-related information 5124 may include a purchase history by a payment terminal using face authentication.
  • the service providing device information 513 is information that defines the functions provided by the service providing device.
  • the service providing device information 513 is information in which a device ID 5131, a device type 5132, and a providing function 5133 are associated with each other.
  • the device ID 5131 is identification information of the service providing device.
  • the device type 5132 is information indicating the type of service providing device.
  • the device type 5132 is information indicating, for example, a gate device, a vending machine, a multifunction device, or the like.
  • the provided function 5133 is information indicating a function (service) that the service providing apparatus can provide when authentication is successful. For example, if the device type 5132 is a gate device, the provided function 5133 is unlocking the gate.
  • the provided function 5133 is a list of products that can be sold. For example, if the vending machine 300-2 is a food and beverage vending machine, the provision function 5133 includes the product name, price, etc. of the beverage or food.
  • the provided functions 5133 are copying, printing, scanning, facsimile, etc., and may include details and settings of each function.
  • the memory 520 is a volatile storage device such as RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 540 operates.
  • a communication unit 530 is a communication interface with the network N. FIG.
  • the control unit 540 is a processor that controls each component of the recommendation device 500, that is, a control device.
  • the control unit 540 loads the program 511 from the storage unit 510 into the memory 520 and executes the program 511 .
  • the control unit 540 realizes the functions of the registration unit 541 , the authentication control unit 542 , the determination unit 543 , the identification unit 544 , the acquisition unit 545 , the determination unit 546 and the notification unit 547 .
  • the registration unit 541 is an example of the registration unit 11 described above.
  • the registration unit 541 performs user information registration processing. Specifically, the registration unit 541 receives a user information registration request from the user terminal 100 , generates user information 512 , and registers it in the storage unit 510 .
  • the registration request includes the user's face image and personal information.
  • registration unit 541 transmits a face information registration request including the face image included in the registration request to authentication device 400 and acquires a user ID issued from authentication device 400 in response to registration of the face information.
  • registration unit 541 may issue a new user ID.
  • the registration unit 541 generates user information 512 by associating the issued user ID 5121 with the personal information 5122 included in the registration request and the terminal information 5123 of the user terminal 100 that requested the registration. As described above, since the user ID is associated with the facial feature information, it can be said that the registration unit 541 preliminarily registers the personal authentication information for registration of the user and the personal information as user information in association with each other.
  • the user information registration request may include personal authentication information other than the face image. In that case, the registration unit 541 generates and registers the user information 512 using the personal authentication information included in the registration request.
  • the registration unit 541 also registers the user-related information 5124 acquired before or after authentication in the user information 512 in association with the successfully authenticated user ID 5121 . Specifically, the registration unit 541 registers at least one of the authentication result 51241, the physical condition information 51242, and the operation information 51243 in the user information 512 in association with the successfully authenticated user ID 5121. FIG. Note that the registration unit 541 may register, in the user information 512, the history of the determined recommendation information, the adoption/rejection result of the recommendation information, and the like.
  • the authentication control unit 542 controls face authentication for the face image included in the received authentication request. Specifically, authentication control unit 542 transmits a face authentication request including a face image to authentication device 400 and receives a face authentication result from authentication device 400 . Then, the authentication control unit 542 determines the success or failure of the authentication from the face authentication result received from the authentication device 400, and specifies the user ID included in the face authentication result when the authentication is successful. Note that the authentication control unit 542 may detect the user's face area from the face image and include the image of the face area in the face authentication request. Alternatively, the authentication control unit 542 may extract facial feature information from the face area and include the facial feature information in the face authentication request.
  • personal authentication is not limited to face authentication, and the authentication control unit 542 may control authentication using personal authentication information for registration and authentication.
  • the authentication control unit 542 appropriately selects personal authentication information for registration registered in the authentication device or inside according to the type of personal authentication information. Authentication is performed by controlling matching with Then, when the authentication is successful, the authentication control unit 542 identifies the corresponding user ID.
  • the determination unit 543 determines the physical condition of the user based on the user-related information. Specifically, the determination unit 543 determines whether the user's physical condition is better or worse than a predetermined condition based on the physical condition information included in the user-related information. Alternatively, the determination unit 543 may determine whether the physical condition of the user is better or worse than a predetermined state based on the attendance/leaving information based on the authentication times included in the authentication results at multiple points of time in the user-related information. Furthermore, the determination unit 543 may determine whether the user's physical condition is better or worse than a predetermined state based on the degree of user's operation error based on the operation information included in the user-related information.
  • the identification unit 544 is an example of the identification unit 12 described above. If the authentication is successful, the identifying unit 544 identifies the provided function 5133 from the service providing device information 513 based on the type of the service providing device 300 included in the authentication request.
  • the acquisition unit 545 acquires user-related information from the authentication terminal 200 before or after authentication.
  • the user-related information to be acquired may include the user's face image taken at the time of the first authentication.
  • the determination unit 546 is an example of the determination unit 13 described above. Also, the determination unit 546 may include the function of the determination unit 543 described above. That is, the determination unit 546 determines the physical condition of the user based on the user-related information, and determines the recommended information based on the physical condition and the provision function of the second service providing apparatus.
  • the second service providing device is a service providing device that is used at least after user-related information has been accumulated in advance by first authentication success when using the first service providing device. Then, the determining unit 546 determines recommended information based on the success of the second authentication when using the second service providing apparatus.
  • the determining unit 546 may generate the attendance/leaving information of the user from the authentication times in the plurality of first authentications of the user who succeeded in the second authentication, and determine the physical condition of the user from the attendance/leaving information. . Further, the determination unit 546 may analyze the face image captured during the first or second authentication to derive the fatigue level of the user, and determine the fatigue level as the state of physical condition.
  • the determination unit 546 may determine, as recommended information, a food item that can contribute to recovery of the user's physical condition from among the plurality of food items.
  • the determining unit 546 may derive the concentration of the user by analyzing the operation information included in the user-related information, and determine the concentration as the state of physical condition.
  • the determination unit 546 may determine privilege information that can be used for product purchase as recommendation information based on the user-related information.
  • the privilege information may be a discount coupon, points, or the like.
  • the notification unit 547 is an example of the notification unit 14 described above.
  • the notification unit 547 notifies the user terminal 100, the authentication terminal 200, or the service providing apparatus 300 of the success of the authentication. Further, when the second authentication is successful and the physical condition of the user is worse than the predetermined state, the notification unit 547 sends the fact that the second authentication was successful and the recommendation information determined by the determination unit 546 to the user terminal. 100, the authentication terminal 200 or the service providing apparatus 300 is notified.
  • FIG. 9 is a flowchart showing the flow of user-related information registration processing according to the second embodiment.
  • user U1 has completed registration of user information in recommendation device 500 .
  • user U1 is in front of authentication terminal 200-1 and gate device 300-1 of building 20.
  • FIG. At this time, authentication terminal 200-1 captures the face of user U1 with camera 210, and sends an authentication request including the face image, time information, and the device type of gate device 300-1 to recommendation device 500 via network N. Send to
  • the authentication control unit 542 of the recommendation device 500 receives the authentication request from the authentication terminal 200-1 via the network N (S311).
  • the authentication request includes a face image, time information, and the device type of gate device 300-1.
  • the authentication control unit 542 transmits a face authentication request including the face image included in the authentication request to the authentication device 400 via the network N (S312).
  • authentication device 400 performs face authentication processing.
  • FIG. 10 is a flow chart showing the flow of face authentication processing according to the second embodiment.
  • the authentication device 400 receives a face authentication request from the recommendation device 500 via the network N (S211). Note that the authentication device 400 may receive a face authentication request from the user terminal 100 or the like.
  • authentication device 400 extracts facial feature information from the face image included in the face authentication request in the same manner as in steps S202 and S203 described above.
  • the authentication unit 450 of the authentication device 400 compares the facial feature information extracted from the face image included in the face authentication request with the facial feature information 412 of the face information DB 410 (S212), and calculates the matching degree. Then, the authentication unit 450 determines whether or not the degree of matching is equal to or greater than the threshold (S213).
  • the authentication unit 450 identifies the user ID 411 associated with the facial feature information 412 (S214). Then, the authentication unit 450 returns the result of the face authentication including the result of the successful face authentication and the specified user ID 411 to the recommendation device 500 via the network N (S215). If the degree of matching is less than the threshold in step S213, the authentication unit 450 returns the result of face authentication including the failure of the face authentication to the recommendation device 500 via the network N (S216).
  • the authentication control unit 542 of the recommendation device 500 receives the face authentication result from the authentication device 400 via the network N (S313). Then, the authentication control unit 542 determines whether or not the face authentication is successful based on the face authentication result received from the authentication device 400 (S314). When determining that the face authentication has succeeded, the authentication control unit 542 identifies the user ID included in the face authentication result (S315). Then, the notification unit 547 notifies the authentication terminal 200-1 of the success of the authentication via the network N (S316). Note that the notification unit 547 may include an acquisition request for user-related information.
  • authentication terminal 200-1 outputs an unlocking instruction to gate device 300-1. Therefore, user U1 can enter building 20 .
  • Authentication terminal 200-1 also acquires user-related information from user U1 by various methods described above, and transmits the user-related information to recommendation device 500 via network N.
  • the authentication terminal 200-1 may notify the user terminal 100 of the notified success of the authentication by short-range wireless communication or the like. In that case, the user terminal 100 may transmit the user-related information to the recommendation device 500 via the authentication terminal 200-1 or not via the authentication terminal 200-1. At this time, the user terminal 100 may notify the authentication terminal 200-1 of the personal authentication information 123, physical condition information 124, and other user-related information stored in the storage unit 120 by short-range wireless communication or the like.
  • the acquisition unit 545 of the recommendation device 500 acquires user-related information (S317).
  • the acquisition unit 545 receives user-related information via the network N from the authentication terminal 200-1 or the user terminal 100.
  • the acquisition unit 545 may acquire the time information included in the authentication request received in step S311 or the reception time of the face authentication result as the authentication time, that is, the user-related information.
  • the registration unit 541 associates the specified user ID with the acquired user-related information and registers them in the user information 512 (S318).
  • step S314 if it is determined in step S314 that the face authentication has failed, the recommendation device 500 notifies the authentication terminal 200-1 of the authentication failure (S319).
  • steps S312 to S314 are not limited to face authentication, and may be other personal authentication. That is, the authentication control unit 542 performs authentication by controlling matching between the authentication information for authentication included in the authentication request and the authentication information registered in advance. The authentication control unit 542 identifies the user ID associated with the successfully authenticated personal authentication information for registration.
  • FIG. 11 is a flowchart showing the flow of recommendation processing according to the second embodiment. It is assumed that user U2 has completed registration of user information in recommendation device 500, has been successfully authenticated by authentication terminal 200-1, has unlocked gate device 300-1, and has entered building 20. . Then, it is assumed that user-related information of user U2 is registered in recommendation device 500 in accordance with the success of the authentication.
  • the authentication terminal 200-2 captures the face of the user U2 with the camera 210, and sends an authentication request including the face image, time information, and the device type of the vending machine 300-2 to the recommended device via the network N. 500.
  • the recommendation device 500 performs the processes from steps S311 to S315 in FIG. 9 described above (S321). In other words, it is assumed that user U2 has been authenticated successfully and the recommendation device 500 has identified the user ID of user U2.
  • the specifying unit 544 of the recommendation device 500 specifies the user-related information 5124 (for example, authentication time) associated with the specified user ID 5121 (S322).
  • specifying unit 544 specifies, as user-related information, a plurality of authentication times (at gate device 300-1) at a plurality of points in time associated with user U2.
  • the identifying unit 544 identifies the authenticated time when user U2 starts work (attendance time) and the authenticated time when user U2 leaves work (leaving work time) on a plurality of days.
  • the attendance management system (not shown) manages the user ID and the attendance information in association with each other, the identification unit 544 obtains the attendance information associated with the user ID of the user U2 to obtain the user ID. Relevant information may be identified.
  • the attendance/leaving information may include a set of arrival and departure times for each user, monthly working hours, and the like.
  • the determining unit 546 generates attendance/leaving information for the user U2 from the authentication times at a plurality of points in time (S323). For example, the determining unit 546 calculates the difference between the work start time and the work finish time of the user U2 for each day, aggregates the difference, and generates working hours for each month as the work time information. Alternatively, the determining unit 546 may calculate the average working hours per day in a predetermined period and use it as the attendance/leaving information.
  • the identifying unit 544 identifies the provided function 5133 from the service providing device information 513 based on the device type 5132 of the vending machine 300-2 included in the authentication request (S324). For example, the identification unit 544 identifies a product group that can be sold as a function provided by the vending machine 300-2.
  • the product group includes not only the product name and price of each product, but also the product attributes (type, characteristics) and the like. For example, if the product is food or drink, the product attribute may be energy drink, low calorie, or the like.
  • the determination unit 543 determines whether or not the physical condition based on the attendance information is worse than a predetermined condition (S325). For example, the determination unit 543 determines whether the working hours in the most recent month indicated by the attendance/leaving information exceed a predetermined number of hours, or whether the average working hours per day in the most recent week exceeds a predetermined number of hours. do. Then, when the monthly working hours exceed the predetermined hours or when the average working hours exceed the predetermined hours, the determination unit 543 determines that the physical condition is worse than the predetermined state.
  • the determining unit 546 determines recommended information based on the provided function of the identified service providing apparatus (S326). Specifically, when vending machine 300-2 is a vending machine for food and drink, and user U2's physical condition is worse than a predetermined condition, determining unit 546 determines the product group that vending machine 300-2 can sell. Food and drink that can contribute to recovery of the user's physical condition are determined as recommended information. For example, when the user U2 often goes to work early in the morning or leaves work late at night, or when the working hours exceed a predetermined time, the determining unit 546 may decide to use an energy drink or A supplement or the like may be determined as recommended information.
  • the notification unit 547 notifies the authentication terminal 200-2 of the authentication success and the recommendation information (S327).
  • notification unit 547 transmits, via network N, to authentication terminal 200-2, the fact that user U2 has been successfully authenticated and the fact that purchase of an energy drink is recommended.
  • authentication terminal 200-2 outputs to vending machine 300-2 a recommendation to purchase an energy drink.
  • step S325 if it is determined in step S325 that the physical condition is not worse than the predetermined condition, the notification unit 547 notifies the authentication terminal 200-2 of successful authentication (S328).
  • FIG. 12 is a diagram showing a display example of recommendation information according to the second embodiment.
  • vending machine 300-2 and authentication terminal 200-2 are connected, and authentication is successful based on the face image of user U2 photographed by camera 210 of authentication terminal 200-2.
  • the recommendation device 500 determines that the physical condition of the user U2 is worse than a predetermined condition, for example, that the user U2 is tired, and recommends an energy drink that can contribute to the recovery of the physical condition of the user U2. shall be determined as
  • Authentication terminal 200-2 outputs the notified recommendation information to vending machine 300-2, and vending machine 300-2 performs display based on the recommendation information.
  • the vending machine 300-2 has a sales product list display field 310 and a recommendation comment 320.
  • the sales product list display field 310 is a field for displaying at least part of the product group that can be sold by the vending machine 300-2.
  • the sales product list display field 310 indicates that the user U2 is highlighted to purchase the energy drink (second from the left) designated by the recommendation information.
  • a recommended comment 320 is a display field for comments based on recommended information.
  • the recommendation comment 320 shows an example of the comment "You look tired. I recommend an energy drink.”
  • the comment content of the recommendation comment 320 is merely an example.
  • FIG. 13 is a diagram showing a display example of recommendation information according to the second embodiment.
  • an example is shown in which privilege information that can be used for product purchase at the vending machine 300-2 is displayed as recommended information according to the attendance status and working status of the user U2.
  • the recommendation device 500 determines the discount coupon as the recommendation information because the number of days of work for the user U2 in the month exceeds the predetermined value.
  • the vending machine 300-2 has a sales product list display field 310a and a recommendation comment 320a.
  • the sales product list display field 310a is the same as that of FIG. 12 described above, but shows an example in which the product to be recommended is not specified.
  • the sales product list display field 310a may display only a group of products to be discounted (to which the discount coupon is applied), or highlight the products to be discounted.
  • the recommendation comment 320a shows an example of the comment "The number of working days this month has exceeded 20. A 50-yen discount coupon is available."
  • the privilege information may be set by directly discounting the discount amount from the settlement amount.
  • the recommendation information may be a message or the like recommending purchase of a product that can be settled by directly discounting the discount amount from the settlement amount.
  • the recommendation device 500 acquires and registers the physical condition information at the time of going to work as the user-related information when the first authentication for passing through the gate device 300-1 is successful, and when the vending machine 300-2 is used, Beverages and supplements suitable for the current physical condition information may be determined as recommended information.
  • the recommendation device 500 may analyze the facial expression and degree of smile of the user from the face image captured during the first authentication, and determine the degree of fatigue as the physical condition of the user. Then, when the degree of fatigue indicates that the degree of fatigue is worse than a predetermined state, the recommendation device 500 may determine an energy drink or the like that can contribute to the recovery of physical condition as the recommendation information.
  • recommendation device 500 may analyze the degree of concentration of user U3 based on the content of user U3's operation on multifunction device 300-3, and determine the physical condition of the user based on the degree of concentration. good. For example, if the user U3 continues to perform a print canceling operation on the MFP 300-3 (more than a predetermined number of times within a predetermined period of time), the recommendation device 500 determines that the concentration of the user U3 is low (more than a predetermined value). low). Then, when the recommendation device 500 determines that the degree of concentration is lower than a predetermined value, the recommendation device 500 may determine, for example, the purchase of coffee when using the vending machine 300-2 as the recommendation information. Alternatively, the recommendation device 500 may analyze tastes and preferences from text content printed by the user U3 using the multi-function device 300-3, and determine recommendation information based on the analysis results.
  • the service providing device may be a PC that performs login authentication by face authentication.
  • the user-related information may be information on the operation of the PC by the user after successful face authentication.
  • the operation information may include a history of login and logout times, a history of typing operations, and search histories such as web search keywords and browsed pages.
  • the recommendation device 500 may analyze working hours and the degree of typing errors from user U3's PC operation information, and determine the user's health condition (fatigue level and concentration) based on these.
  • the recommendation device 500 may analyze tastes and preferences from the search history of the user U3 and determine recommended information based on the analysis results.
  • the purchase history of products actually purchased at the store will be used to provide recommended products to purchase when using the vending machine. It may be displayed on a providing device or the like.
  • the recommendation device 500 registers, as user-related information, a purchase history of a specific user through a payment terminal using face authentication, and when the user succeeds in authentication of the vending machine, recommending information based on the purchase history through the payment terminal. may be determined and displayed on the vending machine.
  • the recommendation device 500 selects a product other than coffee considering the user's health. It may be determined and displayed on the service providing device or the like.
  • the recommendation device 500 analyzes the user's hobbies and preferences in consideration of the purchase history of the specific product, A product similar to the product may be determined and displayed as a recommended product on the vending machine.
  • the recommendation device 500 registers the user-related information acquired when the first authentication performed for the user U1 to pass through the gate device 300-1 is successful. back. Then, for example, when the user U1 succeeds in the second authentication performed to purchase a drink at the vending machine 300-2, the user-related information of the user U1 and the drink that can be purchased at the vending machine 300-2 recommended information to the user U1 based on the list (attributes of products).
  • the combination of the first service providing device and the second service providing device may be any of gate device 300-1, vending machine 300-2 and multifunction device 300-3, or may be another device. In other words, it is sufficient that the functions provided by the first service providing device and the second service providing device are different.
  • the recommendation information may be based on the providing function of the second service providing device. Further, the user-related information may be based on not only authentication results and physical condition information, but also functions provided by the second service providing apparatus, operation details, or purchase history, as described above.
  • the recommendation device 500 and the like and the authentication device 400 are described as separate information processing devices, but they may be the same.
  • the recommendation device 500 and the like may register facial feature information in association with the user ID 5121 of the user information 512 .
  • the control unit 540 may include the face detection unit 420, the feature point extraction unit 430, the registration unit 440, and the authentication unit 450 shown in FIG.
  • the program includes instructions (or software code) that, when read into a computer, cause the computer to perform one or more of the functions described in the embodiments.
  • the program may be stored in a non-transitory computer-readable medium or tangible storage medium.
  • computer readable media or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drives (SSD) or other memory technology, CDs - ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device.
  • the program may be transmitted on a transitory computer-readable medium or communication medium.
  • transitory computer readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.
  • the determining means is determining the physical condition of the user based on the user-related information;
  • the first service providing device is an entrance/exit gate control device,
  • the user-related information includes the authentication time of the first authentication,
  • the determining means is generating attendance and leaving information of the user from the authentication times in the plurality of first authentications of the user;
  • the recommendation device according to appendix A2, wherein the physical condition of the user is determined from the attendance/leaving information.
  • the user-related information includes a face image of the user taken at the time of the first authentication,
  • the recommendation device according to appendix A2 or A3, wherein the determination unit analyzes the face image to derive the fatigue level of the user, and determines the fatigue level as the physical condition.
  • the second service providing device is a plurality of vending machines for food and drink, When the physical condition indicates that the physical condition is worse than a predetermined condition, the determining means determines, as the recommended information, a food and drink that can contribute to recovery of the user's physical condition from among the plurality of food and drink.
  • the recommendation device according to any one of .
  • the user-related information includes operation information of the user on the first service providing device;
  • the recommendation device according to any one of appendices A2 to A5, wherein the determination unit analyzes the operation information to derive concentration of the user, and determines the concentration as the state of physical condition.
  • the second service providing device is a product vending machine,
  • the recommendation device according to any one of Appendixes A1 to A4, wherein the determination means determines privilege information that can be used for purchasing the product as the recommendation information based on the user-related information.
  • (Appendix B1) a first service providing device that makes the service available in response to the success of the first authentication; a second service providing device that makes the service available in response to the success of the second authentication; a recommendation device;
  • the recommendation device is registration means for registering user-related information related to the user obtained when the first authentication performed by the predetermined user succeeds when the user uses the first service providing apparatus, in association with the user; , identifying means for identifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful; determining means for determining recommended information when using the second service providing device based on the user-related information and the function provided by the second service providing device; notification means for notifying the user of the recommended information; Recommendation system with (Appendix B2)
  • the determining means is determining the physical condition of the user based on the user-related information;
  • the recommendation system according to appendix B1, wherein the recommendation information is determined based on the physical condition and the provision function of the second service providing device.
  • (Appendix C1) the computer Registering user-related information related to the user acquired when the predetermined user succeeds in the first authentication performed when the user uses the first service providing apparatus, in association with the user, identifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing device is successful; determining recommendation information when using the second service providing device based on the user-related information and the function provided by the second service providing device; notifying the user of the recommended information; Recommendation method.
  • (Appendix D1) a registration process of registering user-related information related to the user obtained when the first authentication performed by the predetermined user when the user uses the first service providing apparatus is successful, in association with the user; a specifying process of specifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing apparatus is successful; a determination process of determining recommended information when using the second service providing device based on the user-related information and the function provided by the second service providing device; a notification process for notifying the user of the recommended information;
  • a non-transitory computer-readable medium storing a recommended program that causes a computer to execute
  • recommendation device 11 registration unit 12 identification unit 13 determination unit 14 notification unit 1000 recommendation system N network U1 user U2 user U3 user 100 user terminal 110 camera 120 storage unit 121 program 122 location information 123 personal authentication information 124 physical condition information 130 memory 140 communication Unit 150 Input/output unit 160 Control unit 161 Registration unit 162 Acquisition unit 163 Display control unit 20 Building 200 Authentication terminal 200-1 Authentication terminal 200-2 Authentication terminal 200-3 Authentication terminal 210 Camera 220 Storage unit 221 Program 240 Communication unit 250 input/output unit 260 control unit 261 display control unit 262 authentication request unit 263 processing control unit 300 service providing device 300-1 gate device 300-2 vending machine 300-3 multifunction device 400 authentication device 410 face information DB 411 User ID 412 facial feature information 420 face detection unit 430 feature point extraction unit 440 registration unit 450 authentication unit 500 recommendation device 510 storage unit 511 program 512 user information 5121 user ID 5122 personal information 5123 terminal information 5124 user related information 51241 authentication result 51242 physical condition information 51243 operation information 513 service providing device

Landscapes

  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un dispositif de recommandation (1) comprenant : une unité d'enregistrement (11) qui enregistre, en association avec un utilisateur prescrit, des informations relatives à l'utilisateur acquises lors du succès d'une première authentification effectuée lorsque l'utilisateur utilise un premier dispositif de fourniture de services ; une unité d'identification (12) qui identifie les informations associées à l'utilisateur lors du succès d'une seconde authentification effectuée lorsque l'utilisateur utilise un second dispositif de fourniture de services ; une unité de détermination (13) qui détermine, d'après les informations relatives à l'utilisateur et une fonction de fourniture du second dispositif de fourniture de services, des informations de recommandation lors de l'utilisation du second dispositif de fourniture de services ; et une unité de signalisation (14) qui signale les informations de recommandation pour l'utilisateur.
PCT/JP2021/030140 2021-08-18 2021-08-18 Dispositif, système et procédé de recommandation et support à lecture informatique WO2023021599A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023542078A JPWO2023021599A5 (ja) 2021-08-18 推薦装置、推薦システム、推薦方法、及び推薦プログラム
PCT/JP2021/030140 WO2023021599A1 (fr) 2021-08-18 2021-08-18 Dispositif, système et procédé de recommandation et support à lecture informatique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/030140 WO2023021599A1 (fr) 2021-08-18 2021-08-18 Dispositif, système et procédé de recommandation et support à lecture informatique

Publications (1)

Publication Number Publication Date
WO2023021599A1 true WO2023021599A1 (fr) 2023-02-23

Family

ID=85240234

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/030140 WO2023021599A1 (fr) 2021-08-18 2021-08-18 Dispositif, système et procédé de recommandation et support à lecture informatique

Country Status (1)

Country Link
WO (1) WO2023021599A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004341983A (ja) * 2003-05-19 2004-12-02 Nec Fielding Ltd 住民の健康管理システム，方法，自動販売機およびプログラム
WO2020188714A1 (fr) * 2019-03-18 2020-09-24 日本電気株式会社 Dispositif de traitement d'informations, dispositif serveur, procédé de traitement d'informations et support d'enregistrement
JP2020160849A (ja) * 2019-03-27 2020-10-01 カシオ計算機株式会社 サービス提供装置、サービス提供方法、及びプログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004341983A (ja) * 2003-05-19 2004-12-02 Nec Fielding Ltd 住民の健康管理システム，方法，自動販売機およびプログラム
WO2020188714A1 (fr) * 2019-03-18 2020-09-24 日本電気株式会社 Dispositif de traitement d'informations, dispositif serveur, procédé de traitement d'informations et support d'enregistrement
JP2020160849A (ja) * 2019-03-27 2020-10-01 カシオ計算機株式会社 サービス提供装置、サービス提供方法、及びプログラム

Also Published As

Publication number Publication date
JPWO2023021599A1 (fr) 2023-02-23

Similar Documents

Publication Publication Date Title
US11039314B2 (en) Method for passive authentication of an individual using an individual's geo-location via a communication network and blockchain associated recording of individual's authentication data
US20210357489A1 (en) Communication network based non-fungible token creation platform with integrated creator biometric authentication
US20170140174A1 (en) Systems and Methods for Obtaining Authorization to Release Personal Information Associated with a User
KR102190056B1 (ko) 빅데이터 기반의 환자 맞춤형 복약 정보 제공 장치 및 복약 정보 제공 방법
KR101983558B1 (ko) 보험금 청구 하는 방법 및 장치
US8629755B2 (en) Visitor management systems and methods
US8582829B2 (en) Online identity verification
JP4115329B2 (ja) 顧客管理システム、該システムの機能を実現するプログラム及び記録媒体
WO2016210295A1 (fr) Procédés et appareil permettant à des utilisateurs de contrôler l'utilisation d'images
JP6865321B1 (ja) 入退場管理装置、入退場管理方法、入退場管理プログラム、および入退場管理システム
WO2018162989A1 (fr) Systèmes et procédés d'obtention d'autorisation de validation d'informations personnelles associées à un utilisateur
JP6728649B2 (ja) ポイント管理システム、アカウント生成方法、自動販売機及びプログラム
JP7034452B2 (ja) チケット発券システム、検札装置、およびプログラム
US20220309139A1 (en) Authentication system, authentication method and program
WO2023021599A1 (fr) Dispositif, système et procédé de recommandation et support à lecture informatique
JP2014154143A (ja) 物理的な書籍と電子書籍との一致照合
JP7036300B1 (ja) システム、認証方法、認証端末、認証端末の制御方法及びプログラム
US20220329589A1 (en) Methods and apparatus for providing biometric authentication and authorization services
US11720937B2 (en) Methods and systems for dynamic price negotiation
WO2021075121A1 (fr) Dispositif et procédé d'enregistrement de données
US20100312825A1 (en) System, method and apparatus for locating a missing person
JP6516337B2 (ja) 読取システム及び読取プログラム
JP2020173671A (ja) 情報収集装置、情報収集システム、情報収集方法及び情報収集プログラム
KR101713378B1 (ko) 무인정보단말기를 이용한 상품권 환전 시스템 및 방법
WO2023281747A1 (fr) Dispositif de traitement de service, système, procédé et support lisible par ordinateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21954172

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023542078

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE