WO2023181236A1 - Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur - Google Patents

Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur Download PDF

Info

Publication number
WO2023181236A1
WO2023181236A1 PCT/JP2022/013850 JP2022013850W WO2023181236A1 WO 2023181236 A1 WO2023181236 A1 WO 2023181236A1 JP 2022013850 W JP2022013850 W JP 2022013850W WO 2023181236 A1 WO2023181236 A1 WO 2023181236A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
floor
elevator
management support
usage management
Prior art date
Application number
PCT/JP2022/013850
Other languages
English (en)
Japanese (ja)
Inventor
栞 杉本
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to PCT/JP2022/013850 priority Critical patent/WO2023181236A1/fr
Publication of WO2023181236A1 publication Critical patent/WO2023181236A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B3/00—Applications of devices for indicating or signalling operating conditions of elevators

Definitions

  • the present disclosure relates to a usage management support device, system, method, and program.
  • Patent Document 1 discloses a technology related to an elevator control system.
  • the system disclosed in Patent Document 1 photographs candidates getting on and off the elevator in a building, performs image authentication of the candidates based on the photographed images, and determines the movement pattern of the candidates to each floor for each candidate.
  • the robot learns and controls the elevator based on the learning results.
  • Patent Document 2 discloses a technology related to an alarm device installed at the entrance/exit of an elevator on each floor.
  • an alarm device installed at the elevator entrance reads the floor information of the IC tag, and if the person is on an unauthorized floor, Activate the alarm.
  • JP2020-132410A Japanese Patent Application Publication No. 2000-306050
  • Patent Document 2 requires the installation of physical security gates on each floor in order to prevent unauthorized persons from entering each floor, making it difficult to implement. There is a problem.
  • an object of the present disclosure is to provide a usage management support device, system, and method for supporting prevention of unauthorized users from entering each floor without requiring a physical gate.
  • the goal is to provide programs.
  • the usage management support device is Performs first face authentication on a first face image taken due to boarding the elevator by referring to a database that associates facial feature information of the user with floors that the user is permitted to use.
  • identification means for identifying a first permission floor associated with a successful first user
  • operation control means for controlling operation of the elevator according to the first permitted floor;
  • a determining means for determining whether or not the second user can get off the vehicle;
  • output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle; Equipped with
  • the usage management support system is a database that associates facial feature information of a user with permission floors that the user is permitted to use; a usage management support device connected to the database;
  • the usage management support device includes: Identifying a first permitted floor associated with a first user who has successfully performed first face authentication on a first face image taken due to boarding an elevator by referring to the database; means and operation control means for controlling operation of the elevator according to the first permitted floor; By referring to the database and performing second face authentication on a second face image taken of the second user getting off the elevator at the stop floor where the elevator has stopped in accordance with the operation control, A determining means for determining whether or not the second user can get off the vehicle; output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle; Equipped with
  • the usage management support method related to this disclosure is as follows:
  • the computer is Performs first face authentication on a first face image taken due to boarding the elevator by referring to a database that associates facial feature information of the user with floors that the user is permitted to use. identifying a first permission floor associated with the successful first user; controlling the operation of the elevator according to the first permitted floor;
  • By referring to the database and performing second face authentication on a second face image taken of the second user getting off the elevator at the stop floor where the elevator has stopped in accordance with the operation control Determine whether the second user can get off the vehicle, If it is determined that the second user is not allowed to get off the vehicle, first warning information is output.
  • the usage management support program related to this disclosure is Performs first face authentication on a first face image taken due to boarding the elevator by referring to a database that associates facial feature information of the user with floors that the user is permitted to use.
  • identification processing for identifying a first permission floor associated with a successful first user; an operation control process that controls the operation of the elevator according to the first permitted floor;
  • a determination process for determining whether or not the second user can get off the vehicle;
  • Output processing that outputs first warning information when it is determined that the second user is not allowed to get off the vehicle; have the computer execute it.
  • FIG. 1 is a block diagram showing the configuration of a usage management support device according to the first embodiment
  • FIG. 3 is a flowchart showing the flow of the usage management support method according to the first embodiment.
  • FIG. 2 is a block diagram showing the configuration of a usage management support system according to the second embodiment.
  • 2 is a block diagram showing the configuration of an authentication device according to a second embodiment.
  • FIG. 7 is a flowchart showing the flow of face information registration processing by the authentication device according to the second embodiment.
  • 2 is a block diagram showing the configuration of a usage management support device according to a second embodiment.
  • FIG. 12 is a flowchart showing the flow of operation control processing when boarding an elevator according to the second embodiment.
  • 7 is a flowchart showing the flow of face authentication processing by the authentication device according to the second embodiment.
  • FIG. 7 is a diagram illustrating an example of the situation inside the elevator during boarding according to the second embodiment.
  • 12 is a flowchart showing the flow of a warning determination process when exiting an elevator according to Example 2-1 of the second embodiment.
  • 12 is a flowchart showing the flow of a warning determination process when exiting an elevator according to Example 2-2 of the second embodiment.
  • FIG. 7 is a diagram illustrating a display example of warning information when getting off the vehicle according to the second embodiment.
  • FIG. 7 is a diagram showing an example of displaying warning information when getting off the vehicle on the administrator terminal according to the second embodiment.
  • 12 is a flowchart showing the flow of operation control processing when boarding an elevator according to the third embodiment.
  • FIG. 7 is a diagram showing an example of pressing a designated button in an elevator according to the third embodiment.
  • FIG. 7 is a diagram showing an example of display of warning information when a designated button in an elevator is pressed according to the third embodiment.
  • FIG. 3 is a block diagram showing the configuration of a usage management support system according to the fourth embodiment.
  • 12 is a flowchart showing the flow of a warning determination process when an elevator is called according to Example 4-1 of the fourth embodiment. 12 is a flowchart showing the flow of warning determination processing when an elevator is called according to Example 4-2 of the fourth embodiment.
  • FIG. 7 is a diagram showing an example of when an elevator is called according to the fourth embodiment.
  • FIG. 7 is a diagram showing an example of display of warning information when an elevator is called according to the fourth embodiment.
  • FIG. 12 is a diagram showing an example of displaying warning information on an administrator terminal when an elevator is called according to the fourth embodiment.
  • FIG. 1 is a block diagram showing the configuration of a usage management support device 1 according to the first embodiment.
  • the usage management support device 1 is an information processing device for supporting the management of users who enter each floor by monitoring boarding and alighting of elevators in a predetermined building.
  • the usage management support device 1 is capable of referring to a database stored in a built-in storage device (not shown) or a connected external storage device (not shown).
  • the database manages information that associates a user's facial feature information with a floor that the user is permitted to use.
  • at least a photographing device (not shown) is installed inside or outside the elevator, and the usage management support device 1 acquires images taken by the photographing device.
  • the usage management support device 1 includes a specifying section 11, an operation control section 12, a determining section 13, and an output section 14.
  • the specifying unit 11 refers to the database and specifies the first permitted floor associated with the first user.
  • the "first user” is a passenger (user) who has successfully performed the first face authentication on the first face image photographed due to boarding the elevator.
  • the photograph was taken as a result of boarding the elevator means, for example, that the photograph was taken outside the elevator or inside the elevator (near the entrance) when boarding the elevator, or that the photograph was taken while the passenger was inside the elevator after boarding the elevator. Indicates that a photo was taken.
  • face recognition compares the facial feature information calculated from the facial image with the facial feature information stored in the above database, and if the degree of matching is greater than or equal to a threshold, authentication is considered successful.
  • This process identifies the user associated with the facial feature information.
  • the face authentication process may be performed inside the usage management support device 1 or outside the usage management support device 1.
  • the specifying unit 11 specifies at least the first permitted floor associated with the first user specified by successful first face authentication from the database.
  • the operation control unit 12 controls the operation of the elevator according to the first permitted floor specified by the identification unit 11. For example, the operation control unit 12 instructs the elevator operation controller or operation control system to stop at the first permitted floor.
  • the determining unit 13 refers to the database and determines whether or not the second user can get off the vehicle at the stop floor by performing second face authentication on a second face image taken of the second user.
  • the second face image is a face image taken of the second user getting off the elevator at the stop floor where the elevator has stopped in accordance with the operation control by the operation control unit 12.
  • "A second user getting off the elevator was photographed at the stop floor where the elevator stopped” means, for example, when the elevator stopped at the stop floor and the second user was about to get off the elevator, the second user was photographed inside the elevator. or that the second user was photographed outside the elevator after getting off the elevator.
  • the determination unit 13 determines whether the second permission floor associated with the second user includes a stop floor. It is preferable to determine that it is possible for the second user to get off the vehicle. Alternatively, for example, if the second face authentication for the second face image is successful in matching the stop floor with candidates of facial feature information associated with the stop floor as a permitted floor in the database, the determination unit 13 may stop the stop. It may be determined that it is possible for the second user to get off the vehicle at the floor.
  • the output unit 14 outputs first warning information when it is determined that the second user is not allowed to get off the vehicle. For example, the output unit 14 outputs the first warning information to speakers (not shown) and display devices (not shown) installed inside and outside the elevator. Alternatively, the output unit 14 may output the first warning information to the terminal of the manager of the elevator, the stop floor, or the building.
  • FIG. 2 is a flowchart showing the flow of the management support method according to the first embodiment.
  • a first face image of a first user is photographed due to the first user boarding an elevator. It is assumed that the first face authentication is performed on the first face image with reference to the database, and that the first user has succeeded in the first face authentication. Therefore, the specifying unit 11 refers to the database and specifies the first permitted floor associated with the first user who has successfully completed the first face authentication (S11). Then, the operation control unit 12 controls the operation of the elevator according to the first permitted floor (S12).
  • the elevator stops at a predetermined stop floor, such as the first permitted floor, according to the operation control by the operation control unit 12. At this time, a second facial image of the second user getting off the elevator at the stop floor is photographed.
  • the determination unit 13 refers to the database and determines whether or not the second user can get off the vehicle at the stop floor by performing second face authentication on the second face image (S13). If it is determined in step S13 that the second user cannot get off the vehicle, the output unit 14 outputs first warning information (S14).
  • the operation of the elevator is controlled according to the detected permitted floor of the first user. .
  • This can prevent a user whose permitted floor has not been registered in advance from boarding the elevator alone and attempting to move to a floor for which he or she is not permitted.
  • the facial recognition result for the second user (not necessarily the first user) who is about to get off is acquired.
  • the second user fails in facial recognition, or if the stopping floor is not registered as a permitted floor even if facial recognition is successful, it is determined that the second user is not allowed to get off the vehicle, and a message to that effect is determined. Output. Therefore, people in the elevator or around the stopping floor, or the administrator, can easily recognize that the second user is about to get off at a floor for which he is not permitted. Therefore, if the second user has malicious intent, this may deter the second user from getting off the vehicle. Alternatively, it becomes easier for surrounding people, security guards, etc. to call out to you. Further, even if the second user has no malicious intent and tries to get off the vehicle by mistake, the second user will be more likely to be aware of the situation.
  • each floor can be made difficult for non-personnel to enter, helping to prevent unauthorized users from entering each floor.
  • the usage management support device 1 includes a processor, a memory, and a storage device as components not shown. Further, the storage device stores a computer program in which the processing of the usage management support method according to the present embodiment is implemented. Then, the processor loads a computer program or the like from the storage device into the memory, and executes the computer program. Thereby, the processor realizes the functions of the identification section 11, the operation control section 12, the determination section 13, and the output section 14.
  • each component of the usage management support device 1 may be realized by dedicated hardware. Further, a part or all of each component of each device may be realized by a general-purpose or dedicated circuit, a processor, etc., or a combination thereof. These may be configured by a single chip or multiple chips connected via a bus. A part or all of each component of each device may be realized by a combination of the circuits and the like described above and a program. Further, as the processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (a quantum computer control chip), etc. can be used.
  • a CPU Central Processing Unit
  • GPU Graphics Processing Unit
  • FPGA Field-Programmable Gate Array
  • quantum processor a quantum computer control chip
  • each component of the usage management support device 1 may be realized by a plurality of information processing devices, circuits, etc.
  • the plurality of information processing devices, circuits, etc. may be centrally arranged. , may be distributed.
  • information processing devices, circuits, etc. may be realized as a client server system, a cloud computing system, or the like, in which each is connected via a communication network.
  • the functions of the usage management support device 1 may be provided in a SaaS (Software as a Service) format.
  • FIG. 3 is a block diagram showing the configuration of a usage management support system 1000 according to the second embodiment.
  • the usage management support system 1000 is an information system for supporting the management of elevators and users of each floor (floor) using images captured by the floor camera 101 and the camera 120.
  • the network N is a wired or wireless communication line or communication network, such as a LAN (Local Area Network), the Internet, a wireless communication network, a mobile phone network, or the like. Furthermore, the type of communication protocol used by the network N does not matter.
  • the elevator 100 is installed in a predetermined building such as a building and operates. Further, in this example, it is assumed that users U1 to U3 are boarding the elevator 100, but the number of passengers is not limited to this.
  • the elevator 100 includes an operation controller 110, a camera 120, a display device 130, a floor designation section 140, an opening/closing designation section 150, a door 160, and a warning information output device 170.
  • the operation controller 110 is a device for controlling general operations of the elevator 100, such as raising and lowering the elevator 100, opening and closing the door 160, accepting requests from passengers to specify a floor and opening and closing the door 160, and stopping at a specified floor. It is.
  • the operation controller 110 is connected to a camera 120, a display device 130, a floor designation section 140, an opening/closing designation section 150, a door 160, and a warning information output device 170, and is connected to the camera 120, display device 130, floor designation section 140, opening/closing designation section 150, door 160, and warning information output device 170, and performs data transmission/reception and control with each component.
  • the signal shall be communicated.
  • the operation controller 110 causes the elevator 100 to stop at a designated permitted floor, not to stop at any floor other than the permitted floor, and selects a designation button in the floor designation section 140. Performs operational control such as changing the state. Further, the operation controller 110 performs controls such as outputting the warning information received from the usage management support device 300 to the warning information output device 170.
  • the camera 120 is a photographing device installed inside the elevator 100. It is assumed that the camera 120 captures at least a portion of the interior space of the elevator 100, including the faces of the users U1 to U3 boarding the elevator 100. That is, the camera 120 photographs an area including the faces of the users U1 to U3 inside the elevator 100. It is assumed that the camera 120 takes pictures at least when the door 160 is opened and closed, that is, when the user U1 and the like board and exit the vehicle. The camera 120 transmits the captured image to the usage management support device 300 via the operation controller 110 and the network N. Note that two or more cameras 120 may be provided within the elevator 100.
  • the display device 130 includes a screen such as a liquid crystal display, and is installed at a position where the user U1 and others in the elevator 100 can view the screen.
  • the display device 130 displays the moving image received from the usage management support device 300 via the network N and the operation controller 110 on the screen.
  • the floor designation unit 140 is configured to accept designation of the floor at which the elevator 100 stops from the user U1 or the like, and is, for example, a collection of buttons that accept designation for each floor.
  • the opening/closing designation unit 150 is configured to accept designations to open and close the door 160 of the elevator 100 from the user U1 and the like, and is, for example, a collection of buttons that accept designations to open and close the door 160.
  • the door 160 opens and closes in response to an operation control signal from the operation controller 110 at the floor where the elevator 100 has stopped. Therefore, even if the elevator 100 stops, the door 160 will not close if it receives a control signal from the operation controller 110 to prevent it from closing (keeping it open).
  • the warning information output device 170 outputs the warning information received from the usage management support device 300 via the network N and the operation controller 110 so that the user U1 etc. can perceive it.
  • the warning information output device 170 may include a speaker, a lamp, a display panel, and the like.
  • the warning information is audio data of an alarm sound or a warning message
  • the warning information output device 170 outputs the audio of the alarm sound or warning message via a speaker.
  • the warning information is a warning signal
  • the warning information output device 170 lights up or blinks a lamp.
  • the warning information is text information or an image of a warning message
  • the warning information output device 170 displays the warning message on the display panel or the display device 130.
  • the floor camera 101 is a photographing device installed on each floor of the building, and is installed near the entrance of the elevator 100 and in the elevator hall.
  • the floor camera 101 is installed at a position where it can photograph an area including the faces of users who board and exit the elevator 100.
  • the floor camera 101 may be a camera of an authentication terminal installed at an entrance gate on an entrance floor of a building.
  • the camera 120 and floor camera 101 described above may also be referred to as a first camera.
  • the authentication device 200 is an information processing device that manages a user's facial feature information and performs facial authentication. In addition, in response to a face authentication request received from the outside, the authentication device 200 matches the facial image or facial feature information included in the request with the facial feature information of each user, and requests the matching result (authentication result). Reply to original.
  • FIG. 4 is a block diagram showing the configuration of the authentication device 200 according to the second embodiment.
  • the authentication device 200 includes a face information DB (DataBase) 210, a face detection section 220, a feature point extraction section 230, a registration section 240, and an authentication section 250.
  • the face information DB 210 stores the user ID 211 and the facial feature information 212 of the user ID in association with each other.
  • the facial feature information 212 is a set of feature points extracted from the facial image.
  • the authentication device 200 may delete the facial feature information 212 in the facial information DB 210 in response to a request from a user or the like corresponding to the facial feature information 212.
  • the authentication device 200 may delete the facial feature information 212 after a certain period of time has passed since registration.
  • the face detection unit 220 detects a face area included in a registration image for registering face information, and outputs it to the feature point extraction unit 230.
  • the feature point extraction unit 230 extracts feature points from the face area detected by the face detection unit 220 and outputs facial feature information to the registration unit 240. Further, the feature point extraction unit 230 extracts feature points included in the facial image received from the usage management support device 300 or the like, and outputs facial feature information to the authentication unit 250.
  • the registration unit 240 issues a new user ID 211 when registering facial feature information.
  • the registration unit 240 associates the issued user ID 211 with the facial feature information 212 extracted from the registered image and registers it in the facial information DB 210.
  • the authentication unit 250 performs face authentication using the facial feature information 212. Specifically, the authentication unit 250 compares the facial feature information extracted from the facial image with the facial feature information 212 in the facial information DB 210. When the verification is successful, the authentication unit 250 identifies the user ID 211 associated with the verified facial feature information 212. The authentication unit 250 returns whether or not the facial feature information matches to the request source as a facial authentication result. Whether or not the facial feature information matches corresponds to the success or failure of authentication. Note that facial feature information matches (match exists) when the matching degree is equal to or higher than a threshold value. Further, the face authentication result shall include the specified user ID when the face authentication is successful.
  • FIG. 5 is a flowchart showing the flow of face information registration processing by the authentication device 200 according to the second embodiment.
  • the authentication device 200 receives a face information registration request (S201).
  • the authentication device 200 receives a face information registration request from the usage management support device 300 via the network N.
  • the face detection unit 220 detects a face area from the face image included in the face information registration request (S202).
  • the feature point extraction unit 230 extracts feature points (facial feature information) from the face area detected in step S202 (S203).
  • the registration unit 240 issues the user ID 211 (S204).
  • the registration unit 240 registers the extracted facial feature information 212 and the issued user ID 211 in the facial information DB 210 in association with each other (S205). Thereafter, the registration unit 240 returns the issued user ID 211 to the request source (for example, the usage management support device 300) (S206).
  • the authentication device 200 may perform face information registration processing in response to a face information registration request received from an arbitrary information registration terminal.
  • the information registration terminal is an information processing device such as a personal computer, a smartphone, or a tablet terminal.
  • the usage management support device 300 is an example of the usage management support device 1 described above.
  • the usage management support device 300 is an information processing device that controls the operation of the elevator 100.
  • the usage management support device 300 controls the first facial authentication using a photographed image of the passenger (user) when boarding the elevator 100, and controls the operation of the floors at which the elevator 100 stops based on the authentication result.
  • the usage management support device 300 also controls second face authentication using a captured image of the person (user) getting off the elevator 100, determines whether or not it is possible to get off the elevator based on the authentication result, and determines whether or not the user can get off the elevator 100.
  • the usage management support device 300 can control the camera 120, the display device 130, the floor designation section 140, the opening/closing designation section 150, the door 160, and the warning information output device 170 via the network N, the operation controller 110, etc. be.
  • the usage management support device 300 may control the operation of two or more elevators.
  • the usage management support device 300 may be made redundant with multiple servers, and each functional block may be implemented with multiple computers.
  • the administrator terminal 400 is an information processing device operated by the administrator of the building, elevator, or each floor.
  • the administrator terminal 400 is, for example, an information terminal such as a personal computer, a smartphone, or a tablet terminal.
  • the administrator terminal 400 outputs the warning information received from the usage management support device 300 via the network N. If the warning information is audio data, or if the warning information is audio data of an alarm sound or a warning message, the administrator terminal 400 outputs the alarm sound or the audio of the warning message via the speaker. Furthermore, when the warning information is a warning signal, the administrator terminal 400 lights up or blinks a lamp. Further, if the warning information is text information or an image of a warning message, the administrator terminal 400 displays the warning message on the screen.
  • FIG. 6 is a block diagram showing the configuration of the usage management support device 300 according to the second embodiment.
  • the usage management support device 300 includes a storage section 310, a memory 320, a communication section 330, and a control section 340.
  • the storage unit 310 is an example of a storage device such as a hard disk or flash memory.
  • the storage unit 310 stores a program 311 and a user management DB 312.
  • the program 311 is a computer program (usage management support program) in which the usage management support processing and the like according to the second embodiment are implemented.
  • the user management DB 312 is a database that manages permission floors for each user.
  • the user management DB 312 stores the user ID 3121 and the permitted floor 3122 in association with each other.
  • the user ID 3121 is identification information of the target user.
  • the permitted floor 3122 is information indicating a floor that the target user is permitted to use. There may be a plurality of permitted floors 3122 per user.
  • the user ID 3121 is information that is the same as or uniquely corresponds to the user ID 211 that is managed in association with the facial feature information 212 in the facial information DB 210 of the authentication device 200. Therefore, the user management DB 312 and the face information DB 210 are databases in which feature information for user registration (biometric information, personal authentication information, personal identification information, etc.) is associated with the permission floor 3122 via the user ID 3121. I can say that. In other words, the user management DB 312 and the facial information DB 210 can be said to be databases that associate facial feature information of users with permission floors that the users are permitted to use.
  • the storage unit 310 only needs to store at least the program 311. Therefore, the user management DB 312 may be stored in an external storage device connected to the usage management support device 300.
  • the memory 320 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 340 operates.
  • the communication unit 330 is a communication interface with the network N.
  • the control unit 340 is a processor that controls each component of the usage management support device 300, that is, a control device.
  • the control unit 340 loads the program 311 from the storage unit 310 into the memory 320 and executes the program 311. Thereby, the control unit 340 realizes the functions of the registration unit 341, the authentication control unit 342, the identification unit 343, the operation control unit 344, the determination unit 345, and the output unit 346.
  • the registration unit 341 registers the permitted floor 3122 for a specific user in the user management DB 312. For example, the registration unit 341 receives a set of a specific user ID and a permitted floor indicating the predetermined floor via the network N from the administrator terminal 400 of the administrator of the predetermined floor. Then, the registration unit 341 associates the received user ID 3121 and the permitted floor 3122 and registers them in the user management DB 312. Further, the registration unit 341 may register the user's face information. For example, the registration unit 341 receives a set of a specific user's face image and a permitted floor from the administrator terminal 400. The registration unit 341 then transmits the face information registration request including the received face image to the authentication device 200 via the network N.
  • the registration unit 341 receives the user ID issued at the time of face information registration from the authentication device 200. Then, the registration unit 341 registers the issued user ID 3121 and the accepted permission floor 3122 in the user management DB 312 in association with each other.
  • the authentication control unit 342 extracts the recognized facial area from the captured image as a facial image. At this time, the authentication control unit 342 may extract facial images of multiple people from one captured image.
  • the authentication control unit 342 controls face authentication using the authentication device 200 for the recognized face area or extracted face image. Specifically, the authentication control unit 342 transmits a face authentication request including a face image corresponding to the face area to the authentication device 200, and receives a face authentication result from the authentication device 200. Then, the authentication control unit 342 notifies the determination unit 345 of the face authentication result received from the authentication device 200. Note that the authentication control unit 342 may extract facial feature information from the face area and include the facial feature information in the face authentication request.
  • the identifying unit 343 is an example of the identifying unit 11 described above.
  • the identifying unit 343 identifies the user ID included in the face authentication result when the determining unit 345 determines that the face authentication is successful.
  • the specifying unit 343 then specifies the permitted floor 3122 associated with the specified user ID 3121 from the user management DB 312. That is, the identification unit 343 performs first face authentication performed using the face feature information 212 of the face information DB 210 on the first face image taken of the first user when boarding the elevator 100. If successful, the first permission floor 3122 is identified.
  • the operation control unit 344 is an example of the operation control unit 12 described above.
  • the operation control unit 344 controls the operation of the elevator 100 according to the first permitted floor specified by the specifying unit 343. Specifically, the operation control unit 344 controls the operation of the elevator 100 so as to stop at the first permitted floor.
  • the operation control unit 344 performs operation control by selecting a designation button for designating stopping at the first permitted floor in the elevator 100.
  • the operation control unit 344 transmits an instruction to select the designated button corresponding to the first permitted floor to the operation controller 110 via the network N.
  • the operation control unit 344 performs operation control by setting a designation button for designating stopping at the first permitted floor in the elevator 100 in a selectable state (activation).
  • the operation control unit 344 sends an instruction to activate the specified button corresponding to the first permitted floor and an instruction to deactivate the specified button corresponding to floors other than the first permitted floor via the network N. and transmits it to the operation controller 110. For example, if the first user is permitted to use multiple floors, the operation control unit 344 activates multiple designation buttons that can be designated by the first user, and disables selection of designation buttons for other floors. It is better to control the operation by keeping it in a safe state, that is, inactivating it.
  • the determining unit 345 is an example of the determining unit 13 described above.
  • the determination unit 345 determines whether authentication is successful or not based on the face authentication result notified from the authentication control unit 342. Furthermore, the determination unit 345 determines whether the second user who is attempting to get off the vehicle at the stop floor can get off the vehicle, depending on the face authentication result.
  • the identifying unit 343 and the determining unit 345 refer to the user management DB 312 and perform the second You may specify the second permission floor 3122 associated with the user ID 3121 of the second user whose face authentication was successful. Then, the determination unit 345 determines whether the stop floor is included in the specified second permitted floor. The determination unit 345 determines that the second user can get off the vehicle if the stopping floor is included in the second permitted floor, and determines that the second user can get off the vehicle if the stopping floor is not included in the second permitted floor. is determined to be impossible.
  • the specifying unit 343 and the determining unit 345 may specify the user ID 3121 associated with the allowed floor 3122 as the stopping floor from the user management DB 312.
  • the authentication control unit 342 and the determination unit 345 control the second face authentication using the facial feature information 212 associated with the specified user ID 211 in the face information DB 210. Then, if the second face authentication is successful, the determination unit 345 determines that the second user can get off the vehicle, and if the second face authentication fails, the determination unit 345 determines that the second user cannot get off the vehicle. do.
  • the output unit 346 is an example of the output unit 14 described above.
  • the output unit 346 outputs first warning information when it is determined that the second user is not allowed to get off the vehicle. Specifically, the output unit 346 transmits the first warning information to the warning information output device 170 via the network N and the operation controller 110. Further, the output unit 346 may transmit the first warning information to the administrator terminal 400 via the network N. Further, the output unit 346 preferably outputs the first warning information including the second face image to the administrator terminal 400 of the administrator of the stop floor.
  • FIG. 7 is a flowchart showing the flow of operation control processing when boarding an elevator according to the second embodiment.
  • the elevator 100 stops at a predetermined floor and opens the door 160.
  • the user U1 and the like board the elevator 100.
  • the camera 120 photographs an image including the face of the user U1 and the like when boarding the elevator 100, and transmits the photographed image to the usage management support device 300 via the network N. Therefore, the captured image includes the face area of the user U1 and the like.
  • the usage management support device 300 acquires a captured image of the user when boarding the elevator 100 (S301). For example, the usage management support device 300 acquires a captured image from the camera 120 via the operation controller 110 and the network N. Alternatively, the usage management support device 300 may acquire a captured image from the camera 120 via the network N without going through the operation controller 110. Further, the photographed image may be taken by the floor camera 101 instead of the camera 120. In that case, the usage management support device 300 acquires a captured image from the floor camera 101 via the network N.
  • the usage management support device 300 extracts the user's face image from the captured image (S302). Specifically, the usage management support device 300 recognizes a face area of a person from a captured image and extracts a face image corresponding to the recognized face area. Then, the usage management support device 300 transmits a face authentication request including the extracted facial image to the authentication device 200 via the network N (S303). In response to this, the authentication device 200 performs face authentication processing.
  • FIG. 8 is a flowchart showing the flow of face authentication processing by the authentication device 200 according to the second embodiment.
  • the authentication device 200 receives a face authentication request from the usage management support device 300 via the network N (S211).
  • the authentication device 200 extracts facial feature information from the facial image included in the facial authentication request, similarly to steps S202 and S203 described above.
  • the authentication unit 250 of the authentication device 200 compares the facial feature information extracted from the facial image included in the face authentication request with the facial feature information 212 of the facial information DB 210 (S212), and calculates the degree of matching.
  • the authentication unit 250 determines whether the degree of matching is greater than or equal to the threshold (S213).
  • the authentication unit 250 identifies the user ID 211 associated with the facial feature information 212 (S214). Then, the authentication unit 250 returns the face authentication result including the fact that the face authentication was successful and the specified user ID 211 to the usage management support device 300 via the network N (S215). If the matching degree is less than the threshold in step S213, the authentication unit 250 returns the face authentication result including the fact that the face authentication has failed to the usage management support device 300 via the network N (S216).
  • the usage management support device 300 receives the face authentication result from the authentication device 200 via the network N (S304). Then, the usage management support device 300 determines whether face authentication is successful (S305). Specifically, the usage management support device 300 refers to the face authentication result and determines that the face authentication has been successful if the face authentication result includes the user ID. Then, the usage management support device 300 identifies the user ID included in the face authentication result (S306). Then, the usage management support device 300 identifies the first permitted floor 3122 associated with the identified user ID 3121 from the user management DB 312 (S307). Then, the usage management support device 300 changes the specified button for the specified first permitted floor to a selected state (S308).
  • the usage management support device 300 transmits an instruction to select the designated button corresponding to the first permitted floor to the operation controller 110 via the network N. Thereby, the operation controller 110 puts the corresponding designation button in the floor designation section 140 into a selected state.
  • the usage management support device 300 outputs warning information (S309). Thereby, the warning information output device 170 outputs warning information.
  • step S302 the usage management support device 300 repeatedly executes steps S303 to S309 for each facial image.
  • the usage management support device 300 may change the designation button of the specified first permitted floor to a selectable state, that is, activate the designation button.
  • the usage management support device 300 also changes the designation buttons other than the specified first permitted floor to a state where they cannot be selected, that is, deactivates the designation buttons.
  • the user U1 may press the designation button 141 for "10F". In this case, since the user U1 can only select the permitted floor and cannot select other floors, it is possible to prevent the user from pressing the button incorrectly.
  • FIG. 9 is a diagram showing an example of the situation inside the elevator 100 during boarding according to the second embodiment.
  • "10F" is associated with at least the user ID of the user U1 as a permitted floor in the user management DB 312.
  • Cameras 120-1 and 120-2 are an example of a photographing device that photographs the interior space of elevator 100. Note that the number of cameras may be one.
  • the camera 120-2 is capable of capturing images including the faces of the users U1 to U3 when they board the elevator 100.
  • the camera 120-1 is capable of capturing images including the faces of the users U1 to U3 in the elevator 100 when they face outward (towards the back of FIG. 9, toward the door 160) after boarding the elevator. do.
  • the usage management support device 300 has performed the process shown in FIG. 7 described above using the image taken by either the camera 120-1 or 120-2. Then, for example, when the user U1 succeeds in the first face authentication, the usage management support device 300 specifies "10F" as the permitted floor for the user U1, selects the "10F” designation button 141, and selects the elevator. 100 is under operational control. Alternatively, the designation button 141 may be activated in a selectable state, and the other designation buttons may be inactivated in a non-selectable state. The display device 130 shows that a message "Move to 10F" is displayed. Thereafter, the elevator 100 closes the door 160 and moves to the designated floor (for example, the 10th floor).
  • Example 2-1 similarly to the operation control process during boarding, the usage management support device 300 identifies the permitted floor of the second user who has successfully passed the second face authentication, and places the stop floor on the specified permitted floor. is included, it is determined that it is possible for the second user to get off the vehicle.
  • FIG. 10 is a flowchart showing the flow of the warning determination process when exiting the elevator according to Example 2-1 of the second embodiment.
  • the elevator 100 stops at a predetermined floor and opens the door 160.
  • the user U1 and the like get off the elevator 100.
  • the camera 120 captures an image including the face of the user U1 and the like when getting off the elevator 100, and transmits the captured image to the usage management support device 300 via the network N. Therefore, the captured image includes the face area of the user U1 and the like.
  • the usage management support device 300 acquires a captured image of the user when getting off the elevator 100 (S321).
  • the photographed image may be taken by the floor camera 101 installed in the elevator hall of the stopping floor instead of the camera 120.
  • steps S302 to S305 are executed similarly to FIG. 7 described above, and if the second face authentication is successful, steps S306 and S307 are executed similarly to FIG. 7 described above.
  • the usage management support device 300 determines whether the floor where the elevator 100 stops is included in the permitted floors specified in step S307 (S328). If the stop floor is included in the second user's permitted floors, the usage management support device 300 determines that the second user can get off at the stop floor. In this case, the usage management support device 300 performs normal operation control on the elevator 100. That is, after the user who exits the elevator finishes exiting the elevator, the elevator 100 closes the door 160 and starts moving to the next designated floor.
  • the usage management support device 300 It is determined that the user cannot get off the vehicle at the stop floor, and warning information is output (S329). Thereby, the warning information output device 170 outputs warning information.
  • the usage management support device 300 may include the second face image of the second user who failed the second face authentication in the warning information and output it.
  • the usage management support device 300 may include the second face image in the warning information and transmit it to the administrator terminal 400. This allows the administrator and the security guard to visually recognize the face of the second user who is not permitted to get off the vehicle, making it easier for them to greet the second user.
  • step S302 the usage management support device 300 repeatedly executes steps S303 to S307, S328, and S329 for each facial image.
  • Example 2-2 when the elevator stops, the usage management support device 300 narrows down the users whose stopping floor is the permitted floor, and uses the facial feature information of the narrowed down users as a comparison target for the second facial authentication. Then, if the second face authentication is successful, it is determined that the second user can get off the vehicle.
  • FIG. 11 is a flowchart showing the flow of the warning determination process when exiting the elevator according to Example 2-2 of the second embodiment.
  • the usage management support device 300 identifies the user ID 3121 associated with the stop floor as the permitted floor 3122 from the user management DB 312 (S320). Then, similarly to step S321 in FIG. 10 described above, the usage management support device 300 acquires a captured image of the user when getting off the elevator 100. Then, similar to step S302 in FIG. 7 described above, the usage management support device 300 extracts the second user's face image from the captured image.
  • the usage management support device 300 transmits a face authentication request targeted at the user ID specified in step S320 (S323). For example, if multiple user IDs are identified in step S320, the usage management support device 300 specifies the identified multiple user IDs, and performs facial authentication including the facial image of the second user extracted in step S302. The request is sent to the authentication device 200 via the network N.
  • the authentication device 200 extracts facial feature information from the second user's facial image included in the facial authentication request. Further, the authentication device 200 narrows down the facial feature information 212 associated with the user ID 211 specified in the received face authentication request from the facial information DB 210. Then, the authentication device 200 performs face authentication processing by comparing the second user's facial feature information with each of the narrowed-down facial feature information 212.
  • 1:N authentication is performed between the second user's facial feature information and all of the facial feature information 212 in the facial information DB 210.
  • Example 2-2 although the authentication is 1:N, the object to be compared with the facial feature information of the second user is narrowed down to a part of the facial feature information 212 in the facial information DB 210. There is. Therefore, in the face authentication process of Example 2-2, the amount of facial feature information to be authenticated is reduced compared to normal face authentication process, and authentication costs such as authentication process load and processing time can be reduced. In other words, authentication processing can be made more efficient. Then, the authentication device 200 transmits the face authentication result to the usage management support device 300.
  • the usage management support device 300 receives the face authentication result from the authentication device 200 via the network N (S304). Then, the usage management support device 300 determines whether face authentication is successful (S305). If the second user succeeds in face authentication, the usage management support device 300 determines that the second user can get off at the stop floor. In this case, the usage management support device 300 performs normal operation control on the elevator 100.
  • the usage management support device 300 determines that the second user cannot get off at the stop floor, and outputs warning information (S329) . Thereby, the warning information output device 170 outputs warning information. Further, similarly to the above-described embodiment 2-1, the usage management support device 300 may include the second face image of the second user who failed the second face authentication in the warning information and output it.
  • step S302 the usage management support device 300 repeatedly executes steps S323, S304, S305, and S329 for each facial image.
  • FIG. 12 is a diagram showing a display example of warning information when getting off the vehicle according to the second embodiment.
  • the elevator 100 stopped at the 10th floor, and users U1 and U2 succeeded in the second facial recognition, and it was determined that they could get off on the 10th floor, but user U3 was not allowed to get off on the 10th floor. Indicate the case.
  • the user U3 is not permitted to get off the train, there are two cases: a case where the user U3's face authentication fails, and a case where the user U3's face authentication is successful but the 10th floor is not included in the permitted floors for the user U3. be.
  • the display device 130 indicates that the warning information output in step S329 of FIG.
  • the warning information displayed on the display device 130 includes, for example, a message indicating "Getting off the vehicle is not permitted!", a facial image taken when the user U3 gets off the vehicle, and the date, time, and location (10F) of the third face authentication.
  • the warning information is not limited to these.
  • a face image registered for verification may be used as the face image included in the warning information.
  • FIG. 13 is a diagram showing an example of displaying warning information at the time of getting off the vehicle on the administrator terminal according to the second embodiment.
  • the elevator 100 stops at the 5th floor, users moving from inside the elevator 100 toward the door 160 and trying to get off are photographed by the camera 120-1 on the door 160 side inside the elevator 100. shall be taken as a thing.
  • face authentication is performed for each user in the captured image, and one user is determined to be NO in step S305 or NO in S328, and warning information is output (S329).
  • the administrator terminal 400 displays the warning information output in step S329 on the screen.
  • the warning information displayed on the screen of the administrator terminal 400 includes, for example, an image taken by the camera 120-1 on the door 160 side in the elevator 100, and a face image of the person targeted for warning in the image. , warning messages.
  • the face image may be an image obtained by enlarging the face area of the person to be warned out of the photographed image.
  • the warning message includes the floor to be warned, date and time, and so on. In this example, the warning message is "An unauthorized user alighted (entered) the fifth floor at 2:30 p.m.," but is not limited to this.
  • the manager or security guard of a building, etc., or the manager of a company that uses the exit floor, etc. can check the warning information displayed on the administrator terminal 400 to identify who is allowed to get off the elevator. It will be easier to understand the number of people who are not working and their facial photos.
  • the warning information may include the floor on which the person to be warned boarded.
  • the usage management support device 300 corresponds to the boarding floor (boarding floor) for each face image and facial feature information when each user U1 etc. boards the board, regardless of whether the first face authentication of each user is successful or not. It is attached and held in the memory 320 or the like.
  • the usage management support device 300 warns the boarding floor associated with the face image and facial feature information of the person to be warned. It is a good idea to include it in the information. Then, the usage management support device 300 outputs warning information including the person to be warned and their boarding floor.
  • the usage management support device 300 may identify attribute information such as the person's name and department, and include the identified attribute information in the warning information. Further, if the person to be warned cannot be identified through face authentication, the usage management support device 300 may include in the warning information a message indicating that the person to be warned is not registered. Further, even if the person to be warned is identified by face recognition, but the attribute information of the person cannot be identified, the usage management support device 300 may include in the warning information that the person to be warned is not registered. good.
  • the button for specifying a permitted floor registered in advance for a user boarding an elevator is automatically set to a selected state. Therefore, even if the user does not press a designated button, the elevator automatically stops at the floor for which use is permitted, and the permitted user can smoothly complete his or her business. In particular, in the case of a visitor, the visitor can go to the permitted floor without getting lost or accidentally going down to another floor, even without being accompanied by a guide.
  • the designation button for the permitted floors may be automatically made selectable, and the designation buttons for floors other than the permitted floors may be automatically made unselectable. This prevents you from accidentally pressing down on another floor.
  • warning information will be output, so the second user and the people concerned at the stopping floor can quickly recognize the fact. . Therefore, it is possible to prevent malicious users from entering unauthorized floors.
  • Embodiment 2-1 even if the second user mingles with other users or tailgating on board, the permitted floor is determined after facial recognition is performed for each user upon disembarkation. Therefore, it is possible to warn the second user who is not permitted to get off the vehicle at the stop floor. Therefore, it is possible to prevent people from getting off the train while tailgating. Furthermore, in Example 2-2, since the target of the second face authentication is narrowed down, the cost of face authentication when getting off the vehicle can be reduced.
  • the second embodiment can reduce the cost of installing physical gates and help prevent unauthorized users from entering each floor.
  • the third embodiment is a modification of the second embodiment described above.
  • the first facial authentication is performed. Therefore, in the elevator 100 according to the third embodiment, a second camera is installed at a position where the face of the user who presses the designation button can be photographed, for example, around the floor designation section 140.
  • the overall configuration of the usage management support system according to the third embodiment is the same as that described above, so illustrations and redundant explanations will be omitted, and the differences from the second embodiment will be mainly explained below.
  • the identification unit uses facial feature information in a database for a first facial image taken when a first user attempts to specify a floor to get off in an elevator. If the first face authentication is successful, the first permitted floor is specified.
  • "when the first user attempts to specify the floor to get off" is, for example, when the first user presses the specification button in the floor specification section in the elevator.
  • the operation control unit specifies stopping at the specified floor when the first face authentication is successful and the floor specified by the first user is included in the first permitted floors. Operation control is performed by selecting the specified button.
  • "when the first user attempts to specify the floor to get off” means, for example, when the first user stands in front of the floor designation part in the elevator to specify the floor to get off, and , it may be before the designated button is pressed. If the first face authentication is successful at this time, the operation control unit may control the operation by setting a designation button for designating stopping at the first permitted floor in a selectable state.
  • FIG. 14 is a flowchart showing the flow of operation control processing when boarding an elevator according to the third embodiment.
  • the elevator 100 has stopped at a predetermined floor and the user U1 and the like have boarded the elevator 100.
  • the user U1 first user
  • the second camera photographs the face of the user U1 in front of the floor designation section 140, and transmits the photographed image to the usage management support device 300 via the network N.
  • the photograph was taken in the elevator 100 (by the second camera) when the user U1 was specifying the floor to get off” is an example of "the photograph was taken due to boarding the elevator". be.
  • the usage management support device 300 accepts the press of the alighting floor designation button by the user U1 in the elevator 100 (S331). At the same time, the usage management support device 300 acquires a captured image of the user U1 in front of the designated button in the elevator 100 (S301a).
  • steps S302 to S305 are executed similarly to FIG. 7 described above, and if the first user succeeds in the first face authentication, steps S306 and S307 are executed similarly to FIG. 7 described above.
  • the usage management support device 300 determines whether the exit floor (designated floor) accepted in step S331 is included in the first permitted floor specified in step S307 (S338). If the specified floor is included in the first permitted floors of the first user, the usage management support device 300 changes the specified button for the specified first permitted floor to the selected state, as described above (S308). Thereby, the operation controller 110 puts the corresponding designation button in the floor designation section 140 into a selected state.
  • the usage management support device 300 outputs warning information ( S309). Thereby, the warning information output device 170 outputs warning information.
  • the usage management support device 300 does not necessarily have to output warning information to the administrator terminal 400. This is because, for example, excessive notifications may occur if the user presses the wrong button. Therefore, in step S309 of FIG. 14, the usage management support device 300 may output an alarm sound, audio data or a display message indicating that the designated floor is not a permitted floor as warning information.
  • step S331 of FIG. 14 may be executed after the face authentication is successful in step S305 and before step S338. This is because if face authentication fails, the user is not permitted to use the elevator in the first place, so there is no need to accept the designation of the exit floor, and it is sufficient to output warning information.
  • the usage management support device 300 may change the designation button for the identified first permitted floor to a selectable state, that is, activate the designation button.
  • the usage management support device 300 also changes the designation buttons other than the specified first permitted floor to a state where they cannot be selected, that is, deactivates the designation buttons. Thereby, when there are a plurality of first permitted floors, selectable designation buttons can be narrowed down in advance, and erroneous selection by the user can be prevented. Thereafter, the user U1 may press the designation button 141 for "10F".
  • the usage management support device 300 may accept a press from among the activated alighting floor designation buttons.
  • FIG. 15 is a diagram showing an example of pressing a designated button in the elevator 100 according to the third embodiment.
  • the user U1 has pressed the designation button 141 in front of the floor designation section 140.
  • the camera 120-3 is an example of a second camera, and photographs the face of the user U1 in front of the floor designation section 140.
  • the first face authentication for the first face image of the user U1 extracted from the image taken by the camera 120-3 is successful.
  • the usage management support device 300 determines that "10F" corresponding to the designation button 141 pressed by the user U1 is included in the permitted floors 3122 associated with the user U1, and changes the designation button 141 to the selected state. do. In other words, this indicates that the designation button 141 pressed by the user U1 has been activated.
  • FIG. 16 is a diagram showing a display example of warning information when a specified button in an elevator is pressed according to the third embodiment.
  • the designation button 141 corresponding to the 10th floor in front of the floor designation section 140, or before pressing the designation button 141
  • a case is shown in which the user U1 is not allowed to get off (designation) on the 10th floor.
  • the user U3 is not permitted to get off the train, there are two cases: a case where the user U3's face authentication fails, and a case where the user U3's face authentication is successful but the 10th floor is not included in the permitted floors for the user U3.
  • the display device 130 indicates that warning information similar to that shown in FIG. 12 described above is displayed. However, the warning information is not limited to these.
  • either of the above-described embodiments 2-1 or 2-2 can be applied to the warning determination process when exiting the elevator.
  • this embodiment can also reduce the cost of installing physical gates and help prevent unauthorized users from entering each floor.
  • the designation button will not be in a selected state, and the user will not be able to get off the elevator alone on a floor for which he or she is not permitted. In other words, boarding by malicious users can be prevented.
  • Embodiment 4 is an improved example of Embodiment 2 or 3 described above.
  • the second or third embodiment described above when an elevator passenger tries to get off the elevator on a floor other than the authorized floor, warning information is output. This has the effect of deterring people from getting off the train.
  • this embodiment does not use a security gate, if you are tailgating with authorized users or disembarking in a large group, it is not impossible to disembark at a floor other than the authorized floor. Therefore, in the fourth embodiment, in order for a user who has alighted on a floor other than the permitted floor to return to the original floor, the timing of calling the elevator in the elevator hall is detected to strengthen the call out and deterrence.
  • the determination unit refers to the database and performs third face authentication on a third face image taken of a third user who is about to press an elevator call button on a predetermined floor. Determine whether or not to stop at a predetermined floor. Then, when it is determined that the elevator should not be stopped at the predetermined floor, the operation control unit performs operation control so as not to stop the elevator at the predetermined floor. This can prevent the third user staying on a floor other than the permitted floor from boarding the elevator.
  • "attempting to press an elevator call button on a predetermined floor” means, for example, when the third user presses a call button in an elevator hall on a predetermined floor.
  • "trying to press the elevator call button on a predetermined floor” may be, for example, when the third user stands in front of the call button and before pressing the call button.
  • the output unit outputs second warning information when it is determined that the vehicle should not be stopped at a predetermined floor. This makes it easier for the third user and people around the elevator hall on the predetermined floor to recognize that the third user is staying on the predetermined floor without permission.
  • the output unit preferably outputs the second warning information including the third face image to the terminal of the administrator on the predetermined floor. This makes it easy for a security guard, administrator, etc. on a predetermined floor to recognize the third user's face and then call out to or track the third user.
  • the determination unit also controls the third face authentication using facial feature information associated with a predetermined floor in the database, and determines that the stop should not be made at the predetermined floor if the third face authentication fails. It is best to judge that. This reduces the amount of facial feature information to be authenticated compared to normal face authentication processing, making it possible to reduce authentication costs such as authentication processing load and processing time. In other words, authentication processing can be made more efficient.
  • the determination unit refers to the database to identify a third permitted floor associated with the third user who has successfully completed the third face authentication, and the predetermined floor is not included in the third permitted floor. In this case, it may be determined not to stop at a predetermined floor. Thereby, the third user himself or the person concerned on the predetermined floor can quickly recognize this fact. Therefore, it is possible to prevent a malicious user from escaping from an unauthorized floor.
  • the operation control unit may control the operation by making the call button unselectable. This makes it possible to avoid stopping the elevator and prevent the third user from boarding the elevator.
  • FIG. 17 is a block diagram showing the configuration of a usage management support system 1000b according to the fourth embodiment.
  • the usage management support system 1000b is installed at a position where the floor camera 101-2 can photograph an area including the face of the user who presses the call button for calling the elevator 100 on each floor.
  • the floor camera 101-2 third camera
  • the floor camera 101-2 is installed above the call button of the elevator 100 in the elevator hall of a predetermined floor.
  • the user UX third user
  • the user UX does not have the predetermined floor registered as a permitted floor.
  • FIG. 18 is a flowchart showing the flow of warning determination processing when an elevator is called according to Example 4-1 of the fourth embodiment.
  • the user UX presses the call button of the elevator 100 in the elevator hall of a predetermined floor.
  • the floor camera 101-2 photographs the face of the user UX in front of the call button, and transmits the photographed image to the usage management support device 300 via the network N.
  • the usage management support device 300 receives a press of the call button by the user UX to call the elevator 100 at a predetermined floor (S341). In addition, the usage management support device 300 acquires a captured image of the user UX when calling the elevator 100 (S342).
  • steps S302 to S305 are executed similarly to FIG. 7 described above, and if the third user succeeds in the third face authentication, steps S306 and S307 are executed similarly to FIG. 7 described above.
  • the usage management support device 300 determines whether the predetermined floor accepted in step S341 is included in the third permitted floor specified in step S307 (S347). If the predetermined floor is included in the third permitted floors of the third user, the usage management support device 300 changes the designation button accepted in step S341 to a selected state (S348). Specifically, the usage management support device 300 transmits an instruction to select a call button for a predetermined floor via the network N to a controller (not shown) of an elevator hall on the predetermined floor. This causes the controller to select the call button, ie activate the call button.
  • the usage management support device 300 outputs warning information ( S349).
  • the warning information output device (not shown) on the predetermined floor outputs warning information.
  • the warning information output device outputs an alarm sound or a warning message from a speaker in an elevator hall on a predetermined floor.
  • the warning information output device lights up or blinks a lamp in the elevator hall of a predetermined floor, or displays a warning message on the display panel.
  • the usage management support device 300 may transmit the warning information to the administrator terminal 400 via the network N.
  • the usage management support device 300 may output warning information including the third user's face image.
  • warning information such as a facial image of the third user may be displayed on a display panel in an elevator hall on a predetermined floor. This allows people around the elevator hall on the predetermined floor to recognize that the third user is a user who is not permitted to stay on the predetermined floor, making it easier to take action.
  • the usage management support device 300 may transmit the warning information in step S349 to the administrator terminal 400 via the network N.
  • the administrator terminal 400 displays the received warning information such as the third user's face image on the screen. This allows the building, the manager, the person in charge, and the security guard on a predetermined floor to recognize the third user's face, making it easier to approach and track the third user.
  • step S341 of FIG. 18 may be executed after the face authentication is successful in step S305 and before step S347. This is because if face authentication fails, the user is not permitted to use the current floor (predetermined floor) in the first place, so there is no need to accept the press of the call button, and it is sufficient to output warning information.
  • the usage management support device 300 may make the call button unselectable, that is, deactivate it.
  • FIG. 19 is a flowchart showing the flow of warning determination processing when an elevator is called according to Example 4-2 of the fourth embodiment.
  • step S341 is executed as in the above-described embodiment 4-1.
  • the usage management support device 300 identifies the user ID 3121 associated with the predetermined floor as the permitted floor 3122 from the user management DB 312 (S343).
  • step S342 is executed similarly to the above-described embodiment 4-2. Then, the usage management support device 300 extracts the user's face image from the captured image (S302). After steps S343 and S302, the usage management support device 300 transmits a face authentication request targeted at the user ID specified in step S343 (S344). For example, if multiple user IDs are identified in step S343, the usage management support device 300 specifies the identified multiple user IDs and performs facial authentication including the facial image of the third user extracted in step S302. The request is sent to the authentication device 200 via the network N.
  • the authentication device 200 performs face authentication processing by comparing the third user's facial feature information with each of the narrowed-down facial feature information 212.
  • the authentication device 200 transmits the face authentication result to the usage management support device 300. Thereafter, steps S304 to S307 and S347 to S349 are executed similarly to FIG. 18 described above.
  • FIG. 20 is a diagram showing an example when the elevator 100 is called according to the fourth embodiment.
  • a display device 130 is installed outside the elevator 100 (on the elevator hall side), and shows that the user UX has pressed the call button 180 of the elevator 100 in the elevator hall of a predetermined floor. Alternatively, it may be before the user UX presses the call button 180.
  • the floor camera 101-2 photographs the face of the user UX who is in front of the call button of the elevator 100 in the elevator hall on a predetermined floor. In this example, it is assumed that the third face authentication for the third face image of the user UX extracted from the image taken by the floor camera 101-2 is successful.
  • the usage management support device 300 does not activate the call button.
  • the usage management support device 300 may transmit a control signal that suppresses activation of a call button to a controller of an elevator hall on a predetermined floor.
  • the usage management support device 300 outputs a warning message to the controller.
  • the controller causes the display 130 to display the warning message "You are not authorized to stay on this floor!”.
  • FIG. 21 is a diagram showing a display example of warning information when an elevator is called according to the fourth embodiment.
  • the user UX presses the call button 180 in the elevator hall on the 10th floor, or before pressing the button, a case is shown in which the user UX is not allowed to stay on the 10th floor in the first place.
  • the user UX's face authentication fails, and a case in which the user UX's face authentication succeeds but the 10th floor is not included in the permitted floors for the user U3.
  • the display device 130 indicates that warning information similar to that shown in FIG. 12 described above is displayed. However, the warning information is not limited to these.
  • FIG. 22 is a diagram illustrating an example in which warning information at the time of elevator call according to the fourth embodiment is displayed on the administrator terminal.
  • a case is shown in which warning information is output to the administrator terminal 400 in step S349 in the same situation as in FIG. 21 described above.
  • the administrator terminal 400 displays the warning information output in step S349 on the screen.
  • the warning information displayed on the screen of the administrator terminal 400 includes, for example, an image taken by the floor camera 101-2 installed above the call button in the elevator hall on the 5th floor, and the person targeted for the warning in the image. includes a face image and a warning message.
  • the face image may be an image obtained by enlarging the face area of the person to be warned out of the photographed image.
  • the warning message includes the floor to be warned, date and time, and so on.
  • the warning message reads, "At 2:30 pm, there is a user in the elevator hall on the 5th floor who is not permitted to stay on the 5th floor.”
  • the warning message is not limited to this.
  • the manager or security guard of a building, etc., or the manager of a company using the exit floor, etc. can check the warning information displayed on the administrator terminal 400 to determine which of the people who are attempting to board the elevator are allowed to board the elevator. It will be easier to understand the number of people who are not working and their facial photos.
  • the warning information may include attribute information such as the boarding floor, name, and department of the person to be warned, or information indicating that the person is unregistered.
  • biometric authentication identity verification, personal authentication, personal identification processing, etc.
  • biometric authentication and biometric information other techniques that use captured images of people can be applied.
  • the biometric information may be data (feature amounts) calculated from physical characteristics unique to an individual, such as fingerprints, voiceprints, veins, retinas, iris of the eyes, and patterns on the palm of the hand.
  • feature information indicating a person's physical characteristics is extracted from a photographed image of a part of the user's body, and the extracted feature information is compared with pre-registered feature information to determine the match.
  • biometric authentication may be based on a person's external shape.
  • the characteristic information is information regarding the external shape of the person, for example, information indicating characteristics such as body shape, height, clothing, etc.
  • the authentication device 200 and the usage management support device 300 are described as separate information processing devices, but they may be the same.
  • the usage management support device 300 may further associate and register facial feature information with the user ID 3121 of the user management DB 312.
  • the control unit 340 may further include the functions of the face detection unit 220, feature point extraction unit 230, registration unit 240, and authentication unit 250 shown in FIG.
  • the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments.
  • the program may be stored on a non-transitory computer readable medium or a tangible storage medium.
  • computer readable or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD - Including ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device.
  • the program may be transmitted on a transitory computer-readable medium or a communication medium.
  • transitory computer-readable or communication media includes electrical, optical, acoustic, or other forms of propagating signals.
  • (Appendix A1) Performs first face authentication on a first face image taken due to boarding the elevator by referring to a database that associates facial feature information of the user with floors that the user is permitted to use.
  • identification means for identifying a first permission floor associated with a successful first user; operation control means for controlling operation of the elevator according to the first permitted floor;
  • a determining means for determining whether or not the second user can get off the vehicle;
  • output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
  • a usage management support device comprising: (Appendix A2) The identifying means performs the first face authentication performed on the first face image taken of the first user when boarding the elevator using the facial feature information in the database.
  • the usage management support device described in Appendix A1. (Appendix A3) The usage management support device according to appendix A2, wherein the operation control means controls the operation of the elevator so that it stops at the first permitted floor. (Appendix A4) The usage management support device according to appendix A2, wherein the operation control means performs the operation control by making a designation button for designating stopping at the first permitted floor in the elevator selectable. (Appendix A5) The identifying means is performed using the facial feature information in the database with respect to the first facial image taken when the first user attempts to specify a floor to get off in the elevator. identifying the first permitted floor when the first facial authentication is successful; The usage management support device described in Appendix A1.
  • the determining means is referring to the database to identify a second permission floor associated with the second user who has successfully completed the second face authentication;
  • the usage management support device according to any one of appendices A1 to A7, wherein if the stop floor is not included in the second permitted floor, it is determined that the second user is not allowed to get off the vehicle.
  • the usage management according to any one of appendices A1 to A9, wherein the output means outputs the first warning information including the second face image to a terminal of the manager of the stop floor. Support equipment.
  • the determining means refers to the database and performs third face authentication on a third face image taken of a third user who is about to press a call button of the elevator at a predetermined floor. Determine whether to stop at a predetermined floor, The operation control means performs the operation control so as not to stop the elevator at the predetermined floor when it is determined that the elevator is not to be stopped at the predetermined floor.
  • Device. (Appendix A12) The usage management support device according to appendix A11, wherein the output means outputs second warning information when it is determined not to stop at the predetermined floor.
  • the determining means is referring to the database to identify a third permission floor associated with the third user who has successfully completed the third face authentication;
  • the usage management support device according to any one of appendices A11 to A13, wherein if the predetermined floor is not included in the third permitted floor, it is determined that the vehicle should not be stopped at the predetermined floor.
  • the usage management support device according to any one of appendices A11 to A15, wherein the operation control means performs the operation control by making the call button unselectable when it is determined that the operation should not be stopped at the predetermined floor. .
  • (Appendix B1) a database that associates facial feature information of a user with permission floors that the user is permitted to use; a usage management support device connected to the database;
  • the usage management support device includes: Identifying a first permitted floor associated with a first user who has successfully performed first face authentication on a first face image taken due to boarding an elevator by referring to the database; means and operation control means for controlling operation of the elevator according to the first permitted floor; By referring to the database and performing second face authentication on a second face image taken of the second user getting off the elevator at the stop floor where the elevator has stopped in accordance with the operation control, A determining means for determining whether or not the second user can get off the vehicle; output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle; A usage management support system equipped with.
  • the identifying means performs the first face authentication performed on the first face image taken of the first user when boarding the elevator using the facial feature information in the database. if successful, identifying the first authorized floor; The usage management support system described in Appendix B1.
  • the computer is Performs first face authentication on a first face image taken due to boarding the elevator by referring to a database that associates facial feature information of the user with floors that the user is permitted to use.
  • identification processing for identifying a first permission floor associated with a successful first user; an operation control process that controls the operation of the elevator according to the first permitted floor;
  • a determination process for determining whether or not the second user can get off the vehicle;
  • Output processing that outputs first warning information when it is determined that the second user is not allowed to get off the vehicle;
  • a non-transitory computer-readable medium that stores a usage management support program that causes a computer to execute.

Abstract

Un dispositif d'aide à la gestion d'utilisation (1) comprend : une unité d'identification (11) qui se réfère à une base de données dans laquelle des éléments d'informations de caractéristiques faciales d'utilisateurs et des étages autorisés pour lesquels l'utilisation par chacun des utilisateurs a été autorisée sont associés les uns aux autres, de façon à identifier un premier étage autorisé associé à un premier utilisateur qui a réussi une première authentification de visage pour une première image faciale qui a été imagée à la suite de l'entrée dans un ascenseur; une unité de commande de fonctionnement (12) qui effectue une commande de fonctionnement pour l'ascenseur en fonction du premier étage autorisé; une unité de détermination (13) qui se réfère à la base de données, effectue une seconde authentification de visage pour une seconde image faciale obtenue par imagerie d'un second utilisateur qui sort au niveau d'un étage d'arrêt auquel l'ascenseur s'est arrêté selon la commande de fonctionnement, de façon à déterminer s'il est possible pour le second utilisateur de sortir au niveau de l'étage d'arrêt; et une unité de sortie (14) qui délivre en sortie des premières informations d'alerte s'il a été déterminé que le second utilisateur ne peut pas sortir.
PCT/JP2022/013850 2022-03-24 2022-03-24 Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur WO2023181236A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/013850 WO2023181236A1 (fr) 2022-03-24 2022-03-24 Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/013850 WO2023181236A1 (fr) 2022-03-24 2022-03-24 Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur

Publications (1)

Publication Number Publication Date
WO2023181236A1 true WO2023181236A1 (fr) 2023-09-28

Family

ID=88100605

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/013850 WO2023181236A1 (fr) 2022-03-24 2022-03-24 Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur

Country Status (1)

Country Link
WO (1) WO2023181236A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007169030A (ja) * 2005-12-26 2007-07-05 Mitsubishi Electric Corp エレベータシステム
JP2011195268A (ja) * 2010-03-19 2011-10-06 Hitachi Information & Communication Engineering Ltd 入退管理システム
US20220058760A1 (en) * 2018-12-27 2022-02-24 Nec Corporation Information processing apparatus, information processing method, and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007169030A (ja) * 2005-12-26 2007-07-05 Mitsubishi Electric Corp エレベータシステム
JP2011195268A (ja) * 2010-03-19 2011-10-06 Hitachi Information & Communication Engineering Ltd 入退管理システム
US20220058760A1 (en) * 2018-12-27 2022-02-24 Nec Corporation Information processing apparatus, information processing method, and storage medium

Similar Documents

Publication Publication Date Title
KR101610657B1 (ko) 출입통제 데이터를 기반으로 하는 3차원 공간정보 출입통제 및 방역 시스템 및 방법
CN101600640B (zh) 电梯的安全系统
JP2011048547A (ja) 異常行動検知装置、監視システム及び異常行動検知方法
JP5404423B2 (ja) エレベータ制御システム及びエレベータ制御装置
US11769392B2 (en) Method of and device for converting landline signals to Wi-Fi signals and user verified emergency assistant dispatch
CN105303089A (zh) 对无线设备的功能的受控访问
KR101981900B1 (ko) 얼굴 인식 기술을 이용한 안전 관리 시스템 및 그 방법
US10419728B2 (en) Monitoring system having personal information protection function and method thereof
JP6483214B1 (ja) エレベータシステム及びエレベータの迷子検出方法
KR20160025768A (ko) 안면인식을 활용하는 출석관리 시스템
WO2023181236A1 (fr) Dispositif d'aide à la gestion d'utilisation, système, procédé et support lisible par ordinateur
KR102246925B1 (ko) 통합 버스 정보 및 질병 관리 시스템과 방법
JP5404076B2 (ja) 扉制御装置
JP2007022776A (ja) エレベータの防犯システム
JP2021087103A (ja) 情報処理装置、情報処理装置の制御方法およびプログラム
US20230095529A1 (en) Visit assistance apparatus, visit assistance method, and non-transitory computerreadable medium storing program
KR102220921B1 (ko) 비가역함수를 이용하여 프라이버시 침해를 방지하는 부정승차 검출시스템 및 방법
WO2020203302A1 (fr) Système de notification, procédé de notification et programme informatique de notification
JP5524250B2 (ja) 異常行動検知装置、監視システム、異常行動検知方法及びプログラム
JP2018073059A (ja) 顔認証防犯システム
WO2023181090A1 (fr) Dispositif, système et procédé de commande d'ascenseur et support lisible par ordinateur
JP2019153908A (ja) 画像認証システム、画像認証方法および画像認証プログラム
WO2019111408A1 (fr) Dispositif de commande d'ascenseur et procédé de commande d'ascenseur
KR102658852B1 (ko) 안면 인식 기반 출입 관리 시스템
KR20090002458A (ko) 탑승 정보 제공 장치 및 상기 장치를 수행하는 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22933377

Country of ref document: EP

Kind code of ref document: A1