JP7576860B2 - Locking/unlocking system and locking/unlocking device - Google Patents

Description

The present invention relates to a locking/unlocking system and a locking/unlocking device for locking and unlocking doors via a thumb turn.

Electric locks that electrically lock or unlock (hereinafter referred to as "locking and unlocking") locks on doors of homes and offices without using a physical key have been increasingly used. For example, the locking and unlocking system described in Patent Document 1 includes an external housing that is provided on the outside surface of the door and a key case that is embedded in the door, and is configured so that the deadbolt of the key case is electrically opened and closed based on key information input to the external housing.

According to the above-mentioned locking/unlocking system, people entering or leaving a house or office can lock and unlock the door by inputting key information into an external housing, so there is no need to carry a physical key. However, existing doors are equipped with parts such as key cases and thumb turns that correspond to locking and unlocking with physical keys, so in order to introduce the locking/unlocking system of Patent Document 1, work is required to remove the existing parts.

Meanwhile, a locking/unlocking control device for use with existing doors is described in Patent Document 2. The locking/unlocking control device is a device that is attached to the inside surface of the door so as to cover the thumbturn, and includes a clamping structure that clamps the knob of the thumbturn, and a control unit that rotates and drives the clamping structure in response to remote control by the user via a smartphone.

Patent No. 6935965 Patent No. 7071017

In recent years, locking/unlocking control devices such as those described in Patent Document 2 have appeared, which control locking/unlocking by linking with the user's smartphone. Specifically, an application for linking with the locking/unlocking control device is installed in the user's smartphone in advance, and key information is sent to the locking/unlocking control device through the application. If the received key information is successfully authenticated, the locking/unlocking control device rotates the thumb turn.

In this way, a system that links a locking/unlocking control device with a user's smartphone uses a smartphone instead of a physical key, so the user must always carry the smartphone with them when going out. If the smartphone is left behind inside the room, or if the user does not own a smartphone at all, it becomes impossible to use the locking/unlocking device to lock or unlock the door.

Therefore, the present invention aims to provide a locking/unlocking system and a locking/unlocking device that do not require a physical key for existing doors and that allow users who do not own a smartphone to lock and unlock doors.

In order to achieve the above object, the locking/unlocking system of the present invention comprises an acquisition terminal installed to acquire biometric information of a person positioned in front of a door, a locking/unlocking device attached to a thumb turn provided on the interior side of the door, and a server that authenticates the person's eligibility to enter and exit the door based on the person's biometric information, and the locking/unlocking device operates the thumb turn in accordance with the authentication result.

The present invention is also characterized in that the acquisition terminal has an input reception unit that receives touch input from the person, and acquires the biometric information when touch input is received on the input reception unit.

The present invention is also characterized in that the acquisition terminal has an imaging unit that captures an image of the area in front of the door and generates an image, and acquires the biometric information when a person is detected in the generated image.

Furthermore, the present invention is characterized in that the acquisition terminal returns from a power saving mode when acquiring the biometric information.

The present invention is also characterized in that the acquisition terminal has an attitude detection unit that detects the installation attitude and an alarm generation unit that generates an alarm, and the alarm generation unit generates the alarm when the installation attitude changes.

The present invention is also characterized in that the locking/unlocking device and the acquisition terminal transmit and receive operation information of the thumb turn based on the authentication result using a Bluetooth Low Energy communication method.

Furthermore, the present invention is characterized in that the biometric information is generated based on a facial image of the person captured by the imaging unit.

Furthermore, the acquisition terminal is characterized in that it is a smart device.

According to the present invention, a physical key is not required for an existing door, and even users who do not own a smartphone can lock and unlock the door.

FIG. 1 is a view of a door in which a locking/unlocking system according to an embodiment of the present invention is installed, viewed from the outside of a room. Door with locking/unlocking system installed, viewed from inside the room Overall diagram of the hardware that makes up the locking/unlocking system (a) A hardware configuration diagram of a smart device provided in the locking/unlocking system, (b) A hardware configuration diagram of a locking/unlocking device provided in the locking/unlocking system, and (c) A hardware configuration diagram of a server provided in the locking/unlocking system. Side view of a door with a locking and unlocking system installed (a) a user table held by the server; (b) a verification list held by the server; and (c) an installation information table held by the server. A diagram showing the main flow of the locking/unlocking system A diagram showing the registration process of the locking/unlocking system A diagram showing the locking/unlocking process of the locking/unlocking system. A diagram showing the tracking process of the locking and unlocking system

[First embodiment]

Below, the locking/unlocking system relating to the first embodiment of the present invention is described with reference to the drawings.

1 to 3, the locking/unlocking system 100 according to the first embodiment is a system that locks and/or unlocks a door D of a house or an office building based on biometric information of a person entering or exiting the door D. The locking/unlocking system 100 includes a plurality of smart devices 10a, 10b, and 10c that are outdoor terminals installed outside the doors Da, Db, and Dc, a server 30 that is capable of communicating with each of the plurality of smart devices 10a, 10b, and 10c via a network such as an Internet communication line, and a plurality of locking/unlocking devices 20a, 20b, and 20c installed on thumb turns S inside the doors Da, Db, and Dc. The aspect of being installed outside the door means that all or a part of the smart device 10 is exposed to the outside of the door D.

<Smart device configuration>

The smart device 10 functions as an acquisition terminal that acquires biometric information, and is a known smartphone or tablet terminal that is installed outside the door D. The installation manner of the smart device 10 is not particularly limited, but for example, as shown in FIG. 1, the smart device 10a is attached to the outer surface of the door Da with double-sided tape on its back. The smart device 10b is attached to the wall surface near the door Db with double-sided tape on its back. The smart device 10c is held in a holder (not shown) provided at the top of a support provided in front of the door Dc. The smart devices 10a and 10b may be embedded inside the walls near the door Da or the door Db so that their front faces are exposed to the outside.

As shown in Fig. 4(a), the smart device 10 includes a touch panel display 11, a camera module 12, a short-range wireless communication module 13, a network communication module 14, and a GPS module 17. These are electrically connected to the CPU 15 of the smart device 10 and are controlled by the CPU 15.

The touch panel display 11 is disposed over substantially the entire front surface of the smart device 10, and functions as a display unit that displays information generated by the CPU 15 to a person standing in front of the door D. The touch panel display 11 also functions as an input receiving unit that receives touch input from a person standing in front of the door D and inputs the input to the CPU 15.

The camera module 12 is disposed on the front side of the smart device 10 and includes an image sensor that captures an image of the area in front of the door D through a lens unit. The camera module 12 functions as an imaging unit that captures an image of a person standing in front of the door D and generates an image, and inputs the generated image to the CPU 15.

The network communication module 14 is a module that functions as a network communication unit that connects to a network such as an Internet communication line and transmits and receives information to the server 30 via the network. The network communication module is a Wi-Fi module that wirelessly connects to a LAN installed in the room, or a communication module that connects to a mobile communication network provided by a telecommunications carrier based on subscriber information recorded on a SIM card. In this embodiment, the network communication module preferentially connects to the indoor LAN, and connects to the mobile communication network when it cannot connect to the indoor LAN.

The short-range wireless communication module 13 is a module that functions as a short-range wireless communication unit that performs short-range wireless communication using radio waves, and transmits an operation command to the locking/unlocking device 20. The operation command is a command that indicates that the thumb turn S should be rotated in the unlocking direction, or a command that indicates that the thumb turn S should be rotated in the locking direction. In this embodiment, from the viewpoint of reducing energy consumption, a Bluetooth (registered trademark) module that performs wireless communication according to the Bluetooth Low Energy standard is used as the short-range wireless communication module 13.

The GPS module 17 is a module that functions as a location detection unit that detects the location of the smart device 10 and inputs the detected location information to the CPU 15.

The CPU 15 is electrically connected to the memory 16, and functions as a processing unit that executes application programs stored in the memory 16 to process images acquired from the camera module 12, information transmitted and received via the network communication module 14, information transmitted and received via the short-range communication module 13, and location information received from the GPS. Note that the application programs stored in the memory 16 are assigned identification information (hereinafter referred to as a "device code") that is unique to the smart device 10 in order to distinguish the smart device 10 from other smart devices.

<Configuration of the locking/unlocking device>

2 and 5, the locking/unlocking device 20 is installed on the inside surface of the door D so as to cover the thumb turn S. The locking/unlocking device 20 includes a housing 21 installed on the door D and a clamping portion 22 that clamps the thumb turn S. The housing 21 includes a base 23 that is attached to the inside surface of the door D via double-sided tape, and an extension portion 24 that extends from the tip of the base 23 toward the thumb turn S. As shown in FIG. 4, the inside of the housing 21 contains a board on which a short-range wireless communication module 25, a microcomputer 26 (MCU 26), a drive circuit 27, and a power circuit that supplies power to these components are mounted, a motor 28, and a power transmission mechanism (not shown) that transmits the rotational power of the motor 28 to the clamping portion 22.

The short-range wireless communication module 25 of the locking/unlocking device 20 is a module that functions as a short-range wireless communication unit that performs wireless communication by radio waves with the corresponding smart device 10, receives operation commands from the smart device 10, and inputs the received operation commands to the microcomputer 26. Note that in this embodiment, a Bluetooth module that performs wireless communication according to the Bluetooth Low Energy standard is used, similar to the short-range wireless communication device 13 of the smart device 10.

The microcomputer 26 has a built-in CPU (not shown) and memory (not shown), and the CPU executes a program stored in the memory to output a control signal to the drive circuit 27 that controls the rotation direction and rotation step of the motor 28 based on the input operation command. In this way, the microcomputer 26 functions as a control unit that controls the motor 28. The drive circuit 27 is a circuit that drives the motor 28, and outputs power to the motor 28 to drive the motor 28 based on the control signal input from the microcomputer 26.

The motor 28 rotates based on the power input from the drive circuit 27. The shaft of the motor 28 is connected to a power transmission mechanism composed of multiple gears, and the output shaft of the power transmission mechanism is connected to the clamping unit 22. As a result, the clamping unit 22 rotates in response to the rotation of the motor 28.

<Server configuration>

As shown in FIG. 4(c), the server 30 includes a network communication module 31 for communicating with the smart device 10 via a network such as an Internet communication line, a CPU 32, and a memory 33.

The memory 33 of the server 30 functions as a storage unit that stores information used in the locking/unlocking process, information provision process, and tracking process described below, and includes a user table, a matching list, and an installation information table, as shown in Figure 6. Each table and list will be explained below.

6A, the user table functions as a user information storage unit that stores information on persons (hereinafter referred to as "users") who are authorized to enter and exit door D, and a record is provided for each user. The user table has a user ID field, a biometric information field, and a personal information field.
The user ID field stores a user ID. The user ID is a character string that is uniquely assigned to each user and is issued by the server 30 in a registration process that will be described later.
The biometric information field is used to register the biometric information of the user. The biometric information in this embodiment is a feature amount calculated by analyzing a facial image of the user, and is acquired by the smart device 10 in a registration process described later.
In the personal information field, personal information of the user other than biometric information is registered. The personal information is, for example, private information such as name, address, telephone number, and email address, and business information such as department, position, and employment type. When the smart device 10 is installed in a general residence, private information is registered, and when the smart device 10 is installed in an office building, business information is registered. Such personal information is acquired by the smart device 10 in a registration process (s10) described later.

As shown in FIG. 6(b), the matching list stores the user IDs of users who are authorized to enter and exit the door, and multiple matching lists (three matching lists in this embodiment) are provided to correspond to each smart device 10 (device code). User IDs are registered in the matching lists in the registration process (s10) described below.

As shown in FIG. 6(c), the installation information table functions as an installation information storage unit that stores installation information (device code, installation location, and GPS value) regarding the installation of the smart device 10, and a record is provided for each smart device 10. The installation information table has a device code field in which the device code of the smart device 10 is registered, an installation location field, and a GPS field. The installation location field registers the address of the building in which the smart device 10 is installed. The GPS field registers the GPS value acquired by the GPS module 17 of the smart device 10. Registration of installation information in the installation information table is performed in the registration process (s10) and tracking process (s30) described below.

As described above, the locking/unlocking system 100 of this embodiment is composed of multiple smart devices 10, multiple locking/unlocking devices 20, and the server 30, and the locking/unlocking device 20 operates the thumb turn S based on the operation command received from the corresponding smart device 10. Here, in the locking/unlocking system 100 of this embodiment, the smart device 10 acquires biometric information of a person in front of the door D, the server 30 identifies the user based on the biometric information, and the smart device 10 transmits an operation command to the locking/unlocking device 20 based on the authentication result of the user's entry/exit qualification. In addition, the server 30 provides the information registered in the memory 33 to the administrator computer 40 (FIG. 3) via the Internet communication line. Furthermore, the server 30 is capable of tracking the location of the installed smart device 10. Below, the processing flow of the locking/unlocking system 100 will be described based on FIG. 7 to FIG. 10.

<Registration process>

Figure 7 shows the main flow of the locking/unlocking system 100, where the registration process (s10) is executed first. The registration process (s10) is a process for registering information in the user table, comparison list, and installation information table stored in the memory 33 of the server 30, and is executed when the smart device 10 is installed. In the registration process (s10), as shown in Figure 8, the smart device 10 executes an input process (s11), an image capture process (s12), a biometric information acquisition process (s13), and a transmission process (s14) in this order, and the server executes a reception process (s15) and a registration process (s16) in this order.

The input process (s11) includes an installation information input process and a user information input process.
The installation information input process is a process in which a user or an installer of each smart device 10 inputs installation information, and the CPU 15 of the smart device 10 displays an input form on the touch panel display 11 for inputting the installation location. The user or installer operates the touch panel display 11 to input the installation location into the input form. When the CPU 15 acquires the installation location from the touch panel display 11, it reads out the device code stored in the memory 16 and acquires a GPS value from the GPS module 17. The CPU 15 stores the installation location, device code, and GPS value in the memory 16 in association with each other.
The user information input process is a process for having the user input personal information. Specifically, the CPU 15 of the smart device 10 displays an input form for inputting personal information on the touch panel display 11. The user operates the touch panel display 11 to input the personal information into the input form. When the CPU 15 acquires the personal information from the touch panel display 11, the CPU 15 stores the personal information in the memory 16.

The imaging process (s12) is a process of capturing an image of the user's face, for example by taking a selfie. Specifically, the CPU 15 of the smart device 10 inputs an imaging command to the camera module 12. The camera module 12 captures an image at a predetermined frame rate in accordance with the input imaging command, and generates an image. The image generated by the camera module 12 is input to the CPU 15. Each time the CPU 15 acquires an image from the camera module 12, it causes the acquired image to be displayed on the touch panel display 11. The CPU 15 also causes a decision button to be displayed on the touch panel display 11 together with the display. The decision button is a GUI, and when the decision button is pressed by the user, the CPU 15 stores the displayed image in the memory 16 as an image for biometric information.

The biometric information acquisition process (s13) is a process for acquiring the biometric information of the user based on the image stored in the memory 16 in the imaging process (s12), and includes an extraction process in which the CPU 15 extracts an image of the face part included in the image (hereinafter referred to as the "face image"), and a calculation process in which the CPU 15 calculates feature amounts based on the extracted face image. The method of calculating the feature amounts is not particularly limited, but for example, the feature amounts can be calculated by quantifying the positions, sizes, ranges, etc. of facial elements such as the eyes, nose, and mouth based on certain rules. The feature points calculated in this manner are stored in the memory 16 as the biometric information of the user.

The transmission process (s14) is a process in which the CPU 15 of the smart device 10 transmits the information (installation information, personal information, biometric information) acquired in each of the above processes to the server 30 via the network communication module 14.

The receiving process (s15) is a process in which the CPU 32 of the server 30 receives installation information, personal information, and biometric information via the network communication module 31.

In the registration process (s16), the CPU 32 of the server 30 issues a new user ID and adds the user ID, the received personal information, and the biometric information to the user table. The CPU 32 also adds the received installation information to the installation information table. Furthermore, the CPU 32 identifies a matching list corresponding to the device code included in the installation information, and adds the user ID to the identified matching list.

The above registration process (s10) is performed for all users who are eligible to enter and exit door D.

<Locking/unlocking process>

Returning to FIG. 7, the detection process (s2) is executed after the registration process (s10). The detection process (s2) is a process for detecting a person located in front of the door D. Specifically, the CPU 15 of the smart device 10 monitors input from the touch panel display 11. In this state, when the user performs a touch input on the touch panel display 11, information on the touch input is input from the touch panel display 11 to the CPU 15. When the input is received, the CPU 15 determines that a person is present in front of the door D. As another example of the detection process (s2), the CPU 15 of the smart device 10 inputs an image capture command to the camera module 12 at predetermined second intervals. Based on the image capture command, the camera module 12 captures an image in front of the door D and inputs the generated image to the CPU 15. The CPU 15 analyzes the acquired image and determines that a person is present in front of the door D when a person is detected in the image. The smart device 10 performs one or both of the detection process using the touch panel display 11 and the detection process using the camera module 12.

If the result of the above detection process (s2) is that no person is detected (No), the request confirmation process (s3) described below is executed. On the other hand, if a person is detected (Yes), the locking/unlocking process (s20) is executed.

The locking/unlocking process (s20) is a process that authenticates the entry/exit eligibility of a person based on the detected biometric information of the person, and operates the thumb turn S if the authentication is successful.As shown in Figure 9, the process includes an acquisition process (s21), an identification process (s22), a matching process (s23), a selection process (s25), and an operation process (s26).

The acquisition process (s21) is a process for acquiring biometric information of a person in front of door D. In this embodiment, the CPU 15 of the smart device 10 inputs an image capturing command to the camera module 12. The camera module 12 captures an image in accordance with the input image capturing command, generates an image, and inputs the generated image to the CPU 15. The CPU 15 detects the face of the person in the image acquired from the camera module 12, and calculates the feature amount of the face. The method of calculating the feature amount is the same as the calculation method in the above-mentioned registration process (s10). The biometric information acquired by the acquisition process (s21) is transmitted to the server 30.

When the server 30 receives the biometric information, it executes an identification process (s22). The identification process (s22) is a process in which the CPU 32 of the server 30 identifies the user corresponding to the received biometric information. Specifically, the CPU 32 searches the user table for biometric information that is most similar to the received biometric information (feature). If there is no similar biometric information (No), a message is sent to the smart device 10 indicating that the authentication of entry and exit qualifications has failed. On the other hand, if there is similar biometric information (Yes), a user ID corresponding to the biometric information is extracted from the user table. In this way, the CPU 32 of the server 30 functions as an identification unit that identifies a user based on the biometric information.

Once the server 30 has identified the user, it executes a matching process (s23). In the matching process (s23), the CPU 32 of the server 30 matches the identified user ID with a matching list corresponding to the received device code. If the user ID is included in the matching list as a result of the matching, a message is sent to the smart device 10 indicating that authentication of the entry/exit qualifications has been successful. On the other hand, if the user ID is not included in the matching list, a message is sent to the smart device 10 indicating that authentication of the entry/exit qualifications has failed. In this way, the CPU 32 of the server 30 functions as a matching unit that matches the identified user with the matching list. The identification unit and the matching unit then constitute a qualification authentication unit that authenticates the entry/exit qualifications of a person at the door.

The smart device 10 receives the authentication result from the server 30. If the received authentication result is a failure (s24: No), the locking/unlocking process (s20) is terminated. On the other hand, if the authentication result is a success (s24: Yes), the selection process (s25) is executed.

The selection process (s25) is a process that allows the user to select either unlocking or locking, and the CPU 15 of the smart device 10 displays a selection screen having a GUI for selecting unlocking or locking on the touch panel display 11 and accepts the user's selection. Here, if "lock" is selected, the CPU 15 of the smart device 10 transmits a lock command to the locking/unlocking device 20 via the short-range wireless communication module 13. On the other hand, if "unlock" is selected, the CPU 15 of the smart device 10 transmits an unlock command to the locking/unlocking device 20 via the short-range wireless communication module 13.

The short-range wireless communication module 25 of the locking/unlocking device 20 receives the command transmitted from the smart device 10 and inputs the received command to the microcomputer 26. The microcomputer 26 inputs a control signal for controlling the motor 28 to the drive circuit 27 in response to the command input from the short-range wireless communication module 25. The drive circuit 27 outputs power to the motor 28 for driving the motor 28 based on the control signal input from the microcomputer 26. As described above, the rotational power of the motor 28 is transmitted to the clamping portion 22 via the power transmission mechanism, and the knob of the thumb turn S rotates as the clamping portion 22 rotates.

As described above, according to the locking/unlocking system 100 of this embodiment, the locking/unlocking device 20 is installed so as to cover the thumb turn S, and the locking/unlocking device 20 operates the thumb turn S based on the authentication result from the smart device 10, so that it is possible to lock and unlock an existing door D without using a physical key. In addition, because the smart device 10 is installed on the door D, even users who do not own a smartphone can use it.

In addition, according to the locking/unlocking system 100 of this embodiment, the user's personal information and biometric information are registered in the server. Therefore, even if the smart device 10 is lost or stolen, the personal information and biometric information will not be leaked.

Returning to FIG. 7, when the lock/unlock process (s20) is executed, the server 30 checks whether there is a request from the administrator computer 40 (s3). The request is to send the installation information, and if there is no request, the next time confirmation process (s4) is executed. On the other hand, if there is a request, the information provision process (s30) is executed. In the information provision process (s30), the CPU 32 of the server 30 extracts the installation information from the installation information table and sends the extracted installation information to the administrator computer 40. The administrator computer 40 displays the received installation information on a display unit such as a monitor. This allows the administrator to check the installation information.

When the information provision process (s30) is executed, a time confirmation process (s4) is executed. The time confirmation process (s4) is a process in which the CPU 15 of the smart device 10 checks whether a predetermined time has elapsed. If the predetermined time has not elapsed, a person detection process (s2) is executed. If the predetermined time has elapsed, the tracking process (s40) described below is executed.

The tracking process (s40) is a process for tracking the position of the smart device 10 installed at the door D, and as shown in FIG. 10, executes a GPS acquisition process (s41), a comparison process (s42), a map information generation process (s43), and a display process (s44).

The GPS acquisition process (s41) is a process in which the smart device 10 acquires GPS values from the GPS module 17. The CPU 15 of the smart device 10 associates the acquired GPS values with the device code stored in the memory 16 and transmits them to the server 30.

The CPU 32 of the server 30 receives the GPS value and the device code from the smart device 10 and executes a comparison process (s42). In the comparison process (s42), the GPS value corresponding to the received device code is extracted from the installation information table, and the extracted GPS value is compared with the received GPS value. As a result of the comparison, if the GPS values of each other are within the error range, it is judged to be normal, and if they differ beyond the error range, it is judged to be abnormal. If it is judged to be abnormal in this way, information indicating the abnormality and the device code of the smart device 10 judged to be abnormal are transmitted to the administrator computer 40 in a transmission process described later. After performing the above comparison, the CPU 32 of the server 30 identifies a record in the installation information table based on the received device code, and registers the received GPS value in the GPS field of the identified record.

Next, the CPU 32 of the server 30 executes a map information generation process (s43). The map information generation process (s43) is a process for generating a map showing the location of the installed smart device 10 with a marker, and the CPU 32 of the server 30 extracts the GPS value from the installation information table and generates map information that reflects the extracted GPS value in the marker coordinates on the map. The CPU 32 of the server 30 transmits the generated map information and the comparison result to the administrator computer 40.

The administrator computer 40 receives the map information and the comparison results from the server 30 and executes a display process (s44). The display process (s44) is a process for displaying the information received from the server 30, and when a comparison result indicating an abnormality is received, the administrator computer 40 displays a screen on the monitor instructing the administrator to check the installation status of the smart device 10. The administrator computer 40 also displays the map information on the monitor. This allows the administrator to check the location of the smart device 10.

The locking/unlocking system 100 of this embodiment may further have the following functions:

＜Anti-theft feature＞

In addition to the tracking function described in the above embodiment, the locking/unlocking system 100 may have an anti-theft function for the smart device 10. As the anti-theft function, the smart device 10 generates an alarm when its installation posture changes. Specifically, as shown in FIG. 4, the smart device 10 includes an angular velocity sensor 18 that functions as a detector that detects the installation posture, and a speaker 19 that functions as an alarm generator that generates an alarm sound when the installation posture changes. The angular velocity sensor 18 is a sensor that detects the rotation and change in orientation of the smart device 10 as an angular velocity, and the signal is input to the CPU 15. The CPU 15 determines the change in the installation posture of the smart device 10 based on the change in the signal input from the angular velocity sensor 18. In this way, the CPU 15 functions as a posture change determination unit. Then, when it is determined that the installation posture has changed as a result of the determination, the CPU 15 plays an alarm sound source pre-stored in the memory 16. The alarm sound signal output by playing the alarm sound source is amplified by an amplifier circuit (not shown) and input to the speaker 19. According to this configuration, an alarm sound is output when the attitude of the installed smart device 10 changes, so that theft can be prevented.

Furthermore, when the CPU 15 of the smart device 10 detects a change in the installation posture, it inputs an image capture command to the camera module 12. Then, it may acquire an image generated by the camera module 12 and transmit it to the server 30. When the server 30 receives an image from the smart device 10, it stores the image in the memory 33 and transmits the image to the administrator computer 40 based on a request from the administrator computer 40.

<Intercom function>

The locking/unlocking system 100 may have an intercom function. The intercom function is a function for communicating with a person in front of the door D. Specifically, the locking/unlocking system 100 is equipped with a network telephone capable of communicating with the smart device 10. The network telephone is a known IP telephone or Internet telephone installed in the room and is connected to an Internet communication line. The smart device is equipped with a speaker 19 and a microphone (not shown), and the CPU 15 converts a voice signal input from the microphone into voice information and transmits it to the network telephone. The CPU 15 also generates the voice information received from the network telephone from the speaker. According to this configuration, a person in front of the door D can use the smart device 10 to communicate with a person in the room.

In addition, when making the above-mentioned call, the CPU 15 of the smart device 10 may display a GUI for "ringing the intercom" or a GUI for "ringing the doorbell" on the touch panel display 11, and may start the call when the GUI is operated. It is preferable to display the GUI when the person's entry and exit qualification is not authenticated (s24: No), for example.

In addition, when the GUI is operated, the CPU 15 of the smart device 10 may input an image capture command to the camera module 12 and acquire an image generated by the camera module. In this embodiment, the CPU 15 transmits the acquired image and device code to the server 30. The server 30 stores the received image and device code in memory 33 in association with each other. According to this embodiment, an image of a person to whom a call is to be made can be stored in the server 30. When the image is to be viewed, a viewing request is transmitted to the server 30 from a user terminal that can be connected to an Internet communication line. When the CPU 32 of the server 30 receives the viewing request, the CPU 32 identifies the device code corresponding to the received user based on the matching list, and transmits the image stored in association with the identified device code to the user terminal.

Although an embodiment of the present invention has been described above, the present invention is not limited to the embodiment and may be modified in the following manner, for example.

[Modification 1]
In the above embodiment, the smart device 10 calculates the facial feature points of a person based on an image and transmits the feature points to the server 30 as biometric information. However, the image acquired by the smart device 10 may be transmitted to the server 30 as biometric information, and the CPU 32 of the server 30 may calculate the feature points. The server 30 may identify a user by machine learning. For example, in the registration process (s10), the server 30 acquires an image of the user from the smart device 10 and generates a trained model using the image of the user as teacher data. Then, in the identification process (s22), the CPU 32 of the server 30 can identify the user by inputting the image acquired from the smart device 10 into the trained model.

[Modification 2]
In the above embodiment, feature points calculated from a person's facial image and a facial image are used as biometric information, but a user may also be identified based on biometric information such as a fingerprint, palm print, veins, iris, ear, or voiceprint.

For example, when using biometric information such as a fingerprint, palm print, or vein pattern, a scanner that scans a fingerprint, palm print, vein pattern, etc. to generate a biometric image is communicatively connected to the smart device 10, and the biometric image generated by the scanner is input to the smart device 10.

In addition, for example, when biometric information such as the iris or auricle is used, a camera that generates a biometric image of the iris or auricle is communicatively connected to the smart device 10, and the biometric image generated by the camera is input to the smart device 10.

For example, when a voiceprint is used as biometric information, the biometric information is acquired by a microphone provided in the smart device 10, and the acquired biometric information is input to the CPU 15 of the smart device 10. An external microphone may also be connected to the smart device 10.

[Modification 3]
In the above embodiment, the user is identified based only on the face image. However, the user may be identified by combining the face image with other biometric information as described in the second modification.

[Modification 4]
In the locking/unlocking process (s20) of the above embodiment, an authentication process may be executed to authenticate the user identified by the identification process (s22). In this modified embodiment, a password field is provided in the user table provided in the memory 33 of the server 30. The password field is a field in which a password designated by the user is registered, and is registered together with the user's personal information in the above registration process (s10). The password is an alphanumeric character string, an answer to a question, or the like. In the locking/unlocking process (s20), an input process of the password is executed after the acquisition process (s21), and the password is transmitted to the server 30 together with the biometric information by the transmission process. In the reception process, the server 30 receives the password together with the biometric information, and the authentication process is executed after the identification process (s22). In the authentication process, first, the password corresponding to the user ID identified in the identification process (s22) is extracted from the user table, and the received password is compared with the extracted password. If the two match as a result of the comparison, it is authenticated that the user (user ID) identified in the identification process (s22) is valid, that is, the user identified in the identification process (s22) is a user of this system. Note that the person authentication using the password does not necessarily have to be performed for all users, and may be performed only for users who are identical twins. Also, it may be performed only when entering a room with a high security level.

[Modification 5]
In the registration process (s10) of the above embodiment, the smart device 10 transmits the information to be registered to the server 30, but the present invention is not limited to this. For example, the locking/unlocking system 100 may be provided with a user's terminal (hereinafter referred to as a "user terminal") capable of communicating with the server 30 via an Internet communication line, and may be capable of transmitting biometric information and personal information from the user terminal to the server 30. By enabling the user terminal to transmit biometric information and personal information to the server 30 in this manner, when the personal information is changed after the fact or when the identification of the user based on the biometric information becomes unstable, the user himself/herself can re-register such information.

[Modification 6]
In the above embodiment, the smart device 10 may operate in a power saving mode such as a sleep mode if no person is detected in the detection process (s2) (No), and may operate in a normal mode if a person is detected in the detection process (s2).

[Modification 7]
In the above embodiment, communication between the smart device 10 and the locking/unlocking device 20 is based on the Bluetooth Low Energy standard, but other wireless communication standards or wired communication standards may also be used.

[Modification 8]
The memory 33 of the server 30 in the above embodiment may function as a history storage unit that stores the authentication history. Specifically, the memory 33 of the server 30 is provided with a history table. A record is added to the history table every time the authentication of the entry/exit qualification of a user is successful. The history table includes a user code field in which the user code of the authenticated user is registered, a date and time field in which the date and time of the authentication is registered, a device code field in which the device code of the smart device 10 used for the authentication is registered, and a biometric information field in which the biometric information used for the authentication is registered. The information registered in the history table is transmitted to the administrator computer 40 in response to a request from the administrator computer 40. The administrator computer 40 displays the received information on a monitor. According to this aspect, the administrator can grasp the entry and exit status of the user.

[Modification 9]
In the above embodiment, the smart device 10 is installed outside as an acquisition terminal that acquires a facial image, which is biometric information. However, it may also be installed, for example, inside (inside) a glass door D and capture a facial image of a person outside through the glass door D.

10 Smart device (acquisition terminal)
11 Touch panel display (input reception section)
12 Camera module (imaging unit)
13 Short-distance wireless communication module 17 GPS module (position detection unit)
18 Angular velocity sensor (attitude detection part)
20 Locking/unlocking device 30 Server 100 Locking/unlocking system D Door S Thumb turn

Claims (9)

A locking/unlocking device is disposed on the interior side of the door and attached to a thumb turn provided on the interior side of the door to operate the thumb turn;
an acquisition terminal that is installed in association with the locking/unlocking device, is capable of communicating with the locking/unlocking device, and acquires biometric information of a person positioned in front of the door;
a server capable of communicating with the acquisition terminal, identifying the person based on the biometric information received from the acquisition terminal, verifying the person's eligibility to enter and exit the door by comparing the identified person with a person list managed in association with the acquisition terminal , and transmitting an authentication result to the acquisition terminal ;
Equipped with
The locking/unlocking device operates the thumb turn based on information for operating the thumb turn from the acquisition terminal that receives the authentication result , in a locking/unlocking system. the acquisition terminal has an input receiving unit that receives a touch input from the person;
The locking/unlocking system according to claim 1 , wherein the biometric information is acquired when a touch input is made to the input receiving unit. The acquisition terminal has an imaging unit that captures an image of the area in front of the door and generates an image,
The locking/unlocking system according to claim 1 , wherein the biometric information is acquired when a person is detected in the generated image. The locking/unlocking system according to claim 2 or 3, characterized in that the acquiring terminal returns from a power saving mode when acquiring the biometric information. The acquiring terminal,
A posture detection unit that detects an installation posture;
an alarm generating unit that generates an alarm;
having
The locking/unlocking system according to claim 1 , wherein the alarm generating unit generates the alarm when the installation attitude is changed. The locking/unlocking system according to claim 1, characterized in that the locking/unlocking device and the acquiring terminal transmit and receive information for operating the thumb turn using a Bluetooth Low Energy communication method. The locking/unlocking system according to claim 3, characterized in that the biometric information is generated based on a facial image of the person captured by the imaging unit. The locking/unlocking system according to claim 1, characterized in that the acquisition terminal is a smart device. The locking/unlocking device of the locking/unlocking system of claim 1.

Images