WO2024023867A1

WO2024023867A1 - Locking/unlocking system, and locking/unlocking device

Info

Publication number: WO2024023867A1
Application number: PCT/JP2022/028545
Authority: WO
Inventors: 規之鈴木
Original assignee: 株式会社アスタリスク
Priority date: 2022-07-23
Filing date: 2022-07-23
Publication date: 2024-02-01

Abstract

[Problem] To remove the need for a physical lock for an already installed door, and enable locking/unlocking even by a user not in possession of a smartphone. [Solution] This locking/unlocking system 100 is characterized by comprising: an acquisition terminal 10 installed so as to acquire biometric information of a person located in front of a door D; a locking/unlocking device 20 attached to a thumb turn S that is provided on the indoor-side of the door D; and a server 30 for authenticating the exit/entry qualification for said person with respect to the door on the basis of the biometric information of the person. The locking/unlocking system 100 is also characterized in that the locking/unlocking device 20 operates the thumb turn S in accordance with the authentication result.

Description

Locking/unlocking system and locking/unlocking device

The present invention relates to a locking/unlocking system that locks/unlocks a door via a thumb turn, and a locking/unlocking device.

BACKGROUND ART Conventionally, electric locks have been used to electrically lock or unlock (hereinafter referred to as "locking/unlocking") locks installed on doors of homes and offices without using a physical key. For example, the locking/unlocking system described in Patent Document 1 includes an external housing provided on the outer surface of the door and a key case embedded in the door, and key information input to the external housing is provided. Based on this, the deadbolt of the key case is configured to open and close electrically.

According to the above-described locking/unlocking system, a person entering or leaving a house or office can lock and unlock the door by inputting key information into the external housing, so there is no need to carry a physical key. However, existing doors are equipped with parts such as key cases and thumb turns that are compatible with locking and unlocking with physical keys, so in order to introduce the locking and unlocking system of Patent Document 1, it is necessary to remove the existing parts. Construction will be required.

On the other hand, a lock/unlock control device used for an existing door is described in Patent Document 2. The locking/unlocking control device is a device that is attached to the inner surface of the door so as to cover the thumb turn, and includes a clamping structure that clamps the thumbturn knob, and a control that rotates the clamping structure in response to remote control from the user's smartphone. It has a section and a.

Patent No. 6935965 Patent No. 7071017

In recent years, a locking/unlocking control device as described in Patent Document 2 has appeared, and this locking/unlocking control device controls locking/unlocking by interlocking with a user's smartphone. Specifically, the smartphone owned by the user has an application installed in advance to work with the lock/unlock control device, and key information is sent to the lock/unlock control device through the application. . The lock/unlock control device rotates the thumb turn when the received key information is successfully authenticated.

This system, in which the lock/unlock control device and the user's smartphone are linked, uses the smartphone instead of a physical key, so the user is required to always carry the smartphone with him when he goes out. be. If the smartphone is left behind in the room, or if the user does not own the smartphone in the first place, it will be impossible to lock and unlock the smartphone using the locking control device.

Therefore, an object of the present invention is to provide a locking/unlocking system and a locking/unlocking device that do not require a physical key to an existing door and can be locked and unlocked even by a user who does not own a smartphone. shall be.

In order to achieve the above object, the locking/unlocking system of the present invention includes an acquisition terminal installed to acquire biometric information of a person located in front of the door, and a locking/unlocking system attached to a thumb turn provided on the indoor side of the door. The locking and unlocking device includes a locking device and a server that authenticates the person's entry/exit qualification to the door based on the person's biometric information, and the locking/unlocking device operates the thumb turn according to the authentication result. shall be.

Further, the present invention is characterized in that the acquisition terminal has an input reception unit that receives a touch input from the person, and acquires the biometric information when there is a touch input to the input reception unit.

Further, the present invention provides that the acquisition terminal includes an imaging unit that images the area in front of the door and generates an image, and acquires the biometric information when a person is detected in the generated image. Features.

Furthermore, the present invention is characterized in that the acquisition terminal returns from the power saving mode when acquiring the biometric information.

Further, in the present invention, the acquisition terminal includes an orientation detection unit that detects an installation orientation, and an alarm generation unit that generates an alarm, and the alarm generation unit is configured to alarm the alarm when the installation orientation changes. It is characterized by generating.

Further, the present invention is characterized in that the lock/unlock device and the acquisition terminal transmit and receive operation information of the thumb turn based on the authentication result using a Bluetooth Low Energy communication method.

Furthermore, the present invention is characterized in that the biological information is generated based on a facial image of the person captured by the imaging unit.

Furthermore, the acquisition terminal is a smart device.

According to the present invention, there is no need for a physical key to an existing door, and even a user who does not own a smartphone can lock and unlock the existing door.

A diagram of a door installed with a locking/unlocking system according to an embodiment of the present invention, viewed from outside A view of a door equipped with a locking/unlocking system from inside the room Overall diagram of the hardware that makes up the lock/unlock system (a) Hardware configuration diagram of a smart device included in the locking/unlocking system, (b) Hardware configuration diagram of a locking/unlocking device included in the locking/unlocking system, (c) Hardware configuration diagram of a server included in the locking/unlocking system. Side view of a door with locking and unlocking system installed (a) User table possessed by the above server, (b) Verification list possessed by the above server, (c) Installation information table possessed by the above server Diagram showing the main flow of the lock/unlock system Diagram showing the registration process of the lock/unlock system Diagram showing the locking/unlocking process of the locking/unlocking system Diagram showing the tracking process of the lock/unlock system

[First embodiment]

Hereinafter, a locking/unlocking system according to a first embodiment of the present invention will be described based on the drawings.

As shown in FIGS. 1 to 3, a locking/unlocking system 100 according to the first embodiment locks and/or locks a door D of a house or an office building based on biometric information of a person entering or exiting the door D. Or it is an unlocking system. This locking/unlocking system 100 includes a plurality of

smart devices

10a, 10b, 10c, which are outdoor terminals installed outside doors Da, Db, and Dc, and a plurality of

smart devices

10a, 10b connected via a network such as an Internet communication line. , 10c, and a plurality of locking/unlocking

devices

20a, 20b, 20c installed at thumb turns S inside each door Da, Db, Dc. Note that the mode in which the smart device 10 is installed outdoors is a mode in which all or part of the smart device 10 is exposed outside the door D.

The smart device 10 functions as an acquisition terminal that acquires biometric information, and is a known smart phone or tablet terminal installed outside the door D. Although the manner in which the smart device 10 is installed is not particularly limited, for example, as shown in FIG. 1, the smart device 10a is adhered to the outer surface of the door Da with a double-sided tape provided on the back thereof. The smart device 10b is adhered to a wall near the door Db with double-sided tape provided on the back side of the smart device 10b. The smart device 10c is held in a holder (not shown) provided at the top of a column provided in front of the door Dc. Note that the

smart devices

10a and 10b may be embedded inside a wall near the door Da or the door Db so that the front surfaces thereof are exposed toward the outside.

As shown in FIG. 4(a), the smart device 10 includes a touch panel display 11, a camera module 12, a short-range wireless communication module 13, a network communication module 14, and a GPS module 17. These are electrically connected to the CPU 15 included in the smart device 10 and controlled by the CPU 15.

The touch panel display 11 is arranged on substantially the entire front surface of the smart device 10, and functions as a display unit that displays information generated by the CPU 15 to the person in front of the door D. Further, the touch panel display 11 functions as an input reception unit that receives a touch input from a person in front of the door D and inputs the input to the CPU 15.

The camera module 12 is placed in front of the smart device 10 and includes an image sensor that captures an image in front of the door D via a lens unit. The camera module 12 functions as an imaging unit that takes an image of the person in front of the door D and generates an image, and inputs the generated image to the CPU 15.

The network communication module 14 is a module that functions as a network communication unit that connects to a network such as an Internet communication line and sends and receives information to and from the server 30 via the network. The network communication module is a Wi-Fi module that wirelessly connects to a LAN installed in the room, and connects to a mobile communication network provided by a carrier based on subscriber information recorded on a SIM card. It is a communication module. In this embodiment, the network communication module preferentially connects to the indoor LAN, and connects to the mobile communication network when it cannot connect to the indoor LAN.

The short-range wireless communication module 13 is a module that functions as a short-range wireless communication unit that performs short-range wireless communication using radio waves, and transmits operation commands to the lock/unlock device 20. The operation command is a command indicating to rotate the thumb turn S in the unlocking direction or a command indicating rotating the thumb turn S in the locking direction. In this embodiment, from the viewpoint of reducing energy consumption, a Bluetooth (registered trademark) module that performs wireless communication according to the Bluetooth Low Energy standard is used as the short-range wireless communication module 13.

The GPS module 17 is a module that functions as a position detection unit that detects the position of the smart device 10, and inputs the detected position information to the CPU 15.

The CPU 15 is electrically connected to the memory 16, and by executing an application program stored in the memory 16, images acquired from the camera module 12, information transmitted and received via the network communication module 14, and short-range information are stored in the memory 16. It functions as a processing unit that processes information transmitted and received via the communication module 13 and position information received from GPS. Note that the application program stored in the memory 16 includes identification information (hereinafter referred to as a "device code") that is uniquely assigned to the smart device 10 in order to distinguish it from other smart devices. ) has been established.

The lock/unlock device 20 is installed on the inner surface of the door D so as to cover the thumb turn S, as shown in FIGS. 2 and 5. The locking/unlocking device 20 includes a casing 21 installed on the door D and a clamping part 22 that clamps the thumb turn S. The housing 21 includes a base 23 that is adhered to the inner surface of the door D via double-sided tape, and an extension 24 that extends from the tip of the base 23 toward the thumb turn S. As shown in FIG. 4, inside the housing 21, there is a board on which a short-range wireless communication module 25, a microcomputer 26 (MCU 26), a drive circuit 27, and a power supply circuit that supplies power to these components are mounted. , a motor 28, and a power transmission mechanism (not shown) that transmits the rotational power of the motor 28 to the clamping portion 22.

The short-range wireless communication module 25 of the lock/unlock device 20 is a module that functions as a short-range wireless communication unit that performs wireless communication using radio waves with the corresponding smart device 10, and receives operation commands from the smart device 10 and performs the received operation. A command is input to the microcomputer 26. Note that in this embodiment, like the short-range wireless communication device 13 of the smart device 10, a Bluetooth module that performs wireless communication according to the Bluetooth Low Energy standard is used.

The microcomputer 26 has a built-in CPU (not shown) and memory (not shown), and the CPU executes a program stored in the memory to control the rotational direction of the motor 28 based on the input operation command. and outputs a control signal for controlling the rotation step to the drive circuit 27. In this way, the microcomputer 26 functions as a control section that controls the motor 28. The drive circuit 27 is a circuit that drives the motor 28 , and outputs electric power for driving the motor 28 to the motor 28 based on a control signal input from the microcomputer 26 .

The motor 28 rotates based on the power input from the drive circuit 27. The shaft of the motor 28 is connected to a power transmission mechanism composed of a plurality of gears, and the output shaft of the power transmission mechanism is connected to the clamping part 22. As a result, the holding portion 22 rotates in accordance with the rotation of the motor 28.

As shown in FIG. 4C, the server 30 includes a network communication module 31 for communicating with the smart device 10 via a network such as an Internet communication line, a CPU 32, and a memory 33.

The memory 33 of the server 30 functions as a storage unit that stores information used in locking/unlocking processing, information provision processing, and tracking processing, which will be described later.As shown in FIG. Equipped with an installation information table. Each table and list will be explained below.

As shown in FIG. 6(a), the user table functions as a user information storage unit that stores information on persons who are qualified to enter/exit door D (hereinafter referred to as "users"), and is configured for each user. A record is set. The user table has a user ID field, a biometric information field, and a personal information field.
A user ID is registered in the user ID field. The user ID is a character string uniquely assigned to each user, and is issued by the server 30 in a registration process described later.
The user's biometric information is registered in the biometric information field. The biometric information of this embodiment is a feature amount calculated by analyzing a user's face image, and is acquired by the smart device 10 in a registration process described later.
The user's personal information other than biometric information is registered in the personal information field. Personal information includes, for example, private information such as name, address, telephone number, and e-mail address, as well as business information such as department, position, and employment type. When the smart device 10 is installed in a general residence, Private information is registered, and if the smart device 10 is installed in an office building, business information is registered. Such personal information is acquired by the smart device 10 in a registration process (s10) described later.

As shown in FIG. 6(b), the verification list stores the user ID of the user who is qualified to enter/exit the door. In the embodiment, three matching lists) are provided. Registration of the user ID in the matching list is performed in a registration process (s10) described later.

As shown in FIG. 6(c), the installation information table functions as an installation information storage unit that stores installation information (device code, installation location, and GPS value) regarding the installation of the smart device 10. A record is provided every 10. The installation information table has a device code field in which the device code of the smart device 10 is registered, an installation location field, and a GPS field. In the installation location field, the location of the building where the smart device 10 is installed is registered. The GPS value acquired by the GPS module 17 of the smart device 10 is registered in the GPS field. Registration of installation information in the installation information table is performed in a registration process (s10) and a tracking process (s30), which will be described later.

As described above, the locking/unlocking system 100 of this embodiment is configured by a plurality of smart devices 10, a plurality of locking/unlocking devices 20, and a server 30, and the locking/unlocking device 20 receives Operate thumb turn S based on the operation command. Here, in the locking/unlocking system 100 of the present embodiment, the smart device 10 acquires biometric information of the person in front of the door D, the server 30 identifies the user based on the biometric information, and the authentication result of the user's entry/exit qualification is obtained. Based on this, the smart device 10 transmits an operation command to the lock/unlock device 20. Further, the server 30 provides the information registered in the memory 33 to the administrator computer 40 (FIG. 3) via the Internet communication line. Furthermore, the server 30 is capable of tracking the location of the installed smart device 10. The processing flow of the lock/unlock system 100 will be described below based on FIGS. 7 to 10.

FIG. 7 shows the main flow of the lock/unlock system 100, and first, registration processing (s10) is executed. The registration process (s10) is a process of registering information in the user table, collation list, and installation information table provided in the memory 33 of the server 30, and is executed when the smart device 10 is installed. . In the registration process (s10), as shown in FIG. 8, the smart device 10 executes an input process (s11), an imaging process (s12), a biological information acquisition process (s13), and a transmission process (s14) in this order. Then, the server executes reception processing (s15) and registration processing (s16) in this order.

The input process (s11) includes an installation information input process and a user information input process.
The installation information input process is a process in which the user or the person in charge of installation of each smart device 10 inputs installation information, and the CPU 15 of the smart device 10 causes the touch panel display 11 to display an input form for inputting the installation location. A user or a person in charge of installation operates the touch panel display 11 to input the installation location into the input form. Upon acquiring the installation location from the touch panel display 11, the CPU 15 reads out the device code stored in the memory 16 and acquires the GPS value from the GPS module 17. The CPU 15 stores the installation location, device code, and GPS value in the memory 16 in association with each other.
The user information input process is a process that allows the user to input personal information. Specifically, the CPU 15 of the smart device 10 causes the touch panel display 11 to display an input form for inputting personal information. The user operates the touch panel display 11 to input personal information into the input form. Upon acquiring the personal information from the touch panel display 11, the CPU 15 stores the personal information in the memory 16.

The image capturing process (s12) is a process of capturing an image of the user's face, for example by taking a selfie. Specifically, the CPU 15 of the smart device 10 inputs an imaging command to the camera module 12. The camera module 12 performs imaging at a predetermined frame rate according to the input imaging command and generates an image. The image generated by the camera module 12 is input to the CPU 15. Every time an image is acquired from the camera module 12, the CPU 15 displays the acquired image on the touch panel display 11. Further, the CPU 15 causes the touch panel display 11 to display a determination button along with the display. The determination button is a GUI, and when the determination button is pressed by the user, the CPU 15 stores the displayed image in the memory 16 as an image for biological information.

The biological information acquisition process (s13) is a process for acquiring the user's biological information based on the image stored in the memory 16 in the imaging process (s12), and the CPU 15 acquires the image ( This includes an extraction process for extracting a facial image (hereinafter referred to as a "face image"), and a calculation process for calculating feature amounts based on the extracted facial image. Note that the method for calculating the feature amount is not particularly limited, but for example, it may be calculated by quantifying the position, size, range, etc. of facial elements such as eyes, nose, and mouth based on certain rules. Can be done. The feature points calculated in this manner are stored in the memory 16 as biometric information of the user.

The transmission process (s14) is a process in which the CPU 15 of the smart device 10 transmits the information (installation information, personal information, biometric information) acquired in each of the above processes to the server 30 via the network communication module 14. .

The reception process (s15) is a process in which the CPU 32 of the server 30 receives installation information, personal information, and biometric information via the network communication module 31.

In the registration process (s16), the CPU 32 of the server 30 issues a new user ID, and additionally registers the user ID, the received personal information, and biometric information in the user table. Further, the CPU 32 additionally registers the received installation information in the installation information table. Further, a verification list corresponding to the device code included in the installation information is specified, and the user ID is additionally registered in the specified verification list.

The above registration process (s10) is performed for all users who are eligible to enter and exit door D.

Returning to FIG. 7, the detection process (s2) is executed after the registration process (s10). The detection process (s2) is a process for detecting a person located in front of door D. Specifically, the CPU 15 of the smart device 10 monitors input from the touch panel display 11. In this state, when the user performs a touch input on the touch panel display 11, information regarding the touch input is input from the touch panel display 11 to the CPU 15. The CPU 15 determines that a person exists in front of the door D when the input is received. As another example of the detection process (s2), the CPU 15 of the smart device 10 inputs an imaging command to the camera module 12 at predetermined second intervals. Based on the imaging command, the camera module 12 images the area in front of the door D, and inputs the generated image to the CPU 15. The CPU 15 analyzes the acquired image and determines that a person exists in front of the door D if a person is detected in the image. The smart device 10 performs one or both of the detection processing using the touch panel display 11 and the detection processing using the camera module 12.

As a result of the above detection process (s2), if a person is not detected (No), a request confirmation process (s3) to be described later is executed. On the other hand, if a person is detected (Yes), lock/unlock processing (s20) is executed.

The locking/unlocking process (s20) is a process of authenticating the entry/exit qualification of the detected person based on the detected person's biometric information, and operating the thumb turn S if the authentication is successful, as shown in FIG. , acquisition processing (s21), identification processing (s22), matching processing (s23), selection processing (s25), and operation processing (s26).

The acquisition process (s21) is a process of acquiring biometric information of the person in front of door D. In this embodiment, the CPU 15 of the smart device 10 inputs an imaging command to the camera module 12. The camera module 12 performs imaging according to the input imaging command, generates an image, and inputs the generated image to the CPU 15. The CPU 15 detects a person's face in the image obtained from the camera module 12, and calculates the feature amount of the face. The calculation method of the feature amount is the same as the calculation method in the registration process (s10). The biometric information acquired by the acquisition process (s21) is transmitted to the server 30.

Upon receiving the biometric information, the server 30 executes identification processing (s22). The identification process (s22) is a process in which the CPU 32 of the server 30 identifies the user corresponding to the received biometric information. Specifically, the CPU 32 searches the user table for biometric information that is most similar to the received biometric information (feature amount). Here, if there is no similar biometric information (No), a notification that authentication of entry/exit qualification has failed is transmitted to the smart device 10. On the other hand, if there is similar biometric information (Yes), the user ID corresponding to the biometric information is extracted from the user table. In this way, the CPU 32 of the server 30 functions as a specifying unit that specifies the user based on biometric information.

After identifying the user, the server 30 executes a verification process (s23). The verification process (s23) is a process in which the CPU 32 of the server 30 verifies the identified user ID with a verification list corresponding to the received device code. As a result of the verification, if the user ID is included in the verification list, a message is sent to the smart device 10 that the authentication of entry/exit qualification has been successful. On the other hand, if the user ID is not included in the verification list, a message is sent to the smart device 10 that the authentication of entry/exit qualification has failed. In this way, the CPU 32 of the server 30 functions as a matching unit that matches the specified user with the matching list. The identification section and the verification section constitute a qualification authentication section that authenticates the entry and exit qualifications of the person in front of the door.

The smart device 10 receives the authentication result from the server 30. Here, if the received authentication result is a failure (s24: No), the lock/unlock process (s20) is ended. On the other hand, if the authentication result is successful (s24: Yes), a selection process (s25) is executed.

The selection process (s25) is a process in which the user selects either unlocking or locking. and accept the selection by the user. Here, if "lock" is selected, the CPU 15 of the smart device 10 transmits a lock command to the lock/unlock device 20 via the short-range wireless communication module 13. On the other hand, when "unlock" is selected, the CPU 15 of the smart device 10 transmits an unlock command to the lock/unlock device 20 via the short-range wireless communication module 13.

The short-range wireless communication module 25 of the lock/unlock device 20 receives the command sent from the smart device 10 and inputs the received command to the microcomputer 26. The microcomputer 26 inputs a control signal for controlling the motor 28 to the drive circuit 27 in response to a command input from the short-range wireless communication module 25. The drive circuit 27 outputs electric power to the motor 28 to drive the motor 28 based on a control signal input from the microcomputer 26 . As described above, the rotational power of the motor 28 is transmitted to the clamping part 22 via the power transmission mechanism, and as the clamping part 22 rotates, the knob of the thumb turn S rotates.

As described above, according to the locking/unlocking system 100 of the present embodiment, the locking/unlocking device 20 is installed so as to cover the thumbturn S, and the locking/unlocking device 20 locks and unlocks the thumbturn S based on the authentication result from the smart device 10. Since the door is operated, it becomes possible to lock and unlock the existing door D without using a physical key. Furthermore, since the smart device 10 is installed at the door D, even users who do not own a smartphone can use it.

Furthermore, according to the lock/unlock system 100 of this embodiment, the user's personal information and biometric information are registered in the server. Therefore, even if the smart device 10 is lost or stolen, personal information and biometric information will not be leaked.

Returning to FIG. 7, when the lock/unlock process (s20) is executed, the server 30 checks whether there is a request from the administrator computer 40 (s3). The request is for sending installation information, and if there is no request, the next time confirmation process (s4) is executed. On the other hand, if there is a request, information provision processing (s30) is executed. In the information provision process (s30), the CPU 32 of the server 30 extracts installation information from the installation information table and transmits the extracted installation information to the administrator computer 40. The administrator computer 40 displays the received installation information on a display unit such as a monitor. This allows the administrator to check the installation information.

When the information provision process (s30) is executed, the time confirmation process (s4) is executed. The time confirmation process (s4) is a process in which the CPU 15 of the smart device 10 confirms whether a predetermined time has elapsed. If the predetermined time has not elapsed, a person detection process (s2) is executed. When the predetermined time has elapsed, the following tracking process (s40) is executed.

The tracking process (s40) is a process for tracking the position of the smart device 10 installed at the door D, and as shown in FIG. 10, it includes a GPS acquisition process (s41), a comparison process (s42), and a map information generation A process (s43) and a display process (s44) are executed.

The GPS acquisition process (s41) is a process in which the smart device 10 acquires a GPS value from the GPS module 17. The CPU 15 of the smart device 10 associates the acquired GPS value with the device code stored in the memory 16 and transmits the associated value to the server 30.

The CPU 32 of the server 30 receives the GPS value and device code from the smart device 10, and executes the comparison process (s42). In the comparison process (s42), the GPS value corresponding to the received device code is extracted from the installation information table, and the extracted GPS value is compared with the received GPS value. As a result of comparison, if the GPS values are within the error range, it is determined to be normal, and if they differ beyond the error range, it is determined to be abnormal. If it is determined to be abnormal in this manner, information indicating the abnormality and the device code of the smart device 10 determined to be abnormal are transmitted to the administrator computer 40 in a transmission process to be described later. After performing the above comparison, the CPU 32 of the server 30 identifies a record in the installation information table based on the received device code, and registers the received GPS value in the GPS field of the identified record.

Next, the CPU 32 of the server 30 executes map information generation processing (s43). The map information generation process (s43) is a process of generating a map showing the location of the installed smart device 10 with a marker, and the CPU 32 of the server 30 extracts the GPS value from the installation information table and Generate map information that reflects GPS values on marker coordinates on a map. The CPU 32 of the server 30 transmits the generated map information and comparison results to the administrator computer 40.

The administrator computer 40 receives the map information and comparison results from the server 30, and executes display processing (s44). The display process (s44) is a process of displaying the information received from the server 30, and when a comparison result indicating an abnormality is received, the administrator computer 40 checks the installation status of the smart device 10 on the monitor. Display a screen that says. Additionally, the administrator computer 40 displays map information on the monitor. This allows the administrator to confirm the location of the smart device 10.

The locking/unlocking system 100 of this embodiment may further include the following functions.

<Anti-theft function>

In addition to the tracking function described in the above embodiment, the lock/unlock system 100 may have a theft prevention function for the smart device 10. As the theft prevention function, the smart device 10 generates an alarm when its installation orientation changes. Specifically, as shown in FIG. 4, the smart device 10 functions as an angular velocity sensor 18 that functions as a detection unit that detects the installation orientation, and an alarm generation unit that generates an alarm sound when the installation orientation changes. It is equipped with a speaker 19. The angular velocity sensor 18 is a sensor that detects changes in rotation and orientation of the smart device 10 as angular velocity, and its signal is input to the CPU 15. The CPU 15 determines a change in the installation orientation of the smart device 10 based on a change in the signal input from the angular velocity sensor 18 . In this way, the CPU 15 functions as a posture change determination section. As a result of this determination, if it is determined that the installation orientation has changed, the CPU 15 reproduces the alarm sound source stored in the memory 16 in advance. The alarm sound signal output by reproducing the alarm sound source is amplified by an amplifier circuit (not shown) and input to the speaker 19. According to this configuration, an alarm sound is output when the posture of the installed smart device 10 changes, so it is possible to prevent theft.

Further, the CPU 15 of the smart device 10 inputs an imaging command to the camera module 12 when a change in the installation orientation is detected. Then, the image generated by the camera module 12 may be acquired and transmitted to the server 30. Upon receiving the image from the smart device 10, the server 30 stores the image in the memory 33, and transmits the image to the administrator computer 40 based on a request from the administrator computer 40.

The lock/unlock system 100 may have an intercom function. The intercom function is a function to talk to the person in front of door D. Specifically, the lock/unlock system 100 includes a network telephone that can communicate with the smart device 10. The network telephone is a known IP telephone or Internet telephone installed indoors, and is connected to an Internet communication line. The smart device includes a speaker 19 and a microphone (not shown), and the CPU 15 converts an audio signal input from the microphone into audio information and transmits it to the network phone. Further, the CPU 15 causes the speaker to generate audio information received from the network telephone. According to this configuration, the person in front of the door D can use the smart device 10 to talk to a person inside the room.

In addition, when making the above call, the CPU 15 of the smart device 10 displays a GUI to "ring the intercom" or a GUI to "ring the doorbell" on the touch panel display 11, and starts the call when the GUI is operated. I don't mind if you do. The GUI is preferably displayed, for example, when the person's entry/exit qualification is not authenticated (s24: No).

Furthermore, when the GUI is operated, the CPU 15 of the smart device 10 may input an imaging command to the camera module 12 and obtain an image generated by the camera module. In this aspect, the CPU 15 transmits the acquired image and device code to the server 30. The server 30 associates the received image and device code and stores them in the memory 33. According to this aspect, an image of the person with whom the user wants to talk can be stored in the server 30. When viewing the image, a viewing request is sent to the server 30 from a user terminal that can be connected to the Internet communication line. Upon receiving the viewing request, the CPU 32 of the server 30 identifies the device code corresponding to the received user based on the matching list, and transmits the stored image corresponding to the identified device code to the user terminal.

Although the embodiments of the present invention have been described above, the present invention is not limited to the embodiments, and may be modified, for example, as described below.

[Modification 1]
In the above embodiment, the smart device 10 calculates the feature points of the person's face based on the image and sends the feature points to the server 30 as biometric information. It may also be a mode in which the feature points are transmitted to the server 30 and the CPU 32 of the server 30 calculates the feature points. Further, the server 30 may identify the user by machine learning. To identify a user by machine learning, for example, in the registration process (s10), the server 30 acquires a user's image from the smart device 10, and generates a learned model using the user's image as training data. Then, in the identification process (s22), the CPU 32 of the server 30 can identify the user by inputting the image acquired from the smart device 10 into the learned model.

[Modification 2]
In the above embodiment, feature points and facial images calculated from a person's facial image are used as biometric information, but users can also be identified based on biometric information such as fingerprints, palm prints, veins, iris, auricles, or voice prints. I don't mind going.

For example, when biometric information such as a fingerprint, a palm print, or a vein is used, a scanner that scans the fingerprint, palm print, vein, etc. to generate a biometric image is communicatively connected to the smart device 10, and the information generated by the scanner is A biological image is input to the smart device 10.

For example, when using biometric information such as an iris or an auricle, a camera that generates biometric images of the iris or an auricle is communicably connected to the smart device 10, and the biometric image generated by the camera is transferred to the smart device 10. 10 is input.

Furthermore, for example, when a voiceprint is used as biometric information, the biometric information is acquired by a microphone included in the smart device 10, and the acquired biometric information is input to the CPU 15 of the smart device 10. Further, an external microphone may be connected to the smart device 10.

[Modification 3]
In the above embodiment, the user is identified based only on the face image, but the user may be identified by combining the face image and other biometric information mentioned in the second modification.

[Modification 4]
In the locking/unlocking process (s20) of the above embodiment, an authentication process may be performed to authenticate the user specified by the specifying process (s22). In this variation, a password field is provided in the user table provided in the memory 33 of the server 30. The password field is a field in which a password specified by the user is registered, and is registered together with the user's personal information in the registration process (s10). Note that the password is a string of alphanumeric characters, an answer to a question, or the like. Then, in the lock/unlock process (s20), the password input process is executed after the acquisition process (s21), and the password is transmitted to the server 30 together with the biometric information in the transmission process. In the reception process, the server 30 receives the password together with the biometric information, and after the identification process (s22), the authentication process is executed. In the authentication process, first, the password corresponding to the user ID specified in the identification process (s22) is extracted from the user table, and the received password is compared with the extracted password. As a result of the comparison, if the two match, it is determined that the user (user ID) identified in the identification process (s22) is correct, that is, the user identified in the identification process (s22) is the user of this system. This is verified. Note that the person authentication using the password does not necessarily need to be performed for all users, and may be performed only for users who are identical twins. Further, it may be performed only when entering a room with a high security level.

[Modification 5]
In the registration process (s10) of the above embodiment, the smart device 10 transmits information to be registered to the server 30, but the present invention is not limited to this mode. For example, the lock/unlock system 100 includes a user terminal (hereinafter referred to as a "user terminal") that can communicate with the server 30 via an Internet communication line, and the user terminal sends biometric information to the server 30. It does not matter if the response is to send personal information. By making it possible to send biometric information and personal information from the user terminal to the server 30 in this way, it is possible to avoid situations where personal information is changed after the fact or identification of users based on biometric information becomes unstable. If so, the user himself/herself can re-register this information.

[Modification 6]
In the above embodiment, the smart device 10 operates in a power saving mode such as a sleep mode when a person is not detected in the detection process (s2) (No), and when a person is detected in the detection process (s2). It is also possible to operate in a normal mode.

[Modification 7]
In the above embodiment, the smart device 10 and the lock/unlock device 20 communicate based on the Bluetooth Low Energy standard, but other wireless communication standards or wired communication standards may be used.

[Modification 8]
The memory 33 of the server 30 in the embodiment described above may function as a history storage unit that stores authentication history. Specifically, the memory 33 of the server 30 is provided with a history table. A record is added to the history table each time the user's entry/exit qualifications are successfully authenticated. The history table has a user code field in which the user code of the authenticated user is registered, a date and time field in which the date and time of authentication is registered, and a device code field in which the device code of the smart device 10 used for authentication is registered. , and a biometric information field in which biometric information used for authentication is registered. The information registered in the history table is transmitted to the administrator computer 40 in response to a request from the administrator computer 40. The administrator computer 40 displays the received information on the monitor. According to this aspect, the administrator can grasp the status of users coming in and going out.

[Modification 9]
In the above embodiment, the smart device 10 is installed outdoors as an acquisition terminal that acquires facial images that are biometric information, but for example, it is installed inside a glass door D (indoor side), A facial image of a person outside the room may be captured through the door D.

10 Smart device (acquisition terminal)
11 Touch panel display (input reception section)
12 Camera module (imaging section)
13 Short-range wireless communication module 17 GPS module (position detection unit)
18 Angular velocity sensor (attitude detection section)
20 Locking/unlocking device 30 Server 100 Locking/unlocking system D Door S Thumb turn

Claims

an acquisition terminal installed to acquire biometric information of a person located in front of the door;
a locking/unlocking device attached to a thumb turn provided on the indoor side of the door;
a server that authenticates the person's entry/exit qualification to the door based on the person's biometric information;
Equipped with
A locking/unlocking system, wherein the locking/unlocking device operates the thumb turn according to the authentication result.
The acquisition terminal includes an input reception unit that receives touch input from the person,
The locking/unlocking system according to claim 1, wherein the biometric information is acquired when there is a touch input to the input receiving unit.
The acquisition terminal includes an imaging unit that captures an image in front of the door and generates an image,
The lock/unlock system according to claim 1, wherein the biometric information is acquired when a person is detected in the generated image.
The locking/unlocking system according to claim 2 or 3, wherein the acquisition terminal returns from a power saving mode when acquiring the biometric information.
The acquisition terminal is
an attitude detection unit that detects the installation attitude;
an alarm generating section that generates an alarm;
has
The locking/unlocking system according to claim 1, wherein the alarm generation unit generates the alarm when the installation orientation changes.
The locking/unlocking system according to claim 1, wherein the locking/unlocking device and the acquisition terminal transmit and receive operation information of the thumb turn based on the authentication result using a Bluetooth Low Energy communication method.
The locking/unlocking system according to claim 3, wherein the biometric information is generated based on a facial image of the person captured by the imaging unit.
The lock/unlock system according to claim 1, wherein the acquisition terminal is a smart device.
A locking/unlocking device included in the locking/unlocking system according to claim 1.