SI24326A - Interactive door system - Google Patents

Abstract

The present invention relates to an interactive gateway system, comprising a new intelligent interface designed to control entry into a restricted access space, such as an apartment and the like. According to the present invention, it is intended that said system comprises a device positioned in a restricted door entry door region associated with at least one outer assembly. The said device comprises at least a control component (2), a process component (3), and a user interface component (4), wherein said control component (2) operates said at least one outer assembly. In the described way, services are provided that are essentially similar to the services that would be performed by the gatekeeper-man, and in addition, security and comfort are increased.

Description

INTECH-LES, Development Center, d.o.o.

Interactive door system

The present invention relates to an interactive door system comprising a new intelligent interface designed to control entry into a restricted space, such as an apartment and the like.

The interactive gate system of the type mentioned above is known from a variety of documents, such as WO 2011127739, WO 9966467, CN101882335, etc., but none of the known solutions meets the requirements of security, functionality and reliability at the same time. In addition, all known solutions are challenging for the user, both in terms of usage and learning.

It is an object of the present invention to create a new interactive door system that eliminates the disadvantages of known systems of this type.

«

The task according to the invention is solved by the characteristics given in the characteristic part of claim 1. Details of the invention are disclosed in the sub-claims. According to the present invention, it is envisaged that by identifying persons on entry / exit through the space door, it will be possible to automatically keep a list of people present in the space and, on a flight basis, to provide the services required by said persons upon entry / exit. On this basis, the system essentially performs activities that are otherwise performed by the goalkeeper - human. The advantage of the system is that through automation and motivation of users to participate, a high degree of reliability is kept of keeping a list of people present and identifying them on entry / exit. As a result, a reliable attendance record and identification of persons upon entry / exit into the said premises is provided.

The invention will now be described in more detail on the basis of an embodiment and with reference to the accompanying drawings, where FIG. 1 is a schematic view of an interactive door system according to the invention; 2 is a schematic illustration of the operation of the system of FIG. 1.

The interactive door system 1 according to the invention comprises a multimedia device, which is schematically shown in FIG. 1, and is located in the door area of the restricted entry space and connected to at least one external assembly. Said device comprises a set of components, such as control component 2, process component 3, and user interface component 4. The first component of system 1 is selected as the control component 2 that controls at least one of said external assemblies. According to the present invention, said outer assembly comprises a sensor assembly 5, preferably represented by at least one sensor, at least one arresting assembly 6, preferably represented by at least one lock, in particular an electro-mechanical lock, and an alarm sending unit 7 and warned. Each of said assemblies 5, 6, 7 capable of communicating with said device may be an integral part of or fully separate from the device. The gate system according to the invention requires several different sensors, which are included in the sensor assembly 5. For the reliable operation of the gate system according to the invention, at least the following sensors are required:

identification sensor, such as fingerprint reader, radio frequency identification card (RFID) card reader, code dial, and the like, door pass sensor, such as door open sensor, ultrasonic distance sensor, frame laser interrupt sensor door and the like, and select a door movement sensor such as an accelerometer, gyroscope, magnetometer, and the like.

In addition, sensors are provided that measure data specific to a particular person's entry. Such a sensor is, for example, a camera capable of recognizing faces or determining a person's physical parameters, an ultrasonic sensor for determining a person's physical parameters as they pass through a door, and sensors of a person's presence, such as a motion sensor or a motion sensing camera. Said arresting assembly 6 comprises at least one electromechanical lock that enables electronically guided door unlocking and locking. Said alarm and alert unit 7 allows for the diversion of alarms and alerts from process component 3 through control component 2 to users 8. Said assembly 7 may be selected as a conventional alarm system connected to a call center or security center that can be connected to a door system according to the invention. According to a preferred embodiment of the invention, said assembly 7 is selected as a module that allows the transmission of at least textual data, such as a GSM module that can send SMS messages to users, and preferably is selected as a module that allows image transmission and / or audio, such as an Internet server capable of sending images and / or audio to users.

The second component of said device is selected as a central processing unit 3, which receives the collected data from said control component 2 and user commands 8, processes them and, according to the results, issues commands to control said arresting assembly 6, alarm and warning assembly 7 and assembly to display on UI component 4. The third component of said device is represented by component 4 of the user interface, which is connected to the central processing unit 3 and enables communication between the user and said gate system 1. As a user interface, a touch screen or any other device or device assembly may be used. allows information to be displayed and user commands accepted. According to the present invention, it is contemplated that the control component 2 can be designed, for example, by means of a microcontroller with an appropriate number of inputs and outputs, and software that allows data to be received from different sensors, sending data to process component 3 via a wired or wireless connection, and operating said arresting assembly 6 and alarming and alerting assembly 7. The aforementioned components 2, 3, 4 may be designed as either a single integral assembly or multi-component assembly.

The following describes in more detail the operation of the system represented by the process schematically shown in FIG. 2. That procedure shall cover the following essential elements:

a) sensing the person on the outside of the door and acting properly at the entrance,

b) detection of the person on the inside of the door and proper operation upon exit,

c) detection of security threats and proper functioning,

d) learning the typical mode of entry, eg entry / exit, through the door of the controlled space, users and identification or identification. verification of these data by comparing the collected sensor data as they pass through the door with models built on past passages.

At startup 8a of the interactive door system according to the invention, the initial settings 9 of the separate external system 1 assemblies are first made, such as sensor unit 5, aretime unit 6, and alarm and alert unit 7. Subsequently, processes 10, 13a for detecting the presence of persons on either side of the door and process 14a for detecting security threats that initiate the related processes, described below, begin in parallel. Each time you enter or exit, a process 12 of modeling user behavior is initiated based on the collected sensor data. It builds a user behavior model 17 using machine learning methods that contains a person's physical characteristics such as size, face model and the like, entry mode characteristics, such as door opening speed, time between identification with the sensor and door opening , door open time and the like, as well as entry time characteristics, such as time of day, day of the week, weekdays / holidays, presence of others, pre-entry time, and the like. In the first phase, the system collects data for user modeling. Once sufficient data has been collected to build a reliable model for user classification, that is, either identification or verification, the second phase can begin. In the second phase, the built-in models are used to identify or verify users, and are updated and upgraded based on new data, allowing automatic adaptation to changes in use and user needs.

Procedure 11 at the entrance or. sensing a person on the outside of the door is triggered whenever the possibility of a person entering a controlled space is detected. To this end, a process 10 is ongoing which periodically checks that a person is present at the outside of the space being monitored outside the door. The presence of a person is detected based on data from a suitable sensor from sensor assembly 5, such as a PIR of a motion sensor that is directed directly in front of a door and configured to detect people. If the system does not have a suitable sensor for process 10, the data is stored all the time and used -about entry. The first step involves the collection of sensor data. If a detected person is in front of the door, the entry process 11 begins and interrupts the front door detection process 10. All relevant sensor data is stored in the cache. This can be followed by one of three options: (i) the person does not enter, (ii) the person enters without identification, (iii) the person enters with identification.

If after the presence of a person is detected and the subsequent detection that the person is no longer present at the door, a pre-prescribed time elapses, then this is considered as option (i). In this case, the storage is interrupted. Only the time of the event and the image or image are retained from the stored data. pictures of events ahead of the door (if image capture sensors are connected to the system: video camera or infrared camera) and any collected temporary data is deleted. For example, a picture and a time are listed in the event list in front of the door, which is displayed to the user when he enters through the door, giving the user an overview of visitors.

If entry is detected after a person is detected without prior identification, the event is considered as option (ii). The entry is detected by a suitable sensor from sensor assembly 5 (eg, door open sensor or laser beam interrupt sensor mounted in the door frame.) In this case, the appropriate safety procedure 14 described below is initiated.

Otherwise, this is option (iii), which is an identification entry which is recognized by the first person being detected at the door and then one of the identification sensors (eg fingerprint reader, magnetic card reader) is triggered. , RFID card reader, code entry pad). The next step is to verify that the identified person has permission to enter. If it is not present, the event image and time are stored in the event list in front of the door, after which the aforementioned security procedure 14 is initiated, otherwise the list of users' presence 16 is checked. If the identified person in the attendance list 16 is marked as present, the aforementioned security procedure 14 is initiated, otherwise the procedure is continued with the next step. If no user is present in list 16, process 14 a for intrusion detection and for example the alarm system is excluded because we know that a person with the necessary identification is entering and therefore no longer needs to operate the alarm system. In the next step, the central processing unit 3 sends a door unlock command via the sensor control unit 5 and the time unit 6, and starts the timer. If, after the door is unlocked, the time limit for entry without an entry has been detected, the central processing unit 3 sends a door lock command and the process ends. Otherwise, the system detects the entry of a person with at least one of the aforementioned "entry sensors". Upon entry, sensor data are stopped collecting and, along with the person's identity, entry information, and time of entry, are sent for further processing to Process 12 to model user behavior. The presence of an identified person is recorded in the list of 16 users present and then the verification of 15 identified persons is carried out based on the data collected. If the verification process 15 confirms the identity of the identified person, a door lock command is sent (arresting the block 6 only triggers the lock when the door is closed) and services related to the person's entry are triggered, such as displaying a list of events in front of the door (ie visitor list ) on said component 4; a speech greeting; forwarding messages to an identified person; turn on or change the way certain devices and systems work in a smart home: heating, lighting, music tower; etc. If the verification process 15 does not confirm the identity of the person, said security procedure 14 is initiated.

Exit 13 is triggered each time a person is exited. To this end, a process 13a is ongoing which periodically checks that a person is present in front of the door. The presence of a person is detected on the basis of data from the sensor assembly 5 (eg detection of the presence of persons by means of a camera and a motion detection program or a PIR of the motion sensor). If a person is detected in front of the door, the exit procedure 13 begins and interrupts the perception of 13a people in front of the door. The first step involves sensing data collection: all relevant sensor data is stored in cache. If the system does not have a suitable sensor for process 10, the data is stored at all times and used upon entry. This can be followed by one of three options: (i) the person does not exit, (ii) the person exits without identification, (iii) the person exits with identification.

If after the presence of a person is detected and the subsequent detection that the person is no longer present at the door, a pre-prescribed time elapses, then this is considered as option (i). In this case, the storage is interrupted and all previously collected sensor data is erased from the cache.

If an exit is detected after a person is detected without prior identification, the event is considered as option (ii). The output is, as described, detected by a suitable sensor. If no person is identified as present in the list of present users, the alarm system is activated, since we assume that the last person has left the room and therefore it is necessary to include process 14a for intrusion detection, such as an alarm system. The sensory data collection is then interrupted and used to identify the person using the identification procedure 15. If the identification succeeds, the sensory data collected, along with the information about the exit, time and identity of the prominent person, is sent to process 12 to model the behavior of the users. List 16 of users' presence records that the identified person is absent and that the attendance list may not match the actual status (identification was done automatically without the user being explicitly identified). If the door is unlocked, the central processing unit 3 sends a door lock command. If the identification procedure 15 determines that the person cannot be reliably identified, said security procedure 14 is initiated, and the door is locked, if necessary, at the command of process unit 3.

• · ·

If, after being detected by a person at the door, he or she is identified, this is an option (iii). The exit person can be identified by one of the identification sensors (the same sensors as for entry identification) ah by pressing a dedicated button on the user interface 4. If the person identifies with the identification sensor, the consistency of the 16 user presence list is checked and be repaired as necessary. If the only way of identifying an exit logon is to use a user interface, it must also be able to edit the presence list of users when it is incompatible with the actual situation. In the next step, services related to the exit of the identified person are triggered. After that, a command to unlock the door is sent and the timer starts. If, after unlocking the door, an exit timeout expires without the exit being detected, the central processing unit 3 sends a door lock command, thereby ending the process. Otherwise, the system detects the exit of a person with at least one of the listed I / O sensors. In the next step, the user presence checklist 16 checks to see if the outlier is the only person present: if so, process 14a for intrusion detection, such as an alarm system, is included. Thereafter, the collection of sensory data is interrupted, which, along with the person's identity, time, and exit information, is transmitted to Procedure 12 for modeling user behavior. The list of 16 user presence is then updated to mark the identified person as absent. Following this, on the basis of the information collected, procedure 15 is started to verify the identity of the person leaving. If the verification process 15 confirms the identity, the door is locked and the process is completed, otherwise a suitable security procedure is triggered in addition to the door lock 14.

Procedure 12 for modeling user behavior is initiated at each entry or exit of the identifying user. The objective of the process is to build a user behavior model based on the collected sensor data, using machine learning methods, which can then be used to identify and verify persons. Verification, like the behavioral modeling process, is initiated at each entry or exit of the identified user. The purpose of the verification and / or identification procedure 15 is to verify that the behavior of a properly identified person matches the expected behavior of the person to whom the identification actually belongs - i.e. to determine whether the person who has properly identified himself is really the person to whom that identification belongs. The second purpose is to identify the unusual behavior of a known person upon entry or exit and to initiate appropriate security procedures on the basis of the result. 14. Identification is used at each entry or exit of a user who does not identify himself. The purpose of the identification procedure 15 is to identify the identity of a user who has not properly identified himself based on the collected sensor data: if the process is sufficiently sure of its result, the identified identity in the entry and exit procedures is used as an identity explicitly provided by the user. Otherwise, appropriate security procedures 14 are put in place to ensure that the user is correctly identified and thereby ensure that the list of 16 users present is consistent with the actual situation.

As indicated, procedures 11, 12, 13 are initiated upon entry or exit of a person. Procedure 11 upon entry or entry. the exit procedure 13 provides for the collection of all necessary sensor io data, time information, and whether it is entry or exit. After the first phase of gathering the necessary data, the modeling process 12 proceeds to the second phase, in which, at each startup, the so-called i. the characteristics or attributes that characterize the entry of an individual. To do this, a time aggregation of the collected data is first performed. Time relations between the responses of individual sensors and the duration of sensations of individual sensors are presented in a format suitable for further processing. For example, sensor data indicate that the front door sensor was first triggered, the identification sensor was triggered 3 seconds later, the person touched the hook for 2 seconds, then the door was opened for 1.3 seconds, and then 1.6 second shutter. In parallel, a data fusion is performed to allow additional information to be obtained by combining data from different sensors. E.g. the door opening time is determined by the time of contact between the door handle and the accelerometer located in the door leaf. The merging of sensor data also serves to increase detection reliability: by combining data from multiple related sensors or. of sensors that allow the detection of a similar property, a more accurate and reliable determination of the quantitative property of the gate passage is considered.

The complexity of time aggregation and data fusion depends on the number and type of sensors in said sensor assembly 5 connected to the system and must be specifically tailored to the actual sensors. In the next step, the characteristics themselves are calculated from the information thus obtained. machine learning attributes when it comes to modeling user behavior or classification, that is, for identification or verification. Characters are presented in the form of an attribute description, where attribute values can be either nominal or numeric. From here, the process is independent of the type and number of sensors used.

In the case of a process 12 for modeling user behavior, a component that defines a class and is identical to the user identity is added to the calculated characteristics (attributes) arranged in the feature value vector. The vector is then used as learning data in the machine learning process. Machine learning can be any method of controlled machine learning that provides sufficiently high classification accuracy and has timely efficiency in classification (e.g. decision trees, decision rules, nearest neighbor method, naive Bayes classifier, support vector method, artificial neural network, etc.). The model 17 thus constructed, which is updated every time the new learning vector is accessible, is stored in a format that can be used to update the model and classify the user.

In the case of a user identification and / or verification process 15, after calculating the feature vector, it is first verified that sufficient learning data has already been collected to build a sufficiently reliable user behavior model 17. If the data collected is not yet sufficient, both procedures answer that the person cannot be identified (identified or verified). Otherwise, the feature vector and user behavior model 17 are used to classify the user, the result of which is the identity of the person (Y) and the confidence of the classification method in the result. In the case of verification, the result returns the estimated probability that explicitly given identity of person (X) is equal to recognized identity (Y) based on the sensory data collected and the behavior of person X in the past. However, in the case of an identification process, the identity of the identified person and the likelihood that the person passing through the door is indeed identified is answered in response to an assessment of the reliability of that person's model 17 classification of behavior. If the likelihood estimates are below a certain threshold, the identification or considers validation as invalid, but otherwise valid.

As stated above, the entry 11 process and the exit exit 13 may in certain cases trigger the security process 14. Given the reason for initiating the security process, the correct sequence of action is performed. The entry procedure may initiate a security procedure for one of the following four reasons: (i) because, upon entry, the person has failed the verification, (ii) because the person has entered without being identified, (iii) because the presence status 16 does not match the actual situation with respect to the entry identification sensor, or (iv) because the identifying person is not authorized to enter.

If verification fails (i), an alert will be sent to users immediately upon entry, informing them of the event. The system is then added identification via the user interface 4 of the person who entered. If additional identification is successful, the system sends a warning cancellation, otherwise it triggers an alarm. In each case, the entry process continues after that, in terms of the door lock. Services related to the entry of person X are only triggered if identification is successful.

If a person has entered without identification (ii), identification procedure 15 is first started. If the identification process succeeds, the identified user identity is taken into account as the identity given by the incoming user, and the process continues as with the failed verification (s) (alert, additional verification and cancellation of alert or alarm triggering). If identification fails, the system requires the identification of an inbound person via UI 4. Failure to do so triggers the alarm, otherwise the security procedure is immediately completed. If the result of security procedure 14 is an alarm, the entry process 11 that triggered the security procedure is terminated. Otherwise, the implementation of the entry process 11 proceeds as if the entering person were identified by an identification sensor: if no user is indicated in the list of 16 present users, the intrusion detection process 14a, for example, an alarm, is then recorded and the presence of the person in the a list of 16 users present, the door is locked and services related to the entry of an identified person are started.

If, at entry, the attendance list 16 does not match the actual situation (iii), i.e. the 16 user presence list records that a person with a given identity is present, first checking that the 16 presence list is marked as valid (or has been corrected based on automatic identification of persons and has not yet been validated by users). If the attendance list 16 is not valid, the procedure shall continue as with the failed verification (i), and upon completion of security procedure 14, the entry process 11 will only resume upon entry unless an alarm has been triggered. If the attendance list 16 is valid, the request for additional identification is immediately triggered. If it succeeds, the entry process 11 will resume normally, otherwise an alarm will be triggered and the entry process 11 will be interrupted.

«

If the person who has identified themselves for entry does not have permission to enter, a warning is sent to the users about the attempt to enter, and the entry process itself is interrupted without allowing the person to enter.

At the exit of a person, security procedure 14 may be initiated for two reasons. The first reason is that verification of the 15 outstanding person failed. In this case, the list of 16 users present is marked as potentially invalid, and then an alert is sent to the selected users on exit failure, which may indicate an unusual exit. Otherwise, the alert also serves as a notice that the attendance list 16 must be reconciled manually.

Another option to initiate security procedure 14 upon exit is if the exit person did not identify himself. At this event, the identification of 15 prominent persons is first initiated. If the identification fails, the procedure 14 is continued as with the failed exit verification. If identification is successful, it simply indicates that the attendance list 16 is potentially invalid.

Security procedure 14 may also be triggered by procedure 14a, which operates on the basis of one of the security sensors: e.g. a sensor that detects movement on the inside of a door or a physical attack on a door when no persons are present in the list 16, or a separate alarm system. In this case, security procedure 14 triggers an alarm.

Claims (17)

Patent claims 1. An interactive door system comprising a new intelligent interface designed to control entry into a restricted space, such as an apartment and 5 similarly characterized in that it comprises a multimedia device positioned in the door area of the restricted entry space connected to at least one external assembly, said device comprising at least a control component (2), a process component (3), and a component ( 4) a user interface, wherein said control component (2) controls said at least one external assembly. Interactive door system according to claim 1, characterized in that said outer assembly comprises a sensor assembly (5), preferably represented by at least one sensor, at least one arresting assembly (6), preferably represented by at least one lock, in particular electromechanical lock, and assembly (7) for sending alarms and alerts. Interactive door system according to claims 1 and 2, characterized in that each of said assemblies (5, 6, 7) capable of communicating with said device may be an integral part of said device or completely separate from it. 20 Interactive gate system according to claims 1 to 3, characterized in that said sensor assembly (5) comprises an identification sensor, such as a fingerprint reader, a radio frequency identification card (RFID) card reader, a code entry pad, and the like; door pass sensor, such as door open sensor, ultrasonic frame sensor, laser beam interruption sensor 25 doors and the like; and selecting a door movement sensor such as an accelerometer, gyroscope, magnetometer and the like. An interactive door system according to claims 1 to 4, characterized in that additional sensors are provided, such as a camera capable of recognizing faces ah 30 determination of a person's physical parameters, an ultrasonic sensor for determining a person's physical parameters as they pass through a door, and sensors of a person's presence, such as a motion sensor or a motion-sensing camera. An interactive door system according to claims 1 and 2, characterized in that it is mentioned The 35 arresting assembly (6) comprises at least one electro-mechanical lock that enables electronically guided door unlocking and locking. An interactive door system according to claims 1 and 2, characterized in that said alarm and alert transmission assembly (7) allows the alarms and alerts to be diverted from the process component (3) to users. 8. An interactive door system according to claim 7, characterized in that said assembly (7) is selected as a conventional alarm system connected to a call center or security center or to users or a combination thereof, as a module for transmitting at least text messages data, such as a GSM module, or as an image and / or audio transmission module, such as an Internet server. An interactive door system according to claims 1 to 8, characterized in that the central processing unit (3) receives the collected data from the control unit (2) and user commands (8), processes them and issues commands for controlling said aretime assembly (6 ), an alarm and alert unit (7), and a user interface display unit (4). An interactive gate system according to claims 1 to 9, characterized in that the user interface component (4) is connected to the central processing unit (3) and enables communication between the user and said gate system. An interactive door system according to claim 10, characterized in that the touch screen or any other device or device assembly is used as the user interface, which allows the information to be displayed and user commands received. « 12. An interactive gate system comprising a new intelligent interface designed to control entry into a restricted space, such as a dwelling and the like, characterized in that it comprises the initial settings (9) of said external assemblies, such as a sensor assembly (5), aretime assembly (6) and assembly (7) for sending alarms and alerts; detecting a person on the outside of the door of the room being monitored; detecting a person on the inside of the door of the room being monitored; detection of security threats; modeling user behavior; and identification or identification. user verification. 13. An interactive door system according to claim 12, characterized in that a process (10; 13a) is continuously performed to check the presence of a person on the outside and / or inside of the door of the space being monitored. 14. An interactive door system according to claims 12 and 13, characterized in that the entry and / or exit of the identifiable person into / from the space being monitored, based on the collected sensor data, initiates the modeling process (12) user behavior that builds a user behavior model using machine learning methods that contains a person's physical characteristics, entry mode characteristics, and entry time characteristics. Interactive door system according to claim 13, characterized in that the presence of a person on the outside and / or inside of the door of the room to be monitored is detected based on the data from said sensor assembly (5). 16. An interactive door system according to claims 12 to 15, characterized in that the identification or it performs user verification on the basis of a comparison of the collected sensor data when passing through a door with a built-in model of user behavior with the machine learning method. 17. An interactive door system according to any one of the preceding claims, characterized in that a process (14a) is continuously carried out which, based on the data from said sensor assembly (5), detects an intrusion attempt and initiates a security process (14). INTECH-LES, development