EP4078543A1

EP4078543A1 - Building system for private user communication

Info

Publication number: EP4078543A1
Application number: EP20815825.3A
Authority: EP
Inventors: Florian TRÖSCH
Original assignee: Inventio AG
Current assignee: Inventio AG
Priority date: 2019-12-20
Filing date: 2020-12-02
Publication date: 2022-10-26
Also published as: US20230012098A1; JP2023506552A; WO2021121989A1; AU2020408805A1; CN114868163A; KR20220116174A

Abstract

The invention relates to a building system (1) comprising a camera system (4) and an image processing device (22) which generates a real-time facial template for facial features of the user (2, 2a) from a camera recording of a user (2, 2a) when the user (2, 2a) stops in a building zone (12). A control and processing device (8) searches a storage device (26, 28) for a reference facial template which matches the real-time facial template to a specified degree, wherein in the event of a match, the user (2, 2a) is a registered user (2). A bidirectional communication channel (18) is ascertained from the user profile of the user (2, 2a) for a private communication between the building system (1) and a wireless device (6) of the user (2, 2a).

Description

Building systems for private user communication

description

The technology described here relates generally to a building system that performs one or more services in or for a building. Exemplary embodiments of the technology relate in particular to a building system that executes a communication service and a method for operating such a building system.

Building systems can be designed in a wide variety of ways for a wide variety of applications. In a building, for example, there may be an interest in recognizing the presence of a user in the building. This interest can exist on the part of the user who wants to orientate himself in the building, for example after entering the building. The interest can also exist on the part of a building management, which for example would like to know if and when a user is in the building and which service the user would like to use in the building.

The presence of a user can be detected, for example, with an access control system, which is an example of a building system. The access control system controls, for example, access to a restricted-access zone (e.g. building entrance or floor corridors with access to elevators). In such an access control system, users who want to use the service of the access control system can identify themselves as authorized to access in different ways, e.g. B. with a key, a magnetic, chip or RFID card or a mobile electronic device (z. B. mobile phone). WO 2010/112586 A1 describes an access control system in which a mobile phone carried by a user sends an identification code to an access node. If the identification code is valid, the access node sends an access code to the mobile phone, which shows the access code on a display. If the user holds the displayed access code to a camera, the access control system checks whether the recorded access code is valid. If it is valid, the user is granted access.

Another example of a building system is an elevator system installed in the building. To use the service of the elevator system, a user can e.g. B. at a landing call terminal to enter an elevator call to receive from a Boarding floor to be promoted to a destination floor. Depending on the type and purpose of a building, the elevator system and the access control system can be designed in such a way that an elevator call is initiated when the user is granted access; the elevator call can be made to a specified destination floor that is stored in a user profile created for the user.

These building systems recognize the presence of a user, deduce from this which service the user would like to use and react accordingly. It is true that a user can, for example, change the specified destination floor because the user would like to be transported to another floor, but there are generally no further possibilities for interaction between the building system and the user. There is therefore a need for a building system that offers further options for interaction.

One aspect of such a technology relates to a method for operating a building system for a building, in particular for a building in which an elevator system and / or an access control system are present. The building system comprises a camera system, an image processing device communicatively connected to it, a control and processing device communicatively connected to the image processing device, a storage device communicatively connected to the control and processing device and a communication device communicatively connected to the control and processing device. The camera system is arranged in a building zone that is accessible for users who have mobile radio devices with them and for users who do not have mobile radio devices with them. A real-time face template for facial features of a user is generated when the user is in the building zone, the real-time face template being generated by the image processing device from a camera recording of the user. Under the control of the control and processing device, the memory device is searched for a reference face template stored in the memory device which matches the real-time face template to a specified degree. If they match, the user is recognized as a registered user for whom a user profile is stored in the storage device. The user profile of the user is read by the control and processing device to create a bidirectional communication channel for private communication between the building system and to determine the user. Controlled by the control and processing device, a first data signal is sent by the communication device via the determined bidirectional communication channel to the mobile radio device of the user.

Another aspect of the technology relates to a building system for a building, in particular for a building, in which an elevator system and / or an access control system are present. The building system has a camera system, which is arranged in a building zone, which is accessible for users who have mobile radio devices with them and for users who do not have mobile radio devices with them, and an image processing device that is communicatively connected and configured with the camera system to generate a real-time face template for facial features of the user from a camera recording of a user when the user is in the building zone. The building system also has a storage device in which a large number of user profiles are stored, each user profile being assigned to a user and comprising a reference face template of the user and information about a communication channel preferred by the user. A communication device is designed to send and receive data signals via a communication network. A control and processing device is communicatively connected to the image processing device, the storage device and the communication device and is designed to search the storage device for a reference face template that matches the real-time face template to a specified degree, with the user being a registered user if they match is. The control and processing device is also designed to read the user profile of the user in order to determine the bidirectional communication channel for private communication between the building system and the user, and to send a first data signal to the user through the communication device via the bidirectional communication channel determined for the user send.

The technology described here creates a building system that, after recognizing a registered user, can communicate with the user using face recognition via a communication channel selected by the user. Face recognition is preferably done in a manner that is as unobtrusive to the user as is possible and does not disturb the flow of movement of the user; Proof of authorization (e.g. photo IDs, RFID cards) therefore do not have to be presented. Especially when there is a high volume of traffic, this reduces the risk of a queue forming in front of an access point, for example.

It can be assumed that a registered user who stores his or her reference face template declares that he / she agrees that a technology for face recognition may be used. Furthermore, in one exemplary embodiment, the user's first reaction (and any further reaction) to a message received via the private communication channel can represent consent to the use of the technology.

In contrast to known building systems, in which the communication for all users takes place via information and / or operating devices permanently installed in the building as a communication channel, the communication channel is selected by the user in accordance with the technology described here. The communication channel takes place via the user's mobile device, which the user is familiar with using. It is therefore not necessary that the user first has to go to an information and / or operating device, possibly having to wait there behind other users and then having to deal with the operation of the information and / or operating devices. Instead, the technology described here allows location-independent communication by means of the mobile radio device. Any input (manually and / or by voice) by the user is made using their (own) mobile device. There is no need to make inputs on an information and / or operating device that is touched by a large number of users, which can be advantageous from a hygienic point of view.

In addition, the technology described here can also be used to advantage by users with limited vision or blindness. Such a user is recognized by the face recognition mentioned, without having to search for an information and / or operating device, for example, or feel and take action there. If such a user selects his mobile device as the communication channel, communication takes place via the familiar mobile device; Information can for example by the mobile device as Voice message can be transmitted. The user can make any entries manually and / or by voice on his own mobile radio device.

The technology described here also protects the privacy of users because it is a private communication, i. H. Information transmitted from the building system to the user, or vice versa, is not visible to bystanders. On it z. B. value users who want to keep their destination in the building or the purpose of their stay in the building hidden; for a female user it can e.g. B. be advantageous that their destination floor and the elevator assigned to it is not visible to bystanders, as well as z. B. for a user who wants to go to debt counseling or a specialist in the building.

The technology described here also offers flexibility in terms of the communication channel. The bidirectional communication channel can e.g. B. comprises a telephone service, an email service, a multimedia or text message service or a service for social media, wherein the bidirectional communication channel can be used by the user by means of a mobile device carried along. These are communication channels that users are familiar with.

Several communication channels can be defined in the user profile. If several communication channels are defined, one of them can be defined as the preferred communication channel. The user can define, e.g. B. by one or more rules and / or conditions as to when a communication channel other than the preferred one is to be used. For example, an order of precedence can be established; if the preferred communication channel (e.g. a special chat service) is not available, you can switch to another chat service, for example, before selecting a telephone service. For example, a rule can specify times during which the private communication channel is to be selected.

In one embodiment, the communication device receives a second data signal via the determined bidirectional communication channel. The second data signal relates to a reaction of the user to the first data signal. The user can enter this reaction on his mobile device. In one embodiment, the message transmitted by the first data signal includes user-specific information, for example a question or a request to confirm, reject or modify the user-specific information. The second data signal can therefore include an answer to the question or a confirmation, rejection or modification of the user-specific information.

In one embodiment, the control and processing device can generate a control signal as a function of the second data signal, the control signal relating to the execution of a building action specified by the user-specific information. The user-specific information can, for example, a

Concern elevator call. The user can therefore use the familiar mobile radio device to input an elevator call and / or to confirm a proposed destination floor. In one embodiment, the technology described here can also be used if the user profile does not contain any information about a bidirectional communication channel or if the user is without a mobile radio device. For this purpose, the building system is designed in such a way that the first data signal is sent to an information device that is arranged in the building zone. The information can be transmitted to such a user there.

In the following, various aspects of the improved technology are explained in more detail on the basis of exemplary embodiments in conjunction with the figures. In the figures, the same elements have the same reference symbols. Show it:

Fig. 1 is a schematic representation of an application example of a

Building system in connection with an exemplary situation in a building;

2 shows a flow diagram of a first exemplary embodiment of a method for operating the building system;

3 shows a flow chart of a second exemplary embodiment of a method for operating the building system; and

4 shows a schematic representation of an exemplary embodiment of a building system. 1 is a schematic illustration of an application example of a building system 1 in connection with an exemplary situation in a building, of which only a few walls, rooms 5 and a building zone 12 are shown for reasons of illustration. The rooms 5 can, for. B. offices, apartments, halls and / or elevator cars of an elevator system 16. The building zone 12 can in one embodiment be a public zone from which restricted-access zones, such as e.g. B. the rooms 5 or the elevator system 16 can be entered. In this exemplary embodiment, the building system 1 can be a subsystem or subsystem of an access control system that monitors the building zone 12 and / or of the elevator system 16. In another embodiment, the building system

1 can be a system that is independent of another system, in particular an access control system or an elevator system. In the application of the building system 1 shown in FIG. 1, there are several users 2, 2a, one user in the building zone 12

2 carries a mobile electronic device 6 (hereinafter also referred to as mobile radio device 6) with it, and a user 2a does not carry such a mobile radio device 6 with him.

FIG. 1 also shows a camera system 4, an information device 14 and a control and processing device 8 (CTRL in FIG. 1), which are communicatively connected to a communication network 10. As shown in FIG. 4, the control and processing device 8 contains an image processing device 22 and a storage device 26 which stores user profiles and associated face templates of registered users 2, 2a. The control and processing device 8 can be arranged in the building or outside the building. In one exemplary embodiment, the control and processing device 8 can be arranged wholly or partially in a remote control center or implemented as an IT infrastructure made available via the Internet (also referred to as “cloud computing”). The communicative connection between the control and processing device 8 and the communication network 10 is indicated by means of a communication connection 30. It is also indicated that a communication connection 18 can exist between the mobile radio device 6 of the user 2 and the communication network 10. Further structural properties of the building system 1 and the control and processing device 8 are described in connection with FIG. 4. In the exemplary situation shown in FIG. 1, the technology described here can be used according to an exemplary embodiment in order to create further possibilities for interaction between the building system 1 and the users 2, 2a. The technology described here uses a face recognition technology based on a comparison of a real-time face template of a user 2, 2a with stored reference face templates of registered users 2, 2a. The technology described here also uses one or more communication services, such as a telephone service, a text message service, an email service or a service for social media (chat apps). Such services, including their technical properties, for example with regard to the transmission medium (e.g. radio, cable, Internet), addressing (Uniform Resource Locator (URL) and transmission protocol (e.g. Internet protocols such as Internet Protocol (IP)) Transmission Control Protocol (TCP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), Simple Mail Transfer Protocol (SMTP), File Transfer Protocol (FTP)) are known to the person skilled in the art known under the following names, for example: Facebook, Instagram, WhatsApp and WeChat.

2 shows an exemplary flow chart of a first exemplary embodiment of a method for operating the building system 1. The method begins in a step S1. If a user 2, 2a is in the building zone 12 in a detection area of the camera system 4, in a step S2 the image processing device 22 generates a real-time face template of the user 2, 2a from a camera recording of the user 2, 2a. Controlled by the control and processing device 8, the storage device 26 is searched in a step S3 for a reference face template which corresponds to the real-time face template to a specified degree; if they match, it is a registered user 2, 2a, for whom a user profile is stored in the storage device 26. The control and processing device 8 reads the user profile of this user 2, 2a in a step S4 in order to determine a bidirectional communication channel 18 for communication between the building system 1 and the user 2, 2a. The communication channel 18 indicates how the user 2, 2a would like to communicate with the building system 1, or which communication service is to be used for this, in particular, how the user 2, 2a would like to be contacted by the building system 1, for example when he enters the building. Once the communication channel 18 has been determined, a data signal can be sent to the mobile radio device 6 of the user 2 via the communication channel 18 in a step S5. The method ends in a step S6.

3 shows an exemplary flow chart of a second exemplary embodiment of a method for operating the building system 1. The method begins in a step A1 and ends in a step All, in between the method comprises steps A2, A3, A5 and A9, which are not referred to below will be discussed in more detail, since they essentially correspond to the respective steps S2, S3, S4 and S5 of the method shown in FIG. 2.

In a step A4 it is checked whether there is a match, i. H. whether a reference face template is determined during the search in step A3, which corresponds to the real-time face template to a specified degree. If there is a match, i. H. it is a registered user 2, 2a, the method proceeds along the yes branch to step A5 and reads the user profile of the user 2, 2a. On the other hand, if there is no match, the method proceeds along the no branch to step A6.

In step A6, the user 2, 2a is defined as a non-registered user; the method then ends in step All. Since no reference face template was found in steps A3, A4 that matches the real-time face template, the user 2, 2a can be an unregistered user 2, 2a, for example a visitor, or a registered user 2, 2a who is mistakenly not recognized by face recognition. From the point of view of the building system 1, it is a non-registered user in both cases. In such a case, the erroneously not recognized user 2, 2a can, for example, turn to a customer service counter (e.g. reception or porter) and identify himself there in a different way. On the other hand, depending on the design of the building, visitors can be directed to a visitor information desk or spoken to by building staff. In step A5, the communication channel is determined which is defined by the user 2, 2a as preferred in the user profile. In a step A7 it is determined whether the communication channel is via a mobile phone 6. As stated above, the user 2a does not have a mobile phone 6 with him. For this user 2a it is specified in his user profile that the communication channel is via the information device

14 takes place. The information device 14 can, for. B. building-specific information (z. B. building plan information, site plan information), situation-specific information (z. B. routing / orientation information, elevator information) and / or personalized information (z. B. notifications, messages) with or without a voice message or display Prompt for input. Is it this

User 2a, the method proceeds along the no branch to a step A8. In step A8, the control and processing device 8 sends a data signal to the information device 14 in order to display the information. The process then ends in step All.

As shown in FIG. 1, the user 2 carries a mobile phone 6 with him. In one embodiment, one of the named communication services is defined as a preferred communication channel for this user 2 in his user profile so that communication takes place via the mobile radio device 6. In addition, alternative communication channels can be specified in the user profile, but these are not considered preferred and are only used in exceptional cases. An exceptional case can exist, for example, if the preferred communication channel is not available. The information device 14 can also be defined as a communication channel for the user 2 (e.g. in the event that there is a system interruption or the mobile radio device 6 is not available or ready for use); In this case, the information can be conveyed via the information device 14, as described in connection with step A8.

If it is determined in step A7 that the communication channel is via a mobile radio device 6, the method proceeds along the yes branch to step A9. In step A9, the control and processing device 8 sends a (first) data signal to the mobile radio device 6 in order to initiate the transmission of the information there, for example by displaying the information on a display device of the mobile radio device 6. include situation-specific and / or personalized information. In one embodiment, the method then ends in step All. In another exemplary embodiment, as shown in FIG. 3, the control and processing device 8 waits for a (second) data signal sent by the mobile radio device 6. In FIG. 3, the mobile radio device 6 sends this data signal to the transmitting and receiving device 8 in a step A10. The data signal can for example comprise a message which represents a reaction to the received (first) data signal, e.g. B. a confirmation or modification of the message or a response or input to the message.

A person skilled in the art recognizes that a large number of users 2, 2a can be in the building zone 12 at a specific point in time. The person skilled in the art recognizes that in such a case the method according to FIG. 2 or the method according to FIG. 3 can be carried out for several of these users 2, 2a or for all of them. Depending on the number of users 2, 2a, the execution can take place essentially simultaneously or one after the other. If several of the users 2 present want a communication channel via the respective mobile radio devices 6, there is a bidirectional private communication channel for each of these users 2.

The communication channel determined according to FIGS. 2 and 3 can be used as follows in an exemplary embodiment that does not restrict the protection area:

If it is recognized that a registered user 2 (with mobile radio device 6) prefers a chat service as a communication channel, the control and processing device causes the chat service to send a message to the mobile radio device 6 of user 2, i. H. the user 2 is contacted via his preferred private communication channel; he uses the familiar mobile radio device 6 for this. The message can include, for example, a greeting by name, a request as to which building action is desired at the given time and / or a request to confirm a building action proposed by the building system 1 according to the user profile. The reaction of the user 2 (response or confirmation) takes place, for example, in step A10 (FIG. 3), in that the mobile radio device 6 of the user 2 sends a corresponding data signal to the control and processing device.

In one embodiment, the control and processing device can be a use so-called chatbot for bidirectional communication with user 2 via the communication channel. A chatbot (also called chatterbot, bot or virtual personal assistant) is a text-based dialogue system that allows chatting, ie electronic communication by means of written text in real time (mostly via the Internet) with a technical system. A chatbot can e.g. B. respond to special commands; the recognition of a registered user 2 can, for. B. trigger a greeting or a specific message. Technically, a chatbot is therefore similar to a full-text search engine that searches through a specified database for a corresponding reaction to a command; as a result, a relatively intelligent private dialogue with the user 2 is also possible.

The general communication described in the previous exemplary embodiment via the private communication channel preferred by the user 2 can be used in the building for special applications, for example in connection with an access control system and / or an elevator system. As mentioned above, in one exemplary embodiment the building system 1 can be a subsystem or subsystem of an access control system and / or of the elevator system 16. An access control system can e.g. B. monitor the building zone 12 so that only authorized users 2, 2a can get into the rooms 5 or the elevator system 16, for example by blocking or releasing a door, a barrier, a turnstile, or another physical barrier or sluice, by activating ( e.g. activation) of an alarm device in the case of access without a physical barrier, if an unauthorized user 2, 2a is detected, or by combining these measures. The alarm device can, for. B. trigger a visual and / or acoustic alarm or initiate notification of a security service. The rooms 5 shown in FIG. 1 can, for example, belong to a group of elevators (e.g. elevators A, B). If a user 2, 2a is recognized, this can mean in one embodiment that the user 2, 2a wants access and wants to be transported with one of the elevators to a destination floor specified for this user 2, 2a. In one exemplary embodiment, a destination call can be initiated for the user 2, 2a, to which an elevator control assigns an elevator. The assigned elevator can be communicated to the user 2, 2a via the preferred communication channel. Access control systems and elevator systems and their modes of operation are known to a person skilled in the art, and such a person skilled in the art can be a person skilled in the art Trade access control systems and / or elevator systems; further explanations on the structural and functional properties of these systems therefore do not appear to be necessary.

In one embodiment, a registered user 2 has specified in his user profile that a private communication channel is to be used via his mobile radio device 6. The user 2 can be a user who regularly, e.g. B. enters the building every day because he lives or works there. It can also be a visitor for whom a temporary user profile (visitor profile) has been created beforehand. The reference face template for this can be generated from a photo on which the face of the user 2 is clearly visible, which the visitor sends to his host by e-mail, for example. In addition to the data mentioned above, the temporary user profile can include date information and information about the host, for example name, telephone number, floor and / or apartment or office number, and the visitor (for example the name or status (VIP) of the visitor). In addition, a time window can be set within which the visitor is to be granted access. The time window can, for example, indicate that visitor 2 receives access approximately half an hour before and after the start of the appointment, in the event that visitor 2 arrives too early or is late. The user profile can be deleted after the arrival of visitor 2 or at a later point in time. The technology described here is particularly advantageous for visitors because the visitors do not need a system or building-specific app, but can use their usual services.

If the user 2 was recognized by the building system 1 as a registered user, the user 2 is granted access by the access control system. He can be contacted by the building system 1 via the private communication channel in accordance with one of the services mentioned. In one case, the contact can only include a greeting, possibly together with current building information. A visitor can be told which room 5 his host is in and how he can get there. In another case, contacting may include a request, e.g. B. whether a specific building action is desired. The building action can consist, for example, in that a destination call for the elevator system 16 is initiated for the user 2, either according to the data of the user profile existing for this user 2 or according to a call input on the mobile radio device 6 via the private communication channel is transmitted to the building system 1. The user 2 can also enter a destination or a location in the building (e.g. shop, department store, company, parking garage, restaurant, public toilets, etc.). The destination or the location can be used by the user 2 z. B. can be selected from a list that is previously transmitted from the building system 1 to the mobile radio device 6 via the private communication channel. The building system 1 then transmits the assigned elevator or the desired destination / location information, e.g. B. a wayfinding with or without a building plan.

In one embodiment, the building system 1 is connected to an elevator system, in particular to an elevator controller. The communication between the building system 1 and the elevator control can take place via the communication network 37 (as indicated in FIG. 1). If the access control takes place, for example, in the entrance hall of the building, which users 2 have to pass through in order to get to the elevators, a destination call can be initiated for the user 2 in question every time access is granted. The elevator control of the elevator system processes the destination call and assigns an elevator to it. The elevator assigned to the destination call can be communicated to the user 2 via the private communication channel. The user 2 can thus go directly to the assigned elevator without having to enter an elevator call.

With an understanding of the operating mode of the building system 1 described above by way of example, a description of exemplary components of the building system 1 and their modes of operation is provided below in conjunction with FIGS. 1 and 4.

The communication network 10 can comprise a building-internal communication network to which the camera system 4 and the information device 14 are connected within the building. In one embodiment, the control and processing device 8 can be connected to the building-internal communication network, in particular if the control and processing device 8 is also arranged in the building. The building-internal communication network can include a wired network topology (e.g. a bus, ring, mesh topology) and / or a radio-based network topology (WLAN). In another exemplary embodiment, the control and processing device 8 can be wholly or partially be located away from the building. In this case, the control and processing device 8 can be connected to the building-internal communication network by an external communication network. For this purpose, there is an interface device in the building-internal communication network which enables communication between the building-internal and the external communication network.

FIG. 4 shows a schematic illustration of an exemplary embodiment of the building system 1, with components of an exemplary embodiment of the control and processing device 8 being shown. The control and processing device 8 comprises, in addition to the above-mentioned image processing device 22 (image processing in FIG. 2) and the also above-mentioned memory device 26 (memory in FIG. 2), a communication device 24 (COM in FIG. 2) and a processor 20 (mR in Fig. 2). A person skilled in the art recognizes that the arrangement of the components shown reproduces an exemplary basic structure of the building system 1, the components being able to be arranged in a unit (e.g. in a housing, computer system or server system) or spatially distributed, for example through the said cloud -Computing infrastructure.

The storage device 26 comprises, for example, a hard disk drive (HDD), a CD / DVD drive, a semiconductor drive / solid-state disk (SSD) or combinations thereof, or other storage devices for digital data; it is connected to the image processing device 22 as shown in FIG. 4 and comprises a database system 28 (also called database 28, DB in FIG. 2). The database system 28 consists of two parts: a management software, called a database management system, and a set of data to be managed. The management software organizes the structured storage of the data internally and controls all read and write access to the database. In one embodiment, the database system 28 is a relational database system. A database system offers a database language for querying and managing the data. B. the language SQL.

The database system 28 stores a data record for each registered user 2, 2a, which is also referred to as a user profile. The user profile can, for example, be personal Data of user 2, 2a (e.g. name, reason for authorization (residents, employees, external service providers, visitors), telephone number (s), email address (es)), access authorizations (e.g. certain rooms 4 and floors ) and any time restrictions (e.g. access from Monday to Friday, from 7:00 a.m. to 8:00 p.m.). The user profile also defines how the user 2, 2a would like to be contacted when he is in the building. At least one communication channel can be defined for this. If several communication channels are defined, one of them can be defined as the preferred communication channel. The user 2, 2a can define, e.g. B. by one or more rules and / or conditions, when a different communication channel is to be used. For example, a ranking can be established; if the preferred communication channel (e.g. a special chat service) is not available, you should switch to another chat service, for example, before a telephone service is selected. For example, a rule can specify times during which the private communication channel is to be selected.

The connection between the image processing device 22 and the database system 28 is designed such that the image processing device 22 can query (or access) the data stored in the database system 28. The database management system can in particular search for a stored reference face template that matches the real-time face template.

In the exemplary embodiment shown, the processor 20 is connected to the image processing device 22 and the communication device 24. Through the connection to the image processing device 22, the result of the image processing can be transmitted to the processor 20, i. H. based on the image processing, the user 2, 2a is either registered or not registered. A non-registered user can be ignored by the building system 1 or he can be addressed by a supervisor (cf. step A6 in FIG. 3). If, on the other hand, the user 2, 2a is registered, a computer program implemented in the processor 20 executes one of the methods shown in FIGS. 2 and 3.

In the exemplary embodiment shown, the image processing device 22 and the communication device 24 are each connected to the communication network 10 connected. The image processing device 22 can receive camera recordings from the camera system 4 via the communication network 10 without this reception being carried out by the communication device 24. In another exemplary embodiment, the image processing device 22 can be connected to the communication device 24 for receiving the camera recordings. In FIG. 2, these possibilities of connecting the image processing device 22 for receiving the camera recordings to the communication network 10 are indicated by the communication link 30. Those skilled in the art will recognize that communication link 30 can be established in a number of ways, e.g. B. by means of wired transmission technologies (e.g. point-to-point connections and / or bus systems) and / or radio technologies.

The camera system 4 generates a camera recording of a user 2, 2a (in particular his face) who is located in the detection range of the camera system 4 when the user 2, 2a is in the building zone 12. In one embodiment, the camera system 4 comprises a digital camera with selectable and / or adjustable properties; In this exemplary embodiment, camera recordings are thus available as digital data records (digital camera recording (also referred to as digital image)). The properties of the digital camera, for example resolution (e.g. specified in megapixels), exposure and focal length, are selected or set so that a camera recording (digital image) can be evaluated and the face of the user 2, 2a in evaluable quality on the Digital image is recognizable. The digital image is available, for example, in a JPEG format, but it can also be available in another format, for example in the BMP or JPEG2000 format.

The camera system 4 can be equipped with a sensor module or connected to a separate sensor module that activates the camera system 4 when it detects the presence of a user 2, 2a in the detection area of the camera system 4. The sensor module can for example comprise a proximity sensor, which can be configured as an ultrasonic sensor, an infrared sensor or an optical sensor (for example light barrier, brightness sensor). Alternatively, in one exemplary embodiment, the presence of a user 2, 2a in the detection area of the camera system 4 can be detected in that changes in the detection area are detected. For example, if the user 2, 2a enters the detection area and is the camera system 4 continuously in an active state, the camera system 4 records changes in front of an essentially static background; these changes are interpreted as presence.

The person skilled in the art recognizes that the camera system 4 can be designed with an image processing function in one exemplary embodiment. In this case, the image processing device 22 in the control and processing device 8 can be omitted. Depending on the configuration of the building system 1, several camera systems 4 can be present, for example in an entrance hall and on individual floors of the building.

The image processing device 22 comprises at least one processor unit which executes a computer-aided method for image processing. Image processing methods are known, for example from US Pat. No. 8,494,231 B2. A basic description of image processing for the purpose of face recognition is described in the publication "Face Recognition" by the German Federal Office for Information Security (under the topic of biometrics, available at the Internet address www.bsi.bund.de). This publication distinguishes between the three main working steps "create template", "create reference data record" and "compare facial images". In order to keep the comparison of two facial images as simple and quick as possible, the features of a face are determined and stored in the form of a feature data set called a "face template". If the face has been found and normalized in a picture of a user, further features in addition to the eyes, the nose and the mouth / chin area are searched for, measured and set in relation to one another. These extracted features are coded, compressed and saved as a feature data set (face template). In order to determine the similarity of the face templates of two face images, they are combined using a mathematical algorithm. This results in a degree of similarity between the face templates. If the result is within certain tolerance limits, the two face templates, and thus the facial images on which they are based, are classified as identical.

With reference to FIG. 2 and FIG. 3, in steps S3 and A4, respectively, it is checked whether the real-time face template with a reference face template is to a specified degree matches. In one embodiment, the real-time face template and the reference face templates each include a fixed number of fixed face parameters and their values (e.g. eye relief, mouth width, distance between upper and lower lip, distance between nose and lower lip, etc.). When searching, the parameter values of the real-time facial template are compared with the parameter values of the reference facial template. A match exists if the degree of similarity of the face templates corresponds at least to the specified degree. The specified degree indicates a percentage agreement between the facial parameters of the real-time facial template and the facial parameters of a reference facial template. Depending on the accuracy requirement, the specified degree can be selected between approx. 60% and approx. 90%, for example.

The mobile radio device 6 can be, for example, a mobile phone, a smartphone, a tablet PC or a smartwatch, these devices usually being equipped with hardware that enables communication via a local radio network (WLAN / WiFi) and / or a global mobile radio network according to a mobile radio standard ( e.g. GSM, LTE, G4, G5). The mobile radio device 6 can also be a pair of glasses with a miniature computer or another computer-aided device worn on the body (also referred to as "wearable device") if these devices are intended for communication via a local radio network and a global mobile radio network. Depending on the design of the mobile radio device 6, it can, for. B. have application-specific software (so-called apps) and have a graphical user interface (also referred to as graphical user interface, GUI) in order to be able to selectively activate and deactivate its functions (e.g. individual apps).

Claims

1. A method for operating a building system (1) for a building, in particular for a building, in which an elevator system (16) and / or an access control system are present, the building system (1) having a camera system (4) communicatively connected to it Image processing device (22), a control and processing device (8) communicatively connected to the image processing device (22), a storage device (26, 28) communicatively connected to the control and processing device (8) and a storage device (26, 28) communicatively connected to the control and processing device (8) ) comprises communicatively connected communication device (24), wherein the camera system (4) is arranged in a building zone (12), which is for users (2) who carry mobile radio devices (6) and for users (2a) who do not have mobile radio devices (6) is accessible, the method comprising:

Generation of a real-time face template for facial features of a user (2, 2a) when the user (2, 2a) is in the building zone (12), the real-time face template being generated by the image processing device (22) from a camera recording of the user (2 , 2a) is generated;

Searching, controlled by the control and processing device (8), of the storage device (26, 28) for a reference face template stored in the storage device (26, 28) which corresponds to the real-time face template to a specified degree, with a match the user (2, 2a) is recognized as a registered user (2) for whom a user profile is stored in the storage device (26, 28);

Reading the user profile of the user (2, 2a) by the control and processing device (8) in order to determine a bidirectional communication channel (18) for private communication between the building system (1) and the user (2, 2a); and

Sending, controlled by the control and processing device (8), of a first data signal by the communication device (24) via the determined bidirectional communication channel (18) to the mobile radio device (6) of the user (2) in order to be sent there as a message to the user (2) to be transmitted.

2. The method according to claim 1, further comprising receiving a second data signal via the determined bidirectional communication channel (18) by the Communication device (24), the second data signal relating to a reaction of the user (2) to the first data signal.

3. The method according to claim 1 or 2, wherein the bidirectional communication channel (18) comprises a telephone service, an email service, a multimedia or text message service or a service for social media, wherein the bidirectional communication channel (18) for the user (2 ) can be used by means of an accompanying mobile radio device (6).

4. The method according to any one of the preceding claims, in which the message transmitted by the first data signal comprises user-specific information and in which the second data signal comprises a confirmation, rejection or modification of the user-specific information.

5. The method according to claim 4, further comprising generating a control signal by the control and processing device (8) as a function of the second data signal, the control signal relating to the execution of a building action specified by the user-specific information.

6. The method according to any one of claims 4 or 5, in which the user-specific information relates to an elevator call.

7. The method according to any one of the preceding claims, further comprising sending the first data signal to an information device (14) which is arranged in the building zone (12) if the user profile contains no information about a bidirectional communication channel (18) or if it is a user (2a) without a mobile radio device (6).

8. A building system (1) for a building, comprising: a camera system (4) which is arranged in a building zone (12), which is for users (2) who carry mobile radio devices (6) with them, and for users (2a) , which do not have any mobile radio devices (6) with them, is accessible, an image processing device (22) which is communicatively connected to the camera system (4) and is configured from a camera recording of a User (2, 2a) to generate a real-time face template for facial features of the user (2, 2a) when the user (2, 2a) is in the building zone (12); a storage device (26, 28) in which a large number of user profiles are stored, each user profile being assigned to a user (2, 2a) and a reference face template of the user and information about a communication channel (18) preferred by the user (2a) includes; a communication device (24) which is configured to send and receive data signals via a communication network (10); and a control and processing device (8) which is communicatively connected to the image processing device (22), the storage device (26, 28) and the communication device (24), the control and processing device (8) being configured: the storage device ( 26, 28) to search for a reference face template that matches the real-time face template to a specified degree, with the user (2, 2a) being a registered user (2) if they match, the user profile of the user (2, 2a ) to read in order to determine the bidirectional communication channel (18) for private communication between the building system (1) and the user (2, 2a), and the communication device (24) sends a first data signal to the user (2) for the user (2) determined bidirectional communication channel (18) to be transmitted there as a message to the user (2).

9. Building system (1) according to claim 8, in which the control and processing device (8) is also designed to process a second data signal received by the communication device (24) via the determined bidirectional communication channel (18), the second data signal being a The reaction of the user (2) to the first data signal.

10. Building system (1) according to claim 8 or 9, wherein the bidirectional communication channel (18) comprises a telephone service, an email service, a multimedia or text message service or a service for social media, wherein the bidirectional communication channel (18) for the user (2) by means of a carried Mobile device (6) can be used.

11. Building system (1) according to one of claims 8-10, in which the control and processing device (8) is also designed to send the first data signal to an information device (14) which is arranged in the building zone (12) if the user profile does not contain any information about a bidirectional communication channel (18) or if it is a user (2a) without a mobile radio device (6).

12. Building system (1) according to one of claims 8-11, in which the control and processing device (8) is communicatively connected to an elevator system (16), the second data signal indicating an elevator call to be sent to the elevator system (16) is conveyed.