CH710525A1 - Device for detecting an environment and for interaction with a user. - Google Patents

Abstract

A device (1) for detecting an environment and for interacting with a user by voice control and voice reproduction comprises a housing in which at least the following components are accommodated: a camera (20) for optical detection of the environment, a microphone (50) for acoustic detection the environment, a speaker (51) for reproducing acoustic information and an interface (31) for connection to a data network. The housing is designed such that it can be fixedly mounted in a room. The apparatus further comprises a controller (30) which receives data from the camera (20) and the microphone (50), drives the speaker (51) and via the interface (31) to a user's mobile terminal (70) installed application communicates.

Description

Technical area

The invention relates to a device for detecting an environment and for interacting with a user. The invention further relates to a system with at least two such devices.

State of the art

Corresponding devices are known in principle. Thus, WO 03/050 798 A2 (Siemens) shows a system for operating a telecommunications system and electronic terminals. The system is based on voice control and includes, for example, via a bus connected input means in each room of a flat, so that phone calls can be made from the entire apartment. It can be provided a voice recognition, which remains set to the user after establishing a connection so that it can move freely during a call throughout the apartment, with only the respective input means is unlocked, in the vicinity of which the user is located. In addition to the telecommunication system and a hi-fi system, further terminals can be operated, e.g. Kitchen appliances, lighting or blinds controls. Different users can be managed, being distinguished and identified by speech recognition. In addition, a logon and logoff signal or password may be required. The system can interact with a mobile phone. Instead of a microphone as an input means or in addition thereto, a room monitoring system (for example with motion detectors) can also be used, which at the same time can form part of an alarm system.

WO 11/001 370 A1 (A. Ben David) discloses a method for home automation with a system that enables communication with a natural language user. The recorded audio signal is first converted into text form, from which instructions, inquiries or statements are extracted and appropriate measures are triggered; Finally, the system returns feedback via voice output. The system can act as a "servant" and control local devices and facilities. It can also access the Internet and answer user questions or provide information. The pulse of people can be recorded acoustically, so that people can be identified and announced. There is also a telephone connection, both for making telephone calls and for remote control of the system. Access can be via a voice sample and / or password. Cameras can be integrated into the system.

The known devices are - as far as can be seen from the documents - elements of complex technical systems and require a large installation effort.

Presentation of the invention

The object of the invention is to provide a device belonging to the aforementioned technical field, which is easy to install and configurable with a large range of functions.

The solution of the problem is defined by the features of claim 1. According to the invention, the interaction with the user takes place (inter alia) by voice control and voice reproduction and the device comprises a housing in which at least the following components are included: a) a camera for optical detection of the environment; b) a microphone for acoustic detection of the environment; c) a loudspeaker for reproducing acoustic information; d) an interface for connection to a data network; wherein the housing is adapted to be fixedly mounted in a room and wherein the device comprises a controller which receives data from the camera and the microphone, drives the loudspeaker and via the interface with an application installed on a mobile terminal of the user communicated.

Voice control allows users to control the device without additional input means and without direct physical contact with the device. Commands or entire sentences of the user are detected by the microphone, the acoustic information is converted into digital data and processed in the controller. The user can control the device as long as it is within the detection range of the microphone. Therefore, a microphone is used whose sensitivity is adapted to the desired detection range or can be adapted to the desired detection range. Speech playback also allows device feedback to be recorded as audible information (feedback, acknowledgments, information, etc.) as long as the user is within range of the loudspeaker. By adjusting the volume, the range can be influenced. If desired, this influence can also take place dynamically if the device has means for detecting the position of the user. Voice control and voice output allow easy and intuitive operation. While the device interacts with the mobile terminal of the user, the user does not usually have to operate the mobile terminal directly to operate the device according to the invention.

The camera is adapted to the desired detection range. In particular, it comprises an optic which allows the detection of a solid angle, which practically makes up a whole hemisphere. The camera can be designed such that its detection space is dynamically adaptable and, for example, comprise a zoom and means for changing the detection axis.

The detected environment may in particular be a room, a room area or interconnected rooms of an apartment or a residential building.

In addition to the loudspeaker, further output means are possible, e.g. further acoustic output means such as a siren for alert purposes, or optical output means, e.g. a status light, a screen o. Ä.

The housing and the elements received therein are advantageously designed such that the housing is suitable for ceiling mounting. There it is inconspicuous, can be easily supplied with power and the camera usually has a good and complete field of view. Also acoustically, the attachment to the ceiling is advantageous. The housing accordingly comprises a flat attachment surface with means for attachment, more preferably adhesive, and a front surface opposite the attachment surface with the camera. The speaker may also be mounted on the front surface, but it is also possible to arrange one or more preferably speakers on one or more side surfaces of the housing. In addition to a ceiling mounting, the housing may in particular also be designed for wall mounting.

The connection between the device and the mobile terminal (eg a mobile phone, a tablet, a notebook computer o. Ä.) Of the user can be done via a direct connection (eg Bluetooth), indirectly via a local area network (eg WLAN or a combination of LAN and WLAN) or via a central server (eg with the inclusion of a mobile data network GSM / GPRS / UMTS / LTE etc.). The application on the mobile terminal may be part of the operating system or an application separately installed therefrom. Several applications installed on the mobile device can interact with the device at the same time or alternately.

The device according to the invention is therefore an "all-in-one" device. For installation, it is sufficient to install the device mechanically in the room and, if necessary, to connect it to the power grid. External components are optional and not necessary for the basic functions of the system.

Advantageously, the interface allows a connection via a power line ("Powerline"). As a result, a connection to a central server or a remote mobile terminal is possible without a wireless network must be active. Especially in sensitive rooms such as bedrooms or living rooms wireless networks are often undesirable or these should be temporarily switched off to avoid so-called electrosmog and related health problems. The connection via the power line, instead of or in addition to a wireless connection (e.g., WLAN connection) to a local area network, ensures permanent availability. The data to be transmitted, for example, via a connection of the device to the power supply in a conventional manner in the power grid or be coupled out of the mains. Elsewhere, an adapter is used which is connected firstly to the power grid and secondly to a local area network (LAN), e.g. connected via a router.

Preferably, the device comprises at least one sensor for at least one of the following: <tb> a) <SEP> constituents of the ambient air, in particular carbon dioxide and / or carbon monoxide; <Tb> b) <September> temperature; <Tb> c) <September> humidity; <Tb> d) <September> smoke; <tb> e) <SEP> movements of living beings (especially humans).

Particularly preferably, at least two of these sensors are included in the housing of an inventive device, in particular, all these sensors are present in the housing.

The device is thus able, without recourse to external elements u. a. to record the most relevant variables for the following aspects and functionalities: <Tb> 1 <September> indoor climate; <tb> 2. <SEP> intrusion detection; <Tb> 3 <September> fire protection; <tb> 4. <SEP> personal assistance functions; <tb> 5. <SEP> Control functions for building services.

The scope is thereby maximized, while the installation cost can be minimized. Additional sensors or some of the mentioned sensors can be designed as external units and used as needed. They preferably interact with the device according to the invention via a wireless data connection (for example, Bluetooth or WLAN).

Advantageously, the device comprises a connectable to a mains power supply and a rechargeable battery to power the device in case of failure of the mains power supply.

This ensures that the device continues to function even during such a failure for a certain period of time. This is particularly important if the device assumes the function of an alarm system, since otherwise the system could be put out of action by unauthorized persons by interrupting the power supply in a simple manner.

Advantageously, the device comprises a, in particular arranged on the housing, only manually operable mechanical switch, by means of which a power supply or a data line to a hardware component of the device can be physically interrupted, so that <tb> a) <SEP> the camera; <tb> b) <SEP> the microphone; and or <tb> c) <SEP> the interface to the data network

Is deactivated and software is not reactivated until another operation of the mechanical switch. A mechanical deactivation of the function of the camera or of the microphone (and possibly other sensors) thus ensures that third parties can not obtain any data even during an attempt to influence the software (eg by hackers, Trojans, etc.), thus completely protecting the privacy is. A mechanical deactivation of the interface to the data network also ensures this, because captured data can not be forwarded. With regard to a wireless connection, this deactivation also ensures that no unwanted, so-called electrosmog-emitting, electromagnetic radiation is emitted.

Preferably, the device comprises a first software component for voice recognition, which cooperates with a database to authenticate the user based on at least one recorded with the microphone voice sample.

In general, software components can be implemented as part of an operating software or as a separate application. A software component may comprise several subcomponents that interact with each other or with a central control component. Individual software components or subcomponents can also run on an external device or server. Authentication ensures that the device accepts specific instructions (for example, safety-related instructions such as the activation or deactivation of monitoring or alarm messages) only from authorized users. Multiple voice samples may be used for authentication, they may refer to predefined words or any word information received.

In addition to the authentication, recorded voice samples can also be used to identify a user cooperating with the device. For example, the device may be designed to work differently with different users, e.g. each based on a user profile of a plurality of user profiles with different user preferences.

Preferably, the user is identified on the basis of at least one recorded with the microphone voice sample in conjunction with a predetermined code word. The codeword can be, for example, a "call name" individually assigned to the device by the user with which the device is addressed in each case. The use of defined nicknames allows the device to quickly and securely identify the user interacting with it; Furthermore, the device recognizes immediately that it is addressed that received acoustic information is thus actively processed.

Alternatively, only the voice samples are used for identification and each user uses the same "nickname". It is also conceivable that the device does not have to be addressed separately, but that it filters out instructions to be implemented by him from all received acoustic information. Also, a respective activation by an external actuator, e.g. a button which interacts with the device via a wireless connection is conceivable in principle.

Preferably, the device comprises a second software component for triggering an alarm when detecting predetermined events in the environment, wherein the software component between a deactivated state and an activated state is switchable. The given events may be, for example, an unauthorized intrusion, the presence of unidentified persons, health problems of a detected person or the like. The detection can be done by means integrated in the device (camera, microphone, sensors) or by others Devices coupled to the device (eg additional motion sensors, opening sensors for doors or windows, heart rate monitors or other sensors worn by monitored persons, etc.). The device can thus perform an alarm system function and / or ensure that a responsible body is informed when a supervised person has health problems.

A given event may also be when a person present triggers the alarm manually, in particular when a burglary (or other emergency event) occurs when a resident is present. The triggering can be done by pressing a designated, possibly hidden button or by a given voice command. When triggered by voice command, it may be provided that the triggering can only be done by persons who have been authorized by voice recognition.

Advantageously, the second software component is switchable by at least one voice command from the deactivated state to the activated state and from the activated to the deactivated state, wherein a switching takes place only when the voice command can be assigned to the authenticated using the at least one voice sample user. This software component can therefore only be operated by authorized persons-in particular, it is not possible for authorized persons to deactivate the monitoring. For activating and deactivating the same voice command can be used, so it takes place each switching between the states, but it can also be provided different voice commands. The respective state is advantageously confirmed by the device by voice output. Alternatively or additionally, the state may also be visually displayed by a status light or other means. The voice command itself can in particular also represent the voice sample for the authentication of the user.

Preferably, the second software component is automatically switched from the deactivated state to the activated state if no movement was detected during a predeterminable period. This ensures that the monitoring is activated even if a manual activation has been forgotten, even though, for example, all residents have left the monitored dwelling or the supervised dwelling house. The detection of the movement can take place on the basis of video images and / or by means of a specific motion sensor. In addition, acoustic information can be used.

Advantageously, the second software component is automatically switched from the deactivated state to the activated state if no mobile terminals registered user of the device were detected during a predetermined period. This allows the conclusion that all users have left the monitored apartment or the monitored house.

The detection of mobile devices (in the monitored apartment or the monitored residential building) can take place in various ways. The following criteria can be used alone or in combination for the determination of the presence: <tb> a. <SEP> The mobile device is currently registered in a local network (especially WLAN); <tb> b. <SEP> the mobile terminal is currently reachable via a wireless connection (e.g., Bluetooth); and or <tb> c. <SEP> the mobile terminal reports a position (e.g., by GPS location) corresponding to the monitored home or monitored home.

Mobile terminals may in this context also be simple tokens indicating the presence of a user, e.g. a kind of key chain with RFID function.

The detection of movements or the presence of mobile phones can be combined in the assessment of whether an automatic activation should take place.

Since the lack of detection of mobile devices may have other causes, e.g. the fact that all existing mobile devices have been turned off, preference is given to the user before automatic switching to the activated state. This demand is made in particular by voice output on the device. The activation takes place only if a response from the user does not appear or the activation is explicitly confirmed.

Advantageously, when the alarm is triggered, the device initially issues an inquiry message by voice reproduction, whereafter the alarm is deactivated when the inquiry message is answered in a predetermined manner by the user authenticated on the basis of the at least one voice sample.

This ensures that an alarm in case of erroneous tripping, e.g. if the alarm function was erroneously deactivated on the return of a user, it can be deactivated again in a simple manner and without further disadvantageous consequences. Authentication ensures that the device will only deactivate if the response comes from an authenticated user.

The answer itself may in particular also represent the voice sample for the authentication of the user.

Preferably, after triggering the alarm, an alarm message is sent to the mobile terminal of the user. This gives the user the ability to respond to the alarm message, e.g. Contact third parties, disable the alarm or similar.

Preferably, the alarm message on confirmation or omitted action of the user is forwarded to a third party. This ensures that a response to the alarm occurs even within a reasonable time, if the user's mobile phone is not reachable or the user can not react. The forwarding of the alarm message takes place, in particular, after the expiration of a predetermined period of time (which can vary depending on the type of alarm message) or after an explicit confirmation by the user.

Advantageously, the user and / or the third party with the alarm received access to the camera and / or the microphone. This will give you an idea of the situation in the environment covered by the device. In addition, it is also possible to provide access to the loudspeaker of the device. The user can then contact any persons in the vicinity of the device.

Preferably, the device comprises a third software component for presence simulation. Presence simulation refers here to measures that ensure that outside of the apartment or residential building third parties get the impression that there are currently people in the apartment or in the house.

Advantageously, the third software component controls an interface for controlling home automation components, in particular lights, blinds or AV devices. This allows - possibly in addition to the integrated components of the device according to the invention - a convincing presence simulation that practically makes it impossible for a third party outside to determine whether someone is present or not.

Alternatively, the presence simulation is carried out exclusively with the integrated components of one or more devices according to the invention, namely the loudspeaker and the LED light strip.

Preferably, the third software component accesses a noise database, selects time and / or place dependent noise from the noise database and controls a playback of the selected sounds. The sounds can be played back on the unit's speaker and / or external speakers. The noise database can be set up and updated by the device itself. For this purpose, the device continuously detects noises via its microphone and assigns them to a time of day and possibly to a location or a direction. Other assignments, e.g. at a season, a weekday or similar are possible. In the context of the presence simulation, noises are then reproduced which are typical for a specific time of day (and possibly weekday, season, etc.). Basically, the recorded sounds can be reproduced for the presence simulation. Preferably, however, synthetic generated or retained sounds are reproduced. The retained sounds may be downloaded from a central database (e.g., via the Internet) as needed.

Preferably, an actuation of a door bell is detected and after detection of the operation, a presence of a person acoustically simulated and / or establishes a connection to the mobile terminal of the user. The detection of the door bell can take place when the door bell is connected directly to the device, e.g. via a data line.

Alternatively, the detection can be made acoustically by the sound of the bell detected by the microphone of the device and is identified by the controller. The acoustic simulation can be done by adequate noise in response to the operation of the doorbell are reproduced or by the device contacts by voice over a door intercom with the person ringing. In a further embodiment, it is possible that the user with the help of his mobile device via the speaker of the device or - preferably - via door intercom directly with the ringing person can make contact.

Preferably, the third software component controls an integrated into the housing of the device light, wherein the lamp is designed in particular for the delivery of different colored light and the control takes place in such a way that a light output characteristic for televisions takes place. The luminaire integrated into the housing is, in particular, an LED luminaire that can generate light with various colors. To simulate the characteristic light output of a television, the light colors, their changes and the frequencies of typical changes in color and brightness are chosen such that the light impression from the outside - if the light source is not directly visible - can not be distinguished from that of a running TV. Thanks to the integrated light source, a convincing presence simulation is easily possible.

Advantageously, the device comprises a fourth software component for guiding a person to a destination, wherein the fourth software component can control at least one external light source to indicate a direction of travel to the destination. In particular, the fourth software component can control a plurality of external light sources and / or interact with further analogously constructed devices which have their own light sources. The entirety of the driven light sources is located on a path which varies from the current location of the person to the destination, e.g. a bathroom, leads. For example, older people who can not easily orient themselves at night can be supported.

Advantageously, the fourth software component accesses a database of spatial information, the database comprising associations between external light sources and locations. The path from whereabouts to destination is determined, for example, from a digital representation of the floor plan of the dwelling or house, or the fourth software component provides a "teach" mode in which a person can walk the desired path - from the device or detected by several devices, the detected path is then stored.

With at least two devices according to the invention, an inventive system can be constructed, wherein the at least two devices for the exchange of data are interconnected. The exchange of the data may e.g. via a direct wireless connection (e.g., via Bluetooth, WLAN, or other suitable protocol), via a wired connection (in particular via powerline communication), or over an existing data network (e.g., a WiFi network). The interaction of multiple devices offers several advantages. Thus, the detected environment can be extended and ensured that all desired areas of an apartment or a residential building are recorded acoustically and visually. The devices can also operate in parallel, e.g. in relation to communication with users, monitoring tasks or tasks in the context of presence simulation.

Preferably, an association with a user is transferred from a first of the at least two devices to a second of the at least two devices as the user moves from an interaction region of the first device to an interaction region of the second device. Thus, a handover is made depending on the location of the associated user. The handover may involve a transition of the speech connection between the device and the user, the playback of music, the control of external devices (e.g., lighting, heating and / or ventilation), etc. Also, the tasks of the co-operating devices may change with the handover. For example, the device to which the user is associated may perform a master function while the other device or devices are performing a slave function.

Alternatively, a master device is firmly defined in the entire system with all devices, while the other devices have a slave function. Nonetheless, all devices may be the same in hardware and in terms of their operating software. The network advantageously organizes itself by automatically making the necessary adjustments when adding an additional device.

Preferably, a first user is simultaneously associated with a first of the at least two devices and a second user with a second of the at least two devices. It is thus possible for two users to make simultaneous calls (or video calls) to different subscribers, for two users to communicate with each other via two devices (intercom), etc.

Preferably, the device comprises a user database, which includes a prioritization of multiple users, wherein a user who is assigned a higher priority, priority is given to the use of at least one of the at least two devices. Corresponding situations include, for example, the receipt of a telephone call for a user A (with higher priority) on a device over which a call is already being made with a user B (with a lower priority). The user B can then cancel his call, transfer it to another device or transfer it to his mobile device. Another situation is the receipt of a call for user A on a device when the user is in an area that is acoustically detected by an adjacent device with which subscriber B is currently on the phone. Again, it may be provided that user A can accept his call and lead, while the user B, the said measures are offered for selection.

From the following detailed description and the totality of the claims, there are further advantageous embodiments and feature combinations of the invention.

Brief description of the drawings

The drawings used to explain the embodiment show: <Tb> FIG. 1 <SEP> An external view of the underside of a device according to the invention for detecting an environment and interacting with a user; <Tb> FIG. 2 <SEP> an outside view of the top of the device; <Tb> FIG. 3 <SEP> an exploded view of the device; <Tb> FIG. 4 <SEP> is a schematic representation of the functional elements of the device and their interaction with a user's mobile device; and <Tb> FIG. 5A, B <SEP> two floor plans of apartments equipped with one or more devices according to the invention.

Basically, the same parts are provided with the same reference numerals in the figures.

Ways to carry out the invention

FIG. 1 is an external view of the underside of an apparatus according to the invention for detecting an environment and interacting with a user. The device 1 has a square base with rounded corners, is flat and has a slightly curved bottom 2. The device 1 is particularly suitable for ceiling mounting, the bottom 2 is directed downward, in the room. The underside 2 has a square central region 3 and an edge region 4 surrounding it on all sides. In the edge region 4, the cover plate 5 forming the underside 2 has a plurality of irregularly arranged small circular openings.

FIG. 2 is an exterior view of the top of the device. FIG. The top 6 is also curved. It has a circular central region 7 and an edge region 8 surrounding it on all sides. The central region 7 is provided with an adhesive surface 9, which is provided with a cover film 10 prior to assembly. The device can be easily adjusted e.g. mounted on a ceiling by the cover sheet 10 removed and the device is glued to the ceiling. Alternatively, a fastening with screws is possible.

In the edge region 8, in a central region of one of the lateral edges, three manually operable buttons 11.1 ... 11.3 are arranged. The cover plate 5 comprises edge regions extending to the rear and thus forms a receptacle for the rear plate 12 forming the upper side 6. Between the cover plate 5 and the rear plate 12, an LED light strip 13 is encircled.

FIG. 3 is an exploded view of the apparatus. FIG. On the back plate 12, a battery holder 14 is mounted with accumulators 15 received therein. Also fastened to the rear plate 12, but not visible in the illustration according to FIG. 3, a power supply unit 40 with a charging electronics, which is connected to a mains or charging cable 41. This can be connected, for example, with a conventional power supply for a ceiling light or a power outlet. In addition, when a ceiling lamp is needed, the apparatus 1 can be placed at a distance from the same, with a branch for the power supply is turned on.

Between the back plate 12 and the cover plate 5, a main circuit board 16 and an opaque shield 17 are added together with the LED strip light 13. The latter prevents light emitted by the LED strip light 13 from being visible through the openings of the cover plate 5. On the back of the cover plate 5 a plurality of sensors 18.1 ... 18.4 are arranged, each communicating with one or more openings of the cover plate 5. Also arranged on the back of the cover plate 5 are a microphone 50 and a speaker 51. Arranged on the motherboard is also a siren with a sound level of at least 85 dB.

The cover plate 5 has a cutout forming its central region 3. In this detail, a holder 19 with a camera 20 and a plurality of LEDs 21 for the required illumination in the dark are included. The camera 20 is essentially capable of detecting the half-space in front of the cover plate 5 and, for this purpose, has an objective in the form of a so-called fisheye lens or a lens which can be swiveled accordingly. With the help of the camera 20 single images or burst images can be recorded, but in particular a continuous video capture is possible. A movement sensor 22 is likewise arranged on the holder 19. The holder 19 is covered by a transparent cover 24, which is also permeable to infrared radiation, via a sealing ring 23. In addition, a colored LED can be arranged as a status indicator on this cover 24 (not shown here). For example, it may indicate that the camera is currently activated.

Fig. 4 is a schematic representation of the functional elements of the device and their interaction with a user's mobile device. The device 1 comprises a central controller 30 having components known per se (processors, memories, interfaces, etc.). A WLAN interface 32 and a feed module 33 for a powerline connection are connected to the controller 30 via a communication interface 31. The power supply of the device via a power supply 40, which is connected via a cable 41 to a socket 42 (or a lamp terminal). The device 1 further comprises a charger 43 for charging accumulators and for feeding the device 1 when the power supply from the mains fails. The accumulators are dimensioned so that in the monitoring or standby mode (only motion and smoke detectors active), a running time of several days, preferably a good two weeks, is reached. At full power (active camera and music output) results in a running time of about 4 hours.

The device further comprises a camera 20 and a microphone 50. The supply of both components (or optionally the data connection) can be interrupted by mechanically actuated switches 20a, 50a. In addition or as an alternative to a camera which can be deactivated in this way, a mechanical slider can be present, which is pushed in front of the camera lens and which reliably and immediately indicates that no pictures can currently be taken.

The device further comprises a number of sensors 18.1 ... 18.4, 22, namely a temperature sensor 18.1, a sensor 18.2 for humidity, a smoke sensor 18.3 (in particular according to DIN EN 14604), a carbon monoxide sensor 18.4 and the motion sensor 22. Das The device also comprises a loudspeaker 51 and the LED light band 13. The function of all mentioned components is controlled by the controller 30, the components are in data communication therewith.

Thanks to the feed module 33, data from the device 1 via socket 42 and the in-house power supply network 44 can be transmitted to a powerline adapter 61. This is coupled on the one hand to a further socket 45 of the power supply network 44 and on the other hand to a router 62 of a local data network. Also connected to the router (directly or indirectly) is a wireless access point 63, which provides a wireless network. Alternatively or in parallel to the powerline connection, a WLAN connection between the device 1 and the local network is also possible.

A mobile terminal of the user, e.g. a mobile phone 70 is also attached to the local area network via a Wi-Fi connection. Via a local network, a data connection between the device 1 and the mobile terminal 70 is thus possible as long as the mobile terminal 70 is within range of the WLAN network. When the mobile terminal 70 is outside of this WLAN network, it has access to the Internet via a mobile data connection (e.g., GSM, GPRS, UMTS or LTE) and via a mobile network provider. Data can be exchanged via the Internet with the local network, which is connected in a known manner to the Internet. Even if the mobile terminal 70 is outside the range of the WLAN network, thus a data connection with the device 1 is possible.

In addition, a direct wireless connectivity between device 1 and mobile terminal 70 may be provided, e.g. according to the bluetooth standard. For example, audio and / or video data can be transmitted in a manner known per se, namely as part of a hands-free function or if the mobile terminal serves as a media player.

The controller includes hardware and software that allow speech recognition, namely, can be generated from spoken language in normal environmental noise and with a range of at least 6 m text. Furthermore, textual information can be output with a voice output so that it is understandable to normal hearing persons under normal ambient noise up to a distance of at least 10 m.

FIGS. 5A and 5B show two floor plans of apartments equipped with one or more devices according to the invention. In Fig. 5A, the floor plan of a relatively small apartment 101 is shown. It includes a living room 102, in which a kitchen is housed, a bedroom 103, a hallway 104 and on the opposite side of the corridor 104 a bathroom 105. Adjacent to the living room 102 is a balcony 106. In the apartment is an inventive device 1 in the middle of the ceiling of the living room 102 attached. This can (with each door open) visually the shaded areas, namely the entire living space 102, a large part of the bedroom 103 and the hallway 104 and the bathroom 105 to capture. Acoustically, these areas are also accessible.

Fig. 5B shows a larger apartment 111. It includes a living room 112, a living room 113, three bedrooms 114, 115, 116, a bathroom 117, a toilet 118, a hallway 119 and a to the kitchen 112 and the Living room 113 adjacent balcony 120. Five inventive devices 1.1 ... 1.5 are arranged on the ceiling, respectively in the middle of the living room 112, the living room 113, the bedroom 114 and the bathroom 117 and in a leg of the hall 119. Visually detected However, a large part of the apartment, two of the bedrooms 115, 116 and the toilet 118 are not aware in the optical recording range of the devices 1.1 ... 1.5.

The five devices 1.1... 1.5 are all connected to a local data network as described above in connection with FIG. 4 and can cooperate in this way. One of the stations 1.1 takes over certain central control and coordination functions (master station), while the other four stations 1.2 ... 1.5 in principle work independently within the specifications of the master station and, for example, data with a mobile terminal of each station 1.2 ... 1.5 assigned user without detour via the master station.

The device may be directly or via a local area network, e.g. the WLAN - contacting other inventive devices or external devices, e.g. Buttons, door locks, outdoor motion detectors, door / window sensors, lights of all kinds, heating, network storage, media players, active speakers, Smartplugs, Smart TVs, etc. With the help of so-called Smart Plugs, existing devices can be subsequently made controllable. These external devices are - as well as the inventive devices - uniquely named in a database and - if space bound - a room (or a device) assigned. The devices 1.1 ... 1.5 have access to this database.

The devices may be controlled so that e.g. the audio output (for music or handsfree in the context of a telephone call or an internal connection between two of the devices 1.1 ... 1.5) follows an assigned user. The location of the user is determined on the basis of video images, on the basis of noises (in particular speech) or in another way continuously.

The devices 1.1 ... 1.5 also have access to a database of user profiles. These user profiles include individual preferences, permissions, and prioritizations. The functionality of the devices 1.1 ... 1.5 may therefore depend on the presence, but also on the absence of certain users. For example, certain Assisted Living functions can only be activated if a certain person is present but other defined persons are absent. Each present user is assigned the currently responsible device 1.1 ... 1.5.

With the aid of the devices 1.1... 1.5 according to the invention, music can be reproduced in several rooms. The sound source may include a digital media library, Internet radio or streaming services. The music is first played in the room in which it was requested by a corresponding voice command. Also via voice input more rooms can be switched on (or switched off again), the volume can be influenced or the playback of the desired titles can be controlled. Playback may automatically follow the requesting user or, upon entering another room, the user may explicitly wish to have the playback expanded or switched to that room. The system can be controlled to play music on external speakers, if any, and on the device's internal speaker 1.1 ... 1.5 if external speakers are missing in a room.

The transition from one device to another can be made gradually, i. E. H. At times several devices are arranged the same user and simultaneously active. For example, the playback volume can be controlled from originally 100% / 0% (1st / 2nd device) continuously over 50% / 50% to 0% / 100%.

The user addresses the device with a user-specific trigger word. As a result, the device recognizes that language information is directed to it and is to be processed and identifies the user. The authentication of the user is based on the characteristic features of the voice. Once captured, multiple devices can follow a user by evaluating the trigger word or using the voice, respectively. If the user does not speak, information from the camera and / or the movement detector can be used for the assignment. Thus, a simultaneous leaving of the room 1 and entering the (adjacent) room 2 indicates that a person has moved from room 1 to room 2. It is also possible to use methods of image processing which are known per se, so that persons can be identified by their face (face recognition) or by assignment of a color signature. The above approaches can also be combined to reduce detection time and increase reliability.

The identification and optionally authentication of users can also be done on the basis of their mobile terminal. For example, an active connection to the local WLAN indicates that the mobile device, and therefore presumably its user, is within its range. Exiting the local WLAN may indicate that the user has left the apartment or house. In addition to WLAN, this information may also be transmitted by other wireless connection, e.g. Bluetooth or NFC. The mobile terminal may also be a token (eg, in the manner of a keyfob) with respect to this functionality, which can be recognized by the device and which is carried by users to inform the device of the current position or absence or presence , Corresponding devices are known, e.g. "Tue", Tile Inc. or Philips InRange.

The system may be configured such that an incoming call to a mobile terminal is automatically routed to the device of the invention closest to the user (or the mobile terminal) - the device thus functions as a hands-free device. A corresponding functionality is basically also possible for calls that go to a landline, in which case the devices optionally allow an extension of the area in which a hands-free facility exists. Analogously, the function of an answering machine can be realized by the devices according to the invention.

Switching from hands-free talking to a handset speech (via mobile device or landline phone) is possible at any time by a corresponding voice command or via an app on the mobile device. Further, switching may also be automatic when a call is received for a higher prioritization. The higher prioritization may result from the caller, but in particular the called party has a higher priority than a currently calling party. The first still running on the device conversation is redirected in such a case automatically (possibly after prior confirmation or after making a selection of the still telephoning) on a device according to the invention in another room, the mobile terminal or the landline phone.

As described above, a monitoring or alarm system function can be activated manually (by voice command or via app) or automatically. In particular, an automatic activation may take place if during a predetermined time (eg 5 minutes) no mobile terminal (or token) is detected by the devices of a system within range of the devices or a wireless local area network or if applications to the mobile Terminals using GPS or other navigation service is determined that they are no longer in the apartment or the house. A deactivation of the alarm is also when again a mobile terminal of a registered user should be recognized, always by voice command with trigger word, with a voice recognition takes place, so that third parties can not disable the alarm with a possibly left behind mobile device. Upon detection of a registered mobile terminal, however, the corresponding device can automatically offer the deactivation of the monitoring or alarm system function, after which it only has to be acknowledged. The acknowledgment is used as a voice sample for voice recognition.

If an extraordinary activity (burglary, fire, etc.) is detected by the camera, the microphone or one of the sensors of one of the devices, the corresponding device sets an acoustic inquiry message by default via the loudspeaker.

If this is not acknowledged by a registered and authorized user, an alarm is triggered. If the user (or the user with the highest priority) can be reached via the corresponding application on his mobile device, an alarm message is sent via the application. The user can access the camera and microphone through the application and send messages through the device's speaker. The user may also alert third parties (e.g., the police) directly in the application and / or activate the siren of the device. Captured video and / or audio data may be recorded and, in particular, stored in a secure external memory (e.g., a cloud service) so that an unauthorized person will not be able to locally erase or otherwise corrupt the corresponding data.

If the user (or the user with the highest priority) is unreachable, the alarm message is issued to a user second, third, etc. Priority. If there is no response within a predetermined time (e.g., 1 minute) or there are no reachable users, the alarm message may be sent to a third party, e.g. a security service, the police, the fire department or paramedics, are discontinued. The recipients of the alarm message have the same options as the first user.

Alternatively, it is possible that an alarm message is not sequentially transmitted as described above but directly at several points simultaneously. If several of these locations respond to the alarm message and contradictory instructions occur, the instruction of the highest priority user is automatically executed.

Locally present users have the option of placing a call for help, which is automatically transmitted to defined users, a security service, the police, fire or sanitation. The call for help can be silent (and, for example, issued via a button) or via a given voice command and, for example, result in the siren being triggered. Again, help call recipients can access the camera and microphone and record.

If several devices are installed in an apartment or a residential building, authorized users in the application can switch from one camera to another or from one microphone to another on their mobile terminal. The switching can also be done automatically by - for example by means of the motion sensor - each of the device is active, which detects just a movement.

By voice command can - especially at bedtime - all connected devices including the WLAN access point are turned off. The latter is equipped for this purpose, for example, with a so-called smart plug, which can be controlled from a distance. The power consumption can be minimized and unwanted electromagnetic fields ("electrosmog") are avoided. The reconnection takes place after a predetermined period of time or at a predetermined time (this information can be given in the context of the voice command) or manually by pressing a button connected to the Smart Plug. Alternatively, the access point can be controlled on the LAN side and the devices are coupled in parallel with a power line connection to the LAN, as described above.

The devices can be controlled so that they automatically turn off all external devices in the absence of all persons - except those that may be needed for presence simulation. This allows for further power savings and reduces the risk of fire due to equipment being inadvertently turned on (e.g., stove, iron, etc.). The smart plugs to which such devices are connected can be configured so that they can only be switched on when certain persons are present at the same time.

Upon the return of a user, e.g. simultaneously with the deactivation of the alarm system, the devices are switched on again.

The device according to the invention or a system with a plurality of devices according to the invention can be used to simulate a presence of one or more persons in the flat provided with the device or the devices. For this purpose, in a first step, a usage profile is recorded, in particular with the help of the camera and the microphone. In a second step - in the absence of all residents - the presence is simulated on the basis of the recorded usage profile, whereby means of the devices themselves (especially speakers and lights) and external devices (smart plugs, remote controlled lights or AV devices, blinds, etc.) are used , Possible sounds include music, radio / TV sound, conversations, barking dogs, toilet flushing, kitchen sounds, etc. - as a rule, the sounds recorded by the device during the creation of the usage profile are not reproduced but synthetically generated or stored in a database Sounds. Optically, for example, by means of the integrated LED light strip simulating a running TV set (or the existing TV set is turned on), also light sources are simulated or turned on by means of the integrated LED light strip.

The usage profile can be updated regularly. It contains information about typical activities or noises and light conditions at certain times of the day, on certain days of the week, in certain seasons, etc. These parameters are then used to control the presence simulation, including a random element, so that it is not apparent from the outside by predictable sequences that the presence is only simulated. In a system with several devices, in addition to the information mentioned also recorded in which rooms they take place. Accordingly, the simulation is controlled.

The presence simulation can also be made dependent on current events. Thus, the presence simulation can be influenced by recognizing an approach of third parties, e.g. by outside of the apartment located motion detectors.

If someone rings the door, this is detected directly or indirectly as described above. The recognizing device can then u. a. send the user an event message. This person can then contact the ringing person directly via the device and, if necessary, via the door intercom system.

The inventive device is further suitable for supporting and monitoring the health of frail persons. For this purpose, day-by-day and weekday-dependent routines of a monitored person are recorded. Upon completion of a first learning phase, the device detects significant variations, e.g. that a person does not stand up for an exceptionally long time or does not move, the device issues a request for information. If this is acknowledged by the user, nothing else happens.

If there is no reaction or an alert is explicitly requested by the user, an alarm is triggered, the subsequent actions correspond to those described above.

Within the scope of this functionality, a fall sensor known per se can also be addressed by the device according to the invention. Upon detection of a fall, the aforementioned process is started.

If the device has access to a controllable door lock, this can be released for relatives or rescue services. These authenticate themselves with the help of their mobile device or via a corresponding application.

[0103] When a user gets up at night, the device may be configured to first activate night lighting and then ask the user where they want to go. If the person then calls a defined room (here also several names for the same room can be defined, eg bath, toilet, toilet, etc. for the bathroom), all lamps (of the devices according to the invention and / or external) will be on the way switched there. If the person is back in bed and gives an appropriate voice command or if the motion detectors register that the person has returned to bed, the lights are turned off again.

The paths to be displayed can be transmitted to the device as part of a learning sequence, or a room card with recorded devices and lights in the device or in an external, available for the device database is stored.

The device according to the invention allows further functionalities: <tb> 1. <SEP> Fire protection: Fires can be detected by smoke, carbon monoxide and temperature sensors. Accordingly, an alarm can be triggered. The alarm is initially local, analogous to a smoke detector, first by voice output, then by activating the siren. Subsequently, users are informed on their mobile devices and, if necessary, third parties. Deactivation is possible by a voice command. <tb> 2. <SEP> Monitoring the room climate: In particular, the humidity and temperature can be monitored continuously, with additional (internal or external) sensors, for example, a C02 measurement is possible. If the room climate does not meet the requirements for such or threatened structural damage (such as mold) the user will be notified accordingly. He can subsequently take measures, e.g. Ventilate or regulate the heating. <tb> 3. <SEP> Remote Monitoring: Users can access the camera and microphone via a dedicated application on their mobile device. If persons are present in the surveillance area of a corresponding device, they are warned by voice output before activating the camera or the microphone. <tb> 4. <SEP> known functions of a personal assistant, such as Apple Siri. For this purpose, the device can access the entire functionality of a mobile terminal (ie essentially form a hands-free device) or use subfunctions (eg alarm clock, timer, e-mail function, SMS, address book, etc.). Within this framework, the device can read texts (e.g., excerpts from web pages, e-books). <Tb> 5 <September> baby monitor

The configuration of the system via voice commands and / or an application on the mobile terminal of a user. Thus, for example, the user profiles can be adapted or the priorities of the persons to be contacted or bodies can be specified in event reports. It is also possible to program additional functions, for example an automatic message to a defined user can be set up if a certain person (for example a schoolchild) has not arrived at home at a certain time of the week at a certain time of the week.

By means of an application it is also possible to give the device all voice commands in writing.

An apparatus according to the invention can also be constructed differently. In addition to a different geometry and structure, certain elements may be missing or additionally provided. In particular, not every device has to be provided with all sensors, the type of camera used, the microphone used and / or the loudspeaker used can also be adapted to the respective situation.

In summary, it should be noted that the invention provides a device which is easy to install and configure with a large range of functions.

Claims (25)

1. A device for detecting an environment and for interacting with a user by voice control and voice reproduction, the device comprising a housing in which at least the following components are included: a) a camera for optical detection of the environment; b) a microphone for acoustic detection of the environment; c) a loudspeaker for reproducing acoustic information; d) an interface for connection to a data network; wherein the housing is adapted to be fixedly mounted in a room and wherein the device comprises a controller which receives data from the camera and the microphone, drives the loudspeaker and via the interface with an application installed on a mobile terminal of the user communicated. 2. Apparatus according to claim 1, characterized in that the interface allows a connection via a power supply line. 3. Apparatus according to claim 1 or 2, characterized in that it comprises at least one sensor for at least one of the following: a) components of the ambient air, in particular carbon dioxide and / or carbon monoxide; b) temperature; c) humidity; d) smoke; e) movements of living things. 4. Device according to one of claims 1 to 3, characterized by a, in particular arranged on the housing, only manually operable mechanical switch, by means of which a power supply or a data line to a hardware component of the device can be physically interrupted, so that a) the camera; b) the microphone; and or c) the interface to the data network is deactivated and can not be reactivated by software until further actuation of the mechanical switch. 5. Device according to one of claims 1 to 4, characterized by a first software component for voice recognition, which cooperates with a database to authenticate the user based on at least one recorded with the micron voice sample. 6. Device according to one of claims 1 to 5, characterized in that the user is identified on the basis of at least one recorded with the microphone voice sample in conjunction with a predetermined code word. 7. Device according to one of claims 1 to 6, characterized by a second software component for triggering an alarm when detecting predetermined events in the environment, wherein the software component between a deactivated state and an activated state is switchable. 8. Apparatus according to claim 7 and claim 5 or 6, characterized in that the second software component is switchable by at least one voice command from the deactivated state to the activated state and from the activated to the deactivated state, wherein a switching takes place only when the voice command the can be assigned based on the at least one voice sample authenticated user. 9. Apparatus according to claim 7 or 8, characterized in that the second software component is automatically switched from the deactivated state to the activated state, if during a predetermined period of time no movement has been detected. 10. Device according to one of claims 7 to 9, characterized in that the second software component is automatically switched from the deactivated state to the activated state if no mobile terminals registered user of the device were detected during a predetermined period. 11. Device according to one of claims 7 to 10, characterized in that the device first sets off an alarm message when triggering the alarm by voice playback, after which the alarm is deactivated when the inquiry message by the authenticated using the at least one voice sample user in a predetermined manner is answered. 12. Device according to one of claims 7 to 11, characterized in that after triggering the alarm, an alarm message is sent to the mobile terminal of the user. 13. Apparatus according to claim 12, characterized in that the alarm message is forwarded to a third party upon confirmation or omitted action of the user. 14. Apparatus according to claim 12 or 13, characterized in that the user and / or the third party get triggered alarm on access to the camera and / or the microphone. 15. Device according to one of claims 1 to 14, characterized by a third software component for presence simulation. 16. Apparatus according to claim 15, characterized in that the third software component controls an interface for controlling home automation components, in particular lights, blinds or AV devices. 17. Apparatus according to claim 15 or 16, characterized in that the third software component accesses a sound database and time and / or location dependent selects sounds from the noise database and controls a playback of the selected sounds. 18. Device according to one of claims 15 to 17, characterized in that detects an actuation of a door bell and acoustically simulated after detection of the presence of a person and / or a connection to the mobile terminal of the user is established. 19. Device according to one of claims 15 to 18, characterized in that the third software component controls an integrated into the housing of the device lamp, wherein the lamp is designed in particular for dispensing differently colored light and the control is such that a characteristic for televisions light output takes place. 20. Device according to one of claims 1 to 19, characterized by a fourth software component for guiding a person to a destination, wherein the fourth software component can control at least one external light source to indicate a direction of travel to the destination. 21. Apparatus according to claim 20, characterized in that the fourth software component accesses a database with spatial information, the database comprising associations between external light sources and locations. 22. System comprising at least two devices according to one of claims 1 to 21, characterized in that the at least two devices for the exchange of data are interconnected. 23. The system of claim 22, wherein an association with a user is transferred from a first of the at least two devices to a second of the at least two devices when the user moves from an interaction region of the first device to an interaction region of the second device , 24. System according to claim 22 or 23, characterized in that simultaneously a first user with a first of the at least two devices and a second user with a second of the at least two devices is associated. 25. The system according to claim 24, characterized by a user database which comprises a prioritization of a plurality of users, wherein a user who is assigned a higher priority is given priority in the use of at least one of the at least two devices.