Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
  • H04L12/2803—Home automation networks
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/30—Services specially adapted for particular environments, situations or purposes
  • H04W4/33—Services specially adapted for particular environments, situations or purposes for indoor environments, e.g. buildings
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/30—Services specially adapted for particular environments, situations or purposes
  • H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/90—Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Definitions

• the present invention relates to an artificial intelligence system for smart home.
• the systems on the market generally send information collected in the home, such as images, videos and other data collected by sensors, to a remote computer.
• This problem is particularly relevant in the case of the processing of multimedia information, in particular videos from one or more cameras installed inside the home.
• systems of known type are generally capable of managing a single type of data (e.g. noise level, presence, movement, temperature).
• the systems of known type are generally based on an individual gateway architecture. Therefore, in case of gateway failure, the correct functioning of the entire system cannot be maintained.
• Known systems generally require an Internet connection, in the light of the fact that all the proposed functions can only be performed in the presence of information or algorithms located on a cloud platform. Nevertheless, in the home environment the user does not expect not to be able to use certain functions if there is no Internet connection, especially when these functions are not perceived as strictly related to the Internet connection (e.g. heating control or roller shutter automation).
• the main aim of the present invention is to provide an artificial intelligence system for smart homes which allows the effective management and analysis of different types of collected data.
• Another object of the present invention is to provide an artificial intelligence system for smart homes which allows protecting the privacy of users.
• Another object of the present invention is to provide an artificial intelligence system for smart home which can be easily installed inside a home.
• Another object of the present invention is to provide an artificial intelligence system for smart home which is fault-tolerant.
• Another object of the present invention is to provide an artificial intelligence system for smart home that is able to function correctly and effectively even in the absence of an Internet connection.
• Figure 1 is a general diagram of the system according to the invention installed inside a home
• Figure 2 is a general diagram of a single node of the system according to the invention
• Figure 3 is a functional diagram illustrating the operation of an automatic reasoner of the system according to the invention.
• reference numeral 1 globally indicates an artificial intelligence system for smart home.
• the system 1 comprises a plurality of nodes 2 for the detection and processing of data, which nodes can be located within different areas of a home and operationally connected to each other by means of a wireless network 3.
• each of the nodes 2 comprises:
• At least one wireless communication unit 7 configured for the communication with at least one of the other nodes 2.
• each individual node 2 is able to collect different types of data by means of one or more sensor devices 4 and is also able to process such data collected by means of a dedicated processing unit 6.
• system 1 comprises distribution and synchronization means 8 configured to distribute and synchronize the data collected by each of the nodes 2 on all the nodes.
• these distribution and synchronization means 8 are implemented by means of a middleware for the communication between the different nodes 2.
• the data related to each relevant area or home environment are collected on the storage units 5 of each individual node 2, are processed locally by the processing units 6 of each individual node 2 and are distributed to each node by means of the distribution and synchronization means 8.
• each of the nodes 2 has all the knowledge available within the whole system 1, i.e. all the data collected by all the nodes 2.
• the data distribution middleware 8 is developed so as to adapt to the critical conditions of the wireless network 3.
• the system 1 implements QoS (Quality of Service) and data compression policies to optimize the use of available bandwidth.
• QoS Quality of Service
• data compression policies to optimize the use of available bandwidth.
• Each application running in the system 1 subscribes to the transmission and reception on a subset of messages of predefined types (topics) defined in the system itself and characterized by respective unique identifiers (UUID).
• predefined types topics
• UUID unique identifiers
• Each application has a local cache that keeps the last copy of the data for which it has subscribed (in accordance with the QoSs of each message, indicated below).
• the distribution and synchronization means 8 comprise at least one persistence service running on each node 2 of the system 1.
• the persistence service is configured to perform at least one of the following tasks:
• QoS Quality of Service
• - reliability indicates whether it is a piece of data that has to be compulsory delivered to all recipients or whether the message may be lost;
• - persistence specifies the type of persistence of the piece of data with respect to switches-off and restarts of the system and of the services;
• - domain specifies whether the piece of data is also propagated to the cloud
• the persistence policies comprise the following policies:
• the datum must not be stored (involves only the reception and sending of requests but not their storage, e.g. signals); such datum is only available in the management cycle of the reception event;
• - volatile_app_cache datum stored only on the application RAM and not on persistence services RAM; the applications have the datum in their local cache (can take readings); the persistence services do not store the datum;
• gateway _loopback the message is not transmitted over the network but is used to exchange messages within the individual application process, to make the process loosely coupled at the architectural level.
• the domain policies comprise the following policies:
• the access policies comprise the following policies:
• the message can be displayed by both mobile applications (users) and the nodes 2;
• the message can be displayed and modified only by the nodes 2.
• the system 1 comprises a plurality of micro services, made up of their respective software running components, classifiable into two separate categories:
• node services 9 running on each node 2 of the system 1 and configured to collect data strictly related to the area of relevance of the specific node inside the home and by means of at least one sensor device 4;
• cluster services 10 (or“system” services) running on at least one node 2.
• the cluster services 10 are configured to carry out tasks relating to all nodes (having a“global” feature) and usually carry out tasks which can hardly be performed in a completely decentralized manner.
• the clustering manager is implemented by means of a control algorythm being configured to carry out at least the following steps:
• each cluster service 10 is constantly monitored and maintained in operation by the local control algorithm which, in case of an error or failure of the same, is able, in a short time, to reschedule them elsewhere.
• the cluster services 10 are running on a plurality of different nodes 2.
• the cluster services 10 must be running on at least one of the nodes 2 but, for fault-tolerance reasons, it is not advisable to have them all running on the same node 2.
• the system 1 comprises an appropriate clustering manager configured to manage the distribution of the cluster services 10 on multiple nodes
• the clustering manager ensures that the correct set of cluster services 10 is running throughout the system 1.
• the clustering manager is running as node service 9 (i.e. on all nodes).
• the node services 9 comprise at least one of the following:
• an acquisition, pre-processing and processing service of an audio stream (e.g. for running voice commands);
• the cluster services 10 comprise at least one automatic reasoner.
• the cluster services 10 may comprise at least one of the following:
• the automatic reasoner is configured for the processing of the collected data and for the implementation of predefined activities (predefined rules and/or smart behaviors).
• the automatic reasoner is configured to receive at input all the collected data D1 from the input sources 11 , whether they are physical sensor devices 4 or processes that generate data of interest for the correct management of the home.
• the automatic reasoner comprises a component of data fusion 12 configured for:
• the automatic reasoner is also configured to receive at input the user commands C coming from at least one command unit 13.
• the command unit 13 may consist of voice command software, mobile app command or physical input.
• the automatic reasoner comprises a reasoning unit 14, made up of a state machine 15 and of a reasoning engine 16.
• the state machine 15 is configured to receive at input the semantically relevant information D2 together with the user commands C.
• the state machine 15 is configured to ensure the consistency of the mode transitions of the home, and to ensure the correctness thereof.
• the reasoning engine 16 is configured to activate the behaviors expected by the applicable rules.
• the reasoning engine activates the expected behaviors according to a priority override mechanism (increasing from top to bottom).
• the priority override mechanism makes it possible to avoid implementation conflicts: the mechanism, due to the way it is constituted, ensures that each object is associated with one and only one implementation, thus avoiding the generation of conflicts (several implementations, resulting from different rules, associated with the same object).
• the applicable rales comprise the following rules, reported with increasing priority:
• the basic rules 16a may comprise: automatic change of seasonal home settings (transition of the home from summer to winter and vice versa); activation of automatic irrigation starting from current and expected weather conditions.
• the category rules 16b may comprise, e.g., lighting, air quality, temperature, security, energy, irrigation.
• the instant rules 16c may comprise, e.g., cinema time, rest time, party time.
• the user rules 16d may comprise, e.g., punctual modification of the general rules, some examples may be the inhibition of punctual lighting of individual objects or categories.
• the emergency rules 16e may comprise, e.g., securing the home in cases of emergency such as gas leaks or flooding.
• the reasoning engine is configured to generate a set of actuation commands 17 or one (or several) user notification(s) 18 according to an evaluation of all the applicable rules 16a-16e.
• the reasoning unit 14 also comprises a Machine Learning component 19 configured to create new knowledge and modify default behaviors starting from possible detected patterns.
• the automatic reasoner of the system 1 permits “codifying” the rules, i.e. the events that make it active and the actions that characterize it, by means of specific data structures. This makes it possible to change/adapt a set of rules and, therefore, the relative behavior of the automatic reasoner, without having to create and distribute a new version of the automatic reasoner or start the process again.
• each service is designed in itself in such a way as to reduce start times to the utmost.
• each service can be performed in any of the nodes 2 of the network. This feature makes the system 1 extremely fault-tolerant.
• a further advantage is that the location of the node services 9 and of the cluster services 10 makes it possible to ensure the privacy of users. All home-related information, whether usage data or multimedia information, is extracted and processed locally, and the processing results are maintained locally. The user may temporarily request access to such data only from the mobile application, subject to the privacy policies for all family members.
• the sensor device 4 is selected out of: at least one camera, at least one motion radar, at least one temperature sensor, at least one humidity sensor, at least one light sensor, at least one sensor of CO2, CO or volatile gases, at least one microphone, at least one pressure sensor.
• each of the nodes 2 comprises a plurality of sensor devices 4.
• each node 2 has the same set of sensor devices 4.
• the data collected by the sensor devices 4 comprise at least one of either:
• clusters For example, by collecting faces, clusters of all the people present are created. If the cluster is associated with a user, he/she will be recognized as“known”. More specifically, in this case, the term“cluster” means a set of techniques for the statistical analysis of multidimensional data, used for various purposes such as dimensionality reduction or unsupervised classification.
• This information is extracted locally, appropriately filtered and compressed (to comply with the traffic constraints of the local wireless network), and processed in a node 2 elected to the function of automatic reasoner.
• the automatic reasoner is configured to process the collected data to obtain at least the following semantically relevant information:
• the automatic reasoner is able to recognize, through analysis of the data produced in the system, some activities of interest such as the entry and exit of people from the rooms and the house, the home exit and return habits of the residents.
• the automatic reasoner is configured for running in real time predefined rules of operation depending on said determined information.
• the system according to the invention is able to ensure the privacy of the users inasmuch as all the sensitive data (such as, e.g., videos) are processed locally and are not displayed on remote devices, except when the users are away from home.
• the system according to the invention allows the effective use of heterogeneous data.
• the use of distributed knowledge derived from the aggregation of heterogeneous data, and the consequent generation of data semantically more and more relevant in the domestic context provides not only the possibility of further processing and refinement, but also determines a sort of high-level“language” for the description of the state of the house and for the expected behavior.
• a further advantage is represented by the fact that the system is fault-tolerant.
• the system consists of a plurality of devices and in case of failure of one of the devices (e.g. due to hardware problems) or in the event of one of the devices being unreachable (e.g. due to problems with the quality of the wireless communication means), the system nonetheless continues to operate correctly thanks to the clustering service.
• the system according to the invention is able to work correctly and effectively even in the absence of an Internet connection.

Landscapes

• Engineering & Computer Science (AREA)
• Computer Networks & Wireless Communication (AREA)
• Signal Processing (AREA)
• Automation & Control Theory (AREA)
• Telephonic Communication Services (AREA)
• Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
• Feedback Control In General (AREA)
• Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Priority Applications (1)

Applications Claiming Priority (2)

Publications (1)

Family

ID=66776666

Family Applications (1)

Country Status (3)

Citations (3)

• 2019
  • 2019-02-06 IT IT102019000001753A patent/IT201900001753A1/it unknown
• 2020
  • 2020-02-06 WO PCT/IB2020/050949 patent/WO2020161659A1/en unknown
  • 2020-02-06 EP EP20707321.4A patent/EP3921982A1/en not_active Withdrawn

Patent Citations (3)

Also Published As

Similar Documents

Legal Events