WO2019198187A1 - Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage - Google Patents

Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage Download PDF

Info

Publication number
WO2019198187A1
WO2019198187A1 PCT/JP2018/015307 JP2018015307W WO2019198187A1 WO 2019198187 A1 WO2019198187 A1 WO 2019198187A1 JP 2018015307 W JP2018015307 W JP 2018015307W WO 2019198187 A1 WO2019198187 A1 WO 2019198187A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
user
sensor
section
display
Prior art date
Application number
PCT/JP2018/015307
Other languages
English (en)
Japanese (ja)
Inventor
玲子 嘉和知
秀人 井澤
邦朗 本沢
弘之 野本
幸紀 八鍬
Original Assignee
東芝映像ソリューション株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 東芝映像ソリューション株式会社 filed Critical 東芝映像ソリューション株式会社
Priority to CN201880077424.4A priority Critical patent/CN111433755A/zh
Priority to PCT/JP2018/015307 priority patent/WO2019198187A1/fr
Publication of WO2019198187A1 publication Critical patent/WO2019198187A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Definitions

  • the present invention relates to a home network, an electronic device, a processing device, and a display method.
  • sensors, switches, and controllers that can be used to realize home security, home automation, or home energy management are sold by various manufacturers (manufacturers).
  • Individual sensors, switches, and control terminals for example, comply with IEEE 802.15.4, use 2.4 GHz band (of radio waves), comply with 802.15.4e, and use 900 MHz band (same). In many cases, it is designed in accordance with the standardized standard such as using the 2.4 GHz band (same as the above) in conformity with 802.15.11.
  • sensors, switches, and control terminals are often designed according to the manufacturer's (manufacturer) 's own standards.
  • it is functionally unique, for example, one sensor has multiple functions, and the control method is a manufacturer's original method. There are cases.
  • HGW home gateway
  • An object of the present invention is to provide a home network, an electronic device, a processing device, and a display method.
  • the home network of the embodiment includes an information processing unit [HGW600] and a data holding unit [700].
  • the information processing unit [HGW 600] specifies a device to be operated corresponding to the input information, and outputs a control signal for controlling the operation of the device.
  • the data holding unit [700] holds conditions for the information processing unit to control the operation of the device and information for specifying the device based on the input information.
  • FIG. 1 is a schematic diagram illustrating an example of an environment to which the home network of the embodiment can be applied.
  • 2A to 2C are schematic diagrams illustrating an example of an environment to which the home network of the embodiment can be applied.
  • FIG. 3 is a schematic diagram illustrating an example of an initial setting screen display in the home network according to the embodiment.
  • FIG. 4 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 5 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 6 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 7 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 1 is a schematic diagram illustrating an example of an environment to which the home network of the embodiment can be applied.
  • 2A to 2C are schematic diagrams illustrating an example of an environment to which the home network
  • FIG. 8 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 9 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 10 is a schematic diagram illustrating an example of section (zone) position information (data table) referred to by the home network according to the embodiment.
  • FIG. 11 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 12 is a schematic diagram illustrating an example of a setting screen display in the home network according to the embodiment.
  • FIG. 13A is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13B is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13C is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network according to the embodiment is applied.
  • FIG. 13D is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13E is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13F is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13C is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network according to the embodiment is applied.
  • FIG. 13D is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of
  • FIG. 13G is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13H is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 13I is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 14 is a schematic diagram illustrating an example of in-zone information (data table) referred to by the home network according to the embodiment.
  • FIG. 15 is a schematic diagram illustrating an example of sensor characteristic information (data table) referred to by the home network according to the embodiment.
  • FIG. 15A is a schematic diagram illustrating an example of sensor characteristic information (data table) referred to by the home network according to the embodiment.
  • FIG. 15B is a schematic diagram illustrating an example of sensor characteristic information (data table) referred to by the home network according to the embodiment.
  • FIG. 15C is a schematic diagram illustrating an example of sensor characteristic information (data table) referred to by the home network according to the embodiment.
  • FIG. 15D is a schematic diagram illustrating an example of sensor characteristic information (data table) referred to by the home network according to the embodiment.
  • FIG. 16 is a schematic diagram illustrating an example of an intention interpretation rule (data table) referred to by the home network according to the embodiment.
  • FIG. 16A is a schematic diagram illustrating an example of an intention interpretation rule (data table) referred to by the home network according to the embodiment.
  • FIG. 16B is a schematic diagram illustrating an example of an intention interpretation rule (data table) referred to by the home network according to the embodiment.
  • FIG. 17 is a schematic diagram illustrating an example of sensor control (data table) referred to by the home network according to the embodiment.
  • FIG. 17A is a schematic diagram illustrating an example of sensor control (data table) referred to by the home network of the embodiment.
  • FIG. 18 is a schematic diagram illustrating an example of a home gateway (HGW) that can be used in the home network of the embodiment.
  • HGW home gateway
  • FIG. 19A is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 19B is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 19C is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 20A is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 20B is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • FIG. 20C is a schematic diagram illustrating an example of an installation procedure of a device to be controlled to which the home network of the embodiment is applied.
  • HGW home gateway
  • the server 1000 can be connected to the HGW 600 via the Internet (network) 300.
  • An audio processing unit 400, an input device (smart phone (portable terminal device)) 500, a zone management unit 700, a data table 800, and the like are connected to the network 300.
  • the zone management unit 700 and the data table 800 hold various data described with reference to FIGS. 14, 15, 15A, 15B, 15C, 15D, 16, 16, 16A, 16B, 17, and 17A. To do.
  • At least one of the sound processing unit 400, the zone management unit 700, and the data table 800 may be integrated with the HGW 600.
  • the HGW 600 includes a control data management unit 601, a system controller 602, a device manager 603, a network interface (hereinafter referred to as network I / F) 605, a recording manager 607, a camera 611, a microphone 613, a speaker 615, and the like.
  • the HGW 600 includes a sensor control table 609.
  • the control data management unit 601 includes an application manager (hereinafter abbreviated as APP-Mg), an event manager (hereinafter abbreviated as EVT-Mg), and a configuration manager (hereinafter abbreviated as CONFIG-Mg).
  • APP-Mg manages a plurality of applications for controlling various operations of the HGW 600.
  • the EVT-Mg manages an event application for controlling various operations resulting from the occurrence of various events described later.
  • CONF-Mg recognizes the functions in the HGW 600 and various functions related to the HGW 600, and manages configuration applications that perform, for example, operation order and operation restriction.
  • the system controller 602 can control each block in the HGW 600 in an integrated manner.
  • the system controller 602 sequentially controls each block in the HGW 600 (in the embodiment, the operation of one or more sensors, switches, or control terminals is performed in time series with respect to one instruction or at a predetermined timing.
  • two or more operations classified according to a predetermined rule may be included.
  • EVT-Mg can control the camera 611, the microphone 613, the speaker 615, the recording manager 607, and the like. EVT-Mg also determines detection data from external sensors imported from the network I / F 605 and data from the camera 611, microphone 613, and speaker 615, and controls the next action and behavior (by operation case). can do. CONFG-Mg can perform initial setting, function restriction, function expansion, priority order, operation time, and the like of each function block in the HGW 600.
  • the device manager 603 can authenticate other devices operating in association with the HGW 600 and register them in the memory (storage device). Therefore, the device manager 603 can manage the other sensors 101, 102, 103,... Connected via the network I / F 605.
  • the device manager 603 also registers and recognizes identification data of the server 1000 connected via the Internet 300. Furthermore, the device manager 603 also registers and recognizes identification data such as the smartphone GUI-1 (screen display 501) connected via the Internet 300.
  • the sensor control table 609 includes names (management numbers (Device ID / Name)) of each sensor, switch, or control terminal 101, 102, 103,.
  • names management numbers (Device ID / Name)
  • data for controlling each sensor is stored, and the name and position information of each sensor, switch, or control terminal can be displayed on the GUI-1 of the smartphone 500.
  • the installer / user can confirm the type, mounting position, function, and the like of each sensor, switch, or control terminal.
  • the network I / F 605 is connected to, for example, a sensor located at an arbitrary position in the home or the switches 101, 102, 103,.
  • a sensor located at an arbitrary position in the home or the switches 101, 102, 103,.
  • the configuration of the sensors or switches 101, 102, 103,... With sensing function is an active sensor having two or more functions.
  • the sensor 101 includes a control data management unit 112 and a network I / F 115.
  • the sensor 101 also includes a function 1 (first sensing function) 116 and a function 2 (second sensing function) 117 as sensing elements.
  • the types of sensors are not limited to such types, and various types can be used.
  • the switch may have a timer function, for example, and may operate such that the switch is turned off after X (X is a positive integer) has elapsed since the switch was turned on.
  • the switch may be combined with a temperature sensor or an infrared sensor, and may be turned on when the temperature reaches a set temperature or when a specific temperature (heat) is detected. Good.
  • the control data management unit 112 includes an application manager (APP-Mg), an event manager (EVT-Mg), and a configuration manager (CONFIG-Mg).
  • CONFIG-Mg manages various applications for controlling the sensor 101 and the operation of the entire system linked to the sensor 101 (associated with the sensor 101).
  • the EVT-Mg manages the event application for executing the next operation of the sensor 101 based on the detection data from the function 1 (first sensing function) 116 and the function 2 (second sensing function) 117. ing.
  • the function 1 (first sensing function) 116 and the function 2 (second sensing function) 117 have various elements depending on the purpose of sensing. Examples of the various elements include a camera and a microphone as in the case of the HGW 600.
  • Various elements include a thermal sensor, a temperature sensor, a humidity sensor, a lighting sensor, a pressure sensor, a switch, and the like.
  • the sensor 101 may include one or more sensing elements for the purpose of use.
  • the sensors 101, 102, 103,... are, for example, sensors that detect the opening and closing of doors and windows, sensors that detect the generation of sounds that are louder than a certain level, and human movements (motion detection / Infrared sensors, sensors for detecting abnormalities (impacts) in doors and windows, sensors for taking pictures (cameras), sensors for detecting temperature, sensors for detecting brightness, etc. Is done.
  • the open / close detection sensor and the open detection sensor include a first circuit that outputs an output when the sensor is open and a second circuit that outputs an output when the sensor is not open.
  • a two-circuit type prepared integrally is preferable.
  • a sensor for detecting opening and closing of the curtain a sensor that is turned on when the curtain is opened (opened) and a sensor that is turned on when the curtain is closed (closed) are combined. Thereby, even if one of the sensors breaks down, the HGW 600 can easily determine the abnormality.
  • a detection signal is output from one or more of the sensor 611 (camera), the sensor 613 (microphone), and the sensors 101, 102,.
  • the control data management unit 601 recognizes that an event has occurred. Then, the control data management unit 601 controls the camera (sensor) 611 via the recording manager 607. As a result, the camera 611 sends the monitoring data cached before the event occurrence time (for example, 10 minutes before) to the storage medium via the recording manager 607 and the control data management unit 601, and thereafter for a certain period of time (for example, (3 minutes, 5 minutes, 10 minutes, 20 minutes, 30 minutes, etc.) Continue to send the captured monitoring data.
  • event-related data also referred to as event attribute data
  • the storage medium 1010 storage device / memory
  • the event-related data can include, for example, one or more of an event occurrence time, the type of sensor (sensor ID) that detected the event, sensor position data, recording start time, recording end time, and the like. .
  • the storage medium 1010 is a memory in the server 1000, for example. However, the storage medium 1010 is not necessarily a storage medium in the server 1000.
  • the storage location of the monitoring data may be a storage medium in the HGW 600 or a storage medium connected via the network I / F 605.
  • the storage medium 1010 includes a data area 1011 and a management area 1021. Monitoring data 1012 is stored in the data area 1011, and event related data 1022 is stored in the management area 1021.
  • the monitoring data 1012 may include not only video data but also measurement data from a sensor. For example, a change state of temperature at a specific location, a change state of humidity, or a change state of pressure.
  • management data for reproducing the monitoring data is described. This management data includes the previous event-related data.
  • the management data includes event-related data and a recording address of monitoring data corresponding to the event-related data. When a plurality of events occur, a plurality of event related data and a plurality of monitoring data corresponding to the plurality of event related data exist.
  • the event related data includes the type of event (may be referred to as a sensor). Monitoring data (for example, monitoring video) is recorded based on the event, and the event related data includes its recording start time, recording end time, and the like.
  • various sensors, switches, control terminals, etc. in the home and devices to be controlled (hereinafter referred to as target devices, but devices or simply devices) Must be registered in the device management unit.
  • the registration means will be described below.
  • FIG. 1 shows a space (a front plan view) in which the home network and the setting method (setting assist method) of the embodiment can be applied.
  • this space various target devices that can exchange signals with the home network are arranged.
  • the target device is assumed to be a sensor or a camera that captures an image, but is not limited thereto, and may be a device that provides various other functions for detecting that the surrounding environment has reached a certain condition.
  • the target device is connected to the home network through the regional communication unit.
  • Each of the target devices provides an operation state and / or arbitrary data to the home network by communication according to a protocol determined for each device or a specific type of signal.
  • Each of the target devices has a specific format prepared so that the HGW 600 can control each of the above-described target devices provided by various manufacturers through the HGW 600 according to a protocol determined for each target device.
  • Receive control data from the home network. And it operates based on the received control information or control data.
  • the control data in a specific format is used to control the target device, that is, the sensor 101, and the operation of the entire system (associated with the sensor 101), for example, via the server 1000 or It can be acquired from the data table 800 connected to the HGW 600 (see FIG. 15, FIG. 15A to FIG. 15D, FIG. 16, FIG. 16A, FIG. 16B, FIG. 17 and FIG. 17A for the data format).
  • the acquired control data in a specific format can be recognized by the individual sensors 101 and the entire system (associated with the sensors 101) linked to the sensors 101, from the HGW 600 as necessary (to the target device). ) It may be updated individually.
  • the conditions to be detected and output may be changed from the outside through the HGW 600.
  • the threshold (detection determination) level when the detection target is detected and notified can be changed in the HGW 600.
  • detection timing detection interval
  • non-detection time can also be set.
  • a non-photographing period off time
  • the set non-photographing period can be arbitrarily changed.
  • the user it is also possible for the user to directly instruct the shooting timing by the camera and take a picture.
  • the user can set, for example, still image shooting, continuous shooting (moving image) for a fixed period, or intermittent (interval) shooting for a fixed period. Further, in the shooting of a still image, it is possible to take a predetermined number of times when the user gives an instruction for shooting.
  • the HGW 600 also connects the home network and an external network (for example, the Internet network or the cloud).
  • an external network for example, the Internet network or the cloud.
  • FIG. 15, FIG. 15A to FIG. 15D, FIG. 16, FIG.16A, FIG.16B, FIG.17 and FIG.17A for the target device determined based on, for example, the operation state and / or arbitrary data received from the target device.
  • control information described later or control data in a specific format can be supplied to the target device.
  • the control data in the specific format includes, for example, a voice instruction (voice expression itself) associated with the control information, a determination condition to be linked from the voice instruction, and the like.
  • the HGW 600 can accept a user instruction (operation input) from a terminal device held by the user, such as a smartphone or a tablet (PC), by any communication format (protocol) supported by the HGW 600. Further, the HGW 600 provides a message or an output signal in a predetermined format to the smartphone or tablet (PC) held by the user using an arbitrary communication format (protocol) supported by the smartphone or tablet as necessary. Can do.
  • the space shown in FIG. 1 includes at least one floor (floor / hierarchy) and at least one partitioned area.
  • the space is, for example, a finite space consisting of a predetermined area around a building in which a target area of a network mainly using wireless communication is relatively small and around the building.
  • the building is preferably, for example, a general house, a small commercial facility (retail store), or a small office.
  • the building may be, for example, a hospital, a facility for children, a facility for elderly people, or the like.
  • the network (home network) using wireless communication is designed in accordance with a standard standardized by an international organization such as IEEE (Institute of Electrical and Electronics Electronics).
  • IEEE Institute of Electrical and Electronics Electronics
  • the network conforms to IEEE 802.15.1 and uses 2.4 GHz band radio waves (Bluethooth (registered trademark)), and also conforms to 802.15.4 and uses 2.4 GHz band radio waves.
  • Z-Bave registered trademark
  • Z-Wave registered trademark
  • a network that conforms to IEEE802.11 and uses a 2.4 or 2.5 GHz band radio wave (Wi-Fi (registered trademark)
  • a network that conforms to 802.15.16e, 2 .5 GHz band radio wave (Wi-MAX (registered trademark)), which also conforms to 802.15.4g and uses 2.4 GHz band radio wave (Wi-SUN (Smart Utility Networks))
  • Etc. can also be fried.
  • the space to which the home network and the setting assist method shown in FIG. 1 can be applied will be described as a finite space composed of a general building (house) and a predetermined range around it.
  • the building and the finite space around it may be referred to as a site or simply a site.
  • a building 100 is a first layer (floor) located at a reference plane in a site (finite space) 1, for example, a height (sometimes referred to as altitude) that is substantially equal to or slightly higher than the ground.
  • the second layer (floor) 20 located at a certain height higher than the first layer
  • the third layer located at a height higher than the second layer 20 by a certain height It consists of layers (floors) 30, etc.
  • a portion higher than the third layer 30 by a certain height may be identified as the fourth layer 40.
  • the fourth layer 40 in FIG. 1 may be referred to as the uppermost layer.
  • the number of layers is arbitrary, and in the case of only the first layer 10, the second layer 20 is the uppermost layer.
  • the uppermost layer is sometimes called a roof.
  • the roof does not necessarily have a structure separated from the roof, and may be formed flat, for example.
  • the first section 11-the fourth section 14 of the first layer 10 the first section 21-the fourth section 24 of the second layer 20, and the first section 31-the second layer 30 of the first layer 10.
  • various devices that are operated by electric power provided by a commercial power source and / or a battery (including a fuel cell) are arranged.
  • the device include a television broadcast receiving device (sometimes referred to as a TV device), a lighting device, a door locking device, a window opening / closing device, a curtain (screen) opening / closing device, an air conditioner, an elevator, and a personal computer (PC).
  • a television broadcast receiving device sometimes referred to as a TV device
  • a lighting device a door locking device
  • a window opening / closing device a window opening / closing device
  • a curtain (screen) opening / closing device an air conditioner
  • an elevator and a personal computer (PC).
  • PC personal computer
  • Some sensors have a function of setting a plurality of conditions for outputting detection outputs and / or a function of outputting several detection outputs under different conditions.
  • the HGW 600 can move autonomously in the same layer or in individual sections described below.
  • the first layer 10 includes at least a first section 11, a second section 12, a third section 13, and a fourth section 14 that are each partitioned into a predetermined area.
  • the first section 11 is a section that is positioned at the same height as the ground, for example, and is partitioned into a certain size (area), such as a garage (sometimes referred to as a garage), or a storage space or storage space.
  • the second section 12 is a section adjacent to the first section 11 and positioned at a height higher than the first section 11 by a certain height. For example, a part of the wall such as an entrance or a corridor has a wall surface. The space does not have.
  • the third section 13 is a space that is at least partially connected to the second section 12 on the same plane and is located at a height substantially equal to the second section 11 and is, for example, a dining room (first living room or first floor). Sometimes called a living room or a room at the back of the first floor.)
  • the fourth section 14 is a section that is connected to the second section 12 and the third section 13 and at least a part of which is positioned at the same height as the second section 12, and is, for example, a staircase (the first floor staircase or Sometimes referred to as the lower stairs or descending stairs).
  • the second layer 20 includes at least a first section 21, a second section 22, and a third section 23 that are each partitioned into a predetermined area.
  • the part which hits the roof of the 1st division (garage) 11 of the 1st layer 10 may be called the 4th division 24.
  • FIG. Further, the number of sections is arbitrary, and one layer may be only one section.
  • the first section 21 is a staircase connected to the fourth section 14 of the first layer 10 and connects the first floor (first layer 10) and the second floor (second layer 20) so that a resident can move.
  • the first staircase 15 is included.
  • the second section 22 is a space that is at least partially connected to the first section 21 on the same plane and is located at a height substantially equal to the first section 21, for example, a bedroom (second living room or garage side). Room, or a room of XX (for example, the name of a family such as dad).
  • the third section 23 is a section that is at least partially connected to the first section 21 and located at the same height as the first section 21.
  • the third section 23 is a living room (the back room on the second floor or the widest room). Or it may be called a room with a screen / TV, etc.).
  • the 4th division 24 may have a deck-like structure called a clothesline (veranda) which a resident can enter and exit through the 2nd division 22, for example.
  • the third layer 30 includes at least a first section 31 and a second section 32 that are each partitioned into a predetermined area.
  • the number of divisions is arbitrary and one layer may be only one division.
  • the first section 31 is a staircase connected to the first section 21 of the second layer 20 and connects the second floor (second layer 20) and the third floor (third layer 30) so that the resident can move.
  • the second staircase 25 is included (sometimes referred to as a staircase on the second floor or an upper staircase or a descending staircase).
  • the second section 32 is a space that is at least partially connected to the first section 31 on the same plane and is located at a height substantially equal to the first section 31, and is, for example, a rooftop (a balcony or outside the third floor or Sometimes called under the roof, etc.).
  • the 3rd division 23 of the 2nd layer 20 for example, the space which is the 3rd division 23 of the 2nd layer 20, and is located in the upper part of the division is made into the blow-by (3rd division of the 3rd layer 30) 33, for example.
  • a sunscreen and / or an open / close sensor of a high window that is a detection target
  • blow-through screen (and / or the high window shade (screen)) in the third section 23 of the second layer 20 is viewed from the top (third floor) of the first section (staircase) 31 of the third layer 30.
  • the same control object, whether it is called “3rd floor screen” or “high window awning (screen)” when viewed from the 2nd floor Can be controlled.
  • the fourth layer 40 is a roof 41 that covers the first section (second staircase) 31 of the third layer 30 and the third section 23 of the second layer 20 (blow-through (third section 33 of the third layer 30)). including.
  • the roof 41 preferably holds a solar power generation device (solar power generation panel) 42, for example.
  • a portion (non-building space) excluding the portion where the building (house) 100 is located is provided with a detection mechanism that can detect an object moving around the site 1 such as a cat or a dog. It is preferable that the detection mechanism can detect and record an object even at night, for example, a camera set and / or an illumination unit or a camera (infrared camera) capable of photographing with infrared rays.
  • HGW600 is located at any position of the second section 12 to the fourth section 14 of the first layer 10 or at any position of the first section 21 to the fourth section 23 of the second layer 20, HGW600 is located. It is preferable that the HGW 600 can move autonomously in the same layer that can be regarded as being substantially in the same plane or in individual sections described below.
  • the substantially same layer or individual sections may include irregularities in the height direction of, for example, about several centimeters (centimeters).
  • the HGW 600 has a mechanism suitable for movement in the height direction, for example, an endless track type driving mechanism (crawler) and a lifting mechanism for movement in the height direction in substantially the same layer or in individual sections. It may be.
  • the elevating mechanism may be provided independently of the propulsion (movement) mechanism for moving the plane.
  • the HGW 600 may also be capable of collecting, for example, dust and dirt in the area where the HGW 600 moves.
  • the drive mechanism for movement is a roller shape, for example, a brush or the like that can move dust and dirt may be integrally provided.
  • the HGW 600 can receive the detection output output from each (any one) of the sensors located in the individual sections of the building 100.
  • the HGW 600 also outputs (supplies) a control signal according to a protocol determined in advance for each control target device, control data according to a specific signal format, or the like to an arbitrary control target device.
  • any one of the HGWs 600 becomes a master device. .
  • the remaining HGW 600 is a slave device. If another communication unit prepared independently of the HGW 600 already exists, all the HGW 600 can be slave devices.
  • any one of the HGW 600 can be a master device and another communication unit can be a slave device.
  • the HGW 600 can communicate with a smartphone or a television device registered in the device management unit via a network. When a specific application / program is activated on the smartphone or the television device, the smartphone or the television device is in an intercommunication mode with the HGW 600.
  • FIG. 2 is a plan view showing individual layers of the building 100 shown in FIG. In FIG. 2, the display is omitted for the fourth layer (top) of the building 100 shown in FIG.
  • FIG. 2A shows the first section 11 to the fourth section 14 of the first layer 10
  • FIG. 2B shows the first section 21 to the third section 23 of the second layer 20.
  • FIG. ) Shows the first section 31 and the second section 32 of the third layer 30, respectively.
  • a lighting device that can be turned on / off at an arbitrary timing from an arbitrary position (living room, section, or site) in a first section (storage / garage) 11 of the first layer (first floor) 10 will be described.
  • An example of the procedure will be described with reference to an example in which expansion is to be performed. It is assumed that an electrical outlet has already been installed in the vicinity of the position where the lighting device in the first section 11 of the first layer 10 is to be added.
  • the “Create floor plan” button (display) 511 displayed in the display area 501 of the smartphone (input terminal device) 500 an example of the display illustrated in FIG.
  • the floor plan creation mode is activated.
  • a tap may be called a touch or a flick, but if the user touches the button (display) displayed on the screen and then releases the finger within a certain time, the tap is called. It is not dominated by. However, it is preferable to distinguish the operation (so-called long press) of releasing the finger from the button for a certain time after the user touches the finger.
  • the display area 501 displays, for example, a [device registration] button (display) 512 for starting the “device registration” mode, and the previous screen display.
  • [Back / Cancel] button (display) 513 for displaying is preferably displayed.
  • the GPS (Global Positioning System) / GLONASS (Global Navigation Center) of the smartphone 500 is displayed. System) signal reception mode is activated.
  • the smartphone 500 specifies the position in the space where the user is present based on the received GPS / GLONASS signal, and holds it as reference position information.
  • the reference position information includes latitude, longitude, and altitude. Further, as shown in FIG. 5, the current position 541 of the user corresponding to the reference position information is virtually displayed at an arbitrary position in the display area 501.
  • the position of the user (destination) in the target space (in this case, the first section 11) specified based on the GPS / GLONASS signals received sequentially (repeatedly) and (previous)
  • a virtual map (floor plan) is created in a predetermined area in the memory (RAM) 502 based on the specified reference position information.
  • the smartphone 500 can perform mutual communication with the HGW 600 described later. Therefore, data such as the floor plan created by the smartphone 500 is temporarily stored in the memory in the smartphone 500, but the data to be stored is stored in the memory in the HGW 600, the device management unit, etc. via the network.
  • data such as the floor plan created by the smartphone 500 is temporarily stored in the memory in the smartphone 500, but the data to be stored is stored in the memory in the HGW 600, the device management unit, etc. via the network.
  • mapping when mapping is started, there may be a specific space where reception of GPS / GLONASS signals is unstable (difficult), for example, some sections of an apartment house or an underground space.
  • the application of the smartphone 500 can prompt the user to move to a position where the GPS / GLONASS signal can be received on the screen, and can specify the reference position.
  • the output of the gyroscope (direction sensor) of the smartphone 500, the output of the acceleration sensor, and the movement time The floor plan can be created virtually by calculating the size of the space moved by the user.
  • the smartphone 500 may move to an area where GPS / GLONASS signal reception is unstable after receiving the GPS / GLONASS signal.
  • the application of the smartphone 500 acquires the floor plan information via the Internet for a space where the floor plan information is open, such as a sports gym attached to an apartment house, and uses the information together.
  • a message such as “Please move to the front, near the boundary of the wall or window or room (partition)” is displayed, and the user is able to detect the size of the target space appropriately. By moving to, the floor plan detection accuracy can be further enhanced.
  • the smartphone 500 can display the current position 541 of the user and the message 531 in the display area 501.
  • the message 531 is a message such as “Please move to the boundary of a wall or window or room (section) in the front direction”, that is, a message prompting the user to move in the target space.
  • the current position 541 of the user is a position where the user has tapped the [Start] or [Start / Start] button 521 in the “floor plan creation” mode illustrated in FIG. 4, and will be a reference position thereafter.
  • the reference position is retained even when the floor plan (virtual map) information created in the memory 502 is updated.
  • the current position 541 ′ of the user is created based on the difference between the GPS / GLONASS signal at the current position and the GPS / GLONASS signal at the reference position, which are sequentially received, and the current position 541 ′ is stored in the memory.
  • the information is displayed in the display area 501 as a result of updating the floor plan (virtual map) information created in 502.
  • the current position 541 ′ of the user is continuously displayed as a trajectory that the user has moved. Since the user moves in the target space based on the message 531, there is no useless movement, and the difference between the GPS / GLONASS signal at the current position and the GPS / GLONASS signal at the reference position can be detected with higher accuracy. I can expect.
  • the smartphone 500 detects the reference position or the vicinity thereof at a predetermined timing when the change in the moving direction is detected several times in the state where the “floor plan creation” mode is activated.
  • the floor plan information being created in the memory 502 becomes information that can be approximated to a closed space, that is, a rectangle, a triangle, or a polygon. Therefore, the user's movement trajectory 541 ′ displayed in the display area 501 can be displayed as a plan view showing a certain section as shown in FIG. 6.
  • the locus 541 ′ displayed in the display area 501 is converted (or approximated) into a straight line as illustrated as a rectangle 542 in FIG. 8 or FIG. 9 in the application / program used in the “floor plan creation” mode. Displayed.
  • the message 532 and the button 522 are displayed as shown in FIG. .
  • the message 532 is, for example, “Do you want to register the shape of this section as a floor plan?
  • the button 522 is a button for receiving an instruction input from the user such as [Register] or [Yes] or [Redo] or [Cancel].
  • the display area 501 The display changes as shown in FIG. That is, “Do you want to set the next room (partition)? , Etc., and a button display 523 for accepting an instruction input from the user such as [Continue] or [Yes] or [Register and End].
  • the instruction input (tap) from the user is [Continue] or [Yes]
  • a message prompting the user to move to the next room (section) is displayed in the display area 501.
  • the floor plan in the memory 502 is sequentially updated based on the position of the user's destination specified based on the sequentially received GPS / GLONASS signal and the reference position.
  • Fig. 8 if the instruction input (tap) from the user is [Register and finish], as shown in Fig. 9, "Do you want to register the device in the room (section)?" , Etc., and a button 524 such as [Register] or [Yes] or [Register later] are displayed in the display area 501.
  • the “floor plan” completed at the present time is stored in a predetermined area of the memory 502, and the “floor plan creation” mode is terminated.
  • the latitude (Latitude), the longitude (Longitude), and the altitude (Altitude) are stored for each section ([zone]) as information of the “floor plan” as shown in FIG.
  • the shape of the section is a rectangle 11 as shown in FIG. 9, the latitude and longitude of each corner 11-1, 11-2, 11-3 and 11-4 are set to dd. It is specified and stored in degrees (degrees), mm ′ (minutes), and ss ′′ (seconds).
  • the section 11 shown in FIG. 9 is rectangular and includes four corners. For each position of the latitude and longitude of the section, it is preferable to add and display a subscript specifying each corner and a subscript indicating the latitude or longitude.
  • floor plan is usually given temporary partition names of A (Area) 11-1, A (Area) 11-2,... In the order in which the floor plan is created. This temporary section name is used later when a name is given to each room.
  • a TV device a lighting device, a door locking device, a window opening / closing device, a curtain (screen) opening / closing device, an air conditioner, an elevator, a PC (personal computer), a printer, a microwave oven (electronic Range), toaster, electromagnetic cooker, vacuum cleaner, washing machine, electric fan, rice cooker, refrigerator, telephone, charging device, outlet, switch, sensor, power generator, watt-hour meter, heat recycling device, power storage device, monitoring There are cameras, etc.
  • a “device registration” method for example, a button display 551 ([New registration]) prompting the user to select (input) one of [new registration], [registration change], and [registration deletion]. ), 552 ([Registration change]) and 553 ([Registration deletion]) are displayed in the display area 501.
  • the display as shown in FIGS. 13A-13I / 19A-19C / 20A-20C This activates the “device registration” mode for guiding the user.
  • the application / program used in the “device registration” mode can automatically determine a plurality of wireless communication standards and automatically determine the communication mode.
  • the user can easily register the device without being aware of “what is the wireless communication standard adopted by the new or added device (sensor, control target device)”.
  • “What is the wireless communication standard to which the device to be added belongs” is being detected, at the stage before displaying the screen for each “device registration” mode, for example, “Communication method detected” , Etc. are preferably displayed in the display area 501.
  • a display 560 such as “let's register the name of the room” prompting the registration of the name (name) of the room (section) is displayed, and the user It is preferable to have “room name” registered.
  • the information of the “room plan” shown in FIG. 10 is used. For example, when the user enters a room to register a name and taps “New Registration” 551, if the room name is not attached, the temporary section name of the current room (for example, A (Area shown in FIG. 10) is displayed. ) 11-1, A (Area) 11-2,... When the user inputs a room name by voice or via a character input screen and taps the enter button, the room name input next to the temporary partition name (for example, A (Area) 11-1) is displayed. .
  • the registration of the room name may be started from the message “Register the room name” when the room is registered after the display shown in FIG. 8 or FIG. 9 is made.
  • FIG. 13A to FIG. 13I show that the wireless communication network standard (communication standard adapted to the device) used by the device to be registered is based on, for example, IEEE 802.15.4e and uses the 900 MHz band [Type An example of a registration procedure in the “device registration” mode in the case of A ⁇ Z-Wave>] is shown.
  • FIG. 13A is an example of a display when the “device registration” mode is activated.
  • FIG. 13A displays a state in which the current position of the user is displayed in a planar manner on the “floor plan (planar)” registered in the “floor plan creation” mode described with reference to FIGS. Further, a message 561 such as “Please move to the vicinity of the device to be registered” is displayed in the display area 501 to prompt the user to specify the device to be registered.
  • the activation of the device varies depending on the shape of the device and the state in which the device is fixed. For example, a standard activation switch (an embedded reset button) provided at a predetermined position of the device is turned on. Shall conform to various specifications.
  • a push button method when setting the time on a remote controller or a clock, a push button method may be used in which the reset button is turned on (input mode) when pressed with the tip of a pen / ballpoint pen and turned off (non-input mode) when pressed again.
  • the user When the user moves in the vicinity of the device to be registered (described with the device 571 as an example), the user recognizes the device 571 and activates the device 571 (the user), the display shown in FIG. 13B is obtained. That is, the “floor plan (plane)” 542 is updated to a state in which the position of the device 571 is displayed together with the position 543 of the user.
  • a switch On / off switch
  • a sensor Motion sensor
  • a sensor Open / close sensor
  • a socket Electrical outlet representing the schematic shape of the device 571.
  • / Receptacle outlet is displayed in the display area 501 in a list 572 format, such as a standard identification name for each function, product specifications, or individual names (model numbers) prepared by the supplier.
  • the above list 572 is acquired as follows, for example. That is, when the device 571 is activated, the HGW 600 recognizes the device 571 and transmits, for example, information on the manufacturer of the device 571 to the cloud server via the network. Then, since the smart phone 500 receives the data of the list 572 from the cloud server, the HGW 600 transmits the received data of the list 572 to the smart phone 500. Thereby, the smartphone 500 can display the previous list 572.
  • the cloud server stores a feature table as shown in FIG. 15, FIG. 15A, FIG. 15B, FIG. 15C, and FIG.
  • the feature table may be downloaded to the HGW 600 and stored in a memory in the HGW 600. However, in this case, since the feature table may be updated, the HGW 600 may acquire it from the cloud server when receiving a notification that there has been an update.
  • column C102 is information on the manufacturer of the device
  • column C103 is information on the product name of the device
  • column C104 is the device identification name.
  • Column C105 contains information on the function of the device
  • column C110 contains a display example (Image ⁇ data) of the device. Such information is constructed by each manufacturer uploading it to the cloud server.
  • the rules regarding the display of the list 572, the “floor plan (planar)” display 542, the message 573 and / or the button 525, the display position, the display order, the overlap, the transparency / non-transparency at the time of the overlap, etc. Is optional.
  • the display size is controlled in accordance with the size of the display area 501, and the display amount per screen display is controlled, and all screen displays are displayed by scrolling. Note that, for example, the settings of the smartphone 500 can be used regardless of the display rule adopted by the application / program used in the “device registration” mode.
  • Type A there are other types (“Type B”, “Type C”) that multiple devices start up at the same time, but when this type of device is used, you are trying to register A separate procedure for identifying the device is required. This apparatus will be described later with reference to FIGS. 19A to 19C / FIGS. 20A to 20C.
  • the screen display of FIG. 13C when the user inputs (tap) an instruction of [Register] or [Yes], the screen display is switched to the screen display shown in FIG. 13D. That is, for example, a message 574 such as “Let's name the device (set the name of the device)” and a name input area 575, for example, [Register] or [Yes] or [Redo] or The display area 501 can be displayed with a button 525 that accepts an instruction input such as “quit”.
  • a message 574 such as “Let's name the device (set the name of the device)”
  • a name input area 575 for example, [Register] or [Yes] or [Redo]
  • the display area 501 can be displayed with a button 525 that accepts an instruction input such as “quit”.
  • the display layout, display order, display order, overlap, and transparency / non-transparency at the time of overlap, etc. (actual layout) display 542, message 574, input area 575 and / or button 525 are displayed.
  • Display form is arbitrary.
  • the display amount of each display is controlled according to the size of the display area 501 and the display amount per screen display is controlled, and all screen displays are displayed by scrolling.
  • the size of each display can be displayed in the display area 501 by reducing the screen.
  • a message 575 such as “You can give a nickname” or the like may be displayed so that the nickname can be entered in the input area 581.
  • a message 576 urging the user to avoid registration of a duplicate name (name) such as “Enter another name” may be displayed, and the name may be displayed in the input area 581.
  • FIG. 13D when the instruction input (tap) from the user is [Register] or [Yes], an example is shown in FIG. As well, a latitude (Latitude), a longitude (Longitude), and an altitude (Altitude) are registered in a predetermined area in the memory 502 together with a zone (section) name (Zone) and a registered name (Device).
  • N is a positive integer
  • N is a positive integer
  • N input areas are displayed in advance. It may be a format.
  • the display of the input areas 581... Can be skipped by a user operation, and can be added (or edited) at a predetermined timing using the “edit name” mode, for example.
  • the nickname of the device entered by the user already exists in the input area 581,..., For example, “a device with the same name has already been registered as shown in FIG. It is preferable to display a message 576 prompting the user to avoid registering duplicate nicknames, such as “Enter another nickname”.
  • a message 576 prompting the user to avoid registering duplicate nicknames, such as “Enter another nickname”.
  • the product name unique to the device held in the column C103 of the feature table shown in FIG. 15 and the identification name (product specification) held in the column C104 as shown in FIG. It is preferable to display unique features.
  • the name of the device that has been registered is referred to as “garage spotlight”.
  • nicknames for example, “garage lights”, “garage spots”, “garage spots”, “garage lights”, “lights outside the first floor (examples of expressions not necessarily specifying“ garage ”)”, There are various readings (paraphrases) such as “garage, light (with paragraph breaks)”, “spotlight, garage (with paragraph breaks)”.
  • the names and nicknames of the devices that have been registered are registered in the column C107 (voice instruction column) in FIGS. 15 and 15B in association with the control information indicated by the column C106.
  • the devices that have been registered as described above have the same names (names) given as names (names) and nicknames, even when multiple names (names) are used. If it is a device, it can be determined.
  • the HGW 600 can transmit feedback (question) for specifying the device to the terminal device held by the user.
  • the feedback can be directly output by audio by the audio output mechanism.
  • a device registered as a “garage spotlight” is a voice (voice) instruction (input) via the HGW 600 for a lighting device connected via an already installed outlet. It is a device that can be turned on / off by being notified that there has been. That is, the above-described device (in this example, a device to which a garage spotlight is connected) has been instructed by voice such as “garage spotlight on” or “to garage spotlight”. By being notified via the HGW 600, the connected lighting device is controlled to be turned on (lighted). In addition, the device is connected to the lighting by notifying the HGW 600 that there has been a voice instruction such as “garage spotlight off” or “garage spotlight off”. Control the device to turn off (extinguish).
  • the role of the device registered as “garage spotlight” is “on” and “off” of the lighting device.
  • the role of the device (light) registered as “living lighting” is lighting control by a control unit (controller) incorporated in advance in the light (device). From such a background, in fact, the name of the device specified by the user and information acquired from either “ON” or “ON”, “OFF” or “OFF” (the requested device With regard to (operation), the role is specified (determined) from the column C113 (voice instruction) and the column C117 (control information) of the intention interpretation (data table) shown in FIG. 16 and FIGS. 16A and 16B. Based on the specified (determined) role, the control pattern is read from the column C118 in FIGS. 16A and 16B, and is notified to the device to be controlled through the HGW 600.
  • the device of [Type A] is not able to communicate directly between its own device and HGW 600, and the other [Type A] device is used as a relay device to send signals from HGW 600 to its own device and from its own device.
  • the signal to the HGW 600 can be popped (relayed).
  • the individual communication capability of the [type A] device can be suppressed, and a network with low power consumption can be constructed.
  • voice instructions such as “Turn on” and “Turn off” may not include direct instructions.
  • voice instructions that are not similar (expression), such as “Good night” / “Have a nice dream” or “Go out” .
  • control over voice is associated so that any voice instruction can be interpreted as turning off the light ("turn off”).
  • voice instructions such as “Good night” / “Have a nice dream”, for example “Sleep well” or “Sweet dreams”, etc.
  • Various voice instructions and device operation patterns are associated with each other so that a suitable operation pattern can be identified from the expression.
  • the role of the device that is, the operation / function of the device may be uniquely determined based on the product specifications of the device held in the feature tables shown in FIGS. 15 and 15A to 15D.
  • the product specification of the device is, for example, a switch that can only be turned on / off, as shown in FIG. 13H, an area 578 that has been used as an input area until then, You may display the name of the apparatus etc. which can be acquired based on the product specification (description content of the characteristic table) of an apparatus.
  • “XX (input name) is ⁇ ⁇ (room name) ⁇ (standard)
  • a message 579 such as “This device is on and off of the garage spotlight”, etc.
  • a multi-level control pattern is prepared corresponding to voice instructions such as “Good night” / “Good night” for the lighting device)
  • It is also possible to display a feedback message such as “Do you want to?”
  • the HGW600 (or lighting device) has a voice output mechanism (speaker) and a voice playback (synthesized voice output) function. If they are in the above-described feedback message can be heard by the user by (reproduced by the audio reproducing function) sound.
  • the target device is, for example, a sensor (temperature sensor) and its role (operation / function) is room temperature detection, usually polling (or a transmission instruction from the user) is performed.
  • the temperature data of the temperature at the time of acceptance is output.
  • a specific pattern change for example, the humidity exceeds 77% and the temperature exceeds 31 ° C.
  • the function (role) of the device is displayed in an area 578 that has been used as an input area until then, and the remaining part of the display area 501 (displayed for other display). It is also possible to set to display a message 579 such as “I will notify the detected temperature when a certain temperature is exceeded” in the “not present area”.
  • FIG. 10 shows an example of section (zone) position information (data table).
  • the data table illustrated in FIG. 10 is located, for example, in an external server, and holds latitude, longitude, and altitude for each section (zone).
  • Each of the latitude, longitude, and altitude data stored in the data table shown in FIG. 10 can be acquired by the movement of the user as already described with reference to FIGS.
  • the HGW 600 can autonomously move and acquire.
  • the movement trajectory of the HGW 600 is stored in the section position information (data table) at a predetermined timing. If there is location information for each section (zone) acquired by the autonomous movement of the HGW 600, the mapping in the section ("Create floor plan") mode described with reference to FIGS. Needless to say, it can be omitted.
  • FIG. 14 shows an example of zone (position) information (data table).
  • the in-zone position information data table shown in FIG. 14 is the latitude (Latitude) of devices located in the storage medium 1010 of the server 1000 and located in each of the arbitrary sections (zones) A, B,. Holds Longitude and Altitude.
  • Each of the sections (zones) A, B, C,... Corresponds to the correspondence with the temporary section name given in FIG. 10, that is, the section (zone) where the user is currently located.
  • the temporary partition names are shown in a predetermined order. In other words, in FIG.
  • a zone 11 is a zone A (Area) 11-1
  • a zone 12 is a zone A (Area) 11-4
  • a zone (Zone) 13 corresponds to section (Zone) A (Area) 11-3
  • section (Zone) 14 corresponds to section (Zone) A (Area) 11-2. .
  • the data of latitude (Latitude), longitude (Longitude), and altitude (Altitude) held in the data table shown in FIG. 14 is as described above with reference to FIGS. 9, 11, 13A, 13B, and 13C.
  • the position information when the device is registered and the device are held in association with each other.
  • the position information (latitude, longitude, and altitude) held in the data table shown in FIG. 14 is accumulated for each device every time the user registers the device.
  • the position information shown in FIG. 14 is also displayed on the input terminal device (smart phone) 500 by defaulting the analogy (estimation) of the zone when the device is registered next and the nearest zone among the analogized (estimated) zones.
  • the area 501 can be used for display via GUI-1.
  • the device (sensor) feature information data table illustrated in FIGS. 15 and 15A to 15D is located in, for example, the storage medium 1010 of the server 1000, and includes, for example, a column C100 to a column C110.
  • a column C100 indicates a serial number (management number) for identifying an arbitrary number of devices used in the embodiment.
  • the column C101 holds information related to a wireless communication standard supported by an arbitrary device.
  • the column C102 holds, for example, information on the device manufacturer.
  • the column C103 holds product names unique to the device, for example.
  • the column C104 holds, for example, information that can uniquely specify the function of the device, that is, an identification name (product specification). Note that the identification name indicated by the column C104 preferably indicates a function unique to the device such as “switch”, “sensor”, “fan”, and the like.
  • the column C105 holds, for example, information on the device functions and the control method.
  • the function of the device indicated by the column C105 may directly represent a function unique to the device or its operation, as in the case of the identification name indicated by the column C104. For this reason, in the “device registration” described with reference to FIGS. 13D, 13E, 13F, and 13G, the function (name) may be displayed by default on the display area 501 of the smartphone 500 using the GUI-1. preferable.
  • Column C106 holds information on a control method for realizing the function of the apparatus. Note that the information held in the column C106 has a one-to-one correspondence with the function of the device indicated by the column C105.
  • Column C107 holds the relationship with the operation of each device when the device name or nickname is instructed by voice. That is, when an operation is instructed in various paraphrasing with respect to a device that has completed registration based on information related to reading (paraphrase) registered in column C107 and held in column C107, Can be specified. For example, as described above, a voice instruction such as “good night” / “good night” or “go out” is recognized as a voice instruction for specifying “turn off”.
  • Column C108 holds the determination of the operation of various devices held by the column C107 and the rules of operation for the determination result.
  • the rule held by the column C108 is configured by, for example, a syntax of “ ⁇ IF (... // ...)>- ⁇ THEN ( ⁇ ⁇ ⁇ )>”, for example, “Turn on Dad Bedroom light ( Turn on the bedroom light), Turn Turn on Garage light, Turn off light, Turn on light, Turn on light on the aisle, or Set / Warm up temperature bath room for 70F (Temperature in the bathroom to 21 ° C (approx.) (warm) before bathing) ”, etc., and so on, based on the output ( ⁇ IF>) from a certain device It is characterized by realizing the operation of the device ( ⁇ THEN>).
  • the device associated in advance may be the device itself or a device that follows a predetermined correspondence.
  • the HGW 600 sets the air conditioner in the room to a predetermined temperature (by a cooling operation or a heating operation).
  • Instruction for the air conditioner is output. For example, if the notification “Detected temperature of the room ABC over DE °C” ( ⁇ the temperature of room ABC exceeds DE °C) ”( ⁇ IF>) is received, HGW600 will set“ Set temperature of the ABC room for FG It is preferable to output “° C. with the air conditioner (turn on the air conditioner and set (set) the temperature of the room ABC to FG ° C.)” ( ⁇ THEN>).
  • the brightness of the section (room) is higher than the illuminance with a certain brightness. It is also possible to turn on the light when it is dark. Of course, it is possible to always turn on the light when there is a voice instruction “ON”. In the case of a light whose brightness can be adjusted, the brightness at the start of lighting can be fed back to the user, or the brightness at the start of lighting can be set by the user.
  • the living room light is turned off in response to the voice instruction “I'm going out”, taking into account the travel time until the user leaves the room (section), for example, 1 minute or N (N is N The light may be turned off after elapse of a positive integer) minutes).
  • the living room light is turned off in response to the voice instruction “good night” / “good night”, it is necessary to consider that the user remains as it is (remains in the section). In that case, for example, it is preferable to turn off the light at the time when it is detected that the user has gone out of the section based on the output of surrounding sensors (not while the user is in the section).
  • stepwise control is possible in which the brightness of the light is reduced every time a certain time (for example, about 15 seconds or 1 minute elapses).
  • a voice instruction to a fan (ventilation fan), as shown in FIGS. 15B, 15C, and 15D, it is necessary to consider an instruction that does not clearly indicate on and off, such as “soundproof”. In this case, for example, since it is expected that a loud sound is generated in the section, it is determined that the fan is turned off. It should be noted that the fan speed can be switched to a low-speed operation in one or two steps in response to voice instructions such as “I'm listening to music” or “I'm watching a movie now”. On the other hand, for voice instructions such as “ventilation”, if the fan is off, it is turned on, and if it is already on, the fan speed is switched to high speed operation in one or two stages. Can do.
  • the column C109 is an interface for controlling the operation of the target device based on the contents held in the columns C106 to C108, for example, switch on (or off) or temperature change (set) (controller tap voltage).
  • the column C110 holds image data of a target device that is preferably displayed for visual display to the user in the “device registration” described with reference to FIGS. 13D, 13E, 13F, and 13G. ing.
  • FIG. 16, FIG. 16A and FIG. 16B show an example of intention interpretation (data table).
  • the intention interpretation data tables shown in FIGS. 16, 16A, and 16B are located, for example, in an external server, and include, for example, column C111-column C118.
  • Column C111 holds a management number (Device ID) / serial number (Item No.) for each device unique in the home network.
  • the management number (Device ID) / serial number (Item no.) Indicates a correspondence relationship with an arbitrary device held in the sensor characteristic information (data table) shown in FIG.
  • the management number (Device ID) is associated with the serial number (Item no.) Held in the column C100 in FIG. 15, and in the home network described below with reference to FIGS. 16, 16 ⁇ / b> A, and 16 ⁇ / b> B. It is used in management of individual devices by the HGW 600.
  • Column C112 holds the product name in the device characteristic information held in column C103 in FIG. This ensures a correspondence between the management number and the device for which registration has been completed.
  • Column C113 is information on various readings (paraphrases) for recognizing the voice instruction (individual phrases constituting the voice instruction) indicated by column C107 among the sensor characteristic information held in FIGS. 15 and 15B. Hold. That is, column C117 is information related to a control method for realizing the function of the device held by column C106 among the information input by the user (for example, by voice) and the feature information shown in FIGS. 15 and 15B. And information relating the above voice instructions or the association with phrases. As a result, when a voice instruction of various words (expressions) is given to the device given the name indicated by the column C116, the corresponding device is identified, and the control information stored in the column C117 (how to Specific actions are required).
  • Column C114 holds information on individual sections held in FIG. Needless to say, the information on the individual sections held in the column C114 corresponds to the space shown in FIG.
  • Section name corresponding to the information of individual sections held by the column C114.
  • the section name can be arbitrarily set by the user, and holds the room name (name) set in FIG. 12, for example.
  • the section name is also positioned as a nickname corresponding to an arbitrary room (section).
  • FIG. 1 for the section 23 corresponding to Living, there are various such as “Living room”, “Room with everyone”, “Room with TV on the second floor”, “Room with pets”, etc. It can be recognized that they are the same section (room) even if they are called by different reading (paraphrase).
  • the section 11 corresponding to the multipurpose space can cope with various paraphrasing such as “garage”, “garage”, “outside the first floor”, and the like.
  • Column C116 holds a product name and / or identification name (product specification) unique to the apparatus.
  • Column C117 holds control information (same as FIG. 15 and FIG. 15A) associated with the voice instruction (individual phrases constituting the voice instruction) held in column C107 in FIG.
  • Column C118 holds information on an actual control method (control pattern) for realizing the function of the apparatus held in column C106 in FIG. That is, the column C118 is based on the role specified (judged) from the column C113 (voice instruction) and the column C117 (control information) of the intention interpretation (data table) shown in FIGS. 16, 16A, and 16B.
  • the control pattern for actually controlling is shown.
  • the control pattern indicates the operation of the apparatus identified by the voice instruction described above. For example, based on the voice instructions of “Turn off”, “Go out” and “Good night” / “Good night”, for example, illumination ( This indicates that the timing (pattern) to turn off is different when turning off (light).
  • the voice instruction when the voice instruction is “turn off”, it is preferable to immediately turn off the light (illumination) because the control amount is 0x00.
  • the voice instruction when the voice instruction is “I will go out”, the control amount is 0x00, but in the preceding stage, for example, when the door sensor detects that the door has been opened and then closed. It is preferable to turn off the light.
  • the voice instruction is “good night” / “good night”, it is preferable to check, for example, whether an off timer is set or whether brightness adjustment is instructed (not off). Needless to say, if the off timer is instructed to set or adjust brightness, the control is shifted to that control.
  • the air conditioner adjusts the temperature of the section, and for example, when the television apparatus is operating, the voice instruction is given to indicate the target device. It is preferable to obtain approval from the instructing (speaking) user (user). In such a case, an expression that asks the user using an expression that specifies one device and obtains consent to the subsequent control operation, such as “Turn off the TV device” is preferable. On the other hand, it is judged that it is cumbersome to output a voice acknowledgment such as “turn off the air conditioner” for voice instructions that specify the target device such as “turn off the air conditioner”. Therefore, the HGW 600 may output a control signal to the target device without sound (no audio output).
  • a reply with the meaning of reception confirmation such as “turn off the air conditioner” may be displayed (transformed into the mobile terminal device 500).
  • the user can select the output of the silent (no audio output) control signal through, for example, a setting screen displayed by GUI-1.
  • the HGW 600 When the voice instruction is “I will go out”, for example, in the door sensor, the resident (user) goes out of the block (building) by detecting that the door has been opened and then closed. For example, after 3 seconds, the HGW 600 outputs a control signal to turn off the light. In addition, it can also detect using the positional information on the portable terminal device (smartphone) 500 which a user hold
  • the output of the door sensor detection of opening / closing
  • the use of the positional information of the smartphone may be used in combination.
  • the HGW 600 is configured to detect the movement of the user by combining various outputs from other sensors, such as a person intrusion into the garage and a subsequent start of the car from the garage, and turn off the light (switch). It is also possible to output a control signal.
  • the HGW 600 detects the detection of the opening / closing of the door sensor, the HGW 600 checks that there is no person such as a family member including the user remaining in the building using the output of the other sensor. When a person (including a user) remains, it is preferable to disable light (switch) off. Note that whether or not a person remains in the building can also be realized by checking the position information of the smartphone held by each person including the user.
  • the HGW 600 controls each device according to information set in advance by the user.
  • the HGW 600 can be linked with a plurality of user instructions such as turning off the light (switch) but maintaining the air conditioner in operation, and turning on when the motion sensor is off.
  • Various control signals are output to the device.
  • a consent approval
  • sending sending
  • a message for confirming whether or not to automatically operate the air conditioner to a smartphone (portable terminal device) held by the user.
  • control pattern that has been executed and stored in the past can be referred to by the learning function, and a control signal can be automatically output as, for example, [outing mode (door lock (lock check))].
  • a control signal can be automatically output as, for example, [outing mode (door lock (lock check))].
  • a plurality of control patterns can be prepared that are classified based on control patterns such as “outing mode (nighttime)” and “outing mode (daytime)”.
  • control pattern such as “outing mode (daytime)”
  • a plurality of patterns such as “outing mode (daytime-summer)” and “outing mode (daytime-winter)” should be prepared. Can do.
  • control pattern referred to by the learning function may be held in the server 1000, for example, or may be held in the HGW 600.
  • the learning function may be prepared in the control data management unit 601 in advance.
  • the learning function is stored in the storage medium 1010, and when there is a read request from the control data management unit 601, the learning function is stored in the control data management unit 601. May be developed on the memory (work memory) and executed by the CPU in the control data management unit 601.
  • the voice instruction is “good night” / “good night”, for example, it is checked whether an off timer is set or whether brightness adjustment is instructed (not off).
  • the off timer the light (switch) is turned off when it is detected that counting by the off timer (time managed by the timer) has ended.
  • the level set in the light (switch) is read (Read), and the brightness is set to that level.
  • the brightness can be adjusted by changing the power supplied to the light by setting the PWM (Pulse Width Modulation) value (duty) of the inverter.
  • the process of recognizing the voice instruction and determining the intention may be shared by the voice processing unit 400 provided independently of the HGW 600 as shown in FIG.
  • the control data management unit 601 may process.
  • the sensor control information data table shown in FIGS. 17 and 17A is located, for example, in an external server, and includes, for example, a column C121-column C129.
  • Column C121 holds a management number for each device unique in the home network.
  • the management number indicates a correspondence relationship with an arbitrary device held in the sensor feature information data table shown in FIGS. 15 and 15A to 15D.
  • the management number is associated with the sensor feature information held in FIGS. 15, 15A to 15D, and the same number as the management number shown in FIGS. 16, 16A, and 16B is used.
  • Column C122 holds information related to a wireless communication standard supported by an arbitrary device.
  • Column C123 holds product names unique to the apparatus.
  • the column C124 holds information that can uniquely specify the function of the apparatus, that is, an identification name (product specification). Note that the information held in the column C123 and the column C124 is the same information as the column C102 and the column C103 in FIG. 15, respectively, and thus the device (sensor) characteristic information shown in FIGS. 15 and 15A to 15D Can be ensured.
  • Column C125 holds information regarding the function of the device and the control method.
  • Column C126 holds information regarding a control method for realizing the function of the apparatus. Note that the information held in the column C125 and the column C126 is the same information as the column C106 and the column C107 in FIGS. 15, 15A, and 15B, respectively, and accordingly, the sensors shown in FIGS. 15, 15A to 15D. Correspondence with feature information (data table) can be ensured.
  • Column C127 holds information related to various readings (paraphrases) when a registered (device) name and / or nickname is instructed by voice. That is, when a device that has been registered is designated by various names (names) based on information related to reading (paraphrase) registered in column C127 and held in column C127 In this case, the corresponding device can be identified.
  • Column C128 holds the section names of the individual sections held by the column C115 in FIG.
  • Column C129 holds information that can uniquely identify the function of the device, that is, an identification name (product specification).
  • control of various devices in the home network through the HGW 600 based on the information described in FIGS. 14, 15, 15A to 15D, 16, 16A, 16B, 17, and 17A. Will be described.
  • Any device that is, a detection mechanism (sensor) or a device to be controlled can be controlled by a voice instruction (individual phrases constituting the voice instruction).
  • the corresponding device control target
  • identifying the names given as various names (names) of arbitrary devices held in the intention interpretation data table from the phrases included in the voice instructions.
  • name for example, “spotlight” is called “light” or “spot”, and for example, “garage” is called “garage” or “outside (entrance)” so that it can be uniquely identified.
  • various readings (paraphrases) for each of the controlled object (device) and the phrase are also stored in a data table in association with names that can be uniquely identified or information for replacing the names so that they can be handled in various ways. ing. It is preferable that a plurality of names or information for replacing the names are prepared.
  • the data table holds necessary control information for controlling the device by voice so that a phrase indicating an intention to control and information for controlling the device can be associated with each other. Yes.
  • the HGW 600 controls the device to be controlled using the “ ⁇ IF>- ⁇ THEN>” syntax format by linking the recognized device information (name) and the phrase (voice instruction) indicating the intention to be controlled.
  • Control information (word) is generated.
  • the generated control information is registered, for example, as a dictionary so that it can be linked with various re-reading (paraphrase) information. It goes without saying that the dictionary is updated from time to time.
  • the HGW 600 also determines whether it can be defined as ⁇ IF> or ⁇ THEN> based on the characteristics of the input information (recognized device information). Furthermore, in the case of ⁇ IF>, what information should be acquired from the apparatus in order to determine what conditions (information for controlling the control target) exist. Can be obtained from the data table. In the case where ⁇ THEN> is set in advance, for example, when the room temperature in the section 23 (see FIG. 1) where the pet is located reaches a certain temperature, an air conditioner that can cool the section is operated. There is also. In that case, it is also possible to monitor (set as ⁇ IF>) which device (sensor) from which the output has reached a certain temperature.
  • ⁇ IF> that is, a temperature increase in the section 23, based on the outputs of two or more sensors (temperature sensor, sunlight sensor, etc.).
  • the control command for the air conditioner is different from the control command for “cooling (cooling on)” and the control command for “warming (heating on)” as in the automatic mode setting (on the air conditioner side).
  • the temperature of the section 23 is within the range of 20 ° C. to 29 ° C. Can fit in.
  • the HGW 600 when initially registering a device (sensor), the HGW 600 sequentially accumulates and updates the position information output by the device when pairing (registering) the location where the device is set and the own device (HGW 600). You can learn while.
  • the position information includes longitude, latitude, and altitude detected by an input device, for example, a smartphone (which may be a mobile terminal device such as a tablet PC) held by the user at the time of registration.
  • the position information is the information on the nearest zone (Zone) based on the longitude, latitude, and altitude detected by the input device at the time of registration (pairing) of the next device (sensor).
  • data representing the characteristics of the device (feature information), information for controlling the device (control information), and the nickname (user setting) of the device are associated with each other as an initial value. It is preferable to display on the display unit 501 of the mobile terminal device 500.
  • various information can be exchanged between individual devices (sensors) by the HGW 600 described above, that is, by combining various information provided from the sensors (devices) to the HGW 600.
  • Rules can be executed.
  • the current position of the user is specified based on the output of an arbitrary sensor (motion detection sensor).
  • motion detection sensor position detection sensor
  • the position information from the smartphone can be used together.
  • the output of the sensor (opening / closing sensor) provided in the window is referred to in parallel with the specification of the current position of the user or at an arbitrary timing.
  • the output of the open / close sensor prepared for the door is also referred to.
  • the HGW 600 located at or near the position where the audio output can be delivered (sounded) to the user For example, a message such as “Check that the window is not closed, please check” is output.
  • the display unit 501 of the mobile terminal device (smartphone) 500 held by the user It is preferable to display an alert indicating that “the window of the partition HI does not appear to be closed, please check”.
  • the smartphone 500 normally has a voice reproduction (synthesized voice output) function, and thus the above-described alert can be provided by voice.
  • voice reproduction small voice output
  • the smartphone 500 when providing an alert by voice, it is possible to improve user friendliness as a voice of a conversation style, for example, “Your room (section HI) has a window open”.
  • the door or window lock mechanism can be locked by remote control from the HGW 600 or the smartphone 500, it can be locked at a predetermined timing after each of the doors and windows can be checked to be closed. is there.
  • rule G when it is possible to check that no one remains in the building as the user goes out, the user's position is detected based on the positional information from the smartphone 500 held by the user, and the user passes It is also possible to turn off the lights of the divided sections sequentially. In addition, the judgment of other user's family, etc. remaining / going out, for example, by checking the location information of the smartphone held by each person or by using other smartphones in the wireless LAN in the building It can be confirmed if it is not recognized.
  • the door locking mechanism can be locked by remote control from the HGW 600 or the smartphone 500, the door can be locked at a predetermined timing after detecting that the user is outside the space (building). It is.
  • the image processing of the image of the camera and the image that the user has gone out of the site from the site 1 It is also possible to activate “outing mode” or the like when it can be identified by recognition.
  • the user may go out without having a smartphone.
  • the door can be locked at a predetermined timing after the movement detection sensor can detect that a car (or a bicycle or a motorcycle) has left the garage (space 11 in FIG. 1). .
  • the door may be locked when it is possible to specify that the user has gone out of the site 1 from the site 1 by, for example, image processing and image recognition of a camera that acquires the image of the site 1.
  • the target detected in the site 1 is a suspicious person, it is preferable to stop the audio output so that the operation of the HGW 600 is not intentionally stopped (by the suspicious person).
  • the camera (sensor) 611 is activated to acquire an image in the site 1, it is preferable to shoot in the infrared shooting mode or the like without turning on the flashlight even at night, for example.
  • the output from the sensor (opening / closing sensor) provided on the door of the entrance (section 12) does not change after detecting that someone has entered the site 1, if the suspicious person enters the site It can also be recognized as an intrusion.
  • the current position of the user is specified based on the output of an arbitrary sensor (motion detection sensor).
  • motion detection sensor positional information provided from the portable terminal device (smartphone) which the user hold
  • the position information from the smartphone can be used together.
  • a sensor (open / close sensor) provided on the window and a sensor provided on the door of the entrance (section 12 in FIG. 1)
  • the output of (open / close sensor) is referenced.
  • the output of the open / close sensor prepared for the door is also referred to.
  • the HGW 600 located at or near the position where the audio output can be delivered (sounded) to the user For example, a message such as “Check that the window is not closed, please check” is output.
  • the display unit 501 of the mobile terminal device (smartphone) 500 held by the user It is preferable to display an alert indicating that “the window of the partition HI does not appear to be closed, please check”.
  • the smartphone 500 normally has a voice reproduction (synthesized voice output) function, and thus the above-described alert can be provided by voice.
  • voice reproduction small voice output
  • the smartphone 500 when providing an alert by voice, it is possible to improve user friendliness as a voice with a conversational tone such as “The window of Mr. XX's room (section HI) is open”.
  • the windows (see FIG. 1) that may be used for ventilation such as the windows of the section 33 that becomes a high window, with respect to the living room (section) 23 on the second floor of the building of FIG.
  • the HGW 600 can wait for an instruction from the user by feedback. If a heavy rain (Rainy, cats and dogs (are run).) Or a strong wind is expected due to weather forecasts, etc., the user (smartphone) will be closed today. Or the like.
  • the light (illumination) of the section (room) in which it is already detected that the user is not present is turned off.
  • the door and window locking mechanism can be locked by remote control from the HGW 600 or the smartphone 500, it is also possible to lock at a predetermined timing after checking that each door is closed. is there.
  • the smartphone held by the user (own) For example, the HGW 600 may be instructed (transmitted) to transmit a message for other family members such as “I'll go to bed first”.
  • FIG. 15, 15A to 15D, FIG. 16, FIG. 16A, FIG. 16B, FIG. 17 and FIG. 17A are associated with voice instructions and rules, and the actual operation pattern registration (recording) is shown in FIG.
  • FIG. 16A, FIG. 16B, FIG. 17 and FIG. 17A are associated with voice instructions and rules, and the actual operation pattern registration (recording) is shown in FIG.
  • FIG. 13E, and FIG. 13G Each time a “device registration” process described with reference to 13D, FIG. 13E, and FIG. 13G is executed and a new device (sensor) is added, it is automatically updated sequentially. That is, when a device is added, features of the added device are read from the feature information shown in FIGS. 15 and 15A to 15D. Based on the read characteristics, the operation (rule) of the added device is specified based on the intention interpretation (rule) shown in FIGS. 16, 16A, and 16B. That is, the operation of the device corresponding to various voice instructions is specified.
  • the position of the device and the actual operation of the device are correlated as shown in FIGS. 17 and 17A.
  • a rule (rule) is automatically created and added to the data table based on the feature (property) of the added sensor. it can.
  • 19A to 19C show that the wireless communication network standard (communication standard to which the apparatus conforms) used by the apparatus to be registered conforms to, for example, IEEE 802.15.4 and uses 2.4 GHz band radio waves.
  • An example of the registration procedure in the “device registration” mode in the case of the type to be [type B ⁇ zigbee>] is shown.
  • FIG. 19A is an example of a display at the time of registration of a device that has activated the “device registration” mode, and “floor plan (planar)” registered in the “floor plan creation” mode described with reference to FIGS.
  • 1551 a state where the current position of the user is displayed in a plane by reference numeral 1541 is displayed. Further, it is preferable to display a message 1535 such as “Please move to the vicinity of the device to be registered” in the display area 501 to prompt the user to specify the device to be registered.
  • the device is [Type B]
  • each of the devices that can be registered is displayed in the “room plan” 1551.
  • registration target devices 1561, 1562,..., 1565 located in the vicinity are displayed in the “room plan” 1551.
  • registration target devices 1564 and 1565 shown in FIG. 19A are devices located in sections (1 and 11) other than section 11 that are not visible to the user who is trying to register the apparatus (not visible to the user). is there.
  • FIG. 19A by scrolling the display range of the display area 501, for example, the second layer 20 shown in FIG. 2B or the third layer shown in FIG. The approximate position of the device to be registered located within 30 is displayed.
  • the device 1561 will be described as an example
  • the user recognizes the device 1561
  • the device 1561 is set as a registration target device (by the user) and the coupling (the user holds the device).
  • the “floor plan” 1551 is updated to a state in which the position of the device 1561 is displayed together with the position 1543 of the user. At this time, as shown in FIG.
  • an image (Image) and / or a switch (On / off switch), a sensor (Motion sensor), a sensor (Open / close sensor), a socket (Electrical outlet) representing the schematic shape of the device 1561 / Receptacle outlet) is read from the feature table shown in FIG. 15 by reading out standard identification names for each function, product specifications, and individual names (model numbers) prepared by the supplier, for example, a list 1570 It is preferable to display in the display area 501 in a format.
  • a switch On / off switch
  • a sensor Motion sensor
  • a sensor Open / close sensor
  • a socket representing the schematic shape of the device 1561 / Receptacle outlet
  • the rules regarding the display such as the display position of each of the list 1570, “floor plan” 1551, message 573, and / or button 525, the display order, overlap, and transparency / non-transparency when overlapping are arbitrary.
  • the display size is controlled in accordance with the size of the display area 501, and the display amount per screen display is controlled, and all screen displays are displayed by scrolling.
  • the instruction input (tap) from the user for the screen display shown in FIG. 19C is [Register] or [Yes], it conforms to the registration of the type A apparatus already described with reference to FIGS. 13D, 13E, and 13G.
  • the “device registration” process is performed sequentially. If the device name (name) input by the user in the “device registration” process already exists, for example, “a device with the same name has already been registered,” as described with reference to FIG. 13F. It is preferable to display a message 576 that prompts the user to avoid registering a duplicate name (name) such as “Enter another name”.
  • the device of [Type B] even when direct communication between the own device and the HGW 600 is not possible, uses other [Type B] devices as relay devices and signals from the HGW 600 to the own device and from the own device.
  • the signal to the HGW 600 can be popped (relayed). Thereby, the individual communication capability of the [type B] device can be suppressed, and a network with low power consumption can be constructed.
  • the wireless communication network standard used by the device to be registered (the communication standard to which the device is compatible) conforms to, for example, IEEE 802.15.1 and uses 2.4 GHz band radio waves.
  • An example of a registration procedure in the “device registration” mode in the case of [Type C ⁇ Bluethooth>] to be performed is shown.
  • FIG. 20A is an example of a display at the time of registration of a device that has activated the “device registration” mode, and “floor plan (planar)” registered in the “floor plan creation” mode described with reference to FIGS.
  • a state in which the current position of the user is displayed in a planar manner by reference numeral 2541 is displayed in 2551.
  • each identifier of the device that can be registered for example, a MAC (Media Access Control) address or a product code is “ A list is displayed in the “floor plan” 2551.
  • MAC Media Access Control
  • the identifier of the device to be registered in the vicinity is displayed in the “floor plan” 2551 without specifying the position.
  • the identifier of the registration target device shown in FIG. 20A is, for example, for the registration target device located in the second layer 20 shown in FIG. 2B or the third layer 30 shown in FIG. Are also listed. For this reason, it is necessary to display a message 2536 such as “Please select a device to be registered” in the display area 501 to prompt the user to identify the device to be registered.
  • the user When registering type C devices, first. The user recognizes the device to be registered (described with the device 2561 as an example), and couples the device 2561 as a registration target device (establishes communication with the terminal device [smartphone] 500 held by the user) To do).
  • the “floor plan” 2551 is updated to a state in which the position of the device 2561 is displayed together with the position 2541 of the user. .
  • an image (Image) and / or a switch (On / off switch), a sensor (Motion sensor), a sensor (Open / close sensor), a socket (Electrical outlet) representing the schematic shape of the device 2561 / Receptacle outlet) is read out from the feature table shown in FIG. 15, for example, a list 2570, such as a standard function-specific identification name, product specification, or individual name (model number) prepared by the supplier. It is preferable to display in the display area 501 in a format.
  • a switch On / off switch
  • a sensor Motion sensor
  • a sensor Open / close sensor
  • a socket representing the schematic shape of the device 2561 / Receptacle outlet
  • rules regarding display such as the display position of each of the list 2570, “floor plan” 2551, message 573, and / or button 525, display order, overlap, transparency / non-transparency when overlapping, and the like are arbitrary.
  • the display size is controlled in accordance with the size of the display area 501, and the display amount per screen display is controlled, and all screen displays are displayed by scrolling. As shown in FIG. 20C, for example, “Do you want to register this device? , Etc., and a button 525 for accepting an instruction input such as [Register] or [Yes] or [Redo] or [Stop] are displayed in the display area 501.
  • the instruction input (tap) from the user for the screen display displayed in FIG. 20C is [Register] or [Yes], it conforms to the registration of the type A device already described with reference to FIGS. 13D, 13E, and 13G.
  • the “device registration” process is performed sequentially. If the device name (name) input by the user in the “device registration” process already exists, for example, “a device with the same name has already been registered,” as described with reference to FIG. 13F. It is preferable to display a message 576 that prompts the user to avoid registering a duplicate name (name) such as “Enter another name”.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)

Abstract

La présente invention a pour objet la fourniture d'un réseau domestique, d'un dispositif électronique, d'un dispositif de traitement et d'un procédé d'affichage. Un réseau domestique, selon un mode de réalisation, comprend une unité de traitement d'informations et une unité de conservation de données. L'unité de traitement d'informations identifie un dispositif à faire fonctionner en correspondance avec des informations d'entrée et délivre en sortie un signal de commande destiné à la commande du fonctionnement du dispositif. L'unité de conservation de données conserve un état permettant à l'unité de traitement d'informations de commander le fonctionnement du dispositif et des informations permettant d'identifier le dispositif sur la base des informations d'entrée.
PCT/JP2018/015307 2018-04-11 2018-04-11 Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage WO2019198187A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880077424.4A CN111433755A (zh) 2018-04-11 2018-04-11 家庭网络、电子机器、处理装置及显示方法
PCT/JP2018/015307 WO2019198187A1 (fr) 2018-04-11 2018-04-11 Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/015307 WO2019198187A1 (fr) 2018-04-11 2018-04-11 Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage

Publications (1)

Publication Number Publication Date
WO2019198187A1 true WO2019198187A1 (fr) 2019-10-17

Family

ID=68164187

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/015307 WO2019198187A1 (fr) 2018-04-11 2018-04-11 Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage

Country Status (2)

Country Link
CN (1) CN111433755A (fr)
WO (1) WO2019198187A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004005481A (ja) * 2002-03-15 2004-01-08 Samsung Electronics Co Ltd ホームネットワークに連結された電化製品を制御する方法及び装置
JP2004180260A (ja) * 2002-03-20 2004-06-24 Sanyo Electric Co Ltd 信号変換装置
JP2007333998A (ja) * 2006-06-15 2007-12-27 Hitachi Ltd 地図の自動生成装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102058918B1 (ko) * 2012-12-14 2019-12-26 삼성전자주식회사 홈 모니터링 방법 및 장치
WO2014098477A1 (fr) * 2012-12-18 2014-06-26 삼성전자 주식회사 Procédé et dispositif de commande d'un dispositif domestique à distance dans un système de réseau domestique
TWI521480B (zh) * 2014-03-28 2016-02-11 D Link Corp 能主動偵測終端裝置所在位置之安全看護系統
WO2017218234A1 (fr) * 2016-06-15 2017-12-21 Irobot Corporation Systèmes et procédés de commande d'un robot mobile autonome

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004005481A (ja) * 2002-03-15 2004-01-08 Samsung Electronics Co Ltd ホームネットワークに連結された電化製品を制御する方法及び装置
JP2004180260A (ja) * 2002-03-20 2004-06-24 Sanyo Electric Co Ltd 信号変換装置
JP2007333998A (ja) * 2006-06-15 2007-12-27 Hitachi Ltd 地図の自動生成装置

Also Published As

Publication number Publication date
CN111433755A (zh) 2020-07-17

Similar Documents

Publication Publication Date Title
JP2018063537A (ja) ホームネットワーク、電子機器、処理装置および表示方法
US10869006B2 (en) Doorbell camera with battery at chime
US11902657B2 (en) Systems and methods for automatic exposure in high dynamic range video capture systems
US12052494B2 (en) Systems and methods of power-management on smart devices
US20220295008A1 (en) Event Based Recording
EP3888344B1 (fr) Procédés et systèmes de coloration d'images infrarouges
WO2019198187A1 (fr) Réseau domestique, dispositif électronique, dispositif de traitement et procédé d'affichage
US20240333550A1 (en) Electronic device controller, communication terminal, and electronic device
KR20230018295A (ko) 세대단말기를 이용한 스마트홈 시스템
CN113848734A (zh) 一种智能设备联动控制方法及装置
KR102706322B1 (ko) 세대단말기를 이용한 동선감지 시스템 및 이를 이용한 방법
WO2024140803A1 (fr) Procédé de détection et dispositif
KR102510499B1 (ko) 클라우드 플랫폼 기반의 공동주택의 스마트홈 시스템
WO2022170555A1 (fr) Composition de système domestique permettant de réaliser une intelligence de maison entière et procédé permettant de réaliser une intelligence de maison entière
KR20230018297A (ko) 세대단말기를 포함하는 시스템 및 이를 이용한 방법
CN104238528A (zh) 一种室内环境智能控制系统及其方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18914474

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18914474

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP