WO2014128797A1

WO2014128797A1 - Program and method for controlling information terminal

Info

Publication number: WO2014128797A1
Application number: PCT/JP2013/006183
Authority: WO
Inventors: 崇光佐々木; 知成高橋; 康平田原
Original assignee: パナソニック株式会社
Priority date: 2013-02-20
Filing date: 2013-10-18
Publication date: 2014-08-28

Abstract

In this control method, at least one apparatus type icon representing at least one subject apparatus in units of apparatus type is caused to be displayed by the computer of an information terminal at a display, when it is determined that the selection of any one apparatus type icon among the at least one apparatus type icon has been detected, at least one room icon representing the rooms at which the subject apparatuses having a type corresponding to the selected one apparatus type icon are installed is displayed arrayed at the display, the at least one room icon contains an operation screen of the subject apparatuses of the type corresponding to the selected one apparatus type icon, and on the basis of an operation of the operation screen contained in any one room icon among the at least one room icon, a control command for controlling the subject apparatuses of the type corresponding to the selected one apparatus type icon and disposed in the room corresponding to the room icon containing the operation screen that has been operated is output to a network.

Description

Information terminal control method and program

This disclosure relates to an information terminal control method.

A technology for remotely monitoring or controlling one or more target devices using a single remote controller has been proposed.

Patent Document 1 discloses a technique for remotely operating one or more target devices from a television monitor. Specifically, one or more target device icons are displayed on the right side of the monitor screen, and when an arbitrary icon is selected from among them (i), a floor plan is displayed on the left side of the monitor screen (ii), A technique is disclosed in which when the pointer is moved to the installation location of the target device to be operated in the floor plan (iii), the operation screen of the target device selected by moving the pointer is displayed on the monitor screen (iv) (paragraph [ 0138] to [0140] and FIGS. 25 (a) and 25 (b)).

However, the above Patent Document 1 requires further improvement.

JP 2007-104567 A

In order to solve the above-described problem, an aspect of the present invention is a method for controlling an information terminal that is connected to a network that controls one or more target devices and has a display. When one or more device type icons indicating the above target devices in units of device type are displayed on the display, and it is determined that selection of any one of the one or more device type icons is detected One or more room icons indicating a room in which a target device of a type corresponding to the selected one device type icon is installed are arranged on the display, and the one or more room icons are selected Including an operation screen of a target device of a type corresponding to one device type icon, and any one of the one or more room icons A control command for controlling a target device of a type corresponding to the selected one device type icon installed in a room corresponding to the room icon including the operated operation screen based on the operation of the operation screen. It is output to the network.

Further improvement can be realized by the above aspect.

1 is an overall configuration diagram of a home control system to which a home controller according to an embodiment of the present invention is applied. It is a figure which shows the main apparatuses which the home controller in one embodiment of this invention controls. It is a block diagram which shows the structure of the home controller, apparatus, and server in one embodiment of this invention. It is a figure which shows the structural example of the mounting form of the home controller in one embodiment of this invention. It is a figure which shows the structure of the basic screen of the home controller in one embodiment of this invention. It is a figure which shows the room icon displayed on the display of the home controller in one embodiment of this invention. In one embodiment of this invention, it is a figure which shows the room screen displayed on the display of a home controller. In one embodiment of the present invention, it is a figure which shows another example of the room icon displayed on the display of a home controller. In one embodiment of the present invention, it is a figure which shows another example of the room icon displayed on the display of a home controller. It is a figure which shows the example different from FIG. 6 of the display screen of the room icon in one embodiment of this invention. It is a figure which shows the example of a transition of the display screen of the display in one embodiment of this invention. It is a figure which shows another example of a transition of the display screen of the display in one embodiment of this invention. It is a figure which shows the structure of the home information in one embodiment of this invention. In one embodiment of this invention, it is a figure which shows the structure of the room information which a server manages. In one embodiment of this invention, it is a figure which shows the structure of the room information which a home controller manages. In one embodiment of the present invention, it is a figure which shows the structure of the apparatus list which a server manages. In one embodiment of the present invention, it is a figure which shows the structure of the apparatus list which a home controller manages. In one embodiment of this invention, it is a sequence diagram which shows the flow of the process in which a home controller acquires home information from a server. In one embodiment of the present invention, when the home controller is connected to the network, it is a sequence diagram showing a flow of processing in which the home controller detects a device on the network. In one embodiment of the present invention, when a device is connected to a network, it is a sequence diagram showing a flow of processing in which a home controller detects a device on the network. In one embodiment of the present invention, when the basic screen or the room icon is displayed on the display, it is a flowchart showing the flow of processing that the home controller controls the device. In one embodiment of this invention, it is a flowchart which shows the flow of the process in which a home controller controls an apparatus in case the detailed control screen is displayed on the display. It is a flowchart which shows the flow of the process in which a home controller transmits a control command in one embodiment of this invention. In one embodiment of this invention, it is a sequence diagram which shows the flow of the process in which a home controller directly controls an apparatus. In one embodiment of this invention, it is a sequence diagram which shows the flow of the process in which a home controller controls an apparatus via a server. In one embodiment of the present invention, it is a sequence diagram showing a flow of processing in which the home controller acquires the state of the device from the server. In one embodiment of the present invention, when the home controller controls a plurality of devices in one operation, it is a sequence diagram showing a flow of processing in which the home controller directly controls the devices. In one embodiment of the present invention, when the home controller controls a plurality of devices in one operation, it is a sequence diagram showing a flow of processing in which the home controller controls the devices via a server. In one embodiment of the present invention, when the home controller controls a plurality of devices in one operation, it is a sequence diagram showing a flow of processing in which the home controller controls the devices via a server. In one embodiment of the present invention, it is a sequence diagram showing a flow of processing to update the device list of the home controller and the server. In one embodiment of the present invention, it is a sequence diagram showing a flow of processing to update the device list of the home controller and the server. In one embodiment of the present invention, it is a sequence diagram showing a flow of processing to update the device list of the home controller and the server. In one embodiment of this invention, it is a figure which shows the further different example of a room icon. FIG. 34 is a diagram showing a transition example of the display screen of FIG. 33 in the embodiment of the present invention. FIG. 34 is a diagram showing a transition example of the display screen of FIG. 33 in the embodiment of the present invention. FIG. 34 is a flowchart showing the flow of processing in which the home controller controls the device when the room icon shown in FIG. 33 is displayed on the display in the embodiment of the present invention. In one embodiment of this invention, it is a figure which shows the further different example of a room icon. FIG. 38 is a diagram showing a transition example of the display screen of FIG. 37 in the embodiment of the present invention. FIG. 38 is a diagram showing a transition example of the display screen of FIG. 37 in the embodiment of the present invention. FIG. 38 is a flowchart showing a flow of processing in which the home controller controls the device when the room icon shown in FIG. 37 is displayed on the display in the embodiment of the present invention.

(Background to inventing one aspect of the present disclosure)
First, an aspect of one aspect according to the present disclosure will be described.

In Patent Document 1, when a desired icon is selected from the icons of one or more target devices displayed on the right side corner of the monitor screen, a floor plan is displayed on the left side of the same monitor screen. Displays the installation location of the target device.

Due to the above configuration, in Patent Document 1, a room having a specific shape included in the floor plan of the specific building is displayed. For example, the room is included in the floor plan of the specific building owned by a specific individual named Mr. A. , A room having a specific shape applicable only to Mr. A will be displayed.

Therefore, it is not possible to provide a room icon that can be commonly applied to A, B, C, or D who own different floor plans. In addition, for example, when Mr. A moves and lives in a new building with a floor plan, it is necessary to obtain a new floor plan.

Based on the above considerations, the present inventors have come up with the following aspects of the invention.

A control method according to an aspect of the present invention is a method for controlling an information terminal connected to a network that controls one or more target devices and having a display, and the one or more target devices are connected to a computer of the information terminal. Is displayed on the display, and when the selection of any one of the one or more device type icons is detected, the selection is performed. One or more room icons indicating a room in which a target device of a type corresponding to the one device type icon is installed are arranged and displayed on the display, and the one or more room icons indicate the selected one device type Including an operation screen of the target device of the type corresponding to the icon, before being included in any one of the one or more room icons Based on the operation on the operation screen, a control command for controlling the target device of the type corresponding to the selected one device type icon installed in the room corresponding to the room icon including the operated operation screen is output to the network It is what makes you.

In the above aspect, first, one or more device type icons indicating the one or more target devices in units of device types are displayed on the display. Next, when it is determined that selection of any one of the one or more device type icons has been detected, an operation screen of a target device of a type corresponding to the selected one device type icon is displayed. Instead of displaying on the display, one or more room icons indicating a room where a target device of a type corresponding to the selected one device type icon is installed are displayed in an array.

For example, when a plurality of air conditioners (air conditioners) are installed in the home, the operation screen is installed in any room even if the operation screen of the individual target device corresponding to the individual device icon is suddenly displayed. It does not know whether it corresponds to a new air conditioner, and may cause a malfunction such as operating an air conditioner different from the desired air conditioner. On the other hand, when a device icon representing an air conditioner is displayed for each installed air conditioner, the number of device icons displayed on the display increases, and it becomes difficult to select a desired device icon.

In this aspect, as described above, the operation screen of the individual target device corresponding to the individual device icon is not displayed on the display, but the target device of the type corresponding to the selected one device type icon is displayed. One or more room icons indicating the installed rooms are arranged and displayed.

Therefore, for example, it is only necessary to display one device type icon for each device type, and thus it is possible to suppress an increase in the number of device type icons to be displayed. This prevents the selection of a desired device type icon from becoming complicated and facilitates the selection of the desired device type icon.

In addition, since one room icon indicating a room in which a desired target device is installed can be selected from the one or more room icons arranged and displayed, it is possible to select which one by the operation screen included in the room icon. It becomes clear whether to operate the air conditioner installed in the room, and malfunction can be prevented.

Further, the room icons are displayed in an array, not a room having a specific shape included in the floor plan of the specific building. That is, for example, a room having a specific shape that is included in the floor plan of a specific building owned by a specific individual named Mr. A and can only be applied to Mr. A is not displayed. Therefore, it is possible to provide room icons that can be commonly applied to Mr. A, Mr. B, Mr. C, and Mr. D who own buildings with different floor plans. In addition, for example, even if Mr. A moves and resides in a building with a different floor plan, a new floor plan can be obtained by adjusting the correspondence between the target equipment to be used and the room to be installed. You can continue to use it without asking for a picture.

Further, the one or more room icons include an operation screen of a target device of a type corresponding to the one device type icon. According to this, at the stage where the one or more room icons are displayed, it is installed in a room corresponding to any one of the room icons without displaying an operation screen separately from the display of the room icons. It becomes possible to control the target device of the type corresponding to the selected device type icon. In this case, it is possible to easily identify which target device is installed in which room, and to reduce the number of user operations required to operate the desired target device, and to operate the desired target device. It is possible to reduce the number of processing steps required in the apparatus.

In the above aspect, for example, the one or more room icons may have the same size and the same shape. For example, the one or more room icons may be represented by the same size and the same rectangular shape.

According to this, the one or more room icons do not represent a room having a specific shape included in the floor plan of the specific building, for example. Therefore, it is possible to provide room icons that can be commonly applied to Mr. A, Mr. B, Mr. C, and Mr. D who own buildings with different floor plans. In addition, for example, even if Mr. A moves and resides in a building with a different floor plan, a new floor plan can be obtained by adjusting the correspondence between the target equipment to be used and the room to be installed. You can continue to use it without asking for a picture.

In the above aspect, for example, the one or more room icons include an operation button for displaying an extended operation screen for operating an instruction other than an instruction operable on the operation screen, and the selection of the operation button is detected. If it is determined that the extended operation screen is displayed, the extended operation screen may be displayed on the display.

According to this aspect, the operation screen can be included in the one or more room icons for some instructions to the target device, and the extended operation screen is separately displayed on the display for the remaining instructions. Can do. Therefore, for example, the room icon can include instructions that are frequently used, and the size of the room icon can be made compact. As a result, for example, in a target device having a large number of installed devices such as lighting devices or air conditioners, even when many room icons are displayed, more room icons can be displayed with respect to the limited display area of the display. Become. On the other hand, for example, an instruction with a low usage frequency can be dealt with by separately displaying an extended operation screen for the operation on the display.

A control method according to another aspect of the present invention is a method of controlling an information terminal connected to a network that controls one or more target devices and having a display, wherein the one or more targets are connected to a computer of the information terminal. One or more device type icons indicating devices in units of device types are displayed on the display, and when it is determined that selection of any one of the one or more device type icons is detected, the selection One or more room icons indicating a room in which a target device of a type corresponding to the one device type icon is installed are arranged on the display, and any one of the one or more room icons is displayed. If it is determined that the selection of the device is detected, the selected device type is installed in the room corresponding to the selected one room icon. An operation screen for operating the target device of the type corresponding to the icon is displayed on the display, and the selected one device installed in the room corresponding to the selected one room icon based on the operation on the operation screen A control command for controlling a target device of a type corresponding to the type icon is output to the network.

In the above aspect, first, one or more device type icons indicating the one or more target devices in units of device types are displayed on the display. Next, when it is determined that selection of any one of the one or more device type icons is detected, a target device of a type corresponding to the selected one device type icon is installed. One or more room icons indicating the rooms that are present are arranged on the display. In addition, when selection of any one of the one or more room icons is detected, the selected device type installed in the room corresponding to the selected one room icon An operation screen for operating the target device of the type corresponding to the icon is displayed on the display. That is, by selecting one of the device type icons, the operation screen for operating the target device of the type corresponding to the one device type icon is not displayed, but the one device type icon is displayed. One or more room icons indicating rooms in which corresponding types of target devices are installed are arranged and displayed on the display.

In this aspect, as described above, the operation screen of the individual target device corresponding to the individual device icon is not displayed on the display, but the target device of the type corresponding to the selected one device type icon is displayed. One or more room icons indicating the installed rooms are arranged on the display.

Further, in the above-described other aspect, for example, the one or more room icons may have the same size and the same shape. For example, the one or more room icons may be represented by the same size and the same rectangular shape.

In the other aspect, for example, the one or more room icons are instructions other than instructions operable on the operation screen with respect to a target device of a type corresponding to the selected device type icon. A simple operation screen that can operate instructions with a smaller number of instructions than the number of instructions that can be operated on the screen may be included.

According to this, for example, for the operation for controlling the power supply of the target device of the type corresponding to the selected device type icon, the room icon is displayed without displaying the operation screen separately from the display of the room icon. It becomes possible to operate in the display. In this case, it is possible to easily identify which target device is installed in which room without erroneous operation, and if it is a simple operation, the number of user operations required to operate a desired target device is reduced. It is possible to reduce the number of processing steps in the apparatus necessary for operating a desired target device.

In another aspect, for example, the simple operation screen may include an operation button for controlling the power supply of a target device of a type corresponding to the selected device type icon.

In the above aspect, for example, the one or more target devices may include an air conditioner.

In general, one air conditioner (air conditioner) is usually installed in each room in the house.

Therefore, according to this aspect, when it is determined that the selection of the device type icon corresponding to the air conditioner is detected, the target device of the type of air conditioner is installed instead of displaying the operation screen of the individual air conditioner on the display. One or more room icons indicating rooms are arranged on the display. As a result, it becomes clear which air conditioner in the house is operated, and malfunction can be prevented. This effect is particularly remarkable in an air conditioner that is generally installed in each room in a home.

Also, the air conditioner has many operations specific to air conditioning, such as temperature setting and operation mode setting such as heating mode / cooling mode, as compared with other devices.

Therefore, according to this aspect, the operation screen for a part of instructions for the air conditioner is included in the one or more room icons, and an extended operation screen for the remaining instructions is separately displayed on the display. Thereby, for example, the room icon includes instructions frequently used, and the size of the room icon can be made compact. On the other hand, for example, an instruction with a low use frequency can be dealt with by separately displaying an extended operation screen for the operation on the display. This effect is particularly noticeable in an air conditioner with many unique operations.

In the above aspect, for example, the one or more target devices may include a lighting device.

There are more lighting devices installed in the house than other devices.

Therefore, according to this aspect, device icons representing lighting devices are not individually displayed for each installed lighting device, but device type icons corresponding to target devices of the type lighting device are displayed on the display. . Thereby, an increase in the number of device type icons to be displayed can be suppressed. This effect is particularly noticeable in lighting equipment that is installed in many homes.

In the above aspect, for example, the one or more target devices may include an electronic lock.

In recent years, electronic locks are installed not only at the entrance door, but also at multiple locations within the residential premises, such as a veranda door and a garage door.

Therefore, according to this aspect, when it is determined that the selection of the device type icon corresponding to the electronic lock is detected, the operation screen of the individual electronic lock is not displayed on the display, but the target device of the type electronic lock is installed. One or more room icons indicating a room in the house or a place in a residential premises such as a veranda or a garage are arranged on the display. Thereby, it becomes clear which electronic lock is operated. In addition, for example, when going out or before going to bed, it is possible to simultaneously confirm the locks of a plurality of electronic locks on the same screen.

In the above aspect, for example, the one or more target devices may include a monitoring camera.

In recent years, surveillance cameras are being installed not only at the entrance, but also at multiple locations within a residential premises such as a veranda or a garage.

Therefore, according to this aspect, when it is determined that the selection of the device type icon corresponding to the monitoring camera has been detected, the operation screen of the individual monitoring camera is not displayed on the display, but the target device of the type called the monitoring camera is installed. One or more room icons indicating a room in the house or a place in a residential premises such as a veranda or a garage are arranged on the display. Thereby, it becomes clear which surveillance camera is operated.

(Embodiment)
Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the drawings, the same reference numerals are used for the same components.

In this embodiment, a home controller capable of controlling one or more devices with one unit will be described.

(overall structure)
FIG. 1 is an overall configuration diagram of a home control system to which a home controller according to the present embodiment is applied. As shown in FIG. 1, the home control system includes a home controller 100, a device 200 (an example of a target device), and a server 300.

In the house, a home controller 100 and one or more devices 200 (for example, device A 200 and device B 200) are arranged, and a server 300 is arranged in the cloud center. The home controller 100, the device 200, and the server 300 communicate with each other via a wired or wireless network. For example, the device 200 and the home controller 100 are communicably connected to each other via a wireless or wired home network, and the home controller 100, the device 200, and the server 300 are mutually connected via an external network such as the Internet. It is connected so that it can communicate.

Note that the home controller 100 is not necessarily arranged in the house, and may be arranged outside the house. In this case, the user controls one or more devices 200 from the outside.

As the home controller 100, a portable information terminal such as a smartphone or a tablet terminal is adopted. However, this is only an example, and a button-type portable information terminal such as a mobile phone may be employed as the home controller 100.

FIG. 2 is a diagram showing a main device 200 controlled by the home controller 100. The home controller 100 includes an air conditioner (hereinafter referred to as “air conditioner”) 201, lighting devices 202 and 203, a bath 204, a refrigerator 205, a washing machine 206, a toilet 207, an electric curtain device 208, a camera 209, and an electronic lock. The device 200 such as 20A and the electric shutter device 20B is controlled. Note that a plurality of devices 200 of the same type may be included in the devices 200 controlled by the home controller 100, such as the lighting device 202 and the lighting device 203.

Further, the device 200 such as the air conditioner 201 shown in FIG. 2 is merely an example, and a television receiver (hereinafter referred to as “TV”), a Blu-ray recorder, an audio device, or the like may be employed as the device 200. That is, as the device 200, any device may be employed as long as it is an electric device having a function capable of communicating with the home controller 100. In FIG. 2, an electric device used in a general household is shown as the device 200, but the present embodiment is not limited to this, and an office device used in an office or the like may be adopted. Examples of office equipment include a printer, a personal computer, a scanner, and a copier.

FIG. 3 is a block diagram illustrating configurations of the home controller 100, the device 200, and the server 300. As shown in FIG. 3, the home controller 100 includes a display 101, a touch panel control unit 102, a display control unit 103, a storage unit 104, a device management unit 105, a device control unit 106, and a communication control unit 107.

The display 101 is configured by a touch panel display, for example, and displays a user interface for the user to operate the home controller 100 and the like. The user can input various operations to the home controller 100 by touching the display 101.

When the touch panel control unit 102 recognizes a user operation on the display 101, the touch panel control unit 102 interprets the content of the operation and notifies the other components of the operation content. For example, if an object is displayed at a position on the display 101 tapped by the user, the touch panel control unit 102 determines that the object has been selected by the user. As the object, various GUI parts that accept user operations such as buttons are adopted.

The display control unit 103 generates a GUI (Graphical User Interface) of the home controller 100 and causes the display 101 to display the GUI. The storage unit 104 stores information necessary for the operation of the home controller 100 such as a device list managed by the device management unit 105.

The device management unit 105 manages the device 200 to be controlled using the device list stored in the storage unit 104. In addition, when the device 200 is connected to the home network, the device management unit 105 detects the device 200. Furthermore, the device management unit 105 acquires home information 1300 described later from the server 300 and stores the acquired home information 1300 in the storage unit 104 for management. The device control unit 106 issues a control command to the device 200. The communication control unit 107 controls communication between the home controller 100 and the device 200 and communication between the home controller 100 and the server 300. In addition, the communication control unit 107 receives various data transmission requests from other blocks, transmits them to the device 200 or the server 300, receives data transmitted from the device 200 or the server 300, and sets the corresponding blocks. hand over.

Note that the display 101 may be a normal display instead of a touch panel display. In this case, the user may use an external input device such as a mouse (not shown) to move the pointer displayed on the display 101, click a desired object, and input an object selection instruction. That is, in the present embodiment, a series of operations performed by the user touching the display 101 can be replaced with operations for moving or clicking the pointer using an external input device such as a mouse.

3, the device 200 includes a control execution unit 211, a state management unit 212, a storage unit 214, and a communication control unit 217. The control execution unit 211 receives a control command from the home controller 100 or the server 300, and controls the device 200 according to the received control command. The control content of the device 200 by the control execution unit 211 varies depending on the type of the device 200. For example, if the device 200 is a lighting device, the control execution unit 211 turns the lighting device on and off. Further, the control execution unit 211 transmits the execution result of the control command and the state of the device 200 to the home controller 100 and the server 300.

The state management unit 212 manages the state of the device 200. The management content of the device 200 by the state management unit 212 differs depending on the type of the device 200. For example, if the device 200 is a lighting device, the state management unit 212 manages whether the lighting device is currently in an on state or an off state. The storage unit 214 stores information related to the state of the device 200 managed by the state management unit 212. The communication control unit 217 controls communication between the device 200 and the home controller 100 and communication between the device 200 and the server 300. In addition, the communication control unit 217 receives various data transmission requests from other blocks and transmits them to the home controller 100 or the server 300, and receives data transmitted from the home controller 100 or the server 300. Pass to block.

3, the server 300 includes a home information management unit 301, a device control unit 302, a storage unit 304, and a communication control unit 307. The home information management unit 301 manages home information 1300 described later for each house or each user account. In addition, the home information management unit 301 transmits home information 1300 to the home controller 100 in response to a request from the home controller 100. Further, the home information management unit 301 acquires log information related to the usage history of the device 200 and information related to the state of the device 200 from the device 200, and stores and manages the acquired information in the storage unit 304.

The device control unit 302 transmits a control command to the device 200 in response to a request from the home controller 100. The accumulation unit 304 accumulates information necessary for the operation of the server 300 such as home information 1300 managed by the home information management unit 301 and information related to the state of the device 200. Similar to the communication control unit 107, the communication control unit 307 controls communication between the server 300 and the home controller 100 and communication between the server 300 and the device 200. In addition, the communication control unit 307 receives various data transmission requests from other blocks, transmits the requests to the home controller 100 or the device 200, and receives data transmitted from the home controller 100 or the device 200. Pass to block.

FIG. 4 is a diagram illustrating a configuration example of an implementation form of the home controller 100. As shown in FIG. 4, the home controller 100 includes an application 401, an OS (Operating System) 402, a memory 403, and other hardware not shown.

Application 401 is application software for causing the portable information terminal to function as the home controller 100, and is executed by the processor of the home controller 100. The home controller 100 may implement the application 401 by reading the application 401 from a computer-readable recording medium, or may implement the application 401 by downloading from a network. The OS 402 is basic software of the portable information terminal and is executed by the processor of the home controller 100. The memory 403 is configured by a storage device such as a RAM and a ROM provided in the home controller 100 and stores a data group included in the application 401. When the processor of the home controller 100 executes the application 401, the functions of the touch panel control unit 102, the display control unit 103, the storage unit 104, the device management unit 105, the device control unit 106, and the communication control unit 107 illustrated in FIG. Realized. Further, the memory 403 functions as the storage unit 104 when the processor of the home controller 100 executes the application 401.

However, in this embodiment, the home controller 100 may be implemented solely by the application 401, may be implemented by the application 401 and the OS 402, or may be implemented by the application 401, the OS 402, and the memory 403. Alternatively, the application 401, the OS 402, the memory 403, and other hardware (not shown) may be implemented. In any of the mounting forms, it is possible to realize the home controller 100 of the present embodiment. In the present embodiment, a computer is constituted by, for example, a processor and a storage device constituting the portable information terminal. As the processor, any one of CPU, FPGA, and ASIC, or a combination of two or more thereof is employed. As the storage device, for example, any one of ROM, RAM, and hard disk, or a combination of two or more thereof is employed.

FIG. 5 is a diagram showing a basic screen configuration of the home controller 100. As shown in FIG. 5, the basic screen of the home controller 100 displayed on the display 101 includes a device type icon 515 and a page feed button 506.

The device type icon 515 is an icon representing the type of the device 200. A device type icon 515 is prepared for each type of device 200. The device type icon 515 includes a device icon 501 that schematically shows a device that representatively represents the type of the device 200. In the device type icon 515, the name or abbreviation of the device is described.

In the present embodiment, the display control unit 103 arranges the device type icons 515 side by side on the upper end of the display 101. In FIG. 5, in order from the left, the display control unit 103 displays a device type icon 515 representing a television, a device type icon 515 representing an air conditioner, a device type icon 515 representing a lighting device, and a device type icon representing an electric shutter device. 515 is displayed on the display 101.

FIG. 6 is a diagram showing a room icon 502 displayed on the display 101 of the home controller 100. When the user selects the device type icon 515 on the basic screen shown in FIG. 5, the touch panel control unit 102 detects the selection. Then, the display control unit 103 displays on the display 101 a room icon 502 indicating a room in which the type of device 200 corresponding to the selected device type icon 515 is installed. FIG. 6 shows an example in which the air conditioner device type icon 515 is selected by the user on the basic screen shown in FIG. As shown in FIG. 6, the display control unit 103 displays four room icons 502 on the display 101 such as a bedroom, a child room, a living room (living room), and a dining room (dining room) in which an air conditioner is installed.

As shown in FIG. 6, the display control unit 103 displays the device type icon 515 selected by the user in a display mode different from the device type icon 515 that has not been selected. For example, the display control unit 103 may display the selected device type icon 515 in a different color from the unselected device type icon 515 or display it brighter than the unselected device type icon 515. Alternatively, it may be displayed with a darker density than the device type icon 515 that has not been selected, or may be displayed blinking at a constant cycle.

As shown in FIG. 6, the room icon 502 is represented by blocks of the same size. In the room icon 502, the name or abbreviation of the room is described. In addition, floor numbers are displayed in the vertical direction, and room icons 502 indicating the rooms constituting the same floor are arranged in a horizontal row.

In the example of FIG. 6, since the house is composed of two floors of the first floor to the second floor, a room icon 502 indicating a room constituting the second floor is arranged in the first line, and the second line is arranged. A room icon 502 indicating a room constituting the first floor is arranged. In addition, floor numbers such as 1F and 2F are shown at the left end of each row. In the example of FIG. 33 to be described later, since the house is composed of three floors of the first floor to the third floor, a room icon 502 indicating a room constituting the third floor is arranged in the first row, and 2 A room icon 502 indicating a room constituting the second floor is arranged on the line, and a room icon 502 indicating a room constituting the first floor is arranged on the third line. In addition, floor numbers such as 1F, 2F, and 3F are shown at the left end of each row.

Thus, in the present embodiment, the room icon 502 is represented by blocks of the same size. For this reason, the room icon 502 can be applied in common to buildings with different floor plans. Further, even when the user moves and newly resides in a building with a different floor plan, the correspondence between the device 200 to be used and the room to be installed is adjusted as shown in FIG. The room icon 502 can be continuously used as it is.

The room icon 502 includes an operation screen 516 for operating the device 200. The operation screen 516 includes a simple control button 503 and a detailed setting button (an example of an operation button) 504. The simple control button 503 is for controlling on / off of the power supply of the device 200, and includes an on button and an off button.

The display control unit 103 displays the on button or the off button in different colors according to the status 1709 of the device list 1700 (FIG. 17 described later) managed by the device management unit 105. FIG. 6 shows that the air conditioners in the bedroom, living room, and dining room are operating, and the air conditioner in the child room is stopped. Thereby, the user can easily know the status of the device 200 (air conditioner in FIG. 6) in each room.

In the state where the room icon 502 is displayed as shown in FIG. 6, when the user selects the simple control button 503 of the one room icon 502, the touch panel control unit 102 detects the selection. Then, the device control unit 106 generates a control command for controlling on / off of the air conditioner installed in the room corresponding to the room icon 502 including the selected simple control button 503. The device control unit 106 transmits the generated control command to the air conditioner via the communication control unit 107 and the network. Further, the display control unit 103 changes the display state of the on button and the off button according to the selection of the simple control button 503 by the user.

In FIG. 6, for example, when the user selects the off button of the simple control button 503 in the bedroom, the touch panel control unit 102 detects the selection. Then, the apparatus control part 106 produces | generates the control command which stops the power supply of the air conditioner 201 of a bedroom. The device control unit 106 transmits the generated control command to the air conditioner 201 in the bedroom via the communication control unit 107 and the network. In addition, the display control unit 103 returns the on button of the simple control button 503 of the bedroom room icon 502 to the default color and changes the color of the off button.

Further, when the user selects the detailed setting button 504 of one room icon 502 in a state where the room icon 502 is displayed as shown in FIG. 6, the touch panel control unit 102 detects the selection. Then, the display control unit 103 displays the room screen 520 shown in FIG. 7 on the display 101 instead of or overlapping the room icon 502.

FIG. 7 is a diagram showing a room screen 520 displayed on the display 101 of the home controller 100. When the user selects the detailed setting button 504 of one room icon 502 in a state where the room icon 502 is displayed as shown in FIG. 6, the touch panel control unit 102 detects the selection. Then, the display control unit 103 displays the room screen 520 of the room corresponding to the selected room icon 502 on the display 101. For example, in FIG. 6, when the user selects a detail setting button 504 of a room icon 502 representing a living room, the touch panel control unit 102 detects the selection. Then, the display control unit 103 displays a room screen 520 in the living room on the display 101 as shown in FIG.

As shown in FIG. 7, the room screen 520 includes a detailed control screen (an example of an extended operation screen) 517 and a return button 507. The detail control screen 517 includes a detail control button 505 for controlling the state of the device 200 in detail. In FIG. 7, since the device 200 is an air conditioner, the detailed control screen 517 has a detailed control button 505 for setting the temperature, a detailed control button 505 for setting the air direction, and a detailed control for setting the air volume. Button 505.

Also, the display control unit 103 controls the display state of the detailed control button 505 according to the status of the device 200 managed by the device management unit 105. FIG. 7 shows that the temperature of the air conditioner in the living room is set to “28 ° C.”, the wind direction is set to “down”, and the air volume is set to “medium”. Thereby, the user can easily know the current detailed status of the device 200 (the air conditioner in FIG. 7) in each room.

When the user selects the detailed control button 505 in a state where the room screen 520 is displayed as shown in FIG. 7, the touch panel control unit 102 detects the selection. Then, the device control unit 106 generates a control command corresponding to the detailed control button 505 selected by the user. In addition, the device control unit 106 transmits the generated control command to the device 200 via the communication control unit 107 and the network. The display control unit 103 changes the display state of the detail control button 505 according to the selection of the detail control button 505 by the user.

In FIG. 7, for example, when the user selects a button with an upward arrow of the temperature setting detail control button 505, the touch panel control unit 102 detects the selection. Then, the device control unit 106 generates a control command for increasing the set temperature by 1 ° C. The device control unit 106 transmits the generated control command to the air conditioner in the living room via the communication control unit 107 and the network. The display control unit 103 changes the display temperature of the detailed temperature setting control button 505 to 29 ° C.

Further, in FIG. 7, for example, when the user selects the “up” button of the detailed control button 505 for setting the wind direction, the touch panel control unit 102 detects the selection. Then, the device control unit 106 generates a control command for setting the wind direction upward. The device control unit 106 transmits the generated control command to the air conditioner in the living room via the communication control unit 107 and the network. The display control unit 103 returns the “down” button of the detailed wind control button 505 to the default color and changes the color of the “up” button.

Furthermore, in FIG. 7, for example, when the user selects the “weak” button of the detailed control button 505 for air volume setting, the touch panel control unit 102 detects the selection. Then, the device control unit 106 generates a control command for reducing the air volume. The device control unit 106 transmits the generated control command to the air conditioner in the living room via the communication control unit 107 and the network. The display control unit 103 returns the “middle” button of the detailed control button 505 for air volume setting to the default color, and changes the color of the “weak” button.

Further, in FIG. 7, for example, when the user selects the return button 507, the touch panel control unit 102 detects the selection. Then, the display control unit 103 returns the display state of the display 101 and displays the room icon 502 on the display 101 as shown in FIG.

FIG. 8 is a diagram illustrating another example of the room icon 502 displayed on the display 101 of the home controller 100. FIG. 8 shows an example in which the device type icon 515 of the electric shutter device is selected by the user on the basic screen shown in FIG. 5, for example. As shown in FIG. 8, the display control unit 103 displays two room icons 502, that is, a bedroom and a living room (living room) in which an electric shutter device that opens and closes a shutter with electricity is installed on the display 101. Further, the display control unit 103 displays the device type icon 515 of the electric shutter device in a different display mode.

The simple control button 503 included in the operation screen 516 of the room icon 502 shown in FIG. 8 is for opening and closing the shutter because the device 200 is an electric shutter device, and includes an open button and a close button. In FIG. 8, the display control unit 103 indicates that the shutter in the bedroom is closed and the shutter in the living room is open.

In FIG. 8, for example, when the user selects the open button of the simple control button 503 in the bedroom, the touch panel control unit 102 detects the selection. Then, the apparatus control part 106 produces | generates the control command which opens the shutter of a bedroom. The device control unit 106 transmits the generated control command to the electric shutter device 20B in the bedroom via the communication control unit 107 and the network. Further, the display control unit 103 returns the close button of the simple control button 503 of the bedroom room icon 502 to the default color, and changes the color of the open button.

FIG. 9 is a diagram showing still another example of the room icon 502 displayed on the display 101 of the home controller 100. When the user selects the page feed button 506 on the basic screen shown in FIG. 5, the touch panel control unit 102 detects the selection. Then, the display control unit 103 scrolls the device type icon 515 displayed side by side on the display 101 in the right direction.

In FIG. 9, in order from the left, the display control unit 103 displays a device type icon 515 representing an air conditioner, a device type icon 515 representing a lighting device, a device type icon 515 representing an electric shutter device, and a device type icon representing a camera. 515 is displayed on the display 101. That is, the device type icon 515 representing the television is not displayed on the display 101, and in FIG. 9, the device type icon 515 is scrolled by one in the right direction with respect to the basic screen shown in FIG. Thus, the user can control the other device 200 by selecting the page feed button 506.

Also, as shown in FIG. 9, the display control unit 103 newly displays a left-facing page feed button 506 on the left side of the device type icons 515 arranged side by side. In FIG. 6, when the left page feed button 506 is selected by the user, the display state of the device type icon 515 returns to the display state of FIG.

FIG. 9 shows an example in which the device type icon 515 representing the camera is selected by the user after the device type icon 515 is scrolled by one in the right direction on the basic screen shown in FIG. As shown in FIG. 9, the display control unit 103 displays three room icons 502, which are a living room (living room) where the camera is installed, a front door, and a doorway on the display 101. Further, the display control unit 103 displays the device type icon 515 of the camera in a different display mode.

The simple control button 503 included in the operation screen 516 of the room icon 502 shown in FIG. 9 includes a “view video” button because the device 200 is the camera 209. In FIG. 9, for example, when the user selects the “view video” button of the entrance simple control button 503, the touch panel control unit 102 detects the selection. Then, the device control unit 106 generates a control command for operating the entrance camera. The device control unit 106 transmits the generated control command to the entrance camera 209 via the communication control unit 107 and the network.

FIG. 10 is a diagram showing an example different from FIG. 6 of the display screen of the room icon 502. Unlike the case of FIG. 6, the floor number is not displayed on the display 101 of FIG. Such a display screen of the room icon 502 may be used.

FIG. 11 is a diagram showing a transition example of the display screen of the display 101 in the present embodiment. The upper left diagram in FIG. 11 shows the display screen shown in FIG. 5, the upper right diagram in FIG. 11 shows the display screen shown in FIG. 6, and the lower right diagram in FIG. 11 shows the display screen shown in FIG. .

In the basic screen shown in the upper left diagram of FIG. 11, the user selects the device type icon 515 of the device 200 (here, the air conditioner 201) that the user wants to control, and the touch panel control unit 102 detects the selection. Then, the display control unit 103 displays a room icon 502 indicating the room where the selected device type icon 515 is installed below the device type icon 515 of the display 101 as shown in the upper right diagram of FIG. To do. As a result, the display state of the basic screen changes to the display state of the room icon 502.

Next, in the display state of the room icon 502 shown in the upper right diagram of FIG. 11, the user taps the detailed setting button 504 included in the operation screen 516 of any one of the room icons 502 (here, the room icon 502 in the living room). The touch panel control unit 102 detects the tap. Then, as shown in the lower right diagram of FIG. 11, the display control unit 103 deletes the room icon 502 and displays a room screen 520 in the living room.

Next, in the display state of the room screen 520 in the living room shown in the lower right diagram of FIG. 11, the user taps the return button 507, and the touch panel control unit 102 detects the tap. Then, as shown in the upper right diagram of FIG. 11, the display control unit 103 returns to the display state of the room icon 502.

FIG. 12 is a diagram showing another transition example of the display screen of the display 101 in the present embodiment. The upper left diagram in FIG. 12 shows the display screen shown in FIG. 5, the upper right diagram in FIG. 12 shows the display screen shown in FIG. 6, and the lower right diagram in FIG. 11 shows the display screen shown in FIG. .

The upper left diagram and the upper right diagram in FIG. 12 are the same as the upper left diagram and the upper right diagram in FIG.

In a state where the air conditioner device type icon 515 shown in the upper right diagram of FIG. 12 is selected, the user taps the device type icon 515 of another device 200 (in this case, the electric shutter device 20B), and the touch panel controls the tap. The unit 102 detects. Then, as shown in the lower right diagram in FIG. 12, the display control unit 103 displays a room icon 502 indicating the room in which the electric shutter device 20 </ b> B is installed on the display 101.

Next, in the display state of the room icon 502 shown in the lower right diagram of FIG. 12, the user taps another device 200 (here, the air conditioner 201), and the touch panel control unit 102 detects the tap. Then, as shown in the upper right diagram of FIG. 12, the display control unit 103 returns to the display state of the room icon 502 indicating the room where the air conditioner 201 is installed.

As shown in FIGS. 6, 8, and 9, in the present embodiment, the simple control buttons 503 include buttons appropriate for the device 200. That is, the simple control button 503 includes an on button and an off button in the air conditioner 201 illustrated in FIG. 6, and includes an open button and a close button in the electric shutter device 20B illustrated in FIG. 8, and the camera illustrated in FIG. 209 includes a “view video” button. For example, when the device 200 is the electronic lock 20A, the simple control button 503 may include an open button and a close button, as with the electric shutter device 20B.

In the present embodiment, the device type icon 515 may include not only the same specific device but also a device in the same field as the device type. For example, the camera represented by the device type icon 515 shown in FIG. 9 may not be the same camera. The camera at the entrance and the entrance may be a security camera for crime prevention, for example. The entrance camera may be a door phone, for example. Further, the device type icon 515 representing the lighting device 202 may include not only the lighting device in the house but also a lighting device outside the entrance (eaves) or a gate lamp.

FIG. 13 is a diagram showing the configuration of the home information 1300. The home information 1300 is managed by the server 300 for each house. The home controller 100 controls display of the basic screen, the room icon 502, and the like based on the home information 1300 acquired from the server 300. As illustrated in FIG. 13, the home information 1300 includes room information 1400 and a device list 1600 managed by the server 300.

FIG. 14 is a diagram showing a configuration of room information 1400 managed by the server 300. As illustrated in FIG. 14, the room information 1400 includes a room ID 1401, a room type 1402, a hierarchy 1403, and a power consumption amount 1404. Room ID 1401 is an identifier for identifying a room. The room type 1402 indicates the type of room. A hierarchy 1403 indicates a floor on which a room is provided. The power consumption amount 1404 indicates the total power consumption amount of the devices 200 installed in the room. For example, FIG. 14 shows that the total power consumption of all the devices 200 including the air conditioner 201 and the lighting device 202 installed in the living room (living room) is 812 kwh.

FIG. 15 is a diagram showing a configuration of room information 1500 managed by the home controller 100. As illustrated in FIG. 15, the room information 1500 includes a room ID 1501, a room type 1502, a hierarchy 1503, and a power consumption 1504, similar to the room information 1400. The home controller 100 acquires room information 1400 from the server 300 and manages the acquired room information 1400 as room information 1500. The home controller 100 may acquire the power consumption for each room from the distribution board. Alternatively, the home controller 100 may obtain the power consumption for each room by integrating the power consumption for each device.

FIG. 16 is a diagram showing a configuration of a device list 1600 managed by the server 300. As illustrated in FIG. 16, the device list 1600 includes a device ID 1601, a device type 1602, a model number 1603, an arrangement 1604, capability information 1605, a control command transmission destination 1606, a power consumption 1607, and a status 1608.

The device ID 1601 is an identifier of the device 200. The device type 1602 indicates the type of the device 200. A model number 1603 indicates the model number of the device 200. An arrangement 1604 indicates a room in which the device 200 is installed.

The capability information 1605 indicates the contents that can control the device 200 and the state that can be acquired from the device 200. For example, an air conditioner with a device ID of A can control temperature, wind direction, and air volume. A control command transmission destination 1606 indicates a transmission destination of a control command for controlling the device 200. For example, for an air conditioner with a device ID of A, the control command transmission destination 1606 is a device, so the control command is transmitted directly from the home controller 100 to the device 200. The control command is a command for operating the device 200 and confirming the state of the device 200.

The power consumption 1607 indicates the power consumption of the device 200. For example, FIG. 16 shows that the power consumption of device ID A is 204 kwh. A status 1608 indicates the current state of the device 200. For example, FIG. 16 shows that the set temperature of the air conditioner with device ID A is 27 ° C., and the electric shutter device with device ID E is closed.

Note that the device list 1600 managed by the server from the home information 1300 may be omitted. In this case, the home controller 100 may acquire information corresponding to the device type 1602, the model number 1603, and the capability information 1605 described in the device list 1600 managed by the server directly from the device 200.

FIG. 17 is a diagram showing a configuration of a device list 1700 managed by the home controller 100. Based on the information in the device list 1700, the home controller 100 arranges the device type icon 515 on the basic screen and controls the device 200.

The device list 1700 includes a device ID 1701, a device type 1702, a model number 1703, an arrangement 1704, capability information 1705, a control command transmission destination 1706, an IP address 1707, a power consumption 1708, and a status 1709. Device ID 1701 to control command transmission destination 1706, power consumption 1708, and status 1709 are the same as the contents of the same names in FIG.

In the device list 1700, the device management unit 105 transmits the device list 1600 from the server 300 regarding the contents of the device type 1702, model number 1703, arrangement 1704, capability information 1705, control command transmission destination 1706, power consumption 1708, and status 1709. Can be obtained. The IP address 1707 is acquired from the device 200 by the device management unit 105. However, when the device type 1702, model number 1703, capability information 1705, control command transmission destination 1706, power consumption 1708, and status 1709 can be acquired directly from the device 200, the device management unit 105 prioritizes the contents. May be.

Note that the control command transmission destination 1706 may adopt the contents determined in advance by the home controller system without being acquired from the server 300 or the device 200, or may be in the state of the network to which the home controller 100 is connected. It may be automatically determined based on the setting or may be set by the user. Moreover, the home controller 100 may acquire the power consumption for every apparatus from a distribution board. Alternatively, the home controller 100 may directly acquire the power consumption for each device from the device 200.

14 and 15, in this embodiment, room information is managed by both the home controller 100 and the server 300. Alternatively, the room information may be managed by only one of the home controller 100 and the server 300, for example, the server 300, and the home controller 100, for example, may acquire the room information from the server 300 when necessary.

Similarly, as shown in FIGS. 16 and 17, in the present embodiment, the device list is managed by both the home controller 100 and the server 300. Alternatively, the device list may be managed by only one of the home controller 100 and the server 300, for example, the server 300, and the home controller 100 may acquire the device list from the server 300 when necessary. In this case, the server 300 may also manage the IP address 1707 of the device list 1700 managed by the home controller 100.

Next, the flow until the home controller 100 controls the device 200 will be described with reference to the drawings.

FIG. 18 is a sequence diagram showing a flow of processing in which the home controller 100 acquires the home information 1300 from the server 300. The home controller 100 acquires the home information 1300 from the server 300 at an arbitrary timing such as the first use or activation. The home controller 100 updates the display content on the display 101 such as generating the basic screen shown in FIG. 5 based on the acquired home information 1300.

First, the device management unit 105 of the home controller 100 transmits a home information request to the server 300 (S3201). Here, the home information request includes at least a home controller ID indicating a user who uses the home controller 100 or a house. Receiving the home information request, the home information management unit 301 of the server 300 searches the storage unit 304 for the home information 1300 corresponding to the home controller ID (S3202) and transmits it to the home controller 100 (S3203). The device management unit 105 of the home controller 100 stores the home information 1300 received from the server 300 in the storage unit 104, and the display control unit 103 generates a basic screen based on the home information 1300 and displays it on the display 101. The display screen on the display 101 is updated (S3204).

The display screen on the display 101 is updated by, for example, updating the room icon 502 due to a change in floor plan due to reform or the like, updating the power consumption, registering the newly installed device 200, updating the room icon 502, Including 200 status updates. This also applies to the update of the display screen in other sequence diagrams to be described later.

FIG. 19 is a sequence diagram showing a flow of processing in which the home controller 100 detects the device 200 on the network after the home controller 100 is connected to the network. In FIG. 19, a description will be given assuming that the device A 200 with the device ID A and the device B 200 with the device ID B shown in FIG. 17 are connected on the network.

When the home controller 100 is connected to the network when the home controller 100 is used for the first time or powered on (S3301), the device management unit 105 of the home controller 100 broadcasts a device search request to all devices 200 on the network. (S3302). The device A 200 that has received the device search request returns a device search response to the home controller 100 (S3303). The home controller 100 that has received the device search response acquires device information from the device A 200 (S3304), and updates the display screen (S3305).

Similarly, the device B 200 that has received the device search request returns a device search response to the home controller 100 (S3306). The home controller 100 that has received the device search response acquires device information from the device B 200 (S3307), and updates the display screen (S3308). Here, the device information is information representing the device type, model number, capability information, and the like of the device 200. Based on this device information, the device management unit 105 of the home controller 100 generates a device list 1700 (see FIG. 17).

FIG. 20 is a sequence diagram showing a flow of processing in which the home controller 100 detects the device 200 on the network when the device 200 is connected to the network. When the device A200 is connected to the network at the first use or power-on (S3401), a network connection notification is broadcast to all home controllers 100 on the network (S3402). In the home controller 100 that has received the network connection notification, the device management unit 105 acquires device information from the device A 200 (S3403), and the display control unit 103 updates the display screen (S3404). The processing when the device B 200 is connected to the network is the same as that of the device A 200 (S3405 to S3408).

FIG. 21 is a flowchart showing a flow of processing in which the home controller 100 controls the device 200 when the basic screen or the room icon is displayed on the display 101 in the embodiment of the present invention.

First, the touch panel control unit 102 detects the start of contact of the contact object with the display 101 by the user on the basic screen or the room icon display screen (S3501). Next, the touch panel control unit 102 determines whether the user has selected the device type icon 515 (S3502).

If the user has selected the device type icon 515 (YES in S3502), the display control unit 103 acquires all the device information of the device 200 whose device type matches the selected device type icon 515 (S3503). For example, when the user selects the device type icon 515 of the air conditioner, the display control unit 103 acquires the information on the air conditioner as the device information of the device type 1702 from the device list 1700 (FIG. 17).

Next, the display control unit 103 acquires all the room information included in the acquired device information (S3504). This room information is information of the arrangement 1704 of the device list 1700. Next, the display control unit 103 displays a room icon 502 indicating a room in which the type of device 200 corresponding to the selected device type icon 515 is installed on the display 101 (S3505). Next, the display control unit 103 displays an operation screen 516 including a simple control button 503 corresponding to the selected device type icon 515 in the room icon 502 (S3506), and this process ends.

On the other hand, if the user does not select the device type icon 515 in S3502 (NO in S3502), the touch panel control unit 102 determines whether or not the user has selected the simple control button 503 (S3507). If the user has selected the simple control button 503 (YES in S3507), the device control unit 106 generates a control command corresponding to the control of the selected simple control button 503 (S3508). Next, the device control unit 106 executes a control command transmission flow (S3509) described later with reference to FIG.

On the other hand, if the user has not selected the simple control button 503 in S3507 (NO in S3507), the touch panel control unit 102 determines whether or not the user has selected the detail setting button 504 (S3510). If the user has selected the detailed setting button 504 (YES in S3510), the display control unit 103 displays the detailed control screen 517 on the display 101 (S3511), and this process ends. On the other hand, if the user has not selected the detailed setting button 504 in S3510 (NO in S3510), this process ends.

FIG. 22 is a flowchart showing a flow of processing in which the home controller 100 controls the device 200 when the detailed control screen is displayed on the display 101 in the embodiment of the present invention.

First, the touch panel control unit 102 detects the start of contact of the contact object with the display 101 by the user on the detailed control screen (S3601). Subsequent S3602 to S3606 are the same as S3502 to S3506 in FIG. If the user does not select the device type icon 515 in S3602 (NO in S3602), the touch panel control unit 102 determines whether the user has selected the detail control button 505 (S3607). If the user has selected the detailed control button 505 (YES in S3607), the device control unit 106 generates a control command corresponding to the control of the selected detailed control button 505 (S3608). Next, the device control unit 106 executes a control command transmission flow (S3609) described later with reference to FIG.

On the other hand, if the user has not selected the detailed control button 505 in S3607 (NO in S3607), the touch panel control unit 102 determines whether the user has selected the return button 507 (S3610). If the user has selected the return button 507 (YES in S3610), the display control unit 103 displays the original room icon 502 on the display 101 (S3611), and the process ends. On the other hand, if the user has not selected the return button 507 in S3610 (NO in S3610), the process ends.

FIG. 23 is a flowchart showing details of the control command transmission flow executed in S3509 in FIG. 21 and S3609 in FIG. First, the device control unit 106 determines whether or not the home controller 100 is connected to the home network (S3701). If the home controller 100 is connected to the home network (YES in S3701), the control command transmission of the device list 1700 is transmitted. The transmission destination of the control command is checked according to the contents of the destination 1706 (S3702). Here, the home network is a network in the user's home. Therefore, if the user is operating the home controller 100 from the outside, NO is determined in S3701, and if the user is operating the home controller 100 at home, YES is determined in S3701.

In S3702, if the transmission destination of the control command is “device”, the device control unit 106 transmits the control command to the corresponding device 200 (S3703). On the other hand, in S3702, if the transmission destination of the control command is “server”, the device control unit 106 transmits the control command to the server 300 (S3704).

For example, in the device list 1700, since the control command transmission destination 1706 of the air conditioner is “device”, the device control unit 106 transmits the control command to the air conditioner. Also, if it is determined in S3701 that the home controller 100 is not connected to the home network (NO in S3701), the process of S3704 is performed.

In S3705, the device control unit 106 receives a control result from the device 200. Next, the device control unit 106 advances the processing to S3707 when transmission of control commands to all the devices 200 that are operated simultaneously has been completed (YES in S3706). On the other hand, if the transmission of the control command has not been completed for all of the devices 200 operated simultaneously (NO in S3706), the device control unit 106 returns the process to S3702 and repeats the processes after S3702.

For example, when two lighting devices are installed in the same room and the two lighting devices are set to be operated at the same time, the device control unit 106 transmits a control command to each of the two lighting devices. To do. Note that the device 200 that is not operated at the same time as the other devices 200 is not determined as NO in S3706.

Next, the display control unit 103 updates the screen displayed on the display 101 (S3707). For example, if the set temperature of the air conditioner is changed, the temperature display is blinked, for example, until the set temperature of the air conditioner is changed by the control command. When the set temperature of the air conditioner is changed by the control command, the detailed control screen 517 is updated so that the blinking of the temperature display is terminated. For example, when the air conditioner in the bedroom is turned off, the display control unit 103 returns the on button of the simple control button 503 of the bedroom room icon 502 shown in FIG. 6 to the default color and changes the color of the off button. To do.

FIG. 24 is a sequence diagram showing a flow of processing in which the home controller 100 directly controls the device 200. First, the touch panel control unit 102 of the home controller 100 detects a user operation on the simple control button 503 or the detailed control screen 517 (S3801). Next, the device control unit 106 of the home controller 100 generates a control command corresponding to the user's operation and transmits it to the device 200 (S3802).

The device 200 that has received the control command executes the control command (S3803), and transmits the control result to the home controller 100 (S3804). The display control unit 103 of the home controller 100 that has received the control result updates the display screen according to the control result (S3805).

FIG. 25 is a sequence diagram showing a flow of processing in which the home controller 100 controls the device 200 via the server 300. First, the touch panel control unit 102 of the home controller 100 detects a user operation on the simple control button 503 or the detailed control screen 517 (S3901). Next, the device control unit 106 of the home controller 100 generates a control command corresponding to the user's operation and transmits it to the server 300 (S3902).

The server 300 that has received the control command transmits the corresponding control command to the device 200 (S3903). The device 200 that has received the control command executes the control command (S3904), and transmits the control result to the server 300 (S3905). The server 300 that has received the control result transmits the control result to the home controller 100 (S3906). The display control unit 103 of the home controller 100 that has received the control result updates the display screen according to the control result (S3907).

FIG. 26 is a sequence diagram showing a flow of processing in which the home controller 100 confirms the device state of the device 200 via the server 300. First, the device 200 transmits the current device state to the server 300 (S4001). Here, the device 200 transmits the device state to the server 300 when the power is turned on, when the power is turned off, when the device state changes, or periodically, and causes the server 300 to store the device state. Note that the process of S4001 may be executed asynchronously with the processes of S4002 to S4006.

Next, the touch panel control unit 102 of the home controller 100 detects a user operation on the simple control button 503 or the detailed control screen 517 (S4002). Next, the device control unit 106 of the home controller 100 generates a control command corresponding to the user's operation and transmits it to the server 300 (S4003). Here, a control command for confirming the device state of the device 200 is generated.

The server 300 that has received the control command searches the current device state of the corresponding device 200 (S4004), and transmits the device state of the corresponding device 200 to the home controller 100 as a control result (S4005). The display control unit 103 of the home controller 100 that has received the control result updates the display screen according to the control result (S4006). For example, if the operation screen 516 of the room icon 502 is displayed on the display 101, the display content of the simple control button 503 on the operation screen 516 is updated according to the control result.

FIG. 27 is a sequence diagram showing a flow of processing in which the home controller 100 directly controls the devices 200 when the home controller 100 controls a plurality of devices 200 with a single operation. Here, a case where the home controller 100 controls the device A 200 and the device B 200 will be described as an example.

First, the touch panel control unit 102 of the home controller 100 detects a user operation on the simple control button 503 on the operation screen 516 (S4101). Next, the device control unit 106 of the home controller 100 generates a control command corresponding to the user's operation and transmits it to the device A 200 (S4102).

The device A200 that has received the control command executes the control command (S4103) and transmits the control result to the home controller 100 (S4104).

Next, the device control unit 106 of the home controller 100 transmits the same control command as the control command transmitted to the device A 200 to the device B 200 (S4105). The device B 200 that has received the control command executes the control command (S4106), and transmits the control result to the home controller 100 (S4107).

The display control unit 103 of the home controller 100 that has received the control result updates the display screen according to the control result (S4108). In this case, for example, if the operation screen 516 of the room icons 502 of the devices A200 and B200 is displayed on the display 101, the display content of the simple control button 503 of the operation screen 516 of the devices A200 and B200 is updated according to the control result. The

FIG. 28 is a sequence diagram showing a flow of processing in which the home controller 100 controls the devices 200 via the server 300 when the home controller 100 controls a plurality of devices 200 with a single operation. Here, a case where the home controller 100 controls the device A 200 and the device B 200 will be described as an example. In addition, it is assumed that the devices A 200 and B 200 are installed in one room and controlled by the operation screen 516 of one room icon 502.

First, the touch panel control unit 102 of the home controller 100 detects a user operation on the simple control button 503 on the operation screen 516 (S4201).

Next, the device control unit 106 of the home controller 100 generates a control command for the device A 200 according to the user's operation and transmits it to the server 300 (S4202).

The server 300 that has received the control command of the device A200 transmits the control command to the device A200 (S4203). The device A 200 that has received the control command executes the control command (S4204) and transmits the control result to the server 300 (S4205). The server 300 that has received the control result transmits the control result to the home controller 100 (S4206).

Similarly, the device control unit 106 of the home controller 100 generates a control command for the device B 200 according to the user's operation and transmits it to the server 300 (S4207).

The server 300 that has received the control command transmits the control command to the device B 200 (S4208). The device B 200 that has received the control command executes the control command (S4209) and transmits the control result to the server 300 (S4210). The server 300 that has received the control result transmits the control result to the home controller 100 (S4211).

Then, the display control unit 103 of the home controller 100 updates the display screen according to the control result (S4212).

FIG. 29 is a sequence diagram showing a flow of processing in which the home controller 100 controls the devices 200 via the server 300 when the home controller 100 controls a plurality of devices 200 with a single operation. Here, a case where the home controller 100 controls the device A 200 and the device B 200 will be described as an example. In addition, it is assumed that the devices A 200 and B 200 are installed in one room and controlled by the operation screen 516 of one room icon 502.

First, the touch panel control unit 102 of the home controller 100 detects a user operation on the simple control button 503 on the operation screen 516 (S4301).

Next, the device control unit 106 of the home controller 100 generates control commands for the device A 200 and the device B 200 in accordance with a user operation, and transmits them to the server 300 (S4302).

The server 300 that has received the control command transmits the control command to the device A 200 (S4303). The device A 200 that has received the control command executes the control command (S4304), and transmits the control result to the server 300 (S4305).

Similarly, the server 300 transmits a control command to the device B 200 (S4306). The device B 200 that has received the control command executes the control command (S4307) and transmits the control result to the server 300 (S4308). The server 300 that has received the control results of the device A 200 and the device B 200 transmits the control result to the home controller 100 (S4309).

Then, the display control unit 103 of the home controller 100 updates the display screen according to the control result (S4310).

FIG. 30 is a sequence diagram illustrating an example of a process for updating the device list between the home controller 100 and the server 300. The device 200 transmits a device state indicating the current state of the device 200 to the server 300 (S4901). Here, the device 200 may periodically transmit the device status, or may transmit the device status when the status changes. The server 300 updates the device list 1600 according to the content of the received device state (S4902). Here, when the information of the device 200 does not exist in the device list 1600, the server 300 adds the information of the device 200 as a new device. Then, the server 300 transmits a device list update notification to the home controller 100 (S4903).

The device management unit 105 of the home controller 100 updates the device list 1700 according to the content of the received device list update notification (S4904). If the information on the device 200 does not exist in the device list 1700, the device management unit 105 adds the information on the device 200 as a new device. Then, the display control unit 103 of the home controller 100 updates the display screen (S4905). For example, when the information of the new device 200 is added, the display screen is updated by updating the room icon 502 indicating the room in which the new device 200 is installed and displaying the status by the simple control button 503 of the room icon 502. Including updates.

Thus, when the state of the device 200 changes, the state change is notified to the server 300. For this reason, the server 300 can monitor a change in the state of the device 200. In addition, the server 300 to which the device state is transmitted from the device 200 notifies the home controller 100 of the change in the state. For this reason, the home controller 100 can recognize the current state of the device 200. Further, when the new device 200 is connected to the home network, the server 300 and the home controller 100 can add information on the new device. Therefore, it is possible to prevent a deviation between the actual state of the device 200 and the state of the device 200 recognized by the home controller 100.

FIG. 31 is a sequence diagram illustrating another example of the process of updating the device list between the home controller 100 and the server 300. The device 200 transmits the device state to the home controller 100 (S5001). Here, the device 200 may periodically transmit the device status, or may transmit the device status when the status changes.

The device management unit 105 of the home controller 100 updates the device list 1700 according to the content of the received device state (S5002). If the information on the device 200 does not exist in the device list 1700, the device management unit 105 adds the information on the device 200 as a new device. Then, the display control unit 103 updates the display screen (S5003).

Next, the device management unit 105 of the home controller 100 transmits a device list update notification to the server 300 (S5004). The server 300 updates the device list 1600 according to the received device list update notification (S5005). Here, when the information of the device 200 does not exist in the device list 1600, the server 300 adds the information of the device 200 as a new device.

FIG. 32 is a sequence diagram illustrating still another example of processing in which the home controller 100 and the server 300 update the device list. In FIG. 32, a case where the user owns two home controllers 100, ie, the home controller 100 in the house and the home controller 100 outside the house, will be described as an example. Here, the home controller 100 outside the home is the home controller 100 that the user has taken out, and the home controller 100 inside the home is the home controller 100 that the user has left in the home.

The device 200 transmits the device status to the home controller 100 in the home (S5101). The home controller 100 in the home updates the device list 1700 according to the content of the received device state (S5102). If the information on the device 200 does not exist in the device list 1700, the device management unit 105 adds the information on the device 200 as a new device. Then, the display control unit 103 of the home controller 100 in the home updates the display screen (S5103). Then, the home controller 100 in the home transmits a device list update notification to the server 300 (S5104).

The server 300 updates the device list 1600 according to the content of the received device list update notification (S5105). Here, when the information of the device 200 does not exist in the device list 1600, the server 300 adds the information of the device 200 as a new device. Then, the server 300 transmits a device list update notification to the home controller 100 outside the home (S5106).

The home controller 100 outside the home updates the device list 1700 according to the content of the received device list update notification (S5107). Here, when the information of the device 200 does not exist in the device list 1700, the device management unit 105 of the home controller 100 outside the home adds the information of the device 200 as a new device. Then, the display control unit 103 of the home controller 100 outside the home updates the display screen (S5108).

According to this example, even when one home controller 100 is outside the home and the other home controller 100 is in the home, the state of the device 200 recognized by both home controllers 100 is shifted. Can be prevented.

Note that the sequence and processing flow described above are examples, and the order of steps may be changed or some steps may be omitted as long as the target processing can be realized. For example, transmission of control commands to the device A 200 and the device B 200 may be realized asynchronously.

FIG. 33 is a diagram showing still another example of the room icon 502. An operation screen (an example of a simple operation screen) 516 included in the room icon 502 shown in FIG. 33 includes only a simple control button 503, unlike FIG. The room icon 502 of the present embodiment may be a room icon 502 of the form shown in FIG.

34 and 35 are diagrams showing an example of transition of the display screen of FIG. The upper diagram of FIG. 34 shows the display screen shown in FIG. 5, and the lower diagram of FIG. 34 shows the display screen shown in FIG.

In the basic screen shown in the upper part of FIG. 34, when the user touches the device type icon 515 of the device 200 that the user wants to control (here, the air conditioner 201) with the contact object 519, the touch panel control unit 102 detects the contact. To do. Then, as shown in the lower part of FIG. 34, the display control unit 103 displays a room icon 502 indicating a room in which the device 200 of the contacted device type icon 515 is installed, and the device type icon 515 of the display 101. Is displayed below. As a result, the display state of the basic screen changes to the display state of the room icon 502.

The upper diagram in FIG. 35 shows the display screen shown in FIG. 33, and the lower diagram in FIG. 35 shows the display screen shown in FIG. In the display screen of the room icon 502 shown in the upper diagram of FIG. 35, the room icon 502 (in this case, the room icon 502 in the living room) that indicates the room that the user wants to control the air conditioner is displayed outside the area of the operation screen 516. When the user contacts with the contact object 519, the touch panel control unit 102 detects the contact. Then, the display control unit 103 displays a room screen 520 including a detailed control screen 517 as shown in the lower diagram of FIG.

Next, in the display state of the room screen 520 in the living room shown in the lower part of FIG. 35, when the user touches the return button 507 with the contact object 519, the touch panel control unit 102 detects the contact. Then, as shown in the upper diagram of FIG. 35, the display control unit 103 returns to the display state of the room icon 502.

FIG. 36 is a flowchart showing the flow of processing in which the home controller 100 controls the device 200 when the room icon 502 shown in FIG. 33 is displayed on the display 101 in the embodiment of the present invention.

36, S5201 to S5205 are the same as S3501 to S3505 of FIG. When S5205 is executed, this process ends. If the user does not select the device type icon 515 in S5202 (NO in S5202), the touch panel control unit 102 determines whether the user has selected the room icon 502 and outside the area of the operation screen 516. (S5206). If the user is the room icon 502 and has selected outside the area of the operation screen 516 (YES in S5206), the display control unit 103 corresponds to the device type icon 515 of the room indicated by the selected room icon 502. The detailed control screen 517 of the device 200 is displayed (S5207).

Next, the touch panel control unit 102 determines whether or not the user has selected the detail control button 505 (S5208). If the user has selected the detailed control button 505 (YES in S5208), the device control unit 106 generates a control command corresponding to the control of the selected detailed control button 505 (S5209). Next, the device control unit 106 executes the control command transmission flow (S5210) described with reference to FIG. 23, and the process ends. On the other hand, if the user has not selected the detailed control button 505 in S5208 (NO in S5208), this process ends.

If the user has not selected the room icon 502 in S5206 (NO in S5206), the touch panel control unit 102 determines whether the user has selected the simple control button 503 on the operation screen 516 of the room icon 502 ( S5211). If the user has selected the simple control button 503 (YES in S5211), the process proceeds to S5209. On the other hand, if the user has not selected the simple control button 503 (NO in S5211), this process ends.

FIG. 37 is a diagram showing a further different example of the room icon 502. The room icon 502 shown in FIG. 37 does not include an operation screen, unlike FIG. The room icon 502 of the present embodiment may be the room icon 502 shown in FIG.

38 and 39 are diagrams showing an example of transition of the display screen of FIG. The upper diagram of FIG. 38 shows the display screen shown in FIG. 5, and the lower diagram of FIG. 38 shows the display screen shown in FIG.

In the basic screen shown in the upper part of FIG. 38, when the user touches the device type icon 515 of the device 200 that the user wants to control (here, the air conditioner 201) with the contact object 519, the touch panel control unit 102 detects the contact. To do. Then, the display control unit 103 displays a room icon 502 indicating a room where the contacted device type icon 515 is installed below the device type icon 515 on the display 101 as shown in the lower diagram of FIG. . As a result, the display state of the basic screen changes to the display state of the room icon 502.

39 shows the display screen shown in FIG. 37, and the lower figure in FIG. 39 shows the display screen shown in FIG. In the display screen of the room icon 502 shown in the upper diagram of FIG. 39, when the user touches the room icon 502 (in this case, the room icon 502 in the living room) indicating the room to be controlled with the contact object 519, the contact is made. Is detected by the touch panel control unit 102. Then, the display control unit 103 displays a room screen 520 including a detailed control screen (an example of an operation screen) 517, as shown in the lower part of FIG.

Next, in the display state of the room screen 520 in the living room shown in the lower part of FIG. 39, when the user touches the return button 507 with the contact object 519, the touch panel control unit 102 detects the contact. Then, as shown in the upper diagram of FIG. 39, the display control unit 103 returns to the display state of the room icon 502.

FIG. 40 is a flowchart showing a flow of processing in which the home controller 100 controls the device 200 when the room icon 502 shown in FIG. 37 is displayed on the display 101 in the embodiment of the present invention.

40, S5221 to S5225 are the same as S3501 to S3505 of FIG. When S5225 is executed, this process ends. If the user does not select the device type icon 515 in S5222 (NO in S5222), the touch panel control unit 102 determines whether the user has selected the room icon 502 (S5226).

If the user has selected the room icon 502 (YES in S5226), the display control unit 103 displays the detailed control screen 517 of the device 200 corresponding to the device type icon 515 of the room indicated by the selected room icon 502. (S5227). Subsequent S5228 to S5230 are the same as S5208 to S5210 in FIG. If the user does not select the room icon 502 in S5226 (NO in S5226), this process ends.

The present disclosure is useful as a control method and program for controlling one or more target devices connected to a network.

Claims

A method for controlling an information terminal connected to a network for controlling one or more target devices and having a display,
For the information terminal computer,
Displaying one or more device type icons indicating the one or more target devices in units of device type on the display;
When it is determined that selection of any one of the one or more device type icons is detected, a room in which a target device of a type corresponding to the selected one device type icon is installed One or more room icons to be displayed are arranged on the display, and the one or more room icons include an operation screen of a target device of a type corresponding to the selected one device type icon,
Based on the operation of the operation screen included in any one of the one or more room icons, the selected one device installed in the room corresponding to the room icon including the operated operation screen A control command for controlling the target device of the type corresponding to the type icon is output to the network;
Control method.
The one or more room icons have the same size and shape;
The control method according to claim 1.
The one or more room icons include an operation button for displaying an extended operation screen for operating an instruction other than an instruction operable on the operation screen,
If it is determined that selection of the operation button has been detected, the extended operation screen is displayed on the display.
The control method according to claim 1.
A method for controlling an information terminal connected to a network for controlling one or more target devices and having a display,
For the information terminal computer,
Displaying one or more device type icons indicating the one or more target devices in units of device type on the display;
When it is determined that selection of any one of the one or more device type icons is detected, a room in which a target device of a type corresponding to the selected one device type icon is installed One or more room icons to be displayed are arranged on the display,
If it is determined that the selection of any one of the one or more room icons is detected, the device is installed in the room corresponding to the selected room icon and the selected one device type icon An operation screen for operating the target device of the corresponding type is displayed on the display,
Based on the operation on the operation screen, the control command for controlling the target device of the type corresponding to the selected device type icon installed in the room corresponding to the selected room icon is output to the network. ,
Control method.
The one or more room icons have the same size and shape;
The control method according to claim 4.
The one or more room icons are instructions other than instructions that can be operated on the operation screen with respect to the target device of the type corresponding to the selected device type icon, and instructions that are less than the number of instructions that can be operated on the operation screen Including a simple operation screen that can operate a number of instructions,
The control method according to any one of claims 4 to 5.
The simple operation screen includes an operation button for controlling the power supply of a target device of a type corresponding to the selected device type icon.
The control method according to claim 6.
The one or more target devices include an air conditioner,
The control method according to any one of claims 1 to 7.
The one or more target devices include lighting devices;
The control method according to any one of claims 1 to 7.
The one or more target devices include an electronic lock;
The control method according to any one of claims 1 to 7.
The one or more target devices include a surveillance camera;
The control method according to any one of claims 1 to 7.
A program for connecting to a network for controlling one or more target devices and controlling an information terminal having a display,
For the information terminal computer,
Displaying one or more device type icons indicating the one or more target devices in units of device type on the display;
When it is determined that selection of any one of the one or more device type icons is detected, a room in which a target device of a type corresponding to the selected one device type icon is installed One or more room icons to be displayed are arranged on the display, and the one or more room icons include an operation screen of a target device of a type corresponding to the selected one device type icon,
Based on the operation of the operation screen included in any one of the one or more room icons, the selected one device installed in the room corresponding to the room icon including the operated operation screen A control command for controlling the target device of the type corresponding to the type icon is output to the network;
program.
A program for controlling an information terminal having a display connected to a network for controlling one or more target devices,
For the information terminal computer,
Displaying one or more device type icons indicating the one or more target devices in units of device type on the display;
When it is determined that selection of any one of the one or more device type icons is detected, a room in which a target device of a type corresponding to the selected one device type icon is installed One or more room icons indicating
If it is determined that the selection of any one of the one or more room icons is detected, the device is installed in the room corresponding to the selected room icon and the selected one device type icon An operation screen for operating the target device of the corresponding type is displayed on the display,
Based on the operation on the operation screen, the control command for controlling the target device of the type corresponding to the selected device type icon installed in the room corresponding to the selected room icon is output to the network. ,
program.