JP2014216942A - Remote control operation system, controller, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To surely make an operation of a device with remote control operation, while enabling confirmation of an operation result by a user.SOLUTION: A remote control operation system 100 has a controller 30 which controls electrical equipment 11, a server 50, and an operation terminal 60. The operation terminal 60 displays information for operating the electrical equipment 11, acquires operation content which is input from a user U2, and transmits the acquired operation content to the server 50. The operation terminal 60 receives a state signal indicating the state of the electrical equipment 11 from the server 50, and displays the state of the electrical equipment 11 to the user U2. The server 50 transmits the operation content to the controller 30 and transmits the state signal to the operation terminal 60 from the controller 30. The controller 30 controls the electrical equipment 11 on the basis of the transmitted operation content. The controller 30 acquires the state of the electrical equipment 11 and generates the state signal to transmit it to the server 50.

Description

  The present invention relates to a remote operation system, a controller, a remote operation method, and a program.

  In recent years, with the development of communication technology, a system for operating a remote device via a network has been proposed (for example, see Patent Document 1). Patent Document 1 discloses a system for a user to operate a remote device using a joystick or the like. In this system, data indicating the result of the operation and a video image of the device are displayed to the user. Thereby, the user can confirm the result of operation.

JP 2005-236625 A

  In the system described in Patent Document 1, it is assumed that the user-side device and the remote-side device communicate on a one-to-one basis. For this reason, it is difficult to collectively manage communication related to remote operations when operating remote devices from a plurality of user devices or operating multiple remote devices. Therefore, there is a possibility that it is difficult to reliably operate the device by remote operation while allowing the user to check the operation result.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to ensure that the operation of the device by remote operation is performed while allowing the user to check the operation result.

  In order to achieve the above object, a remote operation system according to the present invention includes a controller for controlling an electrical device installed in a residence, a server connected to the controller via a wide area network, and an operation terminal connected to the wide area network. A display unit that displays information for operating the electric device to the user, an acquisition unit that acquires the content of the operation on the electric device from the user, and an acquisition device. The operation content transmitting means for transmitting the content of the operation acquired by the means to the server, and the status receiving means for receiving the status signal indicating the status of the electrical equipment from the server, the display means is indicated by the status signal Displays the status of the electrical equipment, and the server transmits the operation content transmitted by the operation content transmission means to the controller. And a status transmission means for transmitting a status signal from the controller to the operation terminal, and the controller controls the electrical equipment based on the content of the operation transmitted by the operation content transmission means, and the electrical equipment And a status transmission means for acquiring a status of the electrical device from the status, generating a status signal, and transmitting the status signal to the server.

  According to the present invention, communication related to remote operation is performed via a server. In addition, the state of the electric device is displayed to the user. Accordingly, it is possible to ensure the operation of the device by remote operation while allowing the user to check the operation result.

It is a figure which shows the structure of the remote control system which concerns on Embodiment 1 of this invention. It is a block diagram which shows the structure of an electric equipment. It is a block diagram which shows the structure of a controller. It is a block diagram which shows the structure of a server. It is a block diagram which shows the structure of an operating terminal. It is a figure which shows the example of a display screen. It is a flowchart which shows the terminal process performed by the operation terminal. It is a figure which shows the example of the display screen which displays that the communication failure has arisen. It is a figure which shows the example of the display screen which displays that operation was completed. It is a figure which shows the example of the display screen which displays that the electric equipment was operated from the residence. It is a figure which shows the example of the display screen which displays that the communication failure has arisen. It is a figure which shows the example of the display screen which displays that operation failed. It is a flowchart which shows the server process performed by the server. It is a flowchart which shows the controller process performed by a controller. It is a figure which shows the example of the display screen which displays that the communication failure has arisen. It is a flowchart which shows the apparatus process performed by an electric equipment. It is a figure which shows the communication in a remote control system in time series. It is a figure which shows the communication in the remote control system which concerns on Embodiment 2 in time series. It is a figure which shows the example of the display screen which displays that operation content is transmitting. It is a figure which shows the communication in the remote control system which concerns on Embodiment 3 in time series.

  Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.

Embodiment 1 FIG.
Remote operation system 100 according to the present embodiment is a system for operating a device in a house from outside the house. As shown in FIG. 1, the remote operation system 100 includes a plurality of electrical devices 11, 12, 13, a sensor 19, a controller 30, a server 50, and an operation terminal 60 installed in a residence 10. ing.

  The electric devices 11 to 13, the sensor 19, and the controller 30 are connected to each other via the home network 20. The home network 20 is a network for communicating according to a communication protocol such as ECHONET Lite (registered trademark), for example. The electric devices 11 to 13, the sensor 19, and the controller 30 each communicate with each other via the home network 20 by transmitting and receiving signals according to this communication protocol.

  Further, the controller 30, the server 50, and the operation terminal 60 are connected to each other via the wide area network 40. The wide area network 40 is, for example, the Internet. The controller 30, the server 50, and the operation terminal 60 communicate with each other via the wide area network 40 by transmitting and receiving signals according to a predetermined protocol (for example, HTTPS, Hypertext Transfer Protocol over Secure Socket Layer).

  The electric device 11 is an air conditioner that adjusts the air condition in a room where the user U1 lives, for example. The electric device 11 is installed on a ceiling, for example. As illustrated in FIG. 2, the electrical device 11 includes a control unit 111, a communication unit 112, a storage unit 113, a detection unit 114, an operation unit 115, and an input unit 116.

  The control unit 111 includes, for example, a CPU (Central Processing Unit) and a RAM (Random Access Memory). The control unit 111 is connected to the communication unit 112, the storage unit 113, the detection unit 114, and the operation unit 115 via signal lines. The control unit 111 executes a process described later by executing a program stored in the storage unit 113 and controls each component of the electrical device 11.

  The communication unit 112 includes a communication interface for communicating via the home network 20. The communication unit 112 notifies the control unit 111 of information acquired from the home network 20, and outputs the information notified from the control unit 111 to the home network 20.

  The storage unit 113 includes a nonvolatile memory such as a flash memory, for example. In addition to the program executed by the control unit 111, the storage unit 113 stores various data used for processing by the control unit 111. The storage unit 113 supplies data used by the control unit 111 to the control unit 111 and stores the data supplied from the control unit 111.

  The detection unit 114 is a temperature sensor, for example. The detection unit 114 detects the temperature of the air taken in by the electric device 11 and notifies the control unit 111 of the temperature.

  The operation unit 115 includes, for example, a fan for blowing conditioned air and a louver for blowing conditioned air in a predetermined direction. The operation unit 115 operates in accordance with instructions from the control unit 111 and is used to exhibit the main functions of the electrical device 11.

  The input unit 116 includes a power switch and input keys. The input unit 116 acquires information input by the user U1 in the residence 10 and notifies the control unit 111 of the information. The input unit 116 is used by the user U1 to directly operate the electric device 11.

  Returning to FIG. 1, each of the electric devices 12 and 13 is a household electric device such as a television receiver, an electric water heater, a floor heating system, an electromagnetic cooker, a ventilation system, or a refrigerator. Both the electric devices 12 and 13 have the same configuration as the electric device 11.

  The sensor 19 is a temperature sensor installed near the floor of the room where the user U1 lives. The sensor 19 measures the temperature of the air on the floor and outputs the measurement result to the controller 30 via the home network 20. The sensor 19 is used to measure the temperature of the air at a position away from the electric device 11. In addition, the sensor 19 is used in combination with the detection unit 114 to detect a change in the environment caused by the electric device 11 controlled by the controller 30.

  The controller 30 is, for example, a HEMS (Home Energy Management System) controller that controls the electrical devices 11 to 13 in an integrated manner. The controller 30 functions as a home gateway server between the home network 20 and the wide area network 40. As illustrated in FIG. 3, the controller 30 includes a control unit 31, a first communication unit 32, a second communication unit 33, and a storage unit 34.

  The control unit 31 includes, for example, a CPU and a RAM. The control unit 31 is connected to the first communication unit 32, the second communication unit 33, and the storage unit 34 via signal lines. The control unit 31 executes processes described later by executing a program stored in the storage unit 34 and controls each component of the controller 30.

  The first communication unit 32 includes a communication interface for communicating via the home network 20. The first communication unit 32 notifies the information acquired from the home network 20 to the control unit 31 and outputs the information notified from the control unit 31 to the home network 20.

  The second communication unit 33 includes a communication interface for communicating via the wide area network 40. The second communication unit 33 notifies the information acquired from the wide area network 40 to the control unit 31 and outputs the information notified from the control unit 31 to the wide area network 40.

  The storage unit 34 includes a nonvolatile memory. In addition to the program executed by the control unit 31, the storage unit 34 stores various data used for processing by the control unit 31. The storage unit 34 supplies the data used by the control unit 31 to the control unit 31 and stores the data supplied from the control unit 31.

  Returning to FIG. 1, the server 50 is a cloud server that manages a plurality of HEMS controllers including the controller 30, for example. Further, the server 50 serves as an authentication server for the operation terminal 60 attempting remote operation via the wide area network 40. Furthermore, the server 50 according to the present embodiment functions as a web server and communicates with the controller 30 and the operation terminal 60 by responding to a predetermined request (HTTPS request).

  As shown in FIG. 4, the server 50 includes a control unit 51, a communication unit 52, and a storage unit 53.

  The control unit 51 includes, for example, a CPU and a RAM. The control unit 51 is connected to the communication unit 52 and the storage unit 53 via a signal line. The control unit 51 executes processes described later by executing a program stored in the storage unit 53 and controls each component of the server 50.

  The communication unit 52 includes a communication interface for communicating via the wide area network 40. The communication unit 52 notifies the information acquired from the wide area network 40 to the control unit 51, and outputs the information notified from the control unit 51 to the wide area network 40.

  The storage unit 53 includes a nonvolatile memory. The storage unit 53 stores various data used for processing by the control unit 51 in addition to the program executed by the control unit 51. And the memory | storage part 53 supplies the data which the control part 51 utilizes to the control part 51, and memorize | stores the data supplied from the control part 51. FIG.

  Returning to FIG. 1, the operation terminal 60 is a portable terminal (for example, a smart phone, a tablet terminal, etc.) possessed by the user U2, and is connected to the wide area network 40 via a mobile communication network. The user U2 is a resident of the residence 10. The operation terminal 60 is used by the user U2 to operate the electrical device 11 and the like from a place where they are away. As shown in FIG. 5, the operation terminal 60 includes a control unit 61, a communication unit 62, a storage unit 63, an input unit 64, and a display unit 65.

  The control unit 61 includes, for example, a CPU and a RAM. The control unit 61 is connected to the communication unit 62, the storage unit 63, the input unit 64, and the display unit 65 via signal lines. The control unit 61 executes processes described later by executing a program stored in the storage unit 63 and controls each component of the operation terminal 60.

  The communication unit 62 includes a communication interface for communicating via the wide area network 40. The communication unit 62 notifies the information acquired from the wide area network 40 to the control unit 61 and outputs the information notified from the control unit 61 to the wide area network 40.

  The storage unit 63 includes a nonvolatile memory. In addition to the program executed by the control unit 61, the storage unit 63 stores various data used for processing by the control unit 61. The storage unit 63 supplies data used by the control unit 61 to the control unit 61 and stores the data supplied from the control unit 61.

  The input unit 64 includes, for example, an input key and a capacitance type pointing device. The input unit 64 acquires information input by the user U2 and notifies the control unit 61 of the information. The information input by the user U2 includes, for example, the contents of the operation on the electric device 11 or the like.

  The display unit 65 includes a display device such as an LCD (Liquid Crystal Display). The display unit 65 according to the present embodiment is formed integrally with a pointing device that constitutes the input unit 64 to constitute a touch screen.

  The display unit 65 has a display screen 651 for displaying various figures and characters to the user U2 in accordance with instructions from the control unit 61. FIG. 6 shows an example of a screen displayed as the display screen 651. As shown in FIG. 6, the display screen 651 has an operation area A1, a communication status area A2, and a device status area A3.

  A web page distributed from the server 50 is displayed in the operation area A1. For example, as shown in FIG. 6, this web page is an operation screen for inputting the content of the operation on the electric device 11.

  The operation screen includes a box B1 indicating a URI (Uniform Resource Identifier) of the web page, a box B2 for inputting an operation mode of the electric device 11, and a box B3 for setting a target value of the room temperature adjusted by the electric device 11. , A box B4 for instructing the start or stop of driving, and a button B5 for transmitting the contents of the operation input in the boxes B2 to B4.

  In the communication status area A2, the operation terminal 60 and the electric device 11 are displayed using the icon I60 indicating the operation terminal 60, the icon I50 indicating the server 50, the icon I30 indicating the controller 30, and the icon I11 indicating the electric device 11. The status of communication with is displayed.

  In the device status area A3, a plurality of rows including the status of the electrical device 11 are displayed in time series.

  Next, processing performed by each of the operation terminal 60, the server 50, the controller 30, and the electric device 11 when the electric device 11 is operated will be described in order.

  FIG. 7 shows terminal processing executed by the operation terminal 60. This terminal processing starts, for example, when a remote operation application is activated by the user U2.

  As shown in FIG. 7, the control unit 61 of the operation terminal 60 first tries to connect to the server 50 (step S601). For example, the control unit 61 attempts connection by sending a ping message to the server 50.

  Next, the control unit 61 determines whether or not the connection is successful (step S602). For example, the control unit 61 determines whether a response to the ping message has been received from the server 50. When it is determined that the connection has failed (step S602; No), the control unit 61 displays on the display screen 651 that the connection has failed (step S603).

  Specifically, as shown in FIG. 8, the control unit 61 causes the operation area A1 to display the box B1 and the fact that the connection has failed. Moreover, the control part 61 shows with a figure that the line which connects the icon I60 and the icon I50 is cut | disconnected as shown by communication status area | region A2 in FIG. Further, the control unit 61 displays a box B21 including a description of the communication status and a box B22 including advice for supporting the user U2 based on the current communication status.

  Thereafter, the control unit 61 ends the terminal process. When the user U2 tries the remote operation again, the terminal process is executed again.

  On the other hand, when it determines with the connection having been successful in step S602 (step S602; Yes), the control part 61 tries the authentication that it is the connection by the legitimate operator who operates the electric equipment 11 (step S604). . Specifically, the control unit 61 acquires a web page for inputting an ID (identifier) and password from the server 50 and displays the web page in the operation area A1, thereby allowing the user U2 to input the ID and password. Prompt. Then, the control unit 61 transmits the ID and password input by the user U2 to the server 50.

  Next, the control unit 61 determines whether or not the authentication is successful based on the content of the response from the server 50 (step S605).

  If it is determined that the authentication has failed (step S605; No), the control unit 61 causes the display screen 651 to display that the authentication has failed (step S606). For example, the control unit 61 displays the web page distributed from the server 50 in the operation area A1. Thereafter, the control unit 61 ends the terminal process.

  On the other hand, when it is determined that the authentication is successful (step S605; Yes), the control unit 61 acquires the operation screen from the server 50 and displays it on the display screen 651 (step S607).

  Next, the control unit 61 determines whether or not the operation content has been input by the user U2 (step S608). Specifically, the control unit 61 determines whether or not the user U2's finger has touched the button B5 after a value is input to the boxes B2 to B4 on the operation screen.

  When it is determined that the operation content has not been input (step S608; No), the control unit 61 repeats the determination of step S608. Accordingly, the control unit 61 stands by until the user U2 inputs the operation content and touches the button B5.

  When it is determined that the operation content has been input (step S608; Yes), the control unit 61 transmits the operation content to the server 50 (step S609). Specifically, the control unit 61 transmits an HTTPS request to which the operation content is added by the POST method to the server 50.

  Next, the control part 61 requests | requires the result of operation to the server 50 (step S610). As the result of the operation, for example, the state of the electric device 11 after receiving the operation content, whether or not the electric device 11 is in a state according to the operation content, there was a separate operation by the user U1 in the residence 10 And a communication failure that occurs between the operation terminal 60 and the electric device 11 are included. The control unit 61 may receive information not included in the operation result from the server 50. The information that is not included in the operation result includes the suction temperature detected by the detection unit 114, the floor temperature measured by the sensor 19, and the fact that the operation content has been received by the electric device 11.

  Next, the control part 61 receives the response from the server 50, and determines whether the operation result has been acquired (step S611). When it is determined that the operation result has not been acquired (step S611; No), the control unit 61 repeats the processing after step S610.

  On the other hand, when it determines with having acquired the operation result (step S611; Yes), the control part 61 determines whether operation was completed (step S612). Completion of the operation means that the state of the electric device 11 is as intended by the user U2 in accordance with the operation content transmitted in step S609. The control unit 61 may determine whether the operation is completed by comparing the transmitted operation content with the acquired operation result, and indicates whether the electric device 11 is in a state according to the operation content. Data may be received and based on this data, it may be determined whether the operation has been completed.

  When it is determined that the operation has been completed (step S612; Yes), the control unit 61 displays the completion of the operation on the display screen 651 (step S613). As a result, for example, as shown in FIG. 9, the rows R1 and R2 including the state of the electrical device 11 and the description of “completed” indicating that the operation has been performed are displayed in the device state area A3. Is displayed. Further, the rows R1 and R2 include the suction temperature detected by the detection unit 114 and the floor temperature measured by the sensor 19.

  In the device status area A3 in FIG. 9, a row R3 indicating that the operation content has been received by the electric device 11 is displayed regardless of the result of the operation.

  In addition, the communication status area A2 in FIG. 9 indicates that the communication quality between the operation terminal 60 and the server 50 is good when the icons I60 and I50 are connected by a double line. Similarly, the icons I50 and I30 are connected with thick lines, which indicates that there is no problem in communication quality between the server 50 and the controller 30. Further, the icons I30 and I11 are connected with thick lines, which indicates that there is no problem in the communication quality between the controller 30 and the electrical device 11.

  Thereafter, the control unit 61 ends the terminal process.

  When it determines with operation not having been completed in step S612 (step S612; No), the control part 61 determines whether the state of the electric equipment 11 was changed by separate operation from the house (step). S614). When this determination is affirmed (step S614; Yes), the control unit 61 displays the state of the electrical device 11 on the display screen 651 (step S615).

  Thus, for example, as shown in FIG. 10, a row R4 including a description of “× in-home operation” indicating that the state of the electric device 11 is not in accordance with the operation content is displayed in the device state area A3. Is displayed.

  Thereafter, the control unit 61 ends the terminal process.

  On the other hand, when the determination in step S614 is negative (step S614; No), the control unit 61 determines whether an abnormality has occurred (step S616). This abnormality includes, for example, an abnormality in the server 50, the controller 30, and the electric device 11, and a communication failure.

  When it is determined that an abnormality has occurred (step S616; Yes), the control unit 61 displays the content of the abnormality on the display screen 651 (step S617). Thus, for example, as shown in FIG. 11, the details of the abnormality are displayed in the communication status area A2. Thereafter, the control unit 61 ends the terminal process.

  On the other hand, when it is determined that no abnormality has occurred (step S616; No), the control unit 61 determines that the setting of the operation content in the electric device 11 has failed, and displays that the setting has failed. It is displayed on the screen 651 (step S618). As a result, for example, as shown in FIG. 12, a row R5 including the state of the electrical device 11 and the description “x setting failure” indicating that the setting has failed is displayed in the device state area A3.

  Thereafter, the control unit 61 ends the terminal process.

  Next, server processing executed by the server 50 will be described with reference to FIG. This server process starts when the power of the server 50 is turned on.

  As shown in FIG. 13, the control unit 51 of the server 50 first determines whether or not data synchronization is requested from the controller 30 (step S501). This request is, for example, an HTTPS request for data synchronization.

  When it is determined that synchronization is requested (step S501; Yes), the control unit 51 stores the requested time (step S502). Thereafter, the control unit 51 shifts the processing to step S505.

  On the other hand, when it is determined that the synchronization is not requested (step S501; No), the control unit 51 determines whether or not a certain time has elapsed since the last requested time (step S503). This certain time is, for example, 10 minutes. When it is determined that the predetermined time has not elapsed (step S503; No), the control unit 51 shifts the processing to step S505.

  On the other hand, when it is determined that the predetermined time has passed (step S503; Yes), the control unit 51 notifies the operation terminal 60 that a communication failure has occurred with the controller 30 (step S504). Thereby, for example, the information shown in FIG. 11 is displayed in the communication status area A2.

  Next, the control unit 51 responds to maintain a session with the controller 30 (step S505). This response is a response that the control unit 51 periodically returns to the controller 30 in accordance with the Comet method (long polling method). Thereby, the response to the request from the controller 30 is substantially put on hold.

  When step S505 is executed subsequent to step S502, the control unit 51 includes information for synchronizing data in the response. Thereby, the content of the data stored in the controller 30 matches the content of the data stored in the server 50.

  Next, the control unit 51 determines whether or not there is a request from the operation terminal 60 (step S506). Specifically, the control unit 51 determines whether an HTTPS request has been received from the operation terminal 60.

  When it determines with there being no request | requirement (step S506; No), the control part 51 repeats the process after step S501. On the other hand, when it determines with a request | requirement (step S506; Yes), the control part 51 responds with respect to the operating terminal 60 (step S507). Thereby, for example, a state signal indicating the state of the electrical device 11 is transmitted to the operation terminal 60.

  Next, the control unit 51 determines whether or not the operation content added by the POST method or the like is included in the request in step S506 (step S508). When it is determined that the operation content is not included (step S508; No), the control unit 51 repeats the processing after step S501.

  On the other hand, when it determines with operation content being contained (step S508; Yes), the control part 51 transmits the response containing operation content to the controller 30 with respect to the request | requirement of step S501 (step S509).

  Then, the control part 51 repeats the process after step S501.

  Next, controller processing executed by the controller 30 will be described with reference to FIG. This controller process starts when the controller 30 is powered on.

  As shown in FIG. 14, the controller 31 of the controller 30 first synchronizes with the server 50 (step S301). Specifically, the control unit 31 synchronizes with the server 50 by requesting the server 50 to synchronize data and receiving a response from the server 50.

  Next, the control part 31 determines whether the operation content was received from the server 50 by the synchronization of step S301 (step S302). When it determines with not having received the operation content (step S302; No), the control part 31 transfers a process to step S307.

  On the other hand, when it determines with having received operation content (step S302; Yes), the control part 31 produces | generates the control signal for controlling the electric equipment 11 based on operation content, and transmits to the electric equipment 11. (Step S303). This control signal is a signal for transmitting operation details in the home network 20.

  Next, the control part 31 determines whether the response from the electric equipment 11 was received (step S304). This response is a response made by the electrical device 11 to the control signal transmitted in step S303 regardless of the state of the electrical device 11.

  When it is determined that a response has not been received (step S304; No), the control unit 31 synchronizes with the server 50 to notify the server 50 of a communication failure with the electrical device 11 (step S305). . When the signal indicating the communication failure is transmitted to the operation terminal 60 by the server 50, the line connecting the icon I30 and the icon I11 is cut in the communication status area A2, as shown in FIG. Indicated by a graphic. In addition, a box B21 describing the content of the communication failure is displayed.

  On the other hand, when it determines with having received the response (step S304; Yes), the control part 31 transmits the response from the electric equipment 11 to the server 50 by synchronizing with the server 50 (step S306). Thereby, the fact that the operation content has reached the electrical device 11 is transmitted to the server 50 and the operation terminal 60.

  Next, the control unit 31 determines whether or not a change in state has been notified from the electrical device 11 (step S307). Specifically, the control unit 31 determines whether the state of the electrical device 11 has changed and the changed state has been notified. When it is determined that a change in state has been notified (step S307; Yes), the control unit 31 shifts the process to step S311.

  On the other hand, when it determines with the change of a state not being notified (step S307; No), the control part 31 requests | requires a state from the electric equipment 11 (step S308). Specifically, the control unit 31 requests the electric device 11 to notify the current state of the electric device 11.

  Next, the control unit 31 determines whether or not there is a response from the electrical device 11 (step S309). This response is a response made by the electrical device 11 in response to the request in step S308.

  When it determines with there being no response (step S309; No), the control part 31 notifies the communication failure between the electric apparatuses 11 to the server 50 by synchronizing with the server 50 (step S310). Then, the control part 31 repeats the process after step S301.

  On the other hand, when it determines with there being a response (step S309; Yes), the control part 31 produces | generates a state signal and transmits to the server 50 (step S311). Specifically, the control unit 31 generates a status signal in a format suitable for the wide area network 40, and transmits the status signal to the server 50 by synchronizing with the server 50.

  Next, the control unit 31 determines whether or not a predetermined time has elapsed since the last transmission of the control signal to the electrical device 11 (step S312). The predetermined time is, for example, 1 minute. If the control signal has not been transmitted yet, it is determined that a predetermined time has elapsed. When it determines with predetermined time having passed (step S312; Yes), the control part 31 repeats the process after step S301.

  On the other hand, when it determines with predetermined time not having passed (step S312; No), the control part 31 determines whether the state of the electric equipment 11 is a state according to operation content (step S313). ). Specifically, the control unit 31 determines whether or not the state of the electrical device 11 is in a state in accordance with control by the last transmitted control signal.

  When it determines with it not being in the state according to operation content (step S313; No), the control part 31 notifies the server 50 that the electric equipment 11 is in the state which does not follow operation content by synchronizing with the server 50. (Step S314). Then, the control part 31 repeats the process after step S301.

  On the other hand, when it is determined that the state is in accordance with the operation content (step S313; Yes), the control unit 31 synchronizes with the server 50 to indicate that the electrical device 11 is in a state in accordance with the operation content. 50 is notified (step S315). Then, the control part 31 repeats the process after step S301.

  By repeating the controller process shown in FIG. 14, step S307 or step S308 and step S311 are periodically executed. Thereby, a status signal is periodically generated and transmitted to the server 50. The period in which the status signal is generated is, for example, 2 minutes.

  Next, device processing executed by the electric device 11 will be described with reference to FIG. This device processing starts when the electric device 11 is turned on.

  As illustrated in FIG. 16, the control unit 111 of the electrical device 11 first determines whether a control signal is received from the controller 30 (step S <b> 101).

  When it is determined that the control signal has not been received (step S101; No), the control unit 111 shifts the process to step S105. On the other hand, when it determines with having received the control signal (step S101; Yes), the control part 111 responds to the controller 30 (step S102). Thereby, the controller 30 is notified that the operation content has reached the electric device 11.

  Next, the control unit 111 operates the operation unit 115 according to the control signal (step S103). Thereby, for example, a cooling operation with a predetermined set temperature as a target value is started.

  Next, the control unit 111 notifies the controller 30 of the state change (step S104). As a result, the operation terminal 60 is notified via the server 50 that the electrical device 11 is in a state in accordance with the operation content. The notification includes the detection result of the suction temperature by the detection unit 114.

  Next, the control part 111 determines whether it was operated directly by the user U1 in the residence 10 (step S105). When it determines with not being operated (step S105; No), the control part 111 transfers a process to step S108.

  On the other hand, when it determines with having been operated (step S105; Yes), the control part 111 operates the operation part 115 according to operation (step S106).

  Next, the control unit 111 notifies the controller 30 that a home operation has been performed (step S107). Thereby, it is notified to the operation terminal 60 via the server 50 that the state of the electric device 11 has been changed by an operation from within the residence 10.

  Next, the control unit 111 determines whether a notification of a state is requested from the controller 30 (step S108). When it is determined that the state is not requested (step S108; No), the control unit 111 repeats the processing after step S101.

  On the other hand, when it is determined that the state is requested (step S108; Yes), the control unit 111 notifies the controller 30 of the current state of the electrical device 11 in response to the request (step S109). This notification includes the detection result of the suction temperature. Then, the control part 111 repeats the process after step S101.

  In the sequence diagram of FIG. 17, signals transmitted among the operation terminal 60, the server 50, the controller 30, and the electric device 11 are shown in time series. The reference numerals attached to the arrows in FIG. 17 correspond to the reference numerals attached in the flowcharts of FIGS. The connection request and authentication by the operation terminal 60 are omitted. Further, for understanding of the explanation, both notification of a state change by the electric device 11 (step S104) and a response to the request for the state (step S109) are shown.

  A thick solid line in FIG. 17 indicates transmission of a signal including the operation content input by the user U2. The operation content input by the user U2 is transmitted from the operation terminal 60 to the server 50 (step S609). The server 50 transmits this operation content to the controller 30 (step S509). And the controller 30 controls the electric equipment 11 according to operation content by transmitting the control signal produced | generated based on operation content to the electric equipment 11 (step S303).

  In addition, a thick broken line in FIG. 17 indicates transmission of a signal indicating the state of the electrical device 11. The controller 30 acquires the state of the electric device 11 from the electric device 11 and generates a state signal indicating the acquired state (step S109). In addition, the controller 30 transmits the generated status signal to the server 50 by synchronizing with the server 50 (step S311). The server 50 transmits the status signal transmitted from the controller 30 to the operation terminal 60 (step S507). Then, the operation terminal 60 receives the status signal and displays the status of the electrical device 11 on the display screen 651.

  In addition, a two-dot chain line in FIG. 17 indicates transmission of a signal indicating that the operation content has been transmitted to the electrical device 11. When receiving the control signal transmitted from the controller 30, the electrical device 11 responds to this control signal (step S102). The controller 30 notifies the server 50 that the operation content has been transmitted to the electrical device 11 by synchronizing with the server 50 (step S301). And the server 50 notifies the operation terminal 60 that the operation content was transmitted to the electric equipment 11 by responding to the request of the operation terminal 60 (step S507).

As described above, the display screen 651 according to the present embodiment has the operation area A1 and the device state area A3. Thereby, the user U2 who operates the electric device 11 and the like remotely can easily check the state of the electric device 11 after the operation. As a result, it is possible to grasp whether the electric device 11 or the like is operating as intended by the user U2.

  Further, when the electric device 11 or the like is not operating as intended by the user U2, the user U2 can easily operate the electric device 11 again.

  Further, the display screen 651 has a communication status area A2. Thereby, the user U2 can easily recognize the details of the communication failure that has occurred on the communication path from the operation terminal 60 to the electrical device 11 and the countermeasures.

  In the device state area A3, the fact that the electric device 11 was operated by the user U1 in the residence 10 was displayed. Thereby, the user U2 can grasp the cause of the electrical device 11 not operating according to his / her intention.

  Further, the controller 30 periodically acquires the state of the electrical device 11 and notifies the operation terminal 60 via the server 50. And the operation terminal 60 displayed the state of the electric equipment 11 grade | etc., On apparatus state area | region A3 in time series. Thereby, the user U2 can grasp | ascertain transition of the state of the electric equipment 11 grade | etc.,.

  Further, the server 50 performs pseudo two-way communication with the controller 30 according to the Comet method. Accordingly, the server 50 can transmit the operation content to the controller 30 without causing a large time lag after receiving the operation content from the operation terminal 60. In addition, by quickly transmitting the operation contents, it is possible to shorten the waiting time until the result of the operation is confirmed, and to improve the comfort of the user U2.

  The remote operation system 100 includes a server 50 that is a web server. Thereby, a remote operation can be executed from a general-purpose terminal that can be connected to the wide area network 40 using general-purpose web page browsing software (browser). In addition, it is possible to reduce the cost of laying a dedicated line and developing a dedicated communication protocol and dedicated software.

Embodiment 2. FIG.
Next, the second embodiment will be described focusing on the differences from the first embodiment. In addition, about the structure which is the same as that of the said Embodiment 1, or equivalent, while using an equivalent code | symbol, the description is abbreviate | omitted or simplified.

  Remote operation system 100 according to the present embodiment differs from that according to the first embodiment in that server 50 communicates with operation terminal 60 and controller 30 according to the WebSocket method. After establishing a connection with each of the operation terminal 60 and the controller 30, the server 50 performs bidirectional communication with each of the operation terminal 60 and the controller 30.

  In FIG. 18, signals transmitted among the operation terminal 60, the server 50, the controller 30, and the electric device 11 according to the present embodiment are shown in time series.

  As shown in FIG. 18, the connection between the operation terminal 60 and the server 50 is established by the WebSocket connection request C1 from the operation terminal 60 and the response C2. After this connection is established, the server 50 can transmit data to the operation terminal 60 without receiving a request from the operation terminal 60.

  Further, the connection between the controller 30 and the server 50 is established by the WebSocket connection request C3 from the controller 30 and the response C4. After this connection is established, the server 50 can transmit data to the controller 30 without receiving a request from the controller 30.

  In addition, the operation terminal 60 according to the present embodiment displays on the display screen 651 the communication status and the fact that the operation content has arrived at the electric device 11 from the time when the operation content is transmitted until the operation result is acquired. Without displaying, a display for simply waiting the user U2 is made. For example, as shown in FIG. 19, the control unit 61 displays a box B30 that explains that the operation content is being transmitted.

  As described above, the server 50 according to the present embodiment can transmit data to each of the operation terminal 60 and the controller 30 without waiting for a request from each of the operation terminal 60 and the controller 30. Thereby, the time lag which arises in the case of transmission of the operation content and status signal by the server 50 can be shortened.

  The server 50 communicates using a data frame dedicated to the WebSocket method. Since the capacity of the header of this data frame is smaller than that of HTTPS or HTTP, communication loss is reduced.

  Further, the operation terminal 60 displays the display screen 651 without the communication status area A2. Thereby, information displayed on the display screen 651 is reduced, and a simple display screen 651 can be displayed to the user U2.

Embodiment 3 FIG.
Next, the third embodiment will be described focusing on the differences from the first embodiment. In addition, about the structure which is the same as that of the said Embodiment 1, or equivalent, while using an equivalent code | symbol, the description is abbreviate | omitted or simplified.

  Remote operation system 100 according to the present embodiment differs from that according to the first embodiment in that server 50 communicates with controller 30 according to a polling method. In other words, the server 50 communicates with the controller 30 by responding to a periodic HTTPS request from the controller 30. The controller 30 repeatedly transmits an HTTPS request to the server 50, for example, at a cycle of 5 minutes.

  In FIG. 20, signals transmitted among the operation terminal 60, the server 50, the controller 30, and the electric device 11 according to the present embodiment are shown in time series. As shown in FIG. 20, the communication between the operation terminal 60 and the server 50 and the communication between the controller 30 and the server 50 are both composed of a request (HTTPS request) and a response immediately after this request.

  As described above, the server 50 according to the present embodiment communicates with the controller 30 by responding to a periodic request from the controller 30. Thereby, although a time lag of about 5 minutes at the maximum occurs in the transmission of the operation content by the server 50, the remote operation system 100 can be easily implemented.

  As mentioned above, although embodiment of this invention was described, this invention is not limited by the said embodiment.

  For example, the server 50 may notify the operation terminal 60 of the state of the electrical device 11 by communication other than communication according to HTTPS. For example, it is conceivable to notify using an e-mail notification or a push notification function provided in the OS (Operating System) of the operation terminal 60.

  The operation terminal 60 may set a group to which each of the electrical devices 11 to 13 belongs in advance, and display information corresponding to the group on the display screen 651. For example, it is possible to alert the user U2 by displaying a relatively large amount of information about a device having a member that generates heat. Moreover, about the apparatus which has a member which is easy to fail, the reliability of information can be improved by giving priority and displaying the measurement result of an external sensor rather than the state of an apparatus.

  In the communication status area A2, information related to communication failure is mainly displayed, but the present invention is not limited to this. For example, even if no communication failure has occurred, based on a response (step S507) from the server 50 that has received the operation content, the icon I60, that the operation content has been transmitted to at least the server 50. You may display by the line which connects I50.

  Further, the remote operation system 10 may be configured without the sensor 19. When the sensor 19 is omitted, the electric device 11 includes a thermopile sensor, a camera image, or the like as the detection unit 14, so that the temperature at a position away from the electric device 11 can be measured.

  Moreover, in the said embodiment, although the operation mode, preset temperature, and driving | operation ON / OFF were described as the state of the electric equipment 11, it is not limited to this. For example, the energy saving mode indicating the set upper limit value of power consumption may be set as the state of the electric device 11. Further, the state transition itself according to the above embodiment may be defined as a state. For example, each of being on, off, and changing (transitioning) from on (off) to off (on) may be treated equally as the state of the electrical device 11.

  The functions of the controller 30, the server 50, and the operation terminal 60 according to the above-described embodiment can be realized by dedicated hardware or by a normal computer system.

  For example, the programs stored in the storage units 34, 53, and 63 are read by a computer such as a flexible disk, a CD-ROM (Compact Disk Read-Only Memory), a DVD (Digital Versatile Disk), and an MO (Magneto-Optical disk). By storing the program in a possible recording medium and distributing the program and installing the program in a computer, an apparatus that executes the above-described processing can be configured.

  Further, the program may be stored in a disk device or the like included in a predetermined server device on a communication network such as the Internet, and may be downloaded onto a computer by being superimposed on a carrier wave, for example.

  The above-described processing can also be achieved by starting and executing a program while transferring it via a communication network.

  Furthermore, the above-described processing can also be achieved by executing all or part of the program on the server device and executing the program while the computer transmits and receives information regarding the processing via the communication network.

  In addition, when the above functions are realized by sharing the OS, or when the functions are realized by cooperation between the OS and the application, only the part other than the OS may be stored in the medium and distributed. You may download to a computer etc.

  Further, the means for realizing the functions of the controller 30, the server 50, and the operation terminal 60 is not limited to software, and part or all of the means may be realized by dedicated hardware (circuit or the like).

  DESCRIPTION OF SYMBOLS 100 Remote operation system, 10 Housing, 11-13 Electrical apparatus, 19 Sensor, 20 Home network, 30 Controller, 40 Wide area network, 50 Server, 60 Operation terminal, 111, 31, 51, 61 Control part, 112, 52, 62 Communication unit, 32 First communication unit, 33 Second communication unit, 113, 34, 53, 63 Storage unit, 114 Detection unit, 115 Operation unit, 116, 64 Input unit, 65 Display unit, 651 Display screen, A1 Operation area , A2 communication status area, A3 device status area, B1-B4, B21, B22, B30 box, B5 button, C1, C3 WebSocket connection request, C2, C4 response, I11, I30, I50, I60 icon, R1-R5 lines U1, U2 users.

The present invention relates to a remote operation system, a controller, a server, a remote operation method, and a program.

In order to achieve the above object, a remote operation system according to the present invention includes a controller for controlling an electrical device installed in a residence, a server connected to the controller via a wide area network, and an operation terminal connected to the wide area network. A display unit that displays information for operating the electric device to the user, an acquisition unit that acquires the content of the operation on the electric device from the user, and an acquisition device. The operation content transmitting means for transmitting the content of the operation acquired by the means to the server, and the status receiving means for receiving the status signal indicating the status of the electrical equipment from the server, the display means is indicated by the status signal displays the status of the electrical device, the server transmits the contents of the operations transmitted by the operation content transmission unit of the operation terminal to the controller Misao And content transmission means includes a state transmitting means for transmitting a status signal from the controller to the operation terminal, the controller is control means for controlling the electrical device based on the content of the operation transmitted by the server of the operation content transmission means If, to generate a state signal to obtain the status of the electrical device from the electrical equipment, possess a status transmitting means for transmitting to the server, the controller requests transmission of content of the operation to the server, the operation contents of the server The transmission means holds the response to the request from the controller when the operation content is not transmitted by the operation content transmission means of the operation terminal, and from the controller when the operation content is transmitted by the operation content transmission means. In response to the request, the contents of the operation are transmitted to the controller .

The present invention, remote control system, a controller及 beauty program.

In order to achieve the above object, a remote operation system according to the present invention includes a controller for controlling an electrical device installed in a residence, a server connected to the controller via a wide area network, and an operation terminal connected to the wide area network. A display unit that displays information for operating the electric device to the user, an acquisition unit that acquires the content of the operation on the electric device from the user, and an acquisition device. The operation content transmitting means for transmitting the content of the operation acquired by the means to the server, and the status receiving means for receiving the status signal indicating the status of the electrical equipment from the server, the display means is indicated by the status signal The server displays the status of the electrical equipment, and the server transmits an operation content transmitted by the operation content transmission means of the operation terminal to the controller. Control means for controlling the electrical equipment based on the content of the operation transmitted by the operation content transmission means of the server, the content transmission means and the status transmission means for transmitting the status signal from the controller to the operation terminal A status transmission unit that obtains the status of the electrical device from the electrical device, generates a status signal, and transmits the status signal to the server; and determines whether the electrical device is in a state in accordance with control by the control unit, and the determination result Determination result transmitting means for transmitting to the server, and the server further includes determination result transmitting means for transmitting the determination result transmitted by the determination result transmitting means to the operation terminal, and the display means of the operation terminal includes: to display the information corresponding to the result of the determination transmitted by the server of the determination result transmission means, the controller requests transmission of content of the operation to the server, the operation content Den The means holds the response to the request from the controller when the operation content is not transmitted by the operation content transmission means of the operation terminal, and when the operation content is transmitted by the operation content transmission means, In response to the request, the contents of the operation are transmitted to the controller.

Claims (20)

A remote operation system comprising a controller that controls electrical equipment installed in a residence, a server connected to the controller via a wide area network, and an operation terminal connected to the wide area network,
The operation terminal is
Display means for displaying information for operating the electrical equipment to the user;
Obtaining means for obtaining the content of the operation on the electrical device from a user;
Operation content transmitting means for transmitting the content of the operation acquired by the acquiring means to the server;
Status receiving means for receiving a status signal indicating the status of the electrical device from the server;
Have
The display means displays the state of the electrical device indicated by the state signal;
The server
Operation content transmission means for transmitting the operation content transmitted by the operation content transmission means to the controller;
Status transmission means for transmitting the status signal from the controller to the operation terminal;
Have
The controller is
Control means for controlling the electrical equipment based on the content of the operation transmitted by the operation content transmission means;
Status transmitting means for acquiring the status of the electrical device from the electrical device, generating the status signal, and transmitting the status signal to the server;
Having a remote control system. The wide area network is the Internet;
The server is a web server;
The display means displays a web page distributed from the web server as information for operating the electrical device.
The remote control system according to claim 1. The operation content transmission means includes
Transmits the content of the operation to the controller according to the Comet method.
The remote control system according to claim 1 or 2. The operation content transmission means includes
Transmits the operation contents to the controller according to the WebSocket method.
The remote control system according to claim 1 or 2. The operation content transmission means includes
In response to a periodic request from the controller, the contents of the operation are transmitted to the controller.
The remote control system according to claim 1 or 2. The state transmitting means includes
Periodically acquiring the status of the electrical device from the electrical device and transmitting the status signal;
The remote control system according to any one of claims 1 to 5. The controller is
A determination result transmitting means for determining whether or not the electrical device is in a state in accordance with control by the control means, and transmitting a determination result to the server;
The server
A determination result transmission means for transmitting the determination result transmitted by the determination result transmission means to the operation terminal;
The display means includes
Displaying information according to the determination result transmitted by the determination result transmission means;
The remote control system according to any one of claims 1 to 6. A detection unit that is installed in the residence and is capable of detecting a change in environment due to the electric device controlled by the control unit;
The controller is
A detection result transmission means for acquiring a result of detection by the detection means and transmitting the result to the server;
The server
Detection result transmission means for transmitting the detection result transmitted by the detection result transmission means to the operation terminal;
The display means includes
Displaying the detection result transmitted by the detection result transmitting means;
The remote control system according to any one of claims 1 to 7. The controller is
First communication status transmission means for transmitting a first communication status signal indicating the status of communication with the electrical device to the server;
The server
Second communication status transmission means for transmitting the first communication status signal transmitted by the first communication status transmission means and a second communication status signal indicating the status of communication with the controller to the operation terminal; And
The display means includes
Displaying the status of communication indicated by the communication status signal transmitted by the second communication status transmitting means, and the status of communication with the server;
The remote control system according to any one of claims 1 to 8. The display means includes
Displaying information for assisting the user based on the communication status indicated by the communication status signal and the communication status with the server;
The remote control system according to claim 9. A controller that is connected to a server via a wide area network to which an operation terminal is connected and that controls electrical equipment installed in a residence,
Receiving means for receiving the content of the operation on the electrical device acquired by the operation terminal and transmitted from the operation terminal via the server;
Control means for controlling the electric device based on the content of the operation received by the receiving means;
Status notification means for acquiring the status of the electrical device from the electrical device and notifying the acquired status to the operation terminal via the server;
Controller with. The receiving means includes
Receiving the content of the operation from the server according to the Comet method;
The controller according to claim 11. The receiving means includes
Receiving the content of the operation from the server according to the WebSocket method;
The controller according to claim 11. The receiving means includes
Receiving the contents of the operation by periodically requesting the server;
The controller according to claim 11. The state notification means includes
Periodically acquiring the state of the electric device from the electric device, and notifying the acquired state to the operation terminal;
The controller according to any one of claims 11 to 14. A determination result notifying means for determining whether or not the electrical device is in a state in accordance with control by the control means, and notifying a result of the determination to the operation terminal via the server;
The controller according to claim 11, further comprising: A detection result is obtained from a detection unit that is installed in the residence and is capable of detecting a change in environment due to the electrical device controlled by the control unit, and the obtained detection result is transmitted to the operation via the server. Detection result notification means for notifying the terminal,
The controller according to claim 11, further comprising: A communication status notification means for notifying the operation terminal of the status of communication with the electrical device via the server;
The controller according to claim 11, further comprising: A remote operation method for operating the electric device by a controller for controlling the electric device installed in a residence, a server connected to the controller via a wide area network, and an operation terminal connected to the wide area network Because
A first display step in which the operation terminal displays information for operating the electrical device to the user;
An acquisition step in which the operation terminal acquires the content of the operation on the electrical device from the user;
An operation content transmission step in which the operation terminal transmits the content of the operation acquired in the acquisition step to the server;
An operation content transmission step in which the server transmits the operation content transmitted in the operation content transmission step to the controller;
Based on the content of the operation transmitted in the operation content transmission step, the control step in which the controller controls the electrical device;
A state transmitting step in which the controller acquires a state of the electric device from the electric device, generates a state signal indicating the state of the electric device, and transmits the state signal to the server;
A status transmission step in which the server transmits the status signal transmitted in the status transmission step to the operation terminal;
A status receiving step in which the operating terminal receives the status signal transmitted in the status transmitting step from the server;
A second display step in which the operation terminal displays to the user the state of the electrical device indicated by the state signal received in the state reception step;
Including remote control method. A computer connected to the server via a wide area network to which the operation terminal is connected and controlling the electrical equipment installed in the residence,
Receiving means for receiving the content of the operation on the electrical device acquired by the operation terminal and transmitted from the operation terminal via the server;
Control means for controlling the electric device based on the content of the operation received by the receiving means;
Status notification means for acquiring the status of the electrical device from the electrical device and notifying the acquired status to the operation terminal via the server;
Program to function as.

Images