JP6681582B2 - Information terminal control method and air conditioning control system in air conditioning control system - Google Patents

Description

  The present invention relates to a control method and a control method for a communication terminal device, which controls an air conditioning control system that further enhances the ease of operation while maintaining certainty of control when controlling an air conditioning device in a home via a communication network. The present invention relates to a device and a program.

  BACKGROUND ART Conventionally, there is an air conditioning control system that connects an air conditioning apparatus in a home to a communication network and controls the air conditioning apparatus in the home via the communication network using a communication terminal device such as a mobile phone or a smartphone.

JP, 2015-49032, A

  However, the air conditioning control system described above requires further improvement.

  In order to solve the above problems, one aspect of an air conditioning control system is an air conditioning apparatus that sounds a notification sound when normal control is executed according to a received predetermined control signal, and detects ambient sound. A control method for controlling the operation of a computer of the information terminal in an air conditioning control system in which an information terminal having a possible microphone, a display and a computer is connected via a network. In response to an operation, a control signal for controlling the operation of the air conditioner is transmitted via the network, and the air conditioner controls the microphone in the microphone within a predetermined time after the control signal is transmitted. If it is determined that a notification sound indicating that a signal has been received is detected, and if it is determined that the notification sound is not detected, When it is determined that the operation information indicating the operation status of the air conditioner is received from the air conditioner via the network and the notification sound is detected, the display is controlled based on the control signal. The control completion information indicating that is completed is displayed.

  With the above aspect, further improvement can be realized.

The figure which shows the structure of the air conditioning control system in Embodiment 1 of this invention. The structure of the air conditioning control system in Embodiment 1 of this invention is shown. The figure which shows the structure of the communication terminal device in Embodiment 1 of this invention. The figure which shows the structure of the household appliances adapter in Embodiment 1 of this invention The figure which shows the structure of the air conditioning apparatus in Embodiment 1 of this invention. The figure which shows the structure of the cloud server in Embodiment 1 of this invention The figure which shows an example of a display of the communication terminal device in Embodiment 1 of this invention. The figure which shows an example of a display of the communication terminal device in Embodiment 1 of this invention. The figure which shows an example of a display of the communication terminal device in Embodiment 1 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 1 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 1 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 2 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 3 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 4 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 5 of this invention. The figure which shows the structure of the air conditioning control system in Embodiment 6 of this invention. The figure which shows the structure of cooperation apparatus control information in Embodiment 6 of this invention. The figure which shows an example of the setting screen of the cooperation apparatus control information in Embodiment 6 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 6 of this invention. The figure which shows the flow of operation | movement of the air conditioning control system in Embodiment 6 of this invention.

(Knowledge leading to the invention)
In controlling the air conditioner, it is important that the operation intended by the user is reliably performed on the air conditioner side from the viewpoint of control reliability. In particular, since the operation of closing the power supply circuit of the air conditioner (switch ON) has a large influence when the operation fails, the terminal device or the body of the air conditioner is required to give feedback to the user. To be

  In particular, when controlling an air conditioner in a home via a communication network, the user can control the air conditioner even in a remote place, so feedback by voice using an alarm sound emitted from the air conditioner body or LED lighting. It is necessary to consider that the feedback by light such as may not reach remote users.

  Therefore, after the communication terminal device remotely controls the air conditioner, immediately after obtaining the state information from the air conditioner, a method of automatically displaying the state information on the screen of the communication terminal device is disclosed. (Patent Document 1, etc.).

  In the conventional example, in order for the communication terminal device to display the operating state of the air conditioner, the communication terminal device acquires the result of remote control from the air conditioner via a wide area line or the like. When passing through a wide area line, it may take several seconds to several tens of seconds. In the meantime, some communication terminal devices display a screen (so-called loading screen) for prohibiting subsequent operations to the user, indicating that the user is communicating.

  In the above-mentioned conventional configuration, while the communication terminal device displays the loading screen, the user cannot perform any operation and waits. Therefore, the conventional technology has a problem of impairing operation comfort. .

  Further, when the user is near the air conditioner, but the remote control mechanism is intentionally used, the problem becomes particularly remarkable.

  In this case, the user can receive feedback from the air conditioner body by a notification sound or the like, but the communication terminal device has only the disadvantage of waiting time because the control result is acquired from the communication line. Was becoming. In addition, when remote control of home appliances such as air conditioners from information terminals via networks has become widespread, network traffic is increased in order for the information terminals to acquire the operating status of home appliances. There is concern that it will end up.

  Therefore, the following improvement measures were examined to improve the function of the air conditioning control system.

  One aspect of an air conditioning control system is capable of detecting ambient air and an air conditioning apparatus including an alarm sound generating unit that sounds an alarm sound when normal control is executed in accordance with a received predetermined control signal. In an air conditioning control system in which a microphone, a display, and an information terminal having a computer are connected via a network, there is provided a control method for controlling the operation of the computer of the information terminal, wherein the user operates the computer. Accordingly, the control signal for controlling the operation of the air conditioner is transmitted via the network, and within a predetermined time after the control signal is transmitted, the air conditioner transmits the control signal in the microphone. If it is determined that the notification sound indicating acceptance has been detected, and if it is determined that the notification sound is not detected, the above When it is determined that the operation information indicating the operation status of the air conditioner is received from the air conditioner via the network and the notification sound is detected, the control based on the control signal is displayed on the display. The control completion information indicating the completion is displayed.

  According to the above aspect, when it is determined that the air conditioner has detected the notification sound indicating that the air conditioner has received the control signal in the microphone of the information terminal, the operating condition of the air conditioner is confirmed via the network. Instead, the control completion information indicating that the control based on the control signal is completed is displayed on the display of the information terminal. Thereby, for example, when the user performs remote control on the air conditioner using the information terminal near the air conditioner, the information terminal can omit the operation confirmation to the air conditioner via the network. Therefore, it is possible to prevent an increase in network traffic. Further, the user does not have to wait for the information terminal to complete the operation confirmation with respect to the air conditioner. Furthermore, when it is determined that the alarm sound emitted by the body of the air conditioner is not detected, the operation status of the air conditioner is displayed on the display. Can be confirmed.

  Therefore, regardless of whether the user is near or remote from the air conditioner, it is possible to omit unnecessary operation confirmation for the air conditioner while reliably receiving feedback from the air conditioner.

  In the above aspect, for example, the control signal may include an instruction to change the operating state of the air conditioner from an OFF state to an ON state.

  In the above aspect, for example, the control signal may include an instruction to change the operating state of the air conditioner from an ON state to an OFF state.

  In the above aspect, for example, the notification sound generating unit performs sound reproduction of a predetermined pattern when normal control is executed in the air conditioning apparatus according to a predetermined control signal received by the air conditioning apparatus, Whether the microphone detects a predetermined pattern of sound reproduced when the air conditioner receives the control signal, within a predetermined time after the control signal is transmitted to the computer. If it is determined that the sound of the predetermined pattern is not detected, the operation information indicating the operation status of the air conditioner may be received from the air conditioner via the network. Good.

  In the above aspect, for example, the air conditioner further includes a notification light generator that emits visible light in a predetermined pattern when normal control is executed in response to a received predetermined control signal, and the information terminal Is further provided with an optical sensor, and a visible light indicating that the air conditioner has received the control signal at the optical sensor within a predetermined time after transmitting the control signal to the computer. If it is determined that light is detected and it is determined that the notification sound is not detected, or if the visible light is not detected, the air conditioner is passed through the network. From the above, the operation information indicating the operation status of the air conditioner may be received.

  In the above aspect, for example, the fact that the control according to the control signal is not performed from the air conditioner in the microphone within a predetermined time after the control signal is transmitted to the computer It is determined whether or not an abnormal sound is detected, and when it is determined that the abnormal sound is detected, operation information indicating an operation condition of the air conditioner is displayed from the air conditioner via the network. It may be received.

  In the above aspect, for example, the control completion information may be displayed as an image on the display.

  In the above aspect, for example, when it is determined that the notification sound is detected, a second control signal for controlling the operation of another device installed in the same room as the air conditioner is transmitted via the network, It may be transmitted to the other device.

  In the above aspect, for example, the other device may be a lighting device.

  In the above aspect, for example, the other device may be an audio device.

  In the above aspect, for example, the computer may be caused to further acquire time information indicating the current time, and the control content indicated by the second control signal may be switched based on the time information.

  In the above aspect, for example, the operation information is the information received from the air conditioning apparatus via the network in response to a request signal received by the air conditioning apparatus from the information terminal and requesting acquisition of the operation information. It may be information transmitted to the terminal.

  In the above aspect, for example, the operation information is information transmitted from the air conditioning apparatus to the information terminal via the network when the air conditioning apparatus receives the control information from the information terminal. May be.

  In the above aspect, for example, when the operation information is further received by the computer, the operation status of the air conditioner based on the operation information may be displayed on the display.

  In another aspect, an air conditioner including an alarm sound generating unit that sounds an alarm sound when normal control is executed according to the received predetermined control signal, and a microphone that can detect ambient sound, An air conditioning control system in which a display and an information terminal having a computer are connected via a network, and the air conditioning apparatus controls the operation of the air conditioning apparatus from the information terminal via the network. A first communication unit that receives a control signal, a second communication unit that transmits the operation information indicating the operation status of the air conditioner to the information terminal via the network, and the received control signal A first control unit that controls the operation of the air conditioner according to the above, and a notification sound generation unit that sounds a notification sound when normal control is executed according to the control signal. And a third communication unit that transmits the control signal for controlling the operation of the air conditioning apparatus to the air conditioning apparatus via the network, to the air conditioning apparatus, and to the air conditioning apparatus. A fourth communication unit that transmits a request signal requesting transmission of the operation information indicating the operation status of the air conditioner via the network, and within a predetermined time after transmitting the control signal, In the microphone, a detection unit that determines whether or not the air conditioner has detected a notification sound indicating that the control signal has been received, and a second control unit that controls operations of the communication unit and the display. If the second control unit determines that the detection unit does not detect the notification sound, the second control unit causes the fourth communication unit to communicate with the air conditioner via the network. The request signal is transmitted and when it is determined that detects the notification sound, the display to display the control completion information indicating that control based on the control signal is completed.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
(Configuration of air conditioning control system)
FIG. 1 is a diagram showing a schematic configuration of an air conditioning control system 1000 according to the present embodiment. As shown in FIG. 1, the air conditioning control system 1000 includes an air conditioning apparatus 100 connected to a home appliance adapter 50 installed in a user's home (indoor) 500, and communication terminal devices (terminal devices) 300-1 and 300. -2 and the cloud server 200 of the air conditioning apparatus 100.

  Although FIG. 1 illustrates the communication terminal devices 300-1 and 300-2 and two communication terminal devices, the number is not limited to this. When it is not necessary to describe these individually, they are collectively referred to as communication terminal device 300.

  In the present embodiment, by registering the combination of the communication terminal device 300 and the home appliance adapter 50 in the cloud server 200, it is possible to remotely operate the air conditioner 100 to which the home appliance adapter 50 is connected from the communication terminal device 300. To do.

  In the air conditioning control system 1000 shown in FIG. 1, two communication terminal devices 300 (300-1, 300-2) and one home appliance adapter 50 are simply connected via the cloud server 200, but the cloud server 200 The plurality of communication terminal devices 300 ... And the plurality of home appliance adapters 50. Note that one communication terminal device 300 can individually operate a plurality of home appliance adapters 50 ... That is, from one communication terminal device 300, it is possible to remotely operate a plurality of devices to which the home appliance adapters are connected. Further, a plurality of communication terminal devices 300 ... Can remotely operate a device connected to one home appliance adapter 50.

  A wireless LAN, which is a local communication network, is provided in the house 500, and the relay station 400 of the wireless LAN is connected to a wide area communication network 420 including the Internet. The relay station is, for example, a communication terminal device such as a WiFi (registered trademark) router or a WiFi access point. In this embodiment, one of the wireless LAN standards, ie, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, or IEEE 802.11n is used for wireless communication. Of course, those based on a wireless LAN standard other than IEEE 802.11, for example, a specific low-power wireless or Bluetooth (registered trademark) may be used.

  The cloud server 200 can communicate with the home appliance adapter 50 installed in the house 500 via the wide area communication network 420 and the relay station 400 of the wireless LAN. The communication terminal device 300 is connected to the cloud server 200 via the wide area communication network 420. The communication terminal device 300 and the Internet in the wide area communication network 420 are connected using 3G (3rd Generation), LTE (Long Term Evolution), a home or public WiFi access point, or the like. The communication terminal device 300 can remotely operate, via the cloud server 200, the air conditioner 100 in which the combination with the home appliance adapter 50 is registered in the cloud server 200.

  The home appliance adapter 50 and the communication terminal device 300 are both wireless communication terminal devices, and can also communicate with each other via the relay station 400 without using the wide area communication network 420.

  Although a configuration including the Internet as the wide area communication network 420 is shown as an example of a communication network connecting the cloud server 200 and the relay station 400, and the communication terminal device 300 and the cloud server 200, a telephone line network, a mobile communication network, A satellite communication network or the like can also be used.

(Home appliance adapter)
The communication terminal device 300 can be, for example, a smartphone or a tablet terminal.

  The home appliance adapter 50 is an electronic device that transmits a command from the communication terminal device 300 to the air conditioning apparatus 100 via the cloud server 200. The home appliance adapter 50 is a device other than the air conditioning device 100, for example, a refrigerator, a washing machine, a cooking appliance, a lighting device, a hot water supply device, a photographing device, various AV devices, various robots (for example, a cleaning robot, a housework support robot, It can be connected to an animal type robot etc.) and can be remotely controlled from the communication terminal device 300.

  The air conditioning apparatus 100 is an apparatus that performs an air conditioning operation, and examples thereof include an air conditioner, an air cleaner, a humidifier, and a dehumidifier. The air conditioning apparatus 100 is configured to be remotely operable from the communication terminal device 300 by receiving a command from the communication terminal device 300 via the cloud server 200 and the home appliance adapter 50. The home appliance adapter 50 and the air conditioner 100 may be integrated.

  In the present embodiment, a smartphone is exemplified as communication terminal device 300, and an air conditioner is exemplified as air conditioner 100. That is, a configuration for remotely operating an air conditioner using a smartphone is illustrated.

  FIG. 2 is a diagram showing an image of remotely controlling the air conditioning apparatus 100 using the communication terminal device 300 in the air conditioning control system 1000. The communication terminal device 300 and the cloud server 200 are connected via a wide area communication network 420, and the cloud server 200 and the home appliance adapter 50 of the air conditioner 100 in the house 500 are the wide area communication network 420 and a wireless LAN relay station. Connected via 400. The relay station 400 and the home appliance adapter 50 are connected by wireless communication.

(Communication terminal device)
As illustrated in FIG. 3, the communication terminal device 300 includes a control unit 310, a storage unit 350, a display unit 360, a communication unit 370, an operation unit 380, a voice acquisition unit 390, and an ambient light acquisition unit 395.

  The control unit 310 is a block that controls the operation of each unit of the communication terminal device 300. The control unit 310 is composed of, for example, a computer device including an arithmetic processing unit such as a CPU and a dedicated processor, and is for executing various information and various controls stored in the storage unit 350 including RAM, ROM, HDD, and the like. The operation of each unit of the communication terminal device 300 is comprehensively controlled by reading out and executing the program. The control unit 310 also includes a display control unit 320 that controls the display unit 360 and a communication control unit 330 that controls the communication unit 370. Furthermore, the communication control unit 330 includes a state acquisition unit 340 that acquires (state acquisition) information (state information) indicating the state of the air conditioning apparatus 100. The communication unit 370 is a block that performs communication via the wide area communication network 420 and mutual communication between devices via the relay station 400 of the short range communication network.

  The display unit 360 is a block that displays various information to be presented to the user in response to an instruction from the display control unit 320 of the control unit 310. In the present embodiment, the status information of the air conditioner 100 acquired by the status acquisition unit 340 is displayed as shown in FIGS. 7, 8 and 9.

  The operation unit 380 is a block that receives an input from the user and transmits it to the control unit 310. The storage unit 350 is a block that stores various types of information used in the communication terminal device 300.

  The voice acquisition unit 390 is a block for acquiring voice generated around the communication terminal device 300. The voice acquisition unit may be configured by a microphone, for example.

  The ambient light acquisition unit 395 is a block for acquiring the intensity (illuminance) of light around the communication terminal device 300. The ambient light acquisition unit may be composed of, for example, an illuminance sensor such as a photodiode or a phototransistor.

(Home appliance adapter and air conditioner)
The home appliance adapter 50 is an electronic device that transmits a command to the air conditioning apparatus 100, which is received from the communication terminal apparatus 300 via the cloud server 200, to the air conditioning apparatus 100. As shown in FIG. 4, the home appliance adapter 50 includes a control unit 60, a storage unit 70, a communication unit 80, and a connection unit 90. In this embodiment, the air conditioner 100 is an air conditioner, but illustration and description of the outdoor unit of the air conditioner are omitted.

  The control unit 60 is a block that comprehensively controls the operation of each unit of the home appliance adapter 50. The storage unit 70 is a block that stores various types of information used in the home appliance adapter 50. The communication unit 80 is a block that performs the same communication as the communication unit 370 of the communication terminal device 300. The communication unit 80 includes an error detection unit 80a that detects a communication error with the cloud server 200. The connection unit 90 is a block that communicates with the connection unit 160 of the air conditioning apparatus 100. The connection unit 90 includes an error detection unit 90a that detects a communication error with the air conditioning apparatus 100.

  The air conditioning apparatus 100 is an apparatus that performs an air conditioning operation, and as illustrated in FIG. 5, the control unit 110, the storage unit 130, the driving operation unit 140, the power supply unit 150, the connection unit 160, the environment detection unit 170, and the notification sound. The generator 180 is provided.

  The control unit 110 is a block that controls the operation of each unit of the air conditioning apparatus 100. The control unit 110 includes, for example, a computer device including an arithmetic processing unit such as a CPU and a dedicated processor, and executes various information and various controls stored in the storage unit 130 including RAM, ROM, HDD, SSD, and the like. The operation of each unit of the air conditioning apparatus 100 is comprehensively controlled by reading and executing the program for performing the operation. The control unit 110 also includes a mode setting unit 120 that sets various modes of the air conditioning apparatus 100. The storage unit 130 stores various information used in the air conditioning apparatus 100.

  The driving operation unit 140 is a block that executes various driving operations of the air conditioning apparatus 100 under the control of the control unit 110. An example of the driving operation is air conditioning operation. As the air conditioning operation when the air conditioning apparatus 100 is an air conditioner as in the present embodiment, there are a cooling operation, a heating operation, a dehumidifying operation, a blowing operation, and the like. For models having an air cleaning function, there is air cleaning operation.

  Further, when the air conditioning apparatus 100 is an air cleaner, the air conditioning operation includes an air cleaning operation, and in a model having a humidifying function, there is a humidifying / air cleaning operation. Note that these are merely examples, and the present invention is not limited to these.

  The power supply unit 150 is a block that turns on and off the power supply based on an instruction from the control unit 110. The connection unit 160 is a block that performs mutual communication with the connection unit 90 of the home appliance adapter 50. The connection between the connection part 160 of the air conditioner 100 and the connection part 90 of the home appliance adapter 50 may be, for example, a connection by an RS-232 communication connector. The connection unit 160 includes an error detection unit 160a that detects a communication error with the home appliance adapter 50.

  The environment detection unit 170 is a block that measures the temperature of the house 500 (indoor temperature) and the humidity of the house 500. The environment detection unit 170 includes a temperature sensor and a humidity sensor. Further, it may be configured to measure the temperature outside the home. The environment detection unit 170 may be capable of detecting one of temperature and humidity. In addition, the environment detection unit 170 may include a configuration capable of detecting environmental conditions of the house 500 other than temperature and humidity.

  The notification sound generation unit 180 is a sound wave (notification sound) for notifying the user when the power of the power supply unit 150 is turned on or off or when various modes of the air conditioner 100 are changed under the control of the user. ) Is a block that emits. The notification sound generating section may be composed of a piezoelectric buzzer or a voice speaker.

  The air conditioning apparatus 100 may optionally include the notification light generator 190. The notification light generation unit 190 emits light for notifying the user when the power of the power supply unit 150 is turned on or off or when various modes of the air conditioner 100 are changed under the control of the user. It is a block. The notification light generating section may be configured by an LED, a cathode fluorescent tube, an incandescent lamp, or the like.

  As described above, in the present embodiment, the home electric appliance adapter 50 that enables remote control of the air conditioning apparatus 100 is externally attached, but of course, the communication function portion is incorporated in advance inside the air conditioning apparatus 100. That is, the air conditioner 100 and the home appliance adapter 50 may be integrated.

  Further, the air conditioner 100 may be operable not only by remote control from the communication terminal device 300 but also by near field communication by infrared rays using an IR remote controller. In this case, a communication unit (not shown) of the air conditioner 100 receives a command (control signal) from the IR remote controller, and various driving operations are executed under the control of the control unit 110. In this embodiment, the infrared communication is used, but other short-distance wireless or wired communication may be used.

(Cloud server)
As shown in FIG. 6, the cloud server 200 includes a control unit 210, a storage unit 220, and a communication unit 230. The control unit 210 is a block that controls the operation of each unit of the cloud server 200. The communication unit 230 is a block that performs mutual communication with the communication terminal device 300 and the home appliance adapter 50 via the wide area communication network 420. The storage unit 220 stores various information used in the cloud server 200. The storage unit 220 stores a database (DB) 220a that stores various information of the air conditioner 100 connected to the home appliance adapter 50. Further, the identification information of each home appliance adapter 50 and the identification information of each communication terminal device 300 are stored in association with each other. The communication unit 230 includes an error detection unit 230a that detects a communication error with the home appliance adapter 50.

(Flow of processing in remote operation)
The processing of each device when the air conditioner 100 is remotely operated from the communication terminal device 300 will be described.

  First, regarding the information (screen) displayed on the display unit 360 of the communication terminal device 30 when operating the air conditioning apparatus 100 with the communication terminal device 300, the examples shown in FIGS. 7, 8 and 9 will be used. explain. FIG. 7A is an example of a device selection screen showing information for selecting the air conditioner 100 to be remotely controlled. In the present embodiment, since there are two air conditioners 100 to be remotely operated from communication terminal device 300, two air conditioners are displayed in (a) of FIG. 7. When there are a plurality of remote operation targets (that is, a certain communication terminal device 300 is associated with a plurality of devices), all associated devices are displayed on the device selection screen.

  When the air conditioner 100 is selected by pressing (tapping) the icon corresponding to the device to be remotely controlled displayed on the device selection screen, as shown in (b) of FIG. The operation screen of the air conditioner 100 is displayed. The operation screen is a screen for the user to set and transmit operation conditions for the air conditioning apparatus 100. On the operation screen, an operation area 360b for setting operation conditions for the air conditioner 100 is set.

  When the user sets the operation conditions on the operation screen and presses the “send setting” button 1040 on the operation screen, a confirmation screen for confirming the user as shown in FIG. 8 is displayed.

  Then, when the “OK” button 1060 on the confirmation screen as illustrated in (c) of FIG. 8 is pressed, the communication terminal device 300 has information on an operation instruction to the air conditioning apparatus 100 (hereinafter, operation instruction is abbreviated). Is transmitted to the cloud server 200. During the transmission of the operation instruction, the communication terminal device 300 displays information (loading screen) indicating that the transmission is being performed on the display unit 360, as shown in FIG. 8D, and does not accept the operation.

  Next, the processing of each device after transmitting the operation instruction will be described with reference to FIGS. 10 and 11.

  First, the communication terminal device 300 receives an operation instruction to the air conditioning apparatus 100 from the user and transmits it to the cloud server 200 (step 1, hereinafter omitted as S1). At this time, an identification number is also transmitted to identify which home appliance adapter 50 (or which air conditioner 100) is the operation instruction. Then, the communication terminal device 300 displays a loading screen (S2). Then, the communication terminal device 300 waits for a predetermined time (S3).

  When the cloud server 200 receives the operation instruction from the communication terminal device 300 (S4), the cloud server 200 determines the home appliance adapter 50 (or the air conditioner 100) to which the operation instruction should be transmitted (S5). The operation instruction is transmitted (S6).

  When the home appliance adapter 50 receives the operation instruction from the cloud server 200 (S7), the home appliance adapter 50 transmits the operation instruction to the air conditioning apparatus 100 connected by the connection unit 90 (S8).

  When the air conditioner 100 receives an operation instruction from the home appliance adapter 50 (S9), it sets itself to execute an operation corresponding to the received operation instruction, and the operation (for example, operation start, operation stop, set temperature change, The operation mode is changed) (S10).

  Next, the air conditioning apparatus 100 sounds a notification sound when the power is turned on from the power off. If the power has already been turned on, a notification sound may be sounded. After that, the air conditioner 100 sends a reply to the home appliance adapter 50 (S12).

  When the home appliance adapter 50 receives the reply from the air conditioner 100 (S21), it sends the reply to the cloud server 200 (S22).

  Upon receiving the reply from the home appliance adapter 50 (S25), the cloud server 200 transmits the reply to the communication terminal device 300 (S26).

  When the communication terminal device 300 cannot detect the notification sound emitted by the air conditioning device 100 within the predetermined time from step 3, after receiving a reply from the cloud server 200 (S28), the communication terminal device 300 makes a status inquiry to the cloud server 200. It is transmitted (S31 in FIG. 11). At this time, an identification number is also transmitted to identify which home appliance adapter 50 (or which air conditioner 100) is the operation instruction.

  Upon receiving the operation instruction from the communication terminal device 300 (S33), the cloud server 200 determines the home appliance adapter 50 (or the air conditioner 100) to which the status inquiry should be transmitted (S35), and the determined home appliance adapter 50. A status inquiry instruction is transmitted to (S38).

  Upon receiving the status inquiry from the cloud server 200 (S40), the home appliance adapter 50 transmits the status inquiry to the air conditioner 100 (S42).

  When the air conditioner 100 receives a status inquiry from the home appliance adapter 50 (S44), the air conditioner 100 acquires status information indicating the internal state of the home appliance (S46), and the home appliance adapter 50 connecting it with the connection unit 160. (S48). The state information acquired in S46 includes at least information as to whether or not the own device is in the power-on state.

  When the home appliance adapter 50 receives the status information from the air conditioner 100 (S50), it sends it to the cloud server 200 (S52).

  Upon receiving the state information from the home appliance adapter 50 (S54), the cloud server 200 transmits the state information to the communication terminal device 300 (S56).

  Upon receiving the status information from the cloud server 200 (S58), the communication terminal device 300 ends the display of the loading screen (S60). Next, among the status information received from the cloud server 200, information including at least information indicating the status of the power supply of the air conditioner is displayed (S62). On the screen displayed in step 62, the state of the power supply of the air conditioner is displayed, as shown in FIG. In addition to this, the set temperature of the air conditioner, the operation mode, the wind direction and the air volume may also be displayed.

  On the other hand, when the communication terminal device 300 detects the notification sound generated by the air conditioner 100 within a predetermined time from step 3 (S101 in FIG. 10), the display of the loading screen ends (S102 in FIG. 10). Next, the communication terminal device 300 displays a screen indicating that the control of the air conditioner as shown in (e) of FIG. 9 is completed (S103).

  In the present embodiment, whether or not to immediately terminate the display of the loading screen in which the user does not accept the operation of communication terminal device 300 depends on whether or not communication terminal device 300 detects the notification sound that air conditioner 100 sounds. Has been decided.

  Here, that the communication terminal device 300 detects the notification sound means that the user who operates the communication terminal device 300 also hears the notification sound. That is, it means that the user has been given feedback. In this case, it is not necessary to display the loading screen any more and make the user wait.

  In the present embodiment, communication terminal device 300 terminates the display of the loading screen immediately when it detects the notification sound of air conditioner 100 ringing in S101, so that the period during which the screen cannot be operated by the user is shortened. You can

  Further, when the communication terminal device 300 cannot detect the notification sound of the air conditioning device 100 ringing in S101, the communication terminal device 300 acquires the state information of the air conditioning device 100 via the cloud server 200 and the home appliance adapter 50, and then performs communication. The status information is displayed on the screen of the terminal device 300.

  As a result, when the user is far away from which the alarm sound of the air conditioner 100 cannot be detected, the user can turn on the power by remote control based on the status information displayed on the screen of the communication terminal device 300. The embodiment according to the present invention has an advantage that it is possible to judge whether the operation is performed as intended.

(Embodiment 2)
FIG. 12 is a diagram showing a flow of processing in remote operation according to the second embodiment of the present invention. 12, the same components as those in FIGS. 10 and 11 are designated by the same reference numerals, and the description thereof will be omitted.

  When the air conditioner 100 receives the operation instruction in step 9, the air conditioner 100 sounds a notification sound (S11). Next, the air conditioning apparatus 100 transmits the status information including the ON / OFF state of the power supply of the air conditioning apparatus 100 to the home appliance adapter 50 (S48).

  When the home appliance adapter 50 receives the status information from the air conditioner 100 (S51), it sends it to the cloud server 200 (S52).

  The subsequent remote operation flow is the same as the operation flow of FIG. 11 in the first embodiment.

  On the other hand, when the communication terminal device 300 detects the notification sound emitted by the air conditioner 100 within a predetermined time from step 3 (S101 in FIG. 10), the display of the loading screen ends (S102 in FIG. 10). Next, the communication terminal device 300 displays a screen indicating that the control of the air conditioner has been completed (S103).

  The present invention can be applied even when the air conditioner 100 automatically returns status information when receiving an operation instruction.

(Embodiment 3)
FIG. 13 is a diagram showing a flow of processing in remote operation according to the third embodiment of the present invention. 13, the same components as those in FIGS. 10 and 11 are designated by the same reference numerals, and the description thereof will be omitted.

  When the air conditioner 100 receives the operation instruction in step 9, the air conditioner 100 sounds a notification sound (S11). Next, the air conditioning apparatus 100 starts light emission in a predetermined pattern (S211). Next, the air conditioning apparatus 100 transmits a reply to the home appliance adapter 50 (S12).

  When the communication terminal apparatus 300 detects the notification sound emitted by the air conditioning apparatus 100 within a predetermined time from step 3 (S101 in FIG. 10), the communication terminal apparatus 300 determines whether to detect the light of the predetermined pattern emitted by the air conditioning apparatus 100. Perform (S212). When both the notification sound and the light of the predetermined pattern are detected, the display of the loading screen ends (S102 in FIG. 10). Next, the communication terminal device 300 displays a screen indicating that the control of the air conditioner has been completed (S103).

  On the other hand, when the communication terminal device 300 determines that either the notification sound emitted by the air conditioning device 100 or the light of the predetermined pattern emitted by the air conditioning device 100 is not detected within the predetermined time from step 3. , And sends the cloud server 200 status inquiry (S31 in FIG. 11).

  The subsequent remote operation flow is the same as the operation flow of FIG. 11 in the first embodiment.

  In the embodiment of the present invention, in addition to the notification sound emitted by the air conditioner, by using the light of a predetermined pattern emitted by the air conditioner for determination, the air conditioner to be controlled, and by chance the same sound. Even when an electric device that emits a notification sound having a pattern exists near the communication terminal device, it is possible to recognize with high accuracy that the electric device that emits the notification sound is an air conditioner. .

(Embodiment 4)
FIG. 14 is a diagram showing a flow of processing in remote operation according to the fourth embodiment of the present invention. 14, the same components as those in FIGS. 13 and 11 are designated by the same reference numerals, and the description thereof will be omitted.

  When the air conditioner 100 receives the operation instruction in step 9, the air conditioner 100 sounds a notification sound (S11). Next, the air conditioning apparatus 100 reproduces a predetermined sound (S221). Next, the air conditioning apparatus 100 transmits a reply to the home appliance adapter 50 (S12).

  When the communication terminal device 300 detects the notification sound emitted by the air conditioning device 100 within a predetermined time from step 3 (S101 in FIG. 10), the communication terminal device 300 determines whether or not a predetermined sound emitted by the air conditioning device 100 can be detected ( S222). When both the notification sound and the predetermined voice are detected, the display of the loading screen ends (S102 in FIG. 10). Next, the communication terminal device 300 displays a screen indicating that the control of the air conditioner has been completed (S103).

  On the other hand, if the communication terminal device 300 determines that either the notification sound emitted by the air conditioning device 100 or the predetermined sound emitted by the air conditioning device 100 is not detected within the predetermined time from step 3, The cloud server 200 status inquiry is transmitted (S31 in FIG. 11).

  The subsequent remote operation flow is the same as the operation flow of FIG. 11 in the first embodiment.

  In the embodiment of the present invention, in addition to the notification sound emitted by the air conditioner, by using a predetermined sound emitted by the air conditioner for determination, the air conditioner to be controlled, and the pattern of the same sound happens to be the same. Even when the electric device that emits the notification sound exists near the communication terminal device, it is possible to recognize with high accuracy that the electric device that emits the notification sound is the air conditioner.

(Embodiment 5)
FIG. 15 is a diagram showing a flow of processing in remote operation according to the fourth embodiment of the present invention. In FIG. 15, the same components as those in FIGS. 13 and 11 are designated by the same reference numerals, and the description thereof will be omitted.

  When the air conditioner 100 receives the operation instruction in step 9, the air conditioner 100 sounds a notification sound according to whether the air conditioner is operating normally or in an abnormal state (S200). Next, the air conditioning apparatus 100 transmits a reply to the home appliance adapter 50 (S12).

  The communication terminal device 300 detects the notification sound emitted by the air conditioning apparatus 100 within a predetermined time from step 3, and when it is determined that the detected notification sound is the notification sound indicating normality (see FIG. 10). (S201), and the display of the loading screen ends (S102 in FIG. 10). Next, the communication terminal device 300 displays a screen indicating that the control of the air conditioner has been completed (S103).

  On the other hand, if the communication terminal device 300 detects the notification sound generated by the air conditioning apparatus 100 within the predetermined time from step 3, and is determined to be the notification sound indicating that the detected notification sound is not normal, , And sends the cloud server 200 status inquiry (S31 in FIG. 11).

  In addition, the communication terminal device 300 also transmits the cloud server 200 state inquiry (S31 in FIG. 11) even when it is determined that the notification sound emitted by the air conditioner 100 is not detected within the predetermined time from step 3.

  The subsequent remote operation flow is the same as the operation flow of FIG. 11 in the first embodiment.

  In the embodiment of the present invention, the notification sound emitted from the air conditioner is selectively used as the notification sound indicating normality and the notification sound indicating abnormality, and when the notification sound indicating abnormality is detected, the communication terminal device Since the status information is acquired from the air conditioner and displayed, the user has the advantage that the status of the air conditioner can be immediately confirmed by the user when the investigation result is abnormal.

(Embodiment 6)
FIG. 16 is a diagram showing a schematic configuration of an air conditioning control system 1010 according to the sixth embodiment. In FIG. 16, the same components as those in FIG.

  As shown in FIG. 16, the air conditioning control system 1010 includes an air conditioning apparatus 100 to which the home appliance adapter 50 installed in the user's home (indoor) 500 is connected, a communication terminal device (terminal device) 300, In addition to the air conditioner 100 and the cloud server 200, the lighting device 700 and the acoustic device 800 are included.

  The lighting device 700 and the acoustic device 800 are arranged in the vicinity of the air conditioning device 100.

  The lighting device 700 and the acoustic device 800 are controlled by the communication terminal device 300 via wired or wireless communication.

  For example, the communication terminal device 300 and the lighting device 700 or the acoustic device 800 may be controlled by infrared communication, or may be controlled by wireless communication via Bluetooth (registered trademark).

  Further, the communication terminal device 300, the lighting device 700, and the audio device 800 are connected to the in-home wireless LAN relay station 400, and the communication terminal device 300 and the lighting device 700 or the audio device 800 connect the wireless LAN relay station 400. Via, for example, WiFi such as IEEE 802.11.

  Alternatively, the communication terminal device 300 is connected to a wide area communication network such as 3G or LTE or a public WiFi network, and the lighting device 700 and the sound device 800 are connected to the relay station 400 of the in-home wireless LAN and the communication terminal device 300 is connected to the communication terminal device 300. The lighting device 700 or the audio device 800 may communicate by relaying the cloud server 200 and the relay station 400 of the wireless LAN.

  FIG. 17 shows linked device control information 600. When the user of the communication terminal device 300 is in a place where the notification sound of the air conditioner 100 can be detected, the linked device control information 600 is in the vicinity of the air conditioner 100 at the same time as or immediately after the control of the air conditioner 100. It is information that stores how to control the lighting device 700 and the acoustic device 800 arranged in the.

  The linked device control information 600 includes a time zone start time 620, a time zone end time 630, control information 640 for controlling the lighting device when the terminal is able to detect the notification sound of the air conditioner 100, and the terminal air condition. The control information 650 for controlling the audio device when the notification sound of the harmony device 100 can be detected is provided. Further, the linked device control information 600 may include character string information 610 indicating an outline of a time zone.

  FIG. 18G is an example of a screen displayed for the communication terminal device 300 to allow the user to control the cooperative device control information 600. The user refers to the setting screen shown in FIG. 18 (g) while turning on the illumination device when the start time 620 of each time zone, the end time 630 of the time zone, and the terminal can detect the notification sound of the air conditioner 100. The control information 640 for controlling and the control information 650 for controlling the audio device when the notification sound of the air conditioner 100 can be detected by the terminal can be set.

  Next, the processing of each device after transmitting the operation instruction will be described with reference to FIGS. 19 and 20. 19 and 20, the same processing contents as those in FIGS. 10 and 11 are denoted by the same reference numerals, and the description thereof will be omitted.

  When the communication terminal device 300 determines that the air conditioner 100 has sounded the notification sound within the predetermined time from step 3 (S101), the display of the loading screen ends (S102), and the cooperation device control information 600 is displayed. According to the described control information 650 for controlling the audio device, the audio operation instruction is transmitted to the audio device 800 (S302 in FIG. 20).

  Upon receiving the acoustic operation instruction from the communication terminal device 300 (S303), the audio device 800 controls the audio device according to the content of the instruction (S304) and returns a reply to the communication terminal device 300 (S305).

  Upon receiving the reply from the audio device 800 (S310), the communication terminal device 300 transmits a lighting operation instruction to the lighting device 700 according to the control information 640 for controlling the lighting device in which the cooperation device control information 600 is described ( S311).

  When the lighting device 700 receives the lighting operation instruction from the communication terminal device 300 (S312), the lighting device 700 controls the brightness and color of the lighting device according to the content of the lighting operation instruction (S313), and returns a reply to the communication terminal device 300 (S314). ).

  Upon receiving the reply from the lighting device 700 (S320), the communication terminal device 300 ends the display of the loading screen (S321). An operation completion screen is displayed (S103).

  On the other hand, when the communication terminal device 300 determines not to detect the notification sound of the air conditioning device 100 ringing within the predetermined time from step 3 (S101), the cloud server 200 receives the reply from the cloud server 200 (S28). A status wait is transmitted to (S31 of FIG. 11). The subsequent operation of the air conditioning control system 1010 is the same as the continuation flow of FIG. 11.

  In the air conditioning control system according to the sixth embodiment of the present invention, the air conditioner is detected only when the communication terminal device 300 in the vicinity of the user is detected to be in the vicinity where the notification sound emitted by the air conditioner 100 can be detected. The lighting device 700 and the acoustic device 800 in the vicinity of the harmony device 100 are controlled.

  On the other hand, when it is detected that the communication terminal device 300 in the vicinity of the user is not in the vicinity in which the notification sound emitted by the air conditioner 100 can be detected, the lighting device 700 and the acoustic device 800 in the vicinity of the air conditioner 100. Do not control.

  In the air conditioning control system according to Embodiment 6 of the present invention, when the user carrying the communication terminal device 300 is in the vicinity of the air conditioning device 100, following the control of the air conditioning device 100, the lighting device 700 and The sound device 800 is controlled according to the time of day (when waking up, the lighting and sound are controlled to be suitable for awakening, when sleeping, the lighting and sound are controlled to be suitable for sleep, and the night time is several hours before going to bed. Can provide lighting and sound suitable for relaxation.

  Moreover, the air conditioning control system concerning Embodiment 6 of this invention controls only the air conditioning apparatus 100, when the user who carries the communication terminal device 300 is not in the vicinity of the air conditioning apparatus 100, the air conditioning apparatus. The lighting device 700 and the acoustic device 800 which are in the vicinity of 100 but not in the vicinity of the communication terminal device 300 carried by the user are not controlled. For example, this is useful when the user is remote from the air conditioner before going to bed but wants to warm or cool the air in the bedroom in advance, but does not want to control lighting and sound because it wastes electricity bills. is there.

  Further, the communication terminal device or the air conditioner according to each aspect of the present invention may be realized by a computer (electronic computer). In this case, a control program for the terminal device or the air conditioner, which causes the computer to realize the communication terminal device or the air conditioner by operating the computer as each hand provided in the communication terminal device or the air conditioner, and It goes without saying that a recorded computer-readable recording medium also falls within the scope of the present invention.

  The present invention is not limited to each of the above-described embodiments, and various modifications are possible. Technical embodiments of the present invention are also applicable to embodiments obtained by appropriately combining the technical means disclosed in different embodiments. Included in the range. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  INDUSTRIAL APPLICABILITY The communication terminal device control method according to the present invention is useful for simplifying the operation when controlling the air conditioner via a public line or the like. Further, in addition to the air conditioner, the present invention can be applied to a control method via a network of electric equipment provided with means for notifying that power is turned on by using a sound such as a notification sound.

50 home appliance adapter 60 control unit 70 storage unit 80 communication unit 80a error detection unit 90 connection unit 90a error detection unit 100 air conditioner 110 control unit 120 mode setting unit 130 storage unit 140 driving operation unit 150 power supply unit 160 connection unit 160a error detection Part 170 Environment detection part 180 Notification sound generation part 190 Notification light generation part 200 Cloud server 210 Control part 220 Storage part 220a Database 230 Communication part 230a Error detection part 300 Communication terminal device 300-1 First communication terminal device 300-2 No. Second communication terminal device 310 Control unit 320 Display control unit 330 Communication control unit 340 State acquisition unit 350 Storage unit 360 Display unit 370 Communication unit 380 Operation unit 390 Voice acquisition unit 395 Ambient light acquisition unit 400 Wireless LAN relay station 420 Wide area communication Work 500 User's home 510 User's bedroom 520 User's living room 600 Cooperative device control information 610 Character string describing time zone 620 Time zone start time 630 Time zone end time 640 Lighting device control information 650 Sound device control information 700 Lighting device 800 Sound device

Claims (15)

An air conditioner including an alarm sound generating unit that sounds an alarm sound in response to execution of control for a received predetermined control signal, and an information terminal including a microphone capable of detecting ambient sound, a display, and a computer form a network. In an air conditioning control system connected via, a control method for controlling the operation of the computer of the information terminal,
For the computer,
In response to a user's operation, a control signal for controlling the operation of the air conditioner is transmitted via the network,
Within a predetermined time after transmitting the control signal, in the microphone, it is determined whether or not the notification sound that the air conditioner has sounded is detected,
When it is determined that the notification sound is not detected, the operation information indicating the operation status of the air conditioner is received from the air conditioner via the network,
When it is determined that the notification sound is detected, the control completion information indicating that the control based on the control signal is completed is displayed on the display.
Control method. The control signal includes an instruction to change an operating state of the air conditioner from an OFF state to an ON state,
The control method according to claim 1. The control signal includes an instruction to change the operating state of the air conditioner from an ON state to an OFF state,
The control method according to claim 1. The notification sound generating unit performs the reproduction of a predetermined pattern of sound according to the execution of the control for the predetermined control signal received by the air conditioner,
In addition to the computer,
Within a predetermined time from the transmission of the control signal in the microphone, to determine whether the detected speech before Kisho constant pattern,
Alternatively, when it is determined that the sound of the predetermined pattern is not detected, the operation information indicating the operation status of the air conditioner is received from the air conditioner via the network,
The control method according to claim 1. The air conditioner further comprises a notification light generator that emits visible light in a predetermined pattern according to execution of control for a received predetermined control signal,
The information terminal further includes an optical sensor,
In addition to the computer,
Within a predetermined time from the transmission of the control signal, in the optical sensor, to determine whether the detected light emitted by pre hear viewing light,
When it is determined that the notification sound is not detected or the light emission by the visible light is not detected, the operation status of the air conditioner from the air conditioner via the network. The motion information indicating
The control method according to claim 1. In addition to the computer,
Within a predetermined time after transmitting the control signal, in the microphone, it is determined whether or not to detect an abnormal sound indicating that the control according to the control signal from the air conditioner is not performed,
When it is determined that the abnormal sound is detected, the operation information indicating the operation status of the air conditioner is received from the air conditioner via the network.
The control method according to claim 1. The control completion information is displayed on the display as an image,
The control method according to claim 1. When it is determined that the notification sound is detected, a second control signal that controls the operation of another device installed in the same room as the air conditioner is transmitted to the other device via the network. Let
The control method according to claim 1. The other device is a lighting device,
The control method according to claim 8. The other device is an audio device,
The control method according to claim 8. In addition to the computer,
Get time information indicating the current time,
Switching the control content indicated by the second control signal based on the time information,
The control method according to claim 8. The operation information is transmitted from the air conditioner to the information terminal via the network in response to a request signal received by the air conditioner from the information terminal and requesting acquisition of the operation information. Information,
The control method according to claim 1. The operation information is information transmitted from the air conditioner to the information terminal via the network when the air conditioner receives the control signal from the information terminal,
The control method according to claim 1. In addition to the computer,
When the operation information is received, the operation status of the air conditioner based on the operation information is displayed on the display.
The control method according to claim 1. An air conditioner including an alarm sound generating unit that sounds an alarm sound in response to execution of control for a received predetermined control signal, and an information terminal including a microphone capable of detecting ambient sound, a display, and a computer form a network. An air conditioning control system connected via
The air conditioner,
A first communication unit that receives a control signal for controlling the operation of the air conditioner from the information terminal via the network;
To the information terminal, via the network, a second communication unit that transmits shown to operation information the operating status of the air conditioner,
A first controller that controls the operation of the air conditioner according to the received control signal;
An alarm sound generation unit that sounds an alarm sound according to the execution of control for the control signal,
The information terminal is
A third communication unit that transmits, to the air conditioner, the control signal that controls the operation of the air conditioner via the network;
A fourth communication unit that transmits, to the air conditioner, a request signal requesting transmission of the operation information indicating the operation status of the air conditioner via the network,
Within a predetermined time after transmitting the control signal, in the microphone, a detection unit that determines whether or not the air conditioner has sounded the notification sound,
A second control unit that controls operations of the fourth communication unit and the display,
When the second control unit determines that the notification sound is not detected by the detection unit, the second communication unit causes the fourth communication unit to transmit the request signal to the air conditioner via the network. When it is determined that the notification sound is detected, the display is caused to display control completion information indicating that the control based on the control signal is completed,
Air conditioning control system.

Images