WO2021111555A1 - Device control system, operation reception apparatus, server, and device control method - Google Patents

Device control system, operation reception apparatus, server, and device control method Download PDF

Info

Publication number
WO2021111555A1
WO2021111555A1 PCT/JP2019/047488 JP2019047488W WO2021111555A1 WO 2021111555 A1 WO2021111555 A1 WO 2021111555A1 JP 2019047488 W JP2019047488 W JP 2019047488W WO 2021111555 A1 WO2021111555 A1 WO 2021111555A1
Authority
WO
WIPO (PCT)
Prior art keywords
server
operation instruction
change
control target
instruction
Prior art date
Application number
PCT/JP2019/047488
Other languages
French (fr)
Japanese (ja)
Inventor
山田　貴光
矢部　正明
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2021562259A priority Critical patent/JP7191252B2/en
Priority to PCT/JP2019/047488 priority patent/WO2021111555A1/en
Publication of WO2021111555A1 publication Critical patent/WO2021111555A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Definitions

  • the present invention relates to a device control system, an operation reception device, a server, and a device control method for operating a device to be controlled by receiving an instruction from a user.
  • Patent Document 1 discloses a technique in which an operation unit receives an instruction by a user's voice, transmits an instruction via a network, and controls the operation of a device such as an air conditioner in the operation system. Further, in Patent Document 1, the operation unit detects the operating sound of the device, the notification sound when the device executes the operation, and the like, determines the operating state of the device in response to the user's instruction, and makes the user a speaker or the like. A technique for notifying a determination result is disclosed.
  • the operation system described in Patent Document 1 determines whether or not the operation of the device in response to the user's instruction is properly executed based on the sound emitted by the device. Therefore, the operation system described in Patent Document 1 cannot correctly detect the sound emitted by the device in a noisy environment, and the accuracy of determining whether or not the device operates normally in response to the user's instruction is lowered. There was a problem.
  • Patent Document 1 describes that it is determined whether or not the device operates normally by using the environmental information detected by the environmental information detection device using an illuminance sensor or the like. However, the environmental information detected by the environmental information detection device is transmitted to the information processing device, and the information processing device determines whether or not the device has operated normally. Therefore, the operation system described in Patent Document 1 determines whether or not the device operates normally even if the remote control of the device can be executed when the communication between the environmental information detection device and the information processing device is interrupted. There was a problem that it could not be judged.
  • the present invention has been made in view of the above, and when the control target device is operated by receiving an instruction from the user, it is determined whether or not the control target device has been operated according to the instruction from the user.
  • the purpose is to obtain a device control system that can suppress a decrease in accuracy.
  • the present invention is a device control system that receives an instruction from a user and operates a device to be controlled in order to solve the above-mentioned problems and achieve the object.
  • the device control system receives an operation reception device that receives and transfers the first operation instruction by voice from the user to the control target device, and receives the first operation instruction from the operation reception device and controls the first operation instruction. It manages the first server that converts and sends the second operation instruction that can be accepted by the device and the device to be controlled, and receives the second operation instruction from the first server and sends it to the device to be controlled.
  • a second server for transfer and a controlled target device for receiving a second operation instruction from the second server and performing an operation based on the second operation instruction are provided.
  • the first server When the first server receives the first operation instruction from the operation reception device, the first server instructs the operation reception device to monitor the change in the operation of the control target device.
  • the operation receiving device detects a change in the operation of the control target device, and outputs a response to the first operation instruction when the change in the operation of the control target device is based on the first operation instruction.
  • the device control system can suppress a decrease in accuracy of determining whether or not an operation according to an instruction from a user has been performed in the device to be controlled when the device to be controlled is operated by receiving an instruction from the user. , Has the effect.
  • FIG. 1 A block diagram showing a configuration example of the operation receiving device according to the first embodiment.
  • Block diagram showing a configuration example of the first server according to the first embodiment A sequence diagram showing the operation of the device control system according to the first embodiment.
  • FIG. 1 is a diagram showing a configuration example of the device control system 1 according to the first embodiment of the present invention.
  • the device control system 1 includes an operation receiving device 10, a first server 20, a second server 30, and a controlled device 40.
  • the device control system 1 is a system that receives an instruction from a user and operates the control target device 40.
  • the operation reception device 10 receives the first operation instruction by voice from the user to the control target device 40.
  • the operation receiving device 10 transfers the first operation instruction to the first server 20. Further, the operation receiving device 10 detects a change in the operation of the control target device 40, and when the change in the operation of the control target device 40 is based on the first operation instruction, responds to the first operation instruction. Output to the user.
  • the operation receiving device 10 assumes a smart speaker capable of receiving a voice instruction from a user and outputting a voice response to the user.
  • the first server 20 receives the first operation instruction from the operation reception device 10 and converts the first operation instruction into a second operation instruction that can be accepted by the control target device 40.
  • the first server 20 transmits the second operation instruction to the second server 30. Further, when the first server 20 receives the first operation instruction from the operation reception device 10, the first server 20 instructs the operation reception device 10 to monitor the change in the operation of the control target device 40.
  • the first server 20 is a server operated by a business operator or the like that recognizes a voice instruction from a user received by the operation reception device 10 and provides a service to the user via the operation reception device 10.
  • the form of the first server 20 is not particularly limited.
  • the first server 20 may be in the form of a physical server or a cloud server.
  • the first server 20 is also referred to as a front-end cloud or the like.
  • the second server 30 When the second server 30 receives the second operation instruction from the first server 20, the second server 30 transfers the second operation instruction to the control target device 40.
  • the second server 30 manages the controlled device 40.
  • the second server 30 is a server operated by a manufacturer of the controlled device 40 or the like.
  • the form of the second server 30 is also not particularly limited.
  • the second server 30 may be in the form of a physical server or a cloud server.
  • the control target device 40 receives the second operation instruction from the second server 30, and performs an operation based on the second operation instruction.
  • the control target device 40 includes a communication adapter 41 and a device 42.
  • the communication adapter 41 is connected to the device 42 and communicates with the second server 30.
  • the device 42 provides a desired service to the user based on the second operation instruction.
  • the communication adapter 41 is, for example, an IoT (Internet of Things) adapter.
  • the device 42 is, for example, an air conditioner.
  • the form of the controlled device 40 is not limited to the example of FIG.
  • the communication adapter 41 provides a function of communicating with the second server 30 to the device 42 which does not have the function of communicating with the second server 30.
  • the controlled device 40 may not be provided with the communication adapter 41. That is, the control target device 40 may include a device 42 having a function of communicating with the second server 30.
  • the control target device 40 may include a device 42 having a function of communicating with the second server 30.
  • the operation based on the second operation instruction when the device 42 is an air conditioner as described above, the power of the air conditioner is turned on / off, the operation mode such as heating and cooling is changed, and the set temperature is changed.
  • FIG. 2 is a block diagram showing a configuration example of the operation receiving device 10 according to the first embodiment.
  • the operation reception device 10 includes a microphone 11, a speaker 12, a communication unit 13, a control unit 14, and a sensor 15.
  • the microphone 11 receives the first operation instruction by voice from the user to the control target device 40.
  • the speaker 12 outputs a response to the first operation instruction.
  • the communication unit 13 transmits the first operation instruction received by the microphone 11 to the first server 20.
  • the control unit 14 monitors changes in the operation of the controlled device 40 based on the detection result of the sensor 15.
  • the control unit 14 controls the output of the response from the speaker 12 to the first operation instruction.
  • the sensor 15 detects a change in the operation of the controlled device 40.
  • the sensor 15 includes a camera sensor 151, an optical sensor 152, an air volume sensor 153, a WiFi (registered trademark) module 154, and a Bluetooth (registered trademark) module 155.
  • the camera sensor 151 and the optical sensor 152 are optical sensors that detect the light emitted by the controlled device 40.
  • the sensor 15 may include only one of the camera sensor 151 and the optical sensor 152, or may include both the camera sensor 151 and the optical sensor 152, depending on the type of the device to be controlled 40.
  • the air volume sensor 153 detects the air volume, which is the amount of air output from the air conditioner, when the above-mentioned device 42 is an air conditioner, that is, when the controlled device 40 includes an air conditioner.
  • the WiFi module 154 and the Bluetooth module 155 are communication modules that receive communication signals transmitted from the controlled device 40.
  • the sensor 15 may include only one of the WiFi module 154 and the Bluetooth module 155, or may include both the WiFi module 154 and the Bluetooth module 155, depending on the type of the device to be controlled 40.
  • the sensor 15 may include one or more of the camera sensor 151, the optical sensor 152, the air volume sensor 153, the WiFi module 154, and the Bluetooth module 155, depending on the type of the device to be controlled 40.
  • FIG. 3 is a block diagram showing a configuration example of the first server 20 according to the first embodiment.
  • the first server 20 includes a communication unit 21 and a control unit 22.
  • the communication unit 21 receives the first operation instruction by voice from the user to the control target device 40 from the operation reception device 10.
  • the communication unit 21 transmits the second operation instruction converted from the first operation instruction by the control unit 22, which will be described later, to the second server 30.
  • the control unit 22 converts the first operation instruction into a second operation instruction that can be accepted by the control target device 40.
  • the control unit 22 transmits a second operation instruction to the control target device 40 via the communication unit 21 and a second operation instruction to the control target device 40 via the second server 30 that manages the control target device 40, and also to the operation reception device 10. Instruct to monitor changes in the operation of the controlled device 40.
  • FIG. 4 is a sequence diagram showing the operation of the device control system 1 according to the first embodiment.
  • the operation receiving device 10 is a smart speaker
  • the communication adapter 41 of the controlled device 40 is an IoT adapter
  • the device 42 is an air conditioner
  • the user instructs the operation reception device 10 which is a smart speaker to start the operation of the device 42 which is an air conditioner.
  • the operation receiving device 10 receives a first operation instruction from the user, which is an operation start instruction for the device 42 which is an air conditioner (step S101).
  • the operation receiving device 10 transfers the first operation instruction to the first server 20 (step S102).
  • the first server 20 When the first server 20 receives the first operation instruction from the operation reception device 10, the first server 20 converts the first operation instruction into a second operation instruction that can be accepted by the control target device 40 (step S103). The first server 20 transmits the second operation instruction to the second server 30 (step S104). The first server 20 instructs the operation receiving device 10 to monitor the change in the operation of the controlled device 40 (step S105). The first server 20 may perform the operation of step S105 before the operation of steps S103 and S104, or may be performed in parallel with the operation of steps S103 and S104.
  • the operation receiving device 10 starts monitoring the change in the operation of the controlled device 40 based on the instruction from the first server 20 (step S106).
  • the second server 30 When the second server 30 receives the second operation instruction from the first server 20, the second server 30 transfers the second operation instruction to the control target device 40 (step S107).
  • the controlled target device 40 When the controlled target device 40 receives the second operation instruction from the second server 30, it performs an operation based on the second operation instruction (step S108).
  • the air conditioner which is the device 42 included in the device to be controlled 40, starts operation.
  • the operation receiving device 10 When the operation receiving device 10 detects a change in the operation of the control target device 40, it confirms whether or not the change in the operation of the control target device 40 matches the defined operation pattern. When the change in the operation of the control target device 40 matches the defined operation pattern, the operation reception device 10 determines that the change in the operation of the control target device 40 is based on the first operation instruction (step S109). ). The operation receiving device 10 outputs a response to the first operation instruction to the user (step S110). As a result, the user can recognize that the instruction to start the operation of the device 42, which is an air conditioner, has been executed.
  • the change in the operation of the control target device 40 when the change in the operation of the control target device 40 matches the defined operation pattern, the change in the operation of the control target device 40 becomes the first operation instruction. Judge that it is based. Specifically, the control unit 14 of the operation receiving device 10 matches the operation pattern in which the change in the operation of the control target device 40 detected by the sensor 15 is defined, and the change in the operation of the control target device 40 is the first. When it is determined that the device is based on the operation instruction, the speaker 12 outputs a response to the first operation instruction.
  • the operation receiving device 10 stores, for example, the threshold value of the air volume as the above-mentioned defined operation pattern.
  • the control unit 14 detects a wind equal to or greater than the threshold value of the air volume defined by the air volume sensor 153, the change in the operation of the control target device 40 is based on the first operation instruction, that is, the operation of the control target device 40 is performed. Judge that it has started.
  • the operation receiving device 10 may store the defined operation pattern in the control unit 14 or in a storage unit (not shown). The same applies to the specified operation patterns described below.
  • the operation reception device 10 stores, for example, the light emission pattern of the communication adapter 41 or the device 42 of the control target device 40 as the above-mentioned defined operation pattern.
  • the light emission pattern is the display content displayed on the display unit of the communication adapter 41 or the device 42, and the light emission of the LED at a specific position when the communication adapter 41 or the device 42 is provided with a plurality of LEDs (Light Emitting Diodes).
  • the control unit 14 changes the operation of the control target device 40 based on the first operation instruction, that is, the control target device. It is determined that the operation of 40 has started.
  • the operation reception device 10 is a change in the operation of the control target device 40, which is the amount of light emitted by the control target device 40 and the amount of wind output from the air conditioner when the control target device 40 is equipped with the air conditioner. At least one of may be detected.
  • the sensor 15 of the operation receiving device 10 is output from the camera sensor 151 and the optical sensor 152 that detect the light emitted by the controlled device 40, and the air conditioner when the controlled device 40 includes an air conditioner. It includes at least one of the air volume sensors 153 that detects the air volume, which is the air volume.
  • the operation receiving device 10 stores, for example, the content of the signal transmitted from the communication adapter 41 as the above-mentioned defined operation pattern.
  • the content of the signal is a bit pattern at a specific position included in the signal.
  • the control unit 14 receives a signal having the contents specified in one or both of the WiFi module 154 and the Bluetooth module 155
  • the change in the operation of the control target device 40 is based on the first operation instruction, that is, the control target. It is determined that the operation of the device 40 has started. That is, the operation reception device 10 detects the communication signal transmitted from the control target device 40 as a change in the operation of the control target device 40.
  • the sensor 15 of the operation reception device 10 is at least one of the WiFi module 154 and the Bluetooth module 155 that receive the communication signal transmitted from the control target device 40.
  • the air conditioner which is the device 42, may start the operation according to a general procedure. Therefore, the controlled device 40 does not need to perform any special operation.
  • the air conditioner which is the device 42
  • the communication adapter 41 transmits a signal including the contents of the defined operation pattern. Therefore, it is necessary to communicate between the device 42 and the communication adapter 41.
  • the communication between the device 42 and the communication adapter 41 is not interrupted due to the deterioration of the communication state due to wireless communication.
  • the device 42 and the communication adapter 41 are communicating with each other. Therefore, it is considered unlikely that the communication with the communication adapter 41 will be interrupted for some reason immediately after the operation of the air conditioner, which is the device 42, is started.
  • FIG. 5 is a diagram showing an example of a processing circuit included in the operation receiving device 10 according to the first embodiment.
  • the microphone 11 is a device that converts voice into an electric signal.
  • the speaker 12 is a device that converts an electric signal into voice.
  • the communication unit 13 is an interface for communicating with the first server 20.
  • the sensor 15 is various measuring instruments as described above.
  • the control unit 14 is realized by a processing circuit.
  • the processing circuit is, for example, a processor 91 that executes a program stored in the memory 92, and a memory 92.
  • each function of the processing circuit is realized by software, firmware, or a combination of software and firmware.
  • the software or firmware is written as a program and stored in the memory 92.
  • each function is realized by the processor 91 reading and executing the program stored in the memory 92. Further, it can be said that these programs cause the computer to execute the procedure and method of the operation receiving device 10.
  • the processor 91 may be a CPU (Central Processing Unit), a processing device, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.
  • the memory 92 includes, for example, non-volatile or volatile such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable ROM), and EPROM (registered trademark) (Electrically EPROM).
  • RAM Random Access Memory
  • ROM Read Only Memory
  • flash memory EPROM (Erasable Programmable ROM), and EPROM (registered trademark) (Electrically EPROM).
  • Semiconductor memory magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), etc. are applicable.
  • the processing circuit may be dedicated hardware.
  • the processing circuit is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate). Array), or a combination of these.
  • Each function of the operation reception device 10 may be realized by a processing circuit for each function, or each function may be collectively realized by a processing circuit.
  • a part may be realized by dedicated hardware and a part may be realized by software or firmware.
  • the processing circuit can realize each of the above-mentioned functions by the dedicated hardware, software, firmware, or a combination thereof.
  • the communication unit 21 is an interface for communicating with the operation reception device 10 and the second server 30.
  • the control unit 22 is realized by a processing circuit.
  • the processing circuit may be composed of a processor 91 and a memory 92, or may be dedicated hardware.
  • the control target device 40 when the operation reception device 10 matches the defined operation pattern of the operation change of the control target device 40, the control target device 40 It is determined that the change in operation is based on the first operation instruction.
  • the operation receiving device 10 outputs a response to the first operation instruction to the user.
  • the user can recognize that the instruction to start the operation of the device 42, that is, the controlled device 40 has been executed.
  • the device control system 1 receives an instruction from the user and operates the control target device 40, the device control system 1 suppresses a decrease in accuracy of determining whether or not the control target device 40 has been operated according to the instruction from the user. Can be done.
  • Embodiment 2 In the first embodiment, it has been confirmed whether or not the operation receiving device 10 matches the defined operation pattern with the change in the operation of the controlled device 40. In the second embodiment, a case where the first server 20 confirms whether or not the change in the operation of the controlled device 40 matches the defined operation pattern will be described.
  • FIG. 6 is a sequence diagram showing the operation of the device control system 1 according to the second embodiment.
  • the operations from step S101 to step S108 are the same as those of the first embodiment shown in FIG.
  • the operation reception device 10 detects a change in the operation of the control target device 40 (step S201).
  • the operation receiving device 10 transmits information on changes in the operation of the controlled device 40 to the first server 20 (step S202).
  • the first server 20 receives information on changes in the operation of the controlled device 40 from the operation receiving device 10.
  • the first server 20 confirms whether or not the change in the operation of the controlled device 40 matches the specified operation pattern.
  • the first server 20 determines that the change in the operation of the control target device 40 is based on the first operation instruction (step). S203).
  • the first server 20 transmits a determination result that the change in the operation of the controlled device 40 is based on the first operation instruction to the operation receiving device 10 (step S204).
  • the operation receiving device 10 receives a determination result from the first server 20 that the change in the operation of the controlled device 40 is based on the first operation instruction. After that, it is the same as in the case of the first embodiment.
  • the operation receiving device 10 outputs a response to the first operation instruction to the user (step S110). As a result, the user can recognize that the instruction to start the operation of the device 42, which is an air conditioner, has been executed.
  • the operation receiving device 10 transmits the detected information on the change in the operation of the controlled device 40 to the first server 20.
  • the first server 20 determines that the change in the operation of the control target device 40 is based on the first operation instruction, and determines that the change is based on the first operation instruction. The result is transmitted to the operation reception device 10.
  • control unit 14 of the operation reception device 10 transmits information on changes in the operation of the control target device 40 detected by the sensor 15 to the first server 20 via the communication unit 13.
  • the control unit 22 of the first server 20 receives information on the change in the operation of the control target device 40 detected by the operation reception device 10 via the communication unit 21, and the change in the operation of the control target device 40 is defined.
  • the operation pattern is matched, it is determined that the change in the operation of the controlled device 40 is based on the first operation instruction.
  • the control unit 22 of the first server 20 transmits the determination result to the operation reception device 10 via the communication unit 21.
  • the control unit 14 of the operation receiving device 10 matches the operation pattern in which the change in the operation of the control target device 40 is defined from the first server 20 via the communication unit 13, and the change in the operation of the control target device 40.
  • the speaker 12 outputs a response to the first operation instruction.
  • the operation reception device 10 when the operation reception device 10 detects a change in the operation of the control target device 40, the operation reception device 10 transmits information on the change in the operation of the control target device 40 to the first server 20. Therefore, unlike the first embodiment, communication is performed between the operation reception device 10 and the first server 20.
  • the operation receiving device 10 has already transmitted the first operation instruction to the first server 20 at the stage of step S102. That is, before step S202 to step S204, the operation receiving device 10 and the first server 20 are communicating with each other. Therefore, it is considered unlikely that the communication between the operation receiving device 10 and the first server 20 will be interrupted in the steps S202 to S204.
  • the operation receiving device 10 transmits the detected information on the change in the operation of the controlled device 40 to the first server 20.
  • the first server 20 determines that the change in the operation of the control target device 40 is based on the first operation instruction, and determines that the change is based on the first operation instruction.
  • the result is transmitted to the operation reception device 10.
  • the operation receiving device 10 outputs a response to the first operation instruction to the user. Even in this case, the device control system 1 can obtain the same effect as that of the first embodiment.
  • the configuration shown in the above-described embodiment shows an example of the content of the present invention, can be combined with another known technique, and is one of the configurations without departing from the gist of the present invention. It is also possible to omit or change the part.
  • 1 device control system 10 operation reception device, 11 microphone, 12 speaker, 13, 21 communication unit, 14, 22 control unit, 15 sensor, 20 first server, 30 second server, 40 controlled device, 41 communication Adapter, 42 equipment, 151 camera sensor, 152 optical sensor, 153 air volume sensor, 154 WiFi module, 155 Bluetooth module.

Abstract

A device control system (1) for operating a controlled device (40) comprises: an operation reception apparatus (10) that receives a first operation instruction issued by voice from a user for the controlled device (40); a first server (20) that receives the first operation instruction from the operation reception apparatus (10), converts the first operation instruction to a second operation instruction and transmits the second operation instruction; a second server (30) that receives the second operation instruction from the first server (20) and transfers the second operation instruction to the controlled device (40); and the controlled device (40) that receives the second operation instruction from the second server (30) and performs an action based on the second operation instruction, wherein the first server (20), when having received the first operation instruction, instructs the operation reception apparatus (10) to monitor a change in action of the controlled device (40), and the operation reception apparatus (10) outputs a response to the first operation instruction if the change in action of the controlled device (40) is one based on the first operation instruction.

Description

機器制御システム、操作受付装置、サーバおよび機器制御方法Device control system, operation reception device, server and device control method
　本発明は、ユーザからの指示を受け付けて制御対象機器を操作する機器制御システム、操作受付装置、サーバおよび機器制御方法に関する。 The present invention relates to a device control system, an operation reception device, a server, and a device control method for operating a device to be controlled by receiving an instruction from a user.
　従来、ユーザから音声などによる操作を受け付けて、インターネットなどを介して機器を遠隔操作するシステムがある。特許文献１には、操作システムにおいて、操作ユニットが、ユーザの音声による指示を受け付けて、ネットワークを介して指示を送信し、空調機などの機器の動作を制御する技術が開示されている。また、特許文献１には、操作ユニットが、機器の動作音、機器が動作を実行するときの報知音などを検出し、ユーザの指示に対する機器の動作状態を判定し、ユーザに対してスピーカなどから判定結果を報知する技術が開示されている。 Conventionally, there is a system that accepts voice operations from users and remotely controls devices via the Internet or the like. Patent Document 1 discloses a technique in which an operation unit receives an instruction by a user's voice, transmits an instruction via a network, and controls the operation of a device such as an air conditioner in the operation system. Further, in Patent Document 1, the operation unit detects the operating sound of the device, the notification sound when the device executes the operation, and the like, determines the operating state of the device in response to the user's instruction, and makes the user a speaker or the like. A technique for notifying a determination result is disclosed.
国際公開第２０１９／０１３３０９号International Publication No. 2019/013309
　しかしながら、特許文献１に記載の操作システムは、ユーザの指示に対する機器の動作が適切に実行されたか否かを、機器が発する音に基づいて判定している。そのため、特許文献１に記載の操作システムは、騒音が発生する環境では機器が発する音を正しく検知できず、ユーザの指示に対して機器が正常に動作したか否かを判定する精度が低下する、という問題があった。 However, the operation system described in Patent Document 1 determines whether or not the operation of the device in response to the user's instruction is properly executed based on the sound emitted by the device. Therefore, the operation system described in Patent Document 1 cannot correctly detect the sound emitted by the device in a noisy environment, and the accuracy of determining whether or not the device operates normally in response to the user's instruction is lowered. There was a problem.
　また、特許文献１には、照度センサなどを利用した環境情報検知機器で検知された環境情報を用いて機器が正常に動作したか否かを判定することが記載されている。しかしながら、環境情報検知機器で検知された環境情報は情報処理装置に送信され、情報処理装置が、機器が正常に動作したか否かを判定している。そのため、特許文献１に記載の操作システムは、環境情報検知機器と情報処理装置との間の通信が途絶えた場合、機器の遠隔操作は実行できても、機器が正常に動作したか否かを判定できない、という問題があった。 Further, Patent Document 1 describes that it is determined whether or not the device operates normally by using the environmental information detected by the environmental information detection device using an illuminance sensor or the like. However, the environmental information detected by the environmental information detection device is transmitted to the information processing device, and the information processing device determines whether or not the device has operated normally. Therefore, the operation system described in Patent Document 1 determines whether or not the device operates normally even if the remote control of the device can be executed when the communication between the environmental information detection device and the information processing device is interrupted. There was a problem that it could not be judged.
　本発明は、上記に鑑みてなされたものであって、ユーザからの指示を受け付けて制御対象機器を動作させる場合に、制御対象機器においてユーザからの指示による動作が行われたか否かを判定する精度の低下を抑制可能な機器制御システムを得ることを目的とする。 The present invention has been made in view of the above, and when the control target device is operated by receiving an instruction from the user, it is determined whether or not the control target device has been operated according to the instruction from the user. The purpose is to obtain a device control system that can suppress a decrease in accuracy.
　上述した課題を解決し、目的を達成するために、本発明は、ユーザからの指示を受け付けて制御対象機器を操作する機器制御システムである。機器制御システムは、制御対象機器に対するユーザからの音声による第１の操作指示を受け付けて転送する操作受付装置と、操作受付装置から第１の操作指示を受信し、第１の操作指示を制御対象機器で受け付け可能な第２の操作指示に変換して送信する第１のサーバと、制御対象機器の管理を行い、かつ、第１のサーバから第２の操作指示を受信して制御対象機器に転送する第２のサーバと、第２のサーバから第２の操作指示を受信し、第２の操作指示に基づく動作を行う制御対象機器と、を備える。第１のサーバは、操作受付装置から第１の操作指示を受信すると、操作受付装置に対して制御対象機器の動作の変化を監視するよう指示する。操作受付装置は、制御対象機器の動作の変化を検出し、制御対象機器の動作の変化が第１の操作指示に基づくものであった場合、第１の操作指示に対する応答を出力する。 The present invention is a device control system that receives an instruction from a user and operates a device to be controlled in order to solve the above-mentioned problems and achieve the object. The device control system receives an operation reception device that receives and transfers the first operation instruction by voice from the user to the control target device, and receives the first operation instruction from the operation reception device and controls the first operation instruction. It manages the first server that converts and sends the second operation instruction that can be accepted by the device and the device to be controlled, and receives the second operation instruction from the first server and sends it to the device to be controlled. A second server for transfer and a controlled target device for receiving a second operation instruction from the second server and performing an operation based on the second operation instruction are provided. When the first server receives the first operation instruction from the operation reception device, the first server instructs the operation reception device to monitor the change in the operation of the control target device. The operation receiving device detects a change in the operation of the control target device, and outputs a response to the first operation instruction when the change in the operation of the control target device is based on the first operation instruction.
　本発明に係る機器制御システムは、ユーザからの指示を受け付けて制御対象機器を動作させる場合に、制御対象機器においてユーザからの指示による動作が行われたか否かを判定する精度の低下を抑制できる、という効果を奏する。 The device control system according to the present invention can suppress a decrease in accuracy of determining whether or not an operation according to an instruction from a user has been performed in the device to be controlled when the device to be controlled is operated by receiving an instruction from the user. , Has the effect.
実施の形態１に係る機器制御システムの構成例を示す図The figure which shows the configuration example of the device control system which concerns on Embodiment 1. 実施の形態１に係る操作受付装置の構成例を示すブロック図A block diagram showing a configuration example of the operation receiving device according to the first embodiment. 実施の形態１に係る第１のサーバの構成例を示すブロック図Block diagram showing a configuration example of the first server according to the first embodiment 実施の形態１に係る機器制御システムの動作を示すシーケンス図A sequence diagram showing the operation of the device control system according to the first embodiment. 実施の形態１に係る操作受付装置が備える処理回路の例を示す図The figure which shows the example of the processing circuit provided in the operation reception device which concerns on Embodiment 1. 実施の形態２に係る機器制御システムの動作を示すシーケンス図A sequence diagram showing the operation of the device control system according to the second embodiment.
　以下に、本発明の実施の形態に係る機器制御システム、操作受付装置、サーバおよび機器制御方法を図面に基づいて詳細に説明する。なお、この実施の形態によりこの発明が限定されるものではない。 Hereinafter, the device control system, the operation reception device, the server, and the device control method according to the embodiment of the present invention will be described in detail with reference to the drawings. The present invention is not limited to this embodiment.
実施の形態１．
　図１は、本発明の実施の形態１に係る機器制御システム１の構成例を示す図である。機器制御システム１は、操作受付装置１０と、第１のサーバ２０と、第２のサーバ３０と、制御対象機器４０と、を備える。機器制御システム１は、ユーザからの指示を受け付けて制御対象機器４０を操作するシステムである。 Embodiment 1.
FIG. 1 is a diagram showing a configuration example of the device control system 1 according to the first embodiment of the present invention. The device control system 1 includes an operation receiving device 10, a first server 20, a second server 30, and a controlled device 40. The device control system 1 is a system that receives an instruction from a user and operates the control target device 40.
　操作受付装置１０は、制御対象機器４０に対するユーザからの音声による第１の操作指示を受け付ける。操作受付装置１０は、第１の操作指示を第１のサーバ２０に転送する。また、操作受付装置１０は、制御対象機器４０の動作の変化を検出し、制御対象機器４０の動作の変化が第１の操作指示に基づくものであった場合、第１の操作指示に対する応答をユーザに向けて出力する。本実施の形態において、操作受付装置１０は、ユーザからの音声による指示を受け付け、ユーザに対して音声による応答を出力可能なスマートスピーカを想定している。 The operation reception device 10 receives the first operation instruction by voice from the user to the control target device 40. The operation receiving device 10 transfers the first operation instruction to the first server 20. Further, the operation receiving device 10 detects a change in the operation of the control target device 40, and when the change in the operation of the control target device 40 is based on the first operation instruction, responds to the first operation instruction. Output to the user. In the present embodiment, the operation receiving device 10 assumes a smart speaker capable of receiving a voice instruction from a user and outputting a voice response to the user.
　第１のサーバ２０は、操作受付装置１０から第１の操作指示を受信し、第１の操作指示を制御対象機器４０で受け付け可能な第２の操作指示に変換する。第１のサーバ２０は、第２の操作指示を、第２のサーバ３０に送信する。また、第１のサーバ２０は、操作受付装置１０から第１の操作指示を受信すると、操作受付装置１０に対して、制御対象機器４０の動作の変化を監視するよう指示する。第１のサーバ２０は、操作受付装置１０で受け付けたユーザからの音声による指示を認識し、操作受付装置１０を介してユーザにサービスを提供する事業者などが運営するサーバである。第１のサーバ２０の形態については特に限定されない。第１のサーバ２０は、物理サーバによる形態であってもよいし、クラウドサーバによる形態であってもよい。第１のサーバ２０は、フロントエンドクラウドなどとも称される。 The first server 20 receives the first operation instruction from the operation reception device 10 and converts the first operation instruction into a second operation instruction that can be accepted by the control target device 40. The first server 20 transmits the second operation instruction to the second server 30. Further, when the first server 20 receives the first operation instruction from the operation reception device 10, the first server 20 instructs the operation reception device 10 to monitor the change in the operation of the control target device 40. The first server 20 is a server operated by a business operator or the like that recognizes a voice instruction from a user received by the operation reception device 10 and provides a service to the user via the operation reception device 10. The form of the first server 20 is not particularly limited. The first server 20 may be in the form of a physical server or a cloud server. The first server 20 is also referred to as a front-end cloud or the like.
　第２のサーバ３０は、第１のサーバ２０から第２の操作指示を受信すると、第２の操作指示を制御対象機器４０に転送する。第２のサーバ３０は、制御対象機器４０の管理を行う。第２のサーバ３０は、制御対象機器４０の製造メーカなどが運営するサーバである。第２のサーバ３０の形態についても特に限定されない。第２のサーバ３０は、物理サーバによる形態であってもよいし、クラウドサーバによる形態であってもよい。 When the second server 30 receives the second operation instruction from the first server 20, the second server 30 transfers the second operation instruction to the control target device 40. The second server 30 manages the controlled device 40. The second server 30 is a server operated by a manufacturer of the controlled device 40 or the like. The form of the second server 30 is also not particularly limited. The second server 30 may be in the form of a physical server or a cloud server.
　制御対象機器４０は、第２のサーバ３０から第２の操作指示を受信し、第２の操作指示に基づく動作を行う。制御対象機器４０は、通信アダプタ４１と、機器４２と、を備える。通信アダプタ４１は、機器４２に接続され、第２のサーバ３０と通信を行う。機器４２は、第２の操作指示に基づいて、ユーザに所望のサービスを提供する。本実施の形態において、通信アダプタ４１は、例えば、ＩｏＴ（Internet　of　Things）アダプタである。また、機器４２は、例えば、空気調和機である。なお、制御対象機器４０の形態については、図１の例に限定されない。通信アダプタ４１は、第２のサーバ３０と通信を行う機能を有しない機器４２に対して、第２のサーバ３０と通信を行う機能を提供するものである。そのため、機器４２が第２のサーバ３０と通信を行う機能を有する場合、制御対象機器４０は、通信アダプタ４１を備えない形態であってもよい。すなわち、制御対象機器４０は、第２のサーバ３０と通信を行う機能を有する機器４２を備えていてもよい。第２の操作指示に基づく動作については、前述のように機器４２が空気調和機の場合、空気調和機の電源のオンオフ、暖房、冷房などの運転モードの変更、設定温度の変更などである。 The control target device 40 receives the second operation instruction from the second server 30, and performs an operation based on the second operation instruction. The control target device 40 includes a communication adapter 41 and a device 42. The communication adapter 41 is connected to the device 42 and communicates with the second server 30. The device 42 provides a desired service to the user based on the second operation instruction. In the present embodiment, the communication adapter 41 is, for example, an IoT (Internet of Things) adapter. Further, the device 42 is, for example, an air conditioner. The form of the controlled device 40 is not limited to the example of FIG. The communication adapter 41 provides a function of communicating with the second server 30 to the device 42 which does not have the function of communicating with the second server 30. Therefore, when the device 42 has a function of communicating with the second server 30, the controlled device 40 may not be provided with the communication adapter 41. That is, the control target device 40 may include a device 42 having a function of communicating with the second server 30. Regarding the operation based on the second operation instruction, when the device 42 is an air conditioner as described above, the power of the air conditioner is turned on / off, the operation mode such as heating and cooling is changed, and the set temperature is changed.
　操作受付装置１０の構成について詳細に説明する。図２は、実施の形態１に係る操作受付装置１０の構成例を示すブロック図である。操作受付装置１０は、マイク１１と、スピーカ１２と、通信部１３と、制御部１４と、センサ１５と、を備える。マイク１１は、制御対象機器４０に対するユーザからの音声による第１の操作指示を受け付ける。スピーカ１２は、第１の操作指示に対する応答を出力する。通信部１３は、マイク１１で受け付けられた第１の操作指示を第１のサーバ２０に送信する。制御部１４は、センサ１５の検出結果に基づいて、制御対象機器４０の動作の変化を監視する。制御部１４は、第１の操作指示に対するスピーカ１２からの応答の出力を制御する。 The configuration of the operation reception device 10 will be described in detail. FIG. 2 is a block diagram showing a configuration example of the operation receiving device 10 according to the first embodiment. The operation reception device 10 includes a microphone 11, a speaker 12, a communication unit 13, a control unit 14, and a sensor 15. The microphone 11 receives the first operation instruction by voice from the user to the control target device 40. The speaker 12 outputs a response to the first operation instruction. The communication unit 13 transmits the first operation instruction received by the microphone 11 to the first server 20. The control unit 14 monitors changes in the operation of the controlled device 40 based on the detection result of the sensor 15. The control unit 14 controls the output of the response from the speaker 12 to the first operation instruction.
　センサ１５は、制御対象機器４０の動作の変化を検出する。センサ１５は、カメラセンサ１５１と、光センサ１５２と、風量センサ１５３と、ＷｉＦｉ（登録商標）モジュール１５４と、Ｂｌｕｅｔｏｏｔｈ（登録商標）モジュール１５５と、を備える。カメラセンサ１５１および光センサ１５２は、制御対象機器４０が発する光を検出する光センサである。センサ１５は、制御対象機器４０の種別によって、カメラセンサ１５１および光センサ１５２のうち一方のみを備えるようにしてもよいし、カメラセンサ１５１および光センサ１５２の両方を備えるようにしてもよい。風量センサ１５３は、前述の機器４２が空気調和機である場合、すなわち制御対象機器４０が空気調和機を備える場合に、空気調和機から出力される風の量である風量を検出する。ＷｉＦｉモジュール１５４およびＢｌｕｅｔｏｏｔｈモジュール１５５は、制御対象機器４０から送信される通信信号を受信する通信モジュールである。センサ１５は、制御対象機器４０の種別によって、ＷｉＦｉモジュール１５４およびＢｌｕｅｔｏｏｔｈモジュール１５５のうち一方のみを備えるようにしてもよいし、ＷｉＦｉモジュール１５４およびＢｌｕｅｔｏｏｔｈモジュール１５５の両方を備えるようにしてもよい。センサ１５は、制御対象機器４０の種別に応じて、カメラセンサ１５１、光センサ１５２、風量センサ１５３、ＷｉＦｉモジュール１５４、およびＢｌｕｅｔｏｏｔｈモジュール１５５のうち、１つ以上を備えるようにしてもよい。 The sensor 15 detects a change in the operation of the controlled device 40. The sensor 15 includes a camera sensor 151, an optical sensor 152, an air volume sensor 153, a WiFi (registered trademark) module 154, and a Bluetooth (registered trademark) module 155. The camera sensor 151 and the optical sensor 152 are optical sensors that detect the light emitted by the controlled device 40. The sensor 15 may include only one of the camera sensor 151 and the optical sensor 152, or may include both the camera sensor 151 and the optical sensor 152, depending on the type of the device to be controlled 40. The air volume sensor 153 detects the air volume, which is the amount of air output from the air conditioner, when the above-mentioned device 42 is an air conditioner, that is, when the controlled device 40 includes an air conditioner. The WiFi module 154 and the Bluetooth module 155 are communication modules that receive communication signals transmitted from the controlled device 40. The sensor 15 may include only one of the WiFi module 154 and the Bluetooth module 155, or may include both the WiFi module 154 and the Bluetooth module 155, depending on the type of the device to be controlled 40. The sensor 15 may include one or more of the camera sensor 151, the optical sensor 152, the air volume sensor 153, the WiFi module 154, and the Bluetooth module 155, depending on the type of the device to be controlled 40.
　第１のサーバ２０の構成について詳細に説明する。図３は、実施の形態１に係る第１のサーバ２０の構成例を示すブロック図である。第１のサーバ２０は、通信部２１と、制御部２２と、を備える。通信部２１は、操作受付装置１０から、制御対象機器４０に対するユーザからの音声による第１の操作指示を受信する。通信部２１は、後述する制御部２２によって第１の操作指示から変換された第２の操作指示を、第２のサーバ３０に送信する。制御部２２は、第１の操作指示を制御対象機器４０で受け付け可能な第２の操作指示に変換する。制御部２２は、通信部２１を介して、第２の操作指示を、制御対象機器４０の管理を行う第２のサーバ３０を介して制御対象機器４０に送信するとともに、操作受付装置１０に対して制御対象機器４０の動作の変化を監視するよう指示する。 The configuration of the first server 20 will be described in detail. FIG. 3 is a block diagram showing a configuration example of the first server 20 according to the first embodiment. The first server 20 includes a communication unit 21 and a control unit 22. The communication unit 21 receives the first operation instruction by voice from the user to the control target device 40 from the operation reception device 10. The communication unit 21 transmits the second operation instruction converted from the first operation instruction by the control unit 22, which will be described later, to the second server 30. The control unit 22 converts the first operation instruction into a second operation instruction that can be accepted by the control target device 40. The control unit 22 transmits a second operation instruction to the control target device 40 via the communication unit 21 and a second operation instruction to the control target device 40 via the second server 30 that manages the control target device 40, and also to the operation reception device 10. Instruct to monitor changes in the operation of the controlled device 40.
　つづいて、機器制御システム１の動作について説明する。図４は、実施の形態１に係る機器制御システム１の動作を示すシーケンス図である。ここでは、前述のように、操作受付装置１０がスマートスピーカであり、制御対象機器４０の通信アダプタ４１がＩｏＴアダプタであり、機器４２が空気調和機である場合について説明する。まず、ユーザが、スマートスピーカである操作受付装置１０に対して、空気調和機である機器４２の動作開始を指示する。操作受付装置１０は、ユーザからの、空気調和機である機器４２に対する動作開始の指示である第１の操作指示を受け付ける（ステップＳ１０１）。操作受付装置１０は、第１の操作指示を第１のサーバ２０に転送する（ステップＳ１０２）。 Next, the operation of the device control system 1 will be described. FIG. 4 is a sequence diagram showing the operation of the device control system 1 according to the first embodiment. Here, as described above, the case where the operation receiving device 10 is a smart speaker, the communication adapter 41 of the controlled device 40 is an IoT adapter, and the device 42 is an air conditioner will be described. First, the user instructs the operation reception device 10 which is a smart speaker to start the operation of the device 42 which is an air conditioner. The operation receiving device 10 receives a first operation instruction from the user, which is an operation start instruction for the device 42 which is an air conditioner (step S101). The operation receiving device 10 transfers the first operation instruction to the first server 20 (step S102).
　第１のサーバ２０は、操作受付装置１０から第１の操作指示を受信すると、第１の操作指示を制御対象機器４０で受け付け可能な第２の操作指示に変換する（ステップＳ１０３）。第１のサーバ２０は、第２の操作指示を第２のサーバ３０に送信する（ステップＳ１０４）。第１のサーバ２０は、操作受付装置１０に対して、制御対象機器４０の動作の変化を監視するよう指示する（ステップＳ１０５）。なお、第１のサーバ２０は、ステップＳ１０５の動作を、ステップＳ１０３，Ｓ１０４の動作より先に行ってもよいし、ステップＳ１０３，Ｓ１０４の動作と並行して行ってもよい。 When the first server 20 receives the first operation instruction from the operation reception device 10, the first server 20 converts the first operation instruction into a second operation instruction that can be accepted by the control target device 40 (step S103). The first server 20 transmits the second operation instruction to the second server 30 (step S104). The first server 20 instructs the operation receiving device 10 to monitor the change in the operation of the controlled device 40 (step S105). The first server 20 may perform the operation of step S105 before the operation of steps S103 and S104, or may be performed in parallel with the operation of steps S103 and S104.
　操作受付装置１０は、第１のサーバ２０からの指示に基づいて、制御対象機器４０の動作の変化の監視を開始する（ステップＳ１０６）。 The operation receiving device 10 starts monitoring the change in the operation of the controlled device 40 based on the instruction from the first server 20 (step S106).
　第２のサーバ３０は、第１のサーバ２０から第２の操作指示を受信すると、第２の操作指示を制御対象機器４０に転送する（ステップＳ１０７）。 When the second server 30 receives the second operation instruction from the first server 20, the second server 30 transfers the second operation instruction to the control target device 40 (step S107).
　制御対象機器４０は、第２のサーバ３０から第２の操作指示を受信すると、第２の操作指示に基づく動作を行う（ステップＳ１０８）。ここでは、制御対象機器４０が備える機器４２である空気調和機が動作を開始する。 When the controlled target device 40 receives the second operation instruction from the second server 30, it performs an operation based on the second operation instruction (step S108). Here, the air conditioner, which is the device 42 included in the device to be controlled 40, starts operation.
　操作受付装置１０は、制御対象機器４０の動作の変化を検出すると、制御対象機器４０の動作の変化が規定された動作パターンに合致するか否か確認する。操作受付装置１０は、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定する（ステップＳ１０９）。操作受付装置１０は、ユーザに対して、第１の操作指示に対する応答を出力する（ステップＳ１１０）。これにより、ユーザは、空気調和機である機器４２の動作開始の指示が実行されたことを認識することができる。 When the operation receiving device 10 detects a change in the operation of the control target device 40, it confirms whether or not the change in the operation of the control target device 40 matches the defined operation pattern. When the change in the operation of the control target device 40 matches the defined operation pattern, the operation reception device 10 determines that the change in the operation of the control target device 40 is based on the first operation instruction (step S109). ). The operation receiving device 10 outputs a response to the first operation instruction to the user (step S110). As a result, the user can recognize that the instruction to start the operation of the device 42, which is an air conditioner, has been executed.
　このように、実施の形態１では、操作受付装置１０は、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定する。詳細には、操作受付装置１０の制御部１４は、センサ１５で検出された制御対象機器４０の動作の変化が規定された動作パターンに合致し、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定した場合、スピーカ１２から第１の操作指示に対する応答を出力させる。 As described above, in the first embodiment, when the change in the operation of the control target device 40 matches the defined operation pattern, the change in the operation of the control target device 40 becomes the first operation instruction. Judge that it is based. Specifically, the control unit 14 of the operation receiving device 10 matches the operation pattern in which the change in the operation of the control target device 40 detected by the sensor 15 is defined, and the change in the operation of the control target device 40 is the first. When it is determined that the device is based on the operation instruction, the speaker 12 outputs a response to the first operation instruction.
　操作受付装置１０は、例えば、前述の規定された動作パターンとして、風量の閾値を記憶しておく。制御部１４は、風量センサ１５３において規定された風量の閾値以上の風が検出された場合、制御対象機器４０の動作の変化が第１の操作指示に基づくもの、すなわち制御対象機器４０の動作が開始したと判定する。操作受付装置１０は、規定された動作パターンについて、制御部１４で記憶していてもよいし、図示しない記憶部に記憶していてもよい。以降で説明する規定された動作パターンについても同様である。 The operation receiving device 10 stores, for example, the threshold value of the air volume as the above-mentioned defined operation pattern. When the control unit 14 detects a wind equal to or greater than the threshold value of the air volume defined by the air volume sensor 153, the change in the operation of the control target device 40 is based on the first operation instruction, that is, the operation of the control target device 40 is performed. Judge that it has started. The operation receiving device 10 may store the defined operation pattern in the control unit 14 or in a storage unit (not shown). The same applies to the specified operation patterns described below.
　または、操作受付装置１０は、例えば、前述の規定された動作パターンとして、制御対象機器４０の通信アダプタ４１または機器４２での発光パターンを記憶しておく。発光パターンとは、通信アダプタ４１または機器４２が備える表示部に表示される表示内容、通信アダプタ４１または機器４２が複数のＬＥＤ（Light　Emitting　Diode）を備える場合の特定の位置のＬＥＤの発光、特定の位置のＬＥＤの発光色、特定の位置のＬＥＤの点滅パターンなどである。制御部１４は、カメラセンサ１５１および光センサ１５２の一方または両方において規定された発光パターンが検出された場合、制御対象機器４０の動作の変化が第１の操作指示に基づくもの、すなわち制御対象機器４０の動作が開始したと判定する。操作受付装置１０は、制御対象機器４０の動作の変化として、制御対象機器４０が発する光、および制御対象機器４０が空気調和機を備える場合に空気調和機から出力される風の量である風量の少なくとも１つを検出するようにしてもよい。この場合、操作受付装置１０のセンサ１５は、制御対象機器４０が発する光を検出するカメラセンサ１５１および光センサ１５２、および制御対象機器４０が空気調和機を備える場合に空気調和機から出力される風の量である風量を検出する風量センサ１５３の少なくとも１つを備える。 Alternatively, the operation reception device 10 stores, for example, the light emission pattern of the communication adapter 41 or the device 42 of the control target device 40 as the above-mentioned defined operation pattern. The light emission pattern is the display content displayed on the display unit of the communication adapter 41 or the device 42, and the light emission of the LED at a specific position when the communication adapter 41 or the device 42 is provided with a plurality of LEDs (Light Emitting Diodes). The emission color of the LED at the position of, the blinking pattern of the LED at a specific position, and the like. When the light emission pattern defined by one or both of the camera sensor 151 and the optical sensor 152 is detected, the control unit 14 changes the operation of the control target device 40 based on the first operation instruction, that is, the control target device. It is determined that the operation of 40 has started. The operation reception device 10 is a change in the operation of the control target device 40, which is the amount of light emitted by the control target device 40 and the amount of wind output from the air conditioner when the control target device 40 is equipped with the air conditioner. At least one of may be detected. In this case, the sensor 15 of the operation receiving device 10 is output from the camera sensor 151 and the optical sensor 152 that detect the light emitted by the controlled device 40, and the air conditioner when the controlled device 40 includes an air conditioner. It includes at least one of the air volume sensors 153 that detects the air volume, which is the air volume.
　また、操作受付装置１０は、例えば、前述の規定された動作パターンとして、通信アダプタ４１から送信される信号の内容を記憶しておく。信号の内容とは、信号に含まれる特定の位置のビットパターンである。制御部１４は、ＷｉＦｉモジュール１５４およびＢｌｕｅｔｏｏｔｈモジュール１５５の一方または両方において規定された内容の信号が受信された場合、制御対象機器４０の動作の変化が第１の操作指示に基づくもの、すなわち制御対象機器４０の動作が開始したと判定する。すなわち、操作受付装置１０は、制御対象機器４０の動作の変化として、制御対象機器４０から送信される通信信号を検出する。この場合、操作受付装置１０のセンサ１５は、制御対象機器４０から送信される通信信号を受信するＷｉＦｉモジュール１５４およびＢｌｕｅｔｏｏｔｈモジュール１５５の少なくとも１つである。 Further, the operation receiving device 10 stores, for example, the content of the signal transmitted from the communication adapter 41 as the above-mentioned defined operation pattern. The content of the signal is a bit pattern at a specific position included in the signal. When the control unit 14 receives a signal having the contents specified in one or both of the WiFi module 154 and the Bluetooth module 155, the change in the operation of the control target device 40 is based on the first operation instruction, that is, the control target. It is determined that the operation of the device 40 has started. That is, the operation reception device 10 detects the communication signal transmitted from the control target device 40 as a change in the operation of the control target device 40. In this case, the sensor 15 of the operation reception device 10 is at least one of the WiFi module 154 and the Bluetooth module 155 that receive the communication signal transmitted from the control target device 40.
　操作受付装置１０が前述の規定された動作パターンとして、風量の閾値、発光パターンなどを記憶しておく場合、機器４２である空気調和機は、一般的な手順によって動作を開始すればよい。そのため、制御対象機器４０は、特別な動作を行う必要は無い。 When the operation reception device 10 stores the air volume threshold value, the light emission pattern, and the like as the above-mentioned defined operation patterns, the air conditioner, which is the device 42, may start the operation according to a general procedure. Therefore, the controlled device 40 does not need to perform any special operation.
　一方、操作受付装置１０が前述の規定された動作パターンとして、信号の内容を記憶しておく場合、機器４２である空気調和機は、動作を開始した旨を通信アダプタ４１であるＩｏＴアダプタに通知する。そして、通信アダプタ４１が、規定された動作パターンの内容を含む信号を送信する。そのため、機器４２と通信アダプタ４１との間で通信を行う必要がある。しかしながら、機器４２と通信アダプタ４１とは直結されていることが一般的であるから、無線通信による通信状態の悪化によって機器４２と通信アダプタ４１との間の通信が途絶えることはない。また、機器４２である空気調和機が動作を介する段階で、機器４２と通信アダプタ４１とは通信を行っている。そのため、機器４２である空気調和機の動作開始直後に、何らかの原因によって通信アダプタ４１との間の通信が途絶える可能性は低いと考えられる。 On the other hand, when the operation receiving device 10 stores the content of the signal as the above-described defined operation pattern, the air conditioner, which is the device 42, notifies the IoT adapter, which is the communication adapter 41, that the operation has started. To do. Then, the communication adapter 41 transmits a signal including the contents of the defined operation pattern. Therefore, it is necessary to communicate between the device 42 and the communication adapter 41. However, since the device 42 and the communication adapter 41 are generally directly connected to each other, the communication between the device 42 and the communication adapter 41 is not interrupted due to the deterioration of the communication state due to wireless communication. Further, at the stage where the air conditioner, which is the device 42, is in operation, the device 42 and the communication adapter 41 are communicating with each other. Therefore, it is considered unlikely that the communication with the communication adapter 41 will be interrupted for some reason immediately after the operation of the air conditioner, which is the device 42, is started.
　つづいて、操作受付装置１０のハードウェア構成について説明する。図５は、実施の形態１に係る操作受付装置１０が備える処理回路の例を示す図である。操作受付装置１０において、マイク１１は音声を電気信号に変換する機器である。スピーカ１２は電気信号を音声に変換する機器である。通信部１３は第１のサーバ２０との間で通信を行うインターフェイスである。センサ１５は前述のような各種の計測器などである。制御部１４は処理回路により実現される。処理回路は、例えば、メモリ９２に格納されるプログラムを実行するプロセッサ９１、およびメモリ９２である。 Next, the hardware configuration of the operation reception device 10 will be described. FIG. 5 is a diagram showing an example of a processing circuit included in the operation receiving device 10 according to the first embodiment. In the operation reception device 10, the microphone 11 is a device that converts voice into an electric signal. The speaker 12 is a device that converts an electric signal into voice. The communication unit 13 is an interface for communicating with the first server 20. The sensor 15 is various measuring instruments as described above. The control unit 14 is realized by a processing circuit. The processing circuit is, for example, a processor 91 that executes a program stored in the memory 92, and a memory 92.
　処理回路がプロセッサ９１およびメモリ９２で構成される場合、処理回路の各機能は、ソフトウェア、ファームウェア、またはソフトウェアとファームウェアとの組み合わせにより実現される。ソフトウェアまたはファームウェアはプログラムとして記述され、メモリ９２に格納される。処理回路では、メモリ９２に記憶されたプログラムをプロセッサ９１が読み出して実行することにより、各機能を実現する。また、これらのプログラムは、操作受付装置１０の手順および方法をコンピュータに実行させるものであるともいえる。 When the processing circuit is composed of the processor 91 and the memory 92, each function of the processing circuit is realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in the memory 92. In the processing circuit, each function is realized by the processor 91 reading and executing the program stored in the memory 92. Further, it can be said that these programs cause the computer to execute the procedure and method of the operation receiving device 10.
　ここで、プロセッサ９１は、ＣＰＵ（Central　Processing　Unit）、処理装置、演算装置、マイクロプロセッサ、マイクロコンピュータ、またはＤＳＰ（Digital　Signal　Processor）などであってもよい。また、メモリ９２には、例えば、ＲＡＭ（Random　Access　Memory）、ＲＯＭ（Read　Only　Memory）、フラッシュメモリ、ＥＰＲＯＭ（Erasable　Programmable　ＲＯＭ）、ＥＥＰＲＯＭ（登録商標）（Electrically　ＥＰＲＯＭ）などの、不揮発性または揮発性の半導体メモリ、磁気ディスク、フレキシブルディスク、光ディスク、コンパクトディスク、ミニディスク、またはＤＶＤ（Digital　Versatile　Disc）などが該当する。 Here, the processor 91 may be a CPU (Central Processing Unit), a processing device, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like. Further, the memory 92 includes, for example, non-volatile or volatile such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable ROM), and EPROM (registered trademark) (Electrically EPROM). Semiconductor memory, magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), etc. are applicable.
　処理回路については、専用のハードウェアであってもよい。処理回路が専用のハードウェアで構成される場合、処理回路は、例えば、単一回路、複合回路、プログラム化したプロセッサ、並列プログラム化したプロセッサ、ＡＳＩＣ（Application　Specific　Integrated　Circuit）、ＦＰＧＡ（Field　Programmable　Gate　Array）、またはこれらを組み合わせたものが該当する。操作受付装置１０の各機能を機能別に処理回路で実現してもよいし、各機能をまとめて処理回路で実現してもよい。 The processing circuit may be dedicated hardware. When the processing circuit is composed of dedicated hardware, the processing circuit is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate). Array), or a combination of these. Each function of the operation reception device 10 may be realized by a processing circuit for each function, or each function may be collectively realized by a processing circuit.
　なお、操作受付装置１０の各機能について、一部を専用のハードウェアで実現し、一部をソフトウェアまたはファームウェアで実現するようにしてもよい。このように、処理回路は、専用のハードウェア、ソフトウェア、ファームウェア、またはこれらの組み合わせによって、上述の各機能を実現することができる。 Note that, for each function of the operation reception device 10, a part may be realized by dedicated hardware and a part may be realized by software or firmware. As described above, the processing circuit can realize each of the above-mentioned functions by the dedicated hardware, software, firmware, or a combination thereof.
　第１のサーバ２０のハードウェア構成についても同様である。第１のサーバ２０において、通信部２１は操作受付装置１０および第２のサーバ３０との間で通信を行うインターフェイスである。制御部２２は処理回路により実現される。処理回路は、プロセッサ９１およびメモリ９２で構成されてもよいし、専用のハードウェアであってもよい。 The same applies to the hardware configuration of the first server 20. In the first server 20, the communication unit 21 is an interface for communicating with the operation reception device 10 and the second server 30. The control unit 22 is realized by a processing circuit. The processing circuit may be composed of a processor 91 and a memory 92, or may be dedicated hardware.
　以上説明したように、本実施の形態によれば、機器制御システム１において、操作受付装置１０は、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定する。操作受付装置１０は、第１の操作指示に対する応答をユーザに対して出力する。これにより、ユーザは、機器４２すなわち制御対象機器４０の動作開始の指示が実行されたことを認識することができる。機器制御システム１は、ユーザからの指示を受け付けて制御対象機器４０を動作させる場合に、制御対象機器４０においてユーザからの指示による動作が行われたか否かを判定する精度の低下を抑制することができる。 As described above, according to the present embodiment, in the device control system 1, when the operation reception device 10 matches the defined operation pattern of the operation change of the control target device 40, the control target device 40 It is determined that the change in operation is based on the first operation instruction. The operation receiving device 10 outputs a response to the first operation instruction to the user. As a result, the user can recognize that the instruction to start the operation of the device 42, that is, the controlled device 40 has been executed. When the device control system 1 receives an instruction from the user and operates the control target device 40, the device control system 1 suppresses a decrease in accuracy of determining whether or not the control target device 40 has been operated according to the instruction from the user. Can be done.
実施の形態２．
　実施の形態１では、操作受付装置１０が、制御対象機器４０の動作の変化が規定された動作パターンに合致するか否か確認していた。実施の形態２では、第１のサーバ２０が、制御対象機器４０の動作の変化が規定された動作パターンに合致するか否か確認する場合について説明する。 Embodiment 2.
In the first embodiment, it has been confirmed whether or not the operation receiving device 10 matches the defined operation pattern with the change in the operation of the controlled device 40. In the second embodiment, a case where the first server 20 confirms whether or not the change in the operation of the controlled device 40 matches the defined operation pattern will be described.
　実施の形態２において、機器制御システム１、操作受付装置１０、および第１のサーバ２０の構成は、図１から図３に示す実施の形態１のときの構成と同様である。実施の形態２の機器制御システム１の動作について説明する。図６は、実施の形態２に係る機器制御システム１の動作を示すシーケンス図である。図６のシーケンス図において、ステップＳ１０１からステップＳ１０８までの動作は図４に示す実施の形態１のときと同様である。制御対象機器４０が第２の操作指示に基づく動作を行うと（ステップＳ１０８）、操作受付装置１０は、制御対象機器４０の動作の変化を検出する（ステップＳ２０１）。操作受付装置１０は、制御対象機器４０の動作の変化の情報を第１のサーバ２０に送信する（ステップＳ２０２）。 In the second embodiment, the configurations of the device control system 1, the operation receiving device 10, and the first server 20 are the same as those of the first embodiment shown in FIGS. 1 to 3. The operation of the device control system 1 of the second embodiment will be described. FIG. 6 is a sequence diagram showing the operation of the device control system 1 according to the second embodiment. In the sequence diagram of FIG. 6, the operations from step S101 to step S108 are the same as those of the first embodiment shown in FIG. When the control target device 40 performs an operation based on the second operation instruction (step S108), the operation reception device 10 detects a change in the operation of the control target device 40 (step S201). The operation receiving device 10 transmits information on changes in the operation of the controlled device 40 to the first server 20 (step S202).
　第１のサーバ２０は、操作受付装置１０から、制御対象機器４０の動作の変化の情報を受信する。第１のサーバ２０は、制御対象機器４０の動作の変化が規定された動作パターンに合致するか否か確認する。第１のサーバ２０は、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定する（ステップＳ２０３）。第１のサーバ２０は、制御対象機器４０の動作の変化が第１の操作指示に基づくものであるという判定結果を操作受付装置１０に送信する（ステップＳ２０４）。 The first server 20 receives information on changes in the operation of the controlled device 40 from the operation receiving device 10. The first server 20 confirms whether or not the change in the operation of the controlled device 40 matches the specified operation pattern. When the change in the operation of the control target device 40 matches the defined operation pattern, the first server 20 determines that the change in the operation of the control target device 40 is based on the first operation instruction (step). S203). The first server 20 transmits a determination result that the change in the operation of the controlled device 40 is based on the first operation instruction to the operation receiving device 10 (step S204).
　操作受付装置１０は、第１のサーバ２０から、制御対象機器４０の動作の変化が第１の操作指示に基づくものであるという判定結果を受信する。以降は、実施の形態１のときと同様である。操作受付装置１０は、ユーザに対して、第１の操作指示に対する応答を出力する（ステップＳ１１０）。これにより、ユーザは、空気調和機である機器４２の動作開始の指示が実行されたことを認識することができる。 The operation receiving device 10 receives a determination result from the first server 20 that the change in the operation of the controlled device 40 is based on the first operation instruction. After that, it is the same as in the case of the first embodiment. The operation receiving device 10 outputs a response to the first operation instruction to the user (step S110). As a result, the user can recognize that the instruction to start the operation of the device 42, which is an air conditioner, has been executed.
　このように、実施の形態２では、操作受付装置１０は、検出した制御対象機器４０の動作の変化の情報を第１のサーバ２０に送信する。第１のサーバ２０は、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定し、判定結果を操作受付装置１０に送信する。 As described above, in the second embodiment, the operation receiving device 10 transmits the detected information on the change in the operation of the controlled device 40 to the first server 20. When the change in the operation of the control target device 40 matches the defined operation pattern, the first server 20 determines that the change in the operation of the control target device 40 is based on the first operation instruction, and determines that the change is based on the first operation instruction. The result is transmitted to the operation reception device 10.
　詳細には、操作受付装置１０の制御部１４は、通信部１３を介して、センサ１５で検出された制御対象機器４０の動作の変化の情報を第１のサーバ２０に送信する。第１のサーバ２０の制御部２２は、通信部２１を介して、操作受付装置１０で検出された制御対象機器４０の動作の変化の情報を受信し、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定する。第１のサーバ２０の制御部２２は、通信部２１を介して、判定結果を操作受付装置１０に送信する。操作受付装置１０の制御部１４は、通信部１３を介して、第１のサーバ２０から、制御対象機器４０の動作の変化が規定された動作パターンに合致し、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定した旨の判定結果を受信した場合、スピーカ１２から第１の操作指示に対する応答を出力させる。 Specifically, the control unit 14 of the operation reception device 10 transmits information on changes in the operation of the control target device 40 detected by the sensor 15 to the first server 20 via the communication unit 13. The control unit 22 of the first server 20 receives information on the change in the operation of the control target device 40 detected by the operation reception device 10 via the communication unit 21, and the change in the operation of the control target device 40 is defined. When the operation pattern is matched, it is determined that the change in the operation of the controlled device 40 is based on the first operation instruction. The control unit 22 of the first server 20 transmits the determination result to the operation reception device 10 via the communication unit 21. The control unit 14 of the operation receiving device 10 matches the operation pattern in which the change in the operation of the control target device 40 is defined from the first server 20 via the communication unit 13, and the change in the operation of the control target device 40. When the determination result indicating that is based on the first operation instruction is received, the speaker 12 outputs a response to the first operation instruction.
　実施の形態２では、操作受付装置１０は、制御対象機器４０の動作の変化を検出すると、制御対象機器４０の動作の変化の情報を第１のサーバ２０に送信する。そのため、実施の形態１と異なり、操作受付装置１０と第１のサーバ２０との間で通信が行われる。しかしながら、操作受付装置１０は、ステップＳ１０２の段階で既に第１の操作指示を第１のサーバ２０に送信している。すなわち、ステップＳ２０２からステップＳ２０４の前に、操作受付装置１０と第１のサーバ２０とは通信を行っている。そのため、ステップＳ２０２からステップＳ２０４の段階で、操作受付装置１０と第１のサーバ２０との間の通信が途絶える可能性は低いと考えられる。 In the second embodiment, when the operation reception device 10 detects a change in the operation of the control target device 40, the operation reception device 10 transmits information on the change in the operation of the control target device 40 to the first server 20. Therefore, unlike the first embodiment, communication is performed between the operation reception device 10 and the first server 20. However, the operation receiving device 10 has already transmitted the first operation instruction to the first server 20 at the stage of step S102. That is, before step S202 to step S204, the operation receiving device 10 and the first server 20 are communicating with each other. Therefore, it is considered unlikely that the communication between the operation receiving device 10 and the first server 20 will be interrupted in the steps S202 to S204.
　以上説明したように、本実施の形態によれば、機器制御システム１において、操作受付装置１０は、検出した制御対象機器４０の動作の変化の情報を第１のサーバ２０に送信する。第１のサーバ２０は、制御対象機器４０の動作の変化が規定された動作パターンに合致する場合、制御対象機器４０の動作の変化が第１の操作指示に基づくものであると判定し、判定結果を操作受付装置１０に送信する。操作受付装置１０は、第１の操作指示に対する応答をユーザに対して出力する。この場合においても、機器制御システム１は、実施の形態１のときと同様の効果を得ることができる。 As described above, according to the present embodiment, in the device control system 1, the operation receiving device 10 transmits the detected information on the change in the operation of the controlled device 40 to the first server 20. When the change in the operation of the control target device 40 matches the defined operation pattern, the first server 20 determines that the change in the operation of the control target device 40 is based on the first operation instruction, and determines that the change is based on the first operation instruction. The result is transmitted to the operation reception device 10. The operation receiving device 10 outputs a response to the first operation instruction to the user. Even in this case, the device control system 1 can obtain the same effect as that of the first embodiment.
　以上の実施の形態に示した構成は、本発明の内容の一例を示すものであり、別の公知の技術と組み合わせることも可能であるし、本発明の要旨を逸脱しない範囲で、構成の一部を省略、変更することも可能である。 The configuration shown in the above-described embodiment shows an example of the content of the present invention, can be combined with another known technique, and is one of the configurations without departing from the gist of the present invention. It is also possible to omit or change the part.
　１　機器制御システム、１０　操作受付装置、１１　マイク、１２　スピーカ、１３，２１　通信部、１４，２２　制御部、１５　センサ、２０　第１のサーバ、３０　第２のサーバ、４０　制御対象機器、４１　通信アダプタ、４２　機器、１５１　カメラセンサ、１５２　光センサ、１５３　風量センサ、１５４　ＷｉＦｉモジュール、１５５　Ｂｌｕｅｔｏｏｔｈモジュール。 1 device control system, 10 operation reception device, 11 microphone, 12 speaker, 13, 21 communication unit, 14, 22 control unit, 15 sensor, 20 first server, 30 second server, 40 controlled device, 41 communication Adapter, 42 equipment, 151 camera sensor, 152 optical sensor, 153 air volume sensor, 154 WiFi module, 155 Bluetooth module.

Claims (15)

  1. 　ユーザからの指示を受け付けて制御対象機器を操作する機器制御システムであって、
    　前記制御対象機器に対する前記ユーザからの音声による第１の操作指示を受け付けて転送する操作受付装置と、
    　前記操作受付装置から前記第１の操作指示を受信し、前記第１の操作指示を前記制御対象機器で受け付け可能な第２の操作指示に変換して送信する第１のサーバと、
    　前記制御対象機器の管理を行い、かつ、前記第１のサーバから前記第２の操作指示を受信して前記制御対象機器に転送する第２のサーバと、
    　前記第２のサーバから前記第２の操作指示を受信し、前記第２の操作指示に基づく動作を行う前記制御対象機器と、
    　を備え、
    　前記第１のサーバは、前記操作受付装置から前記第１の操作指示を受信すると、前記操作受付装置に対して前記制御対象機器の動作の変化を監視するよう指示し、
    　前記操作受付装置は、前記制御対象機器の動作の変化を検出し、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであった場合、前記第１の操作指示に対する応答を出力する、
    　機器制御システム。     A device control system that receives instructions from users and operates controlled devices.
    An operation receiving device that receives and transfers a first operation instruction by voice from the user to the controlled device, and an operation receiving device.
    A first server that receives the first operation instruction from the operation reception device, converts the first operation instruction into a second operation instruction that can be accepted by the control target device, and transmits the first operation instruction.
    A second server that manages the controlled device and receives the second operation instruction from the first server and transfers the second operation instruction to the controlled device.
    A control target device that receives the second operation instruction from the second server and performs an operation based on the second operation instruction.
    With
    When the first server receives the first operation instruction from the operation reception device, the first server instructs the operation reception device to monitor a change in the operation of the control target device.
    The operation receiving device detects a change in the operation of the controlled device, and when the change in the operation of the controlled device is based on the first operation instruction, the operation receiving device responds to the first operation instruction. Output,
    Equipment control system.
  2. 　前記操作受付装置は、前記制御対象機器の動作の変化が規定された動作パターンに合致する場合、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定する、
    　請求項１に記載の機器制御システム。     When the change in the operation of the control target device matches the defined operation pattern, the operation reception device determines that the change in the operation of the control target device is based on the first operation instruction.
    The device control system according to claim 1.
  3. 　前記操作受付装置は、検出した前記制御対象機器の動作の変化の情報を前記第１のサーバに送信し、
    　前記第１のサーバは、前記制御対象機器の動作の変化が規定された動作パターンに合致する場合、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定し、判定結果を前記操作受付装置に送信する、
    　請求項１に記載の機器制御システム。     The operation receiving device transmits the detected information on the change in the operation of the controlled device to the first server.
    When the change in the operation of the controlled device matches the defined operation pattern, the first server determines that the change in the operation of the controlled device is based on the first operation instruction. Send the determination result to the operation reception device,
    The device control system according to claim 1.
  4. 　前記制御対象機器の動作の変化は、前記制御対象機器が発する光、および前記制御対象機器が空気調和機を備える場合に前記空気調和機から出力される風の量である風量の少なくとも１つである、
    　請求項１から３のいずれか１つに記載の機器制御システム。     The change in the operation of the controlled device is at least one of the light emitted by the controlled device and the air volume which is the amount of wind output from the air conditioner when the controlled device is equipped with an air conditioner. is there,
    The device control system according to any one of claims 1 to 3.
  5. 　前記制御対象機器の動作の変化は、前記制御対象機器から送信される通信信号である、
    　請求項１から３のいずれか１つに記載の機器制御システム。     The change in the operation of the controlled device is a communication signal transmitted from the controlled device.
    The device control system according to any one of claims 1 to 3.
  6. 　第１のサーバ、第２のサーバ、および制御対象機器とともに機器制御システムを構成する操作受付装置であって、
    　前記制御対象機器に対するユーザからの音声による第１の操作指示を受け付けるマイクと、
    　前記第１の操作指示を前記制御対象機器で受け付け可能な第２の操作指示に変換して前記第２の操作指示を前記制御対象機器の管理を行う前記第２のサーバを介して前記制御対象機器に送信する前記第１のサーバに、前記第１の操作指示を送信する通信部と、
    　前記制御対象機器の動作の変化を検出するセンサと、
    　前記第１の操作指示に対する応答を出力するスピーカと、
    　前記センサの検出結果に基づいて前記制御対象機器の動作の変化を監視し、前記第１の操作指示に対する前記スピーカからの応答の出力を制御する制御部と、
    　を備える操作受付装置。     An operation receiving device that constitutes a device control system together with a first server, a second server, and a device to be controlled.
    A microphone that receives a first voice operation instruction from the user for the controlled device, and
    The control target is converted into a second operation instruction that can be accepted by the control target device, and the second operation instruction is converted into the control target via the second server that manages the control target device. A communication unit that transmits the first operation instruction to the first server that transmits to the device, and
    A sensor that detects changes in the operation of the controlled device,
    A speaker that outputs a response to the first operation instruction,
    A control unit that monitors changes in the operation of the controlled device based on the detection result of the sensor and controls the output of a response from the speaker to the first operation instruction.
    Operation reception device equipped with.
  7. 　前記制御部は、前記センサで検出された前記制御対象機器の動作の変化が規定された動作パターンに合致し、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定した場合、前記スピーカから前記第１の操作指示に対する応答を出力させる、
    　請求項６に記載の操作受付装置。     It is said that the control unit matches the operation pattern in which the change in the operation of the control target device detected by the sensor is defined, and the change in the operation of the control target device is based on the first operation instruction. If it is determined, the speaker outputs a response to the first operation instruction.
    The operation reception device according to claim 6.
  8. 　前記制御部は、前記通信部を介して、前記センサで検出された前記制御対象機器の動作の変化の情報を前記第１のサーバに送信し、前記通信部を介して、第１のサーバから、前記制御対象機器の動作の変化が規定された動作パターンに合致し、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定した旨の判定結果を受信した場合、前記スピーカから前記第１の操作指示に対する応答を出力させる、
    　請求項６に記載の操作受付装置。     The control unit transmits information on changes in the operation of the controlled device detected by the sensor to the first server via the communication unit, and from the first server via the communication unit. , When the determination result that the change in the operation of the control target device matches the specified operation pattern and the change in the operation of the control target device is determined to be based on the first operation instruction is received. , The speaker outputs a response to the first operation instruction.
    The operation reception device according to claim 6.
  9. 　前記センサは、前記制御対象機器が発する光を検出する光センサ、および前記制御対象機器が空気調和機を備える場合に前記空気調和機から出力される風の量である風量を検出する風量センサの少なくとも１つである、
    　請求項６から８のいずれか１つに記載の操作受付装置。     The sensor is an optical sensor that detects light emitted by the controlled device, and an air volume sensor that detects an air volume that is the amount of air output from the air conditioner when the controlled device includes an air conditioner. At least one,
    The operation receiving device according to any one of claims 6 to 8.
  10. 　前記センサは、前記制御対象機器から送信される通信信号を受信する通信モジュールである、
    　請求項６から８のいずれか１つに記載の操作受付装置。     The sensor is a communication module that receives a communication signal transmitted from the controlled device.
    The operation receiving device according to any one of claims 6 to 8.
  11. 　操作受付装置、第１のサーバ、第２のサーバ、および制御対象機器で機器制御システムを構成する前記第１のサーバであるサーバであって、
    　前記操作受付装置から、前記制御対象機器に対するユーザからの音声による第１の操作指示を受信する通信部と、
    　前記第１の操作指示を前記制御対象機器で受け付け可能な第２の操作指示に変換する制御部と、
    　を備え、
    　前記制御部は、前記通信部を介して、前記第２の操作指示を、前記制御対象機器の管理を行う前記第２のサーバを介して前記制御対象機器に送信するとともに、前記操作受付装置に対して前記制御対象機器の動作の変化を監視するよう指示する、
    　サーバ。     A server that is the first server that constitutes a device control system with an operation receiving device, a first server, a second server, and a device to be controlled.
    A communication unit that receives a first operation instruction by voice from the user with respect to the control target device from the operation reception device.
    A control unit that converts the first operation instruction into a second operation instruction that can be accepted by the controlled device, and a control unit.
    With
    The control unit transmits the second operation instruction to the control target device via the communication unit, and sends the second operation instruction to the control target device via the second server that manages the control target device, and also to the operation reception device. Instructing the user to monitor changes in the operation of the controlled device.
    server.
  12. 　前記制御部は、前記通信部を介して、前記操作受付装置で検出された前記制御対象機器の動作の変化の情報を受信し、前記制御対象機器の動作の変化が規定された動作パターンに合致する場合、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定し、前記通信部を介して、判定結果を前記操作受付装置に送信する、
    　請求項１１に記載のサーバ。     The control unit receives the information on the change in the operation of the control target device detected by the operation reception device via the communication unit, and matches the operation pattern in which the change in the operation of the control target device is defined. In this case, it is determined that the change in the operation of the controlled device is based on the first operation instruction, and the determination result is transmitted to the operation receiving device via the communication unit.
    The server according to claim 11.
  13. 　ユーザからの指示を受け付けて制御対象機器を操作する機器制御システムの機器制御方法であって、
    　操作受付装置が、前記制御対象機器に対する前記ユーザからの音声による第１の操作指示を受け付けて転送する第１のステップと、
    　第１のサーバが、前記操作受付装置から前記第１の操作指示を受信し、前記第１の操作指示を前記制御対象機器で受け付け可能な第２の操作指示に変換して前記制御対象機器の管理を行う第２のサーバに送信するとともに、前記操作受付装置に対して前記制御対象機器の動作の変化を監視するよう指示する第２のステップと、
    　前記第２のサーバが、前記第１のサーバから前記第２の操作指示を受信して前記制御対象機器に転送する第３のステップと、
    　前記制御対象機器が、前記第２のサーバから前記第２の操作指示を受信し、前記第２の操作指示に基づく動作を行う第４のステップと、
    　前記操作受付装置が、前記制御対象機器の動作の変化を検出し、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであった場合、前記第１の操作指示に対する応答を出力する第５のステップと、
    　を含む機器制御方法。     It is a device control method of a device control system that receives instructions from a user and operates a device to be controlled.
    The first step in which the operation receiving device receives and transfers the first operation instruction by voice from the user to the controlled device, and the first step.
    The first server receives the first operation instruction from the operation reception device, converts the first operation instruction into a second operation instruction that can be accepted by the control target device, and converts the control target device into a second operation instruction. A second step of transmitting to a second server for management and instructing the operation receiving device to monitor changes in the operation of the controlled device, and a second step.
    A third step in which the second server receives the second operation instruction from the first server and transfers the second operation instruction to the controlled device.
    A fourth step in which the controlled device receives the second operation instruction from the second server and performs an operation based on the second operation instruction.
    When the operation receiving device detects a change in the operation of the controlled device and the change in the operation of the controlled device is based on the first operation instruction, a response to the first operation instruction is given. The fifth step to output and
    Equipment control methods including.
  14. 　前記第５のステップにおいて、前記操作受付装置は、前記制御対象機器の動作の変化が規定された動作パターンに合致する場合、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定する、
    　請求項１３に記載の機器制御方法。     In the fifth step, when the change in the operation of the control target device matches the defined operation pattern, the change in the operation of the control target device is based on the first operation instruction. Judge that
    The device control method according to claim 13.
  15. 　前記第５のステップにおいて、前記操作受付装置は、検出した前記制御対象機器の動作の変化の情報を前記第１のサーバに送信し、
    　さらに、
    　前記第１のサーバが、前記制御対象機器の動作の変化が規定された動作パターンに合致する場合、前記制御対象機器の動作の変化が前記第１の操作指示に基づくものであると判定し、判定結果を前記操作受付装置に送信する第６のステップ、
    　を含む請求項１３に記載の機器制御方法。     In the fifth step, the operation receiving device transmits the detected information on the change in the operation of the controlled device to the first server.
    further,
    When the first server matches the defined operation pattern for the change in the operation of the controlled device, it is determined that the change in the operation of the controlled device is based on the first operation instruction. The sixth step of transmitting the determination result to the operation receiving device,
    13. The device control method according to claim 13.
PCT/JP2019/047488 2019-12-04 2019-12-04 Device control system, operation reception apparatus, server, and device control method WO2021111555A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021562259A JP7191252B2 (en) 2019-12-04 2019-12-04 Device control system, operation reception device, server, and device control method
PCT/JP2019/047488 WO2021111555A1 (en) 2019-12-04 2019-12-04 Device control system, operation reception apparatus, server, and device control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/047488 WO2021111555A1 (en) 2019-12-04 2019-12-04 Device control system, operation reception apparatus, server, and device control method

Publications (1)

Publication Number Publication Date
WO2021111555A1 true WO2021111555A1 (en) 2021-06-10

Family

ID=76221138

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/047488 WO2021111555A1 (en) 2019-12-04 2019-12-04 Device control system, operation reception apparatus, server, and device control method

Country Status (2)

Country Link
JP (1) JP7191252B2 (en)
WO (1) WO2021111555A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015020154A1 (en) * 2013-08-07 2015-02-12 三菱電機株式会社 Communication device, appliance operating system, communication method, and program
JP2017166791A (en) * 2016-03-18 2017-09-21 パナソニックＩｐマネジメント株式会社 Control method of information terminal in air conditioning control system, and air conditioning control system
WO2019202666A1 (en) * 2018-04-17 2019-10-24 三菱電機株式会社 Apparatus control system and apparatus control method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015020154A1 (en) * 2013-08-07 2015-02-12 三菱電機株式会社 Communication device, appliance operating system, communication method, and program
JP2017166791A (en) * 2016-03-18 2017-09-21 パナソニックＩｐマネジメント株式会社 Control method of information terminal in air conditioning control system, and air conditioning control system
WO2019202666A1 (en) * 2018-04-17 2019-10-24 三菱電機株式会社 Apparatus control system and apparatus control method

Also Published As

Publication number Publication date
JPWO2021111555A1 (en) 2021-06-10
JP7191252B2 (en) 2022-12-16

Similar Documents

Publication Publication Date Title
KR102345926B1 (en) Electronic Device for detecting proximity of external object using signal having specified frequency
US8461781B2 (en) Configuration of a luminaire system
US8929739B2 (en) Remote control apparatus
US20170094048A1 (en) Light control method and apparatus for user equipment, and user terminal
KR102390979B1 (en) Electronic Device Capable of controlling IoT device to corresponding to the state of External Electronic Device and Electronic Device Operating Method
KR102556360B1 (en) Electronic device for controlling transmission power and method of driving the electronic device based on control information
CN103379252B (en) Display device and display control method
US9872132B2 (en) Information processing apparatus and method of deciding correction amount in the information processing apparatus
US10887502B2 (en) Information processing apparatus, information processing method, photographing system, and program
KR102326198B1 (en) Method for managing device based on signal strength band and electronic device thereof
KR102236057B1 (en) Method and system for changing battery diagnostic condition of battery management system (BMS) using connector connection
KR102538889B1 (en) Electronic device for preventing communication deterioration and method for controlling thereof
JP6911448B2 (en) Lighting system
WO2021111555A1 (en) Device control system, operation reception apparatus, server, and device control method
JP4790866B1 (en) Remote control system
US20140292384A1 (en) Methods of multi-protocol system and integrated circuit for multi-protocol communication on single wire
KR20190120906A (en) Apparatus and method for processing signal of electronic pen having altered resonance frequency
KR20190116749A (en) Method for performing wireless communication using biometric sensor and electronic device therefor
KR20190105857A (en) Electronic device and method for sensing temperature of speaker
JP4976726B2 (en) Sensor system and sensor unit
KR20190105759A (en) Electronic Device and the Method for Informing Message Reception
US10461856B2 (en) Wireless transmission of server status information
KR102532426B1 (en) Electronic device for providing visual effect based on location of user by using light emitting element and method thereof
US20190155392A1 (en) User interface system based on pointing device
EP4150251B1 (en) Selecting a sensor data processing method in accordance with a type of a lighting device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19955106

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021562259

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19955106

Country of ref document: EP

Kind code of ref document: A1