WO2019073618A1 - Server and electrical apparatus - Google Patents

Server and electrical apparatus Download PDF

Info

Publication number
WO2019073618A1
WO2019073618A1 PCT/JP2018/005043 JP2018005043W WO2019073618A1 WO 2019073618 A1 WO2019073618 A1 WO 2019073618A1 JP 2018005043 W JP2018005043 W JP 2018005043W WO 2019073618 A1 WO2019073618 A1 WO 2019073618A1
Authority
WO
WIPO (PCT)
Prior art keywords
server
communication interface
voice
cpu
electric device
Prior art date
Application number
PCT/JP2018/005043
Other languages
French (fr)
Japanese (ja)
Inventor
頌太 井上
琢馬 水野
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Priority to JP2019547897A priority Critical patent/JP7079791B2/en
Publication of WO2019073618A1 publication Critical patent/WO2019073618A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output

Definitions

  • the present invention relates to the technology of electrical devices, and more particularly to the technology of inputting instructions to electrical devices.
  • Patent Document 1 discloses an apparatus control device, an apparatus control system, and a program.
  • the device control system includes a voice recognition device that performs voice recognition, and a device control device that controls a heating and cooling device.
  • the storage unit stores a correspondence table (correspondence) that indicates the correspondence between the first word indicating the thermal sensation and the control content of the air conditioning and heating device.
  • the device control unit controls the air conditioning and heating device in accordance with the control content associated with the first word included in the recognition result input to the input unit.
  • the update unit stores the response stored in the storage unit Update the table At this time, the updating unit changes the control content of the correspondence table in the direction of reducing the excess or deficiency of the control according to the control content.
  • An object of the present invention is to provide a server or an appliance or a network system capable of efficiently receiving user's instructions.
  • a communication interface for communicating with a communication terminal and an electric device, and operation of the electric device corresponding to voice indicating an action or a state are specified based on voice data from the communication terminal, and communication is performed.
  • a server comprising: a processor for causing an electrical device to perform an operation via an interface.
  • a server or an electric device or a network system capable of efficiently receiving a user's command.
  • FIG. 1 is an image diagram showing an entire configuration of a network system 1 according to a first embodiment. It is a block diagram showing composition of electric equipment 100 concerning a 1st embodiment. It is a block diagram showing composition of communication terminal 200 concerning a 1st embodiment. It is a block diagram showing composition of server 300 concerning a 1st embodiment. It is an image figure showing apparatus data 321 concerning a 1st embodiment. It is an image figure showing message command data 322 concerning a 1st embodiment. It is a flowchart which shows the information processing of the server 300 concerning 1st Embodiment. It is a block diagram which shows the structure of the communication terminal 400 concerning 1st Embodiment. It is an image figure showing history data 323 concerning a 3rd embodiment. It is a flowchart which shows the information processing of the server 300 concerning 3rd Embodiment. It is a flow chart which shows information processing of server 300 concerning a 4th embodiment.
  • the network system 1 mainly includes a server 300 for a home appliance control application, a first communication terminal such as a robot 200A or a voice assistant device that exchanges various data with the server 300, and a smartphone 400A. And the air conditioner 100A that exchanges various data with the server 300 via the modem 500 and the WiFi (registered trademark) router 600, and an electric device such as the air purifier 100B, the television 100C, and the lighting 100D. .
  • a server 300 for a home appliance control application mainly includes a server 300 for a home appliance control application, a first communication terminal such as a robot 200A or a voice assistant device that exchanges various data with the server 300, and a smartphone 400A.
  • the air conditioner 100A that exchanges various data with the server 300 via the modem 500 and the WiFi (registered trademark) router 600, and an electric device such as the air purifier 100B, the television 100C, and the lighting 100D.
  • the electric devices are not limited to the air conditioner 100A, the air purifier 100B, the television 100C, the lighting 100D, etc., and may be a curtain opening / closing device, a shutter opening / closing device, a shutter opening / closing device, a refrigerator, a washing machine, a microwave, etc. These may be collectively referred to as the electric device 100.
  • the first communication terminal is not limited to the robot 200A or a dedicated voice assistant device, and may be a device having another microphone and a speaker. These are collectively referred to as the communication terminal 200.
  • the second communication terminal is not limited to the smartphone 400A, but may be a tablet, a game machine, a wearable terminal, a personal computer, or another communication device, and these are collectively referred to as the communication terminal 400.
  • the device performs an appropriate operation even for a message that is not a direct message of the user (indirect message). For example, when the user speaks “cold”, the server 300 raises the control temperature of heating operation of the air conditioner 100A, and when the user speaks “hot”, the server 300 lowers the control temperature of cooling operation of the air conditioner 100A, the user The server 300 causes the air conditioner 100A to start the night automatic operation, turn the operation off, or operate the ventilation fan when the user talks to "smell". That is, the operation content is selected from the user's message.
  • the direct message is a message including an operation instruction to the electric device. For example, if it is an air conditioner, it will be “Cooling ON”, “Set temperature up”, “Stop operation”, etc. If it is a TV, it will be “Channel change”, “TV switch ON” etc. And so on.
  • the electric device 100 includes, as main components, a CPU 110, a memory 120, a display 130, an operation unit 140, various sensors 150, a communication interface 160, and a remote control light receiving unit 165.
  • a speaker 170, a microphone 180, and an apparatus drive unit 190 are included.
  • the CPU 110 controls each part of the electric device 100 by executing a program stored in the memory 120 or an external storage medium.
  • the memory 120 is realized by various RAMs, various ROMs, and the like.
  • the memory 120 receives a program executed by the CPU 110, data generated by execution of the program by the CPU 110, data input through the operation unit 140, data received from a remote control, and data received from the server 300 through a router or the Internet. Store the data you have
  • the display 130 outputs a character, an image, etc. based on the signal from CPU110.
  • the display 130 may simply be a light (such as an LED or a Japanese LED).
  • the operation unit 140 is realized by a button or the like, receives an instruction from the user, and inputs the instruction to the CPU 110.
  • the display 130 and the operation unit 140 may constitute a touch panel. That is, the display 130 may double as the operation unit.
  • the various sensors 150 are a temperature sensor, a humidity sensor, a human sensor, a dust sensor, an odor sensor, and the like, and input measurement results to the CPU 110.
  • the communication interface 160 exchanges data with other devices by wired communication or wireless communication. That is, the communication interface 160 receives data from the CPU 110 and transmits the data to another device such as the server 300. Conversely, the communication interface 160 receives various data from the other device by controlling the communication interface 160. And input to the CPU 110.
  • the remote control light receiving unit 165 detects an infrared signal from a remote control or the like, and inputs a reception signal to the CPU 110. For example, the CPU 110 receives a power on / off command, other control commands, various data, and the like from the remote control via the remote control light receiver 165.
  • the remote control light receiver 165 is often attached to a light, an air conditioner, a fan, a television, a recorder, and the like.
  • the remote control receiver 165 may be omitted because the washing machine, the microwave, and the refrigerator do not have a remote control.
  • the remote control light receiving unit may be replaced with a wireless communication unit, and may be a remote control using Bluetooth (registered trademark). In this way, the second communication terminal such as a smartphone can be replaced with an infrared remote control and used like a wireless remote control.
  • the speaker 170 outputs various sounds, sounds, and melodies based on the signal from the CPU 110.
  • the microphone 180 receives voice and inputs voice data to the CPU 110.
  • the device drive unit 190 controls each part of the electric device, such as a compressor, a fan, another motor, a heater, and the like based on a signal from the CPU 110.
  • the air conditioner 100A realizes a cooling function, a heating function, an air blowing function, an ion generation function, and the like by the device driving unit 190.
  • the CPU 110 exchanges information such as the connection ID with the robot 200A or the smart phone 400A through the communication interface 160, thereby utilizing the information through the server 300 and using the robot 200A or the robot 200A.
  • the pairing with the smartphone 400A is performed.
  • the electric device 100 receives, via the server 300, a remote control instruction and the like from the robot 200A of the pairing destination and the smartphone 400A.
  • the CPU 110 of the air conditioner 100A indicates that the heating operation, the cooling operation, and the blowing operation are being performed via the communication interface 160, the set temperature, the set humidity, the current temperature, the current humidity, and the like via the server 300. It is provided to the smart phone 400A of the pairing destination, or receives a remote control command from the smart phone 400A or the like via the server 300.
  • Communication terminal 200 includes, as main components, CPU 210, memory 220, display 230, operation unit 240, various sensors 250, communication interface 260, speaker 270, microphone 280, and the like. Communication terminal 200 may not have a display.
  • the CPU 210 controls each unit of the communication terminal 200 by executing a program stored in the memory 220.
  • the memory 220 is realized by various RAMs, various ROMs, and the like.
  • the memory 220 stores a program executed by the CPU 210, data generated by the execution of the program by the CPU 210, input data, and other databases used for the home appliance management service according to the present embodiment.
  • the display 230 displays text or an image based on a signal from the CPU 210.
  • the operation unit 240 receives an instruction from a user or the like, and inputs the instruction to the CPU 210.
  • the display 230 and the operation unit 240 may be touch panels. That is, the display 230 may double as the operation unit.
  • the various sensors 250 are a temperature sensor, a humidity sensor, a human sensor, a dust sensor, an odor sensor, etc., and input measurement results to the CPU 210.
  • the communication interface 260 transmits data from the CPU 210 to other devices such as the electric device 100 and the server 300 via the Internet, a carrier network, a router, and the like. Conversely, the communication interface 260 receives data from the other device via the Internet, a carrier network, a router, etc., and passes it to the CPU 210.
  • the speaker 270 outputs voice, sound, and melody based on the data from the CPU 210.
  • the microphone 280 receives voice and inputs voice data to the CPU 410.
  • the CPU 210 acquires a voice message from the user via the microphone 280, transmits the voice data to the server 300 via the communication interface 260, or generates voice from the speaker 270 based on the voice data from the server 300.
  • the server 300 includes, as main components, a CPU 310, a memory 320, a display 330, an operation unit 340, and a communication interface 360.
  • the CPU 310 controls each part of the server 300 by executing a program stored in the memory 320.
  • the CPU 310 executes a program stored in the memory 320 and executes various processes described later by referring to various data.
  • the memory 320 may be realized by various types of RAM, various types of ROM, etc., and may be included in the server 300, or may be removable from various interfaces of the server 300. It may be a recording medium of another device accessible from The memory 320 may be a program executed by the CPU 310, data generated by execution of the program by the CPU 310, input data, device data 321 (see FIG. 5), message instruction data 322 (see FIG. 6), and others. A database or the like used for the home appliance management service according to the embodiment is stored.
  • the device data 321 specifies the device identification information (device ID), the device type, the user identification information (user ID), and the room for each device such as the air conditioner 100A.
  • Name room name
  • operation instruction for specifying the current operation of the device operation status such as various measurement results acquired by the sensor, identification information of the robot 200A of the pairing destination and the smartphone 400A (pair Ring terminal ID) and the like.
  • the message command data 322 includes, for each predetermined voice message (voice data, word) of the user, the correspondence between the type of device as the command target and the content of the command.
  • the display 330 displays text or an image based on a signal from the CPU 310.
  • the operation unit 340 receives an instruction from a service administrator or the like, and inputs the instruction to the CPU 310.
  • the communication interface 360 transmits data from the CPU 310 to the electric device 100 or another device such as the robot 200A or the smart phone 400A via the Internet, a carrier network, a router or the like. Conversely, the communication interface 360 receives data from other devices via the Internet, a carrier network, a router, etc., and passes it to the CPU 310.
  • the CPU 310 of the server 300 executes the following processing as shown in FIG.
  • the CPU 310 reads identification information (device ID), voice data (voice message, word) and the like from the communication terminal 200 from the received data (step S102).
  • the CPU 310 analyzes voice data (step S104).
  • the CPU 310 refers to the device data 321 to specify the electric device 100 that has been paired with the communication terminal 200 (step S106).
  • the CPU 310 refers to the message command data 322 to determine whether a word corresponding to the voice of the user acquired by the communication terminal 200 and the type of the electric device 100 is registered (step S108). If a word is registered (YES in step S108), CPU 310 creates an operation command corresponding to the registered word (step S114), and transmits it to electric device 100 (step S116).
  • CPU 310 determines whether the operation command has been formally accepted based on the response from electric device 100 (step S118). When the operation command is formally accepted (YES in step S118), CPU 310 transmits a normal notification to communication terminal 200 via communication interface 160 (step S120). By this, the CPU 210 of the communication terminal 200 causes the speaker 270 or the display 230 to output information indicating that the command corresponding to the sound has been accepted or the operation of the electric device 100. For example, based on the data from server 300, CPU 210 of communication terminal 200 outputs a message such as "The air conditioner in the living room has started cooling at 27 ° C.” via display or sound via display or voice.
  • CPU 310 transmits an error notification to communication terminal 200 via communication interface 160 (step S122).
  • the CPU 210 of the communication terminal 200 causes the speaker 270 or the display 230 to output that the command has not been accepted.
  • CPU 310 of server 300 executes an instruction to be executed and the instruction via communication terminal 200 by using communication interface 360 between step 108 and step S116.
  • a step may be provided for awaiting from the user an instruction as to whether or not the instruction may be executed by outputting a voice with the electric device 100 for the purpose.
  • CPU 210 of communication terminal 200 outputs a message such as "May start operation of air conditioner in living room at 27 ° C. for cooling” via speaker 270, " If a message (permission) such as “Please”, “Yes” or “Yes” is received, the instruction may be executed by the electric device 100. This can prevent the electrical device from starting an operation unexpected by the user.
  • the user when cool days continue and there is a day when the temperature rises temporarily but there is no need to perform cooling, the user emits "hot", and when the air conditioner turns on, unnecessary cooling is performed for the user. Can be prevented.
  • air conditioners if the room temperature is highly likely to develop heat stroke, the user may start the cooling operation by the word "hot” and the room temperature may develop heat stroke. If it is low, it may be configured to obtain the user's permission when there is a word "hot” issued by the user.
  • Communication terminal 400 which is a second communication terminal such as smartphone 400A according to the present embodiment will be described with reference to FIG.
  • Communication terminal 400 includes, as main components, CPU 410, memory 420, display 430, operation unit 440, communication interface 460, speaker 470, microphone 480 and the like.
  • the CPU 410 controls each unit of the communication terminal 400 by executing a program stored in the memory 420.
  • the memory 420 is realized by various RAMs, various ROMs, and the like.
  • the memory 420 is used for a program executed by the CPU 410, for example, an application program for home appliance control, data generated by the execution of the program by the CPU 410, input data, and other home appliance management services according to the present embodiment. Store the database etc.
  • the display 430 displays text or an image based on a signal from the CPU 410.
  • Operation unit 440 receives an instruction from a user or the like, and inputs the instruction to CPU 410.
  • CPU 410 displays an operation screen on display 430 based on an application program for controlling electric device 100, and receives an input of a remote control instruction to electric device 100 via operation unit 440.
  • the display 430 and the operation unit 440 may be touch panels. That is, the display 130 may double as the operation unit.
  • the communication interface 460 transmits data from the CPU 410 to another device such as the server 300 via the Internet, a carrier network, a router, and the like. Conversely, the communication interface 460 receives data from the other device via the Internet, a carrier network, a router, etc., and passes it to the CPU 410.
  • the speaker 470 outputs voice, sound, and melody based on data from the CPU 410, and the microphone 480 receives voice and inputs voice data to the CPU 410.
  • the operation of a plurality of types of devices is associated with the word, but even if the operation of one type of device is associated with one word Good.
  • a plurality of operations of one type of device may be associated with one word.
  • the operation is associated based not only on the word but also on the time zone, the weather, the air temperature and the like.
  • the cooling operation is performed if the temperature is high and the humidity is high, and the temperature is not so high and the humidity is high (such as rainy day in rainy season) If so, do a dehumidifying operation.
  • the history of operations for each user or each electric device 100 or each communication terminal 200 may be used. That is, in the network system 1 according to the present embodiment, more appropriate control is executed according to the user's command based on the history of the operation of the electric device 100 for each time zone and the like. For example, when an instruction to start cooling operation is input through communication terminal 400, server 300 determines the history of control temperature, air volume, wind direction, and the like for each condition such as the season, time zone, weather, etc. related to air conditioner 100A.
  • the air conditioner 100A is specified with a control temperature, an air flow rate, a wind direction, etc. suitable for the conditions.
  • the server 300 determines the channel 100C according to conditions such as the day of the week and the time zone related to the television 100C, and history based on volume and brightness. , The channel suitable for the conditions, the volume, the brightness and the like are designated to the television 100C.
  • the memory 320 stores history data 323.
  • the history data 323 includes history ID, time, day of the week, type of device, instruction, weather at that time, temperature at that time, etc. for each operation of the past device. Includes correspondence.
  • the CPU 310 of the server 300 executes the following processing as shown in FIG. That is, when the word is registered (YES in step S108), CPU 310 determines whether or not the history data of the electric device is recorded with reference to history data 323 (step S110). . If the history data of the electrical device is not recorded (NO at step S110), CPU 310 creates a default operation command (step S114), and proceeds to step S116.
  • CPU 110 When history data of the electric device is recorded (YES in step S110), CPU 110 creates a user's favorite operation command considering the time zone, the day of the week, the weather, etc. based on the history data. (Step S112). The CPU 110 transmits the created operation command to the device via the communication interface 160 (step S116).
  • the server 300 may set the detail of an operation command based on the log
  • the CPU 310 of the server 300 may select the frequently used electric device 100 in consideration of the time zone, the day of the week, the weather, and the like. That is, as shown in FIG. 11, when history data is recorded (when YES in step S110), CPU 110 selects among the plurality of electrical devices 100 based on device data 321 and history data 323. The electrical device 100 frequently used in a situation similar to the current situation is specified (step S111). Then, the CPU 110 creates a user's favorite operation command considering the time zone, the day of the week, the weather, etc. (step S112). The CPU 110 transmits the created operation command to the device via the communication interface 160 (step S116).
  • CPU 310 refers to device data 321 to identify electric device 100 which has already been paired with communication terminal 200 (step S106), and is registered. A default operation instruction corresponding to the word is generated (step S114) and transmitted to the electric device 100 (step S116).
  • the server 300 receives the voice message of the user from the communication terminal 200, and transmits an instruction corresponding to the voice message to the other electric device 100.
  • the server 300 may receive a voice message of the user from the electrical device 100, and transmit an operation command corresponding to the voice message to the electrical device 100.
  • Other devices may execute some or all of the roles of the devices of the network system 1 of the first and second embodiments.
  • another device plays a part or all of the roles of each of the server 300, the electric device 100, and the communication terminals 200 and 400, or some or all of the roles of each device are a plurality of devices It may be shared by
  • the CPU 210 of the communication terminal 200 locally uses the device data, message command data, and history data of its own memory 220, or device data and message command data and history of other databases. Based on the data, the electric device 100 and the operation corresponding to the voice message of the user may be specified, and the operation command may be transmitted to the electric device 100. Alternatively, the CPU 110 of the electric device 100 responds to the user's voice message locally, based on the message command data or history data of its own memory 120 or based on the message command data or history data of another database. May be identified and the operation may be performed.
  • a plurality of communication terminals 200 may be provided in one home or office.
  • the CPUs 310 and 210 of the server 300 and the communication terminal 200 refer to the device data 321 to preferentially select the electric device 100 in the same room as the communication terminal 200 that has received the user voice, or the communication terminal 200.
  • the electric device 100 closest to the above may be preferentially selected.
  • the communication interface 360 for communicating with the communication terminal 200 and the electric device 100, and the operation of the electric device 100 corresponding to the voice indicating the action or the state based on the voice data from the communication terminal 200.
  • a processor 310 for causing the electric device 100 to perform an operation via the communication interface 160.
  • the server 300 can refer to the correspondence between time zones, sounds indicating actions or states, and actions.
  • the processor 310 causes the electric device 100 to perform an operation corresponding to the time zone and the voice indicating the action or the state through the communication interface 360.
  • processor 310 causes a plurality of corresponding electric devices 100 to perform an operation corresponding to voice based on voice data from communication terminal 200 via communication interface 360.
  • processor 310 obtains feedback information on an instruction of operation to electric device 100 via communication interface 360, and provides the corresponding communication terminal 200 with the feedback information.
  • a server 300 comprising a processor 310 for causing the electrical device 100 to perform an operation via the communication interface 360.
  • the electric device 100 including the microphone 180 and the processor 110 for performing an operation corresponding to the voice indicating the action or the state based on the voice acquired through the microphone 180. Be done.
  • a server 300 comprising, via the communication interface 360, a processor 310 for causing the electric device 100 to execute an operation corresponding to a time zone and voice indicating an activity or a state.
  • a server 300 based on the communication interface 360 for communicating with the communication terminal 200 and the electric device 100 and the plurality of corresponding electric devices 100 via the communication interface 360 based on the voice data from the communication terminal 200.
  • a server 300 is provided, comprising: a processor 310 for performing operations corresponding to voice.
  • Network system 100 Electric device 100A: Air conditioner 100B: Air cleaner 100C: Television 100D: Lighting 110: CPU (processor) 120: Memory 130: Display 140: Operation unit 150: Sensor 160: Communication interface 165: Remote control light receiving unit 170: Speaker 180: Microphone 190: Device driver 200: Communication terminal 200A: Robot 210: CPU (processor) 220: Memory 230: Display 240: Operation unit 250: Sensor 260: Communication interface 270: Speaker 280: Microphone 300: Server 310: CPU (processor) 320: Memory 321: Device data 322: Message command data 323: History data 330: Display 340: Operation unit 360: Communication interface 400: Communication terminal 400A: Smart phone 410: CPU (processor) 420: Memory 430: Display 440: Operation unit 460: Communication interface 470: Speaker 480: Microphone 500: Modem 600: Router

Abstract

Provided is a server (300) that comprises: a communication interface (360) that is for communicating with a communication terminal (200) and an electrical apparatus (100); and a processor (310) that is for specifying an operation for the electrical apparatus (100) on the basis of audio data from the communication terminal (200), the operation corresponding to audio that indicates an action or a state, and for, via the communication interface (360), making the electrical apparatus (100) execute the operation.

Description

サーバおよび電気機器Server and electrical equipment
 本発明は、電気機器の技術に関し、特に電気機器への命令の入力の技術に関する。 The present invention relates to the technology of electrical devices, and more particularly to the technology of inputting instructions to electrical devices.
 従来から、空気調和機内部を自動で清掃する技術が知られている。たとえば、特開2013-207660号公報(特許文献1)には、機器制御装置、機器制御システムおよびプログラムが開示されている。特許文献1によると、機器制御システムは、音声認識を行う音声認識装置と、冷暖房機器を制御する機器制御装置とを備える。機器制御装置において、記憶部は、温冷感を表わす第1の言葉と冷暖房機器の制御内容との対応関係を表わす対応テーブル(対応関係)を記憶する。機器制御部は、入力部に入力された認識結果に含まれている第1の言葉に対応付けられた制御内容に従って冷暖房機器を制御する。機器制御部が上記制御内容に従って冷暖房機器を制御した後に、上記制御内容による制御の過不足を表わす第2の言葉が入力部に入力された場合、更新部は、記憶部に記憶されている対応テーブルを更新する。この際、更新部は、対応テーブルの上記制御内容を、上記制御内容による制御の過不足が低減する方向に変更する。 DESCRIPTION OF RELATED ART Conventionally, the technique which cleans the inside of an air conditioner automatically is known. For example, Japanese Patent Application Laid-Open No. 2013-207660 (Patent Document 1) discloses an apparatus control device, an apparatus control system, and a program. According to Patent Document 1, the device control system includes a voice recognition device that performs voice recognition, and a device control device that controls a heating and cooling device. In the device control device, the storage unit stores a correspondence table (correspondence) that indicates the correspondence between the first word indicating the thermal sensation and the control content of the air conditioning and heating device. The device control unit controls the air conditioning and heating device in accordance with the control content associated with the first word included in the recognition result input to the input unit. When the second word indicating excess or deficiency of control according to the control content is input to the input unit after the device control unit controls the air conditioning and heating equipment according to the control content, the update unit stores the response stored in the storage unit Update the table At this time, the updating unit changes the control content of the correspondence table in the direction of reducing the excess or deficiency of the control according to the control content.
特開2013-207660号公報JP, 2013-207660, A
 本発明の目的は、効率的にユーザの命令を受け付けることができるサーバまたは電気器またはネットワークシステムを提供することにある。 An object of the present invention is to provide a server or an appliance or a network system capable of efficiently receiving user's instructions.
 この発明のある態様に従うと、通信端末と電気機器と通信するための通信インターフェースと、通信端末からの音声データに基づいて、行動または状態を示す音声に対応する電気機器の動作を特定し、通信インターフェースを介して電気機器に動作を実行させるためのプロセッサとを備える、サーバが提供される。 According to an aspect of the present invention, a communication interface for communicating with a communication terminal and an electric device, and operation of the electric device corresponding to voice indicating an action or a state are specified based on voice data from the communication terminal, and communication is performed. A server is provided, comprising: a processor for causing an electrical device to perform an operation via an interface.
 以上のように、本発明によれば、効率的にユーザの命令を受け付けることができるサーバまたは電気器またはネットワークシステムが提供される。 As described above, according to the present invention, there is provided a server or an electric device or a network system capable of efficiently receiving a user's command.
第1の実施の形態にかかるネットワークシステム1の全体構成を示すイメージ図である。FIG. 1 is an image diagram showing an entire configuration of a network system 1 according to a first embodiment. 第1の実施の形態にかかる電気機器100の構成を示すブロック図である。It is a block diagram showing composition of electric equipment 100 concerning a 1st embodiment. 第1の実施の形態にかかる通信端末200の構成を示すブロック図である。It is a block diagram showing composition of communication terminal 200 concerning a 1st embodiment. 第1の実施の形態にかかるサーバ300の構成を示すブロック図である。It is a block diagram showing composition of server 300 concerning a 1st embodiment. 第1の実施の形態にかかる機器データ321を示すイメージ図である。It is an image figure showing apparatus data 321 concerning a 1st embodiment. 第1の実施の形態にかかるメッセージ命令データ322を示すイメージ図である。It is an image figure showing message command data 322 concerning a 1st embodiment. 第1の実施の形態にかかるサーバ300の情報処理を示すフローチャートである。It is a flowchart which shows the information processing of the server 300 concerning 1st Embodiment. 第1の実施の形態にかかる通信端末400の構成を示すブロック図である。It is a block diagram which shows the structure of the communication terminal 400 concerning 1st Embodiment. 第3の実施の形態にかかる履歴データ323を示すイメージ図である。It is an image figure showing history data 323 concerning a 3rd embodiment. 第3の実施の形態にかかるサーバ300の情報処理を示すフローチャートである。It is a flowchart which shows the information processing of the server 300 concerning 3rd Embodiment. 第4の実施の形態にかかるサーバ300の情報処理を示すフローチャートである。It is a flow chart which shows information processing of server 300 concerning a 4th embodiment.
 以下、図面を参照しつつ、本発明の実施の形態について説明する。以下の説明では、同一の部品には同一の符号を付してある。それらの名称および機能も同じである。したがって、それらについての詳細な説明は繰り返さない。
 <第1の実施の形態>
 <ネットワークシステム1の全体構成>
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description about them will not be repeated.
First Embodiment
<Overall Configuration of Network System 1>
 まず、図1を参照して、本実施の形態にかかるネットワークシステム1の全体構成について説明する。本実施の形態にかかるネットワークシステム1は、主に、家電制御用のアプリケーションのためのサーバ300と、サーバ300と各種データをやり取りするロボット200Aや音声アシスタント装置などの第1の通信端末とスマートフォン400Aなどの第2の通信端末と、モデム500やWiFi(登録商標)ルータ600を介してサーバ300と各種データをやり取りするエアコン100Aや空気清浄機100Bやテレビ100Cや照明100Dなどの電気機器などを含む。 First, with reference to FIG. 1, an overall configuration of a network system 1 according to the present embodiment will be described. The network system 1 according to the present embodiment mainly includes a server 300 for a home appliance control application, a first communication terminal such as a robot 200A or a voice assistant device that exchanges various data with the server 300, and a smartphone 400A. And the air conditioner 100A that exchanges various data with the server 300 via the modem 500 and the WiFi (registered trademark) router 600, and an electric device such as the air purifier 100B, the television 100C, and the lighting 100D. .
 なお、電気機器は、エアコン100Aや空気清浄機100Bやテレビ100Cや照明100Dなどには限られず、カーテン開閉装置や雨戸開閉装置やシャッター開閉装置や、冷蔵庫や、洗濯機や、電子レンジなどであってもよく、これらを総称して電気機器100ともいう。第1の通信端末は、ロボット200Aや専用の音声アシスタント装置に限らず、他のマイクやスピーカを有する装置であってもよく、これらを総称して通信端末200ともいう。第2の通信端末は、スマートフォン400Aに限らず、タブレットや、ゲーム機や、ウェアラブル端末や、パーソナルコンピュータや、その他の通信装置であってもよく、これらを総称して通信端末400ともいう。
 <ネットワークシステム1の動作概要>
The electric devices are not limited to the air conditioner 100A, the air purifier 100B, the television 100C, the lighting 100D, etc., and may be a curtain opening / closing device, a shutter opening / closing device, a shutter opening / closing device, a refrigerator, a washing machine, a microwave, etc. These may be collectively referred to as the electric device 100. The first communication terminal is not limited to the robot 200A or a dedicated voice assistant device, and may be a device having another microphone and a speaker. These are collectively referred to as the communication terminal 200. The second communication terminal is not limited to the smartphone 400A, but may be a tablet, a game machine, a wearable terminal, a personal computer, or another communication device, and these are collectively referred to as the communication terminal 400.
<Operation Overview of Network System 1>
 特に、本実施の形態にかかるネットワークシステム1においては、ユーザの直接的でないメッセージ(間接的なメッセージ)に対しても、機器が適切な動作を実行する。たとえば、ユーザが「寒い」と話すとサーバ300がエアコン100Aの暖房運転の制御温度を上げたり、ユーザが「暑い」と話すとサーバ300がエアコン100Aの冷房運転の制御温度を下げたり、ユーザが「おやすみ」や「行ってきます。」と話すとサーバ300がエアコン100Aにおやすみ自動運転を開始させたり、運転をOFFしたり、ユーザが「臭い」と話すと換気扇を運転させたりする。すなわち、ユーザのメッセージから、動作内容を選択するものである。 In particular, in the network system 1 according to the present embodiment, the device performs an appropriate operation even for a message that is not a direct message of the user (indirect message). For example, when the user speaks "cold", the server 300 raises the control temperature of heating operation of the air conditioner 100A, and when the user speaks "hot", the server 300 lowers the control temperature of cooling operation of the air conditioner 100A, the user The server 300 causes the air conditioner 100A to start the night automatic operation, turn the operation off, or operate the ventilation fan when the user talks to "smell". That is, the operation content is selected from the user's message.
 なお、直接的なメッセージとは、電気機器への動作指示が含まれるメッセージである。例えば、エアコンであれば、「冷房ON」「設定温度上げる」「運転停止」など、テレビであれば、「チャンネル変更」「テレビスイッチON」など、照明であれば、「照明ON」「照明OFF」などである。 The direct message is a message including an operation instruction to the electric device. For example, if it is an air conditioner, it will be "Cooling ON", "Set temperature up", "Stop operation", etc. If it is a TV, it will be "Channel change", "TV switch ON" etc. And so on.
 さらに、本実施の形態においては、ユーザからの音声命令に対して複数種類の機器の動作が対応付けられている。これによって、ユーザが、一言発するだけで、複数種類の機器のそれぞれが当該一言に適した動作を協力して実行し始める。以下、このようなネットワークシステム1を実現するための詳細な説明を行う。
 <電気機器100の構成>
Furthermore, in the present embodiment, operations of a plurality of types of devices are associated with voice commands from the user. As a result, the user can start to cooperate and execute an operation suitable for the single word, by simply making a single word. Hereinafter, the detailed description for realizing such a network system 1 will be made.
<Configuration of Electric Device 100>
 まずは、図2を参照して、ネットワークシステム1を構成する電気機器100の構成の一態様についてエアコンを用いて説明する。本実施の形態にかかる電気機器100(エアコン)は、主たる構成要素として、CPU110と、メモリ120と、ディスプレイ130、操作部140と、各種センサ150と、通信インターフェース160と、リモコン受光部165と、スピーカ170と、マイク180と、機器駆動部190とを含む。 First, with reference to FIG. 2, an aspect of the configuration of the electric device 100 configuring the network system 1 will be described using an air conditioner. The electric device 100 (air conditioner) according to the present embodiment includes, as main components, a CPU 110, a memory 120, a display 130, an operation unit 140, various sensors 150, a communication interface 160, and a remote control light receiving unit 165. A speaker 170, a microphone 180, and an apparatus drive unit 190 are included.
 CPU110は、メモリ120あるいは外部の記憶媒体に記憶されているプログラムを実行することによって、電気機器100の各部を制御する。 The CPU 110 controls each part of the electric device 100 by executing a program stored in the memory 120 or an external storage medium.
 メモリ120は、各種のRAM、各種のROMなどによって実現される。メモリ120は、CPU110によって実行されるプログラムや、CPU110によるプログラムの実行により生成されたデータ、操作部140を介して入力されたデータ、リモコンから受信したデータ、ルータやインターネットを介してサーバ300から受信したデータなどを記憶する。 The memory 120 is realized by various RAMs, various ROMs, and the like. The memory 120 receives a program executed by the CPU 110, data generated by execution of the program by the CPU 110, data input through the operation unit 140, data received from a remote control, and data received from the server 300 through a router or the Internet. Store the data you have
 ディスプレイ130は、CPU110からの信号に基づいて、文字や画像などを出力する。なお、ディスプレイ130は、単にライト(LEDや日文字LEDなど)であってもよい。 The display 130 outputs a character, an image, etc. based on the signal from CPU110. Note that the display 130 may simply be a light (such as an LED or a Japanese LED).
 操作部140は、ボタンなどによって実現され、ユーザからの命令を受け付けて、当該命令をCPU110に入力する。なお、ディスプレイ130と操作部140とは、タッチパネルを構成してもよい。すなわち、ディスプレイ130が操作部を兼ねていてもよい。 The operation unit 140 is realized by a button or the like, receives an instruction from the user, and inputs the instruction to the CPU 110. The display 130 and the operation unit 140 may constitute a touch panel. That is, the display 130 may double as the operation unit.
 各種センサ150は、温度センサや湿度センサや人感センサやホコリセンサやニオイセンサなどであって、測定結果をCPU110に入力するものである。 The various sensors 150 are a temperature sensor, a humidity sensor, a human sensor, a dust sensor, an odor sensor, and the like, and input measurement results to the CPU 110.
 通信インターフェース160は有線通信あるいは無線通信によって他の装置との間でデータをやり取りする。すなわち、通信インターフェース160は、CPU110からのデータを受け付けて、当該データをサーバ300などの他の装置に送信したり、逆に、通信インターフェース160を制御することによって他の装置から各種のデータを受信してCPU110に入力したりする。 The communication interface 160 exchanges data with other devices by wired communication or wireless communication. That is, the communication interface 160 receives data from the CPU 110 and transmits the data to another device such as the server 300. Conversely, the communication interface 160 receives various data from the other device by controlling the communication interface 160. And input to the CPU 110.
 リモコン受光部165は、リモコンなどからの赤外線信号を検知して、CPU110に受信信号を入力する。たとえば、CPU110は、リモコン受光部165を介して、リモコンから電源ON/OFF命令、その他の制御命令や各種データなどを受け付ける。なお、リモコン受光部165は、照明、エアコン、扇風機、テレビ、録画機などには付属していることが多い。洗濯機、電子レンジ、冷蔵庫にはリモコンが付属していないため、リモコン受光部165はなくてもよい。また、リモコン受光部を無線通信部に代えて、Bluetooth(登録商標)を用いたリモコンとしてもよい。このようにすれば、スマートフォンなどの第2の通信端末を赤外線リモコンに代えて無線リモコンのように使用することもできる。 The remote control light receiving unit 165 detects an infrared signal from a remote control or the like, and inputs a reception signal to the CPU 110. For example, the CPU 110 receives a power on / off command, other control commands, various data, and the like from the remote control via the remote control light receiver 165. The remote control light receiver 165 is often attached to a light, an air conditioner, a fan, a television, a recorder, and the like. The remote control receiver 165 may be omitted because the washing machine, the microwave, and the refrigerator do not have a remote control. Further, the remote control light receiving unit may be replaced with a wireless communication unit, and may be a remote control using Bluetooth (registered trademark). In this way, the second communication terminal such as a smartphone can be replaced with an infrared remote control and used like a wireless remote control.
 スピーカ170は、CPU110からの信号に基づいて、各種音声や音やメロディーを出力する。マイク180は、音声を受け付けて音声データをCPU110に入力する。 The speaker 170 outputs various sounds, sounds, and melodies based on the signal from the CPU 110. The microphone 180 receives voice and inputs voice data to the CPU 110.
 機器駆動部190は、CPU110からの信号に基づいて、電気機器の各部、たとえば圧縮機やファンやその他のモータやヒータなど、を制御する。具体的には、エアコン100Aは、機器駆動部190によって、冷房機能や暖房機能や送風機能やイオン発生機能などを実現する。 The device drive unit 190 controls each part of the electric device, such as a compressor, a fan, another motor, a heater, and the like based on a signal from the CPU 110. Specifically, the air conditioner 100A realizes a cooling function, a heating function, an air blowing function, an ion generation function, and the like by the device driving unit 190.
 このように構成されているため、CPU110は、通信インターフェース160を介して、ロボット200Aやスマートフォン400Aと接続IDなどの情報をやり取りすることによって、サーバ300を介して当該情報を利用してロボット200Aやスマートフォン400Aとのペアリングを実行する。そして、電気機器100は、サーバ300を介して、ペアリング先のロボット200Aやスマートフォン400Aからの遠隔制御命令などを受け付ける。たとえばエアコン100AのCPU110は、通信インターフェース160を介して、暖房運転や冷房運転や送風運転を実行している旨や、設定温度や、設定湿度や、現在温度や、現在湿度などをサーバ300を介してペアリング先のスマートフォン400Aに提供したり、サーバ300を介してスマートフォン400Aなどからの遠隔制御命令を受信したりする。
 <通信端末200の構成>
With such a configuration, the CPU 110 exchanges information such as the connection ID with the robot 200A or the smart phone 400A through the communication interface 160, thereby utilizing the information through the server 300 and using the robot 200A or the robot 200A. The pairing with the smartphone 400A is performed. Then, the electric device 100 receives, via the server 300, a remote control instruction and the like from the robot 200A of the pairing destination and the smartphone 400A. For example, the CPU 110 of the air conditioner 100A indicates that the heating operation, the cooling operation, and the blowing operation are being performed via the communication interface 160, the set temperature, the set humidity, the current temperature, the current humidity, and the like via the server 300. It is provided to the smart phone 400A of the pairing destination, or receives a remote control command from the smart phone 400A or the like via the server 300.
<Configuration of Communication Terminal 200>
 図3を参照して、本実施の形態にかかるロボット200Aなどの第1の通信端末である通信端末200の構成の一態様について説明する。通信端末200は、主たる構成要素として、CPU210と、メモリ220と、ディスプレイ230と、操作部240と、各種センサ250と、通信インターフェース260と、スピーカ270と、マイク280などを含む。なお、通信端末200において、ディスプレイを有さなくてもよい。 An aspect of the configuration of the communication terminal 200 which is a first communication terminal such as the robot 200A according to the present embodiment will be described with reference to FIG. Communication terminal 200 includes, as main components, CPU 210, memory 220, display 230, operation unit 240, various sensors 250, communication interface 260, speaker 270, microphone 280, and the like. Communication terminal 200 may not have a display.
 CPU210は、メモリ220に記憶されているプログラムを実行することによって、通信端末200の各部を制御する。 The CPU 210 controls each unit of the communication terminal 200 by executing a program stored in the memory 220.
 メモリ220は、各種のRAMや各種のROMなどによって実現される。メモリ220は、CPU210によって実行されるプログラムや、CPU210によるプログラムの実行により生成されたデータ、入力されたデータ、その他の本実施の形態にかかる家電管理サービスに利用されるデータベースなどを記憶する。 The memory 220 is realized by various RAMs, various ROMs, and the like. The memory 220 stores a program executed by the CPU 210, data generated by the execution of the program by the CPU 210, input data, and other databases used for the home appliance management service according to the present embodiment.
 ディスプレイ230は、CPU210からの信号に基づいて、テキストや画像を表示する。操作部240は、ユーザなどの命令を受け付けて、当該命令をCPU210に入力する。なお、ディスプレイ230と操作部240とはタッチパネルであってもよい。すなわち、ディスプレイ230が操作部を兼ねていてもよい。 The display 230 displays text or an image based on a signal from the CPU 210. The operation unit 240 receives an instruction from a user or the like, and inputs the instruction to the CPU 210. The display 230 and the operation unit 240 may be touch panels. That is, the display 230 may double as the operation unit.
 各種センサ250は、温度センサや湿度センサや人感センサやホコリセンサやニオイセンサなどであって、測定結果をCPU210に入力するものである。 The various sensors 250 are a temperature sensor, a humidity sensor, a human sensor, a dust sensor, an odor sensor, etc., and input measurement results to the CPU 210.
 通信インターフェース260は、CPU210からのデータを、インターネット、キャリア網、ルータなどを介して、電気機器100やサーバ300などの他の装置に送信する。逆に、通信インターフェース260は、インターネット、キャリア網、ルータなどを介して当該他の装置からのデータを受信して、CPU210に受け渡す。 The communication interface 260 transmits data from the CPU 210 to other devices such as the electric device 100 and the server 300 via the Internet, a carrier network, a router, and the like. Conversely, the communication interface 260 receives data from the other device via the Internet, a carrier network, a router, etc., and passes it to the CPU 210.
 スピーカ270は、CPU210からのデータに基づいて音声や音やメロディーを出力する。マイク280は音声を受け付けて音声データをCPU410に入力する。たとえば、CPU210は、マイク280を介してユーザからの音声メッセージを取得して、通信インターフェース260を介して当該音声データをサーバ300に送信したり、サーバ300からの音声データに基づいてスピーカ270から音声を出力したりする。
 <サーバ300の構成>
The speaker 270 outputs voice, sound, and melody based on the data from the CPU 210. The microphone 280 receives voice and inputs voice data to the CPU 410. For example, the CPU 210 acquires a voice message from the user via the microphone 280, transmits the voice data to the server 300 via the communication interface 260, or generates voice from the speaker 270 based on the voice data from the server 300. Output.
<Configuration of Server 300>
 図4を参照して、本実施の形態にかかるネットワークシステム1を構成するサーバ300の構成の一態様について説明する。サーバ300は、主たる構成要素として、CPU310と、メモリ320と、ディスプレイ330と、操作部340と、通信インターフェース360とを含む。 An aspect of the configuration of the server 300 constituting the network system 1 according to the present embodiment will be described with reference to FIG. The server 300 includes, as main components, a CPU 310, a memory 320, a display 330, an operation unit 340, and a communication interface 360.
 CPU310は、メモリ320に記憶されているプログラムを実行することによって、サーバ300の各部を制御する。たとえば、CPU310は、メモリ320に格納されているプログラムを実行し、各種のデータを参照することによって、後述する各種の処理を実行する。 The CPU 310 controls each part of the server 300 by executing a program stored in the memory 320. For example, the CPU 310 executes a program stored in the memory 320 and executes various processes described later by referring to various data.
 メモリ320は、各種のRAM、各種のROMなどによって実現され、サーバ300に内包されているものであってもよいし、サーバ300の各種インターフェースに着脱可能なものであってもよいし、サーバ300からアクセス可能な他の装置の記録媒体であってもよい。メモリ320は、CPU310によって実行されるプログラムや、CPU310によるプログラムの実行により生成されたデータ、入力されたデータ、機器データ321(図5参照)、メッセージ命令データ322(図6参照)、その他の本実施の形態にかかる家電管理サービスに利用されるデータベースなどを記憶する。 The memory 320 may be realized by various types of RAM, various types of ROM, etc., and may be included in the server 300, or may be removable from various interfaces of the server 300. It may be a recording medium of another device accessible from The memory 320 may be a program executed by the CPU 310, data generated by execution of the program by the CPU 310, input data, device data 321 (see FIG. 5), message instruction data 322 (see FIG. 6), and others. A database or the like used for the home appliance management service according to the embodiment is stored.
 なお、機器データ321は、図5に示すように、エアコン100Aなどの機器毎に、機器の識別情報(機器ID)と、機器の種類と、ユーザの識別情報(ユーザID)と、部屋を特定するための名前(部屋名)と、機器の現在の動作を特定するための動作命令やセンサによって取得した各種測定結果などの動作状態や、ペアリング先のロボット200Aやスマートフォン400Aの識別情報(ペアリング端末ID)などを含む。 As shown in FIG. 5, the device data 321 specifies the device identification information (device ID), the device type, the user identification information (user ID), and the room for each device such as the air conditioner 100A. Name (room name), operation instruction for specifying the current operation of the device, operation status such as various measurement results acquired by the sensor, identification information of the robot 200A of the pairing destination and the smartphone 400A (pair Ring terminal ID) and the like.
 メッセージ命令データ322は、図6に示すように、ユーザの所定の音声メッセージ(音声データ、ワード)毎に、命令の対象としての機器の種類と、命令の内容との対応関係を含む。 As shown in FIG. 6, the message command data 322 includes, for each predetermined voice message (voice data, word) of the user, the correspondence between the type of device as the command target and the content of the command.
 図4に戻って、ディスプレイ330は、CPU310からの信号に基づいて、テキストや画像を表示する。操作部340は、サービスの管理者などの命令を受け付けて、当該命令をCPU310に入力する。 Returning to FIG. 4, the display 330 displays text or an image based on a signal from the CPU 310. The operation unit 340 receives an instruction from a service administrator or the like, and inputs the instruction to the CPU 310.
 通信インターフェース360は、CPU310からのデータを、インターネット、キャリア網、ルータなどを介して、電気機器100やロボット200Aやスマートフォン400Aなどの他の装置に送信する。逆に、通信インターフェース360は、インターネット、キャリア網、ルータなどを介して他の装置からのデータを受信して、CPU310に受け渡す。 The communication interface 360 transmits data from the CPU 310 to the electric device 100 or another device such as the robot 200A or the smart phone 400A via the Internet, a carrier network, a router or the like. Conversely, the communication interface 360 receives data from other devices via the Internet, a carrier network, a router, etc., and passes it to the CPU 310.
 本実施の形態にかかるサーバ300のCPU310は、通信インターフェース360を介して、通信端末200からデータを受信すると、図7に示すように以下の処理を実行する。 When receiving data from the communication terminal 200 via the communication interface 360, the CPU 310 of the server 300 according to the present embodiment executes the following processing as shown in FIG.
 CPU310は、受信したデータから通信端末200からの識別情報(機器ID)や音声データ(音声メッセージ、ワード)などを読み出す(ステップS102)。CPU310は、音声データを解析する(ステップS104)。CPU310は、機器データ321を参照して、通信端末200とペアリング済みの電気機器100を特定する(ステップS106)。 The CPU 310 reads identification information (device ID), voice data (voice message, word) and the like from the communication terminal 200 from the received data (step S102). The CPU 310 analyzes voice data (step S104). The CPU 310 refers to the device data 321 to specify the electric device 100 that has been paired with the communication terminal 200 (step S106).
 CPU310は、メッセージ命令データ322を参照して、通信端末200が取得したユーザの音声と電気機器100の種類とに対応するワードが登録されているか否かを判断する(ステップS108)。ワードが登録されている場合(ステップS108においてYESである場合)、CPU310は、登録されているワードに対応する動作命令を作成し(ステップS114)、電気機器100に送信する(ステップS116)。 The CPU 310 refers to the message command data 322 to determine whether a word corresponding to the voice of the user acquired by the communication terminal 200 and the type of the electric device 100 is registered (step S108). If a word is registered (YES in step S108), CPU 310 creates an operation command corresponding to the registered word (step S114), and transmits it to electric device 100 (step S116).
 CPU310は、電気機器100からの回答に基づいて、動作命令が正式に受け付けられたか否かを判断する(ステップS118)。動作命令が正式に受け付けられた場合(ステップS118においてYESである場合)、CPU310は、通信インターフェース160を介して通信端末200に正常通知を送信する(ステップS120)。これによって、通信端末200のCPU210は、スピーカ270またはディスプレイ230に音声に対応する命令が受け付けられた旨や電気機器100の動作を示す情報を出力させる。たとえば、通信端末200のCPU210は、サーバ300からのデータに基づいて、スピーカ270を介して「リビングのエアコンを冷房27℃で運転開始しました。」などのメッセージを表示や音声にて出力する。 CPU 310 determines whether the operation command has been formally accepted based on the response from electric device 100 (step S118). When the operation command is formally accepted (YES in step S118), CPU 310 transmits a normal notification to communication terminal 200 via communication interface 160 (step S120). By this, the CPU 210 of the communication terminal 200 causes the speaker 270 or the display 230 to output information indicating that the command corresponding to the sound has been accepted or the operation of the electric device 100. For example, based on the data from server 300, CPU 210 of communication terminal 200 outputs a message such as "The air conditioner in the living room has started cooling at 27 ° C." via display or sound via display or voice.
 一方、動作命令が正式に受け付けられなかった場合(ステップS118においてNOである場合)、CPU310は、通信インターフェース160を介して通信端末200にエラー通知を送信する(ステップS122)。これによって、通信端末200のCPU210は、スピーカ270またはディスプレイ230に命令が受け付けられなかった旨を出力させる。 On the other hand, when the operation command is not formally accepted (NO in step S118), CPU 310 transmits an error notification to communication terminal 200 via communication interface 160 (step S122). By this, the CPU 210 of the communication terminal 200 causes the speaker 270 or the display 230 to output that the command has not been accepted.
 なお、本実施の形態においては、ステップ108とステップS116の間において、サーバ300のCPU310は、通信インターフェース360を利用することによって通信端末200を介して、実行しようとする命令と当該命令を実行するための電気機器100とを音声出力することによって、当該命令を実行してもよいか否かの指示をユーザから待ち受けるステップを設けてもよい。たとえば、通信端末200のCPU210は、サーバ300からのデータに基づいて、スピーカ270を介して「リビングのエアコンを冷房27℃で運転開始してもよいですか。」などのメッセージを出力し、「おねがい」「はい」「うん」などのメッセージ(許可)を受けた場合に、当該命令を電気機器100に実行させてもよい。これによって、ユーザが予期しない動作を電気機器が開始することを防止できる。 In the present embodiment, CPU 310 of server 300 executes an instruction to be executed and the instruction via communication terminal 200 by using communication interface 360 between step 108 and step S116. A step may be provided for awaiting from the user an instruction as to whether or not the instruction may be executed by outputting a voice with the electric device 100 for the purpose. For example, based on data from server 300, CPU 210 of communication terminal 200 outputs a message such as "May start operation of air conditioner in living room at 27 ° C. for cooling" via speaker 270, " If a message (permission) such as “Please”, “Yes” or “Yes” is received, the instruction may be executed by the electric device 100. This can prevent the electrical device from starting an operation unexpected by the user.
 例えば、涼しい日々が続いて一時的に気温が高くなったが冷房を行う必要がない日が存在した場合、ユーザが「暑い」と発したことで、エアコンがONするとユーザにとって不要な冷房をしてしまうことを防止できる。また、エアコンの場合、室内気温が熱中症を発症する可能性が高い場合は、ユーザが発した「暑い」とのワードにより、冷房運転を開始し、室内気温が熱中症を発症する可能性が低い場合は、ユーザが発した「暑い」とのワードがあった際には、ユーザの許可を得るような構成としてもよい。すなわち、周囲環境(室内気温、室外気温、夜中や昼間などの時間帯、明るさなど)に応じて、ユーザのメッセージ(ワード)により動作をすぐに開始する場合と、ユーザの許可を得てから動作を開始する場合とを併用してもよい。
 <通信端末400の構成>
For example, when cool days continue and there is a day when the temperature rises temporarily but there is no need to perform cooling, the user emits "hot", and when the air conditioner turns on, unnecessary cooling is performed for the user. Can be prevented. In the case of air conditioners, if the room temperature is highly likely to develop heat stroke, the user may start the cooling operation by the word "hot" and the room temperature may develop heat stroke. If it is low, it may be configured to obtain the user's permission when there is a word "hot" issued by the user. That is, depending on the surrounding environment (indoor temperature, outdoor temperature, time zone such as midnight or daytime, brightness etc.), operation may be started immediately by the user's message (word) and after obtaining the user's permission You may use together with the case where an operation | movement is started.
<Configuration of Communication Terminal 400>
 図8を参照して、本実施の形態にかかるスマートフォン400Aなどの第2の通信端末である通信端末400の構成の一態様について説明する。通信端末400は、主たる構成要素として、CPU410と、メモリ420と、ディスプレイ430と、操作部440と、通信インターフェース460と、スピーカ470と、マイク480などを含む。 One aspect of the configuration of communication terminal 400 which is a second communication terminal such as smartphone 400A according to the present embodiment will be described with reference to FIG. Communication terminal 400 includes, as main components, CPU 410, memory 420, display 430, operation unit 440, communication interface 460, speaker 470, microphone 480 and the like.
 CPU410は、メモリ420に記憶されているプログラムを実行することによって、通信端末400の各部を制御する。 The CPU 410 controls each unit of the communication terminal 400 by executing a program stored in the memory 420.
 メモリ420は、各種のRAMや各種のROMなどによって実現される。メモリ420は、CPU410によって実行されるプログラムたとえば家電制御用のアプリケーションプログラムや、CPU410によるプログラムの実行により生成されたデータ、入力されたデータ、その他の本実施の形態にかかる家電管理サービスに利用されるデータベースなどを記憶する。 The memory 420 is realized by various RAMs, various ROMs, and the like. The memory 420 is used for a program executed by the CPU 410, for example, an application program for home appliance control, data generated by the execution of the program by the CPU 410, input data, and other home appliance management services according to the present embodiment. Store the database etc.
 ディスプレイ430は、CPU410からの信号に基づいて、テキストや画像を表示する。操作部440は、ユーザなどの命令を受け付けて、当該命令をCPU410に入力する。たとえば、CPU410は、電気機器100の制御用のアプリケーションプログラムに基づいて、ディスプレイ430に操作画面を表示して、操作部440を介して電気機器100への遠隔制御命令の入力を受け付ける。なお、ディスプレイ430と操作部440とはタッチパネルであってもよい。すなわち、ディスプレイ130が操作部を兼ねていてもよい。 The display 430 displays text or an image based on a signal from the CPU 410. Operation unit 440 receives an instruction from a user or the like, and inputs the instruction to CPU 410. For example, CPU 410 displays an operation screen on display 430 based on an application program for controlling electric device 100, and receives an input of a remote control instruction to electric device 100 via operation unit 440. The display 430 and the operation unit 440 may be touch panels. That is, the display 130 may double as the operation unit.
 通信インターフェース460は、CPU410からのデータを、インターネット、キャリア網、ルータなどを介して、サーバ300などの他の装置に送信する。逆に、通信インターフェース460は、インターネット、キャリア網、ルータなどを介して当該他の装置からのデータを受信して、CPU410に受け渡す。 The communication interface 460 transmits data from the CPU 410 to another device such as the server 300 via the Internet, a carrier network, a router, and the like. Conversely, the communication interface 460 receives data from the other device via the Internet, a carrier network, a router, etc., and passes it to the CPU 410.
 スピーカ470は、CPU410からのデータに基づいて音声や音やメロディーを出力し、マイク480は音声を受け付けて音声データをCPU410に入力する。
 <第2の実施の形態>
The speaker 470 outputs voice, sound, and melody based on data from the CPU 410, and the microphone 480 receives voice and inputs voice data to the CPU 410.
Second Embodiment
 第1の実施の形態においては、図6に示すように、ワードに対して複数種類の機器の動作が対応付けられていたが、1つのワードに1種類の機器の動作が対応付けられてもよい。また、1つのワードに1種類の機器の複数の動作が対応付けられてもよい。 In the first embodiment, as shown in FIG. 6, the operation of a plurality of types of devices is associated with the word, but even if the operation of one type of device is associated with one word Good. In addition, a plurality of operations of one type of device may be associated with one word.
 また、ワードだけでなく、時間帯や、天気や、気温などにも基づいて、動作が対応付けられていることが好ましい。例えば、エアコンの場合、ユーザが暑いと発した際、気温が高く、湿度も高い環境であれば冷房運転を行い、気温がそれほど高くなく、湿度が高い(梅雨時などの雨の日)などの場合は、除湿運転を行う。
 <第3の実施の形態>
Moreover, it is preferable that the operation is associated based not only on the word but also on the time zone, the weather, the air temperature and the like. For example, in the case of an air conditioner, when the user issues a hot condition, the cooling operation is performed if the temperature is high and the humidity is high, and the temperature is not so high and the humidity is high (such as rainy day in rainy season) If so, do a dehumidifying operation.
Third Embodiment
 あるいは、ユーザ毎または電気機器100毎または通信端末200毎の動作の履歴を利用してもよい。すなわち、本実施の形態にかかるネットワークシステム1においては、電気機器100に関する時間帯毎の動作などの履歴に基づいて、ユーザの命令に応じて、より適切な制御を実行するものである。たとえば、通信端末400を介して冷房運転開始の命令が入力された際に、サーバ300は、エアコン100Aに関する季節や時間帯や天気などの条件毎の制御温度や風量や風向きなどの履歴に基づいて、条件に適した制御温度や風量や風向きなどをエアコン100Aに指定する。あるいは、通信端末400を介してテレビ100Cの電源ONの命令が入力された際に、サーバ300は、テレビ100Cに関する曜日や時間帯などの条件毎のチャンネルや音量や明るさなどの履歴に基づいて、条件に適したチャンネルや音量や明るさなどをテレビ100Cに指定する。 Alternatively, the history of operations for each user or each electric device 100 or each communication terminal 200 may be used. That is, in the network system 1 according to the present embodiment, more appropriate control is executed according to the user's command based on the history of the operation of the electric device 100 for each time zone and the like. For example, when an instruction to start cooling operation is input through communication terminal 400, server 300 determines the history of control temperature, air volume, wind direction, and the like for each condition such as the season, time zone, weather, etc. related to air conditioner 100A. The air conditioner 100A is specified with a control temperature, an air flow rate, a wind direction, etc. suitable for the conditions. Alternatively, when an instruction to turn on the power of the television 100C is input through the communication terminal 400, the server 300 determines the channel 100C according to conditions such as the day of the week and the time zone related to the television 100C, and history based on volume and brightness. , The channel suitable for the conditions, the volume, the brightness and the like are designated to the television 100C.
 本実施の形態にかかるメモリ320は、履歴データ323を記憶する。履歴データ323は、図9に示すように、過去の機器の動作毎に、履歴IDと、時刻と、曜日と、機器の種類と、命令と、そのときの天気と、そのときの気温などの対応関係を含む。 The memory 320 according to the present embodiment stores history data 323. As shown in FIG. 9, the history data 323 includes history ID, time, day of the week, type of device, instruction, weather at that time, temperature at that time, etc. for each operation of the past device. Includes correspondence.
 そして、本実施の形態にかかるサーバ300のCPU310は、通信インターフェース360を介して、通信端末200からデータを受信すると、図10に示すように以下の処理を実行する。すなわち、ワードが登録されている場合(ステップS108においてYESである場合)、CPU310は、履歴データ323を参照して、当該電気機器の履歴データが記録されているか否かを判断する(ステップS110)。当該電気機器の履歴データが記録されていない場合(ステップS110においてNOである場合)、CPU310は、デフォルトの動作命令を作成して(ステップS114)、ステップS116に進む。 Then, upon receiving data from the communication terminal 200 via the communication interface 360, the CPU 310 of the server 300 according to the present embodiment executes the following processing as shown in FIG. That is, when the word is registered (YES in step S108), CPU 310 determines whether or not the history data of the electric device is recorded with reference to history data 323 (step S110). . If the history data of the electrical device is not recorded (NO at step S110), CPU 310 creates a default operation command (step S114), and proceeds to step S116.
 当該電気機器の履歴データが記録されている場合(ステップS110においてYESである場合)、CPU110は、履歴データに基づいて、時間帯や曜日や天気などを考慮したユーザの好みの動作命令を作成する(ステップS112)。CPU110は、通信インターフェース160を介して、作成した動作命令を機器に送信する(ステップS116)。 When history data of the electric device is recorded (YES in step S110), CPU 110 creates a user's favorite operation command considering the time zone, the day of the week, the weather, etc. based on the history data. (Step S112). The CPU 110 transmits the created operation command to the device via the communication interface 160 (step S116).
 その他の処理は、第1の実施の形態と同様であるため、ここではそれらの説明を繰り返さない。 The other processes are the same as in the first embodiment, and therefore the description thereof will not be repeated here.
 なお、通信端末200を介した音声による電気機器100へのメッセージが入力された場合に、上記のようにサーバ300が履歴データ323に基づいて動作命令の詳細を設定してもよい。すなわち、リモコンを介して電気機器100への動作命令が入力された場合は、リモコンの表示や、前回の動作内容を優先して運転してもよい。
 <第4の実施の形態>
In addition, when the message to the electric equipment 100 by the audio | voice via the communication terminal 200 is input, the server 300 may set the detail of an operation command based on the log | history data 323 as mentioned above. That is, when an operation command to the electric device 100 is input through the remote control, the display of the remote control or the previous operation may be given priority.
Fourth Embodiment
 さらには、履歴データ323を参照することによって、サーバ300のCPU310は、時間帯や曜日や天気などを考慮して、よく利用されている電気機器100を選択してもよい。すなわち、図11に示すように、履歴データが記録されている場合(ステップS110においてYESである場合)、CPU110は、機器データ321と履歴データ323とに基づいて、複数の電気機器100の中から、現在の状況と似ている状況においてよく利用されている電気機器100を特定する(ステップS111)。そしてCPU110は、時間帯や曜日や天気などを考慮したユーザの好みの動作命令を作成する(ステップS112)。CPU110は、通信インターフェース160を介して、作成した動作命令を機器に送信する(ステップS116)。 Furthermore, by referring to the history data 323, the CPU 310 of the server 300 may select the frequently used electric device 100 in consideration of the time zone, the day of the week, the weather, and the like. That is, as shown in FIG. 11, when history data is recorded (when YES in step S110), CPU 110 selects among the plurality of electrical devices 100 based on device data 321 and history data 323. The electrical device 100 frequently used in a situation similar to the current situation is specified (step S111). Then, the CPU 110 creates a user's favorite operation command considering the time zone, the day of the week, the weather, etc. (step S112). The CPU 110 transmits the created operation command to the device via the communication interface 160 (step S116).
 履歴データが記録されていない場合(ステップS110においてNOである場合)、CPU310は、機器データ321を参照して、通信端末200とペアリング済みの電気機器100を特定し(ステップS106)、登録されているワードに対応するデフォルトの動作命令を作成し(ステップS114)、電気機器100に送信する(ステップS116)。
 <第5の実施の形態>
If the history data is not recorded (NO in step S110), CPU 310 refers to device data 321 to identify electric device 100 which has already been paired with communication terminal 200 (step S106), and is registered. A default operation instruction corresponding to the word is generated (step S114) and transmitted to the electric device 100 (step S116).
Fifth Embodiment
 第1の実施の形態においては、サーバ300は、通信端末200からユーザの音声メッセージを受け取って、当該音声メッセージに対応する命令を他の電気機器100に送信するものであった。しかしながらこのような形態には限られない。すなわち、サーバ300は、電気機器100からユーザの音声メッセージを受け取って、当該音声メッセージに対応する動作命令を当該電気機器100に送信してもよい。
 <第6の実施の形態>
In the first embodiment, the server 300 receives the voice message of the user from the communication terminal 200, and transmits an instruction corresponding to the voice message to the other electric device 100. However, it is not limited to such a form. That is, the server 300 may receive a voice message of the user from the electrical device 100, and transmit an operation command corresponding to the voice message to the electrical device 100.
Sixth Embodiment
 第1および第2の実施の形態のネットワークシステム1の各装置の役割の一部または全部を他の装置が実行してもよい。たとえば、サーバ300や電気機器100や通信端末200,400の各々の役割の一部または全部を別の装置が担ったり、それらの装置の1つ1つの役割の一部または全部を、複数の装置で分担したりしてもよい。 Other devices may execute some or all of the roles of the devices of the network system 1 of the first and second embodiments. For example, another device plays a part or all of the roles of each of the server 300, the electric device 100, and the communication terminals 200 and 400, or some or all of the roles of each device are a plurality of devices It may be shared by
 たとえば、サーバ300を介さずに、通信端末200のCPU210が、ローカルで、自身のメモリ220の機器データやメッセージ命令データや履歴データに基づいて、あるいは他のデータベースの機器データやメッセージ命令データや履歴データに基づいて、ユーザの音声メッセージに対応する電気機器100と動作とを特定し、当該電気機器100に動作命令を送信してもよい。あるいは、電気機器100のCPU110が、ローカルで、自身のメモリ120のメッセージ命令データや履歴データに基づいて、あるいは他のデータベースのメッセージ命令データや履歴データに基づいて、ユーザの音声メッセージに対応する動作を特定し、当該動作を行ってもよい。 For example, without passing through the server 300, the CPU 210 of the communication terminal 200 locally uses the device data, message command data, and history data of its own memory 220, or device data and message command data and history of other databases. Based on the data, the electric device 100 and the operation corresponding to the voice message of the user may be specified, and the operation command may be transmitted to the electric device 100. Alternatively, the CPU 110 of the electric device 100 responds to the user's voice message locally, based on the message command data or history data of its own memory 120 or based on the message command data or history data of another database. May be identified and the operation may be performed.
 あるいは、1つの家やオフィスに複数の通信端末200が複数あってもよい。この場合は、サーバ300や通信端末200のCPU310,210は、機器データ321を参照して、ユーザ音声を受け付けた通信端末200と同じ部屋の電気機器100を優先的に選択したり、通信端末200に一番近い電気機器100を優先的に選択したりしてもよい。
 <まとめ>
Alternatively, a plurality of communication terminals 200 may be provided in one home or office. In this case, the CPUs 310 and 210 of the server 300 and the communication terminal 200 refer to the device data 321 to preferentially select the electric device 100 in the same room as the communication terminal 200 that has received the user voice, or the communication terminal 200. The electric device 100 closest to the above may be preferentially selected.
<Summary>
 上記の実施の形態においては、通信端末200と電気機器100と通信するための通信インターフェース360と、通信端末200からの音声データに基づいて、行動または状態を示す音声に対応する電気機器100の動作を特定し、通信インターフェース160を介して電気機器100に動作を実行させるためのプロセッサ310とを備える、サーバ300が提供される。 In the above embodiment, the communication interface 360 for communicating with the communication terminal 200 and the electric device 100, and the operation of the electric device 100 corresponding to the voice indicating the action or the state based on the voice data from the communication terminal 200. , And a processor 310 for causing the electric device 100 to perform an operation via the communication interface 160.
 好ましくは、サーバ300は、時間帯と、行動または状態を示す音声と、動作と、の対応関係を参照可能である。プロセッサ310は、通信インターフェース360を介して、時間帯と行動または状態を示す音声とに対応する動作を電気機器100に実行させる。 Preferably, the server 300 can refer to the correspondence between time zones, sounds indicating actions or states, and actions. The processor 310 causes the electric device 100 to perform an operation corresponding to the time zone and the voice indicating the action or the state through the communication interface 360.
 好ましくは、プロセッサ310は、通信端末200からの音声データに基づいて、通信インターフェース360を介して、対応する複数の電気機器100に音声に対応する動作を実行させる。 Preferably, processor 310 causes a plurality of corresponding electric devices 100 to perform an operation corresponding to voice based on voice data from communication terminal 200 via communication interface 360.
 好ましくは、プロセッサ310は、通信インターフェース360を介して、電気機器100に対する動作の命令に関するフィードバック情報を取得して、対応する通信端末200に当該フィードバック情報を提供する。 Preferably, processor 310 obtains feedback information on an instruction of operation to electric device 100 via communication interface 360, and provides the corresponding communication terminal 200 with the feedback information.
 上記の実施の形態においては、電気機器100と通信するための通信インターフェース360と、電気機器100からの音声データに基づいて、行動または状態を示す音声に対応する電気機器100の動作を特定し、通信インターフェース360を介して電気機器100に動作を実行させるためのプロセッサ310とを備える、サーバ300が提供される。 In the above embodiment, based on the communication interface 360 for communicating with the electric device 100 and the voice data from the electric device 100, the operation of the electric device 100 corresponding to the voice indicating the action or the state is specified, A server 300 is provided, comprising a processor 310 for causing the electrical device 100 to perform an operation via the communication interface 360.
 上記の実施の形態においては、マイク180と、マイク180を介して取得した音声に基づいて、行動または状態を示す音声に対応する動作を実行するためのプロセッサ110と、を備える電気機器100が提供される。 In the above embodiment, provided is the electric device 100 including the microphone 180 and the processor 110 for performing an operation corresponding to the voice indicating the action or the state based on the voice acquired through the microphone 180. Be done.
 上記の実施の形態においては、通信端末200と電気機器100と通信するための通信インターフェース360と、時間帯と、行動または状態を示す音声と、動作と、の対応関係を参照可能であって、通信インターフェース360を介して、時間帯と行動または状態を示す音声とに対応する動作を電気機器100に実行させるためのプロセッサ310とを備えるサーバ300が提供される。 In the above embodiment, it is possible to refer to the correspondence among the communication interface 360 for communicating with the communication terminal 200 and the electric device 100, the time zone, the voice indicating the action or the state, and the action, There is provided a server 300 comprising, via the communication interface 360, a processor 310 for causing the electric device 100 to execute an operation corresponding to a time zone and voice indicating an activity or a state.
 上記の実施の形態においては、通信端末200と電気機器100と通信するための通信インターフェース360と、通信端末200からの音声データに基づいて、通信インターフェース360を介して、対応する複数の電気機器100に音声に対応する動作を実行させるためのプロセッサ310とを備える、サーバ300が提供される。 In the above embodiment, based on the communication interface 360 for communicating with the communication terminal 200 and the electric device 100 and the plurality of corresponding electric devices 100 via the communication interface 360 based on the voice data from the communication terminal 200. A server 300 is provided, comprising: a processor 310 for performing operations corresponding to voice.
 今回開示された実施の形態はすべての点で例示であって制限的なものではないと考えられるべきである。本発明の範囲は、上記した説明ではなく、特許請求の範囲によって示され、特許請求の範囲と均等の意味および範囲内でのすべての変更が含まれることが意図される。 It should be understood that the embodiments disclosed herein are illustrative and non-restrictive in every respect. The scope of the present invention is indicated not by the above description but by the claims, and is intended to include all modifications within the meaning and scope equivalent to the claims.
1    :ネットワークシステム
100  :電気機器
100A :エアコン
100B :空気清浄機
100C :テレビ
100D :照明
110  :CPU(プロセッサ)
120  :メモリ
130  :ディスプレイ
140  :操作部
150  :センサ
160  :通信インターフェース
165  :リモコン受光部
170  :スピーカ
180  :マイク
190  :機器駆動部
200  :通信端末
200A :ロボット
210  :CPU(プロセッサ)
220  :メモリ
230  :ディスプレイ
240  :操作部
250  :センサ
260  :通信インターフェース
270  :スピーカ
280  :マイク
300  :サーバ
310  :CPU(プロセッサ)
320  :メモリ
321  :機器データ
322  :メッセージ命令データ
323  :履歴データ
330  :ディスプレイ
340  :操作部
360  :通信インターフェース
400  :通信端末
400A :スマートフォン
410  :CPU(プロセッサ)
420  :メモリ
430  :ディスプレイ
440  :操作部
460  :通信インターフェース
470  :スピーカ
480  :マイク
500  :モデム
600  :ルータ
1: Network system 100: Electric device 100A: Air conditioner 100B: Air cleaner 100C: Television 100D: Lighting 110: CPU (processor)
120: Memory 130: Display 140: Operation unit 150: Sensor 160: Communication interface 165: Remote control light receiving unit 170: Speaker 180: Microphone 190: Device driver 200: Communication terminal 200A: Robot 210: CPU (processor)
220: Memory 230: Display 240: Operation unit 250: Sensor 260: Communication interface 270: Speaker 280: Microphone 300: Server 310: CPU (processor)
320: Memory 321: Device data 322: Message command data 323: History data 330: Display 340: Operation unit 360: Communication interface 400: Communication terminal 400A: Smart phone 410: CPU (processor)
420: Memory 430: Display 440: Operation unit 460: Communication interface 470: Speaker 480: Microphone 500: Modem 600: Router

Claims (8)

  1.  通信端末と電気機器と通信するための通信インターフェースと、
     前記通信端末からの音声データに基づいて、行動または状態を示す音声に対応する前記電気機器の動作を特定し、前記通信インターフェースを介して前記電気機器に前記動作を実行させるためのプロセッサとを備える、サーバ。
    A communication interface for communicating with the communication terminal and the electric device;
    A processor for specifying an operation of the electric device corresponding to voice indicating an action or a state based on voice data from the communication terminal, and causing the electric device to execute the operation via the communication interface ,server.
  2.  前記サーバは、時間帯と、前記行動または状態を示す音声と、前記動作と、の対応関係を参照可能であって、
     前記プロセッサは、前記通信インターフェースを介して、前記時間帯と前記行動または状態を示す音声とに対応する動作を前記電気機器に実行させる、請求項1に記載のサーバ。
    The server can refer to the correspondence between a time zone, a voice indicating the action or state, and the action,
    The server according to claim 1, wherein the processor causes the electric device to execute an operation corresponding to the time zone and a voice indicating the action or state via the communication interface.
  3.  前記プロセッサは、前記通信端末からの音声データに基づいて、前記通信インターフェースを介して、対応する複数の電気機器に音声に対応する動作を実行させる、請求項1または2に記載のサーバ。 The server according to claim 1, wherein the processor causes the plurality of corresponding electric devices to execute an operation corresponding to voice based on voice data from the communication terminal via the communication interface.
  4.  前記プロセッサは、前記通信インターフェースを介して、前記電気機器に対する動作の命令に関するフィードバック情報を取得して、対応する前記通信端末に当該フィードバック情報を提供する、請求項1から3のいずれか1項に記載のサーバ。 The processor according to any one of claims 1 to 3, wherein the processor acquires feedback information on an instruction of operation to the electric device via the communication interface and provides the feedback information to the corresponding communication terminal. Described server.
  5.  電気機器と通信するための通信インターフェースと、
     前記電気機器からの音声データに基づいて、行動または状態を示す音声に対応する前記電気機器の動作を特定し、前記通信インターフェースを介して前記電気機器に前記動作を実行させるためのプロセッサとを備える、サーバ。
    A communication interface for communicating with the electrical device;
    A processor for specifying an operation of the electric device corresponding to voice indicating an action or a state based on voice data from the electric device, and causing the electric device to execute the operation via the communication interface ,server.
  6.  マイクと、
     前記マイクを介して取得した音声に基づいて、行動または状態を示す音声に対応する動作を実行するためのプロセッサと、を備える電気機器。
    Mike and
    A processor for performing an operation corresponding to the voice indicating an action or a state based on the voice acquired through the microphone.
  7.  通信端末と電気機器と通信するための通信インターフェースと、
     時間帯と、行動または状態を示す音声と、動作と、の対応関係を参照可能であって、前記通信インターフェースを介して、前記時間帯と前記行動または状態を示す音声とに対応する動作を前記電気機器に実行させるためのプロセッサとを備えるサーバ。
    A communication interface for communicating with the communication terminal and the electric device;
    It is possible to refer to the correspondence relationship between the time zone, the voice indicating the action or the state, and the action, and the action corresponding to the voice indicating the time zone and the action or the state through the communication interface And a processor for causing an electrical device to execute.
  8.  通信端末と電気機器と通信するための通信インターフェースと、
     前記通信端末からの音声データに基づいて、前記通信インターフェースを介して、対応する複数の電気機器に音声に対応する動作を実行させるためのプロセッサとを備える、サーバ。
    A communication interface for communicating with the communication terminal and the electric device;
    A server, comprising: a processor for causing a plurality of corresponding electric devices to execute an operation corresponding to voice via the communication interface based on voice data from the communication terminal.
PCT/JP2018/005043 2017-10-12 2018-02-14 Server and electrical apparatus WO2019073618A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019547897A JP7079791B2 (en) 2017-10-12 2018-02-14 Servers and electrical equipment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-198360 2017-10-12
JP2017198360 2017-10-12

Publications (1)

Publication Number Publication Date
WO2019073618A1 true WO2019073618A1 (en) 2019-04-18

Family

ID=66100078

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/005043 WO2019073618A1 (en) 2017-10-12 2018-02-14 Server and electrical apparatus

Country Status (2)

Country Link
JP (1) JP7079791B2 (en)
WO (1) WO2019073618A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7364923B2 (en) 2019-01-29 2023-10-19 ダイキン工業株式会社 Air conditioning system, server, air conditioning system control method, program, and recording medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11351901A (en) * 1998-06-10 1999-12-24 Denso Corp Control device
JP2017009867A (en) * 2015-06-24 2017-01-12 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Control apparatus, control method thereof, and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11351901A (en) * 1998-06-10 1999-12-24 Denso Corp Control device
JP2017009867A (en) * 2015-06-24 2017-01-12 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Control apparatus, control method thereof, and program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7364923B2 (en) 2019-01-29 2023-10-19 ダイキン工業株式会社 Air conditioning system, server, air conditioning system control method, program, and recording medium

Also Published As

Publication number Publication date
JP7079791B2 (en) 2022-06-02
JPWO2019073618A1 (en) 2020-11-19

Similar Documents

Publication Publication Date Title
US10687109B2 (en) Video integration with home assistant
KR20150059081A (en) Method and apparatus for controlling a group of home devices in a home network system
WO2019202666A1 (en) Apparatus control system and apparatus control method
WO2019064616A1 (en) Network system
JP2018021709A (en) Air Conditioning System
JP6625233B2 (en) Controller, air conditioning system, and control method of air conditioner
CN110661888A (en) Voice control method and device for household appliance and readable storage medium
JP7079791B2 (en) Servers and electrical equipment
WO2017199295A1 (en) Management device and air conditioning system
WO2020158615A1 (en) Air conditioning system
JP2016181180A (en) Control system, controller unit and control method
JP7364923B2 (en) Air conditioning system, server, air conditioning system control method, program, and recording medium
WO2018079063A1 (en) Network system, server, information processing method, air conditioner and program
WO2019167306A1 (en) Network system and server
JP2002278604A (en) Control system and control method and its program and its recording medium
JP2019184153A (en) Network system, server and information processing method
JP2020150349A (en) Video reproduction system and program
JP2017151742A (en) Network system, server, information processing method, and electric appliance
TW202127268A (en) Server, information processing method, and network system
CN114777302A (en) Network system
JP2022032391A (en) Control device, control system, facility control method and program
KR20220001903A (en) Cloud platform based apartment home smart home system
WO2019167307A1 (en) Network system and air conditioner
JP2019062329A (en) Communication device, space conditioner and network system
JP2017162018A (en) Parasitic control method and device for hems, and energy saving air conditioning method and device using the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18865834

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019547897

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18865834

Country of ref document: EP

Kind code of ref document: A1