JP2016063415A - Network system, audio output method, server, device and audio output program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a network system, an audio output method, a server, a device and an audio output program capable of outputting audio which is appropriate for a user or a situation.SOLUTION: A network system 1 comprises: first devices 200; second devices 200; and a server 100 capable of referring to correspondence relations 1211, 122, 123, 124 and 125 among the first information acquired by the first device, the second information acquired by the second device, messages and output devices 200. The server 100 makes the corresponding output devices 200 output messages corresponding to the first information and the second information with audio by referring to the correspondence relations 1211, 122, 123, 124 and 125.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for controlling sound output from a home appliance from a server.

  Conventionally, techniques for outputting sound to home appliances such as a refrigerator and an air conditioner have been proposed. For example, Japanese Patent Laying-Open No. 2005-103679 (Patent Document 1) discloses a robot apparatus. According to Japanese Patent Laying-Open No. 2005-103679 (Patent Document 1), the system controller of the robot apparatus performs a schedule management process for supporting the behavior for each user according to the schedule management information stored in the schedule management information storage unit. Run. The schedule management information storage unit stores user identification information, an action to be executed by the user specified by the user identification information, and a start condition for the action in association with each other. When the condition specified by the start condition is satisfied, the system controller executes a support process for supporting the user's action for the user specified by the user identification information corresponding to the satisfied start condition. .

JP 2005-103679 A

  However, in the conventional network system, it is necessary to mount a highly accurate camera, microphone, or the like on the home appliance in order to identify the user. Also, the face image and voice matching processing is complicated. Therefore, an object of the present invention is to provide a network system and an audio that can output audio suitable for a user or a situation without having a highly accurate camera and microphone, or without matching face images and audio. To provide an output method, a server, a device, and a program.

  According to an aspect of the present invention, the first device, the second device, the first information acquired by the first device, the second information acquired by the second device, the message, and the output device A network system is provided that includes a server capable of referencing the corresponding relationship. By referring to the correspondence relationship, the server causes the corresponding output device to output a voice message corresponding to the first information and the second information. Note that the output device is one of the first device, the second device, and another device.

  Preferably, the correspondence relationship includes information for designating a time zone. When at least one of the first information and the second information is acquired within the time period, the server causes the output device to output a message.

  Preferably, the correspondence relationship includes information for designating a time interval. The server causes the output device to output a voice message when the interval between the acquisition of the first information and the acquisition of the second information is within the time interval.

  Preferably, the correspondence relationship includes information indicating whether or not a message has been output.

  Preferably, the first information is information indicating an operation on the first device. The second information is information indicating an operation on the second device.

  Preferably, the first information is information acquired by the first device using a sensor. The second information is information acquired by the second device using a sensor.

  According to another aspect of the present invention, an audio output method in a network system including a first device, a second device, and a server is provided. The audio output method includes a step in which the first device transmits the first information to the server, a step in which the second device transmits the second information to the server, and the server includes the first information and the second information. And outputting a message corresponding to the information to the corresponding output device by voice. Note that the output device is one of the first device, the second device, and another device.

  According to another aspect of the present invention, a communication interface for communicating with the first device and the second device, first information acquired by the first device, and second information acquired by the second device And a processor that can refer to the correspondence between the message and the output device. The processor causes the corresponding output device to output the message corresponding to the first information and the second information via the communication interface by referring to the correspondence relationship. Note that the output device is one of the first device, the second device, and another device.

  According to another aspect of the present invention, there is provided an audio output method in a server including a communication interface and a processor for communicating with a first device and a second device. The audio output method includes a step in which a processor receives first information from a first device via a communication interface, and a step in which the processor receives second information from a second device via a communication interface; The processor includes outputting a message corresponding to the first information and the second information to the corresponding output device via the communication interface. Note that the output device is one of the first device, the second device, and another device.

  According to another aspect of the present invention, an audio output program for a server is provided that includes a communication interface and a processor for communicating with a first device and a second device. The audio output program receives the first information from the first device via the communication interface, accepts the second information from the second device via the communication interface, and via the communication interface. , Causing the processor to execute a step of outputting a message corresponding to the first information and the second information to the corresponding output device. Note that the output device is one of the first device, the second device, and another device.

  According to another aspect of the present invention, an apparatus is provided that includes a communication interface for communicating with a server, an input unit for receiving an operation from a user, a speaker, and a processor. The processor receives a user operation via the input unit, transmits the operation to the server via the communication interface, receives a message corresponding to the operation from the server, and causes the speaker to output the message as a voice.

  As described above, according to the present invention, it is possible to output a sound suitable for a user or a situation without having a highly accurate camera or microphone, or without matching a face image and sound. A system, an audio output method, a server, a device, and a program are provided.

It is an image figure which shows the whole structure of the network system 1 concerning 1st-4th Embodiment, and a 1st operation | movement outline | summary. It is an image figure which shows the whole structure of the network system 1 concerning a 1st-4th embodiment, and a 2nd operation | movement outline | summary. It is a block diagram showing the hardware constitutions of the audio | voice output server 100 concerning 1st-8th embodiment. It is an image figure which shows the data structure of the audio | voice database 1211 concerning 1st and 6th-8th embodiment. It is an image figure which shows the data structure of the apparatus database 1212 concerning the 1st-8th embodiment. It is a block diagram showing the hardware constitutions of the apparatus 200 concerning 1st-8th embodiment. It is a block diagram showing the hardware constitutions of the adapter 300 concerning 1st-8th embodiment. It is an image figure which shows the data structure of the audio | voice database 321 concerning 1st-8th embodiment. It is a block diagram showing the hardware constitutions of the audio production server 700 concerning the 1st-8th embodiment. It is a block diagram showing the hardware constitutions of the application server 500 concerning 1st-8th embodiment. It is a block diagram showing the hardware constitutions of the communication terminal 600 concerning 1st-8th embodiment. It is a flowchart which shows the information processing of the audio | voice output server 100 concerning 1st-8th embodiment. It is an image figure which shows the data structure of the audio | voice database 122 concerning 2nd Embodiment. It is an image figure which shows the data structure of the audio | voice database 123 concerning 3rd Embodiment. It is an image figure which shows the data structure of the audio | voice database 124 concerning 4th Embodiment. It is an image figure which shows the whole structure and the operation | movement outline | summary of the network system 1 concerning 5th Embodiment. It is an image figure which shows the data structure of the audio | voice database 125 concerning 5th Embodiment. It is an image figure which shows the whole structure and the operation | movement outline | summary of the network system 1 concerning 6th Embodiment. It is an image figure which shows the whole structure and the operation | movement outline | summary of the network system 1 concerning 7th Embodiment. It is an image figure which shows the whole structure and the operation | movement outline | summary of the network system 1 concerning 8th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
<First Embodiment>
<Overall configuration of network system>

  First, the overall configuration of the network system 1 according to the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is an image diagram showing an overall configuration of the network system 1 according to the present embodiment and a first operation outline. FIG. 2 is an image diagram showing an overall configuration of the network system 1 according to the present embodiment and a second operation outline.

  The network system 1 according to the present embodiment mainly controls devices such as the lighting 200A, the refrigerator 200B, the air conditioner 200C, the television 200D, the door sensor 200E, the Washlet (registered trademark) controller 200F, and the audio output of the devices. Voice output server 100, adapters 300A, 300B, 300C, 300D, 300E, 300F as communication terminals, router 400 for connecting adapters 300A, 300B, 300C, 300D, 300E, 300F to the Internet, news, A database 701 that provides various information such as a sky forecast, a voice creation server 700 that creates voice data based on the data in the database 701 and passes it to the voice output server 100, and smartphones 600A and 600B as communication terminals. Comprising a 600C, the personal computer 600D, the application server 500 for sending and receiving the communication terminal and data, and a database 501 for storing the information used in the application server 500, a.

  Note that the voice output server 100 or the voice creation server 700 may store part or all of the information in the database 701, and the application server 500 may store part or all of the information in the database 501. .

  The voice output server 100 is connected to the adapters 300A, 300B, 300C, 300D, 300E, 300F and the voice creation server 700 via the Internet or the router 400. For example, the voice output server 100 accepts an utterance command from the administrator or accepts an utterance command from the voice creation server 700. The voice output server 100 sends voice to the lighting 200A, the refrigerator 200B, the air conditioner 200C, the television 200D, the door sensor 200E, and the washlet controller 200F via the adapters 300A, 300B, 300C, 300D, 300E, and 300F based on the speech command. Output.

  Devices such as the lighting 200A, the refrigerator 200B, the air conditioner 200C, the television 200D, the door sensor 200E, and the washlet controller 200F are used for the adapters 300A, 300B, 300C, 300D, 300E, and 300F. And transmitted to the voice output server 100 and the voice creation server 700 via the router 400 and the Internet. Conversely, devices such as the lighting 200A, the refrigerator 200B, the air conditioner 200C, the television 200D, the door sensor 200E, and the washlet controller 200F are voice data acquisition instructions, voice data, speech instructions, and controls from the voice output server 100 and the voice creation server 700. Various operations are executed based on the instruction.

  The devices are not limited to lighting 200A, refrigerator 200B, air conditioner 200C, television 200D, door sensor 200E, and washlet controller 200F, but also humidifiers, dehumidifiers, self-propelled cleaners, washing machines, and other household appliances, hard disk recorders, music It may be an AV (audio / visual) device such as a player, a solar power generator, an interphone, a housing facility such as a water heater, or the like. Hereinafter, these devices are also collectively referred to as a device 200.

  Each of the devices 200 according to the present embodiment transmits / receives data to / from the communication adapters 300A, 300B, 300C, 300D, 300E, and 300F via a communication interface such as a UART (Universal Asynchronous Receiver Transmitter).

  The communication adapters 300A, 300B, 300C, 300D, 300E, and 300F communicate with the device 200 via a communication interface such as UART. In the present embodiment, the communication adapters 300A, 300B, 300C, 300D, 300E, and 300F communicate with the router 400 via a wireless LAN communication interface such as WiFi (registered trademark). However, the communication adapters 300A, 300B, 300C, 300D, 300E, and 300F may communicate with the router 400 through a wired LAN communication interface. The communication adapters 300A, 300B, 300C, 300D, 300E, and 300F transmit data from the device 200 to the voice output server 100 via the router 400 and the Internet. Conversely, the communication adapters 300A, 300B, 300C, 300D, 300E, and 300F transmit data from the audio output server 100 to the device 200. In the following, the communication adapters 300A, 300B, 300C, 300D, 300E, and 300F are collectively referred to as the adapter 300.

  The router 400 relays the adapter 300 and the Internet.

The smartphones 600A, 600B, 600C, the notebook personal computer 600D, and the like can obtain information from the device 200 and control the device 200 via the application server 500 by using the device control application. Hereinafter, the smartphones 600A, 600B, and 600C, the notebook personal computer 600D, and the like are collectively referred to as the communication terminal 600.
<Overview of network system operation>

  Next, an outline of the operation of the network system 1 according to the present embodiment will be described with reference to FIGS.

  In the present embodiment, device 200 receives various operation information directly from the user or from the user via communication terminal 600 such as a remote controller or smartphone 600A. The device 200 transmits the received operation information to the audio output server 100 via the adapter 300. In addition, the device 200 transmits data acquired via an image sensor, a sound sensor, a temperature sensor, a communication interface, and the like to the sound output server 100 via the adapter 300. The audio output server 100 then receives a plurality of operation information input to each of the plurality of devices 200 owned by the family, or image data, sound data, and other data acquired by each of the plurality of devices 200 owned by the family. In response to this, a message corresponding to the plurality of pieces of operation information or other acquired data is output to any device 200 by voice.

  For example, as shown in FIG. 1, when the boys open the entrance door of the house and enter the house, the door sensor 200E detects that the entrance door has been opened. Alternatively, the door sensor 200E detects that someone has passed through the entrance. The audio output server 100 receives information indicating that the front door is opened from the door sensor 200E. Next, when the boy opens the door of the refrigerator 200B, the audio output server 100 receives operation information indicating that the door has been opened from the refrigerator 200B.

  In the present embodiment, the network system 1 includes the door sensor 200E for detecting that the entrance door is opened. For example, the movement of the door knob is not the movement or position of the door body. Alternatively, a sensor that detects the position or the movement or position of the door key may be used. The sensor may detect that someone has passed through the entrance door and transmit the detection result to the audio output server 100.

  The audio output server 100 specifies that the eldest son has operated the two devices based on data from the door sensor 200E and the refrigerator 200B. In the present embodiment, since actions that can be easily taken by a person belonging to a family are stored in the database in advance, the audio output server 100 identifies a user from information acquired by a plurality of home appliances by referring to the database. be able to.

  As a result, the audio output server 100 can cause the device 200 to output the message acquired by the device and / or a message suitable for the identified user. The server 100 does not need to specify who has operated the device. Messages corresponding to a plurality of devices and a plurality of information may be transmitted to the devices.

  Alternatively, as illustrated in FIG. 2, when the mother wakes up in the morning and turns on the living room lighting 200A, the audio output server 100 receives information from the lighting 200A that the lighting 200A has received an ON command. Next, when the mother opens the door of the refrigerator 200B, the audio output server 100 receives operation information indicating that the door has been opened from the refrigerator 200B.

  The audio output server 100 specifies that the mother who operated the two devices is based on the data from the lighting 200A and the refrigerator 200B. Specifically, the audio output server 100 can identify the mother from the operation information for the two home appliances by referring to the database.

  As a result, the audio output server 100 can cause the device 200 to output the data acquired by the device and / or a message suitable for the user. The server 100 does not need to specify who has operated the device. Messages corresponding to a plurality of devices and a plurality of information may be transmitted to the devices.

  As described above, the network system 1 according to the present embodiment is based on information acquired by a plurality of devices without having a highly accurate camera and microphone, or without matching face images and sounds. The user can be specified, and the corresponding message can be output as voice.

  In the present embodiment, the audio output server 100 transmits an instruction for acquiring audio data and an instruction for causing the device 200 to speak audio to the adapter 300 at different timings. As a result, the voice output server 100 can output a free combination voice from the device 200 according to the utterance instruction without transmitting voice data each time. That is, the audio output server 100 can control the audio output of the device 200 more flexibly than in the past.

  Also, since the voice data can be downloaded when the traffic volume of data transmission / reception is relatively small, an increase in the maximum value of the network traffic volume can be suppressed.

  Further, since the utterance instruction does not need to include voice data, the data amount is small. For this reason, even if data is transmitted by always-on connection using WebSocket or the like, it is difficult to prevent other data transmission. That is, it is possible to cause the adapter 300 to immediately receive an utterance instruction at a timing desired by the service manager or user. As a result, it is possible to immediately output sound to the device 200 at a timing desired by the service manager or user.

  However, the voice output server 100 may send the voice data of the message every time the device 200 outputs the message as voice.

Hereinafter, the network system 1 for realizing such a function will be described in detail.
<Hardware Configuration of Audio Output Server 100>

  First, an aspect of the hardware configuration of the audio output server 100 configuring the network system 1 will be described. FIG. 3 is a block diagram showing a hardware configuration of the audio output server 100 according to the present embodiment.

  Referring to FIG. 3, audio output server 100 includes a processor 110, a memory 120, various lights 130, various switches 140, and a communication interface 160 as main components.

  The processor 110 controls each unit of the audio output server 100 by executing a program stored in the memory 120 or an external storage medium. That is, the processor 110 executes various processes described later by executing a program stored in the memory 120.

  The memory 120 is realized by various types of RAM (Random Access Memory), various types of ROM (Read-Only Memory), flash memory, and the like. The memory 120 is a USB (Universal Serial Bus) (registered trademark) memory, a CD (Compact Disc), a DVD (Digital Versatile Disk), a memory card, a hard disk, an IC (Integrated Circuit) card, which is used via an interface. It is also realized by a storage medium such as an optical card, mask ROM, EPROM (Erasable Programmable Read Only Memory), or EEPROM (Electronically Erasable Programmable Read Only Memory).

  The memory 120 is a program executed by the processor 110, data generated by execution of the program by the processor 110, data input from the switch 140, device 200, adapter 300, voice creation server 700, application server 500, communication terminal. The data received from 600 is stored. The memory 120 stores a voice database 1211 and a device database 1212. However, part or both of the voice database 1211 and the device database 1212 may be stored in the voice creation server 700 or the database 701. Alternatively, a part or both of the voice database 1211 and the device database 1212 may be stored in another device so as to be referred to from the voice output server 100 and the voice creation server 700.

  Here, FIG. 4 is an image diagram showing a data structure of the voice database 1211 according to the present embodiment. Referring to FIG. 4, the voice database 1211 includes information for identifying the first device, information for the operation on the first device or information acquired by the first device, and for identifying the second device. The correspondence relationship between the information, the operation on the second device or the information acquired by the second device, the target user, the message, the output device, and the output flag is stored. The target user may not be included in the voice database 1211.

  Note that the message may be a voice ID for identifying the message, the voice data of the message itself, or the text data of the message.

  Further, the message for each record in the voice database 1211 may be fixed. Alternatively, the administrator of the audio output server 100 or the provider of the service may change it. Alternatively, the processor 110 of the voice output server 100 and the processor 710 of the voice creation server 700 are based on information acquired from other Web servers, such as information on weather forecasts and pollen, information on PM2.5, and bargain information on stores. It may be created periodically such as every morning or every hour, or whenever new information is obtained. The message may be a combination of a fixed message and a message that is periodically changed.

  As a result, the processor 110 refers to the audio database 1211 so that the operation on the first device or the image data / audio data acquired by the first device and the operation on the second device or the second device A user and / or a message suitable for the user's operation can be specified based on the acquired image data / audio data and the like.

  Here, FIG. 5 is an image diagram showing a data structure of the device database 1212 according to the present embodiment. Referring to FIG. 5, device database 1212 includes a device ID for specifying a device, an address of the device, a family ID for specifying a family or group that owns the device, and data as a first device. Is stored in correspondence with a flag indicating whether or not a message has already been received.

  Thus, the processor 110 can identify the family or group that owns the device by referring to the device database 1212. Further, the processor 110 can specify another device belonging to the same family as the device by referring to the device database 1212.

  Returning to FIG. 3, the light 130 transmits various states of the audio output server 100 to the outside by being turned on, blinking, and turned off by a signal from the processor 110.

  The switch 140 receives an instruction from the administrator and inputs the instruction to the processor 110.

The communication interface 160 transmits the data from the processor 110 to the adapter 300 and the voice creation server 700 via the Internet, a carrier network, a router, or the like. The communication interface 160 receives data from the adapter 300 and the voice creation server 700 via the Internet, a carrier network, a router, and the like, and passes them to the processor 110.
<Hardware Configuration of Device 200>

  Next, an aspect of the hardware configuration of the device 200 will be described. FIG. 6 is a block diagram showing a hardware configuration of the device 200 according to the present embodiment.

  Referring to FIG. 6, device 200 includes a processor 210, a memory 220, various lights 230, various switches 240, a communication interface 260, a speaker 270, and a device driving unit 290 as main components. .

  The processor 210 controls each unit of the device 200 by executing a program stored in the memory 220 or an external storage medium. That is, the processor 210 executes various processes to be described later by executing a program stored in the memory 220.

  The memory 220 is realized by various RAMs, various ROMs, flash memories, and the like. The memory 220 stores a program executed by the processor 210, data generated by the execution of the program by the processor 210, input data, data received from the audio output server 100, and the like.

  The light 230 transmits various states of the device 200 to the outside by being turned on / flashing / turned off by a signal from the processor 210.

  The switch 240 receives a command from the user and inputs the command to the processor 210.

  The communication interface 260 transmits data from the processor 210 to the adapter 300, for example, various states detected by the device and instructions received by the device via a remote control from the user. In other words, the communication interface 160 transmits the data to the voice output server 100 and the voice creation server 700 via the adapter 300, the router 400, the Internet, and the like. The communication interface 260 receives data from the voice output server 100, data from the voice creation server 700, control commands, voice data, speech commands, and browsing commands from other terminals via the Internet, the router 400, the adapter 300, and the like. To the processor 210.

  The speaker 270 outputs various sounds such as sound and music based on the sound signal from the processor 210.

  The remote control light receiving unit 280 receives an infrared signal or other radio signal from the remote control and inputs the signal to the processor 110.

  The device driving unit 290 plays a main role of the device 200 by controlling a motor, an actuator, a sensor, and the like based on a control command from the processor 210.

In addition, the device 200 may include an image sensor such as a camera, an audio sensor such as a microphone, a temperature sensor, a human sensor, and the like. Then, the processor 210 transmits various information acquired via the sensor to the server 100 via the communication interface 260.
<Hardware configuration of adapter 300>

  Next, an aspect of the hardware configuration of the adapter 300 will be described. FIG. 7 is a block diagram showing a hardware configuration of adapter 300 according to the present embodiment.

  Referring to FIG. 7, the adapter 300 includes a processor 310, a memory 320, various lights 330, various switches 340, a first communication interface 361, and a second communication interface 362 as main components. Including.

  The processor 310 controls each unit of the adapter 300 by executing a program stored in the memory 320 or an external storage medium. That is, the processor 310 executes various processes to be described later by executing a program stored in the memory 320.

  The memory 320 is realized by various RAMs, various ROMs, flash memories, and the like. The memory 320 is received from a program executed by the processor 310, data generated by execution of the program by the processor 310, input data, the audio output server 100, the audio creation server 700, the application server 500, and the communication terminal 600. Store data etc. In the present embodiment, as shown in FIG. 8, the memory 320 stores a voice database 321 received in advance from the voice output server 100 or the voice creation server 700.

  Here, FIG. 8 is an image diagram showing a data structure of the audio database 321 according to the present embodiment. Referring to FIG. 8, the voice database 321 stores the correspondence between the voice ID and the voice data for each voice data. However, the audio database 321 may store an address of audio data indicating a storage location of the audio data instead of the audio data itself.

  Note that the audio database 321 and the audio data itself may be stored in the device 200. In this case, the processor 210 of the device 200 may overwrite or delete the data based on an instruction from the audio output server 100 via the adapter 300.

  In the present embodiment, as a rule for assigning a voice ID to voice data, for example, the type of device for which three digits before the voice ID are targeted is specified, and the next three digits after the voice ID is the device. The installation location and area are specified, and the second digit from the back of the audio ID specifies the type of audio data. For example, the lower second digit “5” is a message about the weather. If the second digit is “7”, it is a message about food. When the lower second digit is “9”, it is a message indicating an error.

  The voice output server 100 transmits a voice ID for specifying a message to the adapter 300 of the device 200 as the output device based on the operation on the first device and the operation on the second device. The processor 310 of the adapter 300 of the device 200 as an output device acquires audio data from the memory 320 and causes the device 200 to output audio.

  However, the voice output server 100 uses the text data for specifying the message and the voice data of the message itself as an output device based on the operation on the first device and the operation on the second device. The information may be transmitted to the device 300, or may be transmitted to the device 200 as an output device via the adapter 300. In this case, the adapter 300 does not need to store the voice database 321 of FIG.

  Returning to FIG. 7, the light 330 transmits the various states of the adapter 300 to the outside by being turned on, blinking, and turned off by a signal from the processor 310.

  The switch 340 receives a command from the user and inputs the command to the processor 310.

  The first communication interface 361 is realized by UART or the like, and transmits data from the processor 310 to the device 200 and transfers data from the device 200 to the processor 310. For example, the processor 310 transmits voice data to the device 200 via the first communication interface 361 based on the utterance instruction, thereby causing the device 200 to output sound.

  However, the audio database 321 may be stored in the device 200. In this case, the processor 310 may simply transmit an utterance instruction including the voice ID to the device 200. In this case, the processor 210 of the device 200 outputs the audio data stored in the memory 220 to the speaker 270 based on the utterance instruction.

The second communication interface 362 is realized by a WiFi (registered trademark) antenna or the like, and transmits data from the processor 310 to the voice output server 100 or the voice creation server 700 via the router 400 and the Internet. 100 or the data processor 110 from the voice creation server 700. For example, the processor 310 receives an audio data acquisition instruction, an utterance instruction, and audio data itself from the audio output server 100 via the second communication interface 362. The processor 310 transmits, via the second communication interface 362, a notification that the acquisition of the voice data has been completed and a notification that the utterance has been completed to the voice output server 100.
<Hardware Configuration of Voice Creation Server 700>

  Next, an aspect of the hardware configuration of the voice creation server 700 constituting the network system 1 will be described. FIG. 9 is a block diagram showing a hardware configuration of the voice creation server 700 according to this embodiment.

  Referring to FIG. 9, the audio creation server 700 includes a processor 710, a memory 720, various lights 730, various switches 740, and a communication interface 760 as main components.

  The processor 710 controls each unit of the voice creation server 700 by executing a program stored in the memory 720 or an external storage medium. That is, the processor 710 executes various processes by executing a program stored in the memory 720.

  A specific example of the memory 720 is the same as that of the audio output server 100, and thus description thereof will not be repeated here. The memory 720 stores a program executed by the processor 710, data generated by execution of the program by the processor 710, input data, data received from the device 200, the adapter 300, and the audio output server 100. The memory 720 may store the database 701 shown in FIG.

  The light 730 is turned on / flashing / turned off in response to a signal from the processor 710 to transmit various states of the voice creation server 700 to the outside.

  The switch 740 receives a command from the administrator and inputs the command to the processor 510.

The communication interface 760 transmits data from the processor 710 to the adapter 300 and the audio output server 100 via the Internet, a carrier network, the router 400, and the like. The communication interface 760 receives data from the adapter 300 and the audio output server 100 via the Internet, a carrier network, the router 400, and the like, and passes them to the processor 710.
<Hardware Configuration of Application Server 500>

  Next, an aspect of the hardware configuration of the application server 500 configuring the network system 1 will be described. FIG. 10 is a block diagram showing a hardware configuration of application server 500 according to the present embodiment.

  Referring to FIG. 10, application server 500 includes a processor 510, a memory 520, various lights 530, various switches 540, and a communication interface 560 as main components.

  The processor 510 controls each unit of the application server 500 by executing a program stored in the memory 520 or an external storage medium. That is, the processor 510 executes various processes described later by executing a program stored in the memory 520.

  A specific example of the memory 520 is the same as that of the audio output server 100, and thus description thereof will not be repeated here. The memory 520 stores a program executed by the processor 510, data generated by execution of the program by the processor 510, input data, data received from the device 200, the adapter 300, the audio output server 100, and the communication terminal 600. To do. The memory 520 may store the database 501 shown in FIG.

  The light 530 is lit, flashed, or turned off by a signal from the processor 510, thereby transmitting various states of the application server 500 to the outside.

  The switch 540 receives an instruction from the administrator and inputs the instruction to the processor 510.

The communication interface 560 transmits data from the processor 510 to the adapter 300, the audio output server 100, and the communication terminal 600 via the Internet, a carrier network, the router 400, and the like. The communication interface 560 receives data from the adapter 300, the audio output server 100, and the communication terminal 600 via the Internet, a carrier network, the router 400, and the like, and passes them to the processor 510.
<Hardware configuration of communication terminal 600>

  Next, an aspect of the hardware configuration of the communication terminal 600 will be described. FIG. 11 is a block diagram showing a hardware configuration of communication terminal 600 according to the present embodiment.

  Referring to FIG. 11, communication terminal 600 includes a processor 610, a memory 620, a touch panel 650 (display 630 and pointing device 640), a communication interface 660, and a speaker 680 as main components.

  The processor 610 controls each unit of the communication terminal 600 by executing a program stored in the memory 620 or an external storage medium. That is, the processor 610 executes various processes described later by executing a program stored in the memory 620.

  The memory 620 is realized by various RAMs, various ROMs, flash memories, and the like. The memory 620 is used via various interfaces, such as a memory card such as an SD card or a micro SD card, a USB (registered trademark) memory, a CD, a DVD, a hard disk, an IC card, an optical card, a mask ROM, It is also realized by a storage medium such as EPROM or EEPROM.

  The memory 620 stores a program executed by the processor 610, data generated by execution of the program by the processor 610, data input via the pointing device 640, data received from the audio output server 100 and the application server 500, and the like. Remember. In particular, in the present embodiment, the memory 620 stores a device control application. The processor 610 transmits a control command for the device 200 to the application server 500 in accordance with a device control application in the memory 620, transmits a speech command for causing the device 200 to output a sound, to the sound output server 100, and the like. Or receive information.

  Display 630 outputs characters and images based on signals from processor 610. The pointing device 640 receives a command from the user and inputs the command to the processor 610. In the present embodiment, communication terminal 600 includes touch panel 650 in which display 630 and pointing device 640 are combined. The processor 610 causes the display 630 to display a screen for controlling the device 200, an SNS family page, and the like.

  The communication interface 660 is realized by an antenna or a connector. The communication interface 660 exchanges data with other devices by wired communication or wireless communication. The processor 610 transmits text data, image data, and the like to other devices such as the audio output server 100 and the application server 500 via the communication interface 660. For example, the processor 610 transmits a control command for the device 200 to the audio output server 100 and the application server 500. Further, the processor 610 receives programs, control commands, image data, text data, and the like from other devices such as the audio output server 100 and the application server 500 via the communication interface 660.

The speaker 680 outputs various sounds such as a call sound, music, and a moving image based on the sound signal from the processor 610.
<Information Processing in Audio Output Server 100>

  Next, information processing of the audio output server 100 according to the present embodiment will be described with reference to FIG. In addition, FIG. 12 is a flowchart which shows the information processing of the audio | voice output server 100 concerning this Embodiment.

  First, when the processor 110 of the audio output server 100 receives data from the device 200 via the communication interface 160, the following processing is executed. The processor 110 extracts the device ID and the operation information on the device or the information acquired by the device from the received data, and stores them in the memory 120 (step S102). The processor 110 refers to the device database 1212 and the audio database 1211, and among the combinations of the device ID and the information from the device stored so far in the memory 120, the currently received device ID and the information from the device. A search is made as to whether there is a combination corresponding to the combination (step S104).

  For example, the processor 110 has a combination of the device ID received this time and the information from the device corresponding to the second device and the second information, and the combination of the device ID received before this time and the information from the device. It is determined whether there is a record whose combination corresponds to the first device and the first information. The processor 110 corresponds to the combination of the device ID received this time and the information from the device corresponds to the first device and the first information, and the combination of the device ID received before this time and the information from the device. It may be determined whether there is a record whose combination corresponds to the second device and the second information.

  If no combination of the device ID and the information from the device stored in the memory 120 corresponds to the combination of the device ID and the information received this time (NO in step S106) The processor 110 waits for the next information via the communication interface 160.

  The combination of the device ID and the information from the device stored in the memory 120 so far corresponds to the combination of the device ID received this time and the information from the device (in step S106) If YES, the processor 110 determines whether or not the flag of the record is OFF (step S108). If the flag of the record is ON (NO in step S108), processor 110 waits for the next information via communication interface 160.

  If the flag of the record is OFF (YES in step S108), the corresponding message voice data or speech instruction is transmitted to the output device via the communication interface 160 (step S110). The processor 110 waits for the next information via the communication interface 160.

  When the processor 110 executes step S110, the data of the combination of the device ID received this time and the information received from the device stored in the memory 120 and the device ID stored before that correspond to the data. And combination data with information from the device.

  In addition, when executing step S110, the processor 110 turns on a flag corresponding to the message output in the voice database 1211. Thereby, the possibility of outputting the same message to the same user can be reduced.

  Accordingly, in the device 200 as the output device, the processor 210 receives the speech instruction data or the message voice data from the voice output server 100 via the communication interface 260. The processor 210 causes the speaker 270 to output a message by voice based on the data.

As described above, the network system 1 according to the present embodiment does not use a camera or perform a matching process for recognizing a user image, uses a microphone or performs matching for recognizing the user. Even without processing, it is possible to recognize a user or specify a message based on operations on a plurality of devices and data acquired by the plurality of devices, using actions that are easy for the user to take.
<Second Embodiment>

In the first embodiment, a user is recognized or a message is specified based on operations on a plurality of devices and data acquired by the plurality of devices. In the present embodiment, not only operations for a plurality of devices and data acquired by a plurality of devices, but also the time and day of the week when the operations are performed are used as a reference to identify a user or specify a message. To do.
<Overall configuration of network system>

Since the overall configuration of network system 1 according to the present embodiment is the same as that of the first embodiment, description thereof will not be repeated here.
<Overview of network system operation>

  Next, an outline of the operation of the network system 1 according to the present embodiment will be described with reference to FIGS.

  In the present embodiment, device 200 receives various operation information directly from the user or from the user via communication terminal 600 such as a remote controller or smartphone 600A. The device 200 transmits the received operation information to the audio output server 100 via the adapter 300. In addition, the device 200 transmits data acquired via an image sensor, a voice sensor, a temperature sensor, or the like to the voice output server 100 via the adapter 300. The audio output server 100 then receives a plurality of operation information input to each of the plurality of devices 200 owned by the family, or image data, sound data, and other data acquired by each of the plurality of devices 200 owned by the family. Then, based on the time and day of the week when the information and data are acquired, a message corresponding to the plurality of pieces of operation information or data is output to any device 200 by voice.

  For example, as shown in FIG. 1, when the boys open the entrance door of the house and enter the house at 16:00 in the evening, the voice output server 100 indicates that the entrance door sensor 200E has detected a person. Is received from the door sensor 200E. Next, when the boy opens the door of the refrigerator 200B at 16:03, the audio output server 100 receives operation information indicating that the door has been opened from the refrigerator 200B.

  In the present embodiment, the network system 1 includes the door sensor 200E at the entrance. For example, the movement or position of the door body, the movement or position of the door knob, or the movement or position of the door key. You may utilize the sensor which detects this. The sensor may detect that someone has passed through the entrance door and transmit the detection result to the audio output server 100.

  The audio output server 100 specifies that the eldest son operated the two devices based on the data from the door sensor 200E and the refrigerator 200B and the time when the data was acquired. In this embodiment, since actions that can be easily taken by a person belonging to a family are stored in the database in advance, the audio output server 100 refers to the database, so that the user can obtain information based on information and times acquired by a plurality of home appliances. Can be specified.

  As a result, the audio output server 100 can cause the device 200 to output the message acquired by the device and / or a message suitable for the identified user. The server 100 does not need to specify who has operated the device. Messages corresponding to a plurality of devices and a plurality of information may be transmitted to the devices.

  Alternatively, as illustrated in FIG. 2, when the mother wakes up at 6 am and turns on the living room lighting 200 </ b> A, the audio output server 100 receives information indicating that the lighting 200 </ b> A has received the ON command from the lighting 200 </ b> A. Next, when the mother opens the door of the refrigerator 200B at 6:05, the audio output server 100 receives operation information indicating that the door has been opened from the refrigerator 200B.

  The audio output server 100 specifies that the mother who operated the two devices is based on the data from the lighting 200A and the refrigerator 200B and the time when the data was acquired. Specifically, the audio output server 100 can specify the mother from the operation information and the time for the two home appliances by referring to the database.

  As a result, the audio output server 100 can cause the device 200 to output the data acquired by the device and / or a message suitable for the user. The server 100 does not need to specify who has operated the device. Messages corresponding to a plurality of devices and a plurality of information may be transmitted to the devices.

  As described above, the network system 1 according to the present embodiment outputs a sound suitable for the user or the situation without having a highly accurate camera and microphone, or without matching a face image and sound. be able to.

  In the present embodiment, the audio output server 100 transmits an instruction for acquiring audio data and an instruction for causing the device 200 to speak audio to the adapter 300 at different timings. As a result, the voice output server 100 can output a free combination voice from the device 200 according to the utterance instruction without transmitting voice data each time. That is, the audio output server 100 can control the audio output of the device 200 more flexibly than in the past.

  However, the voice output server 100 may send the voice data of the message every time the device 200 outputs the message as voice.

  Below, the network system 1 for implement | achieving such a function is demonstrated. However, the voice database 122 of the voice output server 100 will be described, and one aspect of the hardware configuration of the voice output server 100, the device 200, the adapter 300, the voice creation server 700, the application server 500, and the communication terminal 600 will be described. Since it is the same as that of the first embodiment, description thereof will not be repeated here.

  Here, FIG. 13 is an image diagram showing a data structure of the voice database 122 according to the present embodiment. Referring to FIG. 13, the voice database 122 specifies information for specifying the first device, information for the operation of the first device or information acquired by the first device, and for specifying the second device. The correspondence between the information, the operation on the second device or the information acquired by the second device, the time zone and day of the week for acquiring the information, the target user, the message, the output device, and the output flag Store.

As a result, the processor 110 refers to the audio database 1211 so that the operation on the first device or the image data / audio data acquired by the first device and the operation on the second device or the second device A user and a message suitable for the user's operation can be specified based on the acquired image data / audio data and the time when the data is acquired.
<Information Processing in Audio Output Server 100>

  Next, information processing of the audio output server 100 according to the present embodiment will be described with reference to FIG. In addition, FIG. 12 is a flowchart which shows the information processing of the audio | voice output server 100 concerning this Embodiment.

  First, when the processor 110 of the audio output server 100 receives data from the device 200 via the communication interface 160, the following processing is executed. The processor 110 extracts the device ID, the information from the device, and the time when the information was acquired from the received data, and stores them in the memory 120 (step S102). The processor 110 refers to the device database 1212 and the audio database 1211, and includes the device ID and information from the device received this time, among the device ID, information from the device, and time combination stored so far. A search is made as to whether there is a combination corresponding to the combination of time and time (step S104).

  For example, the processor 110 has a combination of the device ID, the information from the device, and the time received this time correspond to the second device and the second information, and the device ID and information from the device received before this time. It is determined whether or not there is a record in which the combination of time and time corresponds to the first device and the first information. Note that the processor 110 has a combination of the device ID, the information from the device, and the time received this time correspond to the first device, the first information, and the time, and the device ID and the device received before this time. It may be determined whether there is a record in which the combination of the information and the time corresponds to the second device, the second information, and the time.

  The combination of the device ID, the information from the device, and the time stored in the memory 120 so far does not correspond to the combination of the device ID, the information from the device, and the time (step) In the case of NO in S106), the processor 110 waits for the next information via the communication interface 160.

  The combination of the device ID, the information from the device, and the time stored in the memory 120 so far corresponds to the combination of the device ID, the information from the device and the time received this time ( In the case of YES in step S106, the processor 110 determines whether or not the flag of the record is OFF (step S108). If the flag of the record is ON (NO in step S108), processor 110 waits for the next information via communication interface 160.

  If the flag of the record is OFF (YES in step S108), the corresponding message voice data or speech instruction is transmitted to the output device via the communication interface 160 (step S110). The processor 110 waits for the next information via the communication interface 160.

  When the processor 110 executes step S110, the memory 120 previously stores the data of the combination of the device ID, the information received from the device received this time, and the time, and the corresponding data. The device ID, the information from the device, and the combination data of the time are deleted.

  In addition, when executing step S110, the processor 110 turns on a flag corresponding to the message output in the voice database 1211. Thereby, the possibility of outputting the same message to the same user can be reduced.

  As a result, in the device 200 as an output device, the processor 210 outputs a message from the speaker 270 via the communication interface 260 based on the voice data or the utterance instruction of the message received from the voice output server 100.

As described above, the network system 1 according to the present embodiment does not use a camera or perform a matching process for recognizing a user image, uses a microphone or performs matching for recognizing the user. Even without processing, it is possible to recognize a user or specify a message based on operations on a plurality of devices and data acquired by the plurality of devices, using actions that are easy for the user to take.
<Third Embodiment>

  In the second embodiment, the same time zone is associated with the combination of the first device and the first information and the combination of the second device and the second information. However, in the present embodiment, different time zones can be associated with the combination of the first device and the first information and the combination of the second device and the second information. However, it is not prohibited to associate the same time zone.

  That is, with reference to FIG. 14, the audio database 123 according to the present embodiment includes information for specifying the first device, operation for the first device or information acquired by the first device, A time zone for acquiring information, information for specifying the second device, an operation for the second device or information acquired by the second device, a time zone and day of the week for acquiring the information, Stores the correspondence relationship between the target user, messages, output devices, and output flags.

Accordingly, the processor 110 refers to the audio database 1211 to operate the first device or the image data / audio data acquired by the first device, the time when the data is acquired, and the second device. The user and a message suitable for the user's operation can be specified based on the operation on the image or the image data / audio data acquired by the second device and the time when the data is acquired.
<Fourth embodiment>

  In the first embodiment, a user is recognized or a message is specified based on operations on a plurality of devices and data acquired by the plurality of devices. In this embodiment, the user is identified and the message is identified by referring not only to the operations for a plurality of devices and the data acquired by the plurality of devices, but also to the intervals at which the operations for the devices are performed. It is something to do.

  That is, referring to FIG. 15, the audio database 124 according to the present embodiment includes information for specifying the first device, operation for the first device or information acquired by the first device, Information for identifying the two devices, information on the operation of the second device or information acquired by the second device, the conditions regarding the interval at which the two pieces of information were acquired, the day of the week on which the two pieces of information were acquired, Stores the correspondence relationship between the target user, messages, output devices, and output flags. In addition to the interval, as in the second and third embodiments, the voice database 124 may store information indicating a time zone.

Accordingly, the processor 110 refers to the audio database 1211 to operate the first device or the image data / audio data acquired by the first device, the time when the data is acquired, and the second device. Identifying a user and a message suitable for the user's operation based on the image data / sound data acquired by the second device or the time when the data was acquired, and the interval calculated from them Can do.
<Fifth embodiment>

In the first embodiment, the user is recognized and the message is specified based on the operations on the first and second devices and the data acquired by them. However, the plurality of devices is not limited to two devices. In the present embodiment, the user is recognized or the message is specified based on the operations on the first to third devices and the data acquired by them.
<Overall configuration of network system>

Since the overall configuration of network system 1 according to the present embodiment is the same as that of the first embodiment, description thereof will not be repeated here.
<Overview of network system operation>

  Next, with reference to FIG. 16, an outline of the operation of the network system 1 according to the present embodiment will be described. FIG. 16 is an image diagram showing an overall configuration and an operation outline of the network system 1 according to the present embodiment.

  In the present embodiment, device 200 receives various operation information directly from the user or from the user via communication terminal 600 such as a remote controller or smartphone 600A. The device 200 transmits the received operation information to the audio output server 100 via the adapter 300. In addition, the device 200 transmits data acquired via an image sensor, a voice sensor, a temperature sensor, or the like to the voice output server 100 via the adapter 300. And the audio | voice output server 100 is the image data, audio | voice data, etc. which each acquired the some operation information input into each of the some apparatus 200 which the same family owns, or each of the some apparatus 200 which the same family owns. And a message corresponding to the plurality of pieces of operation information or data based on the data, the information and the time and day of the week when the data was acquired, are output to any device 200 by voice.

  For example, as shown in FIG. 2, when the mother wakes up at 6 am and turns on the living room lighting 200A, the audio output server 100 receives information from the lighting 200A that the lighting 200A has received an ON command. Next, when the mother turns on the switch of the television 200D at 6:01, the audio output server 100 receives operation information indicating that the switch is turned on from the television 200D. Next, when the mother opens the door of the refrigerator 200B at 6:05, the audio output server 100 receives operation information indicating that the door has been opened from the refrigerator 200B.

  The audio output server 100 specifies that the mother who operated the three devices is based on the data from the lighting 200A, the television 200D, and the refrigerator 200B and the time when the data was acquired. Specifically, the audio output server 100 can specify the mother from the operation information and the time for the three home appliances by referring to the database.

  As a result, the audio output server 100 can cause the device 200 to output the data acquired by the device and / or a message suitable for the user.

  As described above, the network system 1 according to the present embodiment outputs a sound suitable for the user or the situation without having a highly accurate camera and microphone, or without matching a face image and sound. be able to.

  In the present embodiment, the audio output server 100 transmits an instruction for acquiring audio data and an instruction for causing the device 200 to speak audio to the adapter 300 at different timings. As a result, the voice output server 100 can output a free combination voice from the device 200 according to the utterance instruction without transmitting voice data each time. That is, the audio output server 100 can control the audio output of the device 200 more flexibly than in the past.

  However, the voice output server 100 may send the voice data of the message every time the device 200 outputs the message as voice.

  Below, the network system 1 for implement | achieving such a function is demonstrated. However, the audio database 125 of the audio output server 100 will be described. One aspect of the hardware configuration of the audio output server 100, the device 200, the adapter 300, the audio creation server 700, the application server 500, and the communication terminal 600, and the audio output Information processing of server 100 is the same as that of the first embodiment, and therefore description thereof will not be repeated here.

  Here, FIG. 17 is an image diagram showing a data structure of the voice database 125 according to the present embodiment. Referring to FIG. 17, the voice database 125 includes information for specifying the first device, operation for the first device or information acquired by the first device, and information for specifying the second device. Information, operation for the second device or information acquired by the second device, information for specifying the third device, operation for the third device or information acquired by the third device, and The correspondence relationship between the day of the week to obtain the information, the target user, the message, the output device, and the output flag is stored.

  As a result, the processor 110 refers to the audio database 1211 so that the operation on the first device or the image data / audio data acquired by the first device and the operation on the second device or the second device It is possible to identify a user and a message suitable for the user's operation based on the acquired image data / audio data and the operation on the third device or the image data / audio data acquired by the third device. it can.

As described above, the network system 1 according to the present embodiment also uses the camera to recognize the image of the user or does not perform the matching process, or uses the microphone to recognize the user or performs the matching. Even without processing, it is possible to recognize a user or specify a message based on operations on a plurality of devices and data acquired by the plurality of devices, using actions that are easy for the user to take.
<Sixth Embodiment>

In the first to fifth embodiments, the device 200 communicates with the router, the Internet, the audio output server 100, and the like via the adapter 300. However, as shown in FIG. 18, the device 200 communicates directly with the Internet and the audio output server 100 via the router 400 by WiFi (registered trademark) communication or Bluetooth (registered trademark). Also good.
<Seventh embodiment>

In the first to fifth embodiments, the device 200 communicates with the router, the Internet, the audio output server 100, and the like via the adapter 300. However, as shown in FIG. 19, the device 200 is directly connected to the mobile radio communication network such as a 3G line, a 4G line, and an LTE (registered trademark) line via the adapter 300, that is, not via the router 400. It is also possible to communicate with the Internet or the audio output server 100 via the Internet.
<Eighth Embodiment>

Furthermore, as shown in FIG. 20, the device 200 can be directly connected via a mobile wireless communication network such as a 3G line, a 4G line, or an LTE (registered trademark) line directly, that is, without using an adapter 300 or a router. It may communicate with the Internet or the audio output server 100.
<Other application examples>

  It goes without saying that the present invention can also be applied to a case where it is achieved by supplying a program to a system or apparatus. Then, a storage medium (or memory) storing a program represented by software for achieving the present invention is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores it in the storage medium. The effect of the present invention can also be enjoyed by reading and executing the program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code However, it is needless to say that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

Furthermore, after the program code read from the storage medium is written to another storage medium provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU of the function expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
<Summary of the above embodiments>

  In the first to eighth embodiments, the first device 200, the second device 200, the first information acquired by the first device, and the second information acquired by the second device. A network system 1 is provided that includes a server 100 that can refer to a correspondence relationship between information, a message, and an output device 200. By referring to the correspondence relationships 1211, 122, 123, 124, and 125, the server 100 causes the corresponding output device 200 to output a voice message corresponding to the first information and the second information.

  In the second and third embodiments, the correspondence relationships 122 and 123 include information for designating time zones. The server 100 causes the output device 200 to output a voice message when at least one of the first information and the second information is acquired within the time period.

  In the fourth embodiment, the correspondence relationship 124 includes information for specifying a time interval. When the interval between the acquisition of the first information and the acquisition of the second information is within the time interval, the server 100 causes the output device to output a voice message.

  In the first and eighth embodiments, the correspondence relationships 1211, 122, 123, 124, and 125 include information indicating whether a message has been output.

  In the first and eighth embodiments, the first information is information indicating an operation on the first device. The second information is information indicating an operation on the second device.

  In the first and eighth embodiments, the first information is information acquired by the first device using the sensor. The second information is information acquired by the second device using a sensor.

  In the first and eighth embodiments described above, an audio output method in the network system 1 including the first device 200, the second device 200, and the server 100 is provided. The audio output method includes a step in which the first device 200 transmits the first information to the server 100, a step in which the second device 200 transmits the second information to the server 100, And outputting a message corresponding to the information and the second information to the corresponding output device 200 by voice.

  In the first and eighth embodiments described above, the communication interface 160 for communicating with the first device 200 and the second device 200, and the first information acquired by the first device 200, A server 100 is provided that includes a processor 110 that can refer to correspondences 1211, 122, 123, 124, and 125 between second information acquired by the second device 200, messages, and the output device 200. The processor 110 refers to the correspondence relations 1211, 122, 123, 124, and 125, and sends a message corresponding to the first information and the second information via the communication interface 160 to the corresponding output device 200. To output sound.

  In the first and eighth embodiments described above, an audio output method in the server 100 including the communication interface 160 and the processor 110 for communicating with the first device 200 and the second device 200 is provided. The In the audio output method, the processor 110 receives the first information from the first device 200 via the communication interface 160, and the processor 110 receives the second information from the second device 200 via the communication interface 160. And the processor 110 causes the corresponding output device 200 to output a message corresponding to the first information and the second information via the communication interface 160.

  In the first and eighth embodiments described above, an audio output program for the server 100 including the communication interface 160 and the processor 110 for communicating with the first device 200 and the second device 200 is provided. Provided. The audio output program accepts first information from the first device 200 via the communication interface 160, accepts second information from the second device 200 via the communication interface 160, and communication. Through the interface 160, the processor is caused to execute a step of causing the corresponding output device 200 to output a message corresponding to the first information and the second information.

  According to another aspect of the present invention, there is provided a device 200 including a communication interface 260 for communicating with the server 100, input units 240 and 280 for receiving an operation from a user, a speaker 270, and a processor 210. The The processor 210 receives a user operation via the input units 240 and 280, transmits the operation to the server 100 via the communication interface 260, receives a message corresponding to the operation from the server 100, and transmits the message to the speaker. 270 makes the audio output.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1: Network system 100: Voice output server 110: Processor 120: Memory 1211: Correspondence (voice database)
1212: Device database 122: Correspondence relationship (voice database)
123: Correspondence (voice database)
124: correspondence (voice database)
125: Correspondence (voice database)
130: Light 140: Switch 160: Communication interface 200: Device 200A: Lighting 200B: Refrigerator 200C: Air conditioner 200D: Television 200E: Door sensor 200F: Washlet controller 210: Processor 220: Memory 230: Light 240: Switch 260: Communication interface 270 : Speaker 280: Remote controller light receiving unit 290: Device driving unit 300: Adapter 310: Processor 320: Memory 321: Audio database 330: Light 340: Switch 361: First communication interface 362: Second communication interface 400: Router 500: Application server 600: Communication terminal 700: Voice creation server

Claims (11)

A first device;
A second device;
A server capable of referring to the correspondence between the first information acquired by the first device, the second information acquired by the second device, the message, and the output device;
The network system in which the server causes the corresponding output device to output the voice corresponding to the first information and the second information by referring to the correspondence relationship. The correspondence relationship includes information for designating a time zone,
2. The network system according to claim 1, wherein when at least one of the first information and the second information is acquired within the time period, the server causes the message to be output to the output device. 3. . The correspondence includes information for specifying a time interval;
3. The server according to claim 1, wherein when the interval between the acquisition of the first information and the acquisition of the second information is within the time interval, the server causes the output device to output the message by voice. Network system.   The network system according to claim 1, wherein the correspondence relationship includes information indicating whether or not the message has been output. The first information is information indicating an operation on the first device,
5. The network system according to claim 1, wherein the second information is information indicating an operation on the second device. 6. The first information is information acquired by the first device using a sensor,
5. The network system according to claim 1, wherein the second information is information acquired by the second device using a sensor. 6. An audio output method in a network system including a first device, a second device, and a server,
The first device transmitting first information to the server;
The second device transmitting second information to the server;
A voice output method, comprising: a step of causing the corresponding output device to output the message corresponding to the first information and the second information by the server. A communication interface for communicating with the first device and the second device;
A first information acquired by the first device, a second information acquired by the second device, a processor capable of referring to a correspondence relationship between the message and the output device;
The processor, by referring to the correspondence relationship, causes the corresponding output device to output the message corresponding to the first information and the second information via the communication interface. . An audio output method in a server including a communication interface and a processor for communicating with a first device and a second device,
The processor accepting first information from the first device via the communication interface;
The processor accepting second information from the second device via the communication interface;
A voice output method, comprising: a step of causing the corresponding output device to output a message corresponding to the first information and the second information via the communication interface; An audio output program for a server including a communication interface and a processor for communicating with a first device and a second device,
Receiving first information from the first device via the communication interface;
Receiving second information from the second device via the communication interface;
A voice output program that causes the processor to execute a step of outputting a message corresponding to the first information and the second information to a corresponding output device via the communication interface. A communication interface for communicating with the server;
An input unit for accepting operations from the user;
Speakers,
With a processor,
The processor receives a user operation via the input unit, transmits the operation to the server via the communication interface, receives a message corresponding to the operation from the server, and sends the message to the speaker. Equipment that outputs sound.

Images