JP2016045758A - Network system, voice output device, server, voice output method, and voice output program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a network system, voice output device, server, voice output method, and voice output program that can let the voice output device output messages more freely than before.SOLUTION: A network system 1 comprises a voice output device 200, and a server 100 capable of communicating with the voice output device 200 via the Internet. The server 100 transmits voice data corresponding to a TV program to the voice output device 200.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a technique for outputting sound to a sound output apparatus having a speaker, and more particularly to a technique for causing a sound output apparatus to output sound in accordance with the contents of a television broadcast.

  2. Description of the Related Art Conventionally, a technique for outputting audio to an audio output device having a speaker is known.

  For example, Japanese Unexamined Patent Application Publication No. 2002-77073 (Patent Document 1) discloses a broadcasting system, a reception facility, and an external device. According to Japanese Patent Laid-Open No. 2002-77073 (Patent Document 1), a broadcast system sends broadcast program data and program data related to the contents of the program to each customer via a satellite from a station using a broadcast transmission device. To deliver. The broadcast program data is transferred from the customer's tuner to the display terminal, and the broadcast program is displayed on the main broadcast unit. The program data is transferred from the tuner to the display terminal and the external device, the data broadcast is displayed on the data broadcasting unit, and the external device stores a program related to the contents of the program.

  Japanese Unexamined Patent Application Publication No. 2002-118828 (Patent Document 2) discloses an operation terminal and a control method thereof. According to Japanese Patent Laid-Open No. 2002-118828 (Patent Document 2), a viewer receives data broadcasting data and a television signal from a broadcasting center, and views a television program image with a television receiver. When the viewer operates the STB and inputs information to the input means in the STB, the control means in the STB captures this input information as control data for the operating terminal. The control means controls the operation of the operation terminal based on the operation terminal control data received from the broadcasting center and the operation terminal control data input from the input means. By this control, the operation terminal operates in conjunction with the content of the broadcast program based on the information input from the viewer in addition to the received digital television broadcast data.

  Japanese Patent Laid-Open No. 2003-88686 (Patent Document 3) discloses a compatible robot. According to Japanese Patent Laying-Open No. 2003-88686 (Patent Document 3), a first input unit, a receiving unit, a voice recognition unit, a storage unit, and a control unit are provided, the first input unit is operated, and a user When the voice is input to the receiver, the voice recognition unit recognizes the voice, and the control unit stores the voice-recognized registration data in the storage unit. In addition, a driving unit for driving the head is provided, and a companion sound is output, and the control unit drives the driving unit to cause the head to perform a reciprocal operation.

JP 2002-77073 A JP 2002-118828 A JP 2003-88686 A

  However, conventionally, a message other than the broadcasting station cannot freely output a message to the audio output device. Accordingly, an object of the present invention is to provide a network system, an audio output device, a server, an audio output method, and an audio output program that can output a message to an audio output device more freely than before.

  According to an aspect of the present invention, a network system is provided that includes an audio output device and a server that can communicate with the audio output device via the Internet. The server transmits audio data corresponding to the TV program to the audio output device.

  Preferably, the audio output device detects a television channel and transmits the channel to the server. The server transmits audio data corresponding to the TV program to the audio output device based on the channel.

  Preferably, the audio output device has an animal shape. The voice output device transmits data regarding the handling method received from the user to the server. The server transmits audio data to the audio output device based on the data.

  Preferably, the server also transmits operation data corresponding to the TV program to the audio output device.

  Preferably, the server receives text from another terminal and transmits audio data corresponding to the text to the audio output device as audio data corresponding to the TV program.

  Preferably, the server transmits operation data for sign language to the voice output device.

  Preferably, the server receives input of text and transmits operation data for sign language corresponding to the text to the voice output device.

  According to another aspect of the present invention, an audio output method in a network system including an audio output device and a server capable of communicating with the audio output device via a network is provided. The audio output method includes a step in which a server transmits audio data corresponding to a TV program to an audio output device, and an audio output device outputs audio based on the audio data.

  According to another aspect of the present invention, a server is provided that includes a communication interface for communicating with an audio output device via a network, and a processor. The processor transmits audio data corresponding to the TV program to the audio output device via the communication interface.

  Preferably, the processor receives text from another terminal via the communication interface, and transmits voice data corresponding to the text to the voice output device via the communication interface.

  According to another aspect of the present invention, an audio output device including a communication interface for communicating with a server via a network, a speaker, and a processor is provided. The processor receives the audio data corresponding to the TV program from the server via the Internet by using the communication interface, and causes the speaker to output the audio based on the audio data.

  Preferably, the audio output device further includes an IR receiver. The processor receives the channel command via the IR receiver and transmits the channel command to the server by using the communication interface.

  Preferably, the audio output device further includes a part driving unit. The processor receives operation data corresponding to the TV program from the server via the Internet by using the communication interface, and controls the part driving unit based on the operation data.

  According to another aspect of the present invention, an audio output method in an audio output device including a communication interface for communicating with a server via a network, a speaker, and a processor is provided. In the sound output method, the processor receives the sound data corresponding to the TV program from the server via the Internet by using the communication interface, and the processor outputs the sound to the speaker based on the sound data. Steps.

  According to another aspect of the present invention, an audio output program for an audio output device is provided that includes a communication interface for communicating with a server via a network, a speaker, and a processor. The audio output program executes a step of receiving audio data corresponding to a TV program from a server via the Internet by using a communication interface, and causing a speaker to output audio based on the audio data. Let

  As described above, according to the present invention, there are provided a network system, an audio output device, a server, an audio output method, and an audio output program that can output a message to an audio output device more freely than before.

It is an image figure which shows the whole structure and operation | movement outline | summary of the network system 1 concerning 1st Embodiment. It is a block diagram showing the hardware constitutions of the server 100 concerning 1st Embodiment. It is an image figure which shows the data structure of the message database 121 concerning 1st Embodiment. It is a block diagram showing the hardware constitutions of the audio | voice output apparatus 200 concerning 1st Embodiment. FIG. 2 is a block diagram illustrating a hardware configuration of a television 300 according to the first embodiment. It is a flowchart which shows the audio | voice output process of the network system 1 concerning 1st Embodiment. It is an image figure which shows the whole structure and operation | movement outline | summary of the network system 1 concerning 2nd Embodiment. It is a block diagram showing the hardware constitutions of the smart phone 700 concerning 2nd Embodiment. It is a flowchart which shows the audio | voice output process of the network system 1 concerning 2nd Embodiment. It is an image figure which shows the whole structure and the operation | movement outline | summary of the network system 1 concerning 3rd Embodiment. It is a block diagram showing the hardware constitutions of the audio | voice output apparatus 200B concerning 3rd Embodiment. It is a flowchart which shows the audio | voice output process of the network system 1 concerning 3rd Embodiment. It is an image figure which shows the whole structure and operation | movement outline | summary of the network system 1 concerning 4th Embodiment. It is a flowchart which shows the audio | voice output process of the network system 1 concerning 4th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
<First Embodiment>
<Overall configuration of network system>

  First, the overall configuration of the network system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is an image diagram showing an overall configuration and an outline of operation of the network system 1 according to the present embodiment.

  The network system 1 includes a server 100, an audio output device 200, and a television 300 as main components. The network system 1 may include a router 500 for connecting the audio output device 200 to the Internet. In the present embodiment, network system 1 includes remote controller 400 for changing the channel and volume of television 300.

In the following, a bear stuffed animal having a speaker will be described as the audio output device 200. However, the audio output device 200 may have a shape of another animal having a speaker. Furthermore, the audio output device 200 is not limited to a stuffed animal, but includes, for example, air conditioners, refrigerators, air purifiers, humidifiers, dehumidifiers, self-propelled cleaners, lighting, clocks, and other home appliances, televisions, game machines, music players, It may be a communication device having a speaker, such as a hard disk recorder, AV (audio / visual) equipment such as a personal computer, a solar power generator, an interphone, a housing facility such as a water heater.
<Overview of network system operation>

  Next, an outline of the operation of the network system 1 according to the present embodiment will be described with reference to FIG. First, the user turns on the television 300 using the remote controller 400. At this time, the audio output device 200 detects an ON signal from the remote controller and detects that the television 300 is turned on. In the present embodiment, when the audio output device 200 detects an ON signal from the remote controller, the audio output device 200 transmits data indicating “start of service use” to the server 100 via the Internet.

  Next, the user changes the channel of the television 300 using the remote controller 400. At this time, the audio output device 200 detects the remote control signal and acquires the channel of the television 300. The audio output device 200 transmits the channel of the television 300 to the server 100 via the router 500 and the Internet.

  In this embodiment, audio output device 200 is equipped with a microphone. The audio output device 200 knows the zapping status of the program. For example, when there is no channel change for a predetermined time, the audio output device 200 transmits data indicating the channel to the server 100.

  Thereafter, the server 100 accepts input of texts in accordance with the video, audio, and performers' behaviors displayed in the channel program from the administrator. Alternatively, the server 100 stores in advance text that is displayed in a channel program, audio, texts of performers, and the like.

  The server 100 creates voice data from the input text. At the same time, the server 100 also creates an operation of the audio output device 200 corresponding to the text from the input text. The server 100 transmits the audio data and the operation command to the audio output device 200.

  The audio output device 200 outputs a message in accordance with the video, audio, and performer's behavior displayed in the channel program from the speaker, and executes an operation suitable for the message.

  More specifically, in the present embodiment, the voice output device 200 is in a good mood mode when it is stroked or spoken by the user. On the other hand, when the user is hit or ignored, the mode becomes bad. The audio output device 200 transmits a mode related to its own mood to the server 100.

  The server 100 creates audio data of text corresponding to the mood mode received from the audio output device 200 among the input text. At the same time, the server 100 also creates an operation of the voice output device 200 corresponding to the text corresponding to the mood mode received from the voice output device 200. The server 100 transmits the audio data and the operation command to the audio output device 200.

  As a result, the audio output device 200 outputs a message that matches the video, audio, and performer's behavior displayed on the television 300 and the mood of the audio output device 200 from the speaker, and performs an operation suitable for the message. Run.

  Finally, the user turns off the television 300 using the remote controller 400. At this time, the audio output device 200 detects an OFF signal from the remote controller and detects that the television 300 is turned off. In the present embodiment, when detecting the remote control OFF signal, the audio output device 200 transmits data indicating “end of service use” to the server 100 via the Internet.

  As described above, the network system 1 according to the present embodiment can input a message and an operation command to the audio output device 200 via the Internet. That is, the network system 1 according to the present embodiment can output a message to the audio output device more freely than in the past.

Hereinafter, the network system 1 for realizing such a function will be described in detail.
<Hardware Configuration of Server 100>

  First, an aspect of the hardware configuration of the server 100 configuring the network system 1 will be described. FIG. 2 is a block diagram showing a hardware configuration of server 100 according to the present embodiment.

  Referring to FIG. 2, server 100 includes a processor 110, a memory 120, various lights 130, various switches 140, and a communication interface 160 as main components.

  The processor 110 controls each unit of the server 100 by executing a program stored in the memory 120 or an external storage medium. That is, the processor 110 executes various processes described later by executing a program stored in the memory 120.

  The memory 120 is realized by various types of RAM (Random Access Memory), various types of ROM (Read-Only Memory), flash memory, and the like. The memory 120 is a USB (Universal Serial Bus) (registered trademark) memory, a CD (Compact Disc), a DVD (Digital Versatile Disk), a memory card, a hard disk, an IC (Integrated Circuit) card, which is used via an interface. It is also realized by a storage medium such as an optical card, mask ROM, EPROM (Erasable Programmable Read Only Memory), or EEPROM (Electronically Erasable Programmable Read Only Memory).

  The memory 120 stores an audio output program executed by the processor 110, other programs, data generated by the execution of the program by the processor 110, input data, and data received from the audio output device 200. In particular, in the present embodiment, the memory 120 stores a message database 121.

  Here, the message database 121 will be described. FIG. 3 is an image diagram showing a data structure of the message database 121 according to the present embodiment.

  Referring to FIG. 3, message database 121 corresponds to channels, program names, modes of audio output device 200, input times or times to be output, contents of audio messages, and part action commands. Store relationships. Thereby, the processor 110 can obtain the message to be output by the audio output device 200 and the operation content of the audio output device 200 corresponding to the channel and program of the television 300 by referring to the message database 121. . The processor 110 can transmit a message and an operation command to the audio output device 200 via the communication interface 160.

  However, a device different from the server 100 may store the message database 121. In this case, the processor 110 of the server 100 is configured to be able to refer to the message database 121 via the communication interface 160.

  Returning to FIG. 2, the light 130 transmits various states of the server 100 to the outside by being turned on, blinking, and turned off by a signal from the processor 110.

  The switch 140 receives an instruction from the administrator and inputs the instruction to the processor 110.

The communication interface 160 transmits data from the processor 110 to the audio output device 200 via the Internet, a carrier network, a router, or the like. The communication interface 160 receives data from the audio output device 200 via the Internet, a carrier network, a router, etc., and passes it to the processor 110.
<Hardware Configuration of Audio Output Device 200>

  First, an aspect of the hardware configuration of the audio output device 200 according to the present embodiment will be described. FIG. 4 is a block diagram showing a hardware configuration of the audio output device 200 according to the present embodiment.

  Referring to FIG. 4, the audio output device 200 includes a processor 210, a memory 220, a contact sensor 230, a voice recognition unit 245, a neck driving unit 272, an arm driving unit 274, and a leg driving unit 276 as main components. A network communication unit 260 and an IR receiving unit 265.

  The processor 210 controls each unit of the audio output device 200 by executing a program stored in the memory 220 or an external storage medium. That is, the processor 210 executes various processes to be described later by executing a program stored in the memory 220.

  A specific example of the memory 220 is the same as the memory 120 of the server 100, and thus description thereof will not be repeated here.

  The memory 220 stores an audio output program and other programs executed by the processor 210, data generated by executing the program by the processor 210, input data, data received from the server 100, and the like.

  The contact sensor 230 is disposed on the outer surface of the audio output device 200, for example, the head, back, abdomen, arms, legs. The contact sensor 230 inputs an ON signal to the processor 210 when the user's hand touches the audio output device 200. Thus, the processor 210 can detect that the user has stroked, struck, or not touched the animal-type audio output device 200. In the present embodiment, processor 110 switches, for example, the mood mode of audio output device 200 based on the detection result. For example, when the user touches the sound output device 200 many times, the processor 110 sets the pleasant mode, and when the user does not touch the sound output device 200, the processor 110 sets the bad mode. To do.

  The voice recognition unit 245 acquires a message from the user based on voice data input to the processor 210 via the microphone 270.

  The neck drive unit 272 is disposed between the head and the torso of the animal-type audio output device 200. The neck driving unit 272 moves the neck according to a signal from the processor 210. That is, the inclination of the head is changed with respect to the trunk, or the head is rotated.

  There are two arm driving units 274, which are arranged between the right arm and the trunk of the animal-type audio output device 200 and between the left arm and the trunk of the animal-type audio output device 200. The arm driving unit 274 moves the right arm and the left arm according to a signal from the processor 210. That is, the inclination of the right arm and the left arm is changed with respect to the trunk, and the right arm and the left arm are rotated.

  There are two leg driving units 276, which are arranged between the right leg and the trunk of the animal-type audio output device 200 and between the left leg and the trunk of the animal-type audio output device 200. The leg driving unit 276 moves the right leg and the left leg in accordance with a signal from the processor 210. That is, the inclination of the right leg and the left leg is changed with respect to the body part, or the right leg and the left leg are rotated.

  The network communication unit 260 transmits data from the processor 210, for example, the state of the audio output device 200 and the command received by the audio output device 200 from the user to the server 100 via an adapter, a router, the Internet, and the like. For example, the processor 210, via the network communication unit 260, data indicating the start of use of the Aichi service, data indicating the current channel of the television 300, data indicating the mood / moody mode, data indicating the end of use of the Aichi service. , Etc. are transmitted to the server 100.

  Conversely, the network communication unit 260 receives data from the server 100 via the Internet, a router, an adapter, etc., and passes it to the processor 210. For example, the processor 210 receives audio data to be output from the speaker 280, an operation command for operating the neck drive unit 272, the arm drive unit 274, and the leg drive unit 276 from the server 100.

  The IR receiver 265 receives a remote control signal from the remote controller 400 to the television 300 and passes the signal to the processor 210. For example, the IR receiver 265 receives a power ON / OFF signal, a volume UP / DOWN signal, and a channel designation signal, and passes them to the processor 210.

  The microphone 270 receives a message from the user, that is, an audio input. The microphone 270 inputs an audio signal to the processor 210.

The speaker 280 outputs various sounds such as a message to the user, a call sound, music, and a moving image based on the sound signal from the processor 210.
<Hardware configuration of TV 300>

  Next, an aspect of the hardware configuration of the television 300 according to this embodiment will be described. FIG. 5 is a block diagram showing a hardware configuration of television 300 according to the present embodiment.

  Referring to FIG. 5, television 300 includes a processor 310, a memory 320, a display 330, a switch, 340, an IR receiver 365, a speaker 380, and an antenna tuner 390 as main components. .

  The processor 310 controls each unit of the television 300 by executing a program stored in the memory 320 or an external storage medium and other programs. That is, the processor 310 executes various processes by executing a program stored in the memory 320.

  A specific example of the memory 320 is the same as that of the memory 120 of the server 100, and thus description thereof is not repeated here.

  The memory 320 stores programs executed by the processor 310, other programs, data generated by execution of the programs by the processor 310, data input from the switch 340 and the IR receiver 365, and the like.

  The display 330 outputs characters and images based on signals from the processor 310.

  The switch 340 receives a command from the user and inputs the command to the processor 310.

  The IR receiver 365 receives a signal from the remote controller 400 and passes the signal to the processor 310.

  The speaker 380 outputs various sounds based on the sound signal from the processor 210.

The antenna tuner 390 receives a television broadcast wave from a broadcast station and inputs it to the processor 310.
<Audio output processing in the network system 1>

  Next, an audio output process of the network system 1 according to the present embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing the audio output process of the network system 1 according to the present embodiment.

  First, the TV 300 is turned on.

  For example, the user strokes the head of the audio output device 200 (step S101). As a result, the sound output device 200 is set to a pleasant mode. Conversely, the user taps or leaves the audio output device 200 (step S101). As a result, the audio output device 200 is set to the unpleasant mode.

  Next, the user uses the remote controller 400 to change the channel of the television 300 (step S102). The television 300 changes the channel according to the command from the remote controller 400 (step S104). At this time, the processor 210 of the audio output device 200 also receives a signal from the remote controller 400 via the IR receiver 265 and acquires the channel of the television 300 (step S106).

  The processor 210 of the audio output device 200 transmits data indicating the current good or bad mode and the detected channel to the server 100 via the network communication unit 260 (step S112).

  The processor 110 of the server 100 receives the mode and channel from the audio output device 200 via the communication interface 160 (step S114).

  When the television 300 outputs content (step S122), the administrator of the server 100 inputs a message regarding the content to the server 100 (step S132). The processor 110 stores the input message in the message database 121 of the memory 120 in association with the channel and the input time or the time to be output (step S134).

  The network system 1 preferably includes an administrator for each channel. Furthermore, the network system 1 preferably includes an administrator for each channel and for each mode of the audio output device 200. For example, if there are five channels and there are three modes, it is preferable that 5 × 3 = 15 administrators are waiting to input a message. However, the number of types of modes may be different for each channel.

  The processor 110 of the server 100 reads a message to be output and an operation command of the audio output device 200 corresponding to the channel, the current time, and the mood mode of the audio output device 200 from the memory 120 (step S136). The processor 110 transmits the read message and the operation command to the audio output device 200 via the communication interface 160 (step S138).

  The processor 210 of the audio output device 200 receives a message and an operation command from the server 100 via the network communication unit 260 (step S140). The processor 210 outputs the received message as voice via the speaker 280 (step S142). Further, the processor 110 moves the neck, the arm, and the leg via the neck driving unit 272, the arm driving unit 274, and the leg driving unit 276 (step S142).

  However, regarding steps S132 and S134, the message to be output may be stored in advance in the message database 121 in association with the channel and the time to be output at the time of production of the program. In this case, also regarding steps S138 and S140, the server 100 may transmit a message to be output in advance to the audio output device 200 in association with the channel and the time to be output. And regarding step S142, the voice output device 200 may output the message to be output by voice at the time to be output.

  More specifically, when a broadcast station or a program producer prepares a message in advance before TV broadcasting, the message database 121 stores an output time, a voice message, and a part operation command for each mode. It is preferred that However, when the administrator of the server 100 inputs a message while watching a TV program, the part operation command need not be input.

Thus, in the present embodiment, it is possible to cause the voice output device 200 to output a message more freely than in the past.
<Second Embodiment>

In the first embodiment, a message to be output by the audio output device 200 is registered in the server 100 in advance, or an administrator of the server 100 registers a message to be output by the audio output device 200 in the server 100. It was something to do. However, in the present embodiment, a message to be output by the audio output device 200 is registered by the other user in the server 100 from the terminal.
<Overall configuration of network system>

  First, the overall configuration of the network system 1B according to the present embodiment will be described with reference to FIG. FIG. 7 is an image diagram showing an overall configuration and an outline of operation of the network system 1B according to the present embodiment.

  The network system 1B includes a server 100, an audio output device 200, a television 300, and a smartphone 700 as main components. The network system 1B may include a router 500 for connecting the audio output device 200 to the Internet.

  Also in this embodiment, a bear stuffed animal having a speaker will be described as the audio output device 200. However, the audio output device 200 may have a shape of another animal having a speaker. Furthermore, the audio output device 200 is not limited to a stuffed animal, for example, an air conditioner, a refrigerator, an air cleaner, a humidifier, a dehumidifier, a self-propelled cleaner, a lighting, a clock, and other home appliances, a television, a game machine, a music player, It may be a communication device having a speaker, such as a hard disk recorder, AV (audio / visual) equipment such as a personal computer, a solar power generator, an interphone, a housing facility such as a water heater.

In the present embodiment, the user uses the smartphone 700 in order to register a voice message in the server 100, but another communication terminal such as a personal computer or a game machine may be used.
<Overview of network system operation>

  Next, with reference to FIG. 7, an outline of the operation of the network system 1B according to the present embodiment will be described. First, the user turns on the television 300 using the remote controller 400. At this time, the audio output device 200 detects a remote control signal and detects that the television 300 is turned on.

  Next, the user changes the channel of the television 300 using the remote controller 400. At this time, the audio output device 200 detects the remote control signal and acquires the channel of the television 300. The audio output device 200 transmits the channel of the television 300 to the server 100 via the router 500 and the Internet.

  After that, the server 100 accepts input of texts in accordance with video, audio, and performers' behaviors displayed on the channel program from other users via the smartphone 700 or the like. The server 100 creates voice data from the input text. At the same time, the server 100 also creates an operation command for the voice output device 200 corresponding to the text from the input text. The server 100 transmits the audio data and the operation command to the audio output device 200.

  The audio output device 200 outputs a message in accordance with the video, audio, and performer's behavior displayed in the channel program from the speaker, and executes an operation suitable for the message.

  More specifically, also in the present embodiment, the audio output device 200 is in a good mood mode when it is stroked or spoken by the user. On the other hand, when the user is hit or ignored, the mode becomes bad. The audio output device 200 transmits a mode related to its own mood to the server 100.

  The server 100 creates audio data of text corresponding to the mood mode received from the audio output device 200 among the input text. At the same time, the server 100 also creates an operation of the voice output device 200 corresponding to the text corresponding to the mood mode received from the voice output device 200. The server 100 transmits the audio data and the operation command to the audio output device 200.

  As a result, the audio output device 200 outputs a message that matches the video, audio, and performer's behavior displayed on the television 300 and the mood of the audio output device 200 from the speaker, and performs an operation suitable for the message. Run.

  As described above, the network system 1 according to the present embodiment can input a message and an operation command to the audio output device 200 via the Internet. That is, the network system 1 according to the present embodiment can output a message to the audio output device more freely than in the past.

Hereinafter, the network system 1 for realizing such a function will be described in detail. However, the hardware configuration of the server 100 configuring the network system 1 according to the present embodiment, the data structure of the message database 121, the hardware configuration of the audio output device 200, the hardware configuration of the television 300, etc. Since these are the same as those of the embodiment, description thereof will not be repeated here.
<Hardware configuration of smartphone 700>

  Next, an aspect of the hardware configuration of the smartphone 700 as another terminal according to the present embodiment will be described. FIG. 8 is a block diagram showing a hardware configuration of smartphone 700 according to the present embodiment.

  Referring to FIG. 8, smartphone 700 includes a processor 710, a memory 720, a touch panel 750 (display 730 and pointing device 740), and a communication interface 760 as main components.

  The processor 710 controls each unit of the smartphone 700 by executing a program stored in the memory 720 or an external storage medium and other programs. That is, the processor 710 executes various processes described later by executing a program stored in the memory 720.

  The memory 720 is realized by various RAMs, various ROMs, flash memories, and the like. The memory 720 is used via various interfaces, such as a memory card such as an SD card or a micro SD card, a USB (registered trademark) memory, a CD, a DVD, a hard disk, an IC card, an optical card, a mask ROM, It is also realized by a storage medium such as EPROM or EEPROM.

  The memory 720 stores a display program executed by the processor 710 and other programs, data generated by executing the program by the processor 710, data input via the pointing device 740, data received from the server 100, and the like. . The processor 710 executes various processes according to the program in the memory 720.

  The display 730 outputs characters and images based on signals from the processor 710.

  The pointing device 740 receives a command from the user and inputs the command to the processor 710. Note that in this embodiment, the smartphone 700 includes a touch panel 750 in which a display 730 and a pointing device 740 are combined.

The communication interface 760 is realized by an antenna or a connector. The communication interface 760 exchanges data with other devices by wired communication or wireless communication. The processor 710 transmits text data, image data, and the like to another device such as the server 100 via the communication interface 760.
<Audio output processing in the network system 1>

  Next, an audio output process of the network system 1 according to the present embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing the audio output process of the network system 1 according to the present embodiment.

  First, since the processing from turning on the power of the television 300 to step S222 is the same as that of the first embodiment, description thereof will not be repeated here.

  When the television 300 outputs content (step S222), the user of the smartphone 700 inputs a message regarding the content to the smartphone 700 (step S224). The processor 710 of the smartphone 700 registers the message in the server 100 in association with the channel via the communication interface 760 (step S226).

  The processor 110 of the server 100 receives a message and a channel from the smartphone 700 via the communication interface 160 (step S232). The processor 110 stores the received message and channel in the memory 120 in association with the input time or the time to be output (step S234).

  Also in the present embodiment, network system 1 preferably includes an administrator for each channel. Furthermore, the network system 1 preferably includes an administrator for each channel and for each mode of the audio output device 200.

  The processor 110 of the server 100 reads the message to be output and the operation command of the audio output device 200 corresponding to the channel, the current time, and the mood mode of the audio output device 200 from the memory 120 (step S236). The processor 110 transmits the read message and operation command to the audio output device 200 via the communication interface 160 (step S238).

  The processor 210 of the audio output device 200 receives a message and an operation command from the server 100 via the network communication unit 260 (step S240). The processor 210 outputs the received message as voice via the speaker 280 (step S242). Further, the processor 110 moves the neck, the arm, and the leg via the neck driving unit 272, the arm driving unit 274, and the leg driving unit 276 (step S242).

  More specifically, when a broadcast station or a program producer prepares a message in advance before TV broadcasting, the message database 121 stores an output time, a voice message, and a part operation command for each mode. It is preferred that However, when the administrator of the server 100 or the user of the smartphone 700 inputs a message while watching a TV program, it is not necessary to input a part operation command.

Thus, also in the present embodiment, it is possible to cause the voice output device 200 to output a message more freely than in the past.
<Third Embodiment>

In the first and second embodiments, the voice output device 200 having the shape of an animal outputs a message and moves the arms and legs. However, in the present embodiment, the audio output device 200 has two arms like a human, each of which has five fingers, and performs sign language corresponding to the content of the program. It is.
<Overall configuration of network system>

  First, the overall configuration of the network system 1C according to the present embodiment will be described with reference to FIG. FIG. 10 is an image diagram showing an overall configuration and an outline of operation of the network system 1C according to the present embodiment.

The network system 1C includes a server 100, an audio output device 200, and a television 300 as main components. The network system 1C may include a router 500 for connecting the audio output device 200 to the Internet. The audio output device 200 according to the present embodiment has the shape of a human upper body. However, the audio output device 200 only needs to have two arms and fingers, and other parts such as a face are not necessarily required.
<Overview of network system operation>

  Next, an operation outline of the network system 1C according to the present embodiment will be described with reference to FIG. First, the user turns on the television 300 using the remote controller 400. At this time, the audio output device 200 detects a remote control signal and detects that the television 300 is turned on.

  Next, the user changes the channel of the television 300 using the remote controller 400. At this time, the audio output device 200 detects the remote control signal and acquires the channel of the television 300. The audio output device 200 transmits the channel of the television 300 to the server 100 via the router 500 and the Internet.

  Thereafter, the server 100 accepts input of texts in accordance with the video, audio, and performers' behaviors displayed in the channel program from the administrator. The text may be a human story itself output in a program. The server 100 creates voice data from the input text. At the same time, the server 100 also creates a sign language operation command of the voice output device 200 corresponding to the text from the input text. The server 100 transmits the voice data and the sign language operation command to the voice output device 200.

  The audio output device 200 outputs a message in accordance with the video, audio, and performer's behavior displayed in the channel program from the speaker, and executes sign language suitable for the message.

  Also in the present embodiment, the voice output device 200 may be in a good mood mode when it is stroked or spoken by the user. Conversely, when the user is hit or ignored, the mode may be in a bad mood. In this case, the audio output device 200 transmits a mode related to its own mood to the server 100.

  The server 100 creates audio data of text corresponding to the mood mode received from the audio output device 200 among the input text. At the same time, the server 100 also creates an operation of the voice output device 200 corresponding to the text corresponding to the mood mode received from the voice output device 200. The server 100 transmits the audio data and the operation command to the audio output device 200.

  As a result, the audio output device 200 outputs a message that matches the video, audio, and performer's behavior displayed on the television 300 and the mood of the audio output device 200 from the speaker, and performs an operation suitable for the message. Run. However, when the audio output device 200 performs sign language of the human story itself output in the program, it is not necessary to switch modes related to mood.

  As described above, the network system 1 according to the present embodiment can input a message and an operation command to the audio output device 200 via the Internet. That is, the network system 1 according to the present embodiment can output a message to the audio output device more freely than in the past.

Hereinafter, the network system 1 for realizing such a function will be described in detail. However, the hardware configuration of the server 100 configuring the network system 1 according to the present embodiment, the data structure of the message database 121, the hardware configuration of the television 300, and the like are the same as those in the first embodiment. Therefore, the description will not be repeated here.
<Hardware Configuration of Audio Output Device 200B>

  Below, the one aspect | mode of the hardware constitutions of the audio | voice output apparatus 200B which has the shape of the upper body of the person concerning this Embodiment is demonstrated. FIG. 11 is a block diagram showing a hardware configuration of the audio output device 200B according to the present embodiment.

  Referring to FIG. 11, the voice output device 200 includes a processor 210, a memory 220, a contact sensor 230, a voice recognition unit 245, a neck driving unit 272, an arm driving unit 274, and a finger driving unit 274 as main components. -3, a network communication unit 260, and an IR receiving unit 265.

  The processor 210, the memory 220, the contact sensor 230, the voice recognition unit 245, the neck driving unit 272, the arm driving unit 274, the network communication unit 260, and the IR receiving unit 265 according to the present embodiment are the first one. Since these are the same as those in the embodiment, the description will not be repeated here.

The finger driving unit 274-3 is mounted on each of the five fingers of each of the two arms. The finger driving unit 274-3 moves the joints of the ten fingers in response to a signal from the processor 210.
<Audio output processing in the network system 1>

  Next, an audio output process of the network system 1 according to the present embodiment will be described with reference to FIG. FIG. 12 is a flowchart showing audio output processing of the network system 1 according to the present embodiment.

  First, the processing from when the power of the television 300 is turned on to step S322 is the same as that of the first embodiment, and therefore description thereof will not be repeated here.

  When the television 300 outputs content (step S322), the administrator of the server 100 inputs a message corresponding to the content to the server 100 (step S332). The message may be a word itself spoken in the program. The processor 110 stores the input message in the memory 120 in association with the channel and the input time or the time to be output (step S334).

  Also in the present embodiment, network system 1 preferably includes an administrator for each channel. Furthermore, the network system 1 preferably includes an administrator for each channel and for each mode of the audio output device 200.

  The processor 110 of the server 100 reads a message to be output corresponding to the channel, the current time, and the mood mode of the audio output device 200 from the memory 120 (step S336).

  The processor 110 creates a sign language operation command corresponding to the message (step S337). However, the sign language operation command may be stored in the memory 120 simultaneously with the storage of the message in step S334.

  The processor 110 transmits the read message and the sign language operation command to the voice output device 200 via the communication interface 160 (step S338).

  The processor 210 of the audio output device 200 receives a message and a sign language operation command from the server 100 via the network communication unit 260 (step S340). The processor 210 outputs the received message as voice via the speaker 280 (step S342). In addition, the processor 110 moves the arm and the finger via the arm driving unit 274 and the finger driving unit 274-3 (step S342).

  However, with regard to step S332 and step S334, the message to be output may be stored in the message database 121 in advance in association with the channel and the time to be output at the time of production of the program. In this case, also regarding steps S338 and S340, the server 100 may transmit a message to be output in advance to the audio output device 200 in association with the channel and the time to be output. Then, with regard to step S342, the voice output device 200 may voice output a message to be output at the time to be output.

  More specifically, when a broadcast station or a program producer prepares a message in advance before TV broadcasting, the message database 121 stores an output time, a voice message, and a part operation command for each mode. It is preferred that However, when the administrator of the server 100 inputs a message while watching a TV program, the part operation command need not be input.

  Thus, in the present embodiment, it is possible to cause the voice output device 200 to output a message more freely than in the past.

  In the third embodiment, the voice output device 200 executes a sign language operation while outputting a message as a voice. However, the audio output device 200 may be a sign language device. That is, the sign language device may execute a sign language operation corresponding to the contents of the program or a sign language operation indicating a speech itself spoken in the program without outputting the message as a voice.

  That is, in this embodiment, in step S342 in FIG. 12, the processor 110 moves the arm and the finger via the arm driving unit 274 and the finger driving unit 274-3. Since the server 100 only needs to be able to acquire a sign language operation command, the server 100 may receive a message input and create a sign language operation command from the message, or may receive only a sign language operation command without receiving a message input. It may be accepted.

  <Fourth embodiment>

In the third embodiment, a message to be output by the audio output device 200 is registered in the server 100 in advance, or an administrator of the server 100 registers a message to be output by the audio output device 200 in the server 100. It was something to do. However, in the present embodiment, a message to be output by the audio output device 200 is registered by the other user in the server 100.
<Overall configuration of network system>

  First, the overall configuration of the network system 1D according to the present embodiment will be described with reference to FIG. FIG. 13 is an image diagram showing an overall configuration and an operation outline of the network system 1D according to the present embodiment.

  The network system 1D includes a server 100, an audio output device 200, a television 300, and a smartphone 700 as main components. The network system 1D may include a router 500 for connecting the audio output device 200 to the Internet. The audio output device 200 according to the present embodiment has the shape of a human upper body. However, the audio output device 200 only needs to have two arms and fingers, and other parts such as a face are not necessarily required.

In the present embodiment, the user uses the smartphone 700 in order to register a voice message in the server 100, but another communication terminal such as a personal computer or a game machine may be used.
<Overview of network system operation>

  Next, an operation outline of the network system 1D according to the present embodiment will be described with reference to FIG. First, the user turns on the television 300 using the remote controller 400. At this time, the audio output device 200 detects a remote control signal and detects that the television 300 is turned on.

  Next, the user changes the channel of the television 300 using the remote controller 400. At this time, the audio output device 200 detects the remote control signal and acquires the channel of the television 300. The audio output device 200 transmits the channel of the television 300 to the server 100 via the router 500 and the Internet.

  After that, the server 100 accepts input of texts in accordance with video, audio, and performers' behaviors displayed on the channel program from other users via the smartphone 700 or the like. Create voice data from the entered text. At the same time, the server 100 also creates a sign language operation command of the voice output device 200 corresponding to the text from the input text. The server 100 transmits the voice data and the sign language operation command to the voice output device 200.

  The audio output device 200 outputs a message in accordance with the video, audio, and performer's behavior displayed in the channel program from the speaker, and executes sign language suitable for the message.

  Also in the present embodiment, the voice output device 200 may be in a good mood mode when it is stroked or spoken by the user. Conversely, when the user is hit or ignored, the mode may be in a bad mood. In this case, the audio output device 200 transmits a mode related to its own mood to the server 100.

  The server 100 creates audio data of text corresponding to the mood mode received from the audio output device 200 among the input text. At the same time, the server 100 also creates an operation of the voice output device 200 corresponding to the text corresponding to the mood mode received from the voice output device 200. The server 100 transmits the audio data and the operation command to the audio output device 200.

  As a result, the audio output device 200 outputs a message that matches the video, audio, and performer's behavior displayed on the television 300 and the mood of the audio output device 200 from the speaker, and performs an operation suitable for the message. Run. However, when the audio output device 200 performs sign language of the human story itself output in the program, it is not necessary to switch modes related to mood.

  As described above, the network system 1 according to the present embodiment can input a message and an operation command to the audio output device 200 via the Internet. That is, the network system 1 according to the present embodiment can output a message to the audio output device more freely than in the past.

Hereinafter, the network system 1 for realizing such a function will be described in detail. However, the hardware configuration of the server 100 configuring the network system 1 according to the present embodiment, the data structure of the message database 121, the hardware configuration of the audio output device 200B, the hardware configuration of the television 300, etc. Since these are the same as those of the embodiment, description thereof will not be repeated here.
<Audio output processing in the network system 1>

  Next, the audio output process of the network system 1 according to the present embodiment will be described with reference to FIG. FIG. 14 is a flowchart showing audio output processing of the network system 1 according to the present embodiment.

  First, since the process from turning on the power of the television 300 to step S422 is the same as that of the third embodiment, the description thereof will not be repeated here.

  When the television 300 outputs content (step S422), the user of the smartphone 700 inputs a message regarding the content to the smartphone 700 (step S424). The processor 710 of the smartphone 700 registers the message in the server 100 in association with the channel via the communication interface 760 (step S426).

  The processor 110 of the server 100 receives a message and a channel from the smartphone 700 via the communication interface 160 (step S432). The processor 110 stores the received message and channel in the memory 120 in association with the input time or the time to be output (step S434).

  Also in the present embodiment, network system 1 preferably includes an administrator for each channel. Furthermore, the network system 1 preferably includes an administrator for each channel and for each mode of the audio output device 200.

  The processor 110 of the server 100 reads from the memory 120 a message to be output corresponding to the channel, the current time, and the mood mode of the audio output device 200 (step S436).

  The processor 110 creates a sign language operation command corresponding to the message (step S437). However, the sign language operation command may be stored in the memory 120 simultaneously with the storage of the message in step S434.

  The processor 110 transmits the read message and the sign language operation command to the voice output device 200 via the communication interface 160 (step S438).

  The processor 210 of the audio output device 200 receives a message and a sign language operation command from the server 100 via the network communication unit 260 (step S440). The processor 210 outputs the received message as voice via the speaker 280 (step S442). In addition, the processor 110 moves the arm and the finger via the arm driving unit 274 and the finger driving unit 274-3 (step S442).

  More specifically, when a broadcast station or a program producer prepares a message in advance before TV broadcasting, the message database 121 stores an output time, a voice message, and a part operation command for each mode. It is preferred that However, when the administrator of the server 100 or the user of the smartphone 700 inputs a message while watching a TV program, it is not necessary to input a part operation command.

  Thus, in the present embodiment, it is possible to cause the voice output device 200 to output a message more freely than in the past.

  In the fourth embodiment, the voice output device 200 executes a sign language operation while outputting a message as a voice. However, the audio output device 200 may be a sign language device. That is, the sign language device may execute a sign language operation corresponding to the contents of the program or a sign language operation indicating a speech itself spoken in the program without outputting the message as a voice.

That is, in this embodiment, in step S442 in FIG. 14, the processor 110 moves the arm and the finger via the arm driving unit 274 and the finger driving unit 274-3. Since the server 100 only needs to be able to acquire a sign language operation command, the server 100 may receive a message input and create a sign language operation command from the message. Alternatively, the server 100 may operate the sign language operation from the smartphone 700 without receiving a message input. Only instructions may be accepted.
<Other application examples>

  It goes without saying that the present invention can also be applied to a case where it is achieved by supplying a program to a system or apparatus. Then, a storage medium (or memory) storing a program represented by software for achieving the present invention is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores it in the storage medium. The effect of the present invention can also be enjoyed by reading and executing the program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code However, it is needless to say that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the storage medium is written to another storage medium provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU of the function expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

The configurations described in the plurality of embodiments can be combined with each other, only a part thereof can be adopted, or only a part can be omitted.
<Summary of the above embodiments>

  In the first to fourth embodiments, the network system 1 including the audio output device 200 and the server 100 that can communicate with the audio output device 200 via the Internet is provided. The server 100 transmits audio data corresponding to the TV program to the audio output device 200. As a result, a message can be output to the audio output device more freely than in the past.

  In the first to fourth embodiments, the audio output device 200 detects a television channel and transmits the channel to the server 100. The server 100 transmits audio data corresponding to the TV program to the audio output device 200 based on the channel.

  In the first to fourth embodiments, the audio output device 200 has an animal shape. The audio output device 200 transmits data relating to the handling accepted from the user to the server 100. The server 100 transmits audio data to the audio output device 200 based on the data.

  In the first to fourth embodiments, the server 100 also transmits operation data corresponding to the TV program to the audio output device 200.

  In the second and fourth embodiments described above, the server 100 receives text from the other terminal 700 and converts the audio data corresponding to the text as the audio data corresponding to the TV program to the audio output device 200. Send to.

  In the third and fourth embodiments, server 100 transmits operation data for sign language to voice output device 200.

  In the third and fourth embodiments described above, the server 100 receives input of text and transmits operation data for sign language corresponding to the text to the voice output device 200.

  In the first to fourth embodiments described above, there is provided an audio output method in the network system 1 including the audio output device 200 and the server 100 that can communicate with the audio output device via the network. . The audio output method includes a step in which the server 100 transmits audio data corresponding to a TV program to the audio output device 200 and a step in which the audio output device 200 outputs audio based on the audio data.

  In the first to fourth embodiments, a server 100 including a communication interface 160 for communicating with an audio output device via a network and a processor 110 is provided. The processor 110 transmits audio data corresponding to the TV program to the audio output device 200 via the communication interface 160.

  In the second and fourth embodiments described above, the processor 110 receives text from the other terminal 700 via the communication interface 160 and sends the text to the voice output device 200 via the communication interface 160. Audio data corresponding to is sent.

  In the first to fourth embodiments, the audio output device 200 including the communication interface 260 for communicating with the server 100 via the network, the speaker 280, and the processor 210 is provided. The processor 210 uses the communication interface 260 to receive audio data corresponding to the TV program from the server 100 via the Internet, and causes the speaker 280 to output audio based on the audio data.

  In the first to fourth embodiments, the audio output device 200 further includes an IR receiver 265. The processor 210 receives a channel command via the IR receiver 265 and transmits the channel command to the server 100 by using the communication interface 260.

  Preferably, the audio output device 200 further includes site drive units 272, 274, 274-3, 276. The processor 210 uses the communication interface 260 to receive operation data corresponding to the TV program from the server 100 via the Internet, and controls the part driving unit based on the operation data.

  In the first to fourth embodiments described above, there is an audio output method in the audio output device 200 including the communication interface 260 for communicating with the server 100 via the network, the speaker 280, and the processor 210. Provided. In the audio output method, the processor 210 uses the communication interface 260 to receive audio data corresponding to the TV program from the server 100 via the Internet, and the processor 210 uses the speaker 280 based on the audio data. And outputting a sound.

  In the first to fourth embodiments, the audio output for the audio output device 200 including the communication interface 260 for communicating with the server 100 via the network, the speaker 280, and the processor 210 is provided. A program is provided. The audio output program uses the communication interface 260 to receive audio data corresponding to the TV program from the server 100 via the Internet, and to output audio to the speaker 280 based on the audio data. Cause the processor 210 to execute.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1: Network system 1B: Network system 1C: Network system 1D: Network system 100: Server 110: Processor 120: Memory 121: Message database 130: Light 140: Switch 160: Communication interface 200: Audio output device 200B: Audio output device 210 : Processor 220: Memory 230: Contact sensor 245: Voice recognition unit 260: Communication interface (network communication unit)
265: IR receiver 270: Microphone 272: Neck driver 274: Arm driver 274-3: Finger driver 276: Leg driver 280: Speaker 300: Television 310: Processor 320: Memory 330: Display 340: Switch 365: IR receiver 380: speaker 390: antenna tuner 400: remote controller 500: router 700: terminal (smart phone)
710: Processor 720: Memory 730: Display 740: Pointing device 750: Touch panel 760: Communication interface

Claims (15)

An audio output device;
A server capable of communicating with the audio output device via the Internet,
The network system, wherein the server transmits audio data corresponding to a TV program to the audio output device. The audio output device detects a television channel and transmits the channel to the server.
The network system according to claim 1, wherein the server transmits the audio data corresponding to the TV program to the audio output device based on the channel. The audio output device has an animal shape,
The audio output device transmits data on the handling method received from the user to the server,
The network system according to claim 1, wherein the server transmits the audio data to the audio output device based on the data.   4. The network system according to claim 1, wherein the server also transmits operation data corresponding to the TV program to the audio output device. 5.   4. The server according to claim 1, wherein the server receives text from another terminal, and transmits audio data corresponding to the text to the audio output device as audio data corresponding to the TV program. 5. The network system described.   4. The network system according to claim 1, wherein the server transmits operation data for sign language to the audio output device. 5.   4. The network system according to claim 1, wherein the server receives an input of text and transmits operation data for sign language corresponding to the text to the voice output device. 5. An audio output method in a network system including an audio output device and a server capable of communicating with the audio output device via a network,
The server transmitting audio data corresponding to a TV program to the audio output device;
A step of outputting a voice based on the voice data. A communication interface for communicating with the audio output device via the network;
With a processor,
The server, wherein the processor transmits audio data corresponding to a TV program to the audio output device via the communication interface. The processor is
Receive text from other terminals via the communication interface,
The server according to claim 9, wherein voice data corresponding to the text is transmitted to the voice output device via the communication interface. A communication interface for communicating with the server via the network;
Speakers,
With a processor,
The processor outputs audio data corresponding to a TV program from the server via the Internet by using the communication interface, and causes the speaker to output audio based on the audio data. An IR receiver,
The audio output device according to claim 11, wherein the processor receives a channel command via the IR receiver, and transmits the channel command to the server by using the communication interface. It further includes a part drive unit,
The processor receives operation data corresponding to a TV program from the server via the Internet by using the communication interface, and controls the part driving unit based on the operation data. 12. The audio output device according to 12. An audio output method in an audio output device including a communication interface for communicating with a server via a network, a speaker, and a processor,
Receiving the audio data corresponding to the TV program from the server via the Internet by using the communication interface;
And a step of causing the processor to output a sound based on the sound data. An audio output program for an audio output device including a communication interface for communicating with a server via a network, a speaker, and a processor,
Receiving audio data corresponding to a TV program from the server via the Internet by using the communication interface;
An audio output program that causes the processor to execute a step of causing the speaker to output audio based on the audio data.

Images