JP2021092612A - Command control device, control method and control program - Google Patents

Abstract

To support voice recognition with respect to a voice command.SOLUTION: A command control device generates an execution command including a control instruction to a control object apparatus based on inputted voice. The command control device generates the execution command including either of a first control instruction contained in a recognition command obtained by the voice recognition of the voice, and a second control instruction different from the first control instruction.SELECTED DRAWING: Figure 6

Description

Embodiments relate to command control devices, control methods and control programs.

In recent years, a voice control technique for controlling a device by voice using voice recognition has been studied. For example, voice control technology can be used in place of a TV remote control, and when a user utters a command that is a control command, the voice in which the command is superimposed (hereinafter referred to as a voice command) is received by a microphone attached to the TV. It is waved and the command is retrieved as data by voice recognition. The retrieved command data becomes the command to be executed on the TV. In this technology, a voice command issued by a user may be recognized as an erroneous command by voice recognition due to the influence of ambient noise or the like, and improvement of voice recognition performance is being studied.

JP-A-2017-167247

However, depending on the loudness of the ambient noise, voice recognition may not work well, and the range to which the voice control technology can be applied may be limited. Therefore, the control by the voice control technology, which was operating in normal times, may become loud in an emergency such as an earthquake and may not operate normally.

An object to be solved by the present invention is to provide a command control device, a control method, and a control program that support voice recognition for voice commands.

The command control device according to one embodiment is a command control device that generates an execution command including a control command for a device to be controlled based on an input voice, and is included in a recognition command obtained by voice-recognizing the voice. An execution command including any one of the control command 1 and the second control command different from the first control command is generated.

FIG. 1 is a diagram showing a configuration example of the entire system according to the first embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of the receiving device according to the embodiment. FIG. 3 is a block diagram showing an example of the functional configuration of the command control unit according to the embodiment. FIG. 4 is a diagram showing an example of a control target portion and a state of the control target portion that can be controlled by a voice command in the same embodiment. FIG. 5 is a diagram showing an example of auxiliary information that can be used in the same embodiment. FIG. 6 is a flowchart showing an example of processing operation for the command control unit to receive a voice command and transmit an execution command in the same embodiment. FIG. 7 is a diagram showing an example of an execution command generation condition set in the command control unit to control the main power supply in the same embodiment. FIG. 8 is a diagram showing an example of an execution command generation condition set in the command control unit in order to control the volume in the second embodiment. FIG. 9 is a diagram showing an example of execution command generation conditions set in the command control unit in order to control digital content reception in the third embodiment. FIG. 10 is a diagram showing a configuration example of the entire system according to the fourth embodiment.

Hereinafter, embodiments will be described with reference to the drawings.

FIG. 1 is a diagram showing a configuration example of the entire system according to the embodiment.

The receiving device 10 is a device for viewing digital contents, and is a television receiving device (television device, television receiver, etc.) capable of receiving and viewing digital broadcasting such as terrestrial broadcasting such as 2K or 4K / 8K and satellite broadcasting. It is also called a broadcast signal receiver). Further, the receiving device 10 is provided with an external interface for connecting to a network 500 such as the Internet, and can view digital contents provided by the content server device 200 (which may be a cloud server) connected to the network 500. Is. Further, the receiving device 10 may have a recording / playback function, and the digital content recorded by the receiving device 10 can be viewed by the recording / playback function. Further, by connecting a recording / reproducing device (not shown) to the receiving device 10, the digital contents recorded by the recording / reproducing device (not shown) may be viewed. Although one receiving device 10 is shown in FIG. 1, a larger number of receiving devices 10 may be connected. However, the receiving device 10 does not have to have the same function as long as it is a device capable of receiving digital contents. Specifically, a recorder capable of recording only without a monitor that can be viewed, a Set Top Box (STB) capable of receiving a broadcast signal, or the like may be used. The television device, recorder, STB, and the like are collectively referred to as the receiving device 10.

In this embodiment, an example of a television device is particularly shown, but the television device may be replaced with a receiving device 10 such as a recorder or STB. Further, the receiving device 10 may be a mobile device such as a personal computer or a smartphone as a device having the same receiving function.

The receiving device 10 of the present embodiment can be controlled by voice using voice recognition. For example, the command control unit 1 voice-recognizes a voice command uttered by the user, and controls each function in the receiving device 10 by using a command obtained by voice recognition (hereinafter, referred to as a recognition command). Further, the remote controller 100 is a remote controller that remotely controls the receiving device 10.

In addition, the receiving device 10 can collect and store the viewing history (hereinafter referred to as viewing data) of the digital content viewed by the receiving device 10. In addition, data unique to the receiving device 10 (hereinafter referred to as device individual data) can be stored. The viewing device data including the viewing data and the device individual data is referred to as viewing device data. The receiving device 10 can output stored data such as viewing device data to the viewing analysis device 300 connected to the network 500, and can receive the analysis result of the viewing device data performed by the viewing analysis device 300.

The “viewing” in the present embodiment includes a state in which the digital content is received, received, or recorded in a viewable state even if the user is not actually viewing the content. Therefore, the "viewing history" in the present embodiment is, for example, a "reception history" that is simply received by a receiving device such as an STB, regardless of whether or not it is viewed, or when the receiving device is a recorder. , "Recording history" received by the receiving device, reserved for recording, or recorded. Similarly, the "viewing time" in the present embodiment includes, for example, the time when the receiving device such as STB receives the digital content, and when the receiving device is a recorder, the time when the digital content is recorded. ..

Therefore, when the receiving device 10 is replaced with a receiving device such as a recorder or STB, the reception log data generated by the receiving device such as the recorder or STB, the download history data, the recorded data, and the like are also included in the viewing device data.

The device individual data may be registered in the receiving device 10 by the user using, for example, the remote controller 100 of the receiving device 10, or may be set by the manufacturer such as the individual number of the receiving device 10. The device-specific data includes, for example, the IP address of the receiving device 10, the identification number, and demographic data (hereinafter referred to as demogra) registered in advance by the owner or the like. The demogra is data that classifies the users who view the receiving device 10, and is, for example, information such as the age, gender, family structure, and residential area of the users. The identification number is a number, a character string, or the like that identifies different receiving devices 10, and is composed of, for example, a combination of numbers and alphabets.

The content server device 200 is a network or cloud server that provides digital contents. The content server device 200 is provided by, for example, a content service provider (CSP), a telecommunications carrier, or another digital content service provider called Over The Top (OTT). A server that provides a service such as Video On Demand is also included in the content server device 200.

The viewing analysis device 300 exists on the network or the cloud, collects and stores the viewing device data stored in the receiving device 10, further analyzes the stored data, performs various viewing analyzes, and requests analysis, for example. This is a device that outputs the analysis result to the receiving device 10. The viewing analysis device 300 may be built on a computer having, for example, a CPU or a memory. The viewing analysis device 300 may be a personal computer or a cloud service using a server, a database, or the like.

Further, the viewing analysis device 300 may be able to identify each receiving device 10 by the identification number individually possessed by the receiving device 10 and perform the viewing analysis of each receiving device 10.

The voice recognition device 400 is installed on the network 500. The voice recognition device 400 is built on a computer having, for example, a CPU and a memory. The voice recognition device 400 may be a personal computer or a cloud server. The voice recognition device 400 receives digital data (hereinafter referred to as voice data) of a voice waveform with respect to the voice of the user received by a microphone or the like via the network 500, estimates or recognizes a command issued by the user, and estimates or recognizes the command issued by the user. Output the recognized command (recognition command) as text data. In the voice recognition device 400, the commands issued by the user to the control target are listed in advance as text data, and the text data obtained from the received voice data is compared with the text data in the list, and the closest command in the list is compared. You may also select to output the text data of the selected command. However, the method of voice recognition in the voice recognition device 400 is not limited to this method.

Further, the voice recognition device 400 is listed as a Speech To Text server (hereinafter referred to as STT server) that generates voice text in which voice data is converted into text (characterized, verbalized, etc.) and the generated voice text. It may consist of a remote recognition server that generates the closest command as a recognition command. Specifically, the remote recognition server refers to the command list registered in the storage unit (not shown in advance), and selects the command that matches the voice text generated by the STT server or the command closest to the list. It may be output as a recognition command.

The network 500 is a network in which a receiving device 10, a content server device 200, a viewing analysis device 300, and a viewing analysis device 300 are connected so that each device can communicate with each other, for example, the Internet. Further, the network 500 is not limited to the Internet, and may be a network including a plurality of different networks as long as each device can communicate.

FIG. 2 is a block diagram showing an example of the functional configuration of the receiving device 10 according to the embodiment.

The receiving device 10 is a device that receives and processes a signal on which digital contents are superimposed to acquire and view the digital contents.

The broadcast signal reception processing unit 20 processes a broadcast signal such as a digital broadcast received from the antenna 101 according to a standard of digital broadcasting, and acquires and outputs content data such as video, audio, and characters. The standard of digital broadcasting may be, for example, the MPEG2 TS system adopted in 2K digital broadcasting, the MPEG Media Transport system (MMT system) adopted in 4K / 8K digital broadcasting, etc., and both are used by a plurality of tuners. It may correspond to. Processing according to digital broadcasting standards includes demultiplexing processing that separates a digital data stream into a digital data stream of content data such as video, audio, and text, error correction code decoding processing, and decoding of encrypted data. Includes the encryption / decryption process to be performed, the decryption process for the coding (video coding, audio coding, character coding, etc.) applied to each content data, and the like.

The auxiliary information output unit 21 extracts the information requested by the control unit 90 from the broadcast signal and outputs it to the control unit 90. The auxiliary information output unit 21 extracts the requested information from the control information and the program-related information included in the broadcast signal, and outputs the information to the control unit 90. The information output to the control unit 90 is processed as necessary and used by the command control unit 1 as auxiliary information.

The content processing unit 30 executes decoding processing for the coding processing performed by the content server device 200 on the digital data input from the communication unit 102, and outputs the content data such as video, audio, and characters. .. Specifically, the content processing unit 30 performs decoding processing such as demultiplexing processing (separation processing), error correction code decoding processing, and decoding of encoded content data (video, characters, audio, etc.). Perform processing etc.

The auxiliary information output unit 31 extracts the information requested by the control unit 90 from the data output by the content server device 200, and outputs the information to the control unit 90. The auxiliary information output unit 31 extracts related attribute information such as a content program distributor from the control information output by the content server device 200, and outputs the information to the control unit 90. The information output to the control unit 90 is processed as necessary and used by the command control unit 1 as auxiliary information.

The recording / playback unit 40 is, for example, a disc player, an HDD recorder, or the like, stores content data output by the broadcast signal reception processing unit 20 or the content processing unit 30, and outputs the stored content data in accordance with a playback request. It is output to the display unit 103 and the speaker unit 104 as video, characters, and audio. By viewing the video, characters, and audio output by the display unit 103 and the speaker unit 104, the user can view the digital contents stored in the recording / playback unit 40. In the present embodiment, the recording / playback unit 40 is a function of the receiving device 10, but may be, for example, an external device via the interface unit 105. Further, when the receiving device 10 includes a plurality of tuners (corresponding to the broadcast signal reception processing unit 20), the recording / playback unit 40 views the content A received and processed by the broadcast signal reception processing unit 20. However, the recording / playback unit 40 may be able to record the content B received and processed by another broadcast signal reception processing unit 20.

The device data generation unit 50 collects data from each functional unit (particularly, the broadcast signal reception processing unit 20, the content processing unit, and the recording / playback unit 40) of the receiving device 10 to generate viewing device data. The viewing device data includes device-specific data and viewing data. The device individual data is data unique to the receiving device 10, and for example, when the receiving device 10 is installed, the user may set the receiving device 10 from the remote controller 100 or the like. Further, the identification number used in the viewing analysis may be assigned in advance at the time of purchase of the receiving device 10, for example, and set in the device individual data or the like.

The viewing data is, for example, a viewing history, and may be sequentially generated when some viewing is performed by the receiving device 10. Specifically, for example, depending on the timing at which the broadcast signal reception processing unit 20, the content processing unit 30, and the recording / playback unit 40 are activated, each functional unit provides a channel or program name (or a program name equivalent thereto) that provides digital content. The program id), the date and time when the program was viewed, and the like are stored, and each functional unit outputs the stored data as viewing data to the device data generation unit 50 according to the timing when each functional unit is stopped. The device data generation unit 50 processes the viewing data as necessary and stores it in a storage unit (not shown) of the receiving device 10. Further, each function unit (particularly, the broadcast signal reception processing unit 20, the content processing unit 30, and the recording / playback unit 40) stores the viewing data, and when there is a request for transmission of the viewing data from an external device, each function unit May output the viewing data to the device data generation unit 50, and the device data generation unit 50 may process the viewing data as necessary and output the viewing data to an external device as viewing device data.

The device data generation unit 50 outputs the generated viewing device data to the communication unit 102 in response to a request from an external device (particularly the viewing analysis device 300). The viewing device data is transmitted from the communication unit 102 to the viewing analysis device 300 requested via the network 500. Further, when the receiving device 10 detects a change in the viewing device data, the viewing device data may be transmitted to the viewing analysis device 300 at an arbitrary timing.

The auxiliary information output unit 51 receives and controls the viewing device data generated by the device data generating unit 50, the viewing data collected from each function of the receiving device 10, and various analysis result data output by the viewing analysis device 300. Output to unit 90. The information output to the control unit 90 is processed as necessary and used by the command control unit 1 as auxiliary information.

The output control unit 60 adjusts the output timing, display method, and the like with respect to the content data output by the broadcast signal reception processing unit 20, the content processing 30, and the recording / playback unit 40, and outputs the data to the display unit 103 and the speaker unit 104.

The state switching unit 62 includes the current display state of the display unit 103 (ON state or OFF state, display state or non-display state, etc.) and the current output state of the speaker unit 104 (ON state or OFF state, etc.). The audio output state or the audio mute state) is switched according to the control from the control unit 90. The control unit 90 manages the display state of the display unit 103 and the output state of the speaker 104, and the control unit 90 controls the state switching unit 62 according to a control command from the remote controller 100 or the command control unit 1.

The sensor unit 70 is, for example, a camera installed in front of the television, and the front of the television device may be photographed by the camera, and the user who is in front of the television device may be inferred from the captured image by using image recognition or the like. ..

The auxiliary information output unit 71 outputs the user information estimated by the sensor unit 70 to the control unit 90. The information output to the control unit 90 is processed as necessary and used by the command control unit 1 as auxiliary information.

The main power supply unit 80 is a power source for the main function of the receiving device 10. For example, the digital content is output to or stopped from the display unit 103 or the speaker unit 104 of the television device (this operation is turned on in the television device). It is a power supply used for (referred to as -OFF operation).

The state switching unit 82 switches the current state of the main power supply unit 80, that is, the ON-OFF state of the television device according to the control from the control unit 90. The control unit 90 manages the current state of the main power supply unit 80, and the control unit 90 controls the state switching unit 82 according to a control command from the remote controller 100 or the command control unit 1.

The control unit 90 controls each function of the receiving device 10. Specifically, the control unit 90 receives various control signals from the interface unit 105 and controls each function of the receiving device 10. For example, when the user specifies from the remote controller 100 whether to view the content by the broadcast signal or the content from the content server device 200, the control unit 90 transmits the control signal from the remote controller via the interface unit 105. It receives, controls the function of the receiving device 10, and causes the operation specified by the user. Note that, in FIG. 2, data may be exchanged with a functional block that is not particularly connected to the control unit 90.

Further, the control unit 90 in the present embodiment receives an execution command from the command control unit 1 via the interface unit 105, and controls each function in the receiving device 10 according to the execution command.

The auxiliary information management unit 91 is output by the auxiliary information output unit (auxiliary information output unit 21, auxiliary information output unit 31, auxiliary information output unit 41, auxiliary information output unit 51, auxiliary information output unit 71, etc.) in each function. Auxiliary information is received and stored in a storage unit (not shown). The auxiliary information management unit 91 transmits the stored auxiliary information of each function from the interface 105 to the command control unit 1.

For the information to be stored in the auxiliary information management unit 91, predetermined items are set in the auxiliary information output unit in each function, and the auxiliary information output unit voluntarily sets the auxiliary information when the auxiliary information is updated in each function. It may be output to the auxiliary information management unit 91. Further, the auxiliary information management unit 91 may request auxiliary information from the auxiliary information output unit of each function as needed.

The state information management unit 92 stores the state information of the state switching units (state switching unit 62, state switching unit 82, etc.) in each function in a storage unit (not shown). The state information management unit 92 transmits the state information of each function stored via the interface 105 to the command control unit 1. In the present embodiment, since the control unit 90 controls the state of each function, the state information of the state information management unit 92 is always kept up to date. Regarding the information stored in the state information management unit 92, predetermined items are set in the state information output unit (not shown) in each function, and the state information is updated when the state information is updated in each function. The output unit may voluntarily output to the state information management unit 91. Further, the state information management unit 92 may request the state information from the state information output unit of each function as needed.

The time management unit 93 manages the time of the receiving device 10. The clock may be held inside the receiving device 10, or the time may be extracted from a broadcast signal or the like.

The communication unit 102 performs data transmission / reception processing with various devices connected to the network 500 in accordance with predetermined communication rules such as TCP / IP and UDP / IP.

The display unit 103 is, for example, a monitor that displays images and characters. The speaker unit 104 is, for example, a speaker that outputs sound. The display unit 103 and the speaker unit 104 output the content data output by the output control unit 60 as video, characters, and audio. By viewing the video, characters, and audio output by the display unit 103 and the speaker unit 104, the user can view the broadcast signal, the content server device 200, and other digital contents provided by the recording / playback unit 40.

The interface unit 105 is an interface for controlling the receiving device 10 from the outside such as the remote controller 100. For example, the interface unit 105 receives a control signal from the remote controller 100 or a switch (not shown) attached to the receiving device 10 to control the receiving device 10. Output to unit 90. Instead of the remote controller 100, it may have an interface for receiving a control signal from a terminal such as a smartphone (not shown). Further, the interface unit 105 may have an interface for connecting to an external device. For example, it may be an interface for connecting the receiving device 10 and an external HDD recorder (not shown). In this case, the user can view the digital contents output by the external HDD recorder (not shown) on the display unit 103 and the speaker unit 104.

Further, the interface 105 in the present embodiment has an interface capable of communicating with the interface unit 15 of the command control unit 1, for example, the interface may be various serial buses. Further, the interface 105 receives the execution command output by the command control unit 1 and outputs the execution command to the control unit 90.

FIG. 3 is a block diagram showing an example of the functional configuration of the command control unit according to the embodiment.

In the command control unit 1, the command generation unit 11 is based on the recognition command generated by the command recognition unit 13 by voice recognition and the additional information (auxiliary information and state information) acquired by the auxiliary information acquisition unit 16 and the state acquisition unit 17. Then, an execution command is generated and output from the command transmission unit 18 to the outside of the command control unit 1. Each functional block will be described below.

The command generation unit 11 stores a combination of the recognition command, additional information, and the execution command (hereinafter referred to as a condition combination list) in the storage unit 111. The condition combination list can be set by the user in advance. The condition combination list may be incorporated in the computer program of the command generation unit 11, or may be downloaded from an external server via, for example, the network 500. When the recognition command and the additional information are input, the command generation unit 11 generates an execution command by referring to the condition combination list and outputs the execution command.

The voice detection unit 12 is, for example, a microphone, receives a voice emitted by a user, obtains voice data of a voice waveform received by sampling or the like, and outputs the voice data.

The command recognition unit 13 performs voice recognition from the voice data output by the voice detection unit 12, estimates or recognizes a command issued by the user, and outputs the recognition command as text data. The command recognition unit 13 may include a voice data processing unit (voice recognition engine) for executing voice recognition in the command recognition unit 13, but the voice recognition device 400 on the network 500 equipped with the voice recognition engine You can also send voice data to get recognition commands. By using the voice recognition device 400, it is possible to reduce the manufacturing cost of the command recognition unit 13. Further, since the voice recognition device 400 obtains voice data from a large number of receiving devices 10 and performs voice recognition, the voice recognition device 400 has an advantage that a learning effect can be obtained and the performance of voice recognition can be improved. .. However, since the voice recognition device 400 is used via the network 500, there is a demerit that the processing delay of voice recognition is large. In that respect, when the voice recognition engine inside the command recognition unit 13 is used, voice recognition is performed. There is a merit that the processing delay of can be reduced. Further, although FIG. 3 shows an example in which the voice detection unit 12 (speaker) is built in, a smart speaker or the like may be used. For example, the smart speaker is used by connecting to the interface 105. Specifically, a smart speaker equipped with a voice recognition engine generates a recognition command, and a command control unit 1 (or a command generation unit 11) acquires a recognition command generated by the smart speaker, for example, via an interface 105. It may be. The acquired recognition command may be used in the command generation unit 11 to generate an execution command.

The user interface unit 14 is an interface capable of inputting characters, such as a keyboard of a personal computer. Specifically, the user sets a condition combination list from the user interface unit 14 to the storage unit 111. The condition combination list may be set in the storage unit 111 by using the remote controller 100, a smartphone, or the like. Further, the command generation unit 11 may download the condition combination list to the storage unit 111 from a server provided outside the receiving device 10 that provides the condition combination list (not shown).

The interface unit 15 communicates with the interface unit 105 in various ways. Specifically, the interface unit 15 receives auxiliary information and state information from the interface unit 105. Further, the interface unit 15 transmits the execution command generated by the command generation unit 11 to the interface unit 105.

The auxiliary information acquisition unit 16 acquires auxiliary information from the auxiliary information management unit 91 via the interface unit 15. The auxiliary information acquisition unit 16 outputs an auxiliary information acquisition request to the auxiliary information management unit 91 in accordance with the timing when the recognition command is output from the command recognition unit 13, for example, and the auxiliary information management unit 91 outputs the auxiliary information. You may get it.

The state acquisition unit 17 acquires state information from the state information management unit 92 via the interface unit 15. For example, the status information acquisition unit 16 outputs a status information acquisition request to the status information management unit 92 according to the timing when the command recognition unit 13 outputs the recognition command or the timing when the command generation unit 11 receives the recognition command. , The state information may be acquired from the state information management unit 92.

The command transmission unit 18 transmits the execution command generated and output by the command generation unit 11 from the interface unit 15 to the control unit 90. It can also be transmitted to a device or device on the network 500 via the communication unit 102.

The control unit 19 controls each functional block in the command control unit 1. Note that, in FIG. 3, data may be exchanged (controlled) with a functional block that is not particularly connected to the control unit 19.

The voice analysis unit 121 performs frequency analysis (voice print analysis) on the voice data output from the voice detection unit 12, estimates the attributes of the voice source such as adults and children, age, and gender, and estimates the voice source. To get. The voice analysis unit 121 performs necessary processing on the voice source estimation result and outputs it to the auxiliary information acquisition unit 16 as auxiliary information. Further, the voice source estimation result obtained by the voice analysis unit 121 can also be used for whether or not to activate the command generation unit 11, the command recognition unit 13, the command transmission unit 18, and the like. According to the voice source estimation result, for example, when the user who emitted the voice is a child, the voice analysis unit 121 outputs the voice source estimation result to the control unit 19 in order to prevent the execution command from being output. May enable or disable the functions of the command generation unit 11, the command recognition unit 13, and the command transmission unit 18.

FIG. 4 is a diagram showing an example of a control target portion and a state of the control target portion that can be controlled by a voice command in the same embodiment.

From the left column, "NO", "control target part", "possible state value", and "voice command" are shown. The “control target portion” is a portion of the receiving device 10 that can be controlled by a voice command. The "possible state value" is the possible state of the "controlled part". The "voice command" is a control command uttered by the user when the state value is switched with respect to the "control target portion".

“NO” = 1 indicates that the “possible state value” of the main power supply unit 80, which is the “control target part” of the receiving device 10, is in two states, ON and OFF. In this case, the "voice command" for switching the state value is "power ON" when the state value is turned ON, and "power OFF" when the state value is turned OFF. That is, in order to turn on the power of the television device, the user utters "power ON", and in order to turn off the power of the television device, the user utters "power off".

“NO” = 2 indicates that the “possible state value” of the state switching unit 62 of the output control unit 60, which is the “control target part” of the receiving device 10, is in two states of ON and OFF. That is, in order to turn on the volume of the TV device and output the sound from the speaker unit 104, the user utters "volume ON" and turns off the volume of the TV device so that the sound is not output from the speaker unit 104. To (mute), the user says "volume off".

“NO” = 3 is a content output device in a state where digital content is output to the display unit 103 and the speaker unit 104. The content output device is a general term for a broadcast signal reception processing unit 20, a content processing unit 30, and a recording / playback unit 40. Specifically, the "tuner" in the "possible state value" column corresponds to the broadcast signal reception processing unit 20, the "net" corresponds to the content processing unit 30, and the "recorder" corresponds to the recording / playback unit 40. For example, in order to put the broadcast signal reception processing unit 20 in the receiving state and output the content by the broadcast signal to the display unit 103 and the speaker unit 104, the user utters "tuner". In order to put the content processing unit 30 in the receiving state and cause the display unit 103 and the speaker unit 104 to output the content from the content server device 200, the user utters "net". In order to put the recording / playback unit 40 in the playback state and output it to the display unit 103 and the speaker unit 104, the user utters "recorder".

“NO” = 4 is a tuner in which digital contents are output to the display unit 103 and the speaker unit 104. BS, CS, and terrestrial digital broadcasting of "possible state values" indicate tuners for BS digital broadcasting, CS digital broadcasting, and terrestrial digital television broadcasting (terrestrial digital broadcasting), respectively. For example, in order to set the BS digital broadcast in the receiving state and have the display unit 103 and the speaker unit 104 output the contents of the BS digital broadcast, the user utters "BS". In order to set the CS digital broadcast in the receiving state and have the display unit 103 and the speaker unit 104 output the contents of the CS digital broadcast, the user utters "CS". In order to receive the terrestrial digital broadcasting and have the display unit 103 and the speaker unit 104 output the contents of the terrestrial digital broadcasting, the user utters "terrestrial digital broadcasting".

“NO” = 5 is a channel (program) output by the content output device to the display unit 103 and the speaker unit 104. The "possible state values" 1ch, 2ch, and 3ch indicate channel numbers. For example, when 1ch is set to the receiving state and the display unit 103 and the speaker unit 104 output the 1ch program, the user utters "1ch". The same applies to other channels. It should be noted that the channel may usually be defined for each content output device and for each tuner. For example, when the content output device is the broadcast signal reception processing unit 20, channel numbers may be assigned to each of the tuners “BS”, “CS”, and “terrestrial digital”. Further, a unique channel number may be uniformly assigned to all channels of the content output device. In that case, the type of the content output device and the type of the tuner can be specified by the channel number.

In addition, it may have a state of "home (place to return)" as a "possible state value". "Home" is a state value that can be set by the user.

For example, in the example of NO3, a case where “tuner” is set as the “home” state value of the content output device which is the control target part will be described. For example, when the user is watching a program on the content output device "net", that is, when the current state of the content output device is "net", the user utters "net" as a voice command, and the command recognition unit It is assumed that "net" is recognized and generated as a recognition command in 13. When the recognition command is input, the command generation unit 11 generates and transmits an execution command "tuner" for switching the state to the "home" "tuner", and switches the content output device to the "tuner".

For example, in the example of NO4, a case where "terrestrial digital" is set as the "home" state value of the tuner which is the control target part will be described. For example, when the user is watching the tuner of "BS", that is, when the current state of the tuner is "BS", the user utters "BS" as a voice command, and the command recognition unit 13 uses it as a recognition command. It is assumed that "BS" is recognized and generated. When the recognition command is input, the command generation unit 11 generates and transmits an execution command "terrestrial digital" for switching the state to "terrestrial digital" which is "home", and switches the tuner to "terrestrial digital".

In the example of NO5, a case where “1ch” is set as the “home” state value of the channel which is the control target part will be described. For example, when the user is watching the channel of "2ch", that is, when the current state of the channel is "2ch", the user utters "2ch" as a voice command, and the command recognition unit 13 uses the recognition command. It is assumed that "2ch" is recognized and generated. When the recognition command is input, the command generation unit 11 generates and transmits an execution command "1ch" for switching the state to "1ch" which is "home", and switches the channel to "1ch".

The above-mentioned setting to the "home" state value may be set by the user, or the state value immediately before the power of the television device was turned off last time may be automatically set. In addition, there may be "home" as a voice command. For example, when the user utters a voice command as "home" and "home" is generated as a recognition command, the state may shift to the state value set as "home".

FIG. 5 is a diagram showing an example of auxiliary information that can be used in the same embodiment.

From the left column, "NO", "information source", "auxiliary information", and "information value" are shown. The "information source" is the source of the "auxiliary information" or the extraction source (extracted part) of the "auxiliary information". The "auxiliary information" is information used when the command control unit 1 creates an execution command in the present embodiment. The "information value" is the value of the "auxiliary information".

“NO” = 1 indicates that the time management unit 93 of the receiving device 10 which is the “information source” includes the time in the auxiliary information.

“NO” = 2 determines the attribute of the voice source from the voice print obtained by the voice analysis performed by the voice analysis unit 121 of the receiving device 10 which is the “information source”, and assists the attribute of the voice source. Indicates that it should be included in the information. The attributes of the voice source are, for example, the age of the source, the classification of adults and children defined by age, and the classification of infants, kindergarten children, elementary school students, junior high school students, high school students, university students, working adults, etc. defined by age. User identification information.

“NO” = 3 determines the user identification information from the voice recognition result obtained by the voice recognition performed by the command recognition unit 13 of the receiving device 10 which is the “information source”, and uses the attribute of the user identification information as auxiliary information. Indicates to include.

“NO” = 4, 5 and 6 are based on the voice strength, voice pitch and voice speed obtained by the voice analysis performed by the voice analysis unit 121 of the receiving device 10 which is the “information source”, respectively. It is shown that the strength of the voice, the pitch of the voice, and the slowness of the voice are provided as auxiliary information, respectively.

“NO” = 7 means that the sensor unit 70 (for example, a camera) of the receiving device 10 which is the “information source” determines the user identification information from the image recognition result acquired by the camera, and the attribute of the user identification information is supplementary information. Indicates that it should be included in.

"NO" = 8 to 11 are "broadcaster", "program broadcast time zone", "program type", respectively, extracted from the broadcast signal by the broadcast signal reception processing unit 20 of the receiving device 10 which is the "information source". Indicates that the "program name" should be included in the auxiliary information. In the case of "broadcasting company", for example, the name of a company such as company A, company B, or company C is used as the value of the auxiliary information. In the case of "program broadcasting time zone", the broadcasting time zone is used as the value of the auxiliary information. In the case of "program type", the value of the auxiliary information is, for example, the type of program such as drama, sports, music, news, education, and emergency information. In the case of "program name", for example, the name of a program such as program A, program B, or program C is used as the value of the auxiliary information.

“NO” = 12 includes the demogra obtained from the analysis result provided by the viewing analysis device 300, which is the “information source”, in the information assistance.

“NO” = 13 to 16 are “broadcasting business” extracted from the broadcast wave when the recording / playback unit 20 (including an external recorder) of the receiving device 10 which is the “information source” records the program. It indicates that "person", "program broadcast time zone", "program type", and "program name" are included in the auxiliary information.

"NO" = 17 to 20 are "distributor", "program broadcasting time zone", and "program" extracted from the information associated with the content transmitted by the content server device 200 of the receiving device 10 which is the "information source", respectively. Indicates that "type" and "program name" should be included in the auxiliary information. In addition, the user who recorded the digital content (particularly referred to as a recording manager) may be included in the auxiliary information.

(First Embodiment)
In the present embodiment, an operation example in which the ON-OFF of the main power supply of the receiving device is controlled based on the voice command issued by the user and the additional information will be described.

FIG. 6 is a flowchart showing an example of processing operation for the command control unit to receive a voice command and transmit an execution command in the same embodiment.

It is assumed that the user issues a voice command "power ON" or "power OFF" in order to control ON-OFF of the main power of the receiving device 10. The voice detection unit detects the voice (YES in step S11). If the voice detection unit does not detect the voice, wait until it is detected (NO in step S11). To determine whether the voice detector detects or does not detect voice, for example, a threshold is set for the intensity of the input voice, and if it is equal to or more than the threshold, it is determined that the voice is detected, and if it is less than the threshold It may be determined that the voice is not detected.

The voice detection unit 12 outputs the voice data of the received voice to the voice analysis unit 121, and the voice analysis unit 121 performs voice analysis processing on the received voice data (step S12). Specifically, the voice analysis unit 121 performs frequency analysis (voiceprint analysis) on the voice data and estimates the attributes of the voice transmission source.

When the voice analysis unit 121 outputs the estimation result to the control unit 19, the control unit 19 determines whether or not to generate a recognition command from the estimation result (step S13). The user may set the rules for determining whether or not to generate the recognition command from the user interface unit 14 to, for example, the storage unit 111. The control unit 19 accesses the storage unit 111 and refers to the determination rule for generating the recognition command. When the control unit 19 determines that the recognition command is to be generated, the control unit 19 causes the command recognition unit 13 to execute voice recognition for the voice data (YES in step S13). When the control unit 19 determines that the recognition command is not generated, the control unit 19 controls the command recognition unit 13 so as not to recognize the voice data, and causes the command recognition unit 13 to wait until the next voice is detected. (NO in step S13, S11). When the control unit 19 determines that the recognition command is not generated, for example, the control unit 19 outputs a message such as "The recognition command was not generated" to the display unit 103 or the speaker unit 104 to notify the user. But it may be.

When the command recognition unit 13 is instructed to generate a recognition command by the control unit 19, the command recognition unit 13 obtains the recognition command as text data by voice recognition. The command recognition unit 13 outputs the recognition command to the command generation unit 11 (step S14). In step S14, the command recognition unit 13 first attempts to acquire a recognition command with the voice recognition engine provided in the command recognition unit 13, and when the voice recognition fails and is not acquired, the recognition rate of voice recognition is higher. The recognition command may be acquired by using an external voice recognition device 400.

When the command generation unit 11 receives the recognition command from the command recognition unit 13, the command generation unit 11 refers to the condition combination list of the storage unit 111.

FIG. 7 is a diagram showing an example of an execution command generation condition (combination condition list) set in the command control unit to control the main power supply in the same embodiment.

In the example of the combination condition list, "NO", "execution command", "recognition command", "state information", and "auxiliary information" are shown from the left column. It indicates that the "execution command" described in the same line is determined on the condition of the "recognition command", the "state information", and the "auxiliary information" described in each line. The "recognition command" is a recognition command generated and output by the command recognition unit 13. The combination condition list may be set by the user from the user interface unit 14 to the storage unit 111, for example. The combination condition list shown in FIG. 7 is an example, and the number of auxiliary information (number of columns) can be further added.

Returning to FIG. 6, the processing operation of the command control unit 1 will be described. When, for example, "power ON" is input as a "recognition command" from the command recognition unit 13, the command generation unit 11 refers to the combination condition list and selects the column items of the list, "auxiliary information" and "state information". The acquisition is instructed to the auxiliary information acquisition unit 16 and the status information acquisition unit 17, respectively. The auxiliary information acquisition unit 16 requests and acquires the auxiliary information items “time”, “voice strength”, and “user identification information” of the combination condition list from the auxiliary information management unit 91, and the command generation unit 11 Is output to (step S15). Since the "recognition command" is "power ON", the status information acquisition unit 17 grasps that the control target is the main power supply 80, and acquires the status information of the main power supply 80 from the status information management unit 92. , Output to the command generation unit 11 (step S16).

The command generation unit 11 refers to the combination condition list and searches for a line in which the acquired auxiliary information, the state information, and the recognition command match the combination of the conditions in the combination condition list. If there is a command in the "execution command" item on the line that matches the combination of conditions, the command described in the "execution command" item is generated as an execution command and output to the command transmission unit 18 (step S17). , S18 YES, S19). On the other hand, for example, when the item of the "execution command" that matches the combination of conditions is "no transmission" as in NO7 of FIG. 7, the execution command is not generated and the command control unit 1 is next. Wait for the voice of (NO in steps S17 and S18) to be detected. When the execution command is "no transmission", the command control unit 1 may send a message including the meaning "the execution command was not transmitted or generated" to the control unit 90. The control unit 90 that has received the message may notify the user by displaying the message on the display unit 103 or outputting the voice including the message content from the speaker unit 104.

Further, when the item of the "execution command" that matches the combination of conditions is "no transmission", the command control unit 1 may generate and transmit the "execution command for maintaining the current state". For example, as a result of voice print analysis of a voice command by the voice analysis unit 121, when auxiliary information in which the voice source is "child" is input to the command generation unit 11 as user identification information, the auxiliary information is not used without using the recognition command. It is also possible to generate and send an "execution command for maintaining the current state" using only the information. In this case, the command generation unit 11 may send a message including a meaning such as "the operation cannot be performed" to the control unit 90. At that time, the control unit 90 that has received the message may display the message on the display unit 103 or output the voice including the message content from the speaker unit 104 to notify the user.

When the execution command is input, the command transmission unit 18 transmits the execution command to the control unit 90 via the interface unit 15 (step S101). The control unit 90 controls the function to be controlled according to the received execution command.

When the command control unit 1 generates or transmits an execution command, the command control unit 1 may transmit a message including the content "the execution command has been transmitted" to the control unit 90. Further, the command control unit 1 may send a message including the content "the execution command is different from the recognition command" to the control unit 90 when the recognition command and the generated execution command are different. The command control unit 1 may notify the user by displaying a message on the display unit 103 or outputting a voice including the message content from the speaker unit 104. By doing so, the user can confirm whether the voice command issued by the user is correctly executed.

Again, with reference to FIG. 7, the combination condition list will be described in detail.

When "NO" = 1, all the auxiliary information is "-", which indicates that the auxiliary information is not used, and the command generation unit 11 generates an execution command only with the state information and the recognition command. Is. In the example of "NO" = 1, when the "recognition command" is "power ON" and the "state information" is "ON", the execution command is "power OFF". Since the same applies to "NO" = 2 to 4, the description thereof will be omitted.

When "NO" = 5, the "recognition command" is "power ON", the "state information" is "ON", and the first "auxiliary information" "time" is "day". Second, when the second "auxiliary information" "voice strength" is "strong", the execution command is "no transmission (or no generation)". Here, the value of "time" which is "auxiliary information" is set to "day". For example, the auxiliary information acquisition unit 16 has a correspondence relationship between the time and the time classification value (morning, noon, night). The corresponding time classification value may be determined from the "time" acquired by the auxiliary information acquisition unit 16, and the time classification value (in the case of NO = 5, noon) may be output to the command generation unit 11. The same applies to the second "auxiliary information", "voice strength". For example, the auxiliary information acquisition unit 16 has a correspondence relationship between the “voice intensity” input from the voice analysis unit 121 and the intensity classification (strong, weak), and the auxiliary information acquisition unit 16 receives the “voice intensity”. ], The corresponding strength classification value may be determined, and the strength classification value (strong when NO = 5) may be output to the command generation unit 11. Since the same applies to "NO" = 6 to 12, the description thereof will be omitted. By using "time" and "voice strength" as auxiliary information, such as "NO" = 5 to 12, the ambient noise becomes louder during the "daytime" time zone, so voice recognition The execution command can be generated in consideration of the situation where the accuracy of the engine deteriorates and the recognition command differs from the user's voice command.

When "NO" = 13, the "recognition command" is "power ON", the "state information" is "ON", and the first "auxiliary information" "time" is "night". Second, when the second "auxiliary information" "user identification information" is "adult", the execution command is "power off". Similar to "NO" = 5, for example, when the voice analysis unit 121 inputs the age of the source of the voice command by voice print analysis to the auxiliary information acquisition unit 16, the correspondence between the age and the age classification value (adult, child). Therefore, the corresponding age classification value may be determined from the "age" received by the auxiliary information acquisition unit 16 and the age classification value (adult in the case of NO = 13) may be output to the command generation unit 11. Since the same applies to "NO" = 14 to 20, the description thereof will be omitted. By using "time" and "user identification information" as auxiliary information such as "NO" = 13 to 20, the ambient noise is small during the "night" time zone, so the voice recognition engine Although the accuracy does not deteriorate, "night" can be used when the user wants to restrict the generation and transmission of execution commands.

As described above, according to the procedure of the flowchart of FIG. 6, it is possible to generate an execution command using the condition combination list according to FIG.

When the condition of "NO" = 1 in the condition combination list shown in FIG. 7 is applied, the current state (corresponding to "state information") of the main power supply is "ON". Normally, in such a situation, the user is less likely to issue a voice command of "power ON", and conversely, is more likely to issue a voice command of "power OFF" which is the opposite of the current state "ON". Conceivable. However, when the voice command of "power off" is recognized as "power on" by the voice recognition engine of the command recognition unit 13 due to ambient noise or the like, the user says "power off". , A situation occurs in which the main power supply of the receiving device 10 cannot be turned off, and the stress on the user becomes great. However, according to the present embodiment, the command control unit 1 interprets the recognition command based on the state information of the receiving device 10 by using the condition of "NO" = 1 in the condition combination list. It is possible to prevent the situation. Similarly, when "NO" = 2 to 4 of the condition combination list is applied to the command control unit 1, it is recognized when the recognition command is a control command for switching the current state ("state information") of the main power supply. Match the control instructions of the command and the execution command. On the contrary, when the recognition command is a control command to the same state as the "state information", the control command of the execution command is the opposite of or different from the recognition command. The background to such operation is that there is a high possibility that the voice recognition engine makes a mistake in recognizing ON and OFF voices. In the present embodiment, considering that the user rarely issues a voice command so that the current state of the controlled object and the state after the control are the same, the interpretation of the voice command by voice recognition is supported. Make it possible.

In the condition combination list of FIG. 7 in the present embodiment, the condition combinations for determining the execution command are shown in NO1 to NO20, and priority is given to these to give priority to the command generation unit 11. It is also possible to refer to the condition combination list in consideration of. Priority may be given in the line order from NO1 to NO20 as shown in FIG. In this case, even if the command generation unit 11 acquires the auxiliary information, the auxiliary information is not used because NO1 to NO4 have priority. Further, a column item indicating the priority may be added to the list of FIG. 7 so that the user can set the priority for the condition combination of each row.

Further, when there are a plurality of "auxiliary information", priority may be given within the "auxiliary information". For example, in the combination condition list of FIG. 7, the auxiliary information is given higher priority in the order of, for example, "time", "voice strength", and "user identification information". In this case, the command generation unit 11 refers to, for example, from the condition combination containing the auxiliary information having high priority in the combination condition list. Specifically, the auxiliary information gives the highest priority to the condition combination of only "time", then gives the priority to the condition combination of only "time" and "voice strength", and then gives priority. The user may be set to give priority to the condition combination of only "time" and "user identification information".

In addition, by setting points indicating priority in "time", "voice strength", and "user identification information", the user sets the points to be given to "time", "voice strength", and "user identification information". It is also possible to have the command generation unit 11 calculate the sum of the points obtained, and give priority to each combination condition list by, for example, raising the priority separately from the one with the highest sum of points. In this case, since the command generation unit 11 can calculate the priority, the user only needs to set a score indicating the priority for the "time", "voice strength", and "user identification information".

Basically, it is desirable to set the condition combinations shown in the combination condition list so that there are no combinations that have the same conditions. If there are combinations that satisfy the same conditions, the command generation unit 11 may decide in advance a rule such as selecting in the order of the list.

(Second embodiment)
In the present embodiment, the ON-OFF of the volume output by the speaker unit 104 of the receiving device 10 is controlled by using the voice command issued by the user, the state information, and the program type and voice strength as auxiliary information. An operation example of the command control unit 1 is shown below. In this embodiment, it is assumed that the main power supply is in the ON state.

FIG. 8 is a diagram showing an example of an execution command generation condition set in the command control unit in order to control the volume in the second embodiment. An example of the processing operation for the command control unit 1 to receive the voice command and transmit the execution command in the present embodiment will be described with reference to FIG. 6, but the same parts as those in the first embodiment will be described. The explanation is omitted.

It is assumed that the user issues a voice command "volume ON" or "volume OFF" in order to control ON-OFF of the volume output of the speaker unit 104 of the receiving device 10. The voice detection unit detects the voice (YES in step S11). As a result of the voice analysis process, the control unit 19 determines that a recognition command is generated, and causes the command recognition unit 13 to execute voice recognition for the voice data (YES in step S13). The command recognition unit 13 obtains the recognition command as text data by voice recognition and outputs the recognition command to the command generation unit 11 (step S14).

When the command generation unit 11 receives the recognition command from the command recognition unit 13, the command generation unit 11 refers to the condition combination list of the storage unit 111. When "volume ON" is input as a "recognition command" from the command recognition unit 13, the command generation unit 11 refers to the combination condition list and acquires "auxiliary information" and "state information" which are column items of the list. To the auxiliary information acquisition unit 16 and the state information acquisition unit 17, respectively. The auxiliary information acquisition unit 16 requests the auxiliary information management unit 91 for "program type" and "voice strength", which are items of auxiliary information in the combination condition list, acquires them, and outputs them to the command generation unit 11 (step). S15). Since the "recognition command" is "volume ON", the state information acquisition unit 17 grasps that the control target is the main power supply 80, acquires the state information of the speaker unit 104 from the state information management unit 92, and commands. Output to the generation unit 11 (step S16).

The command generation unit 11 refers to the combination condition list, and if there is a command in the "execution command" item of the line where the combination of the acquired auxiliary information, the state information, and the recognition command matches, the command generation unit 11 "execute command". The command described in the item "" is generated as an execution command and output to the command transmission unit 18 (YES, S19 in steps S17 and S18). On the other hand, when the item of "execution command" is "no transmission", the execution command is not generated and the command control unit 1 waits for the next voice to be detected (NO in steps S17 and S18). ). When the execution command is input, the command transmission unit 18 transmits the execution command from the interface unit 15 to the control unit 90 (step S101).

The combination condition list will be described in detail with reference to FIG.

When "NO" = 1, since the "state information" is "ON", it indicates that the "volume" is currently in the output state. In the condition combination of "NO" = 1, the "recognition command" is "volume ON", the first "auxiliary information" "program type" is "emergency information", and the second "auxiliary information". This is an example in which the command generation unit 11 generates "no transmission (or no generation)" as an execution command when the "information" "voice strength" is "-" (no condition). Since the same applies to "NO" = 2 to 4, the description thereof will be omitted. When "program type" is used as auxiliary information such as "NO" = 1 to 4, and the "program type" is "emergency information", a request is made to turn on the volume in all situations. Can be considered. For example, if an earthquake or the like occurs while the broadcast signal reception processing unit 20 is receiving a broadcast signal, or if the volume is turned off by chance, the user immediately makes a voice command of "volume ON" to turn the volume ON. Is output. However, in an emergency such as an earthquake, ambient noise is expected to increase, and there is a high possibility that voice commands issued by the user will be erroneously recognized. In such a case, when "emergency information" is acquired as the "program type" of the auxiliary information acquired by the auxiliary information acquisition unit 16, the command generation unit 11 receives the received "recognition command" and the "state information" to be controlled. Always turn on the volume regardless.

"NO" = 5 to 12 are examples in which "user identification information" is used as auxiliary information. For example, when a child wants to avoid viewing digital contents on the receiving device 10 during a daytime or the like, a combination of conditions such as "NO" = 5 to 12 can be used.

As described above, by setting the combination condition list by the user as in the present embodiment, it is possible to control commands for voice commands assuming various use cases.

(Third Embodiment)
In the present embodiment, the receiving device 10 outputs digital contents to the display unit 103 and the speaker unit 104 by using the voice command issued by the user, the state information, and the user identification information and the time as auxiliary information. An operation example of the command control unit 1 in the case of control is shown. In this embodiment, it is assumed that the main power supply is in the ON state. Further, in the present embodiment, an example of outputting two execution commands for one voice command is shown.

FIG. 9 is a diagram showing an example of execution command generation conditions set in the command control unit in order to control digital content reception in the third embodiment.

An example of processing operation for the command control unit 1 in the present embodiment to receive a voice command and transmit an execution command will be described with reference to the flowchart of FIG. 6, but the same portion as in the first embodiment will be described. Omits the description.

It is assumed that the user issues one of the voice commands "net", "tuner", or "recorder" in order to control the output of digital contents to the display unit 103 and the speaker unit 104 of the receiving device 10. The voice detection unit detects the voice (YES in step S11). Through steps S12 and S13, the command recognition unit 13 obtains the recognition command as text data by voice recognition and outputs the recognition command to the command generation unit 11 (step S14).

When the "recognition command" is input from the command recognition unit 13, the command generation unit 11 refers to the condition combination list of the storage unit 111 and acquires "auxiliary information" and "state information" which are column items of the list. To the auxiliary information acquisition unit 16 and the state information acquisition unit 17, respectively. The auxiliary information acquisition unit 16 requests the auxiliary information management unit 91 for "user identification information" and "time", which are the items of the auxiliary information in the combination condition list, acquires them, and outputs them to the command generation unit 11 (step S15). .. The state information acquisition unit 17 grasps that the control target is the content output device from the “recognition command”, acquires the state information of the speaker unit 104 from the state information management unit 92, and outputs it to the command generation unit 11 (step). S16).

The command generation unit 11 generates an execution command from step 17 through S19 and outputs the execution command to the command transmission unit 18. The command transmission unit 18 transmits an execution command to the control unit 90 (step S101). In this embodiment, two execution commands are generated. It is a first execution command for the content output device and a second execution command for the program type.

The combination condition list will be described in detail with reference to FIG.

When "NO" = 1, since the "state information" of the content output device is the "tuner", it indicates that the "tuner" is currently outputting to the display unit 103 and the speaker unit 104. In the condition combination of "NO" = 1, when the recognition command received by the command generation unit 11 is "net" and the user identification information which is the first auxiliary information is "adult", the command generation unit 11 This is an example of generating an execution command for outputting to the display unit 103 and the speaker unit 104 from the "net" which is one of the content output devices. Since the same applies to "NO" = 2 and 3, the description thereof will be omitted.

When "NO" = 4, since the "state information" of the content output device is the "tuner", it indicates that the "tuner" is currently outputting to the display unit 103 and the speaker unit 104. In the condition combination of "NO" = 4, the recognition command received by the command generation unit 11 is "net", the user identification information which is the first auxiliary information is "child", and the second auxiliary information. This is an example in which the command generation unit 11 does not generate or transmit an execution command in order to prevent output from the "net", which is one of the content output devices, to the display unit 103 and the speaker unit 104 when the time is "daytime". .. The case of "NO" = 4 can be used, for example, when a child wants to avoid viewing digital contents from the "net" on the receiving device 10 during a daytime time zone or the like.

Further, when "NO" = 9, since the "state information" of the content output device is the "recorder", it indicates that the "recorder" is currently outputting to the display unit 103 and the speaker unit 104. In the condition combination of "NO" = 9, the recognition command received by the command generation unit 11 is "net", the user identification information which is the first auxiliary information is "child", and the second auxiliary information. When the time is "night", the command generation unit 11 generates two execution commands, "net" and "education", which is an execution command for the program type. The two generated execution commands are transmitted from the command transmission unit 18 to the control unit 90, and the program related to "education" distributed by the "net" is output to the display unit 103 and the speaker unit 104. The case of "NO" = 9 is, for example, a case where a child wants to watch digital contents whose program type is "education" when he / she tries to watch the "net" with the receiving device 10 at night time. Can be used for.

Further, for example, when the user is watching the BS, that is, when the state information of the controlled target portion “tuner” is “BS”, the user utters “BS” as a voice command, and the command recognition unit 13 , It is assumed that "BS" is generated as a recognition command and output to the command generation unit 11. When the recognition command is input, the command generation unit 11 generates and transmits an execution command "terrestrial digital" that switches to the state value (referred to as "terrestrial digital") set in the "home" of the controlled target part "tuner". To do. The control unit 90 receives the execution command "terrestrial digital" and switches the tuner to "terrestrial digital". At this time, for the channel (program) to be output to the display unit 103 and the speaker 104, the state value of "home" set in the "channel (program)" which is the control target part may be selected. That is, in the case of this example, the command generation unit 11 has a plurality of "tuners" and "channels (programs)" for voice commands (or recognition commands that recognize them) for one controlled target portion issued by the user. Generates an execution command for the controlled part of. The "home" set for the "channel (program)" may be, for example, a channel that was viewed immediately before the power of the television device was turned off last time, or a channel preset by the user. Further, the execution commands for different target control parts may not be divided into one execution command.

As described above, as in the present embodiment, the user can set a combination condition list to generate, transmit, and execute a plurality of execution commands from one voice command.

(Fourth Embodiment)
In this embodiment, an example of a system in which the command control unit 1 is used as one independent device is shown.

FIG. 10 is a diagram showing a configuration example of the entire system according to the third embodiment.
The command control device 2 and the IoT devices 600A and 600B are connected to the network 500. When the IoT devices 600A and 600B have the same functions and the two are not particularly distinguished, the IoT devices 600A and 600B are referred to as IoT devices 600. Although only two IoT devices 600 are shown in FIG. 10, there may be many.

The command control device 2 is built on a computer having, for example, a CPU and a memory. The command control device 2 may be a personal computer or a cloud service including a server, a database, and the like. The command control device 2 includes a command recognition unit 1 and a communication unit 102A. The command recognition unit 1 and the communication unit 102A correspond to the functions of the command recognition unit 1 and the communication unit 102 in FIG. 3, respectively.

The IoT device 600 is an IoT device of all kinds, is connected to the network 100, and performs data communication with the device on the network 100. The IoT device 600 may be, for example, sensors such as a temperature detection sensor, a water leak detection sensor, a door open / close sensor, or a detection device using these sensors. Further, the IoT device 600 may be a home appliance such as an air conditioner, a television device, a lighting, and a camera. Further, as long as it is connected to the network 100, a mobile terminal such as a smartphone may be used. The IoT device 600 in the present embodiment provides auxiliary information and status information to the command control device 2, receives an execution command output by the command control device 2, and functions of the IoT device 600 according to the received execution command. To control.

Specifically, the IoT device 600 includes an auxiliary information output unit 21A, a state switching unit 22A, a control unit 90A, an auxiliary information management unit 91A, a state information management unit 92A, a communication unit 102A, and an interface unit 105A. Each function corresponds to the functions of the auxiliary information output unit 21, the state switching unit 82, the control unit 90, the auxiliary information management unit 91, the state information management unit 92, the communication unit 102, and the interface unit 105 in FIG.

That is, it can be said that each function of FIG. 2 is assigned to the command control device 2 and the IoT device 600A. The major difference between the receiving device 10 shown in the first embodiment and the IoT device 600 shown in the present embodiment is that the receiving device 10 has a command control unit 1 inside, but the IoT device 600 has a command control unit 1. The command control unit 1 is not provided. In the present embodiment, the command control unit 1 is provided in the command control device 2, and the IoT device 600 receives an execution command from the command control device 2 via the network 500.

The controlled target portion of the IoT device 600 that can be controlled by the command control device 2 may be, for example, the power supply (ON-OFF) shown in the first to third embodiments, and other controls for starting and stopping the functional portion. You may do it.

The flowchart of FIG. 6 can be used for the procedure in which the command control device 2 transmits an execution command to the IoT device 600. Detailed description of the procedure similar to that of the first embodiment and the second embodiment will be omitted.

The user is near the command control device 2 and remotely controls the IoT device 600A via the network 500. The user sets the execution command generation condition (combination condition list) for the IoT device 600A in the command control unit 1 of the command control device 2.

It is assumed that the user issues a voice command to the voice detection unit 12 of the command control device 2 in order to control the function of the IoT device 600A. The voice detection unit 12 detects the voice, and after the voice analysis process by the voice analysis unit 121, the command recognition unit 13 generates a recognition command and outputs the recognition command to the command generation unit 11 (YES in step S11, S12). , S13 YES, S14).

When a recognition command is input from the command recognition unit 13, the command generation unit 11 refers to the combination condition list and acquires the column items "auxiliary information" and "state information" of the list, respectively. To the status information acquisition unit 17. The auxiliary information acquisition unit 16 requests various items of auxiliary information in the combination condition list from the auxiliary information management unit 91A, acquires them, and outputs them to the command generation unit 11 (step S15). Step S15 in this embodiment will be described in detail.

The auxiliary information acquisition unit 16 requests auxiliary information from the IoT device 600A via the communication unit 102A. In the IoT device 600A, the control unit 90A receives the request for auxiliary information via the communication unit 102A2. The control unit 90A acquires auxiliary information from the auxiliary information management unit 91A, and transmits the acquired auxiliary information to the command control device 2 via the communication unit 102A2.

The state information acquisition unit 17 grasps the control target from the recognition command, and requests the IoT device 600A for the state information of the control target via the communication unit 102A. In the IoT device 600A, the control unit 90A receives a request for status information via the communication unit 102A2. The control unit 90A acquires the state information from the state information management unit 92A, and transmits the acquired state information to the command control device 2 via the communication unit 102A2. In the command control device 2, the command generation unit 11 receives the state information via the communication unit 102A2 (step S16).

The command generation unit 11 refers to the combination condition list, and if there is a command in the "execution command" item of the condition in which the combination of the acquired auxiliary information, the state information, and the recognition command matches, the command generation unit 11 "execute command". The command described in the item "" is generated as an execution command and output to the command transmission unit 18 (YES, S19 in steps S17 and S18).
On the other hand, when the item of "execution command" is "no transmission", the execution command is not generated and the command control unit 1 waits for the next voice to be detected (NO in steps S17 and S18). ). In this case, the command control unit 1 sends a message including the meaning of "the execution command was not sent or generated" such as "no command transmission" on the display unit (not shown) of the command control device 2. The user may be notified by displaying the command or outputting a voice including a message content from a speaker unit (not shown) of the command control device 2.

The command transmission unit 18 transmits the input execution command to the IoT device 600A via the communication unit 102A (step S101). The IoT device 600A controls the control function according to the received execution command. When the command control unit 1 generates or transmits an execution command, the command control unit 1 displays a message including the meaning of "the execution command has been transmitted" on a display unit (not shown) of the command control device 2, or commands control. The user may be notified by outputting a voice including a message content from a speaker unit (not shown) of the device 2. Further, when the recognition command and the generated execution command are different, the command control device 2 sends a message including the content "the execution command is different from the recognition command" on the display unit (not shown) of the command control device 2. The user may be notified by displaying the command or outputting a voice including a message content from a speaker unit (not shown) of the command control device 2. By doing so, the user can confirm whether or not the intention of the voice command issued by the user is correctly executed.

According to the above procedure, when the user issues a voice command to the command control device 2 connected to the network 500, the IoT device 600 connected to the network 500 can be controlled by the execution command.

According to at least one embodiment described above, it is possible to provide a command generation device, a generation method, and a generation program that support voice recognition for voice commands.

In the above embodiment, an example in which the functions of the control unit 90 (including the auxiliary information management unit 91 and the state information management unit 92) are installed on the receiving device 10 and the IoT device 600, which are the controlled target devices, has been shown. , All or part of the functions of the control unit 90 may be an external control device to be controlled. In this case, the control device is also connected to the network 500. Similarly, with respect to the command control device, various configurations and combinations can be considered for the functions in the device and the hardware on which the functions are executed, and the present invention is not limited to the examples of the embodiments shown above.
(Modification example)
In this modification, for example, by using the "user identification information" and "time zone" of FIG. 5 as auxiliary information, parental control such as viewing restriction and operation restriction of children can be enabled. An example is shown. It is assumed that adults manage remote controls for operating TV devices.

Specifically, when a child issues a voice command, voiceprint analysis is performed by the voice analysis unit 121, "child" is acquired as user identification information by the auxiliary information acquisition unit 16, and is input to the command generation unit 11. To do. At the same time, it is assumed that the voice command is input to the command recognition unit 13, the recognition command is generated, and the voice command is input to the command generation unit 11. The command generation unit 11 generates, for example, "power OFF" as an execution command based on the recognition command "power OFF" and the auxiliary information "child", and outputs it to the control unit 90. On the other hand, it is assumed that the command generation unit 11 acquires "child" as the user identification information from the auxiliary information acquisition unit 16 and acquires "midnight" as the time zone. In this case, the command generation unit 11 may generate, for example, an "execution command for maintaining the current state" from only the auxiliary information of "child" and "midnight".

Although not shown in FIG. 5, parrent control is also possible by using "program viewing target" as auxiliary information. For example, it is assumed that the command recognition unit 13 recognizes that the controlled target portion is a "channel (program)" by a voice command issued by a child. When the command recognition unit 13 outputs the recognition information including the recognized control target part to the auxiliary information acquisition unit 16, the auxiliary information acquisition unit 16 receives the auxiliary information for the control target part "channel (program)" included in the recognition information. The "program viewing target" is acquired from the broadcast signal reception processing unit 20 and the like, and is output to the command generation unit 11. The command generation unit 11 generates an execution command based on two auxiliary information of the user identification information "child" and "program viewing target" obtained from the voice analysis unit 121. For example, when the program viewing target includes "children", the recognition command is generated as it is as an execution command. If the program viewing target does not include the "child", for example, an "execution command for maintaining the current state" is generated.

As described above, according to this modification, parrent control for voice commands is possible. Further, according to this modification, it is possible to generate an execution command from only the auxiliary information acquired based on the voice command without using the recognition command among the recognition command, the state information, and the auxiliary information.

According to at least one embodiment and modification described above, it is possible to provide a command control device, a control method, and a control program that support voice recognition for voice commands.

The above-mentioned device can also be described as follows.
(A-1)
The operation control information (recognition command) is acquired from the input voice (voice command), and the operation state of the controlled device (receiver device 10) is set to either the first mode or the second mode different from the first mode. An electronic device (command control unit 1 or command control device 2) including an operation control means (command generation unit 11) for setting the operation state.
The operating state of the controlled device is the first mode, and
An electronic device that sets the operating state as the second mode when the operation control information relates to the operating state in the first mode.
(A-2)
The electronic device according to (A-1), which acquires operating state information (state information) relating to the state of a controlled target portion of the controlled target device.
(A-3)
The electronic device according to (A-1) or (A-2), which acquires control condition information (auxiliary information) different from the operation control information and the operation state information.
(A-4)
The control condition information is set based on at least one of a group of time zone, user identification information, user attribute, received content information, broadcaster, distributor, and recorded content manager (A-). The electronic device according to 3).
(A-5)
The operation control information (recognition command) is acquired from the input voice (voice command), and the operation state of the controlled device (receiver device 10) is set to either the first mode or the second mode different from the first mode. It is a program that causes a computer to execute the operation state.
The operating state of the controlled device is the first mode, and
The above-mentioned program that sets the operation state as the second mode when the operation control information relates to the operation state in the first mode.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof. Furthermore, in each of the constituent elements of the claim, even if the constituent elements are divided and expressed, a plurality of the constituent elements are expressed together, or a combination thereof is expressed, it is within the scope of the present invention. Further, a plurality of embodiments may be combined, and examples composed of these combinations are also within the scope of the invention.

Further, in order to clarify the explanation, the drawings may be schematically represented by the width, thickness, shape, etc. of each part as compared with the actual embodiment. In the block diagram, data and signals may be exchanged between blocks that are not connected, or even if they are connected but in a direction in which an arrow is not shown. Each function shown in the block diagram and the processing shown in the flowchart and the sequence chart may be realized by hardware (IC chip or the like) or software (program or the like) or a combination of hardware and software. Further, the apparatus of the present invention is applied even when the claim is expressed as a control logic, when it is expressed as a program including an instruction for executing a computer, and when it is expressed as a computer-readable recording medium in which the instruction is described. is there. Further, the names and terms used are not limited, and other expressions are included in the present invention as long as they have substantially the same contents and the same purpose.

1 ... Command control unit, 2 ... Command control device, 10 ... Receiver device, 11 ... Command generation unit, 12 ... Voice detection unit, 13 ... Command recognition unit, 14 ... User interface unit, 15 ... Interface unit, 16 ... Auxiliary information Acquisition unit, 17 ... Status information acquisition unit, 18 ... Command transmission unit, 19 ... Control unit, 20 ... Broadcast signal reception processing unit, 21 ... Auxiliary information output unit, 30 ... Content processing unit, 31 ... Auxiliary information output unit, 40 ... Recording / playback unit, 41 ... Auxiliary information output unit, 50 ... Equipment data generation unit, 51 ... Auxiliary information output unit, 60 ... Output control unit, 62 ... State switching unit, 70 ... Sensor unit, 71 ... Auxiliary information output unit, 80 ... Main power supply unit, 82 ... State switching unit, 90 ... Control unit, 91 ... Auxiliary information management unit, 92 ... Status information management unit, 93 ... Time management unit, 100 ... Remote control, 101 ... Antenna, 102 ... Communication unit, 103 ... Display unit, 104 ... Speaker unit, 105 ... Interface unit, 111 ... Storage unit, 121 ... Voice analysis unit, 200 ... Content server device, 300 ... Viewing analysis device, 400 ... Voice recognition device, 500 ... Network.

Claims (10)

In a command control device that generates an execution command including a control command for a controlled object based on the input voice.
It is characterized in that an execution command including one of a first control command included in the recognition command obtained by voice recognition of the voice and a second control command different from the first control command is generated. Command controller. The command control device according to claim 1, wherein the recognition command and the execution command are generated based on the additional information. The command control device according to claim 2, wherein the recognition command and the command control device according to claim 2 determine whether or not to generate the execution command based on the additional information. The command control device according to claim 2, wherein the presence / absence of transmission of the execution command is determined based on the recognition command and the additional information. The command control device according to any one of claims 2 to 4, wherein the additional information includes state information which is a control state of the control target controlled by the execution command. The command control device according to any one of claims 2 to 4, wherein the additional information includes auxiliary information that is not a control state of the control target. The additional information according to any one of claims 2 to 4, which includes state information that is a control state of the control target controlled by the execution command and auxiliary information that is not the control state of the control target. Command controller. A voice recognition unit that recognizes the voice and obtains the recognition command,
Additional information acquisition means for obtaining the additional information,
A storage means for storing the correspondence between the recognition command, the additional information, and the execution command.
The command control device according to claim 2, further comprising an execution command generating means for generating the execution command from the correspondence. In a command control method that generates an execution command including a control command for a controlled device based on the input voice,
A command characterized by generating an execution command including one of a first control command included in the recognition command obtained by recognizing the voice and a second control command different from the first control command. Control method. In a control program in which a computer generates an execution command including a control command for a controlled device based on an input voice.
A control program that generates an execution command including one of a first control command included in the recognition command obtained by recognizing the voice and a second control command different from the first control command.

Images