JP2020095737A - Communication apparatus, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate the troublesomeness of a user thinking about which device he / she wants to operate. SOLUTION: A control means for controlling the operation of the entire communication device, a communication means for communicating with another communication device, and device information of a collaborating partner capable of communicating by the communication means are held and the control is performed. It is provided with a storage means for storing a program operated by the means in a storage unit, a voice input means for receiving voice input from a user, and a voice analysis means for analyzing the voice received by the voice input means and extracting a voice command. When a voice command is extracted by the voice analysis means, the control means may cooperate with each other through the communication means based on the device information of the cooperation partner stored in the storage unit. The state of each communication device is exchanged with the communication device of the above, and the communication device that responds to the voice command is determined based on the states of the plurality of communication devices. [Selection diagram] Fig. 3

Description

The present invention relates to a communication device and a communication device control method, and more particularly to a communication device capable of recognizing a voice uttered by a user.

In recent years, smartphones and wearable devices have become popular in the market. In these devices, voice input is one of the input methods for the user to operate the device. For example, there is a case where a mail application is launched on the device and characters are input by the user's voice without operating the keyboard displayed on the touch panel. Further, there is a device in which the device shifts to a mode in which the voice command is received not only by the voice character input but also by the voice shout without touching the device at all, and then executes the received voice command.

In addition, an increasing number of users carry around these devices in their kitchens. In such a case, when the user tries to start a voice operation, a plurality of devices may respond, and when an operation is performed on only one device, the mouth is approached to the device and a small voice is uttered. It is necessary to take measures against and the operation is not easy.

In order to solve this problem, in Patent Document 1, in order to specify a device to be a partner, it is possible to cause the specific device to perform a specific operation by including the unique name of the partner device in a voice command and uttering by the user. I am trying.

JP, 2001-5485, A

However, in Patent Document 1, in order to identify the device that responds to the command, the unique identification information of the device must be pronounced as a voice command, and the user can pronounce the proper unique identification information of the device depending on the situation. There was an annoyance to do.
The present invention has been made in view of the above-mentioned problems, and an object thereof is to eliminate the troublesomeness for the user to consider which device he/she wants to operate.

The communication device of the present invention holds control means for controlling the operation of the entire communication device, communication means for communicating with other communication devices, and device information of a partner with which the communication means can communicate. A storage unit for storing a program operated by the control unit in a storage unit; a voice input unit for receiving a voice input from a user; and a voice analysis unit for analyzing a voice received by the voice input unit and extracting a voice command. When the voice command is extracted by the voice analysis means, the control means, based on the device information of the cooperation partner stored in the storage unit, through the communication means, It is characterized in that the state of each communication device is exchanged with a plurality of cooperating communication devices, and the communication device that responds to the voice command is determined based on the states of the plurality of communication devices.

According to the present invention, it is possible to realize a device that responds to a user's intention without being conscious of a plurality of devices, and reduce the user's annoyance.

It is a block diagram which shows the structural example of the communication apparatus in embodiment. 3 is a flowchart illustrating pairing between communication devices according to the embodiment. 6 is a flowchart illustrating an operation of the communication device according to the embodiment. It is a block diagram which shows the structural example of the communication apparatus in 2nd Embodiment.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations.
[First Embodiment]
FIG. 1 is a block diagram showing a configuration example of a communication device according to this embodiment.
In FIG. 1, the communication device 100 and the communication device 110 have the same configuration and perform communication between two communication devices. In reality, a plurality of communication devices may be provided, but here, two communication devices having the minimum configuration will be described as an example.

The communication device 100 will be described.
The control unit 106 controls the entire communication device. The control unit 106 reads out and executes the application program stored in the storage unit 101. The control unit 106 also has a voice analysis function of analyzing a sound collected by the microphone 105, which will be described later, and extracting a voice command.

The storage unit 101 is a memory that stores a program to be run by the communication device 100 and a cooperation status with a communication partner communication device (here, the communication device 110) with which communication is possible.
The touch panel 102 functions as a display unit that displays information to the user, and also functions as an interface that receives an operation performed by the user's finger.
The screen synthesis unit 103 synthesizes an application execution screen stored in the storage unit 101 and data such as an image together with other interface members so as to be displayed on the touch panel 102.

The communication unit 104 is a block that performs communication using radio waves, and is an interface for communicating with an external device, a server, and a communication device that cooperates. The communication unit 104 mainly performs communication using a communication method such as WIFI, Bluetooth (registered trademark), or Bluetooth LE. The microphone 105 is a voice input unit and a device that collects external sounds. The microphone 105 digitizes the sound pressure of the sensed voice, and always holds the digitized sound pressure in the storage unit 101. The sound pressure information stored in the storage unit 101 can be used to determine the volume of sound reaching the communication device.
Since the configuration of the communication device 110 is the same as that of the communication device 100, the description of the configuration of the communication device 110 is omitted.

Since the two communication devices 100 and 110 cooperate to process the voice command from the user, the two communication devices are paired. The pairing operation is the first operation for always linking communication devices.
Pairing between the communication device 100 and the communication device 110 will be described with reference to the flowchart of FIG.

S200 is a flowchart for explaining the operation on the communication device 100 side, and shows a case where the communication device 100 side requests pairing. S210 is a flowchart for explaining the operation on the communication device 110 side.
In S201, pairing is started. The control unit 106 calls an application for pairing from the storage unit 101, processes the application, and displays a screen of the progress of pairing on the touch panel 102. Then, it progresses to S202.

Initially, information indicating that the communication device 100 is not paired with another communication device is stored in the storage unit 101 of the communication device 100. Therefore, in S202, the control unit 106 transmits a broadcast signal (so-called advertisement) in order to have the pairing partner discover the own device using the communication unit 104. The broadcast signal is a communication method that does not specify the receiving party. This communication is a method that is normally used in communication such as wireless LAN and Bluetooth, and thus its details are omitted. Then, it progresses to S203.
In S203, the control unit 106 waits for a certain period of time whether or not there is a response to the advertisement from the communication device on the partner side. If there is no response, the process ends. If there is a response, the process proceeds to S204.

In step S204, the control unit 106 requests the user to input the password on the touch panel 102 by the pairing application in response to the response from the communication device on the other side. The password obtained here is a four-digit number displayed on the display screen of the communication device of the other party, and the password of the partner party visually confirmed by the user is input using the touch panel 102 of the communication device 100. Then, it progresses to S205.
In S205, the control unit 106 confirms whether or not the input password matches the password set in the partner communication device, and if they do not match, the process ends. If they match, the process proceeds to S206.

In S206, the control unit 106 holds the device information of the other party in the storage unit 101. Here, the device information of the partner is an IP address or a MAC address for always communicating with the partner. As a result, pairing is established. Then, it progresses to S207.
In step S207, the control unit 106 transmits a pairing success notification to the pairing partner via the communication unit 104, and ends the process.

Next, the operation of the communication device 110 corresponding to the above operation of the communication device 100 will be described. S211 is in the idle state, and the process periodically proceeds to S212.
In S212, the communication unit 114 on the communication device 110 side checks whether or not a broadcast signal (advertisement) for pairing is received. If a signal is received, the process proceeds to 213, and if not, the process proceeds to 211. Return.

In step S<b>213, in response to the communication unit 114 receiving the broadcast signal for pairing, the control unit 116 displays a 4-digit password number on the touch panel 112. Then, it progresses to S214.
In S214, the control unit 116 determines whether or not the communication unit 114 has received a notification of successful pairing from the communication device on the other side, and if the notification of successful pairing can be received from the communication device on the other side, the process proceeds to S215. If not, the process ends.

In S215, the control unit 116 holds the information of the communication device 100 on the partner side in the storage unit 111 of the communication device 110. Here, the information of the other party is an IP address or a MAC address for always communicating with the other party. As a result, pairing is established. Further, the control unit 116 displays on the touch panel 112 that the pairing is successful and notifies the user.
After that, the two communication devices hold the fact that they have been paired with each other in both storage units (101, 111), so that they can cooperate with each other.

Next, the operation of one communication device (communication device 100) in the case where the communication device 100 and the communication device 110 cooperatively respond to a voice command issued by the user will be described with reference to the flowchart of FIG. .. Here, the operation of the communication device 100 will be described, but the communication device 110 also executes similar processing. The flowchart of FIG. 3 is started in a state where the above pairing process is completed.
When the communication device 100 starts the process in S300, the process proceeds to S301.
In S301, the microphone 105 of the communication device 100 always receives the external sound, and the control unit 106 analyzes the sound, extracts it as a voice command, and repeatedly processes whether or not it has been recognized. When it is recognized as a voice command, it is stored in the storage unit 101 together with the sound pressure value. If it is recognized as a voice command, the process proceeds to S302, and if not, 301 is repeated.

In S302, the control unit 106 inquires of the pairing partner (communication device 110) stored in the storage unit 101 whether or not a voice command is accepted. It communicates with the pairing partner (communication device 110) through the communication unit 104. Then, it progresses to S303.
In S303, the control unit 106 performs a process of determining whether or not the communication device 100 should become the master. Here, the response from the pairing partner (communication device 110) is received. This response includes the information on the manufacturing number held in the storage unit 111 of the pairing partner (communication device 110). Based on the comparison between the response result and the manufacturing number stored in the storage unit 101 of the communication device 100, the control unit 106 determines whether or not the communication device 100 should become the master.

A master is a device that acts as a commander for cooperating multiple communication devices. Here, as a method of determining the master, the serial numbers of the pairing partners (communication device 110) are compared. The manufacturing number is unique to each communication device, and the same one does not exist. In this embodiment, each communication device recognizes this manufacturing number, and the communication device with the smallest number becomes the master. If the communication device 100 becomes the master, the process proceeds to S304, and if not, the process proceeds to S309.

In S304, control unit 106 determines a communication device that responds to the voice command. The master (communication device 100) receives by communication the sound pressure value stored in the storage unit 111 of the communication device 110 together with the voice command, and compares it with the sound pressure value stored in the storage unit 101 of the communication device 100. .. The master determines that the communication device that receives the largest voice (sound pressure) of the user is the communication device that responds to the voice command. This is because it is expected that the device to which the user's voice is loudly input, that is, the user has approached his mouth and uttered a voice command, and the user wants to input a voice command to the device. Is. In this way, the states of the communication devices are exchanged, and it is determined that the communication device having a high priority and capable of responding will respond. Then, it progresses to S305.

In step S305, the control unit 106 determines whether the communication device 100 is a communication device that responds to a voice command. If it is determined that the communication device 100 is a communication device that responds to a voice command, the process proceeds to step S306. If not, the process proceeds to S310.
In S306, the control unit 106 performs various processes according to the voice command. The control unit 106 retrieves a necessary program from the storage unit 101 and processes it according to the voice command. For example, when the user issues a voice command “What is the current time?”, the control unit 106 reads an application for managing the time from the storage unit 101. Then, the control unit 106 processes this application, so that the communication device requested to respond responds with “12:00”. Then, the process proceeds to S312.

In S312, the control unit 106 determines whether or not the communication device 100 is a master. If the communication device 100 is a master, the process proceeds to S308, and if not, the process proceeds to S307.
In step S307, when the response ends, the control unit 106 notifies the communication device 110, which is the master, that the response to the voice command has ended in the communication unit 104, and then the process proceeds to step S308.
In S308, the voice command accepting mode is entered again, and this operation flow is repeated.

In S309, since it is determined that the communication device 100 will not become the master, the control unit 106 waits until an instruction is received from the master communication device. If an instruction is received from the master communication device, the process proceeds to S305, and if not, this process is repeated.

In S310, since it is determined that the communication device 100 does not become the communication device that responds, the control unit 106 causes the communication device 100 to process the voice command, such as “responsive to another communication device” on the touch panel 102. Show that not. Further, at this time, the control unit 106 controls so as not to accept a new voice command. Then, the process proceeds to S311.
In step S311, the communication device 110 that responds waits for a notification that the processing of the voice command is completed. If there is a signal from the other responding communication device to end the process, the process proceeds to S308, and if not, this process is repeated.

With such an operation, first, a master for coordinating a plurality of communication devices is determined, a communication device to which the master responds is determined, and the communication device is caused to perform a voice response process. By doing so, only the optimum communication device responds in a cooperative operation without the plurality of communication devices processing voice commands.
In the present embodiment, the configuration of two communication devices 100 and 110 has been described, but the configuration may be two or more.

Further, as for the process of determining the master, the method of comparing the serial numbers has been described, but the master may be determined by another method. For example, when a wireless LAN is used for communication, an IP address for communicating with another communication device may be considered as a sequence, and a device with a smaller number may be the master. When Bluetooth LE is used for communication, BDAddr may be considered as a sequence and a device with a smaller number may be the master. The priority order of the master device may be registered in the storage unit 101 in advance by the user. It should be noted that the term "master" as used herein is a concept independent of the relationship between an access point and a station defined by the wireless LAN standard and the relationship between a master and a slave defined by the Bluetooth standard. The master in the present embodiment indicates a main body of processing in communication (for example, processing for determining a device to respond to).

[Second Embodiment]
In order to explain the present embodiment, the configuration of the communication device 400 of FIG. 4 will be described.
The communication device 400 is basically the same as the communication device 100 shown in FIG. 1, and each block of 101 to 106 corresponds to each of 401 to 406, so the description thereof will be omitted. Blocks other than the configuration of the communication device 100 will be described.

The speaker 407 is for outputting the audio data stored in the storage unit 401 to the outside. For example, the audio data is audio data received by the communication unit 404 from another communication device. In addition, the control unit 406 can perform control such that sound is output from the speaker 407, sound is not output, volume is increased or decreased, and the like.

The position/acceleration detection unit 408 acquires the position information of the communication device 400 on the earth by GPS (Global Positioning System), and detects the acceleration applied to the communication device 400. The position/acceleration detection unit 408 further includes a gyro sensor, and also has a posture detection function of detecting the posture of the communication device 400 and acquiring posture information. The position/acceleration detection unit 408 can obtain information such as whether or not the communication device 400 is moving. These pieces of information are stored in the sequential storage unit 401.

The external connection 409 is an I/F for connecting the communication device 400 to an external PC (Personal Computer), and is, for example, USB or WIFI. Information regarding whether or not the device is connected to the outside is sequentially stored in the storage unit 401.
The camera 410 is a camera for photographing the outside world of the communication device 400, and the image photographed by the camera is temporarily stored in the storage unit 401 and can be analyzed by the control unit 406 to perform person authentication or the like. Information on whether or not the camera is operating is sequentially stored in the storage unit 401.
Further, the components of the communication device 420 are the same as those of the communication device 400 described above, and the description thereof will be omitted.

In the first embodiment, the configuration has been described in which, when determining a device that responds to a voice command, the communication device having the strongest sound pressure received by the microphones provided for the plurality of communication devices is selected.
The present embodiment differs from the first embodiment only in the method of determining the communication device that responds, and other operations are the same. Therefore, only the process of S304 in FIG. 3 is different and the other operations are the same, and thus the description thereof is omitted.

Here, the communication device 400 shown in FIG. 4 will be described, and a case [(1) to (3)] of cooperating with the communication device 420 of the pairing partner will be described. The communication device 400 and the communication device 420 will be described on the assumption that the communication device 400 is the master.
(1) In the operation of the communication device 400, in S304 of FIG. 3, the control unit 406 of the communication device 400 that is the master instructs the storage unit 401 to store the usage status of the touch panel 402. The control unit 406 also instructs the communication device 420 via the communication unit 404 to store the usage status of the touch panel 422 of the communication device 420 in the storage unit 401. As a result, the operating states of the two communication devices are stored in the storage unit 401.

The control unit 406 determines the touch panel usage status of the communication devices 400 and 420 stored in the storage unit 401. Then, when the touch panel 402 of the communication device 400 is in use and the touch panel 422 of the communication device 420 is unused, the communication device 420 is determined as the communication device that responds to the voice command.
This is to prevent the user's operation from being disturbed if the communication device in use is temporarily switched from the operation screen of the touch panel to the screen of the voice command mode processing when the user pronounces the voice command.

(2) Here, it has been described that the operation statuses of the two communication devices are stored in the storage unit 401. However, other operating conditions include the load condition of the programs processed by the control units 406 and 426, the connection condition of whether or not the external connections 409 and 429 are connected to a PC or the like, or the communication condition. It may be the operating status of the cameras 410, 430 of the devices 400, 420.
In operation of the communication device 400, in S304 of FIG. 3, the control unit 406 of the communication device 400 that is the master instructs the storage unit 401 to store the detection result of the position/acceleration detection unit 408. Further, the control unit 406 instructs the communication device 420 via the communication unit 404 to store the detection of the position/acceleration detection unit 428 of the communication device 420 in the storage unit 401. As a result, the operating states of the two communication devices are stored in the storage unit 401.

The control unit 406 of the master communication device 400 determines the detection result of each communication device stored in the storage unit 401, and the communication device whose communication device is not inverted is used as the communication device that responds to the voice command. decide.
This is because it can be determined that the communication device in the upside-down state is in a state such as being put in the bag, and it is considered unsuitable for performing voice command processing of the user. This is because, depending on the type of voice command, information may be displayed on the touch panels 402 and 422 of the communication devices 400 and 420, and even if the information is displayed on the touch panels 402 and 422, it may not be seen by the user.

(3) In the operation of the communication device 400, in S304 of FIG. 3, the control unit 406 of the communication device 400 that is the master stores the result of whether or not the sound output from the speaker 407 is prohibited in the storage unit 401. Instruct them to do so. The control unit 406 also instructs the communication device 420 via the communication unit 404 to store the result of whether or not the output of the sound from the speaker 427 of the communication device 420 is prohibited in the storage unit 401. As a result, the operating states of the two communication devices are stored in the storage unit 401.

The control unit 406 of the communication device 400 that is the master determines the detection result of each communication device stored in the storage unit 401, and sets the communication device that is not prohibited from outputting the sound from the speaker of the communication device to the voice command. Decide as a communication device to respond.

[Third Embodiment]
The first embodiment and the second embodiment have been described on the assumption that the voice commands received by the respective communication devices are the same. In the present embodiment, the operation when the microphone of each communication device causes a difference in the voice command interpreted by the reception control unit will be described.
The voice command issued by the user may be affected by ambient noise or the positional relationship between the communication device and the user, and the voice command recognized by each communication device may differ. A solution to this problem will be described using an example in which three communication devices 100 shown in FIG. 1 are used. The composition is omitted because it has been described above. The communication devices 100A, 100B, and 100C are called to identify the three devices.

Further, only the part of S304 in FIG. 3 will be described in the present embodiment, and the other operations are as described above, and therefore will be omitted. As an explanation, it is assumed that the communication device 100A serves as a master and a device that makes a voice response is the communication device 100B. The following is a description of a case where the user inquires “what time?” to the three communication devices 100A, 100B, and 100C, and each device recognizes it as a voice command.

In this case, in S304 of FIG. 3, the control unit 106A of the communication device 100A, which is the master, determines to the communication device 100B and the communication device 100C of the pairing partner what voice command each communication device has received. Make an inquiry using 104A. The inquiry result is stored in the storage unit 101A of the master communication device 100A.

In S302 of the master communication device 100A, the voice commands received by the respective communication devices 100A, 100B, and 100C are
Communication device 100A: "What time?"
Communication device 100B: "What time?"
Communication device 100C: "How many days?"
The case where each is recognized will be described.

Next, the communication device 100A that is the master determines the state of the voice command received by each communication device in the storage unit 101A, and estimates the voice command issued by the user. Here, there are two communication devices that understand "what time?", the communication device 100A and the communication device 100B, and one that understands "what day?" is one communication device 100C. Therefore, it is estimated that the communication device 100A, the communication device 100B, and the communication device 100C have received the voice command "What time?" by the majority voting mechanism. Then, the communication device 100A, which is the master, issues a command [respond to the voice command "What time?"] to the communication device 100B that responds by voice to the communication unit 104B via the communication unit 104A. ..

Here, a voice command with a high possibility is adopted by a majority decision, but it is determined together with the sound pressure value detected by the microphones 105A, 105B, 105C in each of the communication device 100A, communication device 100B, and communication device 100C. You may. That is, it is also possible to give a higher score to a voice command determined by a communication device having a high sound pressure and determine the voice command based on the score of each voice command.
In this way, the voice command most likely to be transmitted from the user is recognized again and the recognition accuracy is improved.

(Other embodiments)
The present invention is also realized by executing the following processing. That is, the software (computer program) that realizes the functions of the above-described embodiments is supplied to the system or the device via a network or various computer-readable storage media. Then, the computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program.

100, 110 Communication device 101, 111 Storage unit 102, 112 Touch panel 103, 113 Screen composition unit 104, 114 Communication unit 105, 115 Microphone 106, 116 Control unit

The communication device of the present invention outputs first sound, a first sound input unit that receives a sound input from a user, a first output unit that outputs a sound, and a second sound input unit that receives a sound input from the user. A communication unit that wirelessly communicates with an external device having a second output unit, and a device that responds to a voice command included in the voice received by the first voice input unit, whichever of the communication device and the external device. And a control unit that determines whether to output a sound from the first output unit, and the control unit controls the external device to output the second output. The information about whether to output a sound from the means is received via the communication means, the control means, when a voice command is extracted from the voice received by the first voice input means, the communication device and Of the external devices, the one that does not prohibit sound output is determined as the device that responds to the voice command, and the control unit extracts the voice command from the voice received by the first voice input unit. In this case, if neither of the communication device and the external device prohibits sound output, the generation of the sound received by the first sound input means of the communication device and the external device. The one closer to the source is determined as the device that responds to the voice command, and the control unit determines that the voice input by the first voice input unit when the communication device is determined as the device that responds to the voice command. It responds to the voice command extracted from .

The present invention relates to communication apparatus及beauty CONTROL METHOD, more particularly, to a recognizable communication device voice user emitted.

Claims (11)

Control means for controlling the operation of the entire communication device,
Communication means for communicating with other communication devices,
Storage means for holding device information of a cooperation partner with which the communication means can communicate, and storing a program operated by the control means in a storage part;
A voice input means for receiving voice input from the user,
A communication device comprising a voice analysis unit that analyzes a voice received by the voice input unit and extracts a voice command,
When a voice command is extracted by the voice analysis unit,
The control means is
Based on the device information of the cooperation partner stored in the storage unit, the state of each communication device is exchanged with a plurality of communication devices that cooperate through the communication means, and based on the states of the plurality of communication devices. And a communication device that responds to the voice command. If no other communication device is registered in the storage unit when the voice command is extracted by the voice analysis unit,
The communication device according to claim 1, wherein the communication device that has extracted the voice command responds to the voice command. The storage means stores information regarding which communication device is prioritized in a voice response in accordance with the device information of the cooperation partner stored in the storage unit,
When a voice command is extracted by the voice analysis unit,
The control unit determines a communication device that responds to the voice command so that a communication device that is responsive and has a high priority stored in the storage unit responds. Communication equipment. Furthermore, it is equipped with attitude detection means for detecting the attitude of the communication device,
The storage unit stores the posture information detected by the posture detection unit according to the device information of the cooperation partner stored in the storage unit,
When a voice command is extracted by the voice analysis unit,
The communication device according to any one of claims 1 to 3, wherein the control unit determines a communication device that responds to the voice command based on the posture information stored in the storage unit. .. Further equipped with a display unit,
If another communication device responds to the voice command,
The communication device according to any one of claims 1 to 4, wherein the control unit controls the display unit to display a message to that effect. If another communication device is responding to the voice command,
The communication device according to any one of claims 1 to 5, wherein the control unit controls so as not to accept a new voice command. The communication device according to any one of claims 1 to 6, wherein the communication means notifies another communication device that the response to the voice command has ended when the response ends. The storage means stores the sound pressure information of the sound sensed by the voice input means in accordance with the device information of the cooperation partner stored in the storage unit,
When a voice command is extracted by the voice analysis unit,
The communication device according to claim 1, wherein the control unit determines a communication device that responds to the voice command based on the sound pressure information stored in the storage unit. machine. When a voice command is extracted by the voice analysis unit,
When the control unit compares the extracted voice command with the voice command recognized by the cooperation partner device stored in the storage unit, and the respective cooperation partner devices recognize different voice commands. To
The communication device according to claim 1, wherein a voice command having a high possibility is adopted. A control process for controlling the operation of the entire communication device,
A communication process for communicating with other communication devices,
A storage step of holding device information of a cooperation partner capable of communicating in the communication step and storing a program operating in the control step in a storage section,
A voice input process that receives voice input from the user,
A method of controlling a communication device, comprising: a voice analysis step of analyzing a voice received in the voice input step to extract a voice command,
When a voice command is extracted in the voice analysis step,
The control step is
Based on the device information of the cooperation partner stored in the storage unit, the state of each communication device is exchanged for a plurality of communication devices that cooperate through the communication process, and based on the state of the plurality of communication devices. A method of controlling a communication device, comprising determining a communication device that responds to the voice command. A computer-readable program for causing a computer to function as each unit of the communication device according to claim 1.

Images