JP2019096365A - Control device, input/output device, control method and control program - Google Patents

Abstract

To realize diversification of services provided by input/output devices.SOLUTION: The control device according to the present application is a control device that controls an input/output device having a reception function for receiving sound, an output function for outputting sound, and a movement function, and includes: a movement control unit for moving the input/output device in the direction of a user when the magnitude of the sound emitted from the surroundings of the user exceeds a predetermined threshold value; and an output control unit that causes the input/output device to output voice for alerting the user by using the output function of the input/output device when the input/output device has moved to the vicinity of the user under the control of the movement control unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a control device, an input / output device, a control method, and a control program.

  BACKGROUND ART Conventionally, there are known techniques for causing an autonomously movable mobile body to execute various processes. One example of such a technology is the technology of a robot equipped with a mobile battery, and when the user makes a sound for calling a robot, it moves toward the user and charges various devices. Technology is known.

U.S. Pat. No. 9,492,922

  In recent years, an input / output device such as a smart speaker has been in widespread use, having a speaker function and using voice recognition technology to perform order processing and the like in an electronic shopping mall according to the user's utterance. It is desirable to provide services through input / output devices.

  However, the above-mentioned prior art merely moves the robot in the direction of the user who called the robot, and it can not be said that other forms are disclosed.

  The present application is made in view of the above, and an object of the present application is to realize diversification of services provided by an input / output device.

  The control device according to the present application is a control device that controls an input / output device having a reception function for receiving sound, an output function for outputting sound, and a movement function, and the size of the sound emitted from the user's surroundings. If the input / output device is moved to the vicinity of the user under the control of the movement control unit for moving the input / output device in the direction of the user and the movement control unit moves And an output control unit configured to output, from the input / output device, a voice for prompting the user to pay attention using an output function of the input / output device.

  According to an aspect of the embodiment, diversification of services provided by the input / output device is realized.

FIG. 1 is a diagram illustrating an example of an input / output device according to an embodiment. FIG. 2 is a diagram illustrating an exemplary configuration of the input / output device according to the embodiment. FIG. 3 is a flowchart showing an example of the flow of control processing according to the embodiment. FIG. 4 is a diagram illustrating another example of the control device according to the embodiment. FIG. 5 is a diagram illustrating an example of control processing that the control device according to the embodiment executes based on different business entity data. FIG. 6 is a diagram illustrating an example of the hardware configuration.

  Hereinafter, a control device, an input / output device, a control method, and a mode for implementing a control program (hereinafter, referred to as “embodiment”) according to the present application will be described in detail with reference to the drawings. Note that the control device, the input / output device, the control method, and the control program according to the present application are not limited by this embodiment. Moreover, the same code | symbol is attached | subjected to the same site | part in the following each embodiment, and the overlapping description is abbreviate | omitted.

[1. Example of input / output device]
First, an example of the input / output device 100 controlled by the control device according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of an input / output device according to an embodiment. In FIG. 1, as an example of an input processing device controlled by the control device 10 (for example, see FIG. 2), an input device such as a microphone for acquiring surrounding sound and an output device such as a speaker capable of outputting an arbitrary sound And a drive unit such as a small tire, and has an example of an input / output device having a moving function capable of autonomously moving to any position.

  For example, the input / output device 100 is an input / output device called a smart speaker, and is a device capable of outputting a sound such as music using an output device. In addition, the input / output device 100 has a reception function of receiving an input of sound, and has an output function of outputting a sound according to the content of the acquired sound when acquiring a sound uttered by the user. For example, when the user utters a voice indicating a song title of a predetermined song, the input / output device 100 identifies the song title indicated by the voice by various voice analysis techniques, and the data of the song represented by the identified song title , And from a predetermined external server 200 (see, for example, FIG. 2) via the network N (see, for example, FIG. 2). Then, the input / output device 100 reproduces the acquired music.

  Further, the input / output device 100 has a function of, for example, specifying the content of the voice emitted by the user using various voice analysis techniques, and outputting a response according to the specified content. For example, when the input / output apparatus 100 acquires the user's voice such as “Today's weather”, it acquires various kinds of weather information such as weather and temperature from the external server 200 and reads out the acquired weather information. To provide users with weather information. In addition to the above-described processing, the input / output apparatus 100 can, for example, order products sold in the online shopping mall, control various home appliances such as air conditioners and lighting devices, read out mails and schedules, etc. It is a smart speaker that can realize processing.

  Here, the input / output device 100 has a drive unit for moving the housing of the input / output device, such as a tire or caterpillar, and by controlling the drive unit, a moving function capable of moving to an arbitrary position is realized. Have. For example, the input / output device 100 can realize movement such as rotation or movement by moving a drive unit using a motor or the like. For example, the input / output device 100 may be a device movable by flying using a propeller like a drone.

[1-1. Regarding an example of control processing]
Here, the input / output device 100 having the reception function, the output function, and the movement function described above performs the following processing according to the control processing that the control device 10 executes. For example, the input / output device 100 moves according to the sound received by the reception function, and outputs a sound according to the sound received by the reception function using the output function.

[1-2. About moving to do appropriate analysis]
Hereinafter, an example of the process performed by the input / output device 100 will be described with reference to FIG. For example, the input / output device 100 receives the voice uttered by the user U (step S1). In such a case, the input / output device 100 specifies the content of the voice uttered by the user U who performs voice analysis.

  Here, when the distance between the user U and the input / output device 100 is long, there are cases where it is not possible to accurately analyze the voice emitted by the user U. Therefore, if there is a possibility that the received voice can not be analyzed, the input / output device 100 moves close to the user U who has issued the voice (step S2). For example, in the input / output device 100, the sound accepted by the acceptance function includes the voice emitted by the user U, but when the volume of such voice is lower than a predetermined threshold, the voice emitted by the user U If the ratio to other sounds (for example, various background sounds), that is, the S / N ratio (Signal-to-Noise ratio) is lower than a predetermined threshold, the voice generated by the user U is properly analyzed It determines that it can not do.

  In such a case, the input / output device 100 specifies the direction of the user U who has made the sound. For example, the input / output device 100 has a plurality of microphones installed at different positions, and is used based on the difference in the timing at which each microphone receives a sound, the difference in the size of the sound received by each microphone, etc. The direction in which the person U is located is identified. Then, the input / output device 100 moves to the vicinity of the user U by controlling the drive unit, and outputs a voice for requesting speech again, such as "Do you speak again?" . That is, the input / output device 100 moves in the direction of the user U when the received sound is a voice uttered by the user and the content of the voice can not be specified.

  Then, for example, the input / output device 100 outputs a response according to the content of the newly received voice (step S3). For example, when the input / output device 100 moves appropriately to the vicinity of the user U and appropriately obtains an analysis result such as "What is the weather today?" From the user U's speech, based on the obtained analysis result , Collect weather information from the external server 200. Then, the input / output device 100 provides a response corresponding to the utterance to the user U by outputting a voice that reads the content of the collected weather information, for example, “Today is fine”. Can. Note that after outputting the response, the input / output device 100 may move to the original position, or may remain in the vicinity of the user U as it is.

  In addition, when the input / output device 100 receives an utterance such as “reproduce the music A”, for example, the data of the “music A” may be acquired, and the reproduction of the acquired “music A” may be started. . Here, the input / output device 100 may play the “music A” while moving to the vicinity of the user U, or may play the “music A” after moving to the original position. Further, when the input / output device 100 receives an utterance requesting control of various home electronics devices, it controls the home electronics device using a technology such as HEMS (Home Energy Management System), and then moves to the original position. You may stay in the vicinity of the user U as it is.

[1-3. About movement to perform appropriate offer]
Here, when the input / output device 100 outputs various types of music, depending on the position of the input / output device or the position of the user U, the user U appropriately views the music because the echo of the sound, the volume, and the like change. There is a risk that it will not be possible. Therefore, the input / output device 100 is moved to a position which is specified based on the sound received by the reception function and which is easy for the user to view the sound emitted by the input / output device.

  For example, the input / output device 100 receives voices uttered by a plurality of users U (step S4). In such a case, the input / output device 100 identifies the positional relationship between the input / output device 100 and each user U according to the size of the voice of the user U or the like. The input / output device 100 may specify the positional relationship between the input / output device 100 and each user U according to various environmental sounds, echoes of sound, etc., as well as voice. Further, the input / output device 100 may specify an obstacle such as a wall or furniture between the input / output device 100 and each user U. Such identification processing can be realized by various techniques for identifying the positional relationship from sound, and various identification techniques for identifying an obstacle from sound.

  Then, the input / output device 100 specifies a position where each user U can easily view the sound emitted by the input / output device 100. For example, when the volume of noise with respect to the voice emitted by the user U is large, the input / output device 100 specifies a position closer to the user U. Also, the input / output device 100 takes into consideration the sound of each user U when the input / output device 100 outputs a sound at a predetermined volume in consideration of sound absorption by an obstacle, reflection of sound by a wall, etc. Identify locations that are presumed to be recognizable.

  Then, the input / output device 100 moves to the specified position, that is, a position where each user can easily hear the sound (step S5). Thereafter, the input / output device 100 outputs a sound such as music at the position after movement (step S6).

  In addition, it is also considered that the position where each user can hear well changes depending on the type of sound to be output. For example, depending on whether the type of the sound output from the input / output device 100 is a sound such as music or a voice such as a response, the position where the sound output from the input / output device 100 can be heard may change. Therefore, the input / output device 100 can identify the type of sound to be output (for example, whether it is music or voice), the content of the sound to be output (for example, classical music or pop music), and the sound to be output The position to be the destination of movement may be specified according to the volume of the sound or the like. As a result of such processing, the input / output device 100 can output voice and music at a position where each user can hear well.

[1-4. About moving to perform noise cancellation]
Here, various devices may continue to output steady sound. For example, a refrigerator may constantly output the sound of a compressor or a fan. The steady sound output from such various devices is highly likely to be an unpleasant sound for the user U. Therefore, when the magnitude of the sound output from the predetermined device exceeds the predetermined threshold, the input / output device 100 moves in the direction of the predetermined device and generates a sound whose phase is opposite to that of the sound output from the predetermined device. Output.

  For example, the input / output device 100 acquires the sound emitted by a predetermined device (in the example shown in FIG. 1, a refrigerator) (step S7). In such a case, the input / output device 100 determines whether the acquired sound satisfies a predetermined condition. For example, the input / output device 100 determines whether the frequency characteristic of the acquired sound has a predetermined characteristic and the magnitude of the acquired sound exceeds a predetermined threshold. In addition, such conditions are suitably set according to whether the probability that the user U may be uncomfortable for the sound which the predetermined | prescribed apparatus output is high.

  Then, when the acquired sound satisfies the predetermined condition, the input / output device 100 moves to the vicinity of the device that has generated the sound (step S8). Then, the input / output device 100 reduces noise by outputting a sound whose phase is inverted from the sound emitted by the device (step S9). That is, based on the acquired sound, the input / output device 100 moves to the vicinity of the device to be subjected to noise canceling, and performs noise canceling. As a result, the input / output device 100 can appropriately implement noise canceling.

[1-5. About moving to pay attention to users]
Here, if the volume of the voice uttered by the user U is large or if the user is listening to music at a large volume, there is a risk that the surrounding users U will be annoyed. However, when the distance between the user U and the input / output device 100 is long, there is a possibility that the user U may not notice even if the user U is warned. Therefore, when the magnitude of the sound generated around the user U exceeds the predetermined threshold, the input / output device 100 moves in the direction of the user U and outputs a sound notifying of the predetermined content.

  For example, the input / output device 100 receives sounds around the user U (step S10). More specifically, the input / output device 100 acquires the voice emitted by the user U, and specifies the position where the user U is located based on the acquired voice. Further, the input / output device 100 acquires various environmental sounds and the like, and is emitted from the surroundings of the user U based on the positional relationship between the position where the acquired environmental sound is emitted and the position of the specified user U. Identify the loud sound. Then, the input / output device 100 is used when the volume of the voice emitted by the user U exceeds the predetermined threshold or when the magnitude of the sound emitted from the surroundings of the user U exceeds the predetermined threshold. It moves in the direction of the person U (step S11).

  Then, when the input / output apparatus 100 has moved to the vicinity of the user U, the input / output apparatus 100 outputs a notice for calling attention to the volume, such as "Please reduce the voice" (step S12). As a result, even when the loudness of the sound emitted from the surroundings of the user U is large, the input / output device 100 can realize attention using voice.

  The input / output device 100 may output a notification of different content according to the type of sound whose volume exceeds a predetermined threshold among the sounds emitted from around the user U. For example, when the volume of the voice emitted by the user U exceeds the predetermined threshold, the input / output device 100 reduces the volume of the voice emitted by the user U, such as "Please reduce the voice." If the volume of music emitted from the surroundings of the user U exceeds a predetermined threshold, the notification such as “Please reduce the playback volume” is output from the surroundings of the user U. A notification may be output requesting that the volume of the emitted music be reduced.

[1-6. Other]
As described above, the input / output device 100 moves in accordance with the content of the received arbitrary sound, the mode, or the position where the sound is emitted, in addition to the voice calling the input / output device 100. For example, when the content or the aspect of the received sound satisfies a predetermined condition, the input / output device 100 moves to the vicinity of the position where the sound having the content or the aspect satisfying the predetermined condition is emitted. Also, for example, the input / output device 100 moves to a position where the plurality of users U who have made a sound can easily hear the sound emitted by the input / output device 100, that is, a position according to the position where the received sound is emitted. . Then, the input / output device 100 outputs a sound corresponding to the received sound. As a result, the input / output device 100 can realize diversification of the provided service.

  In addition to the various processes described above, the input / output device 100 may move to any position according to the acquired sound. That is, the input / output device 100 may identify the type of the received sound, and move according to the identified type of sound. More specifically, the input / output device 100 determines whether the type of the received sound is a sound emitted by the user U or a sound emitted by a predetermined device (for example, driving sound, music, etc.) It is sufficient to specify and move the input / output device according to the specified sound type.

  For example, if the type of the received sound is a voice uttered by the user U, and the volume or content of the voice satisfies a predetermined condition, the input / output device 100 can receive the voice of the user U You can move in the direction. For example, if the volume of the sound is smaller than the predetermined threshold to the extent that the input / output device 100 can not properly recognize the sound, or if the volume of the sound is predetermined to the extent that the surrounding user U is annoyed. If it is larger than the threshold value, it may be moved in the direction of the user who has made the voice.

  Also, for example, when the magnitude of the sound emitted by a device (for example, a television etc.) installed at a position away from the user U exceeds the predetermined threshold, the input / output device 100 is not the device but the user. The user may move in the direction of U, and be careful in the vicinity of the user U, such as "Please reduce the sound of the television." In addition, when the input / output device 100 can not specify the position of the user U, for example, when the user U's voice can not be acquired, a user terminal (for example, a smartphone used by the user U registered in advance) Etc.) may be sent and output a warning message.

[1-7. About the sound emitted by the user]
In the example described above, the input / output device 100 specifies the position of the user U based on the voice uttered by the user U. However, the embodiments are not limited to this. For example, the input / output device 100 acquires a sound of an instrument played by the user U or a sound generated by the operation of the user U (for example, a sound for operating a keyboard or a mouse), and based on the acquired sound, The position of the user U may be specified. That is, if the input / output device 100 specifies the position of the user U based on not only the voice uttered by the user U but also the sound uttered due to the user U, any sound may be used. Based on the position of the user U may be specified.

[1-8. Control method]
In the example described above, the input / output device 100 includes the control device 10 for realizing the above-described processing, and executes the above-described processing according to the control by the control device 10. That is, the control device 10 is installed in the housing of the input / output device 100, and controls the drive component for causing the input / output device 100 to exhibit the moving function according to the sound received by the reception function. Realized the processing. However, the embodiments are not limited to this.

  For example, the control device 10 may be a separate device from the input / output device 100. For example, the control device 10 and the input / output device 100 may be communicably connected via the network N. In such a case, the control device 10 acquires the data of the sound received by the input / output device 100, moves the input / output device 100 based on the acquired data of the sound, and generates various sounds from the input / output device 100. Output.

[2. Configuration of input / output device]
Hereinafter, an example of a functional configuration of the above-described input / output device 100 will be described. FIG. 2 is a diagram illustrating an exemplary configuration of the input / output device according to the embodiment. As shown in FIG. 2, the input / output device 100 includes a control device 10, a microphone 50, a speaker 60, a motor 70, and a drive unit 80.

  The microphone 50 is an input device capable of receiving various sounds, and is realized by any microphone. In the input / output device 100, an arbitrary number of microphones 50 can be installed. For example, the microphone 50 converts the received sound into an electrical signal and provides the electrical signal to the control device 10. Thus, the microphone 50 realizes a reception function for receiving a sound.

  The speaker 60 is an output device capable of outputting various sounds, and is realized by various speakers. The input / output device 100 may have any number of speakers. For example, the speaker 60 outputs various sounds and music by reproducing data of the sound received from the control device 10. Thus, the speaker 60 realizes an output function of outputting a sound.

  The motor 70 is a motor for driving a drive unit 80 such as a tire. For example, the motor 70 moves the input / output device 100 to an arbitrary position by driving the drive unit 80 under the control of the control device 10. Thus, the motor 70 and the drive unit 80 realize a moving function of moving the input / output device 100.

  The control device 10 is a control device that controls the input / output device 100. For example, the control device 10 includes a communication unit 20, a storage unit 30, and a control unit 40.

  The communication unit 20 is realized by, for example, a network interface card (NIC). The communication unit 20 is connected to the network N in a wired or wireless manner, and transmits and receives information to and from the external server 200.

  The storage unit 30 is realized by, for example, a semiconductor memory device such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. Further, the storage unit 30 stores a voice database 31 and a music database 32.

  The speech database 31 is a database used to output speech. For example, in the voice database 31, data of various vowels and consonants used when outputting voices of various languages are registered. The control device 10 combines data of vowels and consonants registered in the voice database 31 to generate voice data, and outputs the generated voice from the speaker to realize voice response, attention, and the like.

  Data of music acquired from the external server 200 is registered in the music database 32. In the music database 32, data of any standard such as MP3 (MPEG-1 Audio Layer-3) or MP4 (MPEG-4 Part 14) may be registered.

  The control unit 40 is, for example, a controller, and various programs (an example of a notification program stored in a storage device in the input / output device 100 by a central processing unit (CPU), a micro processing unit (MPU) or the like. Is realized by executing the RAM as a work area. The control unit 40 is a controller, and is realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  As shown in FIG. 2, the control unit 40 includes a receiving unit 41, a specifying unit 42, a movement control unit 43, and an output control unit 44. The receiving unit 41 receives the sound received by the microphone 50. For example, when the receiving unit 41 receives an electrical signal from the microphone 50, the receiving unit 41 generates, from the received electrical signal, sound data indicating the size, frequency characteristics, and the like of the sound received by the microphone 50.

  The identifying unit 42 identifies the type of sound accepted by the accepting function. For example, the specifying unit 42 specifies whether the type of the sound received by the receiving function is a sound emitted by the user U or a sound emitted by a predetermined device.

  For example, the identifying unit 42 analyzes the sound data generated by the receiving unit 41, and based on the frequency characteristic, the received sound is a voice of the user U or a sound emitted by a predetermined device. Identify the Further, the specifying unit 42 specifies the volume of the received sound. When the input / output device 100 has a plurality of microphones 50, for example, the identification unit 42 individually receives the sound data of the sound received by each of the microphones 50. Then, the specifying unit 42 is an input / output device based on the timing when each microphone 50 receives the sound emitted from the same sound source, the size of the sound received by each microphone 50, the position at which each microphone 50 is installed, etc. Identify the location of the sound source relative to 100. For example, the identifying unit 42 identifies the direction, distance, etc. of the sound source with respect to the input / output device 100.

  Further, when the received sound is the voice of the user U, that is, the voice, the specifying unit 42 converts the voice of the user U into text. Such conversion processing may be realized by the input / output device 100 or may be realized by a predetermined external server 200. That is, the identifying unit 42 identifies the content of the voice of the user U.

  The movement control unit 43 moves the input / output device 100 according to the sound received by the reception function. For example, the movement control unit 43 moves the input / output device 100 according to the specified type of sound. As a more specific example, the movement control unit 43 moves the input / output device 100 depending on whether the specified type of sound is voice or a sound emitted by a predetermined device. In addition, the movement control unit 43 moves the input / output device 100 in accordance with the magnitude of the sound received by the reception function.

  For example, if the sound received by the reception function is a voice uttered by the user and the content of the voice can not be specified, the movement control unit 43 moves the input / output device toward the user Move As a more specific example, when the movement control unit 43 can not acquire the text indicating the content of the voice due to noise or the like when the size of the voice is less than the predetermined threshold, When the user U is requested to speak again, for example, when the content of the text indicating the content of the voice is unclear, the input / output device 100 is moved to the vicinity of the user U.

  In addition, the movement control unit 43 moves the input / output device 100 to a position specified based on the sound received by the reception function, which is easy for the user U to view the sound emitted from the input / output device 100. . For example, in the case where the movement control unit 43 outputs a predetermined sound such as music, the position at which each user U can easily hear the sound output from the input / output device 100, that is, the sound emitted by each user U A position where the input / output device 100 can easily hear is specified, and the input / output device 100 is moved to the specified position.

  In addition, the movement control unit 43 moves the input / output device 100 in the direction of the predetermined device when the magnitude of the sound output from the predetermined device exceeds the predetermined threshold. For example, when it is accepted that the frequency characteristic has a predetermined characteristic and the magnitude of the sound exceeds a predetermined threshold, the movement control unit 43 specifies the position of the device that outputs the sound, The input / output device 100 is moved to the vicinity of the identified position.

  In addition, the movement control unit 43 moves the input / output device 100 in the direction of the user U when the magnitude of the sound emitted from the surroundings of the user U exceeds a predetermined threshold. For example, when the size of the voice emitted by the user U exceeds the predetermined threshold, the movement control unit 43 specifies the position of the user U, and moves the input / output device 100 to the vicinity of the specified position. .

  Thus, the movement control unit 43 moves the input / output device 100 to a position according to the sound received by the input / output device 100. More specifically, the movement control unit 43 controls the motor 70 to drive the drive unit 80 and move the input / output device 100. That is, the control device 10 is installed in the housing of the input / output device 100, and controls the drive unit 80 for exhibiting the moving function of the input / output device 100 according to the sound received by the reception function.

  The output control unit 44 uses the output function of the input / output device 100 to cause the input / output device 100 to output a sound corresponding to the sound received by the reception function. For example, the output control unit 44 outputs a sound according to whether the specified type of sound is a sound or a sound emitted by a predetermined device.

  As a more specific example, when the output control unit 44 can not identify the content of the voice uttered by the user U, it uses the data registered in the voice database 31 to "please say again" And so on, generate a voice prompting the user to speak again. Then, the output control unit 44 causes the speaker 60 to output the generated voice after movement by the movement control unit 43.

  When the output control unit 44 causes the movement control unit 43 to move the input / output device 100 to a position where each user U can easily hear the sound output from the input / output device 100, a predetermined sound such as music is output. Is output from the speaker 60. Further, when the input / output device 100 is moved to the vicinity of the device that outputs a sound that the user U thinks unpleasant by the movement control unit 43, the output control unit 44 outputs the sound output from the device as the microphone 50. , And generates a sound whose phase is opposite to that of the acquired sound. Then, the output control unit 44 outputs the generated sound from the speaker 60. When the movement control unit 43 causes the input control unit 44 to move the input / output device 100 to the vicinity of the user U whose magnitude of the sound emitted exceeds the predetermined threshold, the output control unit 44 quietly responds to the user U. The speaker 60 outputs a notification of predetermined content, such as a notification of content to be requested.

[3. Processing procedure]
Next, an example of the flow of control processing executed by the control device 10 according to the embodiment will be described using FIG. 3. FIG. 3 is a flowchart showing an example of the flow of control processing according to the embodiment. As shown in FIG. 3, the control device 10 receives the sound acquired by the microphone 50 of the input / output device 100 (step S101). In such a case, the control device 10 specifies the type of the received sound and the magnitude of the sound (step S102). Then, the control device 10 specifies the movement mode of the input / output device 100 and the output mode of the sound according to the type of sound and the size of the sound (step S103). For example, the control device 10 specifies the position to which the input / output device 100 is moved, and specifies the content of the sound to be output. Then, the control device 10 controls the motor 70 to move the input / output device 100 in the specified movement mode, outputs the sound in the specified output mode (step S104), and ends the process.

[4. Modified example]
The control device 10 described above may be implemented in various different forms other than the above embodiment. So, below, other embodiment of the control apparatus 10 is described.

[4-1. About composition]
In the example described above, the control device 10 is installed in the housing of the input / output device 100, and the control device 10 moves the input / output device 100 according to the sound received by the input / output device 100. However, the embodiments are not limited to this. For example, the control device 10 may be installed in a housing separate from the input / output device 100 such as a control server, and may control the input / output device 100 via the network N.

  For example, FIG. 4 is a diagram illustrating another example of the control device according to the embodiment. In the example illustrated in FIG. 4, the control device 10 is a separate device from the input / output device 100, and can communicate with the input / output device 100 via the network N. In addition, about the function structure which the control apparatus 10 shown in FIG. 4 has, description is abbreviate | omitted as what is a function structure similar to the function structure shown in FIG.

  In the example illustrated in FIG. 4, the input / output device 100 includes a communication unit 120, a storage unit 130, and a control unit 140. The communication unit 120 is realized by, for example, an NIC or the like. The communication unit 120 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the external server 200 and the control device 10.

  The storage unit 130 is realized by, for example, a semiconductor memory device such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. In addition, various types of information for operating the input / output device 100 are registered in the storage unit 130.

  The control unit 140 is, for example, a controller, and various programs (corresponding to an example of a notification program) stored in a storage device in the control device 10 are executed by using a RAM as a work area by a CPU, an MPU, or the like. To be realized. The control unit 140 is a controller, and is realized by, for example, an integrated circuit such as an ASIC or an FPGA.

  Based on such a functional configuration, the control device 10 and the input / output device 100 execute the following control processing. For example, the control unit 140 generates sound data of the sound received by the microphone 50, and transmits the generated sound data to the control device 10. In such a case, the control device 10 executes the above-described control processing to generate movement data indicating the direction or position in which the input / output device 100 is moved, and sound data of the sound to be output. Then, the control device 10 transmits the generated movement data and sound data to the input / output device 100. In such a case, the control unit 140 included in the input / output device 100 moves the input / output device 100 by controlling the motor 70 according to the movement data received from the control device 10, and the sound data received from the control device 10 is By using the speaker 60, a predetermined sound is output.

  As described above, the control device 10 may control the input / output device 100 from the inside of the housing of the input / output device 100, and may control the input / output device 100 via the network N.

[4-2. About movement and output according to user's attribute]
Here, the control device 10 may move the input / output device 100 in a mode according to the attribute of the user U. Further, the control device 10 may output a sound according to the attribute of the user U. For example, when the input / output device 100 receives a voice, the control device 10 performs voice recognition and identifies the user U who has issued the voice. Then, the control device 10 acquires various attributes such as demographic attributes and psychographic attributes of the identified user U from the external server 200. Then, the control device 10 moves the input / output device 100 according to the acquired attribute, and outputs various sounds in a mode according to the acquired attribute.

  For example, when the user U is an old man, the size of the voice emitted by the user U is small, and it may be difficult to recognize. Moreover, when the user U is an old man, it is also considered that the user U is difficult to hear the sound. Therefore, when the age of the user U exceeds the predetermined threshold, the control device 10 may move the input / output device 100 to a position closer to the user U. Further, when the age of the user U exceeds a predetermined threshold, the control device 10 may further increase the volume of the sound to be output. By executing such processing, the control device 10 can make it easier to receive the voice of the user U, and can appropriately deliver various sounds to the user U. When a plurality of users U exist, the control device 10 may move the input / output device 100 to a position according to the attribute of each user U.

  In addition to the age of the user U, the control device 10 may move the input / output device 100 according to the attributes of various users, and the type and size of the sound output from the input / output device 100, The contents may be changed as appropriate.

[4-3. About data linkage]
Here, demographic attributes or psychographic attributes of the user U, or those registered by the user U may be used, based on various histories such as the search history, the position history, the purchase history, etc. of the user U. It may be estimated. Also, the attribute of the user U may be obtained through a plurality of services, or may be estimated from the information of the user U obtained through a plurality of services.

  For example, when the received sound includes the voice emitted by the user U, the control device 10 is information related to the user U, and the information acquired by the first enterprise is different from the information acquired by the first enterprise. The input / output device may be moved in a movement mode according to the information acquired by the second operator. In addition, when the received sound includes the voice emitted by the user U, the control device 10 is information on the user U and is different from the information acquired by the first enterprise and the first enterprise. The sound of the content according to the information acquired by the second enterprise may be output from the input / output device 100.

  For example, FIG. 5 is a diagram illustrating an example of control processing that the control device according to the embodiment executes based on different business entity data. In the example illustrated in FIG. 5, the example in which the control device 10 is installed in the housing of the input / output device 100 has been described.

  In the example illustrated in FIG. 5, the input / output device 100 can communicate with the first provider server 210 used by the first provider and the second provider server 220 used by the second provider. For example, the first provider server 210 is a server device used by the first provider. For example, the first enterprise provides the user U with various services such as an online shopping mall and a web search.

  The second provider server 220 is a server device used by the second provider. For example, the second operator provides the user U with services such as content distribution service such as music and moving images, provision of various terminal devices used by the user U, and content distribution to the terminal device. In addition, if a 1st entrepreneur and a 2nd entrepreneur do business individually, respectively, you may provide the service of the same type with respect to the user U. FIG.

  In such a case, for example, the first provider server 210 acquires information of the user U via the service provided by the first provider (step S1). For example, when the first enterprise provides a service related to the online shopping mall, the first enterprise server 210 may purchase the purchase history of the user U, the history of the product browsed by the user U, the search query input by the user U The user U obtains various information such as the address of the product set by the user U, the credit card number of the user U, the address of the user U, the name, the age, the telephone number, the e-mail address and the like. Then, the first provider server 210 provides the information of the user U acquired by the first provider to the input / output device 100 (step S2).

  In addition, for example, the second enterprise server 220 acquires information of the user U via the service provided by the second enterprise (step S3). For example, when the second enterprise provides a service for providing a terminal device, the second enterprise server 220 may include an operation history of the user U, a position history of the user U, an address of the user U, a name, an age, Get various information such as phone number, email address etc. Then, the second provider server 220 provides the information of the user U acquired by the second provider to the input / output device 100 (step S4).

  In such a case, the input / output device 100 uses the information acquired by the first enterprise and the information acquired by the second enterprise in an integrated manner, and the movement mode and the output mode for the voice emitted by the user U Are determined (step S5). For example, the input / output device 100 combines the information acquired by the first enterprise with the information acquired by the second enterprise, centering on arbitrary information such as the address, name, age, and telephone number of the user U. Conduct and integrate various information on the user U. Then, the input / output apparatus 100 estimates the attribute of the user U based on the integrated information, and determines the movement mode and the output mode according to the estimated attribute. Thereafter, the input / output apparatus 100 moves in the determined movement mode, and outputs the sound in the determined output mode (step S6). As a result, the input / output device 100 can provide various services to the user U in a more appropriate manner.

[4-4. Other]
Further, among the processes described in the above embodiment, all or a part of the process described as being automatically performed can be manually performed, and conversely, the process described as being manually performed. All or part of can be performed automatically by known methods. In addition, information including processing procedures, specific names, various data and parameters shown in the above-mentioned documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

  Further, each component of each device illustrated is functionally conceptual and does not necessarily have to be physically configured as illustrated. That is, the specific form of the distribution and integration of each device is not limited to the illustrated one, and all or a part thereof may be functionally or physically dispersed in any unit depending on various loads, usage conditions, etc. It can be integrated and configured.

  Moreover, it is possible to combine suitably each embodiment mentioned above in the range which does not contradict process content.

[4-5. program〕
Further, the control device 10 according to the above-described embodiment is realized by, for example, a computer 1000 configured as shown in FIG. FIG. 6 is a diagram illustrating an example of the hardware configuration. The computer 1000 is connected to an output device 1010 and an input device 1020, and a form in which an arithmetic device 1030, a primary storage device 1040, a secondary storage device 1050, an output IF (Interface) 1060, an input IF 1070, and a network IF 1080 are connected by a bus 1090. Have.

  The arithmetic unit 1030 operates based on a program stored in the primary storage unit 1040 or the secondary storage unit 1050, a program read from the input unit 1020, etc., and executes various processing. The primary storage device 1040 is a memory device, such as a RAM, temporarily storing data used by the computing device 1030 for various operations. Further, the secondary storage device 1050 is a storage device in which data used by the arithmetic unit 1030 for various calculations and various databases are registered, and a ROM (Read Only Memory), an HDD (Hard Disk Drive), a flash memory, etc. Is realized by

  The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information such as a monitor and a printer. For example, USB (Universal Serial Bus), DVI (Digital Visual Interface), or the like It is realized by a connector of a standard such as HDMI (High Definition Multimedia Interface). The input IF 1070 is an interface for receiving information from various input devices 1020 such as a mouse, a keyboard, and a scanner, and is realized by, for example, USB or the like.

  The input device 1020 may be, for example, an optical recording medium such as a compact disc (CD), a digital versatile disc (DVD), a phase change rewritable disc (PD), a magneto-optical recording medium such as a magneto-optical disc (MO), or a tape. It may be a device that reads information from a medium, a magnetic recording medium, a semiconductor memory, or the like. The input device 1020 may also be an external storage medium such as a USB memory.

  The network IF 1080 receives data from another device via the network N and sends it to the computing device 1030, and transmits data generated by the computing device 1030 via the network N to the other device.

  The arithmetic device 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the processing unit 1030 loads a program from the input unit 1020 or the secondary storage unit 1050 onto the primary storage unit 1040 and executes the loaded program.

  For example, when the computer 1000 functions as the control device 10, the computing device 1030 of the computer 1000 implements the function of the control unit 40 by executing the program loaded onto the primary storage device 1040.

[5. effect〕
As described above, the control device 10 controls the input / output device 100 having a reception function for receiving a sound, an output function for outputting a sound, and a movement function. Further, the control device 10 moves the input / output device 100 according to the sound received by the reception function of the input / output device 100. Then, using the output function of the input / output device 100, the control device 10 causes the input / output device 100 to output a sound corresponding to the sound received by the reception function. Therefore, the control device 10 can realize diversification of services provided by the input / output device 100.

  Further, the control device 10 specifies the type of sound accepted by the acceptance function. Then, the control device 10 moves the input / output device 100 according to the specified type of sound. For example, the control device 10 specifies whether the type of the sound accepted by the accepting function is the voice emitted by the user U or the sound emitted by the predetermined device, and the identified type of the sound is voice The input / output device 100 is moved in accordance with whether there is a sound generated by a predetermined device. Also, for example, the control device 10 moves the input / output device 100 according to the size of the sound received by the reception function. Therefore, the control device 10 can output the sound from the input / output device 100 at an appropriate position according to the received sound.

  Further, the control device 10 outputs a sound corresponding to whether the specified type of sound is a sound or a sound emitted by a predetermined device. Therefore, the control device 10 can cause the input / output device 100 to output a sound corresponding to the received sound.

  Further, in the control device 10, when the sound accepted by the acceptance function is a voice uttered by the user U and the content of the voice can not be identified, the input / output device 100 is directed to the user U. Move For this reason, the control device 10 can perform an interview with the user U in an appropriate manner.

  Further, the control device 10 moves the input / output device 100 to a position identified based on the sound received by the reception function, which is easy for the user U to view the sound emitted by the input / output device 100. Therefore, the control device 10 can output a sound desired to be viewed to each user U in an appropriate manner.

  In addition, when the magnitude of the sound output from the predetermined device exceeds the predetermined threshold, the control device 10 moves the input / output device 100 in the direction of the predetermined device, and the sound and phase output from the predetermined device Output the opposite sound. Therefore, the control device 10 can realize noise canceling of various devices in an appropriate manner.

  In addition, when the magnitude of the sound emitted from the surroundings of the user U exceeds the predetermined threshold value, the control device 10 moves the input / output device 100 in the direction of the user U, and the control device 10 performs the predetermined process for the user U. Output a sound to notify the content. For this reason, the control device 10 can alert the user U who emits noise in an appropriate manner.

  In addition, the control device 10 is installed in a housing of the input / output device 100, and controls a driving component for exhibiting the moving function of the input / output device 100 according to the sound received by the reception function. Therefore, the control device 10 can appropriately control the input / output device 100.

  Further, when the reception function includes the voice uttered by the user U, the control device 10 is information related to the user U and is different from the information acquired by the first enterprise and the first enterprise. 2 Move the input / output device 100 in a movement mode according to the information acquired by the business operator. Further, when the reception function includes the voice uttered by the user U, the control device 10 is information related to the user U and is different from the information acquired by the first enterprise and the first enterprise. 2 Make the sound of the content according to the information acquired by the company be output. For this reason, the control device 10 can provide various services to the user U according to the information acquired by the different business operators.

  The input / output device 100 also has a reception function (for example, the microphone 50) for receiving a sound, and an output function (for example, the speaker 60) for outputting a sound. The input / output device 100 also has a drive unit 80 that moves the input / output device 100. Further, the input / output device 100 controls the drive unit 80 to move the input / output device 100 in accordance with the sound received by the reception function. Then, using the output function, the input / output device 100 outputs a sound corresponding to the sound received by the reception function. Therefore, the input / output device 100 can realize diversification of the service to be provided.

  Although the embodiments of the present application have been described in detail based on the drawings, this is an example, and various modifications and improvements can be made based on the knowledge of those skilled in the art, including the embodiments described in the section of the description of the invention. It is possible to practice the invention in other forms as well.

  In addition, the "section (module, unit)" described above can be read as "means" or "circuit". For example, the acquisition unit can be read as an acquisition unit or an acquisition circuit.

DESCRIPTION OF REFERENCE NUMERALS 10 control device 20 communication unit 30 storage unit 31 audio database 32 music database 40 control unit 41 reception unit 42 identification unit 43 movement control unit 44 output control unit 50 microphone 60 speaker 70 motor 80 drive unit 100 input / output device 120 communication unit 130 storage Unit 140 Control unit 200 External server

Claims (19)

A control device for controlling an input / output device having a reception function for receiving a sound, an output function for outputting a sound, and a movement function,
A movement control unit for moving the input / output device in the direction of the user when the magnitude of the sound emitted from the surroundings of the user exceeds a predetermined threshold;
When the input / output device is moved to the vicinity of the user under the control of the movement control unit, the input / output device uses the output function of the input / output device to call attention to the user. And an output control unit for outputting data from the control unit. A control device for controlling an input / output device having a reception function for receiving a sound, an output function for outputting a sound, and a movement function,
The sound received by the reception function of the input / output device is input to a position where the plurality of users can easily hear the sound output by the input / output device based on voices emitted by the plurality of users. A movement control unit for moving the output device;
When the input / output device is moved by the control of the movement control unit, an output that causes the input / output device to output a sound corresponding to the sound received by the reception function using the output function of the input / output device And a control unit. It has a specific part which specifies the classification of the sound which the above-mentioned acceptance function received,
The control device according to claim 1, wherein the movement control unit moves the input / output device according to a type of sound specified by the specification unit. The specifying unit specifies whether the type of the sound accepted by the accepting function is a sound emitted by a user or a sound emitted by a predetermined device,
The movement control unit moves the input / output device according to whether the type of the sound specified by the specifying unit is the voice or the sound emitted by the predetermined device. Item 4. A control device according to item 3. The output control unit according to claim 4, wherein the output control unit outputs a sound according to whether the type of the sound specified by the specifying unit is the sound or the sound emitted by the predetermined device. Control device. The control device according to any one of claims 1 to 5, wherein the movement control unit moves the input / output device according to the size of the sound received by the reception function. When the sound received by the reception function is a voice emitted by the user and the content of the voice can not be specified, the movement control unit is configured to move the input / output device toward the user The controller according to any one of claims 1 to 6, wherein the controller is moved. The movement control unit moves the input / output device to a position identified based on the sound received by the reception function, the position where the user can easily view the sound emitted by the input / output device. The control device according to any one of claims 1 to 7, characterized in that: The movement control unit moves the input / output device in the direction of the predetermined device when the magnitude of the sound output from the predetermined device exceeds a predetermined threshold.
The control device according to any one of claims 1 to 8, wherein the output control unit outputs a sound whose phase is opposite to that of the sound output from the predetermined device. The movement control unit moves the input / output device in the direction of the user when the magnitude of the sound emitted from the surroundings of the user exceeds a predetermined threshold.
The control device according to any one of claims 1 to 9, wherein the output control unit outputs a sound notifying a predetermined content to the user.   The drive component installed in the housing of the input / output device and controlling the movement function of the input / output device according to the sound received by the reception function is controlled. The control device according to any one of the above. The movement control unit is, when the reception function includes voices uttered by the user, information relating to the user, and the information acquired by the first enterprise is different from the information acquired by the first enterprise and the first enterprise. The control device according to any one of claims 1 to 11, wherein the input / output device is moved in a movement mode according to the information acquired by the second company. The output control unit is information related to the user when the reception function includes voices uttered by the user, and the information different from the information acquired by the first enterprise and the first enterprise. The control device according to any one of claims 1 to 12, wherein a sound of contents corresponding to the information acquired by the second company is output. An input / output device having a reception function for receiving a sound and an output function for outputting a sound,
A drive unit for moving the input / output device;
A movement control unit that controls the drive unit to move the input / output device in the direction of the user when the magnitude of the sound emitted from the surroundings of the user exceeds a predetermined threshold;
An output control unit configured to output a voice for calling the user's attention by using the output function when the input / output device is moved to the vicinity of the user under the control of the movement control unit; An input / output device characterized by A control method is executed by a control device that controls an input / output device having a reception function for receiving a sound, an output function for outputting a sound, and a movement function,
A movement control step of moving the input / output device in the direction of the user if the magnitude of the sound emitted from the surroundings of the user exceeds a predetermined threshold;
When the input / output device is moved to the vicinity of the user by the control of the movement control process, the input / output device uses an output function of the input / output device to call attention to the user. And an output control step of outputting from the control method. In a computer for controlling an input / output device having a reception function for receiving sound, an output function for outputting sound, and a movement function,
A movement control procedure for moving the input / output device in the direction of the user when the magnitude of the sound emitted from the surroundings of the user exceeds a predetermined threshold;
When the input / output device is moved to the vicinity of the user by the control according to the movement control procedure, the input / output device uses the output function of the input / output device to call attention to the user. Control program to execute output control procedure to be output from. An input / output device having a reception function for receiving a sound and an output function for outputting a sound,
A drive unit for moving the input / output device;
To the position where the plurality of users can easily hear the sound output from the input / output device by controlling the drive unit based on the voices received by the reception function and emitted by the plurality of users And a movement control unit for moving the input / output device;
When the input / output device is moved by the control of the movement control unit, the output control unit is used to output a sound according to the sound received by the reception function using the output function. I / O device. A control method is executed by a control device that controls an input / output device having a reception function for receiving a sound, an output function for outputting a sound, and a movement function,
The sound received by the reception function of the input / output device is input to a position where the plurality of users can easily hear the sound output by the input / output device based on voices emitted by the plurality of users. A movement control step of moving the output device;
When the input / output device is moved by the control of the movement control process, an output is made to output from the input / output device a sound according to the sound received by the reception function using the output function of the input / output device And a control step. In a computer for controlling an input / output device having a reception function for receiving sound, an output function for outputting sound, and a movement function,
The sound received by the reception function of the input / output device is input to a position where the plurality of users can easily hear the sound output by the input / output device based on voices emitted by the plurality of users. A movement control procedure for moving the output device;
When the input / output device is moved by control according to the movement control procedure, an output that causes the input / output device to output a sound according to the sound received by the reception function using the output function of the input / output device Control program to execute control procedure and.

Images