JP2018006822A - Voice output system and voice output method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice output system capable of delivering a high-quality voice by easily and surely performing adjustment in accordance with a situation at a recipient side, and a voice output method.SOLUTION: A voice output system comprises: a voice acquisition part 12 for acquiring voice data of a caller; a voice reproduction part 14 for extracting a voice signal and defining it as a reproduction voice signal; and a speaker device 6. The speaker device 6 is configured by including at least: a speaker main body part 61 for outputting sonic waves to a main output direction side that is a recipient side and a sub output direction side that is any other direction than the main output direction side, in accordance with the reproduction voice signal; and a reflector 62 that is disposed at the sub output direction side with respect to the speaker 61. Angle adjustment command parts 16, 17 and 18 are provided for changing an angle of the reflector 62 relative to the speaker main body part 61 in accordance with information indicating a situation at a recipient side.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an audio output system and an audio output method, and more particularly, to an audio output system and an audio output method for causing an audio output to follow the number or position of random interlocutors.

It is already known that persons in remote locations, such as video conferencing, use communication technology to check each other's images in real time.
Furthermore, although it is desired that the voice of the speaker is also transmitted at the same time, a technique for accurately outputting the voice received at the receiver side is required.
In other words, outputting the received voice data to the conversation person is realized using a speaker, but a technique for outputting a voice that is easier to hear on the receiver side is required (for example, see Patent Document 1). ).

Patent Document 1 discloses a system in which speakers are mounted on both sides of a television.
In this system, a reflector is installed on the rear side of the sound source, and the sound radiated to the rear side of the sound source (and the sound reflected by the board for improving low frequency characteristics) is reflected by this reflector. Will move forward. For this reason, the sound radiated to the front side of the sound source and the sound reflected by the reflecting plate and proceeding to the front side are synthesized, and a low frequency band can be expanded.
And this reflector can change an angle.
As described above, the system according to Patent Document 1 is configured to improve the quality of sound generated from the sound source by changing the angle of the reflecting plate and to transmit it to the receiver side.

Japanese Unexamined Patent Publication No. 64-890

As described above, in the technique of Patent Document 1, efforts are made to convey high-quality sound to the receiver side, but the output position and range cannot be freely finely adjusted.
That is, in the technique of Patent Document 1, the angle of the reflector is changed to provide a high-quality sound to the receiver side, but there is a current position on the receiver side, the number of receivers, and a plurality of receivers. In this case, the occupied area (that is, the range in which high-quality sound is output) or the like cannot be finely adjusted in each case.
For example, when it is desired to output sound over a wide area, it is necessary to use a speaker with a wide diffusion range or to install a large number of speakers in the direction in which the sound is to be output. In addition, a special device capable of rotating the speaker is required.
However, if a large number of speakers are to be used, there are problems such that the installation position is required correspondingly, the apparatus becomes complicated, and peripheral devices (amplifiers, etc.) increase with the increase in the number of speakers. In addition, when a special device capable of rotating is employed, the structure becomes complicated and the cost increases.
Further, for example, an ultrasonic speaker or the like may be used, and such a speaker uses reflected sound, but does not use both direct sound and reflected sound.
In addition, when a speaker is mounted on a video display device, a configuration that can store the speaker when not in use is also desired in consideration of space problems, design, and prevention of damage.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems, and an audio output system and an audio output method capable of delivering high-quality audio by simply and surely adjusting according to the situation on the receiver side. It is about.
Another object of the present invention relates to an audio output system and an audio output method that can be stored in a video display device when they are not necessary.

  According to the audio output system of the present invention, the above-described problem is that an audio acquisition unit that acquires the caller's audio data, an audio reproduction unit that extracts the audio signal acquired by the audio acquisition unit and uses it as a reproduction audio signal, and A playback sound output unit that receives the playback sound signal from the sound playback unit and emits it as a playback sound to the receiver, and the playback sound output unit is on the receiver side according to the playback sound signal A speaker main body that outputs sound waves to a main output direction side and a sub output direction side that is a direction other than the main output direction side, and a reflection disposed on the sub output direction side with respect to the speaker main body portion And an angle adjustment command unit that changes the angle of the reflector with respect to the speaker main body according to information indicating the situation on the receiver side. Is solved.

  Further, according to the voice output method according to the present invention, the above-described problem is that the receiver position information acquisition unit of the control device is information indicating the status of the receiver acquired by the position information acquisition device. The position specifying unit of the control device analyzes the receiver position information and specifies the position of the receiver as coordinates on virtual coordinates, and the angle calculation unit of the control device. Receiving and analyzing coordinates indicating the position of the receiver, calculating a moving angle of a reflector mounted on the speaker device as an angle with respect to a speaker main body mounted on the speaker device, and the control device The operation command unit receives the calculation result of the angle calculation unit, transmits an operation signal for commanding the movement of the reflecting plate to the speaker device, and moves the reflecting plate; and the sound of the control device A step in which the acquisition unit acquires the voice data on the caller side, and a voice reproduction unit of the control device extracts the voice signal acquired by the voice acquisition unit as a reproduced voice signal, and the reproduced voice signal is the speaker. And the step of transmitting to the main body.

Thus, in the audio output system according to the present invention, the angle of the reflector with respect to the speaker main body can be changed by the information indicating the situation on the receiver side.
This reflector can change an angle with respect to a speaker main-body part.
In other words, a part of the sound wave output to the main output side and the sub output side is reflected so that the reflected wave and the direct wave reach the receiver side, so that the receiver reproduces more clearly. The sound can be heard.
Furthermore, in the present invention, the relative angle of the reflector with respect to the speaker main body can be changed according to information indicating the situation on the receiver side. This information is information indicating the number of receivers, the arrangement, the purpose of audio hearing, etc., and by determining the reflection direction of the sound wave according to at least one of these information, the receiver more clearly reproduces the reproduced sound. Can be heard.
Here, the “main output direction side” refers to the side where the receiver exists, and the “sub output direction side” refers to all directions other than the “main output direction side”.
Further, “changing the angle of the reflector with respect to the speaker body” means “changing the relative angle of the reflector with respect to the speaker body”, and even when only the reflector moves. Alternatively, the speaker main body may be moved together. In addition, “a configuration in which the relative angle of the reflector with respect to the speaker main body is directly commanded” may be used, or a reflector with respect to another reference object (for example, an attached object in which a part of the reflector is rotatably attached). The configuration may be such that the relative angle of the reflector is commanded, and as a result, the relative angle of the reflector with respect to the speaker body is changed.

At this time, the speaker main body generates sound waves from two directions, that is, a surface on the receiver side and a back surface on the opposite side to the surface, and the main output direction is the reception direction. It is preferable that the second output side is the back side, and the reflector is disposed on the back side, while being on the front side, which is the person side.
In other words, when the speaker main body is a flat plate type that outputs sound from the front and back surfaces, the receiver side is directed with this one surface as the main output direction, and the side facing the back surface is defined as the secondary output side.
And if the reflector is placed so as to cover the back side of the speaker body that is the secondary output side, the sound wave output to the secondary output side is reflected to the primary output side (receiver side) The person can hear the playback sound clearly.

More specifically, the information indicating the situation on the receiver side is information indicating the location of the receiver or the purpose of use of the receiver, so that the direction of sound wave reflection can be accurately commanded. Is preferred.
More specifically, a receiver position information acquisition unit that acquires receiver position information, which is information indicating the status of the receiver acquired by the position information acquisition device, includes the angle adjustment command unit, Analyzing the receiver position information, analyzing the position specifying unit that specifies the position of the receiver as coordinates on the virtual coordinates, and the coordinates indicating the position of the receiver, and calculating the movement angle of the reflector An angle calculation unit, and an operation command unit that designates information related to the movement angle of the reflector from the angle calculation result received from the angle calculation unit and commands the speaker device to move the reflector. It is preferable that it is configured.
With such a configuration, since the arrangement of the receiver can be specified, the receiver can hear the reproduced sound more clearly.
At this time, it is preferable that the position information acquisition device includes at least one of an imaging device and a measurement device provided on the receiver side.
A camera is preferably used as the imaging device, and an infrared sensor is preferably used as the measurement device.

Furthermore, as another specific example, a storage unit storing a use purpose table in which the use purpose of the receiver and the movement angle of the reflector are associated with each other, and a signal indicating the use purpose are received, It is preferable to have an operation command unit that reads a moving angle of the reflecting plate from a use purpose table and commands the speaker device to move the reflecting plate.
In addition, according to the audio output method of the present invention, the above problem is that a speaker main body that vibrates air and outputs sound waves, a part of the air vibration of the speaker main body is reflected, and the speaker main body A speaker device comprising: a reflector plate movable to form a predetermined angle; and a method of outputting sound to a receiver side, wherein a control device uses the receiver for the purpose of use and the speaker body A step of reading the movement angle of the reflecting plate with respect to the use purpose of the specified recipient from the use purpose table in which the movement angle of the reflecting plate with respect to the unit is associated, and the operation command unit of the control device reads An operation signal for instructing movement of the reflecting plate in response to the movement angle of the reflecting plate is transmitted to the speaker device, and the sound acquisition unit of the control device is configured to move the reflecting plate, Caller side Obtaining voice data; and a step in which the audio reproduction unit of the control device extracts the audio signal acquired by the audio acquisition unit to obtain a reproduction audio signal, and transmits the reproduction audio signal to the speaker body unit; It is solved by doing.
The purpose of use is the purpose of the receiver using the system. For example, when the receiver talks alone, or when multiple listeners listen to the lecture, the sound output of the speaker body is output. It is desirable to change the range.
In other words, when there is only one receiver, it is only necessary to output a playback sound so as to show directivity toward that one receiver. Therefore, it is necessary to output the reproduced sound so that it is easy to perform. For this reason, it is necessary to deliver the sound wave to a wider range than the former.
As described above, when the intended use of the receiver is determined, the output range of the reproduced sound can be estimated, and when the movement of the reflector is instructed so that the sound wave reaches in accordance with this estimation, the above-described reception Similar to the system for acquiring the coordinates of the person, the recipient of the system can hear the reproduced sound more clearly.

In addition, a video display device that acquires a captured video when the sender's imaging device captures the sender and displays it on a display provided on the receiver side, and the video display device, It is preferable that at least one speaker device is mounted.
As described above, it is preferable that the video display device is provided because not only auditory information but also visual information (video information) can be received.

More specifically, at least a part of the reflector is attached to the speaker body or the video display device, and the reflector is attached to the speaker body or the video display device. It is preferable that the position is pivoted with respect to the speaker main body or the video display device.
More specifically, the video display device is a box type, and is a surface facing the receiver side, the display device surface on which the display device is disposed, and a display facing the display device surface. A display device side surface, and a display device side surface connecting the display device surface and a side extending in the vertical direction of the display device back surface. At least a part of the speaker device is attached to the display device side surface. In addition, it can be used between a storage position along the side surface of the display device and a deployment position developed at a predetermined angle with the side surface of the display device. If not, it is stored in the storage position, which is preferable because it is compact.

Furthermore, as another specific example, the video display device is a box type, and is a surface facing the receiver side, the surface of the display device on which the display is arranged, and the surface of the display device. A display device back surface, and a display device side surface connecting the display device surface and sides extending in the vertical direction of the display device back surface, and the speaker body is disposed on the display device surface. The display device side surface is the reflection plate, and a space between the storage position that is the position of the display device side surface and the unfolded position that is a position that covers the auxiliary output direction side of the speaker main body. It is preferable that it is movable.
If configured in this way, it is stored in the storage position when not in use, which is compact and suitable, and the side surface of the display device and the reflection plate can be used in common. It is advantageous.
Furthermore, since the speaker body does not protrude in the width direction from the side surface of the display device, the structure is compact even in use.

In the present invention, the angle of the reflector disposed on the sub-output side of the speaker body can be easily changed according to the situation on the receiver side. Thereby, the sound wave radiated to the sub output direction side (the side opposite to the side where the receiver is arranged) can be reflected to the main output direction side (the side where the receiver is arranged), and the main output direction side Can deliver a clearer sound.
Furthermore, in the present invention, the speaker device (including only one of the speaker body and the reflector) is moved between the retracted state and the unfolded state with respect to the video display device. As a result, the speaker device can be unfolded to convey high-quality sound to the receiver side when in use, and the speaker device can be stored compactly when not in use.

It is a schematic explanatory drawing which shows the audio | voice output system which concerns on 1st embodiment of this invention. It is explanatory drawing which shows the structure of the network system which concerns on 1st embodiment of this invention. It is explanatory drawing which shows the outline of the communication unit which concerns on 1st embodiment of this invention. It is a block diagram which shows the function of the server computer which concerns on 1st embodiment of this invention. It is operation | movement explanatory drawing of the speaker apparatus which concerns on 1st embodiment of this invention. It is a condition figure of the function test of the speaker apparatus which concerns on 1st embodiment of this invention. It is a graph which shows the result of the function test of the speaker apparatus which concerns on 1st embodiment of this invention. It is a chart which shows the reflector angle adjustment flow which concerns on 1st embodiment of this invention. It is a figure explaining the process of the position specific part (single row) which concerns on 1st embodiment of this invention. It is a figure explaining the process of the angle calculating part (single row) which concerns on 1st embodiment of this invention. It is a figure explaining the process of the operation command part (single row) which concerns on 1st embodiment of this invention. It is a figure explaining the process of the position specific part (double row) which concerns on 1st embodiment of this invention. It is a figure explaining the process of the angle calculating part (double row) which concerns on 1st embodiment of this invention. It is a figure explaining the process of the operation command part (double row) which concerns on 1st embodiment of this invention. It is explanatory drawing which shows the use purpose table which concerns on 2nd embodiment of this invention. It is a chart which shows the reflector angle adjustment flow which concerns on 2nd embodiment of this invention. It is explanatory drawing which shows the 1st modification of this invention. It is explanatory drawing which shows the 2nd modification of this invention. It is explanatory drawing which shows the 3rd modification of this invention.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
Note that the configuration described below does not limit the present invention and can be variously modified within the scope of the gist of the present invention.
The present embodiment relates to an audio output system provided with a speaker device for a box-type video display device.
In the present embodiment, the example in which the video display device is provided so that the video related to the output sound can be displayed together is shown, but the present invention is not limited to this, and the video device is necessarily required. Do not mean.
That is, as a hardware configuration, a position information acquisition device (which may be an infrared sensor or a camera may be used in the following embodiments) that is a means by which the arrangement of the recipient can be specified is provided and a sound is output. And a reflector that reflects sound waves output from the speaker main body in the sub-output direction (the direction other than the receiver side) are sufficient. And the angle of this reflector is changed according to a receiver's positional information.
In the following, an embodiment of the present invention will be described.

1 to 14 show a first embodiment for embodying the present invention. FIG. 1 is a schematic explanatory view showing an audio output system. FIG. 2 is an explanatory view showing a configuration of a network system. 3 is an explanatory diagram showing an outline of the communication unit, and FIG. 4 is a block diagram showing functions of the server computer. In the second embodiment and the modified example, the configurations of FIGS. 1 to 3 are the same configurations. Regarding FIG. 4, there are some differences in the second embodiment, but these differences will be described in the description of the second embodiment.
FIG. 5 is an explanatory diagram of the operation of the speaker device, FIG. 6 is a condition diagram of the function test of the speaker device, and FIG. 7 is a graph showing the result of the function test of the speaker device.
5 to 7, the operation of the speaker device according to the first embodiment and the verification result of the function of the reflector will be described.
8 is a chart showing the reflector angle adjustment flow, FIG. 9 is a diagram for explaining the processing of the position specifying unit (single row), and FIG. 10 is a diagram for explaining the processing of the angle calculating unit (single row). 11 is a diagram for explaining the processing of the operation command unit (single row), FIG. 12 is a diagram for explaining the processing of the position specifying unit (double row), FIG. 13 is a diagram for explaining the processing of the angle calculation unit (double row), FIG. 14 is a diagram for explaining the processing of the operation command unit (double row).
As described above, in FIGS. 8 to 14, a method for adjusting the angle of the reflector according to the first embodiment will be described with reference to the flowchart.
15 and 16 show a second embodiment for embodying the present invention. FIG. 15 is an explanatory view showing a purpose table, and FIG. 16 is a chart showing a reflector angle adjustment flow. is there.
FIGS. 17 to 19 show modified examples of the above embodiment, and show first to third modified examples, respectively.

<First embodiment>
<< Overview of Network System According to this Embodiment >>
First, an outline of a network system according to the present embodiment (hereinafter, system S) will be described. This system S is a communication system constructed so that users who are away from each other confirm each other's video in real time and transmit audio in real time.
More specifically, a video display device 5 is installed at a place where each user is present, and the video display device 5 is provided with a display 51.
The display 51 displays the real-time video of the other user. Thereby, each user can use the other party's real-time image | video through the display 51 installed in the place where he exists.

Further, each user can listen to the sound (strictly speaking, the reproduced sound of the sound) uttered by the other user through the speaker device 6 installed in the place where the respective user is present. Therefore, through communication using the system S, each user can listen to the voice uttered by the counterpart user and the voice around the counterpart user while watching the video of the counterpart user. Thereby, it is possible for each user to obtain a sense of reality (visual effect) as if they are actually facing each other even though they are located at a distance from each other. Note that the voices uttered by each user side and the voices around them can also be delivered to the counterpart user, and two-way communication is realized.
Each user corresponds to a “recipient” who uses the display video on the display 51 and the sound emitted from the speaker device 6.

  Since the present system S has the effects described above, it can be used for various purposes. For example, each user has a conversation while staying at their home, one user is providing a service to the other user who is far away, or one user is giving a lecture to the other user who is far away This system S is used in scenes such as taking lessons. Thus, the present system S can be widely used in situations where users in different places interact with each other while looking at the faces of the other party.

In order to make the explanation easy to understand, a case where one user is a user A and the other user is a user B and a pseudo-face-to-face call is performed between the two users will be described as an example. . Further, the following description will be made from the viewpoint of the user A (that is, the position of the user B using the voice and video). In this case, user A corresponds to the “recipient” and user B corresponds to the “sender”. The contents described below are the same from the viewpoint on the user B side (that is, the position on the user A's voice and video side). That is, the device configuration and the operation of each device described below are common to the user A side and the user B side.
Further, in the following description, a case where there are a plurality of recipients (that is, user A) will be described, and the plurality of users A will be referred to as user A1, user A2,. n is an integer given in ascending order).

<< Configuration of Audio Output System According to this Embodiment >>
Next, the device configuration of the system S will be described with reference to FIGS. The system S is configured by an audio output system 100 capable of information communication installed in a place where each user is present. If it demonstrates concretely, the audio | voice output system 100 is each provided in the place where the user A and the user B exist at the time of pseudo | simulation face-to-face conversation. As shown in FIG. 2, the user A side audio output system 100 and the user B side audio output system 100 are both connected to the external communication network GN.

  Hereinafter, a configuration example of the audio output system 100 according to the present embodiment will be described. Note that the audio output system 100 on the user A side and the audio output system 100 on the user B side are substantially the same except that the installation location and the video and audio to be distributed are different. Therefore, only a configuration example of the audio output system 100 on the user A side will be described below.

As shown in FIG. 2, the user A side audio output system 100 includes a server computer 1, a camera 2, a microphone 3, an infrared sensor 4, a video display device 5, and a speaker device 6 as main components.
The camera 2 is a photographing device that photographs an image of a subject within a photographing range (angle of view), and is configured by a known network camera in the present embodiment. As shown in FIG. 3, the camera 2 is installed at a position directly above the display 51. Further, the camera 2 according to the present embodiment captures the user A and the surrounding video when the user A stands in front of the display 51 provided in the video display device 5. In the present embodiment, since it is assumed that there are a plurality of users A within the angle of view, all of the plurality of users A can be photographed.
The camera 2 may be configured to function as a “position information acquisition device”. That is, the image data acquired by the camera 2 is subjected to image processing to acquire coordinates indicating the position of the object (the user A in the present embodiment) with respect to a predetermined origin O position, and an infrared sensor described later. 4 (which functions as “position information acquisition means”) is combined with position information including depth information of the object or corrected, and coordinates indicating the position of the object (user A) in more detail are obtained. You may be comprised so that it can specify.

The microphone 3 is a device that collects sound generated in a place where the user A is present during the pseudo face-to-face conversation, and is configured by a known microphone. In the present embodiment, as shown in FIG. 3, the microphone 3 is installed immediately below the display 51. Note that the position of the microphone 3 is not limited to this, and may be any position where sound can be collected appropriately. For example, the microphone 3 may be installed at a position directly above the display 51.
In the present embodiment, the user A listens to the sound produced by the user B as the reproduced sound. That is, the sound around the user B is collected from the microphone 3 similarly set on the user B side, and the user A hears it as a reproduced sound.

  The infrared sensor 4 is a so-called infrared sensor, and is installed at a position immediately above the display 51 and adjacent to the camera 2 as shown in FIG. The infrared sensor 4 is a measuring device that measures a three-dimensional position including the depth of the measurement object. Specifically, the infrared sensor 4 irradiates infrared rays toward the measurement object, receives the reflected light, and acquires position information based on the received light intensity at that time. Here, the “depth” specifically refers to the distance from the reference position to the measurement object (that is, the depth distance). Incidentally, in the present embodiment, the front position of the display 51 is set as the reference position. However, the reference position is not limited to the above position, and can be set to an arbitrary position.

  The depth measurement result by the infrared sensor 4 is obtained when a captured image of the camera 2 (strictly speaking, an image of a frame unit constituting the image, hereinafter referred to as a frame image) is divided into a predetermined number of pixels. Obtained for each pixel. Depth data can be obtained by collecting the depth measurement results obtained for each pixel in units of frame images. This depth data is data indicating a depth measurement result for each pixel of the frame image, and is bitmap format data obtained by changing the color and shading of each pixel according to the depth measurement result.

  Further, the depth data corresponds to a captured video (strictly, a frame image) that is captured at the same time as the depth measurement time indicated by the depth data. More specifically, depth data is acquired for a captured video. In other words, if the difference in depth measurement results between pixels is used, it is possible to distinguish between pixels belonging to the background image and pixels belonging to the person image and extract one image out of the pixels constituting the depth data. Become.

Furthermore, as described above, in the present embodiment, the infrared sensor 4 functions as a “positional information acquisition unit”. That is, a three-dimensional position including the depth data acquired as described above is acquired as coordinates.
The coordinates indicating the position of the object (user A) are specified in more detail by combining the depth data and the coordinates indicating the position of the user A acquired from the camera 2 or correcting the other. You may be comprised so that it can do.

The display 51 provided in the video display device 5 is a display that displays video delivered from the audio output system 100 on the user B side and video on the user B side. In the present embodiment, the display 51 is a vertically-long rectangular display as shown in FIG. 3, and is supported by a box-shaped device body 52. And it is installed in the place where the user A exists at the time of a pseudo face-to-face conversation. If it demonstrates more concretely, the display 51 which concerns on this embodiment is a figure-type display, and displays an image | video on the mirror surface part formed in the front.
In the device main body 52, the surface on which the display 51 is arranged (the surface facing the receiver) is “display device front surface 52a”, and the surface opposite to the display device surface 52a is “display device rear surface 52b”. A surface connecting the sides extending in the vertical direction of the front surface 52a and the display device back surface 52b is referred to as a “display device side surface 52c”.

  Further, as shown in FIG. 1, the display 51 according to the present embodiment has a size sufficient to display the whole body image of the user B in a life-size manner. Here, the “whole body image” is an image showing the entire body from the head to the foot, and may be a standing image or a seated image, and is arranged in front. It is a concept that includes a figure in which a part of the body is hidden by an object.

The speaker device 6 is a device that emits sound (reproduced sound) when the sound distributed from the sound output system 100 on the user B side is reproduced. In the present embodiment, as shown in FIG. In the width direction of the device 5, two each are installed at positions sandwiching them.
However, the installation position and the number of installed speaker devices 6 are not limited to the above-described contents, and can be arbitrarily set.
The speaker device 6 according to the present embodiment includes a speaker main body 61 and a reflection plate 62.

The speaker body 61 is constituted by a known speaker.
In the present embodiment, a speaker that outputs sound waves in at least two directions is used as the speaker body 61.
In the present embodiment, the “main output direction” is a direction toward the side where the receiver exists, and the “sub output direction” is a direction toward the opposite side to the main output direction.
The speaker body 61 has a sound source supported by a rectangular frame 61 a (not shown), and one side of the frame 61 a is attached to the display device side surface 52 c of the video display device 5.
Further, the reflection plate 62 is a rectangular plate, and one side of the reflection plate 62 covers the surface of the speaker body 61 or the display device side surface 52c of the video display device 5 on the side of the auxiliary output direction of the speaker body 61. Installed on. The reflector 62 can be rotated with its attachment portion as a fulcrum, and the angle formed by the reflector 62 with respect to the speaker body 61 can be changed by this configuration.
In addition, although the speaker main body 61 according to the present embodiment is fixed to the apparatus main body 52, the present invention is not limited thereto, and the speaker main body 61 may be configured to rotate. Such a configuration will be described in detail later as a modified example.

  The server computer 1 is an example of a computer and controls the audio output system 100. Server computer 1 (hereinafter referred to as user A side server computer 1) provided in the receiver side voice output system and server computer 1 (hereinafter referred to as user B side server computer) provided in the user B side voice output system 100. 1) is communicably connected via an external communication network GN. More specifically, the server computer 1 on the user B side transmits video and audio of the place where the user B is present to the server computer 1 on the user A side during the pseudo face-to-face conversation. In this embodiment, the video is transmitted in the form of encoded digital data, and the audio is incorporated in the video and transmitted together with the video. However, the present invention is not limited to this, and the video and audio may be transmitted separately.

  Further, the server computer 1 on the user A side transmits depth data corresponding to the captured video to the server computer 1 on the user A side at the same time as transmitting the captured video of the camera 2. Further, the server computer 1 on the user A side receives the video, audio and depth data transmitted from the server computer 1 on the user B side through the external communication network GN. Thereafter, the server computer 1 on the user A side controls the video display device 5 and the speaker device 6 in accordance with the received video and audio. As a result, the video received from the server computer 1 on the user B side (that is, the whole body video of the user B and its peripheral video) is displayed on the display 51. Further, the speaker main body 61 emits a reproduced sound of the sound incorporated in the video received from the server computer 1 on the user B side.

<< Detailed Configuration of Server Computer >>
Next, a detailed configuration of the server computer 1 will be described with reference to FIG. In this embodiment, the server computer 1 on the user A side and the server computer 1 on the user B side have substantially the same configuration. Therefore, only the configuration of the server computer 1 on the user A side will be described below.

  The server computer 1 on the user A side includes a CPU, a memory such as a ROM and a RAM, a communication interface, and a hard disk drive as main components. Further, the hard disk drive of the server computer 1 stores a computer program for the server computer 1 to perform the functions described above.

The functions of the server computer 1 on the user A side will be described again. The server computer 1 on the user A side is equipped with various functions related to video display and various functions related to audio output.
More specifically, an audio / video distribution unit 11, an audio / video acquisition unit 12, a video display unit 13, an audio reproduction unit 14, a user position information acquisition unit 15, a position specification unit 16, an angle calculation unit 17, an operation command The unit 18 and the storage unit 19 are provided in the server computer 1 on the user A side.
These units are realized by the cooperation of the above-described hardware device constituting the server computer 1 on the user A side and the computer program installed on the server computer 1 on the user A side. Each part will be described below.

(Audio / Video Distribution Department)
The audio / video distribution unit 11 distributes video and audio of a place where the user A is present during the pseudo face-to-face conversation. The audio / video distribution unit 11 communicates with the camera 2 and the microphone 3 included in the audio output system 100 on the user A side, and acquires the captured video captured by the camera 2 and the audio collected by the microphone 3. Then, the audio / video distribution unit 11 incorporates the acquired audio in the acquired captured video, and distributes the captured video toward the server computer 1 on the user B side.

(Audio / Video acquisition unit)
The audio / video acquisition unit 12 acquires the video and audio by receiving the video transmitted from the server computer 1 on the user B side and the audio embedded in the video via the external communication network GN. To do. In this embodiment, video and audio are transmitted as encoded digital data as described above. For this reason, the video display unit 13 acquires video and the like at the stage where the received video data is decoded.

(Video display section)
The video display unit 13 displays the video on the display 51 by controlling the display 51 based on the video acquired by the audio / video acquisition unit 12.

(Audio playback part)
The audio reproduction unit 14 extracts audio embedded in the video acquired by the audio / video acquisition unit 12 and generates a reproduction sound of the audio from the speaker body unit 61. In the present embodiment, the user A side audio output system 100 is provided with a plurality of speaker devices 6. When generating the playback sound, the audio playback unit 14 sets playback conditions such as the position and volume of the speaker body 61 actually used so as to be linked to the display video on the display 51, and plays back the playback sound according to the set conditions. Is generated. As a result, the presence of the pseudo-face-to-face conversation is further increased.

(User location information acquisition unit)
The user position information acquisition unit 15 acquires the position information of the user A as coordinates. That is, from the information from the infrared sensor 4, the coordinates indicating the position of the object (the user A in the present embodiment) with respect to the predetermined origin O position are acquired.
Specifically, the infrared sensor 4 includes an infrared emission port 41 and a detector 42 that receives reflected light so as to face the user A.

(Location identification part)
For example, in the present embodiment, as shown in FIG. 9, virtual two-dimensional coordinates are defined in a plane space looking down on a space including the user A from above, and the head vertex (axis position) of the user A is defined. The user position point P is used. In the present embodiment, the center point in the width direction of the display device surface 52a is defined as the origin O. Note that the position of the origin O is not limited to this. For example, the center point of the detector 42 may be defined as the origin O, and the center of the emission port 41 and the center of the detector 42 may be in the width direction. A point may be defined as the origin O.
With respect to the origin O defined in this way, one point (head vertex) of the recognized user A is set as the user position point P, and coordinates indicating the position of the user position point P are obtained.
In the infrared sensor 4, virtual three-dimensional coordinates can be acquired, but in the present embodiment, a virtual two-dimensional coordinate system is set without considering the height direction.

Since the coordinate system is defined in this way, the depth direction (that is, the depth direction) acquired from the infrared sensor 4 from the origin O becomes the y-axis of the virtual two-dimensional coordinate, and the direction orthogonal to the y-axis becomes the x-axis.
In other words, on the virtual two-dimensional plane coordinates, the deviation in the width direction of the video display device 5 from the origin O is the x coordinate, and the deviation in the depth direction of the video display device 5 from the origin O is the y coordinate.
Note that the coordinate acquisition method described above is an example, and the present invention is not limited to this. For example, as described above, a virtual three-dimensional coordinate is defined, and an x, y, z coordinate system (in this case, the concept of “height z” is introduced to indicate the position of the user A) As the user position point P, for example, “the barycentric point” may be selected), and the position of the user A may be defined three-dimensionally. Further, the coordinates obtained by the infrared sensor 4 may be corrected by using the coordinates obtained by performing image processing on the imaging data obtained by the camera 2.

Further, in the present embodiment, it is assumed that there are a plurality of users A, and the coordinates indicating the positions of the users A1, A2,... (X1, y1), user position point P2 (x2, y2),..., User position point Pn (xn, yn) can all be acquired (n is an integer given in ascending order). .
Therefore, in the following description, when the user position point P is generalized, it is indicated as the user position point Pn, and the definition of “n” is not particularly shown.
As described above, the position specifying unit 16 acquires the user position point Pn on the virtual two-dimensional plane coordinates.
The processing using the user position point Pn will be described in detail later.

(Angle calculation unit)
The angle calculation unit 17 receives the user position point Pn specified by the position specifying unit 16 and calculates the movement angle of the reflection plate 62.
As described above, in the present embodiment, the angle of the reflection plate 62 with respect to the speaker main body 61 is configured to be variable. This angle is determined according to the situation of the user A. Therefore, the angle calculator 17 calculates an angle (movement angle) for rotating the reflector 62, that is, an optimum angle of the reflector 62 with respect to the speaker. Moreover, in this embodiment, it is comprised so that an angle may be determined according to the arrangement | positioning condition of the some user A. FIG.
Therefore, the angle calculation unit 17 obtains coordinate information occupied by the user position point Pn specified by the position specifying unit 16, calculates the optimum angle that the reflector 62 should form with respect to the speaker main body unit 61, Output as data.
A specific example of the calculation for the user position point Pn will be described in detail later.

(Operation command part)
The operation command unit 18 receives the angle data calculated by the angle calculation unit 17 and transmits an operation command signal to the reflector 62.
Note that a driving source is mounted on the reflecting plate 62, and the operation command unit 18 transmits an operation command signal to the driving source.
As the drive source, a known mechanism or the like may be used. For example, a motor device may be used.
As an example, it may be configured to transmit a signal obtained by converting angle data into the number of rotations of the motor device to the motor device as a drive source. If comprised in this way, the motor apparatus can rotate according to the signal which shows this rotation speed, and can rotate the reflecting plate 62 to a predetermined position. In this case, the “signal indicating the number of rotations” corresponds to “information on the moving angle of the reflector”. However, the signal is not limited to the signal indicating the rotation speed, and may be a signal for designating the driving time by a timer, for example.

(Memory part)
The storage unit 19 stores various information for executing each process. In the information stored in the storage unit 19, a use purpose table in which the purpose of use of the user A and the angle of the reflector 62 with respect to the speaker main body 61 are associated with each other is stored.
The purpose table and the processing using it will be described in detail later as a second embodiment.
For this reason, the use purpose table is not necessarily required in the storage unit 19 according to the first embodiment, but the use purpose table is also referred to so as to correct the movement angle of the reflector 62. It may be configured.

As described above, in the present embodiment, the received video of the user B can be displayed on the video display device 5 (display 51) on the user A side, and the received audio on the user B side is It can be output as reproduced sound from the speaker device 6 (speaker body 61) on the user A side.
At this time, the user A side is configured to change the angle of the reflecting plate 62 with respect to the speaker body 61 in accordance with the state of the user A.
More specifically, it is configured to detect position information (arrangement information) of a plurality of users A and selectively output reproduced sound from the speaker main body 61 toward the users A group. .
Further, in the present embodiment, the speaker device 6 is provided with a reflection plate 62, and the reflection plate 62 is configured to be able to change the angle formed with respect to the speaker main body 61.
With this configuration, the sound wave output from the speaker body 61 to the sub-output side can be reflected by the reflecting plate 62 and selectively transmitted to a predetermined position. Since the angle of the reflector 62 is determined according to the arrangement state of the user A, the user A can transmit sound waves (reproduced sound) more suitably.
Below, the angle change process of the reflecting plate 62 is demonstrated.

(About the effect of angle change processing)
First, the movement state of the reflecting plate 62 will be described with reference to FIG.
As shown in FIG. 5A, one end of the speaker main body 61 and the reflector 62 is attached to the display device side surface 52c.
In the present embodiment, the speaker body 61 is fixed to the display device side surface 52c, and the state does not change.
However, the reflecting plate 62 is configured to rotate around a place attached to the display device side surface 52c. More specifically, as shown in FIG. 5, the reflector 62 is configured such that the end opposite to the end attached to the display device side surface 52 c rotates in the sub-output direction, so that the speaker main body 61. Is configured to be able to change from 0 ° (initial position: parallel to the speaker body 61) to 90 ° (maximum angle: state along the display device side surface 52c).
FIG. 5B shows a state where the reflecting plate 62 is rotated so as to form an angle of 25 ° with respect to the speaker main body 61.
In order to compare the sound pressure distribution in this state with the sound pressure distribution in FIG. 5A, an experimental system shown in FIG. 6 was created.

In FIG. 6, the user position point P1 of the user A1 in front of the speaker main body 61 and a line connecting the user position point P1 and the speaker main body 61 (line in the depth direction) are separated by a central angle of 55 °. An experimental system is shown in which a reproduction sound observation point is installed at the user position point P2 of the user A2 existing at the position.
In this experimental system, as shown in FIG. 5A, the reflector 62 is installed so that the angle formed by the reflector 62 with respect to the speaker main body 61 is 0 ° (that is, the reflector 62 is parallel to the speaker main body 61. 5) and a test state in which the reflector 62 is rotated at an angle of 25 ° with respect to the speaker main body 61 as shown in FIG. 5B. And the reproduced sound was observed at the user position point P1 and the user position point P2.

The results are shown in FIG.
FIG. 7A shows the reproduction sound observation data of the user position point P1 in the control state and the test state in a graph, and FIG. 7B shows the user position point P2 in the control state and the test state. Reproduced sound observation data is shown as a graph. In both graphs, the horizontal axis represents the octave band center frequency (Hz) centered on 1000 Hz, and the vertical axis represents the sound pressure level (dB).
Thus, as shown in FIG. 7A, at the user position point P1, there is no difference in the sound pressure level between the control state and the test state. In other words, at the user position point P1, the reproduced sound is heard similarly in the control state and the test state.
However, as shown in FIG. 7B, at the user position point P2, the sound pressure level is higher in the test state particularly in the region below 500 Hz and the region above 2000 Hz. In other words, at the user position point P2, the reproduced sound is more audible in the test state than in the control state. In particular, this tendency is noticeable in the high sound range and the low sound range. That is, in the test state, it is easy to hear in a sound range that is difficult for humans to hear.

(About angle change processing)
Next, the angle changing process of the reflecting plate 62 will be described with reference to FIGS.
Hereinafter, the processing will be described along the flow of FIG.
It is assumed that initial information such as position information about the speaker device 6, origin O information, and room size information is input.
In the present embodiment, the angle changing process starts when the “reflector moving mode” is selected. The start trigger is not limited to this, and may be triggered by the video display device 5 being turned on, or may be triggered by the start of BGM output in the case of a fitness lesson, for example.
When the process is started, all position information of the user An is acquired by the infrared sensor 4 in step S1.
As described above, the coordinate points are acquired on the virtual secondary original coordinates as the user position point P1 to the user position point Pn.

Next, in step S2, it is determined whether or not there are a plurality of y coordinates.
That is, whether or not there are a plurality of y-coordinates that are information in the depth direction determines whether the arrangement of the plurality of users An is a single row or a plurality of rows (including a random arrangement).
Here, when it is determined that there are not a plurality of y coordinates (step S2: No), it is determined that the arrangement of the plurality of users A is a single row, and the user positions of the plurality of users An in step S3. Among the points Pn (xn, yn), the user An having the largest x coordinate (hereinafter referred to as “user Anmax”) and the user An having the smallest x coordinate (hereinafter referred to as “user Anmin”). The user position point Pn is extracted.
Hereinafter, an example of the processing will be specifically described with reference to FIGS. 9 to 11.

FIG. 9 shows a state in which all the user position points Pn of the user An have been acquired in step S1.
In this example, there are four users An, that is, users A1 to A4, and user position points P1 (x1, y1) to user position points P4 (x4, y4) are acquired.
In FIG. 9, specific numerical values are illustrated as user position points Pn (n = 1 to 4), and the specific numerical values will be described.
In this example, speaker devices 6 are arranged on both the right and left sides in the width direction, and the coordinates of the speaker devices 6 are (xR0, yR0) and (xL0, yL0).
Note that the coordinates of the right speaker device 6 and the left speaker device 6 are invariant, and are initially set (see specific numerical values in FIG. 10B).

In this example, as shown in FIG. 10B, the y-coordinate is only y = 2000, and thus, in step S2, it is determined that the users A1 to A4 are aligned in a single row.
Since this example is a simple example for explaining the processing, the determination is made only by simple numerical value matching. However, in practice, an error range is defined, and the y coordinate is the error. If it is within the range, it is determined to be in the same row.
In addition, as shown in FIG. 10B, in this example, the x coordinate of the user position point P1 is minimum at x = -2250, and the x coordinate of the user position point P1 is maximum at x = 2250. is there.
Thus, in step S3, the user A1 is the user Anmin, and the user A4 is the user Anmax.

Next, in step S4, an angle θL formed by one speaker device 6 and the user Anmax and an angle θR formed by the other speaker device 6 and the user Anmin are calculated.
In this example, since θL = θR (absolute value), the description will be limited only to the side of θL in order to avoid duplication.
For simplicity of explanation, a, b, and θL are defined as shown in FIG.
In this way, the relationship between a, b, and θL is as follows.

If comprised in this way, (theta) L will be calculated | required as follows. That is, arc tangent may be obtained.

Numerical values a and b are defined as follows. That is, it takes an absolute value.

Substituting the specific numerical values of this example into the above formula gives the following.

If calculated in this way, θL = 40.36 °.
Then, in response to the angle θ1 calculated in step S4, the movement angle of the reflecting plate 62 is calculated in step S5.
In this example, in step S5, the movement angle θmov is calculated as follows (see also FIG. 11A).
Movement angle θmov = 40.36 ° / 2 = 2.18 °

Next, in step S6, the movement angle θmov is converted into a signal for controlling the reflection plate 62 and transmitted to the drive source of the reflection plate 62, and the reflection plate 62 is moved by the movement angle θmov (in this example, it is rotated). )
Thus, the state which moved the reflecting plate 62 is FIG.10 (c).
In this state, the reflected sound reflected by the reflecting plate 62 can be effectively transmitted to the user A1 and the user A4 existing at both left and right ends.

In this example, as shown in FIG. 10A, the initial position of the reflecting plate 62 is parallel to the speaker main body 61.
However, as another example, the reflecting plate 62 may have a position along the display device side surface 52c (that is, a position that forms an angle of 90 ° with the speaker main body 61) as an initial position.
In this case, the movement angle θmov is calculated as follows.
Movement angle θmov = 90 ° -40.36 ° / 2 = 69.82 °

On the other hand, when it is determined in step S2 that there are a plurality of y coordinates (step S2: Yes), it is determined that the arrangement of the plurality of users A is a plurality of columns (including a random array), and in step S7, y Determine the coordinate pattern. That is, the number of columns of the user An is specified.
Similar to the above, FIGS. 12 and 13 will be described together.
In this example, FIG. 12 is a diagram showing the user position points P1 to P7 acquired in step S1, and a state where the users An are arranged in two columns will be described.
In this example, since there are two types of y coordinates (y = 2000, y = 3500), step S2 is affirmed and the process proceeds to step S7.

In step S7, it is determined that there are two types of y-coordinate patterns, y = 2000 and y = 3500. This is because the angle is calculated for all the y-axis patterns determined here in the subsequent processing.
Next, in step S8, the minimum value and the maximum value of the x coordinate are detected for every y coordinate pattern.
That is, as shown in FIG. 12B, in the column of y = 2000, the user A1 whose x coordinate is the minimum value (−1800) is the user Anmin1, and the x coordinate is the maximum value (1800). User A3 is assumed to be user Anmax1.
Similarly, in the column of y = 3500, the user A4 whose x coordinate is the minimum value (−2400) is the user Anmin2, and the user A7 whose x coordinate is the maximum value (2400) is the user Anmax2.

Next, in step S9, the angles θL1 and θL2 formed by one speaker device 6 and the user Anmax1 and the user Anmax2 are respectively calculated, and the other speaker device 6 is formed by the user Anmin1 and the user Anmin2. An angle θR1 and an angle θR2 are respectively calculated.
In this example, since θL1 = θR1 (absolute value) and θL2 = θR2 (absolute value), the description is limited to only the sides of θL1 and θL2 in order to avoid duplication.
For simplification of description, a1, a2, b1, b2, θL1, and θL2 are defined as shown in FIG.
If defined in this way, these relationships are as follows.

If comprised in this way, (theta) L1 and (theta) L2 will be calculated | required as follows. That is, arc tangent may be obtained.

Numerical values a1, a2, b1, and b2 are defined as follows. That is, it takes an absolute value.

Substituting specific numerical values of this example into the above formula, θL1 and θL2 are as follows.

If calculated in this way, θL1 = 32.00 ° and θL2 = 27.86 °.
Next, in step S10, the maximum value is selected from the angle θLm (m is an integer indicating a column number) obtained in step S9.
In this example, since m = 2 and angle θL1> angle θL2, 32.00 °, which is the value of angle θL1, is selected.

Next, in response to the angle θL1 calculated in step S10, the movement angle of the reflecting plate 62 is calculated in step S5.
In this example, in step S5, the movement angle θmov is calculated as follows (see also FIG. 11A).
Movement angle θmov = 32.00 ° / 2 = 16.00 °

Next, in step S6, the movement angle θmov is converted into a signal for controlling the reflection plate 62 and transmitted to the drive source of the reflection plate 62, and the reflection plate 62 is moved by the movement angle θmov (in this example, it is rotated). )
Thus, the state which moved the reflecting plate 62 is FIG.13 (c).
In this state, the reflected sound reflected by the reflecting plate 62 can be effectively transmitted to the user A1 and the user A4 existing at both left and right ends.

In this example, as shown in FIG. 14A, the initial position of the reflector 62 is parallel to the speaker body 61.
However, as another example, the reflecting plate 62 may have a position along the display device side surface 52c (that is, a position that forms an angle of 90 ° with the speaker main body 61) as an initial position.
In this case, the movement angle θmov is calculated as follows.
Movement angle θmov = 90 ° -32.00 ° / 2 = 74.00 °

<Second embodiment>
Next, a second embodiment is shown as another embodiment different from the above embodiment.
In this embodiment, the logic for moving the reflecting plate 62 is different from that in the first embodiment.
In the second embodiment, only the logic for moving the reflecting plate 62 is different. Therefore, the description is limited to this difference, and the description of the same configuration is omitted.

In the present embodiment, a use purpose table as shown in FIG. 15 is stored in the storage unit 19.
In this table, the number of users A, the optimum sound field environment (sound output range), and the movement angle θmov of the reflector 62 are associated with the contents of the content to be used.
A number is assigned to each content, and the moving angle θmov of the reflecting plate 62 is read by designating any number by the input means.
In this example, the moving angle θmov of the reflecting plate 62 is defined as the angle of the reflecting plate 62 with respect to the speaker body 61, but the angle of the reflecting plate 62 with respect to the display device side surface 52c is shown in parentheses in FIG. It is described. The angle in the parenthesis is preferably used as θmov when the reflecting plate 62 moves (rotates) with respect to the display device side surface 52c.

FIG. 16 shows a processing flow.
This procedure starts when the audio output system 100 including the video display device 5 is activated.
When the process starts, a content selection process signal is acquired in step S21.
The content selection processing signal may be configured to be input by selecting a content selection button or the like displayed on the display 51, for example.
Next, in step S22, it is determined whether or not the reflecting plate 62 needs to be moved in the selected content. For example, in the table shown in FIG. 15, when the selected content is a single user An such as shopping or an interview (that is, when the single user A1 stands in front of the display 51: n = In 1), since it is not necessary to change the angle of the reflection plate 62, in such a case, it is determined that the movement of the reflection plate 62 is unnecessary.
In the usage table, “1” may be attached to those that require movement of the reflecting plate 62, and “0” may be attached to those that do not need to be read. The value of the movement angle θmov of the plate 62 is read, and if it is 0 °, it may be determined that the movement of the reflecting plate 62 is unnecessary.

Next, when it is determined in step S22 that it is not necessary to move the reflecting plate 62 (step S22: No), it is determined in step S23 that the reflecting plate is not moved.
On the other hand, when it is determined in step S22 that the reflecting plate 62 needs to be moved (step S22: Yes), in step S24, the moving angle θmov of the reflecting plate 62 corresponding to the selected content is read from the use purpose table. In step S25, the reflecting plate 62 is moved (rotated in this example) by the moving angle θmov.

Next, when the process of step S23 or step S25 is completed, a test sound is generated in step S26.
In step S27, in response to the generation of the test sound, it is determined whether fine adjustment of the reflecting plate 62 is necessary.
For example, a test sound measuring device may be installed at a predetermined position, and the measurement result of this measuring device may be fed back to give a fine adjustment command. You may be comprised so that fine adjustment may be commanded by operating an adjustment switch.
If it is determined in step S27 that fine adjustment is not necessary (step S27: No), the content specified in step S28 is started and the process is terminated.

If it is determined in step S27 that fine adjustment is necessary (step S27: No), the moving direction of the reflecting plate 62 is determined in step S29.
That is, when the fine adjustment is instructed, information specifying the moving direction of the reflecting plate 62 is transmitted together with the instruction, and the direction is determined in step S29. In this example, the reflector 62 is moved so that the angle with respect to the speaker main body 61 is small (inward movement), or the reflector 62 is moved so that the angle with respect to the speaker main body 61 is large (outward). Move).
When the moving direction of the reflecting plate 62 is determined in step S29, the process returns to step S25, and the reflecting plate 62 is moved to perform fine adjustment.

Thereafter, the loop of step S26 → step S27 → step S29 → step S25 → step S26 →... Is repeated until it is finally determined in step S27 that fine adjustment is not necessary.
In this way, fine adjustment is performed until the user An can hear the reproduced sound optimally, and the user An can execute the content in the optimal sound field environment.

In the present example, the fine adjustment of the reflecting plate 62 can be performed in units of 1 °.
Further, the moving angle θmov of the reflecting plate 62 may be determined according to the number of participants rather than being determined only by the type of content.
Furthermore, although it was set as the structure which moves the reflecting plate 62 automatically in both 1st embodiment and 2nd embodiment, it is not restricted to this, The moving angle (theta) mov of the reflecting plate 62 is displayed on the display 51, The structure which moves the reflecting plate 62 manually may be sufficient.

A modification of the speaker device will be described with reference to FIGS.
FIG. 17 shows a first modification.
In this example, the speaker main body 61 and the reflection plate 62 are configured to be stored in a state along the display device side surface 52c. In this example, the reflecting plate 62 is rotatably attached to the speaker main body 61.
That is, when not in use, as shown in FIG. 17A, the speaker device 6 is stored in a state along the display device side surface 52c, and in the used state, as shown in FIG. 17B. Rotate to a position along the display 51 and expand.
Then, as described in the above embodiment, the reflecting plate 62 moves with respect to the speaker main body 61 by a movement angle θmov (30 ° in FIG. 17C).

FIG. 18 shows a second modification.
Although the movement of this example is the same as that of the first modified example, the reflector 62 is attached to the display device side surface 52c, not the speaker main body 61, so as to be rotatable.
In this example, when not in use, as shown in FIG. 18 (a), the speaker device 6 is stored in a state along the display device side surface 52c. In use, the speaker device 6 is shown in FIG. 18 (b). As shown, only the speaker body 61 is first rotated and deployed to a position along the display 51. Then, the reflection plate 62 moves (rotates) relative to the display device side surface 52c by (90 ° −θmov) so as to form a movement angle θmov with respect to the speaker main body 61.

FIG. 19 shows a third modification.
In this example, the speaker main body 61 is embedded on the display device surface 52 a side along the display 51.
When not in use, the reflector 62 is stored in a state along the display device side surface 52c as shown in FIG. 19A, and in the use state as shown in FIG. 19B. Rotate inward toward the position covering the back side of the speaker body 61. That is, the reflection plate 62 moves (rotates) relative to the display device side surface 52c by (90 ° −θmov) so as to form a movement angle θmov with respect to the speaker body 61.

  In any of Modification Examples 1 to 3, the reflection plate 62 may be the same as the display device side surface 52c. That is, in the storage state, the reflection plate 62 may function as the display device side surface 52c, and may function as the reflection plate 62 by moving (turning).

1 Server computer (control device)
2 Camera (photographing device)
3 Microphone 4 Infrared sensor (position information acquisition means)
41 Emission port 42 Detector 5 Video display device 51 Display
52 Device main body 52a Display device front surface 52b Display device back surface 52c Display device side surface 6 Speaker device (reproduced sound output unit)
61 Speaker Main Unit 62 Reflector 11 Audio / Video Distribution Unit 12 Audio / Video Acquisition Unit 13 Video Display Unit 14 Audio Playback Unit 15 User Position Information Acquisition Unit (Recipient Position Information Acquisition Unit)
16 Position specifying part (angle adjustment command part)
17 Angle calculation part (angle adjustment command part)
18 Operation command section (angle adjustment command section)
19 Storage unit 100 Voice output system GN External communication network S This system (voice output system)

Claims (12)

An audio acquisition unit for acquiring the caller's audio data;
An audio reproduction unit that extracts the audio signal acquired by the audio acquisition unit to obtain a reproduction audio signal;
A playback sound output unit that receives the playback sound signal from the sound playback unit and emits it as a playback sound to the receiver;
The playback sound output unit
In accordance with the reproduced sound signal, a speaker main body that outputs sound waves to a main output direction side that is the receiver side and a sub output direction side that is a direction other than the main output direction side;
A speaker device configured to have at least a reflector disposed on the auxiliary output direction side with respect to the speaker main body,
An audio output system, comprising: an angle adjustment command unit that changes an angle of the reflector with respect to the speaker main body according to information indicating a situation on the receiver side. The speaker main body generates sound waves from two directions, that is, a surface on the receiver side and a back surface on the opposite side of the surface.
The main output direction is the front side which is the receiver side, and the secondary output side is the back side,
The audio output system according to claim 1, wherein the reflector is disposed on the back surface side.   The audio output system according to claim 1 or 2, wherein the information indicating the status on the receiver side is information indicating an arrangement of the receiver or a purpose of use of the receiver. A receiver position information acquisition unit that acquires receiver position information that is information indicating the status of the receiver acquired by the position information acquisition device;
The angle adjustment command unit
Analyzing the receiver position information, on a virtual coordinate, a position specifying unit that specifies the position of the receiver as coordinates;
Analyzing the coordinates indicating the position of the receiver, an angle calculation unit for calculating the movement angle of the reflector,
An operation command unit that designates information related to the movement angle of the reflector from the angle calculation result received from the angle calculator and commands the speaker device to move the reflector. The audio output system according to claim 1 or 2, wherein   The audio output system according to claim 4, wherein the position information acquisition device includes at least one of an imaging device and a measurement device provided on the receiver side. A storage unit storing a use purpose table in which the use purpose of the receiver and the movement angle of the reflector are associated with each other;
An operation command unit that receives a signal indicating a purpose of use, reads a movement angle of the reflection plate from the use purpose table, and instructs the speaker device to move the reflection plate; The audio output system according to claim 1 or 2, wherein   A video display device that captures a video image taken when the sender's imaging device captures the sender and displays it on a display provided on the receiver side, and at least one for the video display device. The audio output system according to any one of claims 1 to 6, wherein the speaker devices are mounted. At least a part of the reflector is attached to the speaker body or the video display device,
The said reflecting plate rotates with respect to the said speaker main-body part or the said video display apparatus by using the position attached to the said speaker main-body part or the said video display apparatus as a fulcrum. Audio output system. The video display device is a box type,
A surface of the display device on which the display is disposed, a surface facing the receiver, a display device back surface facing the display device surface, and sides extending in the vertical direction of the display device surface and the display device back surface Each of the display devices connected to each other, and
At least a part of the speaker device is attached to the side surface of the display device, and rotates about the attachment position as a fulcrum, and is deployed at a predetermined angle with the storage position along the side surface of the display device and the side surface of the display device. The voice output system according to claim 7, wherein the voice output system is movable between the developed position and the developed position. The video display device is a box type,
A surface of the display device on which the display is disposed, a surface facing the receiver, a display device back surface facing the display device surface, and sides extending in the vertical direction of the display device surface and the display device back surface Each of which is connected to the display device side surface,
The speaker body is disposed on the surface of the display device,
The display device side surface is the reflector, and is movable between a storage position that is a position of the display device side surface and a deployment position that is a position covering the sub output direction side of the speaker main body. The voice output system according to claim 7 or 8, wherein The receiver position information acquisition unit of the control device acquires the receiver position information, which is information indicating the status of the receiver acquired by the position information acquisition device;
A step of analyzing the receiver position information and specifying the position of the receiver as coordinates on a virtual coordinate;
The angle calculation unit of the control device receives and analyzes the coordinates indicating the position of the receiver, and calculates the movement angle of the reflector mounted on the speaker device as an angle with respect to the speaker main body mounted on the speaker device. And a process of
The operation command unit of the control device receives the calculation result of the angle calculation unit, transmits an operation signal instructing the movement of the reflecting plate to the speaker device, and moves the reflecting plate;
The voice acquisition unit of the control device acquires the voice data of the caller;
An audio reproduction unit of the control device performs a step of extracting the audio signal acquired by the audio acquisition unit into a reproduction audio signal and transmitting the reproduction audio signal to the speaker body unit; output method. A speaker main body that vibrates air and outputs sound waves; and a reflector that reflects a part of the air vibration of the speaker main body and is movable to form a predetermined angle with the speaker main body. A method of outputting sound to a receiver side in a speaker device,
The control device has a movement angle of the reflector with respect to the designated use purpose of the receiver from a use purpose table in which the use purpose of the receiver is associated with the movement angle of the reflector with respect to the speaker main body. A process of reading
A step in which an operation command unit of the control device receives the read movement angle of the reflector, transmits an operation signal instructing movement of the reflector to the speaker device, and moves the reflector; ,
The voice acquisition unit of the control device acquires the voice data of the caller;
An audio reproduction unit of the control device performs a step of extracting the audio signal acquired by the audio acquisition unit into a reproduction audio signal and transmitting the reproduction audio signal to the speaker body unit; output method.

Images