JP5358843B2 - Sound output control device, sound output control method, and sound output control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To properly and accurately obtain the output range of directional sound. <P>SOLUTION: A sound output control device controls a directional speaker outputting directional sound. The device is provided with an imaged-image processing part, which acquires imaging information imaged by a camera so as to generate image information, and an output-range display part for displaying an image in which a figure showing the output range of directional sound outputted by the directional speaker is superimposed on an image of the image information generated by the imaged-image processing part. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a sound output control device, a sound output control method, and a sound output control program.

  In recent years, it has been known that an ultrasonic speaker (directional speaker) using nonlinearity of a medium (air) with respect to ultrasonic waves can reproduce an audible frequency band signal having a much sharper directivity than a normal speaker. (Patent Document 1)

  Patent Document 2 describes a projector that projects a visual guide display on a projection screen when setting a sound reproduction range. According to this technology, the projector user can view the reproduction range of the directional speaker of the projector while viewing the sound reproduction range, the reproduction volume, and the video showing the reflection direction of the sound from the screen. Can be set easily and appropriately.

  Further, Patent Document 3 includes a monitoring monitor camera that monitors the station platform by changing the imaging direction, and a speaker is incorporated in the monitoring monitor camera so that the radiation direction of the voice announcement coincides with the imaging direction. A speaker system is described. According to this technique, an audio announcement can be output in a direction that matches the imaging direction of the monitoring monitor camera.

Also, in Patent Document 4, an imaging device and a directional speaker are installed on a pan head that is rotationally controlled to change the direction of the monitoring range, and an audible sound for alerting the imaging direction is provided from the directional speaker as necessary. A video surveillance device that emits light is described. According to this technique, it is possible to call attention with an audible sound only within the range of the imaging field angle.
JP-A-6-161476 Japanese Patent Laid-Open No. 2005-236652 JP 2002-354573 A JP 2004-297728 A

However, the above prior art has the following drawbacks.
The technique described in Patent Document 2 has a drawback that the listener is dazzling because the listener, who is the output destination of the sound, is irradiated with light indicating the output range of the sound. In addition, this technique has a drawback that other people realize that they are listeners. Furthermore, this technique has a drawback that it is difficult to identify the sound output range in a bright place.

  In the technique described in Patent Document 3, since the imaging direction of the camera and the output direction of the sound are matched, sound can be output in the imaging direction of the camera, but the output range of the sound is grasped. There is a disadvantage that can not be.

  In addition, the technique described in Patent Document 4 has a drawback in that a sound outside the range where sound is output cannot be grasped because the sound is output only within the range of the imaging angle of view. For example, this technique has a drawback in that it is difficult to find a listener by a captured image when a listener who wants to transmit sound is out of a range where sound is output. In addition, there is a drawback in that the user cannot grasp the situation around the listener and the sound is output despite the situation in which the listener cannot be heard such as during conversation with another person.

  As described above, the conventional technique has a drawback in that it cannot properly and accurately grasp the output range of sound having directivity.

  The present invention has been made in view of the above points, and an object of the present invention is to provide a sound output control device, a sound output control method, and a sound output capable of appropriately and accurately grasping an output range of sound having directivity. It is to provide a control program.

(1) The present invention has been made to solve the above-described problems, and one aspect thereof is a sound output control device that controls a directional speaker that outputs directional sound, and the camera captures an image. A captured image processing unit that captures captured image information and generates image information, and a graphic representing an output range of the directional sound output by the directional speaker in an image of the image information generated by the captured image processing unit An output range display unit that displays an image on which the images are superimposed.
According to the above configuration, since the sound output control device displays a graphic representing the output range of sound with directivity on the captured image, the user of the sound output control device can select sound with directivity. Can be grasped appropriately and accurately.

(2) One embodiment of the present invention further includes a direction control unit that performs control so that an output direction of the sound having directivity and an imaging direction captured by the camera are the same.
According to the above configuration, since the sound output control device matches the output direction of the sound with directivity and the imaging direction, a graphic display representing the output range of sound with directivity due to the difference in both directions is displayed. There is no need to calculate the position, and processing by the calculation can be reduced.

(3) Moreover, one aspect of the present invention includes a distance detection unit that detects a distance from a listening body that is an output destination of the directional sound and the directional speaker, and the output range display unit includes: The graphic representing the output range of the sound having directivity is displayed in different display modes according to the distance measured by the distance detection unit.
According to the above configuration, the sound output control device displays the graphic representing the output range of the directional sound in different display modes according to the distance between the listener and the directional speaker. The user can accurately grasp the output range of the directional sound even if the distance between the listener and the directional speaker changes.

(4) Further, according to one aspect of the present invention, a display operation control unit that receives an instruction to change a graphic representing an output range of the directional sound by a user's operation, and a change instruction received by the display operation control unit And a directional speaker control unit for outputting the sound having directivity in an output range represented by a figure according to the above.
According to the above configuration, the sound output control device accepts an instruction to change a graphic representing the output range of the directional sound by a user's operation, and an output range represented by the graphic in accordance with the received change instruction, Since the sound having the directivity is output, the user of the sound output control device can easily and appropriately output the sound having the directivity in the output range of the sound having directivity.

(5) In addition, according to one aspect of the present invention, a display operation control unit that receives a change instruction of a graphic representing an output range of the directional sound by a user's operation, and a change instruction received by the display operation control unit The imaging control part which controls the imaging direction which the said camera images so that the figure according to this may be displayed on the display range of the image which the said output range display part displays is provided. The sound output control device described in 1.
According to the above configuration, the sound output control device is configured such that the camera is displayed in a display range of an image displayed by the output range display unit, in accordance with a change instruction received by the display operation control unit. Since the imaging direction for imaging is controlled, the user of the sound output control device can easily and appropriately confirm the output range of the sound having the directivity.

(6) Moreover, according to one aspect of the present invention, the output range display unit displays the graphic representing the output range of the directional sound in a different display mode according to the zoom level of the camera.
According to the above configuration, since the graphic representing the output range of the directional sound is displayed in different display modes according to the zoom level of the camera, the user of the sound output control device changes the zoom level. However, it is possible to accurately grasp the output range of the sound having the directivity.

(7) Moreover, one aspect of the present invention includes a brightness detection unit that detects the brightness of a captured image, and the output range display unit is based on information about the brightness detected by the brightness detection unit. The graphic representing the output range of the sound having the directivity is displayed in different display modes.
According to the above configuration, for example, the sound output control device uses a color of a graphic representing the output range of the directional sound, a low-brightness color for a high-brightness image, and a high-brightness for a low-brightness image. Since the color is changed, the user of the sound output control device can clearly identify the graphic representing the output range of the sound having directivity by the luminance difference.

(8) Moreover, 1 aspect of this invention is equipped with the time measuring part which measures the time which passed since displaying the figure showing the output range of the sound with said directivity, The said output range display part is the said time measuring part. When the measured time exceeds a predetermined time, the display of the graphic representing the output range of the directional sound is stopped.
According to the above configuration, since the sound output control device does not continue to display the graphic indefinitely after displaying the graphic indicating the output range of the sound having directivity, a part of the captured image has the directivity. It is possible to prevent the sound from being hidden by a graphic representing the output range of a certain sound.

(9) Further, according to one aspect of the present invention, the output range display unit may display a graphic representing an output range of the directional sound while the directional speaker outputs the directional sound. Display.
According to the above configuration, the sound output control device displays the graphic representing the output range of the directional sound while the directional speaker outputs the directional sound. The user of the control device can easily grasp whether or not the sound output control device is outputting sound.

  (10) According to another aspect of the present invention, there is provided a sound output control method in a sound output control device that controls a directional speaker that outputs sound having directivity, and the sound output control device images the camera. A first process of capturing image information, and an output range of the directional sound output by the directional speaker in an image of the image information captured by the sound output control device in the first process And a second process of displaying the figure in an overlapping manner.

  (11) According to another aspect of the present invention, a captured image processing unit that captures image information captured by a camera into a computer of a sound output control device that controls a directional speaker that outputs directional sound. It is made to function as output range display means for displaying a graphic representing the output range of the directional sound output from the directional speaker on the image of the image information captured by the processing means.

  According to the present invention, the sound output control device displays a figure representing the output range of the directional sound on the captured image so that the output range of the directional sound can be grasped appropriately and accurately. be able to.

(First embodiment)
<Sound output system>
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic view showing a sound output system according to the first embodiment of the present invention.
The sound output system includes a directional speaker with camera a1, a sound output control device b1, an input device c1, and a monitor (display device) d1.

In this figure, a directional speaker with camera a1 outputs a sound (hereinafter referred to as a directional sound) having directivity to the listener H1 (listener) among the listeners H1 and H2. In this figure, the range in which this directional sound can be heard (hereinafter referred to as the directional sound output range) is the directional sound output range S1, and at the position of the listener H1, this directional sound output range is the output of the directional sound. Indicates that the range is S11.
The directional speaker a1 with camera includes a directional speaker and outputs directional sound. Moreover, the directional speaker with camera a1 can change the output direction of the directional sound. The directional speaker a1 with camera includes a camera capable of photographing the directional direction of the directional sound output range.

The sound output control device b1 controls the directional speaker with camera a1 and displays an image on the monitor d1. This figure shows that the listeners H1 and H2 are displayed as the listeners h1 and h2 on the monitor d1. In addition, this figure shows a circle (figure) s11 on the monitor d1 in which the directional sound output range S11 of the directional speaker a1 with camera at the position of the listener H1 represents the directional sound output range of the directional speaker a1 with camera. Is displayed as.
As described above, the sound output control device b1 causes the monitor d1 to display the circle representing the output range of the directional sound of the directional speaker with camera a1 on the image captured by the camera of the directional speaker with camera a1.

In the present embodiment, the sound output control device b1 controls the user to specify the imaging direction of the camera and change the imaging direction of the camera using the input device c1. The directional speaker a1 with camera changes the imaging direction by the camera according to the control by the sound output control device b1.
The sound output control device b1 controls to make the output direction of the directional sound of the directional speaker a1 with camera coincide with the imaging direction of the camera. The directional speaker with camera a1 changes the output direction of the directional sound according to the control by the sound output control device b1.

<Display example of output range>
Hereinafter, a circle representing the output range of the directional sound of the directional speaker with camera a1 displayed by the sound output control device b1 according to the present embodiment will be described with reference to FIGS.
FIG. 2 is a diagram showing an example of the display of a circle representing the output range of directional sound according to the present embodiment.
In this figure, the diagram D1-1 shows that the listeners H1 and H2 (FIG. 1) are captured by the camera of the directional speaker a1 with camera and displayed on the monitor d1 as the listeners h1 and h2. Show. Further, the diagram of D1-1 shows that the directional sound output range S11 of the directional speaker a1 with camera (FIG. 1) is a circle s11 representing the directional sound output range of the directional speaker a1 with camera. , H2 are displayed superimposed on the image.

  Moreover, the figure of D1-2 is a figure when the imaging direction of the camera of the directional speaker a1 with a camera is changed from the imaging direction represented by the figure of D1-1 by a user's operation. In the diagram of D1-2, since the sound output control device b1 performs control to make the output direction of the directional sound of the directional speaker a1 with camera coincide with the imaging direction of the camera, the output direction of the directional sound is the imaging of the camera. A circle s12 that coincides with the direction and represents the output range of the directional sound indicates that the circle is still located at the center of the image captured by the camera.

FIG. 3 is a diagram showing another example of the display of a circle representing the output range of directional sound according to the present embodiment.
In this figure, the diagram of D1-1 is the same as the diagram of D1-1 in FIG. In the diagram of D1-3, the degree of zoom of the camera of the directional speaker a1 with camera (magnification reduction rate of imaging) is changed from the zoom level shown in the diagram of D1-1 by the user's operation. It is a figure at the time of enlarging and imaging.
The diagram of D1-3 shows a circle s11 (D1-) representing the sound output range by the sound output control device b1 when the subject is magnified and imaged with the camera of the directional speaker a1 with camera. 1) is enlarged and displayed in s13 (D1-3). Note that when the subject is reduced and imaged by the camera of the directional speaker a1 with camera, the sound output control device b1 reduces and displays the circle s13 representing the sound output range by the sound output control device b1.

<Configuration of Sound Output Control Device b1>
Hereinafter, the sound output control device b1 according to the present embodiment will be described.
FIG. 4 is a configuration diagram showing the configurations of the directional speaker with camera a1 and the sound output control device b1 according to the present embodiment.

First, the directional speaker a1 with camera will be described. The directional speaker with camera a1 includes a camera part a11 and a directional speaker part a12.
The camera unit a11 uses a lens, a CCD (Charge Coupled Device Image Sensor) or a CMOS (Complementary Metal-Oxide Semiconductor: Image Sensor), and a circuit that controls the position of the lens. The imaging direction can be changed.

The camera unit a11 changes the imaging direction in accordance with control by the imaging control unit b143 of the sound output device b1. Further, the camera unit a11 changes the zoom magnification or starts / stops imaging in accordance with control by the imaging control unit b143 of the sound output device b1.
The camera unit a11 detects the position of the lens moved by autofocus or the like, and determines the focal length of the lens (hereinafter simply referred to as the focal length) from the detected lens position and an image captured in a specific zoom state. The ratio (hereinafter referred to as magnification n) is calculated.
The camera unit a11 outputs the captured image information, information indicating the focal length at the time of imaging, and information indicating the magnification n to the captured image processing unit b140 of the sound output device b1. Note that the camera unit a11 faces the same direction as the output direction of the directional speaker.

The directional speaker unit a12 outputs a sound obtained by modulating the sound data input from the directional speaker control unit (direction control unit) b144 with high frequency ultrasonic waves. This output sound has high directivity and becomes a directional sound that can be perceived by a person within a specific range. Thus, the directional speaker unit a12 outputs directional sound.
The directional speaker unit a12 changes the output direction of the directional sound according to the control by the directional speaker control unit b144.

  Next, the sound output control device b1 will be described. The sound output control device b1 includes a volatile memory b11, a nonvolatile memory b12, a timer unit b13, and a control unit b14. The control unit b14 inputs / outputs information to / from the volatile memory b11, the nonvolatile memory b12, and the time measuring unit b13, and processes the information, thereby realizing the functions of the units included in the control unit b14.

  When the time measurement command is input from the output range display unit b145, the time measurement unit b13 measures the time elapsed after the time measurement command is input and outputs the time to the output range display unit b145. This timing command is output from the output range display unit b145 when the output range display unit b145 starts displaying a circle representing the output range of the directional sound. That is, the timer unit b13 measures the time that has elapsed since the graphic representing the output range of the directional sound was displayed.

  The control unit b14 includes a captured image processing unit b140, a luminance detection unit b141 (brightness detection unit), a distance detection unit b142, an imaging control unit b143, a directional speaker control unit b144, an output range display unit b145, and a display control unit b146. It is comprised including.

The captured image processing unit b140 converts the imaging information input from the camera unit a11 into image information and outputs the image information to the luminance detection unit b141 and the output range display unit b145. In other words, the captured image processing unit b140 captures image information captured by the camera.
The captured image processing unit b140 outputs information indicating the magnification n to the output range display unit b145. Further, the captured image processing unit b140 outputs the focal length information input from the camera unit a11 to the distance detection unit b142.

The luminance detection unit b141 detects the luminance (information regarding brightness) of the image from the image information input from the captured image processing unit b140, and outputs it to the output range display unit b145.
The distance detection unit b142 detects the distance from the speaker to the subject based on the focal length information input from the captured image processing unit b140. Here, the camera unit a11 is focused on the listener (subject), and the focal length is the output direction distance x to the listener. That is, the distance detection unit b142 detects the output direction distance x for the listener who is the output destination of the directional sound.

  The imaging control unit b143 controls the imaging direction of the camera unit a11 based on an input from the input device c1. In addition, the imaging control unit b143 performs zoom control of the camera unit a11 and control of start and stop of imaging by the camera unit a11 based on an input from the input device c1. Further, the imaging control unit b143 outputs information related to the imaging direction of the camera unit a11 to the directional speaker control unit b144.

The directional speaker control unit b144 performs control to make the output direction of the directional sound of the directional speaker with camera a1 coincide with the imaging direction indicated by the information regarding the imaging direction of the camera unit a11 input from the imaging control unit b143. That is, the directional speaker control unit b144 performs control so that the output direction of the directional sound is the same as the imaging direction captured by the camera.
Further, the directional speaker control unit b144 outputs the input sound data to the directional speaker unit a12.

The output range display unit b145 displays an image obtained by superimposing a circle (for example, s11 in FIG. 1) representing the output range of the directional sound of the directional speaker with camera a1 on the image of the image information input from the captured image processing unit b140. Generated and displayed on the monitor d1 via the display control unit b146. That is, the output range display unit b145 displays an image obtained by superimposing a graphic representing the output range of the directional sound of the directional speaker with camera a1 on the image of the image information captured by the captured image processing unit b140.
Hereinafter, a specific method for displaying the image will be described.

<How to display a graphic representing the output range of sound>
The output range display unit b145 calculates the radius r of the circle representing the output range of the directional sound of the directional speaker with camera a1 using the magnification n and the output direction distance x.
For example, the radius r (pixel) of the circle superimposed on the image of the image information input from the captured image processing unit b140 is r = n (0.7x + 35) (using the output direction distance x (m) to the listener. Pixel). Here, the pixel is a unit indicating a pixel of an image of the image information input from the captured image processing unit b140.
The output range display unit b145 sets the circle image having the calculated radius r as a circle representing the output range of the directional sound of the directional speaker unit a12 at the center of the image of the image information input from the captured image processing unit b140. The superimposed images are generated (see FIGS. 2 and 3).

Here, the magnification n changes depending on the zooming degree of the camera unit a11, and the output range display unit b145 changes the radius r of a circle representing the sound output range according to the magnification n. That is, the output range display unit b145 displays the graphic representing the output range of the directional sound in a different display mode according to the degree of zoom. Here, the display mode includes, for example, a display mode based on the shape, color, dotted line or broken line of the figure, or a blinking display.
Moreover, the output range display part b145 may perform the following display control about the image of the circle showing the output range of the sound output from the directional speaker part a12.

<Changing the color of the graphic representing the sound output range>
When the luminance detected by the luminance detection unit b141 is higher than a predetermined luminance stored in advance, the output range display unit b145 displays a circle curve color representing the output range of the sound output from the directional speaker unit a12 with low luminance. Color. Conversely, when the luminance detected by the luminance detection unit b141 is lower than the predetermined luminance stored in advance, the color of the circle curve representing the output range of the sound output from the directional speaker unit a12 is set to a color with high luminance. That is, the output range display unit b145 displays a graphic representing the output range of sound with directivity in a different display mode based on information about brightness such as luminance detected by the luminance detection unit b141.
Thereby, the user of the sound output control device b1 can clearly identify the circle representing the output range of the directional sound based on the luminance difference.
In addition to the brightness and the degree of zoom, the sound output control device b1 includes, for example, volume, output direction distance to the listener, spread of directional sound, time, or position information of the directional speakers a1, a2 with camera. Based on this, the color and shape of the graphic representing the output range of the directional sound may be changed.

  The output range display unit b145 controls display of image information obtained by superimposing a circle image representing the output range of the directional sound of the directional speaker unit a12 on the image of the image information input from the generated captured image processing unit b140. To the part b146.

<Discontinuation of display of graphic representing sound output range>
When the output range display unit b145 starts to display a circle representing the output range of the directional sound of the directional speaker unit a12 on the image of the image information input from the generated captured image processing unit b140, The command is output to the timer unit b13.
Further, the output range display unit b145 displays the directivity of the directional speaker unit a12 when the time elapsed since the output range display unit b145 timed by the time measuring unit b13 has output a time measurement command exceeds a predetermined time stored in advance. Stops displaying circles representing the sound output range in an overlapping manner. That is, the output range display unit b145 stops displaying the graphic representing the output range of the directional sound when the time measured by the time measuring unit b13 exceeds a predetermined time.
Note that the output range display unit b145 may resume displaying a circle representing the output range of the directional sound in response to an input from the input device c1.

The display control unit b146 converts the image information input from the output range display unit b145 into an output format determined by a standard or the like, and outputs it to the monitor d1.
Note that the user of the sound output control device b1 refers to the image (see FIGS. 2 and 3) displayed on the monitor d1, and changes the imaging direction and the zoom magnification of the camera unit a11 by operating the input device c1. Change or control of start and stop of imaging by the camera unit a11 is performed.

<Operation of sound output system>
Hereinafter, the operation of the sound output system according to the present embodiment will be described.
FIG. 5 is a flowchart showing an example of the operation of the sound output system according to the present embodiment.
First, the sound output device b1 captures an image with the camera unit a11 of the directional speaker with camera a1 (S101).
The sound output device b1 detects the output direction distance x to the listener (subject) from the focal length of the camera unit a11 input from the directional speaker a1 with camera, and also has a magnification n from the directional speaker a1 with camera. Get information. (S102).
The sound output device b1 calculates a radius r of a circle representing the output range of the directional sound of the directional speaker with camera a1 from the output direction distance x to the listener detected in step S102 and the magnification n (S103).

The sound output device b1 detects the luminance of the image captured in step S101 (S104). The sound output device b1 determines the color of the circular curve representing the output range of the directional sound of the directional speaker with camera a1 from the luminance detected in step S104 (S105).
The sound output device b1 displays a circle representing the output range of the directional sound with the radius r calculated in step S103 on the monitor d1 by superimposing the curve in the color determined in step S105 on the image captured in step S101. (S106).
The sound output device b1 outputs the input sound data to the directional speaker a1 with camera, and the directional speaker a1 with camera directs the sound of the sound data input from the sound output device b1 from the directional speaker. It outputs as a sound (S107).

The sound output device b1 determines whether or not a predetermined time has elapsed since the circle representing the output range of the directional sound displayed in step S106 has been displayed (S108).
When it is determined in step S108 that the predetermined time has not elapsed since the circle representing the output range of the directional sound was displayed, the sound output device b1 performs the determination in step S109.
Next, the sound output device b1 determines whether or not an imaging end command is input based on an input from the input device c1 (S109). If it is determined in step S109 that an imaging end command has not been input, the sound output device b1 performs the process of step S101. On the other hand, if it is determined in step S109 that an imaging end command has been input, the sound output device b1 ends the operation.

On the other hand, when it is determined in step S108 that a predetermined time has elapsed since the circle representing the output range of the directional sound was displayed, the sound output device b1 performs the process of step S110.
The sound output device b1 stops displaying the circle representing the output range of the directional sound displayed in step S106 (S110).
The sound output device b1 captures an image with the camera unit a11 of the directional speaker with camera a1, and displays the captured image on the monitor d1 (S111).

The sound output device b1 detects a command from the input device c1, and determines whether or not to resume the display of the circle representing the output range of the directional sound (S112).
If it is determined in step S112 that the display of the circle representing the output range of the directional sound is to be resumed, the sound output device b1 performs the process of step S102. On the other hand, if it is determined in step S112 that the display of the circle representing the output range of the directional sound is not resumed, the sound output device b1 performs the determination in step S113.

The sound output device b1 determines whether or not an imaging end command is input based on an input from the input device c1 (S113). If it is determined in step S113 that an imaging end command has not been input, the sound output device b1 performs the process of step S111. On the other hand, if it is determined in step S109 that an imaging end command has been input, the sound output device b1 ends the operation.
Note that the order of step S105 and step S106 may be reversed. That is, the sound output device b1 may display a graphic representing the sound output range after starting the sound output.

Thus, according to the present embodiment, the sound output control device b1 displays a circle representing the output range of the directional sound of the directional speaker with camera a1 on the captured image. Thereby, the output range of a directional sound can be grasped appropriately and accurately.
Further, according to the present embodiment, the sound output control device b1 causes the monitor d1 to display a circle representing the output range of the directional sound of the directional speaker with camera a1. Thereby, the user of the sound output control device b1 outputs a sound to the listener without knowing whether or not the listener is listening to those around the listener who cannot refer to the monitor d1. be able to.

Further, according to the present embodiment, the sound output control device b1 performs control to make the output direction of the directional sound of the directional speaker a1 with camera coincide with the imaging direction of the camera unit a11. Thereby, it is not necessary to calculate the display position of the circle representing the output range of the directional sound due to the difference in both directions, and the processing by the calculation can be reduced.
Further, according to the present embodiment, the sound output control device b1 displays the circle representing the output range of the directional sound as a circle with a different radius r according to the distance from the speaker to the listener. Thereby, the user of the sound output control device b1 can accurately grasp the output range of the directional sound even if the distance between the listener and the speaker changes.

Further, according to the present embodiment, the sound output control device b1 has a radius r of a circle representing the output range of the directional sound of the directional speaker a1 with camera in accordance with the magnification n changed according to the zoom degree of the camera unit a11. change. As a result, the user of the sound output control device b1 can accurately grasp the output range of the directional sound even if the zoom level changes.
Further, according to the present embodiment, the sound output control device b1 stops displaying the circle when a predetermined time has elapsed after displaying the circle representing the directional sound output range of the directional speaker with camera a1. . Thereby, after grasping the output range of the directional sound, the circle representing the directional sound output range of the directional speaker a1 with the camera is not continuously displayed. Therefore, a part of the captured image is displayed in the output range of the directional sound. It is possible to prevent hiding by a circle representing.

(Second Embodiment)
The second embodiment of the present invention will be described below with reference to the drawings.
In the first embodiment, the sound output control device b1 performs control to match the output direction of the directional sound of the directional speaker with camera a1 with the imaging direction of the camera unit a11. In the present embodiment, the sound output control device b2 controls the output direction of the directional sound of the directional speaker a2 with camera independently of the imaging direction of the camera unit a21.
Further, in the present embodiment, the sound output control device b2 receives a circle change instruction indicating the output range of the directional sound by the user's operation, and outputs the directional sound in the output range represented by the circle according to the received change instruction. Output.

<Sound output system>
FIG. 6 is a schematic view showing a sound output system according to the second embodiment of the present invention.
Comparing the sound output system according to the present embodiment (FIG. 6) and the sound output system according to the first embodiment (FIG. 1), only the directional speaker with camera a2 and the sound output control device b2 are different. However, since the functions of other devices (input device c1 and monitor d1) are the same as those in the first embodiment, description of the same devices as those in the first embodiment is omitted.

In this figure, the directional speaker with camera a2 outputs a directional sound to the listener H2 (listener) among the listeners H1 and H2. This figure shows that the output range of the directional sound is the output range S2 of the directional sound, and that the output range of the directional sound is the output range S22 of the directional sound at the position of the listener H2.
The directional speaker with camera a2 includes a directional speaker and outputs directional sound. Further, the directional speaker with camera a2 can change the output range of the directional sound. The directional speaker with camera a2 includes a camera capable of photographing the directional direction of the output range of directional sound.

  The sound output control device b2 controls the directional speaker with camera a2 and displays an image on the monitor d1. This figure shows that the listeners H1 and H2 and the listeners h1 and h2 are displayed on the monitor d1. In this figure, the directional sound output range S22 of the directional speaker a2 at the position of the listener H2 is displayed on the monitor d1 as a circle s22 representing the directional sound output range of the directional speaker a2 with camera. It shows that.

In the present embodiment, it is assumed that the camera of the directional speaker with camera a2 is fixed to the directional speaker with camera a2 and the imaging direction cannot be changed. The directional speaker with camera a2 changes the output direction of the directional sound independently of the camera and changes the output range of the directional sound in accordance with the control by the sound output control device b2.
The sound output control device b2 controls the user to specify the output range of the directional sound of the directional speaker a2 with camera using the input device c1 and to change the output range of the directional sound.

<Display example of output range>
Hereinafter, the figure showing the output range of the directional sound of the directional speaker with camera a2 displayed by the sound output control device b2 according to the present embodiment will be described with reference to FIG.
FIG. 7 is a diagram showing an example of a graphic display representing the output range of directional sound according to the present embodiment.
In this figure, the diagram of D2-1 is the diagram of D1-1 of FIG. 2, and the circle s11 representing the output range of the directional sound represents the same directional sound output range as the circle s11 representing the output range of the directional sound. This is the same as the figure replaced with the circle s21.
In this figure, the diagram of D2-2 is a diagram when the circle s21 representing the output range of the directional sound of the directional speaker a2 with camera is changed to the circle s22 of the diagram of D2-1 by the user's operation. It is. Note that the sound output control device b2 controls the directional speaker a2 with camera to change the output of the directional sound to the directional sound output range indicated by the circle s22 in the diagram D2-1 after the change.
In the diagram of D2-2, the sound output control device b2 determines the output range of the directional sound from the direction indicated by the circle s21 in which the output direction of the directional sound of the directional speaker with camera a2 indicates the output range of the directional sound. This indicates that the direction has been changed in the direction indicated by the circle s22. Further, in the diagram of D2-2, the spread of the directional sound indicated by the size of the circle representing the output range of the directional sound is different from the spread of the directional sound indicated by the circle s21 representing the output range of the directional sound. It shows that it changed so that it might become narrow to the breadth of the directional sound shown by circle | round | yen s22 showing the output range of No ..

<Configuration of sound output control device b2>
Hereinafter, the sound output control device b2 according to the present embodiment will be described.
FIG. 8 is a configuration diagram showing configurations of the directional speaker with camera a2 and the sound output control device b2 according to the present embodiment.

First, the directional speaker a2 with camera will be described. The directional speaker with camera a2 includes a camera part a21 and a directional speaker part a22.
The camera unit a21 is realized by using a lens and a CCD or CMOS image sensor, and is fixed to the directional speaker with camera a2. The camera unit a21 starts and stops imaging in accordance with control by the imaging control unit b243 of the sound output device b2. The camera unit a21 outputs the captured image information and information indicating the magnification n to the captured image processing unit b140 of the sound output device b2.
Moreover, in this embodiment, the camera part a21 is being fixed to the directional speaker a2 with a camera, and the imaging direction cannot be changed independently of the directional speaker a2 with a camera.

The directional speaker unit a22 outputs directional sound. In addition, the directional speaker unit a22 changes the output range of the directional sound according to the control by the directional speaker control unit b244.
For example, the directional speaker unit a22 changes the output direction of the directional sound according to the control by the directional speaker control unit b244. Further, the directional speaker unit a22 increases the spread of the directional sound by increasing the amplification factor m of the amplitude of the directional sound according to the control by the directional speaker control unit b244. Conversely, the directional speaker unit a22 increases the spread of the directional sound by decreasing the amplification factor m of the amplitude of the directional sound.

  Next, the sound output control device b2 will be described. The sound output control device b2 includes a volatile memory b11, a nonvolatile memory b12, and a control unit b24. The control unit b24 inputs / outputs information to / from the volatile memory b11 and the nonvolatile memory b12 and processes the information, thereby realizing the functions of the units included in the control unit b24.

The control unit b24 includes a captured image processing unit b140, a luminance detection unit b141, an imaging control unit b243, a directional speaker control unit b244, an output range display unit b245, a display control unit b146, a display operation control unit b247, and a display output range detection. Part b248 is included.
Since the functions of the captured image processing unit b140, the luminance detection unit b141, and the display control unit b146 (FIG. 8) are the same as those in the first embodiment (FIG. 4), description of the functions is omitted.
The imaging control unit b243 controls the start and stop of imaging by the camera unit a21 based on an input from the input device c1.

The directional speaker control unit b244 outputs the directional sound to the directional sound output range of the information indicating the directional sound output range of the directional speaker with camera a2 input from the display output range detection unit b248. The directional speaker unit a22 of the attached directional speaker a2 is controlled. That is, the directional speaker control unit b244 outputs a directional sound in the directional sound output range represented by the graphic changed by the display output range detection unit b248. The directional speaker control unit b244 The input sound data is output to the directional speaker unit a22. In addition, the directional speaker control unit b244 displays information indicating the output range of the directional sound used for controlling the directional speaker unit a22, for example, the output direction of the directional sound and the amplification factor m of the amplitude of the directional sound. To the part b245.

The output range display unit b245 generates an image in which a circle representing the output range of the sound output from the directional speaker unit a22 (eg, s22 in FIG. 6) is superimposed on the image of the image information input from the captured image processing unit b140. Then, it is displayed on the monitor d1 via the display control unit b146.
Hereinafter, a specific method for displaying the image will be described.

<How to display a graphic representing the output range of sound>
The output range display unit b245 calculates the radius r of the circle representing the output range of the directional sound of the directional speaker with camera a2 using the magnification n and the amplification factor m of the amplitude of the directional sound.

Moreover, the output range display part b245 determines the display position of the circle representing the sound output range from the information on the output direction of the directional sound of the directional speaker with camera a2 input from the directional speaker control part b244.
The output range display unit b245 determines the image of the image information input from the captured image processing unit b140 as a circle representing the output range of the directional sound of the directional speaker a2 with the camera as the circle image having the calculated radius r. The superimposed image is generated at the displayed position (see FIG. 7).

  The user of the sound output control device b2 refers to the circle (for example, s21 in FIG. 7) representing the output range of the directional sound of the directional speaker with camera a2 displayed on the monitor d1 by the above processing, and the input device c1. Is changed to the display position or size of a circle representing the output range of the directional sound of the directional speaker a2 with camera (for example, the circle representing the output range of the sound after the change is s22 in FIG. 7).

The display operation control unit b247 accepts an instruction to change a graphic representing the output range of finger sounds by the user's operation of the input device c1. The display operation control unit b247 generates a circle image representing the output range of the directional sound after the change by the received change instruction, and displays the image on the monitor d1 via the display control unit b146.
The display output range detection unit b248 detects the display position or size of a circle that represents the output range of the directional sound that is displayed by the display control unit b146, and each displays the directivity as information indicating the output range of the sound of the directional speaker. It outputs to the speaker control part b244.

<Operation of sound output system>
Hereinafter, the operation of the sound output system according to the present embodiment will be described.
FIG. 9 is a flowchart showing an example of the operation of the sound output system according to the present embodiment.
First, the sound output device b2 takes an image with the camera unit a21 of the directional speaker with camera a2 (S201). The sound output device b2 detects the amplification factor m of the directional sound amplitude of the directional speaker with camera a2, and obtains the magnification n from the directional speaker with camera a2. (S202).
The sound output device b2 calculates the radius r of a circle representing the output range of the directional sound from the amplification factor m of the sound amplitude detected in step S202 and the magnification n (S203).

The sound output device b2 acquires the output direction of the directional sound of the directional speaker with camera a2 (S204). The sound output device b2 determines the display position of a circle representing the output range of the directional sound of the directional speaker a2 with camera from the output direction of the directional sound acquired in step S204 (S205).
The sound output device b2 superimposes a circle representing the output range of the directional sound of the directional speaker with a radius r calculated in step S203 on the image captured in step S201 on the display position determined in step S205, It is displayed on the monitor d1 (S206).

The sound output device b2 determines whether or not there is a change in the display position or size of the circle representing the output range of the directional sound of the directional speaker with camera a2 displayed in step S206 based on the input from the input device c1. (S207).
If it is determined in step S207 that there is a change in the display position or size of the circle representing the output range of the directional sound displayed in step S206, the sound output device b2 performs the process in step S206. On the other hand, if it is determined in step S207 that there is no change in the display position or size of the circle representing the output range of the directional sound displayed in step S206, the sound output device b2 performs the process in step S208. .

The sound output device b2 detects the display position or size of a circle representing the output range of the directional sound displayed in step S206, and calculates the output direction and amplitude amplification factor m of the corresponding directional sound, respectively (S208). .
The sound output device b2 outputs the input sound data and information indicating the output direction of the directional sound and the amplitude amplification factor m calculated in step S208 to the directional speaker with camera a2. The directional speaker a2 with camera is information indicating the amplification factor m of the sound data input from the sound output device b2 in the direction of information indicating the output direction of the directional sound input from the sound output device b2. Are amplified and output (S209).

  The sound output device b2 determines whether or not an imaging end command is input based on an input from the input device c1 (S210). If it is determined in step S210 that an imaging end command has not been input, the sound output device b2 performs the process of step S201. On the other hand, if it is determined in step S210 that an imaging end command has been input, the sound output device b2 ends the operation.

Thus, according to the present embodiment, the sound output control device b2 displays a circle representing the output range of the directional sound of the directional speaker with camera a2 on the captured image. Thereby, the output range of a directional sound can be grasped appropriately and accurately.
Further, according to the present embodiment, the sound output control device b2 accepts a graphic change instruction representing the output range of the directional sound by the user's operation, and in the output range represented by the graphic according to the received change instruction, Output directional sound. Thereby, the user of the sound output control device b2 can easily and appropriately output the directional sound in the directional sound output range.

<Modification>
In the first embodiment, the distance detection unit b142 detects the output direction distance to the listener based on the focal length information input from the captured image processing unit b140. However, the present invention is not limited to this. For example, the directional speaker with camera a1 includes a transmitter and a receiver such as an ultrasonic wave and a radio wave. The output direction distance to the listener may be detected based on the time that is the difference from the reception time of the reflected wave from the subject and the speed of the ultrasonic wave or radio wave.

  In the second embodiment, the camera unit a21 of the directional speaker with camera a2 is provided fixed to the directional speaker with camera a2, and its imaging direction cannot be changed. However, the present invention is not limited to this, and the sound output control device b2 may change the imaging direction of the camera unit a21. When the camera of the directional speaker with camera a2 changes its imaging direction, the sound output range is expressed based on the relative direction between the imaging direction and the output direction of the directional sound of the directional speaker with camera a2. What is necessary is just to determine the display position of a circle.

  In the second embodiment, the sound output control device b2 detects a change in a circle representing the output range of the directional sound, and calculates the output direction and amplitude amplification factor m of the directional sound of the directional speaker a2 with camera. It is changing. However, the present invention is not limited to this, and the sound output control device b2 does not change the circle representing the output range of the directional sound, and sets the output direction or amplitude amplification factor m of the directional sound of the directional speaker a2 with camera. You may change it. In this case, the sound output control device b2 may change and display the graphic representing the output range of the directional sound after the sound output direction or the amplitude amplification factor m of the directional speaker with camera a2 changes.

In the second embodiment, the sound output control device b2 accepts a change instruction for a circle indicating the output range of the directional sound by the user's operation, and the output range represented by the circle according to the received change instruction is A directional sound was output. Furthermore, the sound output control device b2 may control the imaging direction in which the camera takes an image so that a circle according to the change instruction by the user's operation is displayed in the display range of the image displayed on the monitor d1. . For example, when the display output range detection unit b248 detects that the circle according to the display instruction received by the display operation control unit b247 is outside the display range of the image displayed by the output range display unit b146, the output range display Information that changes the imaging direction of the camera from the image displayed by the unit b 146 toward the center of the circle according to the display instruction is output to the imaging control unit b 243. The imaging control unit b243 changes the imaging direction of the camera of the camera unit a21 according to the information for changing the imaging direction of the camera input from the display output range detection unit b248.
Thereby, the user of the sound output control device b2 can easily and appropriately confirm the output range of the sound having the directivity.

  In each of the above embodiments, the sound output control devices b1 and b2 are based on the luminance, volume, output direction distance to the listener, spread of directional sound, time, or position information of the directional speakers with a camera a1 and a2. The color and shape of the graphic representing the output range of the directional sound may be changed.

  Further, in each of the above embodiments, the sound output control devices b1 and b2 display the circle display position representing the sound output range based on the distance between the center (optical axis) of the lens of the camera units a11 and a21 and the center of the directional sound. May be corrected.

  In each of the above embodiments, the camera unit a21 and the directional speaker of the directional speaker with camera a2 are provided in the same housing. However, the present invention is not limited to this, and may be provided in different housings. In this case, the imaging direction of the camera units a11 and a21, the sound output direction of the directional speaker, and the distance between the lens center of the camera units a11 and a21 and the center of the directional sound, What is necessary is just to determine a display position.

  In each of the above embodiments, the camera-equipped directional speakers a1 and a2 are separate from the sound output control devices b1 and b2. However, the present invention is not limited to this, and the sound output control devices b1 and b2 may be provided with the directional speakers a1 and a2 with camera, or may be the same housing as the monitor d1.

In each of the above embodiments, the sound output control devices b1 and b2 may display a graphic representing the output range of the directional sound while the directional speakers with a camera a1 and a2 output the directional sound. In this case, for example, when the directional speaker control units b144 and b244 start outputting the sound data to the directional speaker units a12 and a22, or when the output ends, information indicating that the output of the sound data starts or ends. And output to the output range display parts b145 and b245. When the information indicating that the sound data starts to be output is input from the directional speaker control units b144 and b244, the output range display units b145 and b245 start displaying a graphic representing the output range of the directional sound, and the sound data When the information indicating that the output ends is input, the display of the graphic representing the output range of the directional sound may be ended.
As a result, the sound output control devices b1 and b2 display the graphic representing the output range of the directional sound while the directional speakers with a camera a1 and a2 output the directional sound, so that the sound output control devices b1 and b2 The user can easily grasp whether or not the sound output control devices b1 and b2 are outputting sound.

In each of the above embodiments, the sound output control devices b1 and b2 may cause the user of the sound output control devices b1 and b2 to select display or non-display of a graphic representing the output range of the directional sound.
Further, in each of the above embodiments, the sound output control devices b1 and b2 may store the face authentication result and the sound output possibility in advance in association with each other, and output the sound based on the subject face authentication result.

  Moreover, in each said embodiment, although the sound output control apparatus b1 and b2 and the directional speaker with camera a1 and a2 showed the example with which the different housing | casing was equipped, this invention is not limited to this, Some or all of them may be provided in the same housing. For example, the sound output control device b1 may include either one of the camera unit a11 or the directional speaker unit a12, or may include both. Similarly, for example, the sound output control device b2 may include either one of the camera unit a21 or the directional speaker unit a22, or may include both.

  In addition, a part of the sound output control devices b1 and b2 in the above-described embodiment, the timing unit b13, the captured image processing unit b140, the luminance detection unit b141, the distance detection unit b142, the imaging control units b143 and b243, and the directional speaker control unit The b144 and b244, the output range display units b145 and b245, the display control unit b146, the display operation control unit b247, and the display output range detection unit b248 may be realized by the sound output control devices b1 and b2. In that case, a program for realizing this control function is recorded on a computer-readable recording medium, and the program recorded on this recording medium is read into the computer system of the sound output control devices b1 and b2 and executed. It may be realized by. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In this case, a volatile memory b11 in the computer system serving as a server or a client may be included that holds a program for a certain period of time. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention. It is possible to

1 is a schematic diagram showing a sound output system according to a first embodiment of the present invention. It is a figure which shows an example of the display of the output range of the sound by the sound output control apparatus which concerns on this embodiment. It is a figure which shows another example of the display of the output range of the sound by the sound output control apparatus which concerns on this embodiment. It is a block diagram which shows the structure of the directional speaker with a camera and sound output control apparatus which concern on this embodiment. It is a flowchart which shows an example of operation | movement of the sound output system which concerns on this embodiment. It is the schematic which shows the sound output system which concerns on 2nd Embodiment of this invention. It is a figure which shows an example of the display of the output range of the sound by the sound output control apparatus which concerns on this embodiment. It is a block diagram which shows the structure of the directional speaker with a camera and sound output control apparatus which concern on this embodiment. It is a flowchart which shows an example of operation | movement of the sound output system which concerns on this embodiment.

Explanation of symbols

a1, a2 ... Directional speaker with camera, b1, b2 ... Sound output control device, c1 ... Input device, d1 ... Monitor (display device)
a11, a21 ... camera unit, a12, a22 ... directional speaker unit b11 ... volatile memory, b12, b22 ... non-volatile memory, b13 ... timing unit, b14, b24 ... Control unit b140 ... captured image processing unit, b141 ... luminance detection unit (brightness detection unit), b142 ... distance detection unit, b143, b243 ... imaging control unit, b144, b244 ... directivity Speaker control unit (direction control unit), b145, b245 ... output range display unit, b146 ... display control unit, b247 ... display operation control unit, b248 ... display output range detection unit

Claims (11)

A sound output control device for controlling a directional speaker that outputs sound having directivity,
A captured image processing unit that captures imaging information captured by a camera capable of changing a shooting direction and generates image information;
An output range display unit that displays an image in which an image of the image information generated by the captured image processing unit is superimposed on a graphic representing an output range that is a range in which the directional sound output from the directional speaker can be heard ;
A sound output control device comprising: The sound according to claim 1, further comprising: a direction control unit that controls the directional speaker so that an output direction of the sound having directivity and an imaging direction captured by the camera are the same direction. Output control device. A distance detection unit for detecting a distance between a listening body that is an output destination of the sound having directivity and the directional speaker;
The output range display section, according to the distance the distance detector is measured, the sound output control device according to claim 1, characterized in that to display at different display mode graphic representing the previous Kide force range. A display operation controller for accepting a change instruction figure representing the previous Kide force range by the user's operation,
A directional speaker control unit for outputting the sound having directivity in an output range represented by a graphic in accordance with the change instruction received by the display operation control unit;
The sound output control device according to claim 1, comprising: A display operation controller for accepting a change instruction figure representing the previous Kide force range by the user's operation,
An imaging control unit that controls an imaging direction captured by the camera so that a graphic in accordance with the change instruction received by the display operation control unit is displayed in a display range of an image displayed by the output range display unit;
The sound output control device according to claim 1, comprising: The output range display section, in accordance with the degree of zoom of the camera, the sound output control device according to claim 1, characterized in that to display at different display mode graphic representing the previous Kide force range. It has a brightness detector that detects the brightness of the captured image,
The output range display section, based on information about brightness the brightness detector detects the sound output according to claim 1, characterized in that to display a graphic representing the previous Kide force range in a different display mode Control device. Includes a time measurement unit for measuring the time elapsed since the display of the figure representing the previous Kide force range,
The output range display section, the time during which the timer unit is determined exceeds a predetermined time, the sound output control device according to discontinue the display of graphics representing the previous Kide force range to claim 1, wherein . The output range display section, while the directional speaker is outputting a sound with the directional sound output control according to claim 1, characterized in that to display a graphic representing the previous Kide force range apparatus. A sound output control method in a sound output control device for controlling a directional speaker that outputs sound having directivity,
A first process in which the sound output control device captures image information captured by a camera capable of changing a shooting direction;
The sound output control device superimposes and displays a graphic representing an output range that is a range in which the directional sound output from the directional speaker can be heard on the image of the image information captured in the first process. The second process,
A sound output control method characterized by comprising: To the computer of the sound output control device that controls the directional speaker that outputs sound with directivity,
Captured image processing means for capturing image information captured by a camera capable of changing the shooting direction,
Output range display means for displaying an image of the image information captured by the captured image processing means in a superimposed manner with a graphic representing an output range in which the directional sound output from the directional speaker can be heard ;
Sound output control program to function as.

Images