JP2010268284A - Television device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a television device for executing noise suppression control suitable for a viewer only if the viewer is present. <P>SOLUTION: The television device includes: microphones 4, 5 provided for the television device and collecting sound around the device; a noise detector 16 for detecting noise information around the device from the sound collected by the microphones 4, 5 and broadcast sound processed in the device to be output from the television device; a camera 6 arranged on the television device and imaging the periphery of the device; an image processor 17 for detecting a viewer situation from an image of the camera 6; a control means 15 for creating noise suppression sound based on the noise information and the viewer situation; and loudspeakers 2, 3 for outputting the noise suppression sound by being superposed on the broadcast sound. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a television apparatus having a function of suppressing ambient noise during viewing.

  In a conventional television apparatus (hereinafter also referred to as “TV”), when ambient noise such as the voices of people around the vehicle and automobile noise increases, the viewer may miss the sound of the television. Therefore, the viewer has to deal with ambient noise by performing an operation such as increasing the volume by himself / herself.

  In that respect, the sound correction apparatus disclosed in Patent Document 1 detects noise from the sound collected by a microphone built in the remote controller, and corrects the sound pressure level according to the noise. This eliminates the need for the viewer to control the volume on his / her own.

JP 2005-6247 A

  The sound correction apparatus disclosed in Patent Document 1 detects noise from the sound collected by a microphone built in a remote controller, and corrects the sound pressure level according to the noise. However, since it is assumed that there is a viewer near the remote control, when the viewer is watching away from the remote control, it is not possible to accurately grasp the noise situation to which the viewer is exposed. Noise suppression control cannot be performed.

  In addition, the sound pressure level is corrected every time ambient noise is detected regardless of whether the viewer is watching TV or not, which is inefficient.

  Therefore, in view of the above-described problems, the present invention has an object to provide a television apparatus that performs appropriate noise suppression control for a viewer only when there is a viewer.

  The television device of the present invention is provided in the television device, from a microphone that collects sound around the device, from the sound collected by the microphone and the broadcast sound processed in the device to be output from the television device, A noise detection device that detects noise information around the device, a camera that is provided in the television device, shoots the periphery of the device, an image processing device that detects the viewer status from the video of the camera, and the noise information and the viewer status Based on the above, it is characterized by comprising control means for creating a noise suppression sound and a speaker for outputting the noise suppression sound superimposed on the broadcast sound.

  The television device of the present invention is provided in the television device, from a microphone that collects sound around the device, from the sound collected by the microphone and the broadcast sound processed in the device to be output from the television device, A noise detection device that detects noise information around the device, a camera that is provided in the television device, shoots the periphery of the device, an image processing device that detects the viewer status from the video of the camera, and the noise information and the viewer status Based on the above, it is characterized by comprising control means for creating a noise suppression sound and a speaker for outputting the noise suppression sound superimposed on the broadcast sound. Thereby, noise suppression control appropriate for the viewer can be performed only when there is a viewer.

FIG. 2 is a plan view of the television device according to the first embodiment. FIG. 3 is a conceptual diagram during operation of the television device according to the first embodiment. 1 is a block diagram illustrating a configuration of a television device according to a first embodiment. 3 is a flowchart illustrating an operation of the television device according to the first embodiment.

(Embodiment 1)
<Configuration>
FIG. 1 is a plan view of a television device (hereinafter also referred to as “television”) according to Embodiment 1. FIG. As shown in FIG. 1, the television apparatus includes a housing 1, speakers 2 and 3, noise collecting microphones 4 and 5, and a camera 6 for photographing a viewer. .

  FIG. 3 is a block diagram illustrating a configuration of the television device according to the first embodiment. As shown in FIG. 3, the television apparatus includes a tuner 12 that receives a broadcast wave from an antenna 11, a demodulator 13 that demodulates a broadcast video signal and a broadcast audio signal from the broadcast wave received by the tuner 12, and a demodulator. A sound processor 14 that converts the broadcast sound signal demodulated by 13 into a format that can be processed by the CPU 15 in the subsequent stage, a noise detector 16 that detects noise information from the sound collected by the CPU 15 and the microphones 4 and 5, and a camera. 6 includes an image processing device 17 that detects a viewer situation from the video imaged by the camera 6.

  The noise information detected by the noise detection device 16 is the noise level, frequency waveform, time waveform, and arrival direction, and the viewer status detected by the image processing device 17 is the presence / absence of the viewer, the viewer and the TV. Distance, whether or not the viewer is watching TV, and so on.

<Operation>
FIG. 2 is a schematic diagram during operation of the television device according to the first embodiment. A predetermined range on the front surface of the television device is determined in advance as a noise suppression control range 10. If the viewer 7 exists in this range and the level of the ambient noise 9 exceeds the specified value, the ambient noise suppression sound is superimposed on the television viewing sound 8 (broadcast audio), and the speakers 2 and 3 Output from. Thereby, since the viewer 7 listens to the viewing sound 8 on which the noise suppression sound is superimposed, even if the surrounding noise is large, it is not necessary to operate the volume of the television by itself and can continue to listen to the viewing sound 8.

  The television apparatus detects the noise information of the ambient noise 9 from the sound around the apparatus collected by the built-in microphones 4 and 5, but also determines the arrival direction as well as the noise level. Therefore, in the television device of this embodiment, at least two microphones are required to be separated from each other. By detecting the direction of arrival of the ambient noise 9, the noise situation at the ear of the viewer 7 is grasped, and the ambient noise 9 is effectively suppressed.

  That is, in the television device of the first embodiment, two or more microphones are provided apart from each other, and the noise detection device 16 detects the arrival direction of noise around the device as noise information. By detecting the noise arrival direction, the noise situation around the viewer 7 can be grasped, and effective noise control becomes possible.

  Specifically, the operation of the television device will be described with reference to FIG. When the tuner 12 receives a television broadcast via the antenna 11, the demodulator 13 demodulates the broadcast video signal and the broadcast audio signal from the received signal. The audio processing device 14 converts the broadcast audio signal into a format that can be processed by the CPU 15 and sends it to the CPU 15 and the noise detection device 16.

  The noise detection device 16 extracts a noise component from the sound collected by the microphones 4 and 5 based on the broadcast audio signal from the audio processing device 14. Since the noise detection device 16 has a function of learning and estimating the broadcast sound signal and the sound collected by the microphones 4 and 5, the noise detection device 16 extracts noise components from the sound collected by the microphones 4 and 5, and detects noise information. I can do it.

  The image processing device 17 determines whether or not the viewer 7 is in the noise suppression range 10 from the video captured by the camera 6 built in the housing 1 as the viewer information, and is in the noise suppression range 10. It is determined whether or not the viewer 7 is watching the television (whether the face is facing the screen or the like). Further, the distance between the television device and the viewer 7 is also measured.

  That is, the image processing device 17 determines whether or not the viewer 7 is within the predetermined noise suppression range 10, the distance between the viewer 7 and the device, and whether or not the viewer 7 is viewing as the viewer status. Is detected. Thereby, noise suppression control can be performed only when the viewer 7 is viewing. Further, if the arrival direction of noise is acquired in addition to the distance to the viewer 7, the noise situation at the viewer's ear can be grasped.

  The CPU 15 determines whether it is necessary to suppress the ambient noise 9 based on the noise information of the noise detection device 16 and the viewer information of the image processing device 17. In the case of suppression, ambient noise suppression sound is superimposed on the broadcast audio signal from the audio processing device 14.

  Specifically, the CPU 15 confirms from the signal of the image processing device 17 that the viewer 7 is watching the television in the noise suppression range 10. Further, the distance between the television and the viewer 7 is also acquired.

  Next, the CPU 15 obtains the time waveform, frequency waveform, level, and arrival direction of the ambient noise 9 as noise information from the noise detection device 16. When the noise level is equal to or higher than the specified value N1, control for suppressing the ambient noise 9 is performed. That is, the noise component heard by the viewer 7 is estimated from the distance between the TV and the viewer 7 and the time waveform, frequency waveform, and arrival direction information of the ambient noise 9, and the ambient noise 9 at the ear of the viewer 7 is determined. A sound for suppression (suppression sound) is calculated. Then, the suppression sound is superimposed on the broadcast audio signal of the audio processing device 14. The noise suppression sound is, for example, a sound having a phase opposite to that of the noise. Since the viewer 7 listens to the broadcast sound and the noise suppression sound superimposed thereon as the TV viewing sound 8, the viewer can listen to the broadcast sound even in a viewing environment exposed to the ambient noise 9.

  That is, the television apparatus according to the first embodiment is provided in the television apparatus, and the microphones 4 and 5 that collect sounds around the apparatus and the sounds collected by the microphones 4 and 5 are output from the television apparatus. A noise detection device 16 that detects noise information around the device from broadcast audio processed in the device, a camera 6 that is provided in the television device and shoots around the device, and detects the viewer status from the video of the camera. Based on the image processing device 17, control means (CPU 15) that creates noise suppression sound based on the noise information and the viewer situation, and speakers 2 and 3 that output the noise suppression sound superimposed on the broadcast sound. Prepare. Since the ambient noise 9 is canceled by the noise suppression sound, the viewer 7 can listen to the broadcast sound even if the viewer 7 is exposed to the ambient noise 9.

  Further, in the television device of the first embodiment, the noise detection device 16 has a function of learning the change of the sound collected by the microphones 4 and 5 and the broadcast sound, and based on the learning, the noise around the device Detects the time waveform, frequency waveform, level, and arrival direction of noise. By detecting the noise information, it is possible to create a suppression sound for the ambient noise 9.

  Furthermore, the control means (CPU 15) creates a noise suppression sound when the viewer 7 is viewing within the noise suppression range 10 and the noise level is equal to or higher than the first predetermined value N1. Thus, the noise suppression control can be performed only when the viewer 7 is viewing and noise suppression is necessary.

  In order to prevent the viewer 7 from feeling uncomfortable with the fluctuations in the TV viewing sound 8 and the ambient noise 9, the noise level specified value N1 which is the determination condition for the noise suppression control described above is the volume of the broadcast audio signal. It may be changed in conjunction. For example, when the volume of the television is high, the suppression control is not performed at a low noise level by increasing the noise level threshold N1 compared to when the volume is low.

  That is, the first predetermined value N1 of the noise level changes according to the volume of the broadcast sound output from the speakers 4 and 5. Thereby, the surrounding noise 9 can be suppressed without giving the viewer 7 a sense of incongruity.

  Further, in the case of a noise level equal to or higher than a specified value N2 larger than the specified value N1, in addition to the noise suppression control described above, the volume of the television can be increased.

  That is, the control means (CPU 15) suppresses noise by increasing the volume of broadcast audio output from the speakers 2 and 3 when the noise level is equal to or higher than the second predetermined value N2 that is greater than the first predetermined value N1. Create sound. Thereby, the viewer 7 can listen to the broadcast sound more clearly.

  Furthermore, it is possible to prevent the viewer 7 from feeling uncomfortable by gradually performing the noise suppression sound and the volume control of the broadcast audio signal without performing them at once. Although the noise suppression sound is superimposed on the broadcast audio signal and output from the speakers 2 and 3, the broadcast audio signal and the noise suppression sound may be output separately.

  That is, the control means (CPU 15) gradually performs noise suppression sound and broadcast sound volume control. Thereby, the surrounding noise 9 can be suppressed without giving the viewer 7 a sense of incongruity.

  Also, the speakers 2 and 3 do not superimpose noise suppression sound on the broadcast sound, but output the broadcast sound and noise suppression sound separately. Even by such a method, the ambient noise 9 can be suppressed.

<Control procedure>
Next, the flow of noise suppression control performed by the CPU 15 described so far will be described with reference to the flowchart of FIG. First, when the television is activated by an operation of a key or the like provided on the remote controller or the apparatus main body, the CPU 15 acquires information on the viewer status from the image processing apparatus 17 (step S1). Next, based on the acquired information on the viewer status, it is determined whether or not the viewer 7 is present in the noise suppression range 10 (step S2). If it does not exist, whether or not the viewer 7 exists in the noise suppression range 10 is continuously monitored in step S2.

  If the viewer 7 exists in the noise suppression range 10, it is determined whether or not the viewer 7 is watching TV, and the distance between the viewer 7 and the TV is measured (step S3). Whether or not the viewer 7 is watching the television is determined by detecting the orientation and facial expression of the viewer 7 using, for example, face recognition technology. If it is determined that the user is not viewing the television, the process returns to step S2 to monitor whether or not the viewer 7 exists in the noise suppression range 10.

  If it is determined that the viewer 7 is watching the television, the detection of the ambient noise 9 is started (step S4). That is, noise information is acquired from the noise detection device 16. It is determined whether or not the noise level is equal to or higher than the specified value N1 (step S5). If the noise level is equal to or lower than the specified value N1, the process returns to step S2 to monitor whether or not the viewer 7 exists in the noise suppression range 10.

  If it is not less than the specified value N1, it is further determined whether or not the noise level is not less than the specified value N2 (step S6). If N2 or less, the noise suppression sound is directly superimposed on the broadcast sound from the sound processing device 14 (step S7). However, if it is N2 or more, the volume of the broadcast sound is increased because the noise is very large (step S8), and the noise suppression sound is superimposed on it (step S7). The noise suppression sound estimates the noise situation around the viewer 7 from the distance information between the TV and the viewer obtained in step S3 and the noise information (time waveform, frequency waveform, level, direction of arrival) obtained in step S4. The sound that suppresses this is calculated.

  Thereafter, broadcast sound and noise suppression sound superimposed thereon are output from the speakers 2 and 3 (step S9). Since the ambient noise 9 is constantly fluctuating, the process returns to step S2 again to check the viewing status and noise information of the viewer 7, and the suppression control of the ambient noise 9 is repeated.

<Effect>
The television device according to Embodiment 1 has the following effects. That is, the television apparatus according to the first embodiment is provided in the television apparatus, and the microphones 4 and 5 that collect sounds around the apparatus and the sounds collected by the microphones 4 and 5 are output from the television apparatus. A noise detection device 16 that detects noise information around the device from broadcast audio processed in the device, a camera 6 that is provided in the television device and shoots around the device, and detects the viewer status from the video of the camera. Based on the image processing device 17, control means (CPU 15) that creates noise suppression sound based on the noise information and the viewer situation, and speakers 2 and 3 that output the noise suppression sound superimposed on the broadcast sound. Prepare. Since the ambient noise 9 is canceled by the noise suppression sound, the viewer 7 can listen to the broadcast sound even if the viewer 7 is exposed to the ambient noise 9.

  In the television apparatus, two or more microphones are provided apart from each other, and the noise detection device 16 detects the arrival direction of noise around the device as noise information. By detecting the noise arrival direction, the noise situation around the viewer 7 can be grasped, and effective noise control becomes possible.

  In addition, the noise detection device 16 has a function of learning the change of the sound collected by the microphones 4 and 5 and the change of the broadcast sound, and based on the learning, the noise information includes a time waveform, a frequency waveform, a level of noise around the device. , Detect the direction of arrival. By detecting the noise information, it is possible to create a suppression sound for the ambient noise 9.

  Furthermore, the image processing device 17 determines whether or not the viewer 7 is within the predetermined noise suppression range 10, the distance between the viewer 7 and the device, and whether the viewer 7 is viewing or not. Is detected. Thereby, noise suppression control can be performed only when the viewer 7 is viewing. Further, if the arrival direction of noise is acquired in addition to the distance to the viewer 7, the noise situation at the viewer's ear can be grasped.

  Further, the control means (CPU 15) creates a noise suppression sound when the viewer 7 is viewing within the noise suppression range 10 and the noise level is equal to or higher than the first predetermined value N1. Thus, the noise suppression control can be performed only when the viewer 7 is viewing and noise suppression is necessary.

  Furthermore, the first predetermined value N1 of the noise level changes according to the volume of the broadcast audio output from the speakers 4 and 5. Thereby, the surrounding noise 9 can be suppressed without giving the viewer 7 a sense of incongruity.

  Further, the control means (CPU 15) suppresses noise by increasing the volume of broadcast sound output from the speakers 2 and 3 when the noise level is equal to or higher than a second predetermined value N2 that is greater than the first predetermined value N1. Create sound. Thereby, the viewer 7 can listen to the broadcast sound more clearly.

  Furthermore, the control means (CPU 15) gradually performs noise suppression sound and broadcast sound volume control. Thereby, the surrounding noise 9 can be suppressed without giving the viewer 7 a sense of incongruity.

  Alternatively, the speakers 2 and 3 do not superimpose the noise suppression sound on the broadcast sound, but separately output the broadcast sound and the noise suppression sound. Even by such a method, the ambient noise 9 can be suppressed.

  DESCRIPTION OF SYMBOLS 1 Case, 2, 3 Speaker, 4, 5 Microphone, 6 Camera, 7 Viewer, 8 Viewing sound, 9 Ambient noise, 10 Noise suppression control range, 11 Antenna, 12 Tuner, 13 Demodulator, 14 Audio processing device, 15 CPU, 16 noise detection device, 17 image processing device.

Claims (9)

A microphone provided in the television device for collecting sounds around the device;
A noise detection device for detecting noise information around the device from the sound collected by the microphone and the broadcast sound processed in the device to be output from the television device;
A camera provided in the television device for photographing the periphery of the device;
An image processing device for detecting a viewer situation from the video of the camera;
Control means for creating a noise suppression sound based on the noise information and the viewer status;
And a speaker that outputs the noise suppression sound superimposed on the broadcast sound. Two or more microphones are provided apart from each other,
The television apparatus according to claim 1, wherein the noise detection device detects an arrival direction of noise around the device as the noise information.   The noise detection device has a function of learning a change in sound collected by the microphone and broadcast sound, and based on the learning, as the noise information, a time waveform, a frequency waveform, a level, an arrival direction of noise around the device The television device according to claim 2, wherein the television device is detected.   The image processing device detects, as the viewer status, presence / absence of a viewer within a predetermined noise suppression range, a distance between the viewer and the device, and whether or not the viewer is watching. The television apparatus according to claim 1, wherein:   The control means creates the noise suppression sound when a viewer is viewing within the noise suppression range and the noise level is equal to or higher than a first predetermined value. Item 5. The television device according to Item 4.   The television apparatus according to claim 5, wherein the first predetermined value changes in accordance with a volume of the broadcast audio output from the speaker.   The control means increases the volume of the broadcast audio output from the speaker when the noise level is equal to or higher than a second predetermined value that is greater than the first predetermined value, and creates the noise suppression sound. The television apparatus according to claim 5 or 6, wherein   The television apparatus according to claim 1, wherein the control unit gradually performs volume control of the noise suppression sound and the broadcast sound.   The television apparatus according to claim 1, wherein the speaker separates and outputs the broadcast sound and a noise suppression sound instead of the superposition.

Images