JP2011248309A - Acoustic processing device and electronic equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an acoustic processing device for suppressing strangeness felt by a user with respect to an acoustic signal superimposed with an additional acoustic signal, and provide electronic equipment including the acoustic processing device.SOLUTION: In the acoustic processing device, an acoustic signal analyzing section 81 analyzes an acoustic signal. An adjusting method determining section 83, an acoustic signal adjusting section 84, and an additional acoustic signal adjusting section 85 adjust an acoustic signal and an additional acoustic signal based on the analysis result of the acoustic signal analyzing section 81. A superimposing section 86 superimposes the adjusted additional acoustic signal on the adjusted acoustic signal. Accordingly, a degree for adjusting the additional acoustic signal is suppressed as compared with a case where only the additional acoustic signal is adjusted to obtain a predetermined effect.

Description

  The present invention relates to an acoustic processing device that processes and outputs an input acoustic signal, and an electronic apparatus including the acoustic processing device.

  Conventionally, an additional acoustic signal (hereinafter referred to as an additional acoustic signal) such as BGM (Back Ground Music) is superimposed on an acoustic signal (for example, an acoustic signal included in a moving image file created using a video camera or the like). Sound processing devices have been proposed. In particular, in Patent Literature 1 and Patent Literature 2, an acoustic processing device that adjusts the signal level of an additional acoustic signal to be superimposed based on the signal level of an acoustic signal to be processed (can be interpreted as a volume; the same applies hereinafter). Proposed.

  In the sound processing device described in Patent Document 1, the signal level of the superimposed additional sound signal is adjusted in consideration of the signal level of the sound signal so that the sound signal is not erased by the additional sound signal. When noise is included in the acoustic signal, the signal level of the superimposed additional acoustic signal is amplified so that the noise is hidden by the additional acoustic signal.

  Further, in the sound processing device described in Patent Document 2, when the signal level of the sound signal is small (at the time of chat), the signal level of the superimposed additional sound signal is amplified so that the chat is hidden by the additional sound signal. To do. In addition, when the level of the acoustic signal is high (during speech), the signal level of the superimposed additional acoustic signal is attenuated so that the user can easily hear the content of the speech.

JP 2004-221666 A JP 2006-148183 A

  An example of the operation of the acoustic processing apparatus that adjusts the signal level of the additional acoustic signal to be superimposed according to the signal level of the acoustic signal as described above will be described with reference to FIG. FIG. 6 is a graph showing an operation example of a conventional sound processing apparatus. In FIG. 6, the temporal fluctuation of the signal level of the acoustic signal is indicated by a solid line, and the temporal fluctuation of the signal level of the adjusted additional acoustic signal is indicated by a broken line. Further, in the “sound generation period” in the figure, the signal level of the acoustic signal is temporarily increased.

  As shown in FIG. 6, in the “sound generation period” in which the signal level of the acoustic signal increases, the signal level of the superimposed additional acoustic signal is attenuated. Therefore, it becomes easy for the user to hear the contents of the acoustic signal from the acoustic signal obtained by superimposing the additional acoustic signal. However, when the adjustment as shown in FIG. 6 is performed, the signal level of the additional acoustic signal varies greatly. Then, since the user can hear the sound (such as BGM) indicated by the additional acoustic signal, the user feels uncomfortable with the acoustic signal obtained by superimposing the additional acoustic signal, which is a problem.

  Accordingly, an object of the present invention is to provide an acoustic processing device that suppresses a user's uncomfortable feeling with respect to an acoustic signal on which an additional acoustic signal is superimposed, and an electronic device including the acoustic processing device.

  In order to achieve the above object, an acoustic processing device according to the present invention includes an acoustic signal analysis unit that analyzes an acoustic signal, and an additional signal that indicates an acoustic signal and a predetermined sound based on an analysis result of the acoustic signal analysis unit. An adjustment unit that adjusts the signal, and a superimposition unit that superimposes the additional acoustic signal adjusted by the adjustment unit on the acoustic signal adjusted by the adjustment unit.

  In the following embodiments, an adjustment method determining unit, an input acoustic signal adjusting unit, and an additional acoustic signal adjusting unit are described as examples of the adjusting unit.

  Further, in the acoustic processing device having the above-described configuration, the acoustic signal analysis unit analyzes whether or not a component indicating utterance is included in the acoustic signal, and the acoustic signal analysis unit utters the acoustic signal. When analyzing that the indicated component is included, the adjustment unit may strengthen the acoustic signal and weaken the additional acoustic signal.

  If comprised in this way, it will become possible for a user to hear easily the speech contained in the acoustic signal with which the additional acoustic signal was superimposed.

  In the acoustic processing apparatus having the above-described configuration, the adjustment unit may strengthen the acoustic signal so that a component indicating the utterance of the acoustic signal is relatively emphasized.

  If comprised in this way, it will become possible for a user to hear the speech contained in the acoustic signal on which the additional acoustic signal was superimposed more easily. Note that the adjustment unit may enhance the acoustic signal so that the signal level of the part where the harmonic structure of the acoustic signal is a peak is amplified and the signal level of the part where the harmonic part is attenuated.

  Further, in the acoustic processing apparatus having the above-described configuration, the acoustic signal analysis unit analyzes whether or not a component indicating music is included in the acoustic signal, and the acoustic signal analysis unit adds music to the acoustic signal. When analyzing that the component to be shown is included, the adjustment unit may weaken the additional acoustic signal.

  If comprised in this way, it will become possible to suppress that an additional acoustic signal is superimposed on the input acoustic signal containing music. Therefore, the user can easily listen to music included in the acoustic signal on which the additional acoustic signal is superimposed.

  In the acoustic processing device having the above-described configuration, the adjustment unit may weaken the additional acoustic signal so that the volume of the additional acoustic signal becomes substantially zero.

  If comprised in this way, it will become possible for a user to hear the music contained in an acoustic signal more easily from the acoustic signal on which the additional acoustic signal was superimposed.

  Further, in the acoustic processing apparatus having the above configuration, the acoustic signal analysis unit analyzes whether the acoustic signal indicates background noise, and the acoustic signal analysis unit analyzes the background noise of the acoustic signal. When analyzing that it is shown, the adjusting unit may weaken the acoustic signal and strengthen the additional acoustic signal.

  If comprised in this way, it will become possible to make it difficult for a user to hear the background noise contained in the acoustic signal with which the additional acoustic signal was superimposed.

  The acoustic processing apparatus having the above-described configuration further includes an additional acoustic signal analysis unit that analyzes the additional acoustic signal, and the adjustment unit generates the acoustic signal and the additional acoustic signal based on the analysis result of the additional acoustic signal analysis unit. It does not matter as the adjustment.

  With this configuration, for example, when the volume of the additional acoustic signal is not substantially constant and can vary, the input acoustic signal and the additional acoustic signal can be adjusted with high accuracy according to the variation.

  According to another aspect of the present invention, there is provided an electronic apparatus including the above-described acoustic processing device, wherein the superimposing unit records or reproduces an acoustic signal on which an additional acoustic signal is superimposed.

  With the configuration of the present invention, not only the additional acoustic signal but also the acoustic signal on which the additional acoustic signal is superimposed is adjusted. Therefore, it is possible to suppress the degree of adjusting the additional acoustic signal as compared with the case of adjusting only the additional acoustic signal in order to obtain a predetermined effect. Therefore, it becomes possible to suppress the fluctuation (for example, swell of BGM) of the additional acoustic signal in the acoustic signal on which the additional acoustic signal is superimposed, and to suppress the user's uncomfortable feeling with respect to the acoustic signal on which the additional acoustic signal is superimposed. Is possible.

  The significance or effect of the present invention will be further clarified by the following description of embodiments. However, the following embodiment is merely one of the embodiments of the present invention, and the meaning of the terminology of the present invention or each constituent element is limited to those described in the following embodiments. is not.

These are block diagrams which show the example of whole structure of the imaging device which is one Embodiment of this invention. These are block diagrams which show an example of a structure of a sound superimposition part. FIG. 3 is a block diagram illustrating an example of a harmonic structure of an utterance. These are graphs which show the 1st operation example of a sound superposition part. FIG. 3 is a block diagram illustrating an example of a harmonic structure of music. These are the graphs which show the operation example of the conventional sound processing apparatus.

  An embodiment of the present invention will be described below with reference to the drawings. First, an imaging apparatus according to an embodiment of the present invention will be described. Note that an imaging apparatus described below is capable of generating, recording, and reproducing an image (including a moving image and a still image, the same applies hereinafter) signal and an acoustic signal of a digital camera or the like.

<< Imaging device >>
First, an example of the overall configuration of an imaging apparatus according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram illustrating an example of the overall configuration of an imaging apparatus according to an embodiment of the present invention.

  As shown in FIG. 1, an imaging device 1 includes an image sensor 2 including a solid-state imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complimentary Metal Oxide Semiconductor) sensor that converts an incident optical image into an electrical signal. And a lens unit 3 that forms an optical image of the object on the image sensor 2 and adjusts the amount of light. The lens unit 3 and the image sensor 2 constitute an imaging unit S, and an image signal is generated by the imaging unit S. The lens unit 3 includes various lenses (not shown) such as a zoom lens and a focus lens, and a diaphragm (not shown) that adjusts the amount of light input to the image sensor 2.

  Further, the imaging apparatus 1 converts an analog image signal output from the image sensor 2 into digital and adjusts the gain of the AFE (Analog Front End) 4 for adjusting the gain, and gradation correction processing on the image signal output from the AFE 4. An image processing unit 5 that performs various image processing such as, a sound collecting unit 6 that converts input sound into an electric signal, and an ADC (Analog to Analog) that converts an analog acoustic signal output from the sound collecting unit 6 into digital Digital Converter) 7, an acoustic processing unit 8 that performs various acoustic processing such as noise removal on the acoustic signal output from the ADC 7, and an image signal output from the image processing unit 5 and an acoustic processing unit 8. The image signal output from the image processing unit 5 is subjected to compression coding processing for moving images and sound signals such as MPEG (Moving Picture Experts Group) compression method. (Joint Photographic Experts Group) a compression processing unit 9 that performs compression encoding processing for still images such as a compression method, an external memory 10 that records a compression encoded signal compression encoded by the compression processing unit 9, A driver unit 11 that records and reads the compressed encoded signal in the external memory 10 and an expansion processing unit 12 that expands and decodes the compressed encoded signal read from the external memory 10 by the driver unit 11 are provided.

  The sound processing unit 8 includes a sound superimposing unit 80 that superimposes an additional sound signal on the input sound signal. Details of the configuration of the sound superimposing unit 80 will be described later.

  The imaging apparatus 1 includes an image signal output circuit unit 13 that converts an image signal obtained by decoding by the expansion processing unit 12 into a signal that can be displayed on a display unit (not shown) such as a monitor, and the expansion processing unit 12. And an acoustic signal output circuit unit 14 that converts an acoustic signal obtained by decoding into a signal that can be reproduced by a reproduction unit (not shown) such as a speaker.

  The imaging apparatus 1 also stores a CPU (Central Processing Unit) 15 that controls the entire operation of the imaging apparatus 1 and a memory 16 that stores each program for performing each process and temporarily stores data when the program is executed. And a timing generator (TG) that outputs a timing control signal for making the operation timing of each unit coincide with an operation unit 17 that includes a button for starting imaging, a button for adjusting imaging conditions, and the like. The unit 18 includes a bus 19 for exchanging data between the CPU 15 and each block, and a bus 20 for exchanging data between the memory 16 and each block. In the following, for simplification of explanation, the buses 19 and 20 are omitted in the exchange of each block.

  Note that the imaging apparatus 1 that can generate image signals of moving images and still images has been shown as an example, but may be configured to generate image signals of either moving images or still images, and may be an IC (Integrated Circuit) recorder. Such a recording (reproducing) device that does not have an imaging function may be used. In addition, the display unit and the playback unit may be integrated with the imaging device 1 or may be separate and connected using a terminal and a cable provided in the imaging device 1. It doesn't matter.

  The external memory 10 may be anything as long as it can record image signals and sound signals. For example, a semiconductor memory such as an SD (Secure Digital) card, an optical disk such as a DVD, a magnetic disk such as a hard disk, or the like can be used as the external memory 10. Further, the external memory 10 may be detachable from the imaging device 1.

  Next, an example of the overall operation when the imaging apparatus 1 generates a moving image signal will be described with reference to FIG. First, the imaging device 1 acquires an image signal that is an electrical signal by photoelectrically converting light incident from the lens unit 3 in the image sensor 2. Then, the image sensor 2 outputs an image signal to the AFE 4 at a predetermined timing in synchronization with the timing control signal input from the TG unit 18.

  The image signal converted from analog to digital by the AFE 4 is input to the image processing unit 5. The image processing unit 5 converts an input image signal having R (red), G (green), and B (blue) components into an image signal having luminance signal (Y) and color difference signal (U, V) components. In addition, various image processing such as gradation correction and contour enhancement is performed. The memory 16 operates as a frame memory, and temporarily holds an image signal when the image processing unit 5 performs processing.

  At this time, based on the image signal input to the image processing unit 5, the lens unit 3 adjusts the lens position and adjusts the focus, or adjusts the aperture and adjusts the exposure. Or This adjustment of focus and exposure is automatically performed based on a predetermined program so as to be in an optimum state, or manually performed based on a user instruction.

  On the other hand, an acoustic signal collected by the sound collection unit 6 and converted into an analog electric signal is input to the ADC 7. The ADC 7 converts the input acoustic signal to digital and inputs the digital signal to the acoustic processing unit 8. The acoustic processing unit 8 performs various acoustic processing such as noise removal and intensity control on the input acoustic signal.

  The acoustic superimposing unit 80 superimposes and outputs the additional acoustic signal on the acoustic signal when, for example, a user instruction is input via the operation unit 17. The additional acoustic signal is recorded in, for example, the external memory 10 or the memory 16 and is acquired by the acoustic superimposing unit 80 as necessary. Details of the operation of the sound superimposing unit 80 will be described later.

  The image signal output from the image processing unit 5 and the acoustic signal output from the sound processing unit 8 are both input to the compression processing unit 9 and compressed by the compression processing unit 9 using a predetermined compression method. At this time, the image signal and the sound signal are temporally associated with each other so that the image and the sound are not shifted during reproduction. The compressed encoded signal output from the compression processing unit 9 is recorded in the external memory 10 via the driver unit 11.

  The compressed encoded signal of the moving image recorded in the external memory 10 is read out to the decompression processing unit 12 based on a user instruction. The decompression processing unit 12 generates and outputs an image signal and an audio signal by decompressing and decoding the compressed encoded signal. The image signal output circuit unit 13 converts the image signal output from the expansion processing unit 12 into a format that can be displayed on the display unit, and outputs the converted image signal. The acoustic signal processing circuit unit 14 is output from the expansion processing unit 12. The sound signal is converted into a format that can be played back by the playback unit and output.

  Note that the image signal output from the image processing unit 5 is not compressed and encoded in a so-called preview mode in which the user confirms the image displayed on the display unit or the like without recording the image signal. The signal may be output to the signal output circuit unit 13. Further, when recording the image signal, the image signal is output to the display unit or the like via the image signal output circuit unit 13 in parallel with the operation of compressing and encoding the image signal in the compression processing unit 9 and recording the image signal in the external memory 10. It does not matter. Further, the image signal output from the image processing unit 5 and the sound signal output from the sound processing unit 8 may be recorded in the external memory 10 as they are without being compressed and encoded.

  Moreover, although the acoustic superimposing unit 80 is provided in the acoustic processing unit 8 and the configuration in which the additional acoustic signal is superimposed at the time of recording the acoustic signal is illustrated, the additional acoustic signal is superimposed on the place where the acoustic superimposing unit 80 is provided and the acoustic signal. The timing is not limited to the above. For example, the acoustic superimposing unit 80 is provided after the decompression processing unit 12 and before the acoustic signal output circuit unit 14, and when an acoustic signal is reproduced (for example, after being read and decompressed from the external memory 10 to the decompression processing unit 12). Before being input to the acoustic signal output circuit unit 14) or when editing an acoustic signal (for example, after being read and expanded from the external memory 10 to the expansion processing unit 12 and then recorded again in the external memory 10) The additional acoustic signal may be superimposed on the acoustic signal before being input to the compression processing unit 9).

  In FIG. 1, the image pickup apparatus 1 including the sound collection function (for example, the sound collection unit 6 and the ADC 7) and the reproduction function (for example, the acoustic signal output circuit unit 14 and the reproduction unit) is described as an example. A device without a function (for example, a recording device, a playback device, an editing device, etc.) may be used. Furthermore, these devices may be interpreted as devices in which blocks that realize functions not provided are excluded from the imaging device 1 shown in FIG.

<Sound superposition part>
Next, details of the configuration of the above-described sound superimposing unit 80 will be described with reference to the drawings. Hereinafter, for convenience of explanation, an acoustic signal input to the acoustic superimposing unit 80 (that is, an acoustic signal on which an additional acoustic signal is superimposed) is referred to as an “input acoustic signal”. In addition, an acoustic signal output from the acoustic superimposing unit 80 (that is, an acoustic signal obtained by superimposing an additional acoustic signal on an input acoustic signal) is referred to as an “output acoustic signal”.

  First, the configuration of the sound superimposing unit 80 will be described with reference to the drawings. FIG. 2 is a block diagram illustrating an example of the configuration of the sound superimposing unit. As shown in FIG. 2, the sound superimposing unit 80 analyzes an input sound signal and outputs an analysis result, and an additional sound signal analysis unit 82 analyzes the additional sound signal and outputs the analysis result. An adjustment method determining unit 83 that determines an adjustment method of the input sound signal and the additional sound signal based on the analysis result of the input sound signal and the analysis result of the additional sound signal, and the input sound determined by the adjustment method determining unit 83 An acoustic signal adjustment unit 84 that adjusts the input acoustic signal based on the signal adjustment method, and an additional acoustic signal adjustment unit 85 that adjusts the additional acoustic signal based on the adjustment method of the additional acoustic signal determined by the adjustment method determination unit 83. And a superimposing unit 86 that superimposes the additional acoustic signal adjusted by the additional acoustic signal adjusting unit 85 on the input acoustic signal adjusted by the acoustic signal adjusting unit 84.

  In the acoustic superimposing unit 80 shown in FIG. 2, first, the acoustic signal analyzing unit 81 analyzes the input acoustic signal, and the additional acoustic signal analyzing unit 82 analyzes the additional acoustic signal. The acoustic signal analysis unit 81 analyzes, for example, the signal level of the input acoustic signal, frequency characteristics, and the like. The additional acoustic signal analysis unit 82 analyzes, for example, the signal level of the additional acoustic signal and its variation mode.

  The adjustment method determination unit 83 determines the adjustment method of the input sound signal and the adjustment method of the additional sound signal based on the sound signal analysis information and the additional sound signal analysis information. Thereby, the input sound signal is adjusted in the sound signal adjustment unit 84, and the additional sound signal is adjusted in the additional sound signal adjustment unit 85. The acoustic signal adjustment unit 84 adjusts the signal level of the input acoustic signal or adjusts the signal level of a predetermined frequency component, for example. For example, the additional acoustic signal adjustment unit 85 adjusts the signal level of the additional acoustic signal.

  Then, the superimposing unit 86 generates an output acoustic signal by superimposing (for example, adding) the additional acoustic signal adjusted by the additional acoustic signal adjusting unit 85 on the input acoustic signal adjusted by the acoustic signal adjusting unit 84. ,Output.

  If comprised as mentioned above, not only an additional acoustic signal but an input acoustic signal will be adjusted. Therefore, compared with the case where only the additional sound signal is adjusted to obtain a predetermined effect (for example, the enhancement effect of the input sound signal in the output sound signal), the degree of adjusting the additional sound signal (for example, the additional sound signal). (Attenuation amount of signal level) can be suppressed. Therefore, it is possible to suppress the fluctuation (for example, BGM undulation) of the additional acoustic signal in the output acoustic signal, and it is possible to suppress the user's uncomfortable feeling with respect to the output acoustic signal.

  In FIG. 2, the configuration including the additional acoustic signal analysis unit 82 is illustrated, but a configuration without the additional acoustic signal analysis unit 82 may be employed. In this case, the adjustment method determination unit 83 may determine the adjustment method of the input sound signal and the additional sound signal based on the analysis result of the input sound signal.

  However, when the additional acoustic signal analysis unit 82 is provided and the adjustment method determination unit 83 determines the adjustment method in consideration of not only the analysis result of the input acoustic signal but also the analysis result of the additional acoustic signal, for example, the additional acoustic signal This is preferable because the input sound signal and the additional sound signal can be accurately adjusted in accordance with the fluctuation when the signal level is not substantially constant and may fluctuate.

  The sound indicated by the additional acoustic signal is not necessarily limited to music such as BGM, and any sound may be used.

  Next, a specific example of the operation of the sound superimposing unit 80 will be described with reference to the drawings.

(First operation example)
In this example, the acoustic signal analysis unit 81 analyzes whether or not a component indicating speech (particularly, a harmonic structure of speech) is included in the input acoustic signal. And the adjustment method determination part 83 determines the adjustment method of an input acoustic signal and an additional acoustic signal based on the analysis result.

  First, the harmonic structure of an utterance will be described with reference to FIG. FIG. 3 is a block diagram illustrating an example of the harmonic structure of an utterance. As shown in FIG. 3, in the harmonic structure of the utterance, since the fundamental frequency (pitch) of the utterance is lower than that of music or the like, the interval between the harmonic components can be relatively narrow. For example, the interval between harmonic components can be narrower than the harmonic structure of music (see FIG. 5), which will be described later. In addition, since there is a frequency that resonates depending on the type of voice that is generated, the maximum of the envelope that connects the peaks of the harmonic components (formant, circled broken line in FIG. 3) exists at a specific frequency. It becomes.

  For example, the acoustic signal analysis unit 81 converts an input acoustic signal into a frequency axis signal using Fourier transform or the like. And it is analyzed by using pattern matching etc. whether the harmonic structure of the above speech is contained in the input acoustic signal after conversion.

  When it is analyzed that the input acoustic signal includes the harmonic structure of the utterance, the adjustment method determination unit 83 determines an adjustment method that strengthens the input acoustic signal and weakens the additional acoustic signal. For example, the adjustment method determining unit 83 may adjust the input acoustic signal and the additional acoustic signal so that the adjusted input acoustic signal and the additional acoustic signal satisfy a predetermined relationship (for example, a signal level ratio or a difference has a predetermined value). Determine how to adjust the acoustic signal.

  An example of the input sound signal and the additional sound signal adjusted based on the adjustment method determined as described above will be described with reference to the drawings. FIG. 4 is a graph showing a first operation example of the sound superimposing unit, and can be compared with FIG. 6 showing an operation example of the conventional sound processing apparatus. In FIG. 4, the temporal variation of the signal level of the adjusted input acoustic signal is indicated by a solid line, and the temporal variation of the signal level of the adjusted additional acoustic signal is indicated by a broken line.

  In the example shown in FIG. 4, as described above, the signal level of the input acoustic signal is amplified during the period (speech period) in which it is analyzed that the input acoustic signal includes the harmonic structure of the utterance, and the additional acoustic signal The signal level is attenuated.

  If comprised in this way, it will become possible to reduce the attenuation amount of the signal level of an additional acoustic signal. Therefore, it is possible to suppress a change in the signal level (for example, BGM undulation) of the additional acoustic signal in the output acoustic signal, and it is possible to suppress the user's uncomfortable feeling with respect to the output acoustic signal. In addition, the user can easily hear the utterance included in the output acoustic signal.

  The adjustment method determination unit 83 may determine an adjustment method that relatively strengthens the harmonic structure of the utterance in the input acoustic signal. For example, the adjustment method determining unit 83 amplifies the signal level of a portion where the harmonic structure is a peak, or a portion where the valley is a valley, with respect to the input acoustic signal analyzed as including the harmonic structure of the utterance The adjustment method for attenuating the signal level is determined. This configuration is preferable because the user can more easily hear the utterance included in the output acoustic signal.

  In addition, the acoustic signal adjustment unit 84 converts the input acoustic signal into a frequency axis signal by Fourier transformation or the like, performs adjustment according to the adjustment method determined by the adjustment method determination unit 83, and converts it into a time axis signal by inverse Fourier transformation. You may adjust an input acoustic signal by converting.

  Furthermore, the additional acoustic signal adjustment unit 85 may adjust the additional acoustic signal in the same manner as the acoustic signal adjustment unit 84. For example, the additional acoustic signal adjustment unit 85 may perform adjustment to attenuate a predetermined frequency component of the additional acoustic signal so that the harmonic structure of the utterance of the input acoustic signal is emphasized in the output acoustic signal.

(Second operation example)
In this example, the acoustic signal analysis unit 81 analyzes whether or not the input acoustic signal includes a component (in particular, a harmonic structure of music) indicating music (for example, performance of a musical instrument or singing voice). And the adjustment method determination part 83 determines the adjustment method of an input acoustic signal and an additional acoustic signal (especially additional acoustic signal) based on the analysis result.

  First, the harmonic structure of music will be described with reference to FIG. FIG. 5 is a block diagram showing an example of the harmonic structure of music. As shown in FIG. 5, in the harmonic structure of music, the interval of harmonic components can be relatively wide. For example, the harmonic component interval may be wider than the harmonic structure of the utterance described above (see FIG. 3). Moreover, the maximum of the envelope line connecting the peaks of the harmonic components does not exist at the specific frequency.

  For example, the acoustic signal analysis unit 81 analyzes whether or not the above-described music harmonic structure is included in the input acoustic signal by a method similar to the method described in the first operation example. Then, when it is analyzed that the harmonic structure of music is included in the input acoustic signal, the adjustment method determination unit 83 determines an adjustment method that weakens the additional acoustic signal.

  If comprised in this way, it will become possible to suppress that the output acoustic signal by which the additional acoustic signal was superimposed on the input acoustic signal containing music is generated. Therefore, the user can easily listen to the music included in the output acoustic signal.

  Note that the adjustment method determining unit 83 may determine an adjustment method for making the signal level of the additional acoustic signal substantially equal to 0 (silence). If comprised in this way, it will become possible for a user to hear the music contained in an output acoustic signal still more easily.

(Third operation example)
In this example, the acoustic signal analysis unit 81 may cause an operation of the device that may occur even when the input acoustic signal is mainly background noise (for example, a silent state in which there is no human voice or sound playing a musical instrument during sound collection). It is analyzed whether or not it indicates noise, for example, floor noise generated due to the sound of an air conditioner (air conditioner) or a fan of a personal computer. And the adjustment method determination part 83 determines the adjustment method of an input acoustic signal and an additional acoustic signal based on the analysis result.

  For example, when the acoustic signal analysis unit 81 analyzes that the input acoustic signal does not include the harmonic structure of speech (see FIG. 3) or the harmonic structure of music (see FIG. 3), the input acoustic signal is mainly used. Analyzed to indicate background noise.

  When it is analyzed that the input sound signal mainly indicates background noise, the adjustment method determination unit 83 determines an adjustment method that weakens the input sound signal and strengthens the additional sound signal. For example, the adjustment method determining unit 83 may adjust the input acoustic signal and the additional acoustic signal so that the adjusted input acoustic signal and the additional acoustic signal satisfy a predetermined relationship (for example, a signal level ratio or a difference has a predetermined value). Determine how to adjust the acoustic signal. Specifically, the adjustment method determining unit 83 determines an adjustment method for attenuating the signal level of the input sound signal and amplifying the signal level of the additional sound signal.

  If comprised in this way, it will become possible to reduce the amplification amount of the signal level of an additional acoustic signal. Therefore, it is possible to suppress a change in the signal level (for example, BGM undulation) of the additional acoustic signal in the output acoustic signal, and it is possible to suppress the user's uncomfortable feeling with respect to the output acoustic signal. In addition, it is possible to make it difficult for the user to hear the background noise included in the output acoustic signal.

  In addition, you may interpret that this operation example is performed in periods other than the speech period of FIG. 4 shown about the 1st operation example.

<< Modification >>
Regarding the imaging device 1 according to the embodiment of the present invention, the operation of the acoustic processing unit 8 and the acoustic superimposing unit 80 may be performed by a control device such as a microcomputer. Further, all or part of the functions realized by such a control device is described as a program, and the program is executed on a program execution device (for example, a computer) to realize all or part of the functions. It doesn't matter if you do.

  In addition to the case described above, the imaging device 1 and the acoustic processing unit 8 illustrated in FIG. 1 and the acoustic superimposing unit 80 illustrated in FIG. 2 can be realized by hardware or a combination of hardware and software. In the case where software is used to configure a part of the imaging device 1, the acoustic processing unit 8, and the acoustic superimposing unit 80, a block for a part realized by the software represents a functional block of the part.

  As mentioned above, although embodiment in this invention was described, the range of this invention is not limited to this, It can add and implement various changes in the range which does not deviate from the main point of invention.

  INDUSTRIAL APPLICABILITY The present invention can be used for an acoustic processing device that outputs an additional acoustic signal by superimposing it on an input acoustic signal. Further, the present invention can be used for an electronic device (for example, a recording device, an imaging device, a playback device, an editing device, etc.) provided with the sound processing device.

DESCRIPTION OF SYMBOLS 8 Acoustic processing part 80 Acoustic superimposition part 81 Acoustic signal analysis part 82 Additional acoustic signal analysis part 83 Adjustment method determination part 84 Acoustic signal adjustment part 85 Additional acoustic signal adjustment part 86 Superimposition part

Claims (6)

An acoustic signal analyzer for analyzing the acoustic signal;
Based on the analysis result of the acoustic signal analysis unit, an adjustment unit that adjusts the acoustic signal and an additional acoustic signal indicating a predetermined sound;
A superimposing unit that superimposes the additional acoustic signal adjusted by the adjusting unit on the acoustic signal adjusted by the adjusting unit;
A sound processing apparatus comprising: The acoustic signal analysis unit analyzes whether or not a component indicating utterance is included in the acoustic signal,
When the acoustic signal analysis unit analyzes that the acoustic signal includes a component indicating utterance,
The sound processing apparatus according to claim 1, wherein the adjustment unit strengthens the sound signal and weakens the additional sound signal.   The acoustic processing apparatus according to claim 2, wherein the adjustment unit strengthens the acoustic signal so that a component indicating the utterance of the acoustic signal is relatively emphasized. The acoustic signal analyzing unit analyzes whether or not the acoustic signal includes a component indicating music;
When the acoustic signal analysis unit analyzes that the acoustic signal includes a component indicating music,
The sound processing apparatus according to claim 1, wherein the adjustment unit weakens the additional sound signal. The acoustic signal analyzer analyzes whether the acoustic signal indicates background noise;
When the acoustic signal analysis unit analyzes that the acoustic signal indicates background noise,
The acoustic processing device according to claim 1, wherein the adjustment unit weakens the acoustic signal and strengthens the additional acoustic signal. The sound processing apparatus according to any one of claims 1 to 5,
An electronic apparatus that records or reproduces an acoustic signal on which an additional acoustic signal is superimposed by the superimposing unit.

Images