JP5158054B2 - Recording device, imaging device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a sound recording device that reduces a sense of auditory incompatibility even when a sound signal includes noise or is discontinuous. <P>SOLUTION: The sound recording device includes: an input unit to which the sound signal is input; a timing detection unit which detects the timing at which an operation unit operates; a section setting unit which sets a first section including a section wherein an operation unit operates in the sound signal based upon the timing detected by the timing detection unit; a reference signal determination unit which determines a sound signal corresponding to a second section succeeding to the first section as a first reference signal; a signal detection unit which detects, as a second reference signal, a sound signal having the highest correlation to the first reference signal in the sound signal; an interpolation signal detection unit which detects, as an interpolation signal, a sound signal succeeding to the second reference signal detected by the signal detection unit and having the same time length with the first section in the sound signal; a signal substituting unit which substitutes the interpolation signal for the sound signal of the first section; and a recording unit which records the sound signal substituted by the signal substituting unit. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a recording device, an imaging device including the recording device, and a program.

  Conventionally, a method of replacing a missing section of a sound signal in which noise or discontinuity occurs with previous and subsequent sound signals is known (see Patent Document 1).

Japanese Patent Application Laid-Open No. 9-274772

  However, in the method of Patent Document 1, since the missing section of the sound signal is simply replaced with the front and rear sound signals, there is a possibility that a large discontinuous portion is generated in the front and rear sound signals. There is a problem that occurs.

  The present invention has been made in view of such circumstances, and an object thereof is to provide a recording device, an imaging device, and a program capable of suppressing a sense of incongruity in hearing when reducing noise mixed in a sound signal. It is to provide.

The present invention has been made to solve the problems described above, the section showing an input for the sound signal is inputted, a timing detection unit for detecting a timing that makes the operation of the operation section, that the operation unit is operated depending on the time and storage unit related storing for each type of operation unit of the type of the operation unit equivalent the timing and detected timing by the timing detection unit is detected with the period of the sound signal by the operation unit is generated and read before term memory unit Te, based on the time relationship between the period of the sound signal by section and the operation section indicating that the operation unit is operated occurs, first comprises a section sound signal by the operation unit is generated A section setting unit that sets one section, a reference signal determining unit that uses, as the first reference signal, the sound signal corresponding to the second section that is continuous to the first section in the sound signal; A signal detection unit that detects a sound signal having the highest correlation with the first reference signal as a second reference signal, and is continuous with the second reference signal detected by the signal detection unit in the sound signal, and An interpolated signal detecting unit that detects a sound signal having the same time length as the first interval as an interpolated signal, a signal replacing unit that replaces the sound signal of the first interval with the interpolated signal, and the signal replacing unit And a recording unit for recording a sound signal.

  According to another aspect of the present invention, there is provided an imaging apparatus comprising: the recording apparatus described above; and an imaging unit that captures an image from an optical system.

Further, the present invention causes a computer provided with a sound signal, an input procedure of inputting the timing shown that make operating the operation unit device recorded the sound signal is provided, a timing which is the input, is the timing depending on the type of the detected operation unit, the operation unit is read out from the storage unit for storing for each type of operation unit time relationship between the section in which the sound signal is caused by the section and the operation section indicating that the operation, based on the time relationship between the period of the sound signal by section and the operation section indicating that the operation unit is operated occurs, the interval setting procedure for setting the first interval including a section sound signal by the operation unit is generated In the sound signal, a reference signal determination procedure in which the sound signal corresponding to a second interval that is continuous to the first interval is a first reference signal, and in the sound signal, the first reference Detection procedure for detecting a sound signal having the highest correlation with the signal as a second reference signal, and in the sound signal, continuous to the second reference signal detected by the signal detection procedure, and the same as the first section It is a program for executing an interpolation signal detection procedure for detecting a sound signal having a length of time as an interpolation signal and a signal replacement procedure for replacing the sound signal in the first section with the interpolation signal.

  According to the present invention, there is an effect that noise of a sound signal can be reduced while suppressing a sense of incongruity in hearing.

It is a block diagram which shows an example of a structure of an imaging device provided with the recording device by one Embodiment of this invention. It is a wave form diagram which shows the waveform of the sound signal as an example, and the production | generation method of the interpolation signal in the case of the said sound signal. FIG. 3 is a waveform diagram showing a first reference signal as an example in the case of FIG. 2. It is a flowchart which shows the operation | movement as an example of an imaging device provided with the recording device shown in FIG.

<First Embodiment>
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of an imaging apparatus including a recording apparatus according to an embodiment of the present invention.

  As shown in FIG. 1, the imaging apparatus 100 according to the present embodiment includes an imaging unit 110, a CPU (Central processing unit) 110, an operation unit 180, an image processing unit 140, a display unit 150, and a storage unit 160. A buffer memory unit 130, a communication unit 170, a microphone 230, an A / D (Analog / Digital) conversion unit 240, a sound signal processing unit 250, and a bus 300. Among the configurations of the imaging apparatus 100, for example, the microphone 230, the A / D conversion unit 240, and the sound signal processing unit 250 correspond to a recording device.

  The imaging unit 110 includes an optical system 111, an imaging device 119, and an A / D conversion unit 120. The imaging unit 110 is controlled by the CPU 190 in accordance with the set imaging conditions (for example, aperture value, exposure value, etc.), and is optically controlled by the optical system 111. An image is formed on the image sensor 119, and image data based on the optical image converted into a digital signal by the A / D conversion unit 120 is generated.

  The optical system 111 includes a zoom lens 114, a camera shake prevention lens (hereinafter referred to as a VR (Vibration Reduction) lens) 113, a focus adjustment lens (hereinafter referred to as an AF (Auto Focus) lens) 112, a zoom encoder 115, A lens driving unit 116, an AF encoder 117, and a camera shake prevention unit 118 are provided.

  The optical system 111 guides an optical image that has passed through the zoom lens 114, the VR lens 113, and the AF lens 112 to the light receiving surface of the image sensor 119.

  The lens driving unit 116 controls the position of the zoom lens 114 or the AF encoder 117 based on a drive control signal input from a CPU 190 described later.

  The camera shake prevention unit 118 controls the position of the VR lens 113 based on a drive control signal input from a CPU 190 described later. The camera shake prevention unit 118 may detect the position of the VR lens 113.

  The zoom encoder 115 detects a zoom position indicating the position of the zoom lens 114 and outputs the detected zoom position to the CPU 190.

  The AF encoder 117 detects a focus position representing the position of the AF lens 112 and outputs the detected zoom position and focus position to the CPU 190.

  Note that the optical system 111 described above may be attached to and integrated with the imaging apparatus 100, or may be detachably attached to the imaging apparatus 100.

  For example, the image sensor 119 converts an optical image formed on the light receiving surface into an electrical signal and outputs the electrical signal to the A / D converter 120.

  In addition, the image sensor 119 converts the image data obtained when a shooting instruction is received via the operation unit 180 as shot image data of a shot still image via the A / D conversion unit 120 and the image processing unit 140. And stored in the storage medium 200.

  On the other hand, the image sensor 119 uses, for example, continuously obtained image data as through image data via the A / D conversion unit 120 and the image processing unit 140 in a state where an imaging instruction is not received via the operation unit 180. Output to the CPU 190 and the display unit 150.

  The A / D converter 120 performs analog / digital conversion on the electronic signal converted by the image sensor 119 and outputs image data that is the converted digital signal.

  The operation unit 180 includes, for example, a power switch, a shutter button, and other operation keys. The operation unit 180 receives a user operation input when operated by the user and outputs the operation input to the CPU 190.

  The image processing unit 140 refers to the image processing conditions stored in the storage unit 160 and performs image processing on the image data recorded in the buffer memory 130 or the storage medium 200.

  The display unit 150 is a liquid crystal display, for example, and displays image data obtained by the imaging unit 110, an operation screen, and the like.

  The storage unit 160 stores determination conditions referred to when scene determination is performed by the CPU 190, imaging conditions, and the like.

  The microphone 230 collects sound and outputs a sound signal corresponding to the collected sound. This sound signal is an analog signal.

  The A / D conversion unit 240 performs analog-to-digital conversion of a sound signal that is an analog signal input from the microphone 230 into a sound signal that is a digital signal.

  The sound signal processing unit 250 performs sound signal processing such as noise reduction on the sound signal converted into a digital signal by the A / D conversion unit 240, and stores the sound signal subjected to the sound signal processing. Store in the medium 200. Details of the sound signal processing unit 250 will be described later.

  When the sound signal processed by the sound signal processing unit 250 is stored in the storage medium 200, the sound signal may be stored in a temporal relationship with the image data captured by the image sensor 119. You may memorize | store as a moving image containing a sound signal.

  The buffer memory unit 130 temporarily stores the image data captured by the imaging unit 110, the sound signal converted by the sound signal processing unit 250, and the like.

  The communication unit 170 is connected to a removable storage medium 200 such as a card memory, and performs writing, reading, or erasing of information on the storage medium 200.

  The storage medium 200 is a storage unit that is detachably connected to the imaging apparatus 100. For example, image data generated (captured) by the imaging unit 110, or sound signal processing by the sound signal processing unit 250. The recorded sound signal is stored.

  The CPU 190 controls the entire imaging apparatus. As an example, the CPU 190 is based on the zoom position input from the zoom encoder 115, the focus position input from the AF encoder 117, and the operation input input from the operation unit 180. A drive control signal for controlling the positions of the zoom encoder 115 and the AF encoder 117 is generated. The CPU 190 controls the positions of the zoom encoder 115 and the AF encoder 117 via the lens driving unit 116 based on this drive control signal.

  In addition, the CPU 190 includes a timing detection unit 191. The timing detection unit 191 detects the timing at which the operation unit included in the imaging apparatus 100 operates.

  The operation unit referred to here is, for example, the zoom lens 114, the VR lens 113, the AF lens 112, or the operation unit 180 described above, and operates among the configurations included in the imaging apparatus 100. Or a sound is generated (or a sound may be generated).

  In addition, the operation unit refers to a sound generated by the operation or a sound generated by the operation of the configuration of the imaging apparatus 100 collected by the microphone 230 (or collected). It may be sounded).

  The timing detection unit 191 may detect the timing at which the operation unit operates based on a control signal that operates the operation unit. This control signal is a control signal for operating the operating unit with respect to the driving unit for operating the operating unit, or a control signal for driving the driving unit.

For example, the timing detection unit 191 is based on a drive control signal input to the lens driving unit 116 or the camera shake prevention unit 118 to drive the zoom lens 114, the VR lens 113, or the AF lens 112, or by the CPU 190. The timing at which the operating unit operates may be detected based on the generated drive control signal.
Further, when the CPU 190 generates a drive control signal, the timing detection unit 191 may detect the timing at which the operation unit operates based on processing and commands executed in the CPU 190.
The timing detection unit 191 may detect the timing at which the operation unit operates based on a signal indicating that the zoom lens 114 or the AF lens 112 is input from the operation unit 180.

  The timing detection unit 191 may detect the timing at which the operation unit operates based on a signal indicating that the operation unit has been operated.

For example, the timing detection unit 191 detects the timing at which the operation unit operates by detecting that the zoom lens 114 or the AF lens 112 is driven based on the output of the zoom encoder 115 or the AF encoder 117. Good.
Further, the timing detection unit 191 may detect the timing at which the operation unit operates by detecting that the VR lens 113 is driven based on the output from the camera shake prevention unit 118.
Further, the timing detection unit 191 may detect the timing at which the operation unit operates by detecting that the operation unit 180 has been operated based on an input from the operation unit 180.

  The timing detection unit 191 detects the timing at which the operation unit included in the imaging device 100 operates, and outputs a signal indicating the detected timing to the sound signal processing unit 250 (signal A in FIG. 2 described later). See).

  The bus 300 is connected to the imaging unit 110, the CPU 190, the operation unit 180, the image processing unit 140, the display unit 150, the storage unit 160, the buffer memory unit 130, and the communication unit 170, and outputs from each unit. The transferred data is transferred.

<Detailed Configuration of Sound Signal Processing Unit 250>
Next, details of the sound signal processing unit 250 will be described. The sound signal processing unit 250 includes a section setting unit 251, a reference signal determination unit 252, a signal detection unit 253, an interpolation signal detection unit 254, a signal replacement unit 255, a recording unit 256, a signal processing unit 257, It has.

  Here, the waveform of the sound signal input from the A / D converter 240 shown in FIG. 1 (see signal O in FIG. 2) and control signals (signal A, signal B, signal C, and signal D in FIG. 2) described later. Each component will be described with reference to a first reference signal described later with reference to FIG. 2 and 3, the horizontal axis is a time axis, and the vertical axis is, for example, the voltage of each signal.

  As shown in the signal O of FIG. 2, for example, in the case of a sound signal when picked up by voice, in the case of voice, etc., in a short time of about several tens of milliseconds, as shown in the figure, There are many repetitive signals. Therefore, as will be described later, it is possible to replace a sound signal in a section where noise is superimposed with a sound signal in another section.

  Here, corresponding to the timing detected by the timing detector 191, the signal A becomes high in FIG. 2. The signal A is, for example, a signal that is input from the timing detection unit 191 to the sound signal processing unit 250, and is a signal that indicates a section in which the operation unit is operating.

  In the case of FIG. 2, the signal A is high in the section from time t8 to time t9. For example, in the section from time t8 to time t9, there is a possibility that noise resulting from the operation of the operating unit is superimposed (generated) on the signal O, or this noise is superimposed. high.

In FIG. 2, a signal A is a signal output from the timing detection unit 191 to the section setting unit 251 of the sound signal processing unit 250, for example, and is a signal indicating a section in which the driving unit is driven.
The signal B is, for example, a signal output from the section setting unit 251 of the sound signal processing unit 250 to the reference signal determination unit 252 of the sound signal processing unit 250, and operates as described later in the sound signal (signal O). It is a signal which shows the 1st area including the area where the part is operating.

  The signal C is, for example, a signal output from the reference signal determination unit 252 of the sound signal processing unit 250 to the signal detection unit 253 of the sound signal processing unit 250. In the sound signal (signal O), as described later, It is a signal indicating a second section that is continuous with one section, that is, a section indicating the first reference signal.

  The signal D is, for example, a signal output from the signal detection unit 253 of the sound signal processing unit 250 to the interpolation signal detection unit 254 of the sound signal processing unit 250. In the sound signal (signal O), as described later, It is a signal indicating a section of the sound signal having the highest correlation with the first reference signal, that is, a section of the second reference signal.

  The signal E is, for example, a signal output from the interpolation signal detection unit 254 of the sound signal processing unit 250 to the signal replacement unit 255 of the sound signal processing unit 250. In the sound signal (signal O), as described later, It is a signal indicating a section of an interpolation signal.

Returning to the description of FIG. 1, each component of the sound signal processing unit 250 will be described.
The section setting unit 251 sets a first section including a section in which the operation unit is operating in the sound signal input from the A / D conversion unit 240 based on the timing detected by the timing detection unit 191.

  For example, in response to the timing detected by the timing detection unit 191 (see the time t8 to the time t9 when the signal A is high), the section setting unit 251 selects the first section from the time t7 to the time t10. Set as a section (see section in which signal B in FIG. 2 is high).

  In the sound signal input from the A / D conversion unit 240, the reference signal determination unit 252 sets a sound signal corresponding to a second section continuous to the first section as a first reference signal. For example, the reference signal determination unit 252 determines the first reference signal by setting a section that is continuous with the first section before the first section in the sound signal as the second section.

  In the case of FIG. 2, the reference signal determination unit 252 sets the second interval before the first interval in the sound signal, that is, the interval continuous to the first interval before time t7, for example, the interval from time t5 to time t7. The sound signal corresponding to the second interval is determined as the first reference signal.

  FIG. 3 illustrates an example of the first reference signal. Here, as the first reference signal, a waveform for almost one cycle of the sound signal is illustrated, but the cycle used as the first reference signal is arbitrary, and includes, for example, a sound signal having a plurality of cycles. Or a part of a sound signal of one cycle.

  As will be described later, the sound signal having the highest correlation with the first reference signal is detected in the sound signal. For this reason, it is desirable that the time length of the section of the first reference signal is long enough to detect a sound signal having a high correlation with the first reference signal. If the target sound signal for reducing noise is predetermined as in the case of human speech, the time length of the section of the first reference signal depends on the target sound signal. It may be set in advance.

  Returning to the description of each component included in the sound signal processing unit 250 of FIG. 1, the signal detection unit 253 has the highest correlation with the first reference signal in the sound signal excluding the sound signal corresponding to the second section. A sound signal is detected as a second reference signal. For example, the signal detection unit 253 detects the sound signal having the highest correlation with the first reference signal as the second reference signal in the section before the second section in the sound signal.

  For example, the signal detection unit 253 is a sound signal having the highest correlation with the first reference signal in the section before the second section in the sound signal, that is, the section before the time t5, for example, in this case, from the time t3. The sound signal at time t4 is detected as the second reference signal (see the section in which the signal D is high).

  Here, the section for searching for the second reference signal may be a section before time t5, and the time length of the section may be all sound signals before time t5. Since a sound signal having a high correlation with the first reference signal is likely to be in the vicinity of the first reference signal, it is preferably about several to several tens of times the time length of the second section.

  The interpolation signal detection unit 254 interpolates a sound signal input from the A / D conversion unit 240 that is continuous with the second reference signal detected by the signal detection unit 253 and has the same time length as the first interval. Detect as a signal. For example, the interpolation signal detection unit 254 detects a sound signal that is continuous after the second reference signal and has the same time length as the first interval as an interpolation signal.

  In the case of FIG. 2, the interpolation signal detection unit 254 detects the sound signal from time t4 to time t6 as an interpolation signal as a sound signal that continues after the second reference signal and has the same time length as the first interval (signal). (See E high section).

The signal replacement unit 255 replaces the sound signal in the first section with the interpolation signal. In this case, the signal replacement unit 255 replaces the sound signal in the first section corresponding to the time t7 to the time t10 with the interpolation signal that is the sound signal from the time t4 to the time t6.
Note that the signal replacement unit 255 may perform cross-fading so that the connection portion of the sound signal is continuous when the sound signal of the first section is replaced with the interpolation signal.

  The signal processing unit 257 performs SS (Spectral Subtraction) processing or SNG (Spectral Noise Gating) processing on the sound signal replaced by the signal replacement unit 255.

Note that the time length of the first section set by the section setting unit 251 described above may be an integer multiple of the section corresponding to the processing unit of SS processing or SNG processing executed by the signal processing unit 257.
By doing so, when SS processing or SNG processing is performed on the replaced sound signal, it is possible to reduce the influence of the replaced boundary portion on SS processing or SNG processing. Can be reduced.

  The recording unit 256 records the sound signal replaced by the signal replacement unit 255 or the sound signal processed by the signal processing unit 257 in the storage medium 200 via the communication unit 170. The recording unit 256 may store the sound signal so as to be temporally related to the image data captured by the image sensor 119 when recording the sound signal in the storage medium 200.

  Next, the operation when the recording apparatus of the imaging apparatus according to the first embodiment performs signal processing on a sound signal will be described using the flowchart of FIG.

  First, the timing detection unit 191 detects the timing at which the operation unit included in the imaging apparatus 100 operates (step S1).

  Next, the section setting unit 251 selects a first section including a section in which the operation unit is operating in the sound signal input from the A / D conversion unit 240 based on the timing detected by the timing detection unit 191. Set (step S2).

  Next, in the sound signal input from the A / D conversion unit 240, the reference signal determination unit 252 uses the sound signal corresponding to the second interval that is continuous to the first interval as the first reference signal, and the first reference signal is determined. Determine (step S3).

  Next, the signal detection unit 253 detects the sound signal having the highest correlation with the first reference signal as the second reference signal in the sound signal excluding the sound signal corresponding to the second section, so that the position of the interpolation signal is determined. Is detected (step S4). For example, in the case of FIG. 2, the end position of the second reference signal (see time t4) is detected as the start position of the interpolation signal (see time t4). The time length of the second reference signal is the same as the time length of the first reference signal.

  The interpolation signal detection unit 254 interpolates a sound signal input from the A / D conversion unit 240 that is continuous with the second reference signal detected by the signal detection unit 253 and has the same time length as the first interval. Detect as a signal.

  Here, the second reference signal detected by the signal detection unit 253 has a high correlation with the first reference signal. Therefore, it corresponds to the level (voltage value) of the sound signal corresponding to the end time of the first reference signal (for example, time t7 in FIG. 2) and the end time of the second reference signal (for example, time t4 in FIG. 2). The correlation with the level of the sound signal is also high.

Since the level of the sound signal is continuous in time, the level of the sound signal corresponding to the end time of the first reference signal (for example, time t7 in FIG. 2) and the start time of the first section (for example, FIG. 2 is substantially the same as the level of the sound signal corresponding to time t7).
Further, since the level of the sound signal is continuous in time, the level of the sound signal corresponding to the end time of the second reference signal (for example, time t4 in FIG. 2) and the start time of the interpolation signal (for example, FIG. 2). The level of the sound signal corresponding to time t4) is substantially the same.

  Therefore, the level of the sound signal corresponding to the start time of the first section (for example, time t7 in FIG. 2) and the level of the sound signal corresponding to the start time of the interpolation signal (for example, time t4 in FIG. 2) are: Almost identical. Therefore, even if the sound signal of the first section is replaced with the interpolation signal, the level of the sound signal corresponding to the start time of the replaced first section is the same as the level of the immediately preceding sound signal, Since the level of is continuous, there is little discomfort in hearing.

  Next, the signal replacement unit 255 replaces the sound signal in the first section with the interpolation signal (step S6). Thereafter, the recording unit 256 records the sound signal replaced by the signal replacement unit 255 or the sound signal processed by the signal processing unit 257 in the storage medium 200.

  As described above, the recording apparatus of the present embodiment uses the missing section of the sound signal as the first section, and the sound signal continuous with the sound signal in the first section as the first reference signal, A second reference signal that is a highly correlated sound signal is detected. An interpolation signal that is continuous with the second reference signal and is a sound signal in which the relative positional relationship between the sound signal of the first section and the first reference signal is the same as that of the second reference signal is obtained. To detect. The interpolated signal replaces the sound signal in the first section, that is, the sound signal in the missing section.

This interpolated signal has the same relative positional relationship between the sound signal of the first section and the first reference signal with respect to the second reference signal similar to the first reference signal. Therefore, it is more likely that this interpolated signal is closer to the target sound in the first section than the sound signals before and after the first section. The recording apparatus according to the present embodiment is compared with the case where the missing section of the sound signal is simply replaced with the preceding and following sound signals in order to replace the missing section of the sound signal with an interpolation signal that is likely to be close to the target sound of the first section. , Can reduce the sense of incongruity in hearing.
Note that the target sound here is an ideal sound signal in which no noise is superimposed on a recorded sound signal or an ideal sound signal in which no loss occurs.

  In FIG. 2, as an example, noise resulting from the operation of the operating unit is superimposed (generated) on the sound signal (signal O) corresponding to the period in which the signal A is high, or In the above description, there is a high possibility that this noise is superimposed.

  By the way, for example, when noise is generated in response to an operation of a switch included in the operation unit 180, the timing at which the switch is operated may not match the timing at which the noise is generated.

  For example, when the switch is operated, that is, when the signal A in FIG. 2 becomes high in response to the operation of the switch, the timing at which noise is generated, that is, the signal O in FIG. It is possible that the resulting interval is long.

  However, the relationship between the section in which the signal A in FIG. 2 becomes high in response to the operation of the switch and the timing at which noise is generated, that is, the section in which noise occurs in the signal O in FIG. There is a possibility. Further, this relationship may be different for each type of operation unit such as the zoom lens 114, the VR lens 113, the AF lens 112, or the operation unit 180 described above.

  Therefore, for each type of operation unit, the time relationship between the interval indicating that the operation unit has operated and the interval in which noise actually occurs in the sound signal is stored in the storage unit 160 in advance. This time relationship may be actually measured in advance or may be obtained in advance by simulation.

  Then, the section setting unit 251 sets the first section including the section in which the operation unit is operating in the sound signal input from the A / D conversion unit 240 based on the timing detected by the timing detection unit 191. When doing so, it may be as follows.

  First, the timing detection unit 191 detects the timing at which the operation unit included in the imaging apparatus 100 operates, and outputs information indicating the type of the operation unit to the section setting unit 251 together with the detected timing.

  The section setting unit 251 reads the time relationship corresponding to the type of the operation unit from the storage unit 160. Then, the section setting unit 251 selects a section in which the operation unit is operating in the sound signal input from the A / D conversion unit 240 based on the read time relationship and the timing detected by the timing detection unit 191. The first section to be included is set.

  By doing in this way, even if the section indicating that the operating section has been operated and the section where noise is actually generated in the sound signal do not necessarily match, the section setting section 251 operates the operating section. It is possible to appropriately set the first section that includes the section that is running and that is highly likely to cause noise.

Second Embodiment
In the first embodiment described above, the interpolation signal is detected in the sound signal before the first section set by the section setting unit 251 and the sound signal in the first section is replaced by this interpolation signal.
On the other hand, in the second embodiment, an interpolation signal is detected in a sound signal after the first section set by the section setting unit 251 and the sound signal in the first section is replaced with this interpolation signal.

  In the case of the second embodiment, the reference signal determination unit 252, the signal detection unit 253, and the interpolation signal detection unit 254 are changed as follows. In the description of each embodiment, only differences from the first embodiment will be described.

  The reference signal determination unit 252 determines a sound signal corresponding to a third section that is continuous with the first section after the first section in the sound signal as a third reference signal.

  The signal detection unit 253 detects the sound signal having the highest correlation with the third reference signal as the fourth reference signal in the section after the third section in the sound signal.

  The interpolation signal detection unit 254 detects a sound signal that is continuous before the fourth reference signal and has the same time length as the first interval as an interpolation signal.

  The interpolation signal detected by the second embodiment is similar to the interpolation signal detected by the first embodiment in that the relative positional relationship between the sound signal of the first section and the third reference signal is the third reference signal. The same for a fourth reference signal that is similar to the signal. Therefore, it is more likely that this interpolated signal is closer to the target sound in the first section than the sound signals before and after the first section.

Also in the second embodiment, the sound signal in the first section, that is, the sound signal in the missing section is replaced with the same interpolation signal as in the first embodiment.
For this reason, the recording device according to the second embodiment also reduces the sense of discomfort in the sense of hearing as compared with the case where the missing section of the sound signal is simply replaced with the preceding and following sound signals, similarly to the recording device according to the first embodiment. Can do.

<Third Embodiment>
In the first embodiment described above, an interpolation signal is detected in the sound signal before the first section set by the section setting unit 251. In the second embodiment, the first signal set by the section setting unit 251 is detected. An interpolation signal was detected in the sound signal after the section.

  In the third embodiment, these two interpolation signals are combined (synthesized) to generate an interpolation signal. Based on the generated interpolation signal, the sound signal of the first section, that is, the sound signal of the missing section is generated. replace. Next, an example of a method for combining (synthesizing) these two interpolation signals will be described for the first to fifth examples.

  Here, the interpolation signal detected by the first embodiment described above and detected in the sound signal before the first section set by the section setting unit 251 is referred to as “second reference signal”. This will be described as “interpolated signal based”.

  Further, the interpolation signal detected by the second embodiment and detected in the sound signal after the first section set by the section setting unit 251 is referred to as “interpolation signal based on the fourth reference signal”. ".

  Further, the correlation coefficient between the second reference signal and the first reference signal detected by the signal detection unit 253 is defined as a “first correlation coefficient”, and the fourth reference signal and the third reference detected by the signal detection unit 253 are used. The correlation coefficient with the signal will be described as “second correlation coefficient”.

(First example)
In the first example of the third embodiment, the signal replacement unit 255 converts the sound signal of the first section from the sound signal input from the A / D conversion unit 240, the interpolation signal based on the second reference signal, and the fourth reference. The interpolation signal obtained by averaging the interpolation signal based on the signal is replaced.

  With the above configuration, in the first example of the third embodiment, the sound signal in the first section is replaced with an interpolation signal obtained by averaging the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal. .

  The interpolation signal according to the first example of the third embodiment is an interpolation signal based on the second reference signal or an interpolation signal based on the fourth reference signal, that is, an interpolation signal according to the first embodiment or an interpolation signal according to the second embodiment. In contrast, since the two interpolated signals are averaged, the possibility of being closer to the sound signal (target sound) in the first section is high.

  Therefore, in contrast to the first embodiment or the second embodiment in which the sound signal of the first section is replaced with only one of the interpolation signal based on the second reference signal or the interpolation signal based on the fourth reference signal, the two The first example of the third embodiment in which the interpolation signal is replaced with the averaged interpolation signal can further reduce the sense of discomfort in the sense of hearing.

(Second example)
In the second example of the third embodiment, the signal replacement unit 255 converts the sound signal in the first section from the sound signal input from the A / D conversion unit 240, the interpolation signal based on the second reference signal, and the fourth reference. The interpolated signal based on the signal is replaced with an averaged interpolated signal weighted by the first correlation coefficient and the second correlation coefficient.

  With the above configuration, in the second example of the third embodiment, the sound signal in the first section is not simply averaged between the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal. Then, the interpolated signals are averaged by weighting with the first correlation coefficient and the second correlation coefficient, which are the correlation coefficients.

  The interpolation signal obtained by weighting the two interpolation signals with the first correlation coefficient and the second correlation coefficient and averaging them is further compared to the interpolation signal obtained by simply averaging the two interpolation signals. There is a high possibility that it is close to the target sound.

  Therefore, the sound signal of the first section is compared with the first example of the third embodiment in which the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal are simply replaced with an averaged interpolation signal. The second example of the third embodiment described here can further reduce the sense of incongruity on hearing.

(Third example)
In the third example of the third embodiment, when the first correlation coefficient is greater than or equal to the second correlation coefficient, the signal replacement unit 255 uses the interpolated signal based on the second reference signal as the sound signal of the first section. If the first correlation coefficient is smaller than the second correlation coefficient, the sound signal in the first section is replaced with an interpolation signal based on the fourth reference signal.

  With the above configuration, in the third example of the third embodiment, the sound signal of the first section has a large correlation coefficient between the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal. Replace with the interpolated signal.

  The interpolation signal according to the third example of the third embodiment is an interpolation signal having a large correlation coefficient among the interpolation signal based on the second reference signal or the interpolation signal based on the fourth reference signal. Therefore, the interpolation signal based on the second reference signal or the interpolation signal based on the fourth reference signal, that is, the interpolation signal according to the first embodiment or the interpolation signal according to the second embodiment, is simply compared with either one of The interpolation signal according to the third example of the third embodiment described here is more likely to be closer to the sound signal (target sound) in the first section.

  Therefore, based on the second reference signal as compared with the first embodiment or the second embodiment in which the sound signal of the first section is replaced with the interpolation signal based on the second reference signal or the interpolation signal based on the fourth reference signal. The third example of the third embodiment in which the interpolated signal and the interpolated signal based on the fourth reference signal are replaced by the interpolated signal having the larger correlation coefficient can further reduce the sense of incongruity in hearing.

(Fourth example)
In the third example of the third embodiment, the signal replacement unit 255 determines that the first correlation coefficient is equal to or greater than the second correlation coefficient and that the difference between the first correlation coefficient and the second correlation coefficient is predetermined. If it is larger than the first threshold value, the sound signal in the first section is replaced with an interpolation signal based on the second reference signal.

  Further, the signal replacement unit 255 has a case where the first correlation coefficient is smaller than the second correlation coefficient and the difference between the second correlation coefficient and the first correlation coefficient is larger than the first threshold value. The sound signal of the first section is replaced with an interpolation signal based on the fourth reference signal.

  In addition, in the case other than the above two cases, the signal replacement unit 255 converts the sound signal of the first section into the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal in the sound signal. Replace with the averaged interpolation signal.

  In the interpolation signal according to the fourth example of the third embodiment, the difference between the first correlation coefficient and the second correlation coefficient is larger than the first threshold, that is, the interpolation signal based on the second reference signal When there is a high possibility that only one of the interpolation signals based on the four reference signals is suitable as the interpolation signal, the sound signal of the first section is converted into the interpolation signal based on the second reference signal and the fourth reference signal. The interpolated signal based on the signal is replaced with an interpolated signal having a larger correlation coefficient. In this case, the same effects as those of the third example of the third embodiment described above can be obtained.

  When the difference between the first correlation coefficient and the second correlation coefficient is equal to or less than the first threshold value, that is, after the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal, both are When there is a high possibility that the signal is suitable as an interpolation signal, the sound signal in the first section is replaced with an interpolation signal obtained by averaging both. In this case, the same effects as in the case of the first example of the third embodiment described above are obtained.

Therefore, according to the fourth example of the third embodiment, only one of the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal is likely to be appropriate as the interpolation signal. In both cases, it is possible to replace the sound signal in the first section with an interpolation signal suitable for each case, regardless of whether the case is highly likely to be appropriate as an interpolation signal.
Therefore, according to the fourth example of the third embodiment, it is possible to reduce a sense of incongruity in audibility in any case described above.

(Fifth example)
In contrast to the fourth example of the third embodiment described above, the signal replacement unit 255 in the fifth example of the third embodiment uses the sound signal of the first section in the sound signal input from the A / D conversion unit 240. When the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal are replaced with an averaged interpolation signal, the sound signal of the first section in the sound signal input from the A / D converter 240 is used. Is replaced with an interpolation signal obtained by weighting the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal with the first correlation coefficient and the second correlation coefficient and averaging them.

  Thus, in the fourth example of the third embodiment described above, when it is highly likely that both the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal are appropriate as the interpolation signal, the above-described first The same effects as those of the second example with respect to the first example of the third embodiment are obtained.

  That is, in contrast to the fourth example of the third embodiment in which the sound signal in the first section is simply replaced with an interpolation signal obtained by simply averaging the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal. Since the interpolated signal is weighted with each correlation coefficient and replaced with an averaged interpolation signal, it is possible to further reduce the sense of incongruity in hearing.

  In any of the cases of the first to third embodiments described above and the first to fifth examples of the third embodiment, the recording apparatus of the present embodiment has a sound signal missing section (first The sound signal in the section) is replaced with an interpolation signal that is likely to be close to the target sound in the missing section (first section) of the sound signal. For this reason, it is possible to reduce the sense of discomfort in the sense of hearing as compared with the case where the sound signals are simply replaced with the front and rear sound signals.

In the description using FIG. 2, the section for searching for the second reference signal may be a section before time t5, and the time length of the section is all sound signals before time t5. However, since it is highly possible that a sound signal having a high correlation with the first reference signal is in the vicinity of the first reference signal, it is assumed that the time length of the second section is preferably several to several tens of times. did.
The search period may be dynamically set as follows using the above-described first correlation coefficient, for example.

  For example, when the interpolation signal is detected in the sound signal before the first section set by the section setting unit 251 as in the first embodiment, in the sound signal, the sound signal before the set first section is detected. The first correlation coefficient is calculated in the direction, that is, in the direction away from the set first section.

  Then, when the maximum value of the first correlation coefficient increases, for example, in order, and starts to decrease, the section of the sound signal corresponding to the maximum value immediately before starting to decrease is determined as the above-described second reference signal. To do. In this way, it is not necessary to preset a section for searching for the second reference signal, and a more appropriate second reference signal can be searched with a small number of searches.

  The maximum value of the first correlation coefficient here is, for example, the first correlation coefficient from time t3 to t4 in FIG. 2 and the first correlation coefficient from time t1 to t2.

  Here, the case where an interpolation signal is detected in the sound signal before the first section set by the section setting unit 251 as in the first embodiment has been described. However, as in the second embodiment, when the interpolation signal is detected in the sound signal after the first section set by the section setting unit 251, as in the first embodiment, The second correlation coefficient is calculated in order from the set first section in the backward direction, that is, in the direction away from the set first section.

  Based on the calculated second correlation coefficient, the third reference signal described above is determined in the same manner as in the first embodiment. In this way, it is not necessary to preset a section for searching for the third reference signal, and a more appropriate third reference signal can be searched with a small number of searches.

  As described with reference to FIG. 2, when an interpolation signal is detected in the sound signal before the first interval set by the interval setting unit 251, the sound corresponding to the times t3 to t4 in FIG. There is a possibility that a plurality of sound signals having the maximum first correlation coefficient, such as signals or sound signals from time t1 to t2, are detected as candidates for the second reference signal.

  Thus, when there are a plurality of second reference signal candidates, the interpolation signal detection unit 254, as described above, among the interpolation signals detected based on the plurality of second reference signals, that is, the interpolation signal candidates. Alternatively, an interpolation signal candidate having the highest first correlation coefficient may be selected as the interpolation signal.

  In addition, the signal detection unit 253 uses the plurality of interpolation signal candidates as the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal described in the third embodiment, as described in the third embodiment. As in the first to fifth examples, an interpolation signal may be generated by combining (combining) a plurality of interpolation signal candidates.

  By doing in this way, the signal detection part 253 can detect a more suitable interpolation signal similarly to the case of the 1st example to the 5th example of 3rd Embodiment. Therefore, the sense of incongruity in the sound signal can be further reduced.

  Further, in the sound signal after the set first section, as shown in FIG. 2, as in the first embodiment in which the interpolation signal is detected in the sound signal before the set first section. Also in the second embodiment for detecting an interpolation signal, the signal detection unit 253 may generate an interpolation signal by combining (combining) a plurality of interpolation signal candidates.

  In the above description, the case where the sound signal processing unit 250 performs signal processing on the sound signal collected by the microphone 230 has been described. However, the processing of the sound signal processing unit 250 according to the present embodiment is described above. Thus, the present invention is not applied only to the sound signal collected in real time.

  For example, for a sound signal that has already been recorded, the timing indicating that the operation unit of the device that has recorded the sound signal is operated in association with the sound signal. Even when recorded in the storage unit, the sound signal processing unit 250 according to the present embodiment can similarly perform the signal processing described above.

  Note that the sound signal processing unit 250 in FIG. 1 or each unit included in the sound signal processing unit 250 may be realized by dedicated hardware, or realized by a memory and a microprocessor. There may be.

  The sound signal processing unit 250 or each unit included in the sound signal processing unit 250 may be realized by dedicated hardware, and the sound signal processing unit 250 or the sound signal processing unit 250 may be realized by dedicated hardware. Each unit included in the signal processing unit 250 includes a memory and a CPU (Central Processing Unit), and the sound signal processing unit 250 or a program for realizing the function of each unit included in the sound signal processing unit 250 is loaded into the memory. The function may be realized by executing the function.

  Further, the sound signal processing unit 250 in FIG. 1 or a program for realizing the function of each unit included in the sound signal processing unit 250 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded. May be read by the computer system and executed to perform processing by the sound signal processing unit 250 or each unit included in the sound signal processing unit 250. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design and the like within a scope not departing from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 110 ... Imaging part, 111 ... Optical system, 191 ... Timing detection part, 251 ... Section setting part, 252 ... Reference signal determination part, 253 ... Signal detection part, 254 ... Interpolation signal detection part, 255 ... Signal replacement part, 256 ... Recording unit, 257... Signal processing unit

Claims (13)

An input unit to which a sound signal is input;
A timing detection unit for detecting a timing that makes the operation of the operation unit,
A storage unit that stores a time relationship between a section indicating that the operation unit is operated and a section in which a sound signal is generated by the operation unit for each type of the operation unit;
Wherein those said timing and detected timing is read from the front term memory unit in accordance with the type of operation section detected by the timing detector, a sound signal by the section and the operation section indicating that the operation unit is operated A section setting unit that sets a first section including a section in which the sound signal is generated by the operation unit based on a time relationship with the section in which
In the sound signal, a reference signal determination unit that uses the sound signal corresponding to a second section continuous to the first section as a first reference signal;
A signal detector that detects a sound signal having the highest correlation with the first reference signal as a second reference signal in the sound signal;
In the sound signal, an interpolation signal detection unit that detects a sound signal that is continuous with the second reference signal detected by the signal detection unit and that has the same time length as the first interval, as an interpolation signal;
A signal replacement unit for replacing the sound signal of the first section with the interpolation signal;
A recording unit for recording the sound signal replaced by the signal replacement unit;
A recording apparatus comprising: The reference signal determining unit determines the first reference signal with the second section as a section continuous to the first section before the first section in the sound signal;
The signal detection unit detects a sound signal having the highest correlation with the first reference signal as the second reference signal in a section before the second section in the sound signal,
The interpolation signal detection unit detects the sound signal continuous after the second reference signal as the interpolation signal;
The recording apparatus according to claim 1. The reference signal determining unit determines, as a third reference signal, the sound signal corresponding to a third section that is continuous with the first section after the first section in the sound signal;
The signal detection unit detects a sound signal having the highest correlation with the third reference signal as a fourth reference signal in a section after the third section in the sound signal;
The interpolation signal detection unit detects a sound signal that is continuous before the fourth reference signal and has the same time length as the first interval as the interpolation signal.
The recording apparatus according to claim 2. The signal replacement unit is
In the sound signal, the sound signal of the first section is replaced with an interpolation signal obtained by averaging the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal.
The recording apparatus according to claim 3. A signal processing unit that performs SS (Spectral Subtraction) processing or SNG (Spectral Noise Gating) processing on the sound signal replaced by the signal replacement unit;
5. The recording apparatus according to claim 1, comprising: The first section set by the section setting unit is an integer multiple of a section corresponding to a processing unit of SS processing or SNG processing executed by the signal processing unit.
The recording apparatus according to claim 5, wherein: The timing detector
Detecting the timing based on a signal output in response to operation of a switch for activating the operation unit;
The recording apparatus according to claim 1, wherein the recording apparatus is a recording apparatus. The recording device according to any one of claims 1 to 7,
An imaging unit that captures an image from the optical system;
An imaging apparatus comprising: On the computer,
With a sound signal, an input procedure of inputting the timing shown that make operating the operation unit device recorded the sound signal is provided,
The time relationship between the input timing and the section indicating that the operating section is operated and the section in which the sound signal is generated by the operating section is determined according to the type of the operating section in which the timing is detected. Including a section in which a sound signal from the operating section is generated based on a time relationship between a section indicating that the operating section is operated and a section in which the sound signal is generated by the operating section , which is read from the storage section stored every time Section setting procedure for setting the first section;
In the sound signal, a reference signal determination procedure in which the sound signal corresponding to a second section that is continuous with the first section is a first reference signal;
In the sound signal, a signal detection procedure for detecting a sound signal having the highest correlation with the first reference signal as a second reference signal;
In the sound signal, an interpolation signal detection procedure for detecting, as an interpolation signal, a sound signal that is continuous with the second reference signal detected by the signal detection procedure and has the same time length as the first interval;
A signal replacement procedure for replacing the sound signal of the first section with the interpolation signal;
A program for running An input unit to which a sound signal is input;
A timing detection unit for detecting the timing at which the operation unit operates;
And on the basis of the detected timing by the timing detection unit, and have contact with the sound signal, the section setting unit for setting a first interval including a section in which the operation unit is operating,
The sound signal corresponding to the second section that is continuous to the first section before the first section in the sound signal is set as a first reference signal, and the first signal after the first section in the sound signal is used. A reference signal determination unit that uses the sound signal corresponding to a third section continuous to one section as a third reference signal;
In a section before the second section in the sound signal, a sound signal having the highest correlation with the first reference signal is detected as a second reference signal, and in a section after the third section in the sound signal, A signal detector for detecting a sound signal having the highest correlation with the third reference signal as a fourth reference signal;
In the sound signal, the sound signal continuous after the second reference signal having the same time length as the first interval and the sound signal continuing before the fourth reference signal having the same time length as the first interval are interpolated. An interpolation signal detector for detecting as a signal;
The correlation coefficient between the second reference signal detected by the signal detector and the first reference signal is a first correlation coefficient, and the fourth reference signal and the third reference detected by the signal detector The correlation coefficient with the signal is the second correlation coefficient, and the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal are expressed by the first correlation coefficient and the second correlation coefficient. A signal replacement unit that replaces the sound signal of the first section with a weighted averaged interpolation signal;
A recording unit for recording the sound signal replaced by the signal replacement unit;
A recording apparatus comprising: An input unit to which a sound signal is input;
A timing detection unit for detecting the timing at which the operation unit operates;
And on the basis of the detected timing by the timing detection unit, and have contact with the sound signal, the section setting unit for setting a first interval including a section in which the operation unit is operating,
The sound signal corresponding to the second section that is continuous to the first section before the first section in the sound signal is set as a first reference signal, and the first signal after the first section in the sound signal is used. A reference signal determination unit that uses the sound signal corresponding to a third section continuous to one section as a third reference signal;
In a section before the second section in the sound signal, a sound signal having the highest correlation with the first reference signal is detected as a second reference signal, and in a section after the third section in the sound signal, A signal detector for detecting a sound signal having the highest correlation with the third reference signal as a fourth reference signal;
In the sound signal, the sound signal continuous after the second reference signal having the same time length as the first interval and the sound signal continuing before the fourth reference signal having the same time length as the first interval are interpolated. An interpolation signal detector for detecting as a signal;
The correlation coefficient between the second reference signal detected by the signal detector and the first reference signal is a first correlation coefficient, and the fourth reference signal and the third reference detected by the signal detector When the correlation coefficient with the signal is the second correlation coefficient, and the first correlation coefficient is equal to or greater than the second correlation coefficient, the sound signal of the first section is interpolated based on the second reference signal And when the first correlation coefficient is smaller than the second correlation coefficient, a signal replacement unit that replaces the sound signal of the first section with an interpolation signal based on the fourth reference signal;
A recording unit for recording the sound signal replaced by the signal replacement unit;
A recording apparatus comprising: An input unit to which a sound signal is input;
A timing detection unit for detecting the timing at which the operation unit operates;
And on the basis of the detected timing by the timing detection unit, and have contact with the sound signal, the section setting unit for setting a first interval including a section in which the operation unit is operating,
The sound signal corresponding to the second section that is continuous to the first section before the first section in the sound signal is set as a first reference signal, and the first signal after the first section in the sound signal is used. A reference signal determination unit that uses the sound signal corresponding to a third section continuous to one section as a third reference signal;
In a section before the second section in the sound signal, a sound signal having the highest correlation with the first reference signal is detected as a second reference signal, and in a section after the third section in the sound signal, A signal detector for detecting a sound signal having the highest correlation with the third reference signal as a fourth reference signal;
In the sound signal, the sound signal continuous after the second reference signal having the same time length as the first interval and the sound signal continuing before the fourth reference signal having the same time length as the first interval are interpolated. An interpolation signal detector for detecting as a signal;
The correlation coefficient between the second reference signal detected by the signal detector and the first reference signal is a first correlation coefficient, and the fourth reference signal and the third reference detected by the signal detector The correlation coefficient with the signal is a second correlation coefficient, the first correlation coefficient is greater than or equal to the second correlation coefficient, and the difference between the first correlation coefficient and the second correlation coefficient is predetermined. If the threshold value is greater than the threshold value, the sound signal of the first section is replaced with an interpolation signal based on the second reference signal, the first correlation coefficient is smaller than the second correlation coefficient, and When the difference between the second correlation coefficient and the first correlation coefficient is larger than the threshold, the sound signal in the first section is replaced with an interpolation signal based on the fourth reference signal, and in other cases In the sound signal, the sound signal of the first section is replaced with an interpolation signal based on the second reference signal and a previous signal. A signal replacement portion for replacing the interpolation signal obtained by averaging the interpolation signal based on the fourth reference signal,
A recording unit for recording the sound signal replaced by the signal replacement unit;
A recording apparatus comprising: The signal replacement unit is
In the sound signal, when replacing the sound signal of the first section with an interpolation signal obtained by averaging the interpolation signal based on the second reference signal and the interpolation signal based on the fourth reference signal,
In the sound signal, the sound signal of the first section is converted into an interpolation signal based on the second reference signal and an interpolation signal based on the fourth reference signal by the first correlation coefficient and the second correlation coefficient. Replace with weighted average interpolation signal,
The recording apparatus according to claim 12.

Images