JP2015138204A - Data processing device, imaging device and data processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data processing device that can appropriately reduce noise.SOLUTION: A data processing device comprises: a first conversion unit that allows a part of segment of a first segment and a second segment to overlap, divides input data into data on the first segment and data on the second segment and converts the data on the first segment and the data on the second segment into data on a frequency area; a change unit that changes a prescribed frequency component of the data on the first segment converted by the first conversion unit; a second conversion unit that converts the data on the first segment changed by the change unit and the data on the second segment converted by the first conversion unit into data on a time area; an addition unit that adds the data on the first segment and the data on the second segment converted by the second conversion unit by allowing a part of the segment to overlap; and a correction unit that corrects the data added by the addition unit on the basis of the data on the first segment and the data on the second segment which are converted by the second conversion unit.

Description

  The present invention relates to a data processing device, an imaging device, and a data processing program.

  There is a technique for reducing noise included in sound data (see Non-Patent Document 1, for example). The technique described in Non-Patent Document 1 describes a noise reduction process called a spectral subtraction method.

S. F. Boll, “Suppression of Acoustic Noise in Speech Using Spectral Subtraction.” IEEE TRANSACTION ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, vol.ASSP-27, pp.113-120, APRIL, 1979.

  The spectral subtraction method divides an input signal into a plurality of sections, performs frequency conversion, frequency domain processing (noise reduction processing), and inverse conversion on the divided signals for each section in order, and performs inverse conversion of continuous sections. This is a technique for obtaining a processed signal by connecting signals. In this spectral subtraction method, the polarity of each divided signal when the input signal is divided into a plurality of sections may be different from the original polarity in frequency domain processing. For this reason, when each divided signal is connected, the level of the processing signal at the connected portion may be inadvertently lowered.

  An object of the present invention is to provide a data processing device, an imaging device, and a data processing program capable of appropriately reducing noise.

The present invention solves the above problems by the following means.
In one embodiment of the present invention, a part of the first section and the second section are overlapped to divide input data into the data of the first section and the data of the second section, and the first section A first converter that converts the data of the section and the data of the second section into data in the frequency domain, and a changing section that changes a predetermined frequency component of the data of the first section converted by the first converter A second conversion unit that converts the data of the first section changed by the change unit and the data of the second section converted by the first conversion unit into time-domain data, and the second conversion An addition unit that adds the data of the first section converted by the unit and the data of the second section converted by the second conversion unit by overlapping some sections, and the second conversion unit The converted data of the first section and the second conversion unit Based on the more it converted the second section data, a correction unit which corrects the data added by the adding unit, a data processing apparatus comprising: a.
In one embodiment of the present invention, a part of the first section and the second section are overlapped to divide the input data into the data of the first section and the data of the second section, A first converter that converts data in the first section into data in the frequency domain, a change section that changes a predetermined frequency component of the data in the first section converted by the first converter, and the change section The second conversion unit that converts the changed data of the first section into time domain data, the data of the first section and the data of the second section converted by the second conversion unit are partially Based on the data of the first section and the data of the second section converted by the second conversion section, the data added by the adding section is corrected based on the addition section that overlaps and adds the sections. And a correction unit. It is a management apparatus.
Moreover, one Embodiment of this invention is an imaging device provided with said data processing apparatus.
Moreover, one embodiment of the present invention is a data processing program executed in a computer, wherein the computer overlaps a part of the first section and the second section, and inputs data to the first section. A first converter that divides the data in the section and the data in the second section and converts the data in the first section and the data in the second section into data in the frequency domain; and the conversion by the first converter Changing means for changing a predetermined frequency component of the data of the first section, the data of the first section changed by the changing means, and the data of the second section converted by the first conversion means, The second conversion means for converting the data into time domain data, the first section data converted by the second conversion means, and the second section data converted by the second conversion means Based on the addition means for overlapping and adding, the data of the first section converted by the second conversion means and the data of the second section converted by the second conversion means A data processing program that functions as a correction unit that corrects the data added by the unit.

  According to the present invention, it is possible to provide a data processing device, an imaging device, and a data processing program that can appropriately reduce operation noise.

It is a block diagram which shows the structure of the data processor 100 in 1st Embodiment. It is a schematic diagram which shows the relationship between the process area at the time of setting a frame shift to Lf / 2, a frame length, a frame shift, and an overlap. It is a wave form diagram which shows an example of the sound data before and behind multiplying a window function. It is a wave form diagram which shows an example at the time of multiplying the divided sound data by the window function. It is a wave form diagram of a processing signal after performing frequency domain processing, and sound data after processing. 3 is a flowchart illustrating a procedure of frequency domain processing by the data processing apparatus 100. It is explanatory drawing which shows the specific example of the frequency domain process by the data processor. It is a schematic diagram which shows the relationship between the process area, frame length, frame shift, and overlap when a frame shift is Lf / 3. It is a block diagram which shows the structure of the imaging device 1 provided with the data processor 100 of 1st Embodiment.

Embodiments of the present invention will be described below with reference to the drawings.
[First Embodiment]
FIG. 1 is a block diagram illustrating a configuration of a data processing device 100 according to the first embodiment. The data processing apparatus 100 according to the present embodiment performs data processing on the sound data S (input data) and outputs the processed sound data S ′. For example, the data processing apparatus 100 acquires sound data recorded on a storage medium, and executes data processing on the acquired sound data. Here, the storage medium is a portable medium such as a flash memory card, a magnetic disk, or an optical disk.

  The data processing apparatus 100 may be configured to include a reading unit (not shown) for reading sound data from the storage medium. In addition, the data processing apparatus 100 may include an external device (reading device) that can be connected by wired communication or wireless communication. Further, instead of the storage medium, a flash memory may be mounted and a USB memory that can be connected via a USB (Universal Serial Bus) connector, or a storage device such as a hard disk.

  Sound data of the recorded sound is stored in the storage medium. The storage medium stores sound data of sound collected by at least a device having a recording function. The storage medium stores information indicating a section including noise or a section not including noise in the sound data of the recorded sound in association with the sound data.

  For example, in the sound data of the recorded sound, the section including noise may be a section in which the operation unit of the device that recorded (recorded) the sound data is operating. On the other hand, in the sound data of the recorded sound, the section that does not include noise may be a section in which the operation unit of the device that recorded the sound data is not operating. In addition, in the sound data of the recorded sound, information indicating a section including noise or information indicating a section not including noise indicates the timing at which the operation unit of the device that recorded the sound data is operated. It may be data.

  Here, the operation unit of the device that records the sound data refers to a configuration in which sound is generated (or that sound may be generated) by the operation among the configurations of the device. For example, when the device that records the sound data is an imaging device, the imaging device includes a zoom lens, an anti-vibration lens (hereinafter also referred to as “VR lens”), and a focus adjustment lens (hereinafter also referred to as “AF lens”). ), An operation unit or the like. That is, the noise is a recording of sound generated by the operation of the zoom lens, VR lens, AF lens, operation unit, and the like included in the imaging apparatus.

  The imaging apparatus controls the operation of the drive unit that drives the zoom lens, the VR lens, or the AF lens, which is the operation unit, using a drive control signal. That is, the imaging apparatus operates the above-described operation unit by controlling the output value of the drive control signal. The imaging apparatus may store the output level (High / Low) of the drive control signal in the storage medium in association with the sound data of the recorded sound as a signal indicating the timing at which the operation unit operates. For example, if the output level of the drive control signal is High, the signal indicates the timing at which the operating unit operates, and if the output level is Low, the signal indicates the timing at which the operating unit is not operating. Therefore, if the output level of the drive control signal is High, it can be determined that the section includes noise. If the output level of the drive control signal is Low, it can be determined that the section does not contain noise. Note that the configuration of the imaging device including the operation unit will be described later.

  The data processing apparatus 100 performs data processing on sound data. For example, the data processing apparatus 100 performs a process of reducing noise included in the sound data based on the sound data of the recorded sound and a signal indicating the timing at which the operation unit associated with the sound data operates. To do.

  Next, the configuration of the data processing apparatus 100 will be described. As shown in FIG. 1, the data processing apparatus 100 includes a data processing unit 110 and a storage unit 120.

  The storage unit 120 includes sound data before frequency domain processing to be described later, a window function, pre-processing data of each divided frame, processing data inversely converted for each frame, processed sound data (post-processing data), Data relating to arithmetic expressions, data processing programs, and the like is stored. These data stored in the predetermined area of the storage unit 120 are appropriately written and read by the data processing unit 110 described later.

  The data processing unit 110 includes a conversion unit 111 (first conversion unit), a determination unit 112, a noise reduction unit 113 (change unit), an inverse conversion unit 114 (second conversion unit), an addition unit 115, and a correction. A coefficient calculation unit 116 and a correction unit 117 are provided.

  The converter 111 divides the input sound data S into a plurality of overlapping frames (short-term sections) in the processing section, and converts the divided sound data S into a frequency spectrum (frequency domain data) for each frame. Specifically, the conversion unit 111 divides the input sound data S into pre-processing data of a plurality of frames that overlap in the processing section, and extracts a frame to be processed. The conversion unit 111 multiplies the pre-processing data of the frame to be processed by the window function. Then, the transform unit 111 performs Fourier transform on the pre-processing data multiplied by the window function, and generates a frequency spectrum corresponding to the frame to be processed. In addition, in the conversion unit 111, the pre-processing data multiplied by the window function may be converted into a frequency spectrum by Fast Fourier Transform (FFT).

  Here, conditions for dividing pre-processing data from sound data will be described. FIG. 2 is a schematic diagram showing the relationship between the processing section, the frame length, the frame shift, and the overlap when the frame shift is Lf / 2.

  FIG. 2 shows an example in which sound data is divided into pre-processing data of the (k−1) th frame, the kth frame, and the (k + 1) th frame. In FIG. 2, the frame shift indicates a section in which two adjacent pre-processing data temporally overlap. In the present embodiment, the frame shift is half the frame length Lf (Lf / 2). When the frame shift is Lf / 2, a half frame that is half of the frame length Lf is a processing section (overlap section).

  The converter 111 multiplies the pre-processed data divided by the Lf / 2 frame shift by a window function. The window function is a function whose value becomes 0 (zero) outside a finite specific interval. In this example, a finite specific section is between the start timing and end timing of each frame. That is, the window function is a function that takes a certain value in the frame and becomes 0 (zero) outside the frame.

  FIG. 3 is a waveform diagram showing an example of sound data before and after multiplication by a window function. FIG. 3A shows an example of sound data Wi before being multiplied by the window function. FIG. 3B shows an example of the sound data Wo after being multiplied by the window function. As shown in FIG. 3A, the waveform Wi before being multiplied by the window function has a constant amplitude A from time t0 to time t2. On the other hand, the waveform Wo after being multiplied by the window function has an amplitude A of 0 (zero) at time t0 and time t2, and has a maximum amplitude A at time t1. In this example, one frame is from time t0 to time t2. When Fourier transform is performed without multiplication by the window function, the sound data after inverse Fourier transform may have a discontinuous waveform between frames. By multiplying the window function and performing Fourier transform, it is possible to reduce the sound data after the inverse Fourier transform from having a discontinuous waveform between the frames.

FIG. 4 is a waveform diagram showing an example when the divided sound data is multiplied by a window function. By multiplying the sound data S by a window function as shown in FIG. 3B, pre-processing data S _k−1 , S _k , and S _{k + 1} as shown in FIG. 4 are generated. In this example, the sound data S is divided by multiplying the sound data S by a window function having a value of 0 to 1. Therefore, for example, when comparing the latter half of the pre-processing data S _{k-1 and} the _first half of the pre-processing data S _k , the polarity (+/−) of the sampling points corresponding to the same time is the same at all sampling points. To do.

Note that the pre-processing data S _k-1 shown in FIG. 4 corresponds to the data of the first section in the present embodiment, for example. Also, pre-processing data S _k, for example, correspond to the data of the second section in this embodiment. That is, when the conversion unit 111 overlaps a part of the first section and the second section and divides the sound data (input data) into the data of the first section and the data of the second section, For example, the pre-processing data S _k-1 corresponds to the data in the first section, and the pre-processing data S _k corresponds to the data in the second section.

  Based on the output level (High / Low) of the drive control signal associated with the sound data, the determination unit 112 determines whether each frame of the sound data is a frame in a section including noise or does not include noise. It is determined whether it is a frame of the section. When the determination unit 112 determines that the sound data frame is a frame in a section including noise, the sound data of the frame is sent to the noise reduction unit 113. On the other hand, when the determination unit 112 determines that the sound data frame is a frame in a section not including noise, the sound data of the frame is transmitted to the inverse conversion unit 114.

  For example, when the determination unit 112 determines that the frame of the first section described above is a frame of a section including noise, the data of the first section is sent to the noise reduction unit 113. If the determination unit 112 determines that the frame of the second section described above is a frame of a section that does not include noise, the data of the second section is sent to the inverse conversion unit 114.

  The determination unit 112 includes noise in the frame when the output level of the drive control signal is High until the middle of one frame, or when the output level of the drive control signal becomes High from the middle of one frame. It is determined that it is a frame of a section.

  The noise reduction unit 113 executes processing for changing a predetermined frequency component included in the frequency spectrum converted by the conversion unit 111 (hereinafter also referred to as “frequency domain processing”). The frequency domain processing by the noise reduction unit 113 will be described later.

  The inverse transform unit 114 inversely transforms the frequency spectrum that has been frequency domain processed by the noise reduction unit 113 (or the frequency spectrum that has not been frequency domain processed by the noise reduction unit 113) into processing data in the time domain for each processing interval. . The inverse transformation process in the inverse transformation unit 114 will be described later.

  The adder 115 adds two pieces of processing data that overlap in the processing section, and generates post-processing data. Note that the processing section in which a part of two divided pre-processing data is overlapped in the conversion unit 111 and the processing section in which a part of two processing data to be added are overlapped in the addition unit 115 are: It becomes the section of the same size.

  Here, processing of the conversion unit 111, the noise reduction unit 113, and the inverse conversion unit 114 described above will be specifically described. In the frequency domain processing executed by the noise reduction unit 113 of the present embodiment, the amplitudes of all frequency components in the frequency spectrum are aligned, and the processing data is processed by performing inverse transformation using phase information when Fourier transform is performed. It is a process to generate.

Here, the conversion unit 111, a case of Fourier transform preprocessing data S _k of the k-th frame shown in FIG.
First, in the conversion unit 111, the pre-process data S _k of the k-th frame is Fourier-transformed according to Expression (1), and separated into amplitude information shown in Expression (2) and phase information shown in Expression (3). . “N” in the equation is the number of sampling points in one frame (1 ≦ n ≦ Lf). “S” in the equation is the bin number of the frequency component.

  Next, in the noise reduction unit 113, the amplitude information of Expression (2) is changed to a constant independent of frequency by Expression (4). By executing this processing for all frequency components, the magnitudes of the amplitude information are made uniform. In this frequency domain processing, the sum of the powers of all frequency components in each frame does not change. This frequency domain process is a noise reduction process in the present embodiment.

  As another noise reduction process, for example, the aforementioned spectral subtraction method may be used. The noise reduction processing by the spectrum subtraction method is to reduce noise of sound data by subtracting an estimated noise spectrum for each frequency bin (for each frequency component) from a frequency spectrum of a frame including noise.

  Next, the inverse transform unit 114 performs inverse transform by combining the amplitude information after the frequency domain processing and the phase information before the frequency domain processing according to Expression (5).

The post-processing data is generated by adding the processing data inversely converted by the inverse conversion unit 114 in the subsequent addition unit 115 by overlapping each processing section.
Next, it will be described that the power sum of the processed data subjected to the frequency domain processing changes with respect to the power sum of the pre-processed data before the frequency domain processing.

In FIG. 4, since the sound data S is divided by multiplying the window function having a value of 0 to ₁ , the same time is used in the latter half of the pre-processing data S _{k-1 and} the _first half of the pre-processing data S _k. The polarity (+/−) of the sampling point corresponding to is the same at all sampling points. Therefore, the power of the sound data in a section (processing section) where the latter half of the pre-processing data S _{k−1 and} the _first half of the pre-processing data S _k overlap is obtained by Expression (6). In Equation (6), “FS” indicates a frame shift (= Lf / 2) value. For example, if the sampling number of the frame length Lf is 1024, the FS is 512.

Here, assuming that the processing data in the _k− 1th frame and the kth frame that have been subjected to frequency domain processing are processing data S ′ _k−1 and S ′ _k , respectively, The power is obtained by the equation (7).

Process data S ′ _k−1 , S ′ _k that have been frequency domain processed so that the sum of the powers of all frequency components does not change in each frame, and pre-processing data S _k−1 , S _k before frequency domain processing, The amount of change in the sum of the power in the interval where the values overlap is obtained by equation (8).

In Expression (8), in the pre-processing data before the frequency domain processing, | S _k-1 (n + FS) || S _k (n) | indicating the power of the overlapping section is always a positive value. On the other hand, in post-processed data that has been subjected to frequency domain processing, the correlation between overlapping sections of the (k-1) th frame and the (k-1) th frame may be weak, or the polarity (+/-) may be different. Therefore, as shown in Expression (9), it is conceivable that the power in the overlapping section is reduced as a whole. Equation (9) shows that equation (9) also approaches zero (0) as the correlation in the overlapping section of the (k−1) th frame and the kth frame approaches zero.

  Note that the weakening of the correlation means that the correlation coefficient between the two waveforms is smaller than 1 (the closeness of the two waveforms is reduced). The correlation coefficient is represented by a value normalized between −1 and 1, for example. A correlation coefficient of 0 represents a state where there is no correlation between the two waveforms. A correlation coefficient of 1 means that two waveforms are completely correlated. When the correlation coefficient of the two waveforms is smaller than 1, the power of the processed data obtained by adding the two processed data in the overlapping section may be lower than that before the frequency domain processing. Similarly, even when the polarity (+/−) differs before and after the frequency domain processing, the power of the processed data obtained by adding the two processed data is lower than that before the frequency domain processing in the overlapping section. There are things to do.

  Therefore, even if the noise reduction unit 113 performs frequency domain processing so that the sum of power in each frame does not change, the sum of the power of the processed data obtained by adding the two processing data is larger than that before the frequency domain processing. Tend to decline.

5, pre-processing data _{S k-1, S} k shown in FIG. _4, the _{S k + 1,} the process data _S'k-1 after the frequency domain _{processing, S'k, S'k + 1} , and after treatment It is a wave form diagram which shows sound data S '. Processing data _S'k-1 of each frame shown in FIG. 5, S'k, and _{S'k + 1,} the pre-processing shown in FIG. 4 the data _{S k-1, S} k, is compared with the _{S k + 1,} shown in FIG. 4 In the pre-processing data, in the adjacent frames corresponding to the same time, the polarities (+/−) of the overlapping data are the same. On the other hand, in the processing data shown in FIG. 5, the polarities of the overlapping data do not necessarily match in the adjacent frames corresponding to the same time.

Further, in the pre-processing data S _k−1 , S _k , and S _{k + 1} shown in FIG. 4, the amplitude is narrowed at both ends of each frame by the window function. On the other hand, in the processing data S ′ _k−1 , S ′ _k , and S ′ _{k + 1} shown in FIG. 5, the amplitude is increased at both ends of each frame, and the effect of multiplying the window function is reduced. For this reason, when two overlapping processing data are added, the sum of the power of the processed data is lower than that before the frequency domain processing if the polarities of the two data do not match even near both ends of each frame. Tend to.

Returning to the description of FIG. 1 again, the correction coefficient calculation unit 116 and the correction unit 117 of the data processing unit 110 will be described.
The correction coefficient calculation unit 116 calculates the correction coefficient based on the sum of the power of the processed data after the addition in the processing section and the value obtained by adding the sum of the powers of a plurality of adjacent processing data before the addition in the same processing section. calculate.

  The correction coefficient calculation unit 116 calculates the correction coefficient only when it is determined that the correction coefficient needs to be calculated for the processed data of the frame to be processed. The correction coefficient calculation unit 116 determines that the correction coefficient needs to be calculated when the determination unit 112 determines that the frame to be processed is a frame in a section including noise. The correction coefficient calculation unit 116 determines that calculation of the correction coefficient is unnecessary when the determination unit 112 determines that the frame to be processed is a frame in a section not including noise.

Hereinafter, FIG. 4 preprocessing shown in the data _{S k-1, S k,} and processing the data _S'k-1 shown in FIG. 5 will be explained with reference to an example _S'k.
4 and 5, since the frame shift is Lf / 2, the sound data that becomes the post-processing data is obtained by adding the processing data of two adjacent frames overlapping in the processing section (half frame). S 'is obtained. For this reason, the correction coefficient is calculated so that the sum of the power of the processed data after the addition in the processing section is equal to the value obtained by adding the sum of the powers of two adjacent processing data before the addition in the same processing section. A correction coefficient CC for making the sum of the powers of both data equal is obtained by equation (10).

  In Expression (10), the denominator of the fractional expression indicates the sum of the power of the processed data after the addition in the processing section (the square of the added value). The numerator indicates a value obtained by adding the sums of powers of two adjacent processing data before addition in the same processing section (added value of squared values). Since the power of both data corresponds to the square of the amplitude, a value obtained by taking the square root of the solution obtained by the fractional expression is a correction coefficient CC for correcting the processed data.

  The correction unit 117 sets the processing interval so that the sum of the powers of the processed data after the addition in the processing interval is equal to the sum of the powers of the two adjacent processing data before the addition in the same processing interval. The post-processing data after the addition in is corrected based on the correction coefficient CC.

  The post-processing data S ′ corrected (n) in the post-correction processing section is obtained by Expression (11). The correction of post-processing data in the correction unit 117 is performed for each processing section (half frame in this example).

  Based on the sum of the amplitudes of the processed data after the addition in the processing interval and the sum of the amplitudes of a plurality of adjacent processing data before the addition in the same processing interval in the correction coefficient calculation unit 116. A correction coefficient may be calculated. When the frame shift is Lf / 2, the correction coefficient CC for equalizing the sum of the amplitudes of both data is obtained by Expression (12).

  Even when the post-processing data is corrected by the correction coefficient CC obtained by Expression (12), the same effect as that obtained when the post-processing data is corrected by the correction coefficient CC for equalizing the sum of the powers of both data can be obtained. it can. Further, according to the equation (12), the calculation amount of the correction coefficient CC can be suppressed.

  Next, a series of operations of frequency domain processing by the data processing apparatus 100 will be described. FIG. 6 is a flowchart showing the procedure of frequency domain processing by the data processing apparatus 100. The process of the flowchart shown in FIG. 6 is executed by the data processing unit 110 based on the data processing program stored in the storage unit 120 (see FIG. 1).

  In step S1 shown in FIG. 6, the conversion unit 111 divides the input sound data S into a plurality of frames that overlap in the processing section, and extracts a frame to be processed.

In step S2, the conversion unit 111 multiplies the pre-processing data of the frame to be processed by the window function.
In step S3, the conversion unit 111 converts the pre-processing data multiplied by the window function into a frequency spectrum by Fourier transformation.

  In step S4, the determination unit 112 determines whether the frame to be processed is a frame in a section including noise based on the output level (High / Low) of the drive control signal associated with the pre-processing data, It is determined whether the frame is in a section not included. If the determination in step S4 is YES, the process proceeds to step S5. If the determination in step S4 is NO, the process proceeds to step S6.

In step S5, the noise reduction unit 113 performs frequency domain processing (noise reduction processing) on the frequency spectrum converted in step S3.
In step S5, for example, when noise reduction processing by a spectral subtraction method is performed, predetermined data may be added after subtracting the noise data from the noise data converted into the frequency domain. Here, the predetermined data may be, for example, random noise generated by a program that generates pseudo-random numbers. When noise data is subtracted from the noise data converted to the frequency domain, it may be excessively subtracted beyond the expected noise magnitude, or a value larger than the expected noise magnitude may be intentionally subtracted. is there. In such a case, by adding a process of adding predetermined data, it is possible to interpolate a sound that has been subtracted excessively.

  In step S6, the inverse transform unit 114 inversely transforms the frequency spectrum of the frame subjected to the frequency domain processing in step S5 or the frequency spectrum of the frame not subjected to the frequency domain processing into processing data in the time domain.

In step S <b> 7, the addition unit 115 adds two pieces of processing data that overlap in the processing section, and generates post-processing data. For example, the process target frame, if the k-1 frame and a k-th frame shown in FIG. 4, and the second half portion of the processing data _S'k-1 shown in FIG. 5, the first half of the process data _S'k Are overlapped in the processing section (half frame) and added.

  In step S8, the correction coefficient calculation unit 116 determines whether correction coefficient calculation is necessary for a frame to be processed based on the determination result in the determination unit 112 in step S4. If the determination in step S8 is YES, the process proceeds to step S9. If the determination in step S8 is NO, the process proceeds to step S11.

  In step S9, the correction coefficient calculation unit 116 equals the sum of the powers of the processed data after the addition in the processing interval and the sum of the powers of two adjacent processing data before the addition in the same processing interval. The correction coefficient is calculated as follows. For example, if the frame to be processed is the (k−1) th frame and the kth frame shown in FIG. 4, the correction coefficient CC is obtained by Expression (10).

  In step S10, the correction unit 117 makes the sum of the powers of the processed data after the addition in the processing section equal to the value obtained by adding the sums of the powers of two adjacent processing data before the addition in the same processing section. Further, the post-processing data after the addition in the processing section is corrected based on the correction coefficient CC. For example, if the frame to be processed is the k-1 frame and the k frame shown in FIG. 4, in the corrected processing section (the second half of the k-1 frame and the first half of the k frame). The post-processing data is obtained by, for example, equation (11). The corrected post-processing data is output from the data processing unit 110 as sound data S ′. For the frames for which the correction coefficient calculation unit 116 does not calculate the correction coefficient, the processing data added by the addition unit 115 is output from the data processing unit 110 as sound data S ′.

  In step S11, the conversion unit 111 determines whether or not the processing has been completed for all frames of the input sound data S. If the determination in step S11 is YES, the process of this flowchart is terminated. If the determination in step S11 is NO, the process returns to step S1.

  Next, a specific example of frequency domain processing (noise reduction processing) by the data processing apparatus 100 according to the present embodiment will be described.

  FIG. 7 is an explanatory diagram showing a specific example of frequency domain processing by the data processing apparatus 100. In FIG. 7, the horizontal axis indicates time. 7A and 7C, the vertical axis indicates the data value. In FIG. 7B, the vertical axis indicates the data output level. In FIG. 7D, the vertical axis indicates the ratio of the sum of the power of the processed data when the sum of the power of the data before the processing is 1.

FIG. 7A is a waveform diagram of the sound data S serving as input data. Here, pseudo-random data having a value of −0.5 to 0.5 is used as the sound data S.
FIG. 7B shows a change in the output level of the drive control signal. In this example, it is assumed that the section in which the output level of the drive control signal is High is a section in which noise is included in the sound data S. Further, the section where the output level of the drive control signal is Low is assumed to be a section where the sound data S does not contain noise. In this example, frequency domain processing by the noise reduction unit 113 (see FIG. 1) is performed in a section where the output level of the drive control signal is High (hereinafter also referred to as “processing section where the output level is High”).

  FIG. 7C is a waveform diagram of the sound data S ′ subjected to frequency domain processing. The waveform diagram shown in FIG. 7C is a waveform diagram of the sound data S ′ that is not corrected by the correction coefficient in the correction unit 117 (see FIG. 1).

  FIG. 7D is a graph showing the magnitude of the sum of the power of the processed data relative to the sum of the power of the pre-processed data. In this example, the sampling number of the frame length Lf is 1024, and the frame shift (FS) is 512. In FIG. 7D, the sum of the power of the processed data when the sum of the power of the unprocessed data is 1 is graphed for each half frame (sampling number 512).

  The solid line shown in FIG. 7D is a graph showing the result of the processed data that is not corrected by the correction coefficient in the processing section. Moreover, the broken line shown in FIG.7 (d) is a graph which shows the result of the data after a process which corrected with the correction coefficient in the process area. In FIG. 7D, since the graphs overlap in a section where the output level of the drive control signal is Low, all are shown by solid lines.

  As shown in FIG. 7D, it was confirmed that the post-processing data that is not corrected by the correction coefficient has a tendency that the sum of power tends to decrease as a whole in the processing section where the output level is High. On the other hand, in the post-processing data corrected by the correction coefficient, it was confirmed that the power sum hardly decreases in the processing section where the output level is high.

  As described above, in the data processing apparatus 100 according to the first embodiment, the correction coefficient is calculated based on the sum of the power of the processed data and the sum of the powers of a plurality of adjacent processed data before the addition. Since the post-processing data after the addition is corrected based on the coefficient, it is possible to appropriately reduce the operation noise generated when the operation unit operates while suppressing the decrease in the level of the environmental sound included in the sound data.

  In the data processing apparatus 100 according to the first embodiment, since the output level (High / Low) of the drive control signal is used as a signal indicating the timing at which the operation unit operates, a section including noise is more accurately determined. can do.

  In the first embodiment, the case where the frame shift is set to Lf / 2 (see FIG. 2) has been described, but the frame shift may be Lf / 3. FIG. 8 is a schematic diagram showing the relationship between the processing section, the frame length, the frame shift, and the overlap when the frame shift is Lf / 3. FIG. 8 shows an example in which sound data is divided into pre-processing data of the (k-2) th frame, the (k-1) th frame, the kth frame, and the (k + 1) th frame. In FIG. 8, the frame shift indicates a section in which three adjacent pre-processing data temporally overlap. In the embodiment shown in FIG. 8, the frame shift is half the frame length Lf (Lf / 3). When the frame shift is Lf / 3, a 2/3 frame that is 2/3 of the frame length Lf is a processing section (overlap section).

  When the frame shift is set to Lf / 3, the processing data of the three adjacent frames are overlapped and added in the processing section (2/3 frame) to obtain the sound data S ′ as post-processing data. be able to. Therefore, the correction coefficient is calculated so that the sum of the powers of the processed data after the addition in the processing interval is equal to the value obtained by adding the sums of the powers of the three adjacent processing data before the addition in the same processing interval. A correction coefficient CC for making the sum of the powers of both data equal is obtained by equation (13).

  Further, in this example, the correction unit 117 equals the sum of the powers of the processed data after the addition in the processing interval and the sum of the powers of the three adjacent processing data before the addition in the same processing interval. In this way, the post-processing data after the addition in the processing section is corrected based on the correction coefficient CC. The post-processing data S ′ corrected (n) in the post-correction processing section is obtained by Expression (14). The correction of post-processing data in the correction unit 117 is performed for each processing section (2/3 frame in this example).

  When the frame shift is set to Lf / 3, the correction coefficient calculation unit 116 adds the sum of the amplitudes of the processed data after the addition in the processing section and a plurality of adjacent processing data before the addition in the same processing section. The correction coefficient may be calculated based on a value obtained by adding the sum of amplitudes. When the frame shift is Lf / 3, the correction coefficient CC for equalizing the sum of the amplitudes of both data is obtained by Expression (15).

  Even when the post-processing data is corrected by the correction coefficient CC obtained by the equation (15), the same effect as when the post-processing data is corrected by the correction coefficient CC for equalizing the sum of the powers of both data can be obtained. it can. Further, according to the equation (15), the calculation amount of the correction coefficient CC can be suppressed.

[Second Embodiment]
FIG. 9 is a block diagram illustrating a configuration of the imaging apparatus 1 including the data processing apparatus 100 according to the first embodiment. In FIG. 9, the same reference numerals are given to the components corresponding to the respective parts shown in FIG. 1, and the description thereof will be omitted as appropriate.

  The imaging device 1 includes an imaging unit 10, a CPU 90, an operation unit 80, an image processing unit 40, a display unit 50, a storage unit 60, a buffer memory unit 30, a communication unit 70, a microphone 21, and an A. / D conversion unit 22, sound data processing unit 23, data processing unit 110, and bus 300. In the imaging device 1, a part of the data processing unit 110 and the storage unit 60 corresponds to the data processing device 100 of the first embodiment.

  The imaging unit 10 includes an optical system 11, an imaging element 19, and an A / D conversion unit 20. The imaging unit 10 is controlled by the CPU 90 according to the set imaging conditions (for example, aperture value, exposure value, etc.). The imaging unit 10 forms an optical image by the optical system 11 on the imaging element 19 and generates image data based on the optical image converted into a digital signal by the A / D conversion unit 20.

  The optical system 11 includes a zoom lens 14, a VR lens 13, an AF lens 12, a zoom encoder 15, a lens driving unit 16, an AF encoder 17, and an image stabilization control unit 18. The optical image that has passed through the optical system 11 is guided to the light receiving surface of the image sensor 19.

  The lens driving unit 16 controls the position of the zoom lens 14 or the AF lens 12 based on a drive control signal input from a CPU 90 (described later). The image stabilization control unit 18 controls the position of the VR lens 13 based on a drive control signal input from the CPU 90. The image stabilization controller 18 may detect the position of the VR lens 13.

The zoom encoder 15 detects a zoom position representing the position of the zoom lens 14 and outputs the detected zoom position to the CPU 90. The AF encoder 17 detects a focus position representing the position of the AF lens 12 and outputs the detected focus position to the CPU 90.
The optical system 11 described above may be attached to and integrated with the imaging apparatus 1 or may be attached to the imaging apparatus 1 so as to be detachable.

  The image sensor 19 converts the optical image formed on the light receiving surface into an electrical signal and outputs the electrical signal to the A / D converter 20. In addition, the image sensor 19 uses the image data obtained when a shooting instruction is received via the operation unit 80 as shot image data of a shot still image via the A / D conversion unit 20 and the image processing unit 40. And stored in the storage medium 200. On the other hand, for example, the imaging device 19 uses continuously obtained image data as through image data through the A / D conversion unit 20 and the image processing unit 40 in a state where an imaging instruction is not received via the operation unit 80. To the CPU 90 and the display unit 50. The A / D converter 20 performs analog / digital conversion on the electronic signal converted by the image sensor 19 and outputs image data that is the converted digital signal.

  The operation unit 80 includes a power switch, a shutter button, other operation keys, and the like. The operation unit 80 receives a user operation input and outputs it to the CPU 90. The image processing unit 40 refers to the image processing conditions stored in the storage unit 160 and performs image processing on the image data recorded in the buffer memory unit 30 or the storage medium 200. The display unit 50 is configured by a liquid crystal display. The display unit 50 displays image data, an operation screen, and the like obtained by the imaging unit 10. The storage unit 60 mainly stores imaging conditions and the like. The microphone 21 collects sound and converts it into sound data corresponding to the collected sound. This sound data is analog data. The A / D converter 22 converts the sound data that is analog data converted by the microphone 21 into sound data that is digital data.

  The sound data processing unit 23 performs data processing for storing the sound data, which is digital data converted by the A / D conversion unit 22, in the storage medium 200. In addition, the sound data processing unit 23 stores a signal indicating the timing at which the operation unit operates in the storage medium 200 in association with the sound data. The signal indicating the timing at which the operation unit operates is information detected by the timing detection unit 91 (described later). The sound data stored in the storage medium 200 by the sound data processing unit 23 is, for example, for adding sound to sound data stored in association with a moving image or still images stored in the storage medium 200. The sound data of the sound recorded on the sound, the sound data of the sound recorded as a voice recorder, and the like.

  The buffer memory unit 30 temporarily stores image data picked up by the image pickup unit 10, sound data and information processed by the sound data processing unit 23, and the like. The communication unit 70 is connected to a removable storage medium 200 such as a card memory. The communication unit 70 writes, reads, or erases information to and from the storage medium 200. The storage medium 200 is a storage unit that is detachably connected to the imaging apparatus 1. The storage medium 200 stores image data generated (captured) by the imaging unit 10, sound data and information processed by the sound data processing unit 23, and the like.

  The CPU 90 controls the entire imaging apparatus 1. The CPU 90 determines the positions of the zoom lens 14 and the AF lens 12 based on, for example, the zoom position input from the zoom encoder 15, the focus position input from the AF encoder 17, and the operation input input from the operation unit 80. A drive control signal to be controlled is generated. The CPU 90 controls the positions of the zoom lens 14 and the AF lens 12 via the lens driving unit 16 based on this drive control signal. In addition, the CPU 90 includes a timing detection unit 91. The timing detection unit 91 detects the timing at which the operation unit included in the imaging device 1 operates.

  Here, the operation unit is, for example, the zoom lens 14, the VR lens 13, the AF lens 12, or the operation unit 80. That is, the operation unit is a configuration in which sound is generated (or that sound may be generated) by operating or operating among the configurations of the imaging apparatus 1.

  The timing detection unit 91 detects the timing at which the operation unit operates based on a control signal that operates the operation unit. The control signal is a control signal for controlling the operation of the operating unit, or a driving unit (for example, the lens driving unit 16, anti-vibration control) for driving the operating unit (for example, the zoom lens 14, the VR lens 13, the AF lens 12, etc.). This is a drive control signal for controlling the unit 18). The timing detection unit 91 is generated by the CPU 90 based on a drive control signal input to the lens driving unit 16 or the image stabilization control unit 18 in order to drive the zoom lens 14, the VR lens 13, or the AF lens 12. The timing at which the operating unit operates is detected based on the drive control signal. In the present embodiment, the above-described drive control signal of the zoom lens, VR lens, or AF lens is used as a signal indicating the timing at which the operation unit operates.

  Further, when the CPU 90 generates a drive control signal, the timing detection unit 91 may detect the timing at which the operation unit operates based on processing and commands executed inside the CPU 90. The timing detection unit 91 may detect the timing at which the operation unit operates based on a signal indicating that the zoom lens 14 or the AF lens 12 input from the operation unit 80 is driven. In addition, the timing detection unit 91 may detect the timing at which the operation unit operates based on a signal indicating that the operation unit has operated.

  For example, the timing detection unit 91 may detect the timing at which the operation unit operates by detecting the operation of the zoom lens 14 or the AF lens 12 based on the output of the zoom encoder 15 or the AF encoder 17. . The timing detection unit 91 may detect the timing at which the operation unit operates by detecting that the VR lens 13 has operated based on the output from the image stabilization control unit 18. Further, the timing detection unit 91 may detect the timing at which the operation unit operates by detecting that the operation unit 80 is operated based on an input from the operation unit 80. Then, the timing detection unit 91 detects the timing at which the operation unit included in the imaging device 1 operates, and outputs a signal indicating the detected timing to the sound data processing unit 23.

  The bus 300 includes an imaging unit 10, a CPU 90, an operation unit 80, an image processing unit 40, a display unit 50, a storage unit 160, a buffer memory unit 30, a communication unit 70, and a sound data processing unit 23. Connected to. The bus 300 transfers data, control signals, and the like output from the above units.

  The imaging apparatus 1 configured as described above can perform the frequency domain processing (noise reduction processing) described in the first embodiment on the sound data stored in the storage medium 200. Here, the sound data stored in the storage medium 200 may be sound data recorded and recorded by the imaging apparatus 1 or sound data recorded and recorded by another imaging apparatus. Also good.

Thereby, the imaging device 1 can suppress the environmental sound level from being lowered when the operation noise is reduced from the sound data. Therefore, the imaging device 1 can appropriately reproduce the atmosphere at the time of shooting when playing back a moving image. In addition, when the moving image is reproduced, the imaging apparatus 1 is less likely to be perceived by the user at the noise-reduced portion and does not give the user a sense of incongruity.
As described above, in the imaging device 1 according to the second embodiment, it is possible to appropriately reduce operation noise while suppressing a decrease in the level of environmental sound in the sound data.

(Deformation)
Without being limited to the embodiment described above, the present invention can be variously modified and changed as described below, and these are also within the scope of the present invention.
For example, in the above embodiment, an example in which one correction coefficient is calculated for one overlap section (processing section) has been described. However, the present invention is not limited to this, and one overlap section may be further finely divided, a correction coefficient may be calculated for each divided section, and post-process data may be corrected for each section. According to this, even when the correlation between the processing data of two adjacent frames changes in the overlap interval, the processed data can be corrected more appropriately.

  Further, the correction coefficient calculated in a plurality of overlap sections may be smoothed and the post-process data may be corrected based on the correction coefficient. According to this, since the correction coefficient can be prevented from changing suddenly in adjacent overlap sections, better sound data can be obtained.

  Further, when the correction coefficient calculated by the correction coefficient calculation unit 116 is smaller than the specified value, the correction unit 117 may not correct the processed data. That is, even if the output level of the drive control signal associated with the pre-processing data is High (a signal indicating the timing at which the operation unit operates), if the power reduction due to the frequency domain processing is small, the post-processing data By not performing correction, the processing speed can be improved.

  Further, in the correction unit 117, based on the sum of the two adjacent processing data (first sum) before addition by the addition unit 115 and the processed data added by the addition unit 115, the first The post-processing data added by the adding unit 115 may be corrected so that the sum of the two and the added post-processing data are included in a predetermined range. Here, the predetermined range is, for example, a range in which the difference between the first sum and the added processed data is ± 5%. That is, the correction unit 117 preferably corrects the difference between the first sum and the added processed data to be 0 (zero). However, the present invention is not limited to this. You may make it correct | amend with respect to the post-process data added by the addition part 115 so that the added post-process data may be included in a predetermined range.

  In the above embodiment, an example has been described in which the conversion unit 111 converts the pre-processed data into frequency domain data, and then the determination unit 112 determines whether the frame is in a section including noise. Not limited to this, the determination unit 112 first determines whether there is a frame in a section in which noise is included in the sound data, and then converts the pre-processed data of the frame divided by the conversion unit 111 into data in the frequency domain. May be.

Furthermore, in the above modification, only the pre-processing data of the frame determined by the determination unit 112 as a section in which noise is included is input to the conversion unit 111, and is determined to be a frame in a section not including noise. The pre-process data of the frame that has been processed may be input to the adder 115. For example, it is assumed that the pre _- processing data S _k-1 includes noise and the pre-processing data S _k does not include noise. In this case, of the two pre-processing data multiplied by the window function, only the pre-processing data S _k−1 is input to the conversion unit 111 and the pre-processing data S _k is input to the addition unit 115. The conversion unit 111 converts the pre-processing data S _k-1 into frequency domain data, the noise reduction unit 113 performs frequency domain processing (noise reduction processing), and the inverse conversion unit 114 further performs time domain data (processing data). S ′ _k−1 ). Then, the adder 115 adds post _- processing data S ′ _k−1 that has been subjected to frequency domain processing and pre-processing data S _k that has not been converted to frequency domain data, thereby generating post-processing data.

  Moreover, in the said embodiment, the example which determines the area containing noise based on the signal which shows the timing which the operation | movement part operated was demonstrated. However, the present invention is not limited thereto, and noise analysis processing may be performed on sound data stored in the storage medium 200 to specify a section including noise.

  Further, in the imaging device 1 of the second embodiment, the present invention is not limited to performing the frequency domain processing by the data processing unit 110 described above only on the sound data stored in the storage medium 200. For example, the imaging apparatus 1 may store the processed sound data in the storage medium 200 after performing noise reduction on the sound data collected by the microphone 21 by the data processing unit 110. That is, the imaging device 1 may perform noise reduction by the data processing unit 110 on the sound data collected by the microphone 21 in real time.

  In addition, when the sound data subjected to data processing by the data processing unit 110 is stored in the storage medium 200, the sound data may be stored in association with the image data captured by the image sensor 19 in terms of time. It may be stored as a moving image.

  Moreover, in the said embodiment, although the sound mainly produced by the operation | movement of the optical system 11 was demonstrated as noise contained in sound data, noise is not restricted to this. For example, the same applies to a sound generated when a button or the like provided on the operation unit 80 is pressed. Also in this case, a signal for detecting that a button or the like provided in the operation unit 80 is pressed is input to the timing detection unit 91 of the CPU 90. Therefore, the timing detection unit 91 can detect the timing at which the operation unit 80 or the like operates, as in the case where the optical system 11 is driven. That is, information indicating the timing at which the operation unit 80 or the like operates may be information indicating the timing at which the operation unit operates.

  In addition, the operation unit is not limited to each lens included in the optical system 11 or the operation unit 80, and may have other configurations in which sound is generated (or that sound may be generated) by operation. May be. For example, the operation unit may be a pop-up type light source (for example, a light source for photographing, a flash device (flash), etc.) that generates sound at the time of pop-up.

  Moreover, in the said embodiment, the data processing apparatus 100 or the imaging device 1 demonstrates the example which performs the process by the data processing part 110 with respect to the sound data of the sound collected by the imaging device (for example, imaging device 1). However, the processing by the data processing unit 110 may be executed on sound data of sound collected by a device other than the imaging device.

  In the second embodiment, the configuration in which the data processing apparatus 100 (data processing unit 110) is provided in the imaging apparatus 1 has been described. For example, the data processing device 100 (data processing unit 110) may be provided in another device such as a recording device, a mobile phone, a personal computer, a tablet terminal, an electronic toy, or a communication terminal. Good.

  1 and 9, the data processing unit 110 or each unit included in the data processing unit 110 may be realized by dedicated hardware, or may be realized by a memory and a microprocessor. Also good. In this case, the function may be realized by loading the data processing unit 110 or a program for realizing the function of each unit included in the data processing unit 110 into a memory and executing the program.

  Further, the data processing unit 110 in FIG. 1 or FIG. 13 or a program for realizing the function of each unit included in the data processing unit 110 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded. The processing by the data processing unit 110 or each unit included in the data processing unit 110 may be performed by being read and executed by a computer system. The “computer system” here includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in the computer system. Further, the “computer-readable recording medium” is a program that dynamically holds a program for a short time, like a communication line when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. And those that hold a program for a certain period of time, such as a volatile memory inside a computer system that becomes a server or a client in that case. The program may be for realizing a part of the above-described functions, and may be capable of realizing the above-described functions in combination with a program already recorded in the computer system.

  Moreover, although the said embodiment and modification can be used in combination suitably, since the structure of each embodiment is clear by illustration and description, detailed description is abbreviate | omitted. Furthermore, the present invention is not limited by the embodiment described above.

  1: imaging device, 100: data processing device, 110: data processing unit, 111: conversion unit, 112: determination unit, 113: noise reduction unit, 114: inverse conversion unit, 115: addition unit, 116: correction coefficient calculation unit 117: Correction unit, 120: Storage unit

Claims (12)

The first section and the second section are partially overlapped to divide the input data into the first section data and the second section data, and the first section data and the second section A first conversion unit for converting the data of
A changing unit that changes a predetermined frequency component of the data of the first section converted by the first converting unit;
A second conversion unit that converts the data of the first section changed by the change unit and the data of the second section converted by the first conversion unit into data in the time domain;
An addition unit that adds the data of the first section converted by the second conversion unit and the data of the second section converted by the second conversion unit by overlapping some sections;
A correction unit that corrects the data added by the addition unit based on the data of the first section converted by the second conversion unit and the data of the second section converted by the second conversion unit; ,
A data processing apparatus comprising: The data processing apparatus according to claim 1,
The changing unit performs a process of subtracting a predetermined frequency component from the data of the first section converted by the first conversion unit;
A data processing apparatus. The data processing apparatus according to claim 1 or 2,
The input data is associated with data indicating the timing at which the operation unit of the device storing the input data is operated,
The data of the first section is stored in association with the data indicating the timing,
The changing unit is configured to change a predetermined frequency component of data in a section associated with the data indicating the timing among the input data based on the data indicating the timing;
A data processing apparatus. A data processing device according to any one of claims 1 to 3,
The correction unit adds the data of the first section converted by the second conversion unit and the data of the second section converted by the second conversion unit before the addition by the addition unit, and the addition Comparing the data added by the adder, and correcting the data added by the adder based on the comparison result;
A data processing apparatus. A data processing apparatus according to any one of claims 1 to 4, wherein
When converting by the first conversion unit, a section obtained by overlapping a part of the first section and the second section, and when adding by the adding section, the first section and the second section The section that overlaps a part of is the same size section,
A data processing apparatus. A data processing apparatus according to any one of claims 1 to 5,
The correction unit is a sum of the data of the first section converted by the second conversion unit and the data of the second section converted by the second conversion unit before being added by the addition unit. Data added by the adder so that the first sum and the added data are included in a predetermined range based on a certain first sum and the data added to the adder Correcting,
A data processing apparatus. The data processing apparatus according to any one of claims 1 to 6,
A correction coefficient is calculated based on the sum of the powers of the data added by the adder and the sum of the powers of the data in the first section and the data in the second section before being added by the adder. A correction coefficient calculator,
The correction unit is a value obtained by adding the sum of the powers of the data added by the adding unit and the sum of the powers of the data of the first section and the data of the second section before being added by the adding unit. And correcting the data added by the adding unit based on the correction coefficient calculated by the correction coefficient calculating unit, such that
A data processing apparatus. The data processing apparatus according to any one of claims 1 to 6,
A correction coefficient calculation unit that calculates a correction coefficient based on the sum of the data added by the addition unit and the sum of the data of the first section and the data of the second section before being added by the addition section With
The correction unit has a predetermined value obtained by adding a sum of the data added by the adding unit and a sum of the data of the first interval and the data of the second interval before being added by the adding unit. Correcting the data added by the adding unit based on the correction coefficient calculated by the correction coefficient calculating unit so as to be in a range;
A data processing apparatus. The data processing device according to any one of claims 1 to 8,
The input data is associated with a signal indicating a timing at which an operation unit of the apparatus that recorded the input data is operated,
The first conversion unit divides the input data into data of the first section and data of the second section based on a signal indicating a timing at which the operation unit operates.
A data processing apparatus. The first section and the second section are partially overlapped to divide the input data into the first section data and the second section data, and the first section data is frequency domain data. A first conversion unit for converting to
A changing unit that changes a predetermined frequency component of the data of the first section converted by the first converting unit;
A second conversion unit for converting the data of the first section changed by the change unit into data of a time domain;
An adder that adds the data of the first section and the data of the second section converted by the second conversion section by overlapping some sections;
A correction unit that corrects the data added by the addition unit based on the data of the first section and the data of the second section converted by the second conversion unit;
A data processing apparatus comprising:   An imaging apparatus comprising the data processing apparatus according to claim 1. A data processing program executed on a computer,
The computer,
The first section and the second section are partially overlapped to divide the input data into the first section data and the second section data, and the first section data and the second section First conversion means for converting the data of the above into frequency domain data;
Changing means for changing a predetermined frequency component of the data of the first section converted by the first converting means;
Second conversion means for converting the data of the first section changed by the changing means and the data of the second section converted by the first conversion means into time domain data;
Adding means for adding the first section data converted by the second conversion means and the second section data converted by the second conversion means by overlapping one section;
Correcting means for correcting the data added by the adding means based on the data of the first section converted by the second converting means and the data of the second section converted by the second converting means; ,
A data processing program that makes it function.

Images