JP2011205527A - Imaging apparatus, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve reduction effect of noise, while suppressing increase of the memory capacity.SOLUTION: An optical block includes at least a zoom lens and a zoom drive mechanism and images an object to output image data of the object. A voice processing part 92 obtains voice data input from outside, and outputs it as input voice data. A plurality of zoom patterns are defined beforehand in a noise table 141, and measured data of noise is held as a noise pattern. A recognizer 121 recognizes that movement of the zoom lens corresponds to which zoom pattern among the plurality of zoom patterns. A noise pattern selector 122 selects a noise pattern corresponding to the zoom pattern according to the noise table 141. A zoom noise reduction part 123 performs zoom noise reduction processing for reducing noise from voice input from outside. The present invention is applicable to a digital video camera.

Description

  The present invention relates to an imaging apparatus, method, and program, and more particularly, to an imaging apparatus, method, and program that can improve noise reduction while suppressing an increase in memory capacity.

  Generally, when a digital camera images a subject and records moving image data obtained as a result, it can also record audio data around the subject. Note that the sound to be recorded, such as the sound around the subject, is hereinafter referred to as “target sound”. Also, the digital camera can focus or zoom the subject during imaging by moving the lens.

  However, sound generated from the digital camera during the movement of the lens, for example, driving sound of a lens device such as a zoom driving mechanism or a focus driving mechanism for driving the lens is superimposed on the target sound as noise.

  For this reason, it has been conventionally desired to reduce such noise. As a conventional technique for meeting such a demand, a technique called “spectral subtraction method” is known. (For example, refer to Patent Documents 1 and 2).

  The spectral subtraction method refers to the following method.

  That is, for a plurality of movement patterns of the lens, noise is measured in advance for each movement pattern, FFT (Fast Fourier Transform) is performed on the measured noise, and the resulting frequency domain Are stored in a predetermined table. Here, the data in the frequency domain of noise is hereinafter referred to as “noise pattern”. A table that stores a noise pattern for each movement pattern of the lens is hereinafter referred to as a “noise table”.

  When audio data with noise superimposed on the target sound is provided with such a noise table pre-recorded in the memory of the digital camera, the digital camera displays a noise pattern corresponding to the superimposed noise. Get from table. Next, the digital camera extracts the target sound data with reduced noise by subtracting the acquired noise pattern from the provided sound data in the frequency domain.

JP 2005-228400 A JP 08-2221092 A

  However, in the conventional spectral subtraction method, if the number of types of noise patterns stored in the noise table increases, the noise reduction effect increases, but the data capacity of the noise table increases, so the noise table is recorded accordingly. It is necessary to increase the memory capacity. However, an increase in memory capacity is not preferable because it leads to an increase in cost. In particular, an increase in demand for a low-end model as a digital camera is predicted. However, an increase in memory capacity that leads to an increase in cost is not preferable for such a low-end model that must be manufactured at a low cost.

  On the other hand, in the conventional spectral subtraction method, if the number of types of noise patterns stored in the noise table decreases, the data capacity of the noise table decreases. Therefore, the capacity of the memory storing the noise table must be reduced accordingly. Can do. However, the noise reduction effect is reduced accordingly.

  The present invention has been made in view of such circumstances, and is intended to improve the noise reduction effect while suppressing an increase in memory capacity.

  An imaging apparatus according to an aspect of the present invention includes at least a zoom lens and a zoom drive mechanism that drives the zoom lens, and is input from outside, an imaging unit that outputs image data of the subject by imaging the subject. Sound processing means for acquiring sound data and outputting as input sound data; and a zoom pattern in which the zoom lens driven by the zoom drive mechanism moves from a start position to an end position, the start position and the end position A plurality of zoom patterns in which the combination of the zoom driving mechanism is changed is pre-defined, and noise including the driving sound of the zoom driving mechanism is measured for each zoom pattern, and the measured noise data is stored as a noise pattern. And holding means for performing a predetermined period during which the subject is being imaged by the imaging means. When the zoom lens is driven by the zoom drive mechanism, a recognition unit that recognizes which of the plurality of zoom patterns corresponds to the movement of the zoom lens during the predetermined period, and the recognition unit recognizes A noise pattern selection unit that selects the noise pattern corresponding to the zoom pattern that has been selected from the holding unit, the noise pattern that is selected by the noise pattern selection unit, and the audio processing unit that is output during the predetermined period. Noise reduction processing means for executing zoom noise reduction processing for reducing the noise from the voice input from the outside during the predetermined period using the input voice data.

  The voice processing means outputs time-domain input voice data, and the holding means holds the actually measured voice frequency domain data as a noise pattern for each of the plurality of zoom patterns, and reduces the noise. The processing means converts the time domain input voice data output by the voice processing means during the predetermined period into frequency domain input voice data; and the frequency domain converted by the conversion means. Subtracting the noise pattern selected by the noise pattern selection means from the input voice data, and the resulting voice data with reduced noise from the voice input from the outside during the predetermined period, Subtraction processing means for outputting as noise reduction voice data in the frequency domain, and the frequency domain output from the subtraction processing means The noise reducing audio data may have an inverse conversion means for inversely converting the audio data in the time domain.

  When the zoom lens is moved according to any one of the plurality of zoom patterns by the driving of the zoom lens driving mechanism, the recognizing unit is configured such that the zoom lens has a plurality of zoom patterns in the predetermined period. By recognizing which of the patterns is moved, it is possible to recognize a zoom pattern corresponding to the movement of the zoom lens in the predetermined period.

  When the zoom lens is continuously moved by driving of the zoom lens driving mechanism, the recognizing unit indicates that the locus of movement of the zoom lens during the predetermined period belongs to any of the plurality of zoom patterns. It is possible to recognize the zoom pattern determined as belonging to the zoom pattern corresponding to the movement of the zoom lens during the predetermined period.

  The imaging unit may further include a focus lens and the focus lens driving mechanism, and the holding unit may further hold a noise pattern of noise data including a driving sound of the focus driving mechanism.

  An imaging method and program according to one aspect of the present invention are a method and program corresponding to the above-described imaging apparatus according to one aspect of the present invention.

  The imaging apparatus, method, and program according to one aspect of the present invention include at least a zoom lens and a zoom driving mechanism that drives the zoom lens, and image data of the subject is output by imaging the subject. Audio data input from the outside is acquired and output as input audio data. As a zoom pattern in which the zoom lens driven by the zoom driving mechanism moves from a start position to an end position, a plurality of zoom patterns in which combinations of the start position and the end position are changed are defined in advance, For each zoom pattern, noise including the drive sound of the zoom drive mechanism is measured, and the measured noise data is held as a noise pattern. When the zoom lens is driven by the zoom driving mechanism during a predetermined period during which the subject is being imaged, the movement of the zoom lens during the predetermined period corresponds to any of the plurality of zoom patterns. The noise pattern corresponding to the recognized zoom pattern is selected. Using the selected noise pattern and the input audio data output during the predetermined period, a zoom noise reduction process is performed to reduce the noise from the audio input from the outside during the predetermined period. The

  As described above, according to the present invention, it is possible to improve the noise reduction effect while suppressing an increase in memory capacity.

It is a figure which shows the example of an external appearance structure of the back side of the imaging device to which this invention is applied. It is a block diagram which shows the example of an internal structure of the imaging device to which this invention is applied. It is a block diagram which shows the functional structural example of the software which performs a zoom noise reduction process. It is a block diagram which shows the functional structural example of a zoom noise reduction part. It is a schematic diagram explaining zoom noise reduction processing. It is a figure explaining a fixing method. It is a figure which shows an example of a noise pattern. It is a flowchart explaining an example of an audio | voice data processing process. It is a figure explaining user operation.

[External configuration example of imaging device]
FIG. 1 is a rear view of an imaging apparatus 1 to which the present invention is applied.

  Here, the “rear surface” of the imaging apparatus 1 refers to a surface facing the front surface. The “front” refers to a surface that is directed toward the subject during imaging, that is, a surface on which a lens is provided. In the following description, a surface arranged on the upper side during photographing among the surfaces perpendicular to the back surface and the front surface is referred to as an “upper surface”.

  In the present embodiment, as illustrated in FIG. 1, the imaging device 1 is configured as a digital camera. As shown in FIG. 1, a shutter key 11 to which a function for instructing recording of image data is assigned is provided on the right side of the top surface of the imaging device 1 when viewed from the back. That is, the user instructs recording of data of the image of the imaged subject (hereinafter referred to as a captured image) by pressing the shutter key 11 when the image of the subject is captured.

  In the present embodiment, when the user instructs to record moving image data, the user presses the menu key 14 to display the menu screen on the display unit 18 of the imaging apparatus 1, and then the cross key 15 or the determination key 16. Is appropriately operated, and the moving image recording mode is selected as the operation mode of the imaging apparatus 1. In this way, when the user presses the shutter key 11 while the moving image recording mode is selected, the imaging apparatus 1 starts the process of recording moving image data, and then the shutter key 11 is pressed again. Then, the moving image data recording process is terminated.

  A zoom key 12, a screen key 13, a menu key 14, a cross key 15, a decision key 16, and a display switching key 17 are provided as operation keys in order from the upper side in FIG. ing.

  The zoom key 12 has a function of giving a telephoto instruction (that is, a subject enlargement instruction) or a wide angle instruction (that is, a subject reduction instruction) while the imaging apparatus 1 is imaging a subject. Assigned. Specifically, in the zoom key 12, a function for instructing telephoto (Tele) is assigned to the portion printed with “T”, and the wide angle (Wide) is assigned to the portion printed with “W”. ) Is assigned. Accordingly, in the zoom key 12, the portion printed with “T” is referred to as “Tele key”, and the portion printed with “W” is referred to as “Wide key”.

  The screen key 13 provided on the lower left side of the zoom key 12 is assigned a function for instructing to turn on / off the display of the display unit 18 to be described later, and the menu key 14 provided on the right side thereof is assigned with a function. A function for giving an instruction to display a menu screen is assigned.

  The following various functions are assigned to the cross keys 15 a to 15 d provided below the screen key 13 and the menu key 14. For example, when the imaging device 1 performs a focusing operation, a function for instructing to select a focus determination area from a plurality of areas set for the captured image displayed on the display unit 18 is provided on the cross keys 15a to 15d. Assigned. Here, the focus determination area refers to an area in which it is determined whether or not the imaging apparatus 1 is in focus when performing the focusing operation.

  Further, for example, a function for giving an instruction to move the cursor up, right, down, or left when the menu screen is displayed is assigned to the cross keys 15a to 15d.

  A determination key 16 provided in the center of the cross keys 15a to 15d is assigned a function for giving an instruction to select an item existing at the cursor position when a menu screen including a plurality of items is displayed. ing.

  Therefore, the user moves the cursor to a desired item by appropriately pressing the necessary keys among the cross keys 15a to 15d and the decision key 16 while the menu screen is displayed, and moves the item to the desired item. An instruction to select can be given.

  For example, a plurality of items indicating each of a plurality of zoom driving methods may be displayed on the menu screen. In such a case, the user presses the keys in any direction among the cross keys 15a to 15d as appropriate, places the cursor on the item indicating the desired zoom drive method, and then presses the enter key 16. By instructing the selection of the item, a desired zoom driving method indicated by the item can be selected. Such zoom driving methods include the following fixed method and continuous method.

  In the fixed method, several types of zoom magnifications are fixed in advance. For example, five types of fixed magnifications such as 1 × (1 ×), 1.4 ×, 2 ×, 3 ×, 4 ×, and 5 × are fixed. A zoom magnification is prepared, and a zoom lens is driven by a zoom drive mechanism according to a fixed zoom magnification.

  The continuous method refers to a method in which the zoom lens is driven by the zoom drive mechanism so that the zoom magnification continuously changes from the lower limit value to the upper limit value. At this time, in the movable range of the zoom key 12, a lower limit value of the zoom magnification is associated with a lower limit position in advance, and an upper limit value of the zoom magnification is associated with an upper limit position in advance. Specifically, for example, it is assumed that the lower limit value of the zoom magnification is equal (1 time) and the upper limit value of the zoom magnification is 5 times. In this case, for example, each position obtained by dividing the range of zoom magnification 1 to 5 into 100 is associated with each position obtained by dividing the movable range of the zoom key 12 into 100. Thus, when the continuous method is employed, each value of the zoom magnification is mapped within the movable range of the zoom key 12. The details of the zoom drive method will be described later with reference to FIGS.

  Below the cross keys 15a to 15d that are operated when selecting such a zoom drive method, a display switching key 17 to which a function for instructing switching of the display on the display unit 18 is assigned is provided.

  The operation keys provided in the imaging apparatus 1 have been described above, but the positions and types of the operation keys described above are examples. That is, the arrangement positions and types of various operation keys are not particularly limited to the above-described example.

  A display unit 18 for displaying various images is provided in the left region on the back of the imaging device 1. In addition, the display part 18 may provide a touch panel on the screen, and may receive a user's operation with a touch panel.

[Example of internal configuration of imaging device]
FIG. 2 is a block diagram illustrating an example of the internal configuration of the imaging apparatus 1 of FIG.

  The imaging apparatus 1 includes a camera unit 31, a camera DSP (Digital Signal Processor) 32, an SDRAM (Synchronous Dynamic Random Access Memory) 33, a focus determination unit 34, a control unit 35, an operation unit 36, a display control unit 37, a display unit 18, An external interface (external I / F) 38 and a recording unit 39 are provided.

  In addition, a removable recording medium 40 is attached to the imaging apparatus 1. As the recording medium 40, various recording media such as a so-called memory card using a semiconductor memory, an optical recording medium such as a DVD (Digital Versatile Disc) and a CD (Compact Disc), and a magnetic disk can be employed. A digital image signal (hereinafter referred to as image data) is recorded on the recording medium 40 in accordance with a predetermined image file format. For example, the imaging apparatus 1 compresses and encodes image data obtained as a result of imaging a subject using a JPEG (Joint Photographic Experts Group) method, and conforms to an image file format called Exif (Exchange image file format). Recording is performed on the recording medium 40 in accordance with DCF (Design Rule for Camera File system) regulations.

  The camera unit 31 includes an optical block 61, an image sensor 62, a preprocessing unit 63, an optical block driver 64, a timing signal generator 65, and an image sensor driver 66.

  The optical block 61 as an imaging unit includes a lens, a zoom driving mechanism, a focus driving mechanism, a shutter driving mechanism, an iris (iris) driving mechanism, and the like.

  As the lens, a focus lens and a zoom lens are provided. The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor 62. The zoom lens is a lens that freely changes the focal length within a certain range.

  The zoom drive mechanism drives the zoom lens forward and backward in the optical axis direction under the control of the optical block driver 64. By driving the zoom lens back and forth, the focal length changes, that is, the shooting angle of view changes, and the subject image in the image is enlarged or reduced.

  The focus driving mechanism drives the focus lens to move back and forth in the optical axis direction under the control of the optical block driver 64. The focus is adjusted by driving the focus lens back and forth.

  The shutter driving mechanism includes, for example, a shutter blade and an opening / closing mechanism that opens and closes the shutter blade under the control of the optical block driver 64. When the electronic shutter is operated, light from the subject is always incident on the image sensor 62 and the image is displayed on the display unit 18 as a through image. When the shutter key 11 is operated, a captured image at that time is captured and recorded in the SDRAM 33 and the recording medium 40.

  The aperture driving mechanism adjusts the amount of light beam incident on the image sensor 62 under the control of the optical block driver 64.

  The image sensor 62 is configured as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) type sensor. The image sensor 62 is driven by an image sensor driver 66 and performs photoelectric conversion of an optical image formed on the imaging surface via the optical block 61. That is, the subject image is incident on the image sensor 62 from the lens of the camera unit 31 via the shutter mechanism. Therefore, the image sensor 62 photoelectrically converts (photographs) the subject image at regular time intervals to accumulate image signals, and outputs the accumulated image signals to the preprocessing unit 63 as analog signals.

  The preprocessing unit 63 performs a CDS (Correlated Double Sampling) process on the analog image signal output from the image sensor 62. As a result, reset noise, 1 / f noise, thermal resistance noise, and the like are removed from the analog image signal, so that the S / N (Signal / Noise) ratio of the analog image signal can be kept good. The preprocessing unit 63 controls the gain of the analog image signal by executing an AGC (Automatic Gain Control) process. Further, the pre-processing unit 63 performs A / D (Analog / Digital) conversion processing to convert an analog image signal that has been subjected to CDS processing or AGC processing into a digital image signal, that is, image data. Output to DSP 32.

  The optical block driver 64 controls the operation of the optical block 61 by generating an optical block drive signal and outputting it to the optical block 61 under the control of the control unit 35.

  For example, although details will be described later, when the zoom key 12 is pressed, an instruction to change the zoom magnification is issued from the control unit 35 to the optical block driver 64. Here, with respect to a predetermined zoom magnification, a position of the zoom lens having a focal length corresponding to the zoom magnification (hereinafter referred to as “zoom lens position of zoom magnification”) is determined in advance. Therefore, the optical block driver 64 generates an optical block drive signal indicating the zoom lens position of the zoom magnification after the designated change, and outputs it to the zoom drive mechanism of the optical block 61. Then, the zoom drive mechanism drives the zoom lens forward and backward to the zoom lens position of the zoom magnification after change indicated by the optical block drive signal.

  The timing signal generator 65 generates a timing signal in accordance with control from the controller 35. The image sensor driver 66 generates a drive signal based on the timing signal generated by the timing signal generator 65, and drives the image sensor 62 by outputting the generated drive signal to the image sensor 62.

  The camera DSP 32 includes a camera signal processing unit 71, a compression / decompression unit 72, a resolution conversion unit 73, an SDRAM controller 74, and the like.

  The camera signal processing unit 71 performs various images such as black level correction processing, white balance (WB) processing, γ correction processing, and color correction processing on the digital image signal output from the preprocessing unit 63, that is, image data. Apply processing. Hereinafter, these image processes are collectively referred to as camera signal processing. The image data after the camera signal processing is temporarily stored in the SDRAM 33 under the control of the SDRAM controller 74.

  The compression / decompression unit 72 reads the image data after camera signal processing from the SDRAM 33 under the control of the control unit 35, and performs compression coding processing according to, for example, the JPEG method. Image data that has been subjected to compression encoding processing (hereinafter referred to as compression encoded data) is stored in the SDRAM 33 or a recording medium 40 described later.

  The compression / decompression unit 72 also reads compressed encoded data from the SDRAM 33 or a recording medium 40 described later under the control of the control unit 35, performs decompression decoding processing in accordance with, for example, the JPEG method, and the resulting image data Is appropriately supplied to the resolution conversion unit 73.

  The resolution conversion unit 73 performs resolution conversion processing on the image data after the camera signal processing and the image data obtained as a result of the expansion decoding processing by the compression / expansion unit 72, and as a result, the resolution is converted. The obtained image data is output to the control unit 35.

  The SDRAM controller 74 stores various information in the SDRAM 33 and controls reading of the various information stored in the SDRAM 33.

  The SDRAM 33 temporarily stores image data after camera signal processing. The SDRAM 33 also stores information necessary for various image processing, image display image data, and the like.

  In response to a request from the control unit 35, the focus determination unit 34 is instructed as a focus determination region from among a plurality of regions set for the captured image among the analog image signals output from the image sensor 62. The degree of focus is calculated based on the image signal of the area, and the calculation result is notified to the control unit 35.

  In the control unit 35, for example, a CPU (Central Processing Unit) 81, a flash ROM (Read Only Memory) 82, a RAM (Random Access Memory) 83, and a timer unit 84 are connected via a system bus 85. The system bus 85 is connected to a focus determination unit 34, a display control unit 37, an external I / F 38, and a recording unit 39.

  The flash ROM 82 stores various programs executed by the CPU 81, data necessary for each process, and the like. In the present embodiment, a noise table 141 described later is recorded in the flash ROM 82.

  The RAM 83 is used as a work area when the CPU 81 executes a program, or a work area for temporarily storing a result of the process. In addition, the time measuring unit 84 acquires the current date, current day of the week, current time, imaging date and time, and the like by performing a time measuring operation.

  The CPU 81 executes various controls by executing various programs stored in the flash ROM 82.

  For example, when an operation signal corresponding to a user operation is supplied from the operation unit 36, the CPU 81 causes each unit according to the operation signal from the operation unit 36 so that the operation of the imaging device 1 becomes an operation corresponding to the user operation. To control the operation.

  Specifically, for example, the CPU 81 controls the display control unit 37 and the like to display a through image on the display unit 18. The through image is a captured image corresponding to the image data currently stored in the SDRAM 33, and is an image displayed in real time on the display unit 18 even when the image data is not recorded on the recording medium 40. . For this reason, the through image is also referred to as a live view image. When the user viewing the through image presses the shutter key 11, the CPU 81 interprets that a recording instruction has been issued, and executes control to record the image data of the through image on the recording medium 40.

  Further, for example, the CPU 81 can execute so-called AF (Auto Focus) control.

  The CPU 81 can cause the display unit 18 to display a frame surrounding a plurality of regions in the through image by controlling the display control unit 37 and the like. The user operates the operation unit 36 to instruct to select a frame of an area desired to be a focus determination area from among the plurality of frames. In response to this instruction, the CPU 81 specifies the focus determination area, and requests the focus determination unit 34 to notify the focus degree in the focus determination area.

  Upon receiving the focus degree notification from the focus determination unit 34, the CPU 81 generates an optical block control signal and outputs it to the optical block driver 64.

  The optical block driver 64 generates an optical block drive signal indicating the in-focus degree instructed and outputs the optical block drive signal to the focus drive mechanism of the optical block 61. Then, the focus drive mechanism drives the focus lens back and forth until the degree of focus indicated by the optical block drive signal is reached.

  Furthermore, the CPU 81 can execute zoom control. Details of the zoom control will be described later with reference to FIG.

  The operation unit 36 is configured to include various operation keys described with reference to FIG. 1, and supplies an operation signal according to a user operation to the CPU 81 of the control unit 35.

  The display control unit 37 is connected to a display unit 18 configured using a liquid crystal display element or the like. The display control unit 37 causes the display unit 18 to display an image based on the image data by generating a display drive signal based on the image data supplied from the control unit 35 and outputting the display drive signal to the display unit 18.

  The external I / F 38 is an interface for connecting the imaging device 1 to various external devices such as a computer device and a communication module. By using the external I / F 38, for example, various types of information are supplied from a computer device, and the information is recorded on the attached recording medium 40 or the various information recorded on the attached recording medium 40. Can be supplied to a computer device. In addition, it is possible to connect to a network such as the Internet via the communication module, acquire various information through the network, and record it on the recording medium 40. Furthermore, various information recorded on the recording medium 40 can be transmitted to the intended destination via the network. The external I / F 38 is a wired interface such as IEEE (Institute of Electrical and Electronics Engineers) 1394, USB (Universal Serial Bus), or a wireless interface using light or radio waves.

  The recording unit 39 is an interface for recording various information such as image data and audio data on the recording medium 40 and reading various information such as image data and audio data recorded on the recording medium 40.

  The sound processing unit 92 acquires sound data input from the outside, performs predetermined processing, and outputs the sound data. The sound input by the microphone 91 is subjected to A / D conversion processing by the sound processing unit 92 and then supplied to the CPU 81 as sound data. Audio data that has been subjected to zoom noise reduction processing, which will be described later, in the CPU 81 is recorded on the recording medium 40 by the recording unit 39, for example. Conversely, the audio data read from the recording medium 40 is subjected to A / D conversion processing by the audio processing unit 92 and output to the speaker 93. The speaker 93 outputs sound based on the sound data supplied from the sound processing unit 92.

  The operation unit 36, the recording unit 39, the recording medium 40, the CPU 81, the flash ROM 82, the microphone 91, the audio processing unit 92, and the speaker 93 included in the dotted line frame are main components related to the noise reduction processing of the present embodiment. Is an element.

  The imaging device 1 configured in this manner displays a through image on the display unit 18 so that the user can determine the composition when performing imaging, for example. When the user viewing the through image presses the shutter key 11, the CPU 81 interprets that a recording instruction has been issued, and executes control to record the image data of the through image on the recording medium 40.

  Here, when the operation mode of the imaging apparatus 1 is the moving image recording mode, moving image data configured by arranging a plurality of frame images in a predetermined order with a through image at a predetermined time interval as a frame image. Is recorded on the recording medium 40. At this time, external sound (target sound) data is also recorded on the recording medium 40.

  Further, for example, the imaging device 1 can perform so-called AF control during imaging. That is, the imaging apparatus 1 causes the display unit 18 to display an AF frame surrounding a plurality of regions in the through image. The user operates the operation unit 36 to give an instruction to select a desired AF frame among the plurality of AF frames. In response to this instruction, the imaging apparatus 1 calculates the degree of focus using the focus determination area using the AF frame selected by the user as the focus determination area. Then, the imaging apparatus 1 performs focus adjustment by driving the focus lens back and forth in the optical axis direction based on the calculated degree of focus.

  Furthermore, the imaging device 1 can perform so-called zoom control during imaging. The user issues a zoom magnification change instruction by pressing the zoom key 12. Based on this change instruction, the imaging device 1 specifies the zoom lens position of the changed zoom magnification, and drives the zoom lens forward and backward to the specified zoom lens position.

  Here, the forward / backward drive of the zoom lens is performed based on the control of the zoom drive mechanism. Therefore, when the zoom control is executed when the operation mode of the imaging apparatus 1 is the moving image recording mode, that is, when audio data is recorded on the recording medium 40, the zoom driving mechanism is driven. A target sound on which sound or the like is superimposed as noise is input to the microphone 91. The target sound on which noise is superimposed input from the microphone 91 is input to the audio processing unit 92 as an analog audio signal and becomes audio data.

  Therefore, in the present embodiment, the imaging apparatus 1 performs processing for reducing noise (hereinafter referred to as zoom noise reduction processing) on the audio data acquired during such zoom control, and then performs recording. Recording on the medium 40.

  In the present embodiment, the content of the zoom noise reduction process changes as appropriate according to the content of zoom control at the time when noise occurs. More specifically, the noise pattern used for the zoom noise reduction process changes according to the zoom control content (ie, zoom magnification described later) at the time when the noise is generated. That is, the imaging apparatus 1 recognizes the contents of zoom control at the time when noise occurs, acquires a noise pattern according to the recognition result, and executes zoom noise reduction processing using the acquired noise pattern. A series of processing including such zoom noise reduction processing is hereinafter referred to as “audio data processing processing”. Details of the audio data processing will be described later with reference to FIG.

[Functional configuration example of software that executes zoom noise reduction processing]
FIG. 3 is a block diagram illustrating a functional configuration example of software that executes zoom noise reduction processing among software functions executed by the CPU 81 in FIG. 2.

  3 includes a recognition unit 121, a noise pattern selection unit 122, and a zoom noise reduction unit 123.

  That is, in the present embodiment, the CPU 81 can exhibit the functions of the recognition unit 121, the noise pattern selection unit 122, and the zoom noise reduction unit 123 by executing a predetermined program. In this case, various data stored in the flash ROM 82 and RAM 83 are used as appropriate.

  The recognition unit 121 recognizes the zoom magnification designated by the user by acquiring the zoom control information.

  The zoom control information is information specified based on various states when the user operates the zoom key 12. For example, in this embodiment, the zoom control information includes zoom position information according to the user's operation. , Zoom direction information, and zoom speed information.

  The zoom position information is information that can specify at least the zoom start position and end position. The zoom start position is the zoom lens position when the user starts to press the zoom key 12. Therefore, as described above, since the zoom lens position is determined according to the zoom magnification, the zoom start position differs if the zoom magnification at the start is different. For example, the zoom start position when the zoom magnification starts from a double state is different from the zoom start position when the zoom magnification starts from a quadruple state. The zoom end position is a zoom lens position when the user finishes pressing the zoom key 12 (that is, when a finger or the like is released from the zoom key 12).

  The zoom direction information is information indicating the direction from Tele to Wide or vice versa, and is information that can be specified depending on how the Tele key or Wide key constituting the zoom key 12 is pressed.

  The zoom speed information is information on the zoom lens driving speed, that is, information on the amount of movement of the zoom lens per unit time. For example, the zoom speed information is based on the above-described zoom position information and the time when the user operates the zoom key 12. It is identifiable information. Note that the zoom drive speed may vary depending on the zoom magnification.

  The recognizing unit 121 recognizes an item selected from the menu screen by operating the cross key 15 or the enter key 16 of the operation unit 36, and recognizes the user's instruction content based on the recognized item.

  For example, it is assumed that an item indicating the zoom driving method, that is, a first item indicating the fixed method and a second item indicating the continuous method are displayed on the menu screen. In this case, when the first item is selected, the recognition unit 121 recognizes that the user has selected the fixed method as the zoom drive method from the menu screen. On the other hand, when the second item is selected, the recognition unit 121 recognizes that the user has selected the continuous method as the zoom drive method from the menu screen.

  The noise pattern selection unit 122 recognizes the current zoom control zoom pattern based on the zoom magnification recognized by the recognition unit 121, and the noise pattern corresponding to the recognized zoom control zoom pattern is recorded in the flash ROM 82. Is selected from the noise table 141 as holding means.

  That is, the zoom control is control for moving the zoom lens from the zoom lens position having the first zoom magnification to the zoom lens position having the second zoom magnification. Accordingly, by using the first zoom magnification at the start of zoom control and the second zoom magnification at the end of zoom control as parameters, a plurality of zoom control zoom patterns can be defined by changing these parameters. it can. For example, when the first zoom magnification at the start of zoom control is the same magnification and the second zoom magnification at the end of zooming is 1.4 times, and when the first zoom magnification at the start of zoom control is 1. The zoom pattern is different from that in the case where the zoom magnification is 4 times and the second zoom magnification at the end of zooming is 2 times.

  In this embodiment, zoom control of a predetermined zoom pattern is executed in advance, and frequency domain data such as drive sound of the zoom drive mechanism acquired at that time is a noise pattern corresponding to the predetermined zoom pattern of zoom control. Is stored in the noise table 141. Such a noise pattern is acquired for each of a plurality of zoom patterns for zoom control and stored in the noise table 141. Accordingly, the noise pattern selection unit 122 selects a noise pattern corresponding to the current zoom pattern of the zoom control from among the plurality of noise patterns. The noise table 141 and the noise pattern will be described later with reference to FIG.

  The zoom noise reduction unit 123 serving as a noise reduction processing unit receives audio data obtained as a result of A / D conversion processing performed by the audio processing unit 92 on the audio input from the microphone 91 during zoom control. The Such audio data is hereinafter referred to as input audio data.

  The input sound data is sound data in which the drive sound of the zoom drive mechanism is included as noise with respect to the target sound. Therefore, the zoom noise reduction unit 123 performs zoom noise reduction processing using the noise pattern selected by the noise pattern selection unit 122.

  Specifically, as will be described later, the noise pattern is audio data in the frequency domain, while the input audio data is audio data in the time domain. Therefore, the zoom noise reduction unit 123 converts the input sound data into sound data in the frequency domain. Next, the zoom noise reduction unit 123 subtracts the noise pattern from the input audio data in the frequency domain. Thereby, sound data in the frequency domain for the target sound (more precisely, a sound close to the target sound) is obtained. Therefore, the zoom noise reduction unit 123 converts the frequency domain audio data of the target sound into the time domain audio data and outputs the result.

[Configuration Example of Zoom Noise Reduction Unit 123]
FIG. 4 is a block diagram illustrating a functional configuration example of the zoom noise reduction unit 123 of FIG.

  The zoom noise reduction unit 123 includes a windowed Fourier transform unit 161, a subtraction processing unit 162, and an inverse Fourier transform windowing unit 163.

  A windowed Fourier transform unit 161 serving as a transforming unit performs a windowing process for multiplying time-domain input speech data by, for example, sliding a time window function such as a Hamming window in the time axis direction. Audio data with reduced high-frequency noise is generated. Then, the windowed Fourier transform unit 161 performs FFT on the audio data in units of frames subjected to the windowing process. Thereby, input voice data (power spectrum density) in the frequency domain is obtained and provided to the subtraction processing unit 162. At this time, the input audio data in the frequency domain calculated from the windowed Fourier transform unit 161 has a power spectral density as shown in the left diagram of FIG. 5, for example.

  FIG. 5 is a schematic diagram illustrating zoom noise reduction processing.

  In FIG. 5, the vertical axis represents power, and the horizontal axis represents frequency. The left diagram of FIG. 5 represents the power spectrum density of the input speech data in the frequency domain calculated by the windowed Fourier transform unit 161, that is, the input speech data. The power spectrum density of the input sound data calculated from the windowed Fourier transform unit 161 is a combination of the power spectrum density PS of the target sound and the power spectrum density NS of the noise. That is, in the power spectrum density shown as a bar graph in the left diagram of FIG. 5, the portion represented by white is the power spectrum density PS of the target sound, and the portion represented by diagonal lines is the power spectrum density NS of noise. .

  Returning to the description of FIG. 4, the subtraction processing unit 162 uses the noise pattern (that is, the power spectrum density) provided from the windowed Fourier transform unit 161 to select the noise pattern selected by the noise pattern selection unit 122 (that is, the power spectrum density). A subtraction process for subtracting the power spectral density of noise) is executed. The noise pattern selected by the noise pattern selection unit 122 is, for example, the driving sound of the zoom driving mechanism acquired when zoom control of a predetermined zoom pattern is executed in advance as shown in the center diagram of FIG. Power spectral density. Here, for convenience of explanation, it is assumed that the noise pattern shown in the center diagram of FIG. 5 matches the power spectrum density NS of the noise represented by diagonal lines in the diagram on the left side of FIG. In this case, as a result of the subtraction processing by the subtraction processing unit 162, the power spectrum density PS of the target sound is calculated as shown in the right diagram of FIG.

  Returning to the description of FIG. 4, the inverse Fourier transform windowing unit 163 as the inverse transforming unit is the frequency domain audio data output from the subtraction processing unit 162, i.e., ideally shown in the right diagram of FIG. 5. Inverse FFT is applied to the power spectral density PS of the sound. Then, the inverse Fourier transform windowing unit 163 outputs the sound data in the time domain obtained as a result of the inverse FFT, after performing the inverse windowing process. The time domain audio data output from the inverse Fourier transform windowing unit 163 is recorded on the recording medium 40 by the recording unit 39 as audio data of the target sound whose noise component is suppressed by the zoom noise reduction unit 123. The audio data of the target sound read from the recording medium 40 is subjected to A / D conversion processing by the audio processing unit 92 and converted to an analog audio signal, and noise is further suppressed by the speaker 93. The target sound is output to the outside.

  In this way, the zoom noise reduction unit 123 performs zoom noise reduction processing on the input sound data when the sound data of the sound in which the noise is superimposed on the target sound is input as the input sound data. Thereby, ideally, sound data of the target sound from which noise is removed can be obtained. Note that the reason why it is described as ideal is that the data (power spectrum density) in the frequency domain of noise that is actually superimposed does not necessarily completely match the noise pattern (power spectrum density). That is, if the two match completely, the noise is completely removed, but generally there is a difference between the two, so the noise is not completely removed, but the noise is reduced. become.

[Fixed zoom drive system]
FIG. 6 is a diagram for explaining a fixed method among the zoom drive methods.

  As described above, the zoom driving method includes the fixed method and the continuous method. In this embodiment, the user can select a desired zoom driving method by operating the operation unit 36.

  In the present embodiment, when the user selects the fixed method as the zoom drive method, zoom control is executed according to the fixed methods in which the zoom magnification at the time of moving image recording is fixed to the five types shown in FIG.

  In FIG. 6, the upper left diagram shows a through image 201 displayed on the display unit 18 when the subject 181 is imaged at the same zoom magnification (1 ×) when recording a moving image.

  When the user presses the Tele key while the zoom magnification is equal, the zoom magnification is switched from equal magnification to 1.4 times. Then, under the control of the optical block driver 64, the zoom drive mechanism moves the lens to a 1.4 × zoom lens position. As a result, the through image 201 was displayed on the display unit 18 before the switching, but after the switching, the through image 202 in which the size of the subject is enlarged by 1.4 times is displayed on the display unit 18. .

  6 shows a through image 202 displayed on the display unit 18 when the subject 181 is imaged at a zoom magnification of 1.4 when recording a moving image. At this time, “× 1.4” indicating that the zoom magnification is 1.4 times is displayed in the upper left display area of the display unit 18.

  When the user further presses the Tele key in a state where the zoom magnification is 1.4 times, the zoom magnification is switched from 1.4 times to 2 times. Then, based on the control of the optical block driver 64, the zoom drive mechanism moves the lens to the double zoom lens position. As a result, the through image 202 is displayed on the display unit 18 before switching, but the through image 203 in which the size of the subject is doubled is displayed on the display unit 18 after switching.

  The upper right diagram in FIG. 6 shows a through image 203 displayed on the display unit 18 when the subject 181 is imaged at a zoom magnification of 2 when recording a moving image. At this time, “× 2.0” indicating that the zoom magnification is double is displayed in the upper left display area of the display unit 18.

  Similarly, every time the user presses the Tele key while the zoom magnification is 2 times, the zoom magnification is switched from 2 times to 3 times, 3 times to 4 times, 4 times to 5 times. Then, based on the control of the optical block driver 64, the zoom drive mechanism moves the lens from the double zoom lens position to the triple zoom lens position, from the triple zoom lens position to the quad zoom lens position, and the quad zoom lens. The zoom lens is moved from the position to the zoom lens position 5 times. The display on the display unit 18 is shown in the through image 203 shown in the upper right diagram of FIG. 6, the through image 204 shown in the lower left diagram, the through image 205 shown in the lower middle diagram, and the lower right diagram. It changes to a through image 206. At this time, “× 3.0”, “× 4.0”, “× 5.0” indicating that the zoom magnification is 3 ×, 4 ×, or 5 × is displayed in the upper left display area of the display unit 18. Is displayed. Even if the user further presses the Tele key in a state where the zoom magnification is 5 times, the zoom magnification does not increase any more.

  On the other hand, when the user presses the Wide key in a state where the zoom magnification is 5 times, the zoom magnification is switched from 5 times to 4 times. Similarly, every time the user presses the Wide key from the state where the zoom magnification is 4 times, the zoom magnification is switched to 3 times, 2 times, 1.4 times, or 1 time. Each time the zoom magnification is switched in this way, the zoom drive mechanism moves the zoom lens to the zoom lens position of the switched zoom magnification based on the control of the optical block driver 64. The display on the display unit 18 changes from a through image 206 shown in the lower right diagram of FIG. 6 to a through image 205, a through image 204, a through image 203, a through image 202, and a through image 201. At this time, a display indicating the zoom magnification is displayed in the upper left display area of the display unit 18. Note that even if the user further presses the Wide key in the state where the zoom magnification is equal, the zoom magnification does not decrease any further.

  On the other hand, when the user selects the continuous method as the zoom drive method, the zoom magnification changes within a range of, for example, 0.1 between 1 and 5 times according to the pressed state of the zoom key 12. For example, when the user presses the Tele key while the zoom magnification is the same magnification, the zoom magnification is 1.1 times, 1.2 times, 1.3 times, etc., until the user releases the Tele key. Change. Then, under the control of the optical block driver 64, the zoom drive mechanism moves the lens to the zoom lens position with the corresponding zoom magnification. As a result, a through image in which the size of the subject 181 is enlarged to the corresponding zoom magnification is displayed on the display unit 18. Even if the user continues to press the Tele key while the zoom magnification is 5 times, the zoom magnification does not increase any further. On the other hand, when the user presses the Wide key when the zoom magnification is 5 times, the zoom release is 5 times, 4.9 times, 4.8 times, etc., and the user cancels the pressing of the Wide key. Change to. Then, under the control of the optical block driver 64, the zoom drive mechanism moves the lens to the zoom lens position with the corresponding zoom magnification. As a result, a through image in which the size of the subject 181 is reduced to the corresponding zoom magnification is displayed on the display unit 18. Note that even if the user continues to press the Wide key while the zoom magnification is equal, the zoom magnification does not decrease any further. Even when the continuous method is selected as the zoom drive method, the corresponding zoom magnification is displayed in the upper left area of the display unit 18.

[Noise pattern example]
FIG. 7 is a diagram illustrating an example of noise patterns stored in the noise table 141.

  In the present embodiment, as described above, the movable range of the zoom magnification becomes clear by fixing the five types of zoom magnification. As a result, the noise patterns stored in the noise table 141 can also be limited to the following ten types of noise patterns N1 to N10.

  That is, with the noise pattern N1, the zoom magnification is switched from the same magnification to 1.4 times, and the lens has the zoom magnification from the same magnification zoom lens position where the zoom magnification is the start position to the end position where the zoom magnification is 1.4. This refers to audio data (spectral density) in the frequency domain of noise actually generated before moving to the double zoom lens position. That is, the noise pattern N1 is a noise pattern corresponding to zoom control of the zoom pattern in which the zoom magnification is switched from the same magnification to 1.4 times.

  The noise pattern N2 is that the zoom magnification is switched from 1.4 times to 2 times, and the lens is doubled from the zoom lens position of 1.4 times where the zoom magnification is the start position to 2 times where the zoom magnification is the end position. This refers to audio data (spectral density) in the frequency domain of noise actually generated before moving to the zoom lens position. That is, the noise pattern N2 is a noise pattern corresponding to zoom control of the zoom pattern in which the zoom magnification is switched from 1.4 times to 2 times.

  Similarly, the noise pattern N3 is a noise pattern corresponding to zoom control of the zoom pattern in which the zoom magnification is switched from 2 times to 3 times, and the noise pattern N4 is from 3 times where the zoom magnification is the start position. This is a noise pattern corresponding to the zoom control of the zoom pattern that is switched to the end position of 4 times, and the noise pattern N5 is a zoom that the zoom magnification is switched from the start position of 4 times to the end position of 5 times. This is a noise pattern corresponding to pattern zoom control.

  In addition, with respect to the noise patterns N1 to N5 corresponding to the zoom pattern in which the zoom magnification is switched from Wide to Tele, the noise pattern corresponding to the zoom pattern in which the opposite direction is switched from Tele to Wide is as follows: It can be limited to the following five types of noise patterns. That is, the noise pattern N6 corresponding to the zoom control of the zoom pattern that the zoom magnification is switched from 5 times that is the start position to 4 times that is the end position, and 4 times that the zoom magnification is the start position to 3 times that is the end position The noise pattern N7 corresponding to the zoom control of the zoom pattern that can be switched to, the noise pattern N8 that corresponds to the zoom control of the zoom pattern that the zoom magnification can be switched from 3 times the start position to 2 times the end position, and the zoom magnification The noise pattern N9 corresponds to zoom control of the zoom pattern that is switched from the start position of 2 times to the end position of 1.4 times, and the zoom magnification is 1.4 times from the start position to the end position. Noise pattern N1 corresponding to zoom control of the zoom pattern to be switched to It can be limited to five.

  That is, the zoom magnification is divided into 10 types within the range between the upper limit value and the lower limit value of the zoom magnification, and the lens moves within each of these 10 types of zoom magnification division ranges. Zoom control of the zoom pattern is defined. Then, noise patterns corresponding to each of these ten types of zoom patterns are stored in the noise table 141 as noise patterns N1 to N10.

  Note that as the noise patterns N1 to N10, audio data in the frequency domain of only the driving sound of the zoom driving mechanism may be employed. However, the input audio data that is actually input includes not only the drive sound of the zoom drive mechanism, but also the drive start sound and drive end sound of the zoom drive mechanism, the drive sound of the focus drive mechanism that is other lens device drive sound, etc. Is also included as noise. Therefore, in this embodiment, the lens is actually driven to drive the focus drive mechanism, which is not only the drive sound of the zoom drive mechanism, but also the drive start sound and drive end sound of the zoom drive mechanism, and other lens device drive sounds. Audio data in the frequency domain such as sound is acquired and used as a noise pattern.

[Audio data processing]
FIG. 8 is a flowchart for explaining an example of the audio data processing.

  The audio data processing is executed when the shutter key 11 is pressed to instruct the start of moving image recording. In FIG. 8, for the sake of simplicity of explanation, it is assumed that the Wide key is pressed as the zoom key 12. However, it goes without saying that the corresponding processing is executed even when the Tele key is pressed.

  In step S <b> 1, the recognition unit 121 determines whether the Wide key that is the zoom key 12 is pressed.

  If the Wide key is not pressed, NO is determined in step S1, the process returns to step S1, and the subsequent processes are repeated. That is, the determination process of step S1 is repeated until the Wide key is pressed.

  Thereafter, when the Wide key is pressed, it is determined as YES in Step S1, and the process proceeds to Step S2.

  In step S2, the recognition unit 121 recognizes the current zoom magnification by acquiring the zoom control information.

  In step S3, the recognition unit 121 controls the display control unit 37 to display the current zoom magnification acquired in step S2 in the upper left area of the display unit 18 (see FIG. 6).

  In step S4, the recognition unit 121 determines whether the fixed method is selected as the zoom drive method. That is, as described above, the user presses the necessary keys among the cross keys 15a to 15d and the determination key 16 to display items indicating the fixed method and the continuous method displayed on the menu screen. A desired item can be selected from the items.

  For example, when the item indicating the continuous method is selected, the recognition unit 121 recognizes that the continuous method is selected. In this case, it is determined as NO in Step S4, and the process proceeds to Step S8. However, the processing after step S8 will be described later.

  On the other hand, when the item indicating the fixed method is selected, the recognition unit 121 recognizes that the fixed method is selected. In this case, it is determined as YES in Step S4, and the process proceeds to Step S5.

  In step S <b> 5, the noise pattern selection unit 122 corresponds to the zoom magnification recognized by the recognition unit 121 from among the noise patterns N <b> 6 to N <b> 10 corresponding to the zoom pattern that is switched from Tele to Wide in the noise table 141. Select the noise pattern to be used.

  In step S6, the zoom noise reduction unit 123 performs zoom noise reduction processing using the noise pattern selected by the noise pattern selection unit 122 in step S5. That is, the zoom noise reduction unit 123 converts the input audio data from the time domain format to the frequency domain format. Next, the zoom noise reduction unit 123 subtracts the noise pattern selected by the noise pattern selection unit 122 in the process of step S5 from the input audio data in the frequency domain. As a result, audio data in the frequency domain with reduced noise is obtained. Therefore, the zoom noise reduction unit 123 converts the audio data with the noise reduced in this way from the frequency domain form to the time domain form and outputs the converted data.

  In step S7, the recognizing unit 121 determines whether the end of moving image recording is instructed. That is, the recognition unit 121 determines whether the shutter key 11 has been pressed again to instruct the end of the already started moving image recording.

  If the end of moving image recording is not instructed, it is determined as NO in step S7, the process returns to step S1, and the subsequent processes are repeated. That is, until the end of moving image recording is instructed, the loop processing of steps S1 to S7 is repeated.

  Thereafter, when the end of moving image recording is instructed, the audio data processing ends.

  For example, when the user presses the Wide key in a state where the zoom magnification is 5 times, the zoom magnification is switched to 4 times. At this time, it is determined as YES in the process of step S1, and the process of step S2 is executed. That is, the recognition unit 121 recognizes that the zoom magnification has been switched from 5 times to 4 times by acquiring the zoom control information, and causes the display unit 18 to display the zoom magnification. Here, when the fixed method is selected as the zoom drive method, it is determined YES in the process of step S4, and the process of step S5 is executed. That is, the noise pattern selection unit 122 corresponds to the noise pattern N6 to N10 corresponding to the zoom pattern switched from Tele to Wide direction stored in the noise table 141 based on the zoom magnification recognized by the recognition unit 121. A noise pattern N6 of 5 to 4 times is selected. In step S6, the zoom noise reduction unit 123 performs zoom noise reduction processing on the input audio data supplied from the audio processing unit 92 using the noise pattern N6 selected by the noise pattern selection unit 122. Execute. Thereafter, if the end of moving image recording is not instructed, the process returns to step S1, and the determination process of step S1 is repeated until the zoom key 12 is pressed again, and the audio data processing process enters a standby state.

  Thereafter, when the user further presses the Wide key, the zoom magnification is switched from 4 times to 3 times. At this time, it is determined as YES in the process of step S1, and the process of step S2 is executed. That is, the recognition unit 121 recognizes that the zoom magnification has been switched from 4 times to 3 times by acquiring the zoom control information, and causes the display unit 18 to display the zoom magnification. Here, when the fixed method is selected as the zoom drive method, it is determined YES in the process of step S4, and the process of step S5 is executed. That is, the noise pattern selection unit 122 corresponds to the noise pattern N6 to N10 corresponding to the zoom pattern switched from Tele to Wide direction stored in the noise table 141 based on the zoom magnification recognized by the recognition unit 121. The noise pattern N7 of 4 to 3 times is selected. In step S6, the zoom noise reduction unit 123 performs zoom noise reduction processing on the input audio data supplied from the audio processing unit 92 using the noise pattern N7 selected by the noise pattern selection unit 122. Execute. Then, when the shutter key 11 is pressed again to instruct the end of moving image recording, the audio data processing process ends.

  The audio data processing process when the fixed method is selected as the zoom drive method has been described above.

  Next, the audio data processing when the continuous method is selected as the zoom drive method will be described.

  That is, as described above, the user appropriately presses the necessary keys among the cross keys 15a to 15d and the determination key 16 to display items indicating the fixed method and items indicating the continuous method displayed on the menu screen. The desired item can be selected.

  FIG. 9 is a diagram illustrating a user operation for selecting an item indicating a continuous method.

  The left diagram of FIG. 9 shows a state in which a “zoom driving method” selection menu, which is one menu of the “camera setting menu”, is displayed as the menu screen 221 displayed on the display unit 18.

  As shown in the menu screen 221, the zoom drive method is set to a fixed method as a default here. In addition, the indication “fixed” in the drawings indicates a fixed method.

  In this state, it is assumed that the user desires to select the continuous method as the zoom drive method. In this case, the user depresses a necessary key among the cross keys 15a to 15d to move the cursor to an item displayed as “zoom driving method” and depresses the decision key 16. Then, the display state of the display unit 18 transitions to the display state shown in the center diagram of FIG.

  The center diagram of FIG. 9 shows a state in which items of a fixed method and a continuous method are displayed as two methods of “zoom driving method” on the menu screen 222 displayed on the display unit 18. In addition, the indication “continuous” in the drawings indicates a continuous method. The user depresses a necessary key among the cross keys 15a to 15d as appropriate, thereby moving the cursor to the item displayed as “continuous” and depressing the decision key 16. Then, the display state of the display unit 18 changes to the display state shown in the right diagram of FIG.

  As shown in the menu screen 223 on the right side of FIG. 9, the zoom driving method is set to the continuous method.

  Thus, when the item “continuous” is selected by the user, as described above, it is determined as NO in step S4, and the process proceeds to step S8.

  In step S8, the noise pattern selection unit 122 includes the zoom magnification value recognized by the recognition unit 121 in the process of step S2 from the noise patterns N6 to N10 in the Tele to Wide direction stored in the noise table 141. Select the noise pattern to be used.

  In step S9, the zoom noise reduction unit 123 performs zoom noise reduction processing using the noise pattern selected by the noise pattern selection unit 122 in step S8. That is, the zoom noise reduction unit 123 converts the input audio data from the time domain format to the frequency domain format. Next, the zoom noise reduction unit 123 subtracts the noise pattern selected by the noise pattern selection unit 122 from the input audio data in the frequency domain. As a result, audio data in the frequency domain with reduced noise is obtained. Therefore, the zoom noise reduction unit 123 converts the audio data with the noise reduced in this way from the frequency domain form to the time domain form and outputs the converted data.

  In step S10, the recognition unit 121 determines whether the zoom key 12 is continuously pressed.

  If the zoom key 12 continues to be pressed, it is determined as YES in step S10, the process returns to step S2, and the subsequent processes are repeated. That is, the loop process of steps S2 to S10 is repeated while the zoom key 12 is continuously pressed.

  After that, when the user releases the zoom key 12 and the pressing of the zoom key 12 is released, for example, it is determined NO in step S10, and the process proceeds to step S7.

  In step S7, the recognizing unit 121 determines whether the end of moving image recording is instructed.

  If the end of moving image recording is not instructed, it is determined as NO in step S7, the process returns to step S1, and the subsequent processes are repeated. That is, until the end of the moving image recording is instructed, the loop processing of steps S1 to S10 is repeated.

  Thereafter, when the end of moving image recording is instructed, the audio data processing ends.

  For example, assume that the user presses the Wide key in a state where the zoom magnification is 5 times, and the zoom magnification is switched to 4.5 times. At this time, the recognition unit 121 recognizes that the zoom magnification has been switched from 5 times to 4.5 times by acquiring the zoom control information, and causes the display unit 18 to display the zoom magnification. Then, the noise pattern selection unit 122 selects four of the noise patterns N6 to N10 corresponding to the zoom pattern that is switched from the Tele stored in the noise table 141 to the Wide direction based on the zoom magnification recognized by the recognition unit 121. A noise pattern N6 of 5 to 4 times including a value of 5 times is selected. That is, when the zoom drive method is the continuous method, a noise pattern in which the recognized zoom magnification value is included in the range is selected. Then, the zoom noise reduction unit 123 performs zoom noise reduction processing on the input audio data supplied from the audio processing unit 92 using the noise pattern N6 selected by the noise pattern selection unit 122.

  Thereafter, it is assumed that the user continues to press the Tele key while the zoom magnification is 4.5 times, and the zoom magnification is switched to 3.1 times. At this time, the recognition unit 121 recognizes that the zoom magnification has been switched from 4.5 times to 3.1 times by acquiring the zoom control information, and causes the display unit 18 to display the zoom magnification. Then, based on the zoom magnification recognized by the recognition unit 121, the noise pattern selection unit 122 selects 3 of noise patterns N6 to N10 corresponding to the zoom pattern that is switched from the Tele stored in the noise table 141 to the Wide direction. Select a noise pattern N7 that is 4 to 3 times inclusive and includes a value of 1 times. Then, the zoom noise reduction unit 123 performs zoom noise reduction processing on the input audio data supplied from the audio processing unit 92 using the noise pattern N7 selected by the noise pattern selection unit 122. When the zoom key 12 is no longer pressed and the shutter key 11 is pressed again to instruct the end of moving image recording, the audio data processing process ends.

  Thus, by fixing the five types of zoom magnifications, it is possible to limit the noise patterns stored in the noise table 141 to the ten types of noise patterns N1 to N10. Therefore, the memory capacity for recording the noise table 141 can be kept below a certain level. Further, by executing the zoom noise reduction process using the noise table 141 recorded in a memory capacity below a certain level, a noise reduction effect can be achieved above a certain level.

  In the present embodiment, the noise patterns N1 to N10 are not only the drive sound of the zoom drive mechanism, but also the drive start sound and drive end sound of the zoom drive mechanism, and the drive sound of the focus drive mechanism, which are other lens device drive sounds. And the like are the frequency domain audio data obtained as a result of collecting the noise together. However, the noise pattern is not particularly limited to these, and audio data in a frequency region of noise other than the driving sound of the zoom driving mechanism may be stored separately or simultaneously in the noise table 141 as another noise pattern. Good. Even in this case, since the data capacity of the noise patterns N1 to N10 for the driving sound of the zoom drive mechanism does not change, the memory capacity for storing the noise patterns N1 to N10 in the noise table 141 is constant. Therefore, another noise pattern for the sound other than the drive sound of the zoom drive mechanism can be added to the noise table 141 and stored by the amount of free memory. In this case, the noise reduction processing can be executed by distinguishing between the driving sound of the zoom drive mechanism and the others, so that the noise reduction effect can be further enhanced.

  The present invention can be applied to an imaging apparatus having an imaging function, an optical zoom function, and a recording function for recording audio data input at the time of imaging, such as a digital video camera, in addition to a digital camera.

[Application of the present invention to a program]
The series of processes described above can be executed by hardware or can be executed by software.

  When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, a general-purpose personal computer is installed from a network or a recording medium.

  As shown in FIG. 2, the recording medium including such a program is distributed to provide a program to the user separately from the apparatus main body, and a magnetic disk (including a floppy disk) on which the program is recorded. It is not only composed of a recording medium 40 such as an optical disk (including CD-ROM (compact disk-read only memory) and DVD), a magneto-optical disk (including MD (mini-disk)), or a semiconductor memory. The program includes a flash ROM 82 in which a program is recorded, a hard disk included in the recording unit 39, and the like provided to the user in a state of being preinstalled in the apparatus main body.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the order, but is not necessarily performed in chronological order, either in parallel or individually. The process to be executed is also included.

  DESCRIPTION OF SYMBOLS 1 Imaging device, 12 Zoom key, 15 Cross key, 16 Determination key, 18 Display part, 36 Operation part, 39 Recording part, 40 Recording medium, 61 Optical block, 81 CPU, 82 Flash ROM82, 91 Microphone, 92 Audio | voice processing part, 93 speakers, 121 recognition unit, 122 noise pattern selection unit, 123 zoom noise reduction unit, 141 noise table, 161 windowed Fourier transform unit, 162 subtraction processing unit, 163 inverse Fourier transform windowing unit

Claims (7)

An imaging unit that includes at least a zoom lens and a zoom drive mechanism that drives the zoom lens, and outputs image data of the subject by imaging the subject;
Audio processing means for acquiring audio data input from the outside and outputting as input audio data;
As a zoom pattern in which the zoom lens driven by the zoom driving mechanism moves from a start position to an end position, a plurality of zoom patterns in which combinations of the start position and the end position are changed are defined in advance, For each zoom pattern, noise including the driving sound of the zoom drive mechanism is measured, and holding means for holding the measured noise data as a noise pattern;
When the zoom lens is driven by the zoom drive mechanism during a predetermined period during which the subject is being imaged by the imaging unit, the movement of the zoom lens during the predetermined period is the movement of a plurality of the zoom patterns. A recognition means for recognizing which one of them,
Noise pattern selection means for selecting the noise pattern corresponding to the zoom pattern recognized by the recognition means from the holding means;
Using the noise pattern selected by the noise pattern selection unit and the input voice data output from the voice processing unit during the predetermined period, the voice input from the outside during the predetermined period An image pickup apparatus comprising: a noise reduction processing unit that executes zoom noise reduction processing for reducing noise. The voice processing means outputs time-domain input voice data,
The holding means holds, as a noise pattern, data on the frequency domain of actually measured sound for each of the plurality of zoom patterns,
The noise reduction processing means includes
Conversion means for converting the time domain input voice data output by the voice processing means during the predetermined period into frequency domain input voice data;
The noise pattern selected by the noise pattern selection unit is subtracted from the input voice data in the frequency domain converted by the conversion unit, and the result is obtained from the audio input from the outside during the predetermined period. Subtraction processing means for outputting the noise-reduced audio data as noise-reduced audio data in the frequency domain;
Inverse conversion means for inversely converting the frequency domain noise-reduced voice data output from the subtraction processing means into time domain voice data;
The imaging device according to claim 1, comprising: When the zoom lens is moved according to any one of the plurality of zoom patterns by the driving of the zoom lens driving mechanism, the recognizing unit is configured such that the zoom lens has a plurality of zoom patterns in the predetermined period. The imaging apparatus according to claim 2, wherein a zoom pattern corresponding to the movement of the zoom lens during the predetermined period is recognized by recognizing which of the patterns is moved. When the zoom lens is continuously moved by driving of the zoom lens driving mechanism, the recognizing unit indicates that the locus of movement of the zoom lens during the predetermined period belongs to any of the plurality of zoom patterns. The imaging apparatus according to claim 2, wherein the zoom pattern that is determined as belonging to the zoom pattern is recognized as a zoom pattern corresponding to movement of the zoom lens during the predetermined period. The imaging means further includes a focus lens and the focus lens driving mechanism,
The imaging apparatus according to claim 3, wherein the holding unit further holds a noise pattern of noise data including a driving sound of the focus driving mechanism. An imaging step that includes at least a zoom lens and a zoom drive mechanism that drives the zoom lens, and outputs image data of the subject by imaging the subject;
An audio processing step of acquiring audio data input from the outside and outputting as input audio data;
As a zoom pattern in which the zoom lens driven by the zoom driving mechanism moves from a start position to an end position, a plurality of zoom patterns in which combinations of the start position and the end position are changed are defined in advance, For each zoom pattern, the noise including the driving sound of the zoom drive mechanism is measured, and a holding step for holding the measured noise data as a noise pattern;
When the zoom lens is driven by the zoom driving mechanism during a predetermined period during which the subject is being imaged by the processing of the imaging step, the movement of the zoom lens during the predetermined period is a plurality of the zooms. A recognition step for recognizing which of the patterns corresponds;
A noise pattern selection step of selecting the noise pattern corresponding to the zoom pattern recognized by the processing of the recognition step from the noise pattern held by the processing of the holding step;
The audio input from the outside during the predetermined period using the noise pattern selected by the processing of the noise pattern selection step and the input audio data output from the audio processing step during the predetermined period A noise reduction processing step for executing a zoom noise reduction process for reducing the noise. Including at least a zoom lens and a zoom drive mechanism for driving the zoom lens, and outputting image data of the subject by imaging the subject;
Acquires audio data input from outside and outputs it as input audio data.
As a zoom pattern in which the zoom lens driven by the zoom driving mechanism moves from a start position to an end position, a plurality of zoom patterns in which combinations of the start position and the end position are changed are defined in advance, For each zoom pattern, noise including the driving sound of the zoom drive mechanism is measured, and the measured noise data is held as a noise pattern.
When the zoom lens is driven by the zoom driving mechanism during a predetermined period during which the subject is being imaged, the movement of the zoom lens during the predetermined period corresponds to any of the plurality of zoom patterns. Recognizes what to do,
Selecting the noise pattern corresponding to the recognized zoom pattern from the retained noise pattern;
Using the selected noise pattern and the input audio data output during the predetermined period, a zoom noise reduction process is performed to reduce the noise from the audio input from the outside during the predetermined period. A program for causing a computer to execute control processing including steps.

Images