JP2006217111A - Moving image photographing apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera device capable of sound recording suitable for a photographic environment in photographing a moving image with sound, and a method of photographing moving images with sound. <P>SOLUTION: A plurality of items of video recording setting information (bit rate target values, sampling rates, digital filter set values, stereo effects values and follow-up time values) corresponding to a plurality of video recording scenes (a)-(c) for moving images are recorded in advance. In photographing moving images with sound, a user is induced to designate any desired one of recording scenes (a)-(c) and video recording at the time of photographing is controlled on the basis of the recording setting information corresponding to the designated video recording scene. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a moving image shooting apparatus and a moving image shooting method suitable for use in a digital camera having a moving image shooting function with sound.

2. Description of the Related Art Conventionally, in a digital camera, a large number of sample images exemplifying shooting results based on shooting conditions different from each other are prepared in advance, and a shooting scene similar to a subject to be shot from now on or an atmosphere according to preference You can select shooting scenes via sample images and perform shooting operations in various shooting modes that automatically set shooting conditions such as shutter speed, aperture value, and color balance corresponding to the selected shooting scene. A device having a function to be performed (hereinafter referred to as a best shot photographing function) is known in Japanese Patent Application Laid-Open Publication No. 2003-260, and has been put into practical use.
JP 2002-10133 A

  On the other hand, many recent digital cameras have a moving image shooting function, and it is preferable that the digital camera has a best shot function for moving image shooting as well as still image shooting. However, it is common for a movie to be accompanied by recording of normal audio. In that case, just by setting the image only by scene selection like the best shot function for still images, In the case of taking a video with attached, there was a problem that it was not possible to record the sound suitable for the video.

  The present invention has been made in view of such a conventional problem, and provides a camera device and a moving image recording method with sound capable of performing sound recording suitable for a shooting environment at the time of moving image recording with sound. For the purpose.

  In order to solve the above-mentioned problems, in the first aspect of the present invention, in the moving image photographing apparatus for photographing and recording a moving image with sound, the recording shows the processing contents related to the sound recording processing at the time of photographing the moving image. Recording setting storage means for storing recording setting information corresponding to a predetermined shooting mode that is specified by the user as appropriate for use, and the moving image for which use of the predetermined shooting mode is specified by the user It is provided with setting means for setting processing contents related to recording of sound in image shooting based on recording setting information stored in the recording setting storage means.

  In such a configuration, when shooting a moving image for which use of a predetermined shooting mode is specified by the user, processing related to recording of audio based on recording setting information stored in advance corresponding to the shooting mode. Is done.

  According to the second aspect of the present invention, there is recording setting information indicating processing contents related to image recording at the time of shooting the moving image, and a plurality of recording setting information corresponding to the plurality of shooting modes. A recording setting storage unit that is stored; and a control unit that allows a user to select one of the plurality of shooting modes. The recording setting storage unit includes a plurality of recordings corresponding to the plurality of shooting modes. Setting information is recorded, and the setting unit stores processing contents related to image recording in the recording setting storage unit when shooting the moving image in the shooting mode selected by the control unit by the user. Set based on the recording setting information corresponding to the shooting mode, and the processing contents related to the recording of the sound are stored in the shooting mode stored in the recording setting storage unit. It was assumed to have been set based on the recording setting information to respond.

  Further, in the invention of claim 3, there is provided scene information storage means each storing a plurality of scene information corresponding to each of the plurality of shooting modes, each of which represents a specific moving image shooting target, and the control means A plurality of scene information stored in the scene information storage means is displayed on the screen so as to be selectable, and the user is allowed to select one of the plurality of shooting modes via the scene information displayed on the screen. did.

  According to a fourth aspect of the present invention, the recording setting information includes a follow-up time until the amplification based on the final amplification degree for the input voice is completed as the processing contents related to the voice recording. It was.

  In the invention of claim 5, the recording setting information includes the presence / absence of use of a filter for the purpose of removing wind noise included in the input sound.

  In the invention of claim 6, the imaging means for imaging the subject and whether or not one or a plurality of predetermined image information included in the subject image captured by the imaging means meets a predetermined determination condition. And a recording control unit for performing a recording process related to recording of sound having contents corresponding to a determination result by the determination unit in a predetermined shooting mode. And further provided.

  According to a seventh aspect of the present invention, in the moving image photographing method for photographing and recording a moving image with sound, the processing contents related to the sound recording at the time of photographing the moving image are shown, and in a predetermined photographing environment. Recording setting information corresponding to a predetermined shooting mode assumed to be used in advance is stored in advance, and processing contents related to recording of audio during shooting of the moving image in the predetermined shooting mode are stored in the recording setting. The setting method is based on the recording setting information stored in the storage means.

  In the invention of claim 8, use of a predetermined shooting mode in which a computer included in a moving image shooting apparatus for shooting and recording a moving image with sound is assumed to be used in a predetermined shooting environment by a user. A program for functioning as a setting means for setting processing content related to recording of audio at the time of shooting of the moving image in which is specified based on recording setting information corresponding to the predetermined shooting mode stored in advance did.

  According to the ninth aspect of the present invention, in a moving image shooting apparatus having a function of shooting a moving image with sound, an imaging unit for imaging a subject, and one or a plurality of subjects included in the subject image captured by the imaging unit Recording control for executing a recording process related to recording of a predetermined content corresponding to a determination result by the determination unit and a determination unit that determines a shooting environment based on a predetermined determination criterion using image information of Means.

  In such a configuration, a shooting environment at the time of shooting a moving image is automatically determined based on the image information of the subject, and a recording process related to recording of a predetermined content corresponding to the determined shooting environment. Is performed at the time of shooting.

  According to a tenth aspect of the present invention, a recording process related to recording a predetermined content corresponding to the determination result is performed by a filter for removing wind noise included in the input sound. It is assumed that it is used or not,

  According to an eleventh aspect of the present invention, in the moving image photographing method for photographing and recording a moving image with sound, a step of photographing a subject at the time of photographing the moving image, and one or more included in the photographed subject image A step of determining a shooting environment based on a predetermined determination criterion using the image information of the image, and a recording process related to recording of audio having a predetermined content corresponding to the determined shooting environment during shooting of the moving image The method for taking a moving image including the steps to be performed.

  In the twelfth aspect of the invention, a computer included in a moving image capturing apparatus that captures and records a moving image with sound uses one or more pieces of image information included in the subject image captured by the image capturing means. A function for determining a shooting environment based on a predetermined determination criterion, and a recording control unit for executing a recording process related to recording of audio having a predetermined content corresponding to a determination result by the determination unit; It was a program.

  In the present invention, when shooting a moving image for which use of a predetermined shooting mode is designated by the user, processing related to recording of audio is performed based on the recording setting information stored in advance corresponding to the shooting mode. To be done. Therefore, when recording a moving image with sound in a predetermined shooting mode, it is possible to perform sound recording suitable for the shooting environment.

  In another aspect of the invention, the shooting environment at the time of shooting a moving image is automatically determined based on the image information of the subject, and the present invention relates to the recording of audio having a predetermined content corresponding to the determined shooting environment. The recording process is now done at the time of shooting. Therefore, when recording moving images with sound in a shooting environment that can be determined based on the image information of the subject, it is possible to perform sound recording suitable for the shooting environment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a digital camera in the present embodiment. This digital camera can shoot still images and moving images, and in addition to general functions such as a zoom function, automatic exposure (AE), autofocus (AF), and auto white balance (AWB), it can shoot moving images. And has the following configuration.

  That is, the digital camera is provided with a lens block 1, a driver block 8, a lens control block 13, a CCD imaging system block 15, and an audio input block 21.

  The lens block 1 includes a lens group 2 mainly composed of a zoom lens and a focus lens, zoom and focus position detection sensors 3a and 3b for detecting a zoom position and a focus position in the lens group 2, a zoom motor 4 and a focus. The motor 5 includes a diaphragm actuator 6 that opens and closes a diaphragm (not shown), and a shutter actuator 7 that drives a mechanical shutter. The driver block 8 is a zoom (ZOOM), focus (Focus), aperture (Iris), or shutter (Shutter) driver for driving the motors 4 and 5 and the actuators 6 and 7, respectively. It is comprised from 9-12.

  The lens control block 13 sends position detection signals of the position detection sensors 3a and 3b to the control unit 14 and outputs drive signals for the drivers 9 to 12 of the driver block 8 according to the control signal sent from the control unit 14. .

  The CCD image pickup system block 15 includes a CCD 16 which is an image pickup means, a CDS (Correlated Double Sampling) / AD block 17, and a timing generator (TG) 18. The subject image picked up by the CCD 16 via the lens group 2 is converted into a digital signal by the CDS / AD block 17, and then the image is compressed by the JPEG / MPEG unit 20 through the color process unit 19. Is called.

  The audio input block 21 includes an input amplifier 22 and an ADC 23 for amplifying the audio input from the MIC 27 and converting the digital signal, a filter unit 24 for performing digital filter processing on the audio signal, and an analog signal of the digital audio signal. It comprises a DAC 25 and an output amplifier 26 for converting to and amplifying and outputting to the speaker 28. At the time of moving image recording with audio (hereinafter referred to as recording), the audio input to the MIC 27 is converted into a digital signal in the audio input block 21, subjected to digital filter processing, and sent to the control unit 14. Although not shown, each part of the audio input block 21, the MIC 27, and the speaker 28 are configured to support recording and reproduction of stereo audio.

  The control unit 14 controls each part of the digital camera. The control unit 14 includes a program memory 31, a built-in memory 32, and an audio codec register 33. In addition to the above control, the control unit 14 performs various processes such as compression and expansion of audio signals input to and output from the audio input block 21. That is, at the time of recording, after processing and compressing the audio signal sent from the audio input block 21, it is superimposed on the moving image data (a series of image data) compressed by the JPEG / MPEG section 20 to generate an image. The recording unit 35 records the moving image file. The audio codec register 33 stores various setting parameters for audio recording control used by the control unit 14 in audio signal recording processing, such as bit rate (compression rate), sampling rate, digital filter, stereo effect, Following time, maximum amplification, etc. are recorded.

  The image recording unit 35 includes a card interface and various nonvolatile memory cards that are connected to the control unit 14 via the card interface and are detachably attached to the camera body.

  The image display unit 36 includes a video encoder, a VRAM, a liquid crystal monitor, and a drive circuit thereof. The image display unit 36 is in a shooting standby state in a still image shooting mode, a shooting standby state in a recording mode, and a through image of a subject during recording. The still image and the moving image recorded in 35 are displayed. The key block 37 includes various keys such as a power key, a recording / playback mode changeover switch, a shutter key, a zoom key, and a menu key, and sends an operation signal corresponding to a key operation by the user to the control unit 14. The work memory 38 is a volatile work memory used for various data processing such as compression and decompression of image data and audio data.

  The program memory 31 stores a control program for causing the control unit 14 to function as setting means, control means, determination means, and recording control means of the present invention. The program memory 31 is a control information storage means of the present invention. The program memory 31 also stores a recording scene file used for recording using the recording best shot function.

  FIG. 2 shows the scene file 100 for recording. The scene file 100 indicates recording conditions prepared for each of a plurality of types of best shot scenes for recording (hereinafter simply referred to as BS scenes), as in the conventional best shot function for still images. It consists of data. BS scenes prepared in the present embodiment include concert recording (a), conference recording (b), landscape recording (c), etc. Each scene file 100 includes recording setting information 101 and various image settings. Information 102 and scene ID 103 are included.

  The recording setting information 101 is a parameter set in the audio codec register 33 described above, and includes a bit rate target value, a sampling rate, a digital filter setting value, a stereo effect setting value, a tracking time setting value, and a maximum amplification setting value. is there. Here, the filter setting value is a setting value relating to a sound (acoustic) filter, and specifically, whether or not a wind noise filter, which is a high-pass filter for reducing or eliminating low-frequency wind noise input to the MIC 27, is used. It is shown. The stereo effect setting value indicates whether or not the stereo effect (emphasis) is used. The follow-up time set value is a set value for more naturally changing the recording level when the input sound is amplified. Specifically, the hold time T1 that is the time until the amplification is started as shown in FIG. And a total time T3 with a decay time T2, which is a time for gradually changing the gain to the target gain, and is a time until the amplification based on the final amplification degree for the input sound is completed. In the present embodiment, the ratio between the hold time T1 and the decay time T2 is 1: 1.

  In the recording setting information 101 corresponding to the concert recording (a), settings that place importance on recording of music are described. In other words, in recording music, it is desirable that the recording quality be as high as possible and that the recording level does not rise or fall suddenly. Therefore, the bit rate is particularly high, the sampling frequency is 44.1 KHz, the tracking time setting is long, and the maximum amplification setting is low. On the other hand, in the recording setting information 101 corresponding to the conference recording (b), it is preferable that a voice of a distant person can be recorded as much as possible. Therefore, the tracking time is particularly short and the maximum amplification is set high. .

  Although omitted in the figure, in the recording setting information 101 corresponding to the landscape recording (c), since the recording is outdoors, the filter is set to ON, and depending on the BS scene, the recording setting information 101 is set. In some cases, only some of the setting items described above are determined. On the other hand, various image setting information (recording setting information of the present invention) 102 in the scene file 100 are set values such as image size, frame rate, focus, sharpness, and the scene ID 103 corresponds to each scene file 100. It is a scene number indicating a scene. The program memory 31 is a scene information storage means of the present invention. In addition to the scene file 100, the program memory 31 includes BS scenes (specification such as concert recording (a), conference recording (b), and landscape recording (c) shown in the figure. Scene information such as “Shooting a concert”, scene information such as “Record a concert”, and advice information such as “Focus is set to pan focus” are stored corresponding to the scene ID 103. Has been.

  In addition to the program memory 31, the recording scene file 100 described above is stored in other memories such as the above-described various memory cards that record still image files and moving image files captured by the image recording unit 35, for example. It does not matter. Further, the recording setting information 101 and the various image setting information 102 described above may be stored in different locations as long as they are associated with each other (for example, in a state of being paired with the scene ID 103).

  Next, the operation according to the present invention in the digital camera having the above configuration will be described. FIG. 4 is a flowchart showing a processing procedure of the control unit 14 when the best shot mode is selected by the user during recording.

  When such a mode is set, the control unit 14 first displays a selection screen including a sample image showing the BS scene and a description of the scene, as in the conventional best shot function for still images, on the liquid crystal monitor of the image display unit 36. The BS scene that matches or is similar to the scene to be photographed is determined (designated) by the user (step SA1). Subsequently, the scene file 100 corresponding to the determined BS scene is read from the program memory (step SA2), and settings for image control described there, that is, settings such as image size, frame rate, focus, and sharpness are performed. (Step SA3). This shifts to a shooting mode that is assumed to be used in the shooting environment indicated by the BS scene designated by the user. Thereafter, if the scene file 100 does not contain any of the above-described parameters for audio recording control (NO in step SA4), the recording standby state is entered as it is, and the above-described audio control parameters are included. (YES in step SA4), the audio recording control setting described therein, that is, the audio parameter corresponding to the BS scene is set in the audio codec register 33 (step SA5), and then the recording standby state is entered. .

  Therefore, when a user shoots (records) a state of a concert, for example, by selecting concert recording (a) as the BS scene, the sound quality is high and the volume does not suddenly increase or decrease. It is possible to shoot and record moving images with sound in an appropriate recording state. In addition, when shooting (recording) a state of a meeting or the like, it is easy to hear even a distant person's remarks regardless of the distance from the photographer by selecting the conference recording (b) as the BS scene. It is possible to shoot and record a moving image with sound in a more appropriate recording state. That is, it is possible to perform voice recording suitable for the recording environment. At the same time, since various voice control parameters can be set simply by selecting a BS scene, there is no complication as in the case where the user sets or selects the settings for each parameter, and no one Can be easily set.

  On the other hand, FIG. 5 is a flowchart showing the processing procedure of the control unit 14 in the recording mode in which the automatic recording setting mode prepared in advance separately from the best shot mode is set in the digital camera.

  In such a case, the control unit 14 starts imaging by the CCD 16 in accordance with the setting of the recording mode, acquires image data for through image display (step SB1), and subjects the subject based on the imaged image data by AE processing. The brightness in the shooting environment such as is determined (step SB2). Here, when it is determined that the shooting environment is an environment brighter than a predetermined standard (YES in step SB3), it is assumed that the shooting location is indoors, and for voice recording control that the wind noise filter is used. After that, that is, after “ON” is set as the filter setting value in the audio codec register 33 (step SB4), the process proceeds to the recording standby state.

  On the other hand, when it is determined that the shooting environment is darker than the predetermined reference (NO in step SB3), the type of the light source is determined based on the captured image data by the AWB process (step SB5). If the determined light source type is not sunlight (NO in step SB6), the process proceeds to the above-described step SB4 assuming that the shooting location is indoors, and “ON” is set as the filter setting value. Conversely, when the light source type is sunlight (YES in step SB6), the sound recording control is set not to use the wind noise filter, assuming that the shooting location is outdoors, that is, After “OFF” is set as the filter setting value in the audio codec register 33 (step SB7), the process proceeds to the recording standby state.

  As described above, when the automatic recording setting mode is set, whether or not to use the wind noise filter is automatically set depending on whether the shooting location is indoors or outdoors. Therefore, when recording outdoors, do not automatically record harsh wind noises, and when recording indoors, automatically use bass suitable for music performances. Recording becomes possible. That is, it is possible to perform voice recording suitable for the recording environment.

  In the present embodiment described above, when recording in the best shot mode by the user, not only the setting for audio recording control but also the setting for image control are performed according to the designated BS scene. However, the configuration may be such that only the settings for voice recording control are performed. In addition, the setting items for voice recording control and the specific setting values shown in the present embodiment can be increased / decreased or changed as appropriate.

  In addition to this embodiment, a mode for changing the recording setting information 101 according to a BS scene prepared in advance may be provided. In that case, for example, the recording setting information 101 corresponding to the designated BS scene is displayed in a list on the liquid crystal monitor of the image display unit 36, and the setting value is changed for each setting item by a key operation. The recording setting information 101 may be updated or stored separately as data corresponding to a new BS scene. However, in that case, the updated recording setting information 101 or the like is recorded in the above-described various memory cards or the like that record still image files and moving image files captured by the image recording unit 35.

  In the above-described automatic recording setting mode, the image information included in the through image is the brightness of the subject and the light source type, and the shooting location as the shooting environment is used indoors or indoors using the information. It is configured to automatically set whether or not the wind noise filter is used by determining whether or not the wind noise filter is used. However, even if a shooting environment other than the shooting location is determined using the image information included in the image for the through image Good. Further, depending on the result, control for voice recording control other than the presence or absence of use of the wind noise filter may be performed.

  In the present embodiment, the digital camera provided with both the best shot mode for video and the automatic recording setting mode has been described. However, only one of the modes may be provided. In addition, the description has been given of the case where the control unit 14 performs all the various processes such as compression and expansion of the audio signal. However, the control unit 14 performs only the processes shown in FIGS. You may make it provide the audio | voice processing part etc. which perform a process separately.

  Furthermore, although the case where the present invention is applied to a general digital camera having a video recording function with sound has been described, the present invention is not limited to this and is incorporated in other devices such as a mobile phone. It can be applied to other digital cameras.

1 is a block diagram of a digital camera according to the present invention. It is a figure which shows the example of the audio | voice setting information prepared corresponding to a moving image shooting scene. It is a figure which shows the tracking time setting value in audio | voice setting information. It is a flowchart which shows the process sequence of the control part at the time of the video recording at the time of the best shot mode for video recording being selected. It is a flowchart which shows the process sequence of the control part in the recording mode of the state in which the automatic recording setting mode was set.

Explanation of symbols

14 Control Unit 15 CCD Imaging System Block 16 CCD
20 JPEG / MPEG part 21 Audio input block 27 MIC
28 Speaker 31 Program Memory 32 Built-in Memory 33 Audio Codec Register 27 MIC
33 Audio codec register 100 Scene file 101 Recording setting information T1 Hold time T2 Decay time T3 Total time (follow-up time)

Claims (12)

In a video shooting device that records and records moving images with sound,
Recording setting storage means for storing recording setting information indicating processing contents related to recording of audio during shooting of the moving image and corresponding to a predetermined shooting mode in which use is designated as appropriate by the user When,
Setting means for setting, based on recording setting information stored in the recording setting storage means, processing contents related to sound recording in shooting of the moving image in which use of the predetermined shooting mode is designated by a user; A video shooting device comprising: Recording setting information indicating processing contents related to image recording at the time of shooting the moving image, and recording setting storage means storing a plurality of recording setting information corresponding to the plurality of shooting modes;
Control means for allowing a user to select one of the plurality of shooting modes;
A plurality of the recording setting information corresponding to a plurality of the shooting modes are recorded in the recording setting storage means,
When the moving image is shot in the shooting mode selected by the control unit by the control unit, the setting unit stores processing contents related to image recording in the shooting mode stored in the recording setting storage unit. The setting is based on the corresponding recording setting information, and the processing content related to the recording of the sound is set based on the recording setting information corresponding to the shooting mode stored in the recording setting storage means. Item 3. A moving image photographing apparatus according to item 1. Each of which represents a specific moving image shooting target, and includes scene information storage means for storing a plurality of scene information respectively corresponding to the plurality of shooting modes,
The control means displays a plurality of scene information stored in the scene information storage means so as to be selectable, and selects one of the plurality of shooting modes to the user via the scene information displayed on the screen. The moving image photographing apparatus according to claim 1 or 2, wherein   4. The recording setting information includes a follow-up time until completion of amplification based on a final amplification degree for input sound as processing contents related to sound recording. Video shooting device.   5. The moving image shooting apparatus according to claim 1, wherein the recording setting information includes whether or not a filter intended to remove wind noise included in the input sound is used. Imaging means for imaging a subject;
A determination unit that determines a shooting environment at the time of shooting the moving image based on whether or not one or a plurality of predetermined image information included in the subject image captured by the imaging unit matches a predetermined determination condition;
6. A recording control means for executing a recording process related to recording of a sound having a content corresponding to a determination result by the determination means in a predetermined photographing mode. The moving image photographing device according to the item. In the video shooting method of shooting and recording moving images with sound,
The processing contents related to the recording of the sound at the time of shooting the moving image and the recording setting information corresponding to the predetermined shooting mode are stored in advance,
A moving image shooting method characterized in that the processing content related to recording of audio during shooting of the moving image in the predetermined shooting mode is set based on the recording setting information stored in the recording setting storage means. A computer included in a moving image capturing device that captures and records moving images with sound,
The processing contents related to the recording of the sound at the time of shooting the moving image in which the use of the predetermined shooting mode is designated by the user is set based on the recording setting information corresponding to the predetermined shooting mode stored in advance. A program that functions as a setting means. In a video shooting device having a function of shooting a moving image with sound,
Imaging means for imaging a subject;
A determination unit that determines a shooting environment based on a predetermined determination criterion using one or a plurality of pieces of image information included in the subject image captured by the imaging unit;
A video recording apparatus comprising: a recording control unit that executes a recording process related to recording of audio having a predetermined content corresponding to a determination result by the determination unit.   The recording process related to the recording of voice having predetermined contents corresponding to the determination result is whether or not a filter for removing wind noise included in the input voice is used. 9. The moving image photographing apparatus according to 9. In the video shooting method of shooting and recording moving images with sound,
Capturing a subject when capturing the moving image;
Determining a shooting environment based on a predetermined determination criterion using one or more pieces of image information included in the captured subject image;
And a step of performing a recording process related to recording of audio having a predetermined content corresponding to the determined shooting environment during shooting of the moving image. A computer included in a moving image capturing device that captures and records moving images with sound,
A determination unit that determines a shooting environment based on a predetermined determination criterion using one or a plurality of pieces of image information included in the subject image captured by the imaging unit;
A program for functioning as a recording control means for executing a recording process related to recording of a predetermined content corresponding to a determination result by the determination means.

Images