JP2007235432A - Image sound recorder and image sound recording control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To store and control input sounds corresponding to a taken image at the timing of actual sounds in rapid shooting with an image sound recorder such as a digital camera having a rapid shooting function. <P>SOLUTION: The recorder records sounds inputted by a sound input means according to continuous shooting control of a plurality of still images (A-D) by a rapid shooting control means; and stores and controls the still image (B) taken, related to sound data recorded by the sound recording means, when a sound level deciding means decides the actual sound exceeding a fixed level is inputted among the continuously taken still images (A-D). Even for reproducing individual still image data with sounds, the recorder reproduces and outputs the recorded sound data only when the still image (B) taken at the timing of the actually produced sounds is reproduced and displayed, thus reproducing individual still images with sounds without strange feeling. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an audio / video recording apparatus such as a digital camera having a continuous shooting function and a control program thereof.

  2. Description of the Related Art Conventionally, there is a digital camera equipped with a continuous shooting function that inputs and records voices associated with continuous shooting, and reproduces simple moving images by continuously displaying and reproducing the voices.

  In such a digital camera capable of recording and playing back a simple movie by continuous shooting, shooting is performed from the start to the end of continuous shooting, that is, from the start of continuous shooting by pressing the shutter in continuous shooting mode. The input voice is also continuously recorded until the end point, and a set of images (simple moving images) obtained by continuous shooting and the recorded voice are stored in association with each other.

Therefore, when playback of a simple video shot by continuous shooting is started, the audio stored in association with the captured image group from the playback start time is also played back and output at exactly the same timing as during continuous shooting and audio recording. (For example, refer to Patent Document 1).
JP 2004-088518 A

  In the conventional digital camera capable of recording and playing back simple moving images, the input sound is also continuously recorded and associated and managed at the same time from the start to the end of continuous shooting. Even if the sound is emitted for a certain period of time, it is managed in association with the set of images (simple video) as the sound data of all the processes during continuous shooting including the silent period regardless of the timing. It will be.

  For this reason, when reproducing a simple moving image (a set of images) taken continuously, for example, when reproducing individual captured images in the simplified moving image (a set of images) with sound, Regardless of which shot image is selected and played back, the audio data of the whole process is played back during continuous shooting. It will be.

  The present invention has been made in view of such a problem, and when continuous shooting is performed, an image in which input sound can be stored and managed in association with a captured image at a timing when there is actually sound. An object is to provide an audio recording apparatus and a control program thereof.

  The audio / video recording apparatus according to claim 1 is an audio / video recording apparatus having an imaging unit and an audio input unit, and continuous shooting control unit that continuously captures a plurality of still images by the imaging unit; During continuous shooting control by the continuous shooting control means, sound level determination means for determining whether or not the sound input by the voice input means exceeds a certain level, and a plurality of still images by the continuous shooting control means Among the plurality of still images continuously shot by the continuous shooting control means, the sound recording means for recording the sound input by the sound input means in accordance with the continuous shooting control of the image, and fixed by the sound level determination means. Still image audio for storing the audio recorded by the audio recording means in association with the still image taken when it is determined that the audio exceeding the level is input It is characterized in that a response storage unit.

  The image and sound recording apparatus according to claim 2 is the image and sound recording apparatus according to claim 1, wherein the sound recording means is accompanied by continuous shooting control of a plurality of still images by the continuous shooting control means, The audio input by the audio input unit during a period from when it is determined by the audio level determination unit to have exceeded a certain level to when it is determined to be below a certain level, the still image audio correspondence storage unit, Of the plurality of still images continuously shot by the continuous shooting control means, the voice recording is performed on the still images shot during the period when the voice level determination means determines that the sound exceeding a certain level is input. The voice recorded by the means is stored in association with each other.

  The image / audio recording apparatus according to claim 3 is the image / audio recording apparatus according to claim 1, wherein the audio recorded by the audio recording unit exceeds a certain level by the audio level determination unit. Recording audio extraction means for extracting audio recorded during a period in which it is determined that the image is input, and the still image audio correspondence storage means is configured to store a plurality of still images continuously shot by the continuous shooting control means. Of these, the sound extracted by the recorded sound extraction means is stored in association with a still image shot during a period in which it is determined that sound exceeding a certain level has been input by the sound level determination means. It is said.

  The image / audio recording apparatus according to claim 4 is an image / audio recording apparatus having an imaging unit and an audio input unit, the continuous shooting control unit configured to continuously capture a plurality of still images by the imaging unit, A voice recording means for recording sound input by the voice input means in accordance with continuous shooting control of a plurality of still images by the continuous shooting control means, and a plurality of still pictures continuously shot by the continuous shooting control means. Among the images, when an image designation control unit that allows the user to designate an arbitrary still image and a still image designated by the user under the control of the image designation control unit out of the voice recorded by the voice recording unit Recorded voice extraction means for extracting the voice recorded on the camera, and among the plurality of still images continuously shot by the continuous shooting control means, the control of the image designation control means To over The specified still picture it is characterized in that a still picture audio correspondence storing means for storing in association with audio extracted by the recording sound extraction means.

  The image / audio recording apparatus according to claim 5 is an image / audio recording apparatus having an imaging unit and an audio input unit, and a moving image shooting control unit for shooting a moving image by the shooting unit, and a moving image by the moving image shooting control unit. During image capture control, a still image capture designation control means for allowing a user to designate capture of a still image at an arbitrary timing, and when still image capture is designated by control of the still image capture designation control means, In accordance with the still image shooting control means for temporarily stopping the moving image shooting control by the moving image shooting control means and shooting the still image by the shooting means, and when the still image is shot by the control of the still image shooting control means. Audio recording means for recording audio input by the audio input means, and still images captured by the control of the still image capturing control means It is characterized in that a still picture audio correspondence storing means for storing in association with audio recorded by the voice recording unit.

  The audio / video recording apparatus according to claim 1 (invention 6) of the present invention (According to the audio / video recording control program, input is performed by the audio input unit along with the continuous shooting control of a plurality of still images by the continuous shooting control unit. The sound recording means for the still image that is recorded when the sound level determination means determines that the sound exceeding the predetermined level is input by the sound level determination means among the plurality of continuously shot still images. Since the recorded voice is stored in association with each other, when playing back still images taken with continuous shooting with sound, it matches the playback display of the still image shot at the time when the sound was actually emitted. The recorded sound can be reproduced.

  According to the video and audio recording apparatus of the second aspect of the present invention, in the video and audio recording apparatus according to the first aspect of the invention, the voice recording means controls continuous shooting of a plurality of still images by the continuous shooting control means. Accordingly, the audio input by the audio input unit between the time when the audio level determining unit determines that the predetermined level is exceeded and the time when the audio level is determined to be below the predetermined level is recorded. Of the plurality of still images continuously shot by the continuous shooting control means, the voice recording is performed on the still images shot during the period when the voice level determination means determines that the sound exceeding a certain level is input. The sound recorded by the means is stored in association with each other, so when playing back still images with continuous shooting, with sound, It can only reproduce the recorded sound when the still image playback display.

  According to the video / audio recording apparatus according to claim 3 of the present invention, in the video / audio recording apparatus according to claim 1, the audio level determination unit exceeds a certain level among the audio recorded by the audio recording unit. The recording voice extraction means for extracting the voice recorded during the period in which the voice is determined to be input is provided, and the still picture voice correspondence storage means is a plurality of still images continuously shot by the continuous shooting control means. Since the voice extracted by the recorded voice extraction unit is stored in association with the still image shot during the period when it is determined that the voice exceeding the predetermined level is input by the voice level determination unit, continuous shooting is performed. When playing back individual still images with sound, the recorded sound is played back only when the still image shot at the place where the sound is actually played is played back and displayed. It is possible to live.

  According to the image and sound recording apparatus of the fourth aspect of the present invention, the sound input by the sound input unit is recorded in accordance with the continuous shooting control of a plurality of still images by the continuous shooting control unit, and the continuous shooting is performed. When an arbitrary still image is designated by the user among the plurality of still images, the recorded voice is extracted from the recorded voice when the still picture designated by the user is captured. . Since the extracted voice is stored in association with the still image designated by the user, when the individual still image selected and designated in advance is reproduced with sound after continuous shooting, the designation is performed. Only audio data recorded at the time of still image shooting can be reproduced simultaneously.

  According to the image and audio recording apparatus of the fifth aspect of the present invention, when capturing of a still image is designated by the user at an arbitrary timing during moving image shooting control by the moving image shooting control unit, moving image shooting is performed. The control is temporarily interrupted, a still image is shot, and the voice input by the voice input means is recorded when the still image is shot. Since the recorded audio is stored in association with the captured still image, even when individual still images extracted during moving image shooting are played back, recorded audio corresponding to the still image is simultaneously recorded. Can be played.

  Therefore, according to the present invention, when continuous shooting (or moving image shooting) is performed, an input sound can be stored and managed in association with a captured image at the timing when the sound actually exists. And its control program.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an electronic circuit of a digital camera 10 according to an embodiment of an image / audio recording apparatus of the present invention.

  The electronic circuit of the digital camera 10 includes a CPU (Central Processing Unit) 11 that is a computer.

  The CPU 11 stores the image / sound recording control program stored in the memory 12 in advance, the playback control program thereof, or an external memory (external recording medium) such as a card-type memory set in the external memory drive 13 in the memory 12. The operation of each part of the circuit is controlled in accordance with various control programs read into the memory 12, and flash memory, DRAM (Dynamic Random Access Memory), SRAM (Static Random Access Memory), etc. are used as specific devices of the memory 12. In addition to storing the program data, it is used for temporarily saving various data input / output to / from the CPU 11 according to various operation controls, or for calculation.

  Various programs stored in the memory 12 are activated in response to a key input signal from the key input unit 14 such as a shutter key or a mode switching key, and image data or a voice input unit photographed and input by the image input unit 15. 16 is used to process the audio data input by the control unit 16.

  In addition to the memory 12, the external memory drive 13, the key input unit 14, the image input unit 15, and the audio input unit 16, a monitor (image display / audio output) 17 is connected to the CPU 11. Image data and input audio data are reproduced by the monitor 17.

  The image input unit 15 includes an imaging lens, a CCD (Charge coupled Device), an A / D conversion circuit, and the like, the audio input unit 16 includes a microphone, and the monitor 17 includes an LCD (Liquid Crystal Display) and a speaker. Consists of.

  The digital camera 10 can also shoot and record a moving image by setting a moving image shooting mode.

  Next, the audio / video recording function of the digital camera 10 having the above-described configuration will be described.

(First embodiment)
FIG. 2 is a flowchart showing the image / audio recording process of the first embodiment by the digital camera 10.

  FIG. 3 is a diagram showing an image / sound recording state and a management state of the recorded data associated with the image / sound recording process of the first embodiment by the digital camera 10.

  When an input signal accompanying the shutter pressing from the key input unit 14 is detected in the state in which the continuous shooting mode with sound is set (step S1), recording of the sound data input by the sound input unit 16 is performed. At the same time (step S2), for example, still image shooting of one image data per second of the image data captured by the image input unit 15 is started (step S3).

  The audio data recording process and the still image data shooting / recording process are performed on the audio / image memory in the memory 12 at the timing shown in FIG.

  Then, for example, at the time when the first still image (A) is photographed, it is determined whether or not the “sound generation start flag” indicating detection of the start of generation of input sound exceeding a certain level is not set (step S4). When it is determined that the flag is not set (step S4 (yes)), the sound generation state is chucked from the current input sound signal, and it is determined whether or not a sound signal exceeding a certain level is input (step S5). ).

  Here, when it is determined that no actual audio is generated around the digital camera 10 and an audio signal exceeding a certain level is not input (step S5 (no)), the key input unit 14 It is determined whether or not the shutter has been opened based on the signal input (step S7). If it is determined that the shutter is being pressed without the shutter being opened (step S7 (no)), the image is again displayed. The next still image shooting based on the image data captured by the input unit 15 is performed (step S3).

  Then, at the time when the second still image (B) is captured, the “sound generation start flag” is not set (step S4 (yes)), and there is an audio signal input exceeding a certain level (step S5 (yes)). When the determination is made, a “sound generation start flag” is added to the still image data (B) photographed for the second image (step S6).

  Thereafter, for example, the third still image (C) and the fourth still image are determined while it is determined that the “sound generation start flag” has been set (step S4 (no)) and the shutter is not opened (step S7 (no)). After the image (D) is imaged (steps S7 → S3, S4 → S7), if it is determined that the shutter is opened (step S7 (yes)), the subsequent still image image capturing process is stopped. Accordingly, the recording process of the input voice is also ended (step S8).

  At this time, for the audio / image memory in the memory 12, as shown in FIG. 3A, still image data (A to D) continuously shot from the time when the shutter is pressed to the time when the shutter is released, and Audio data input within the same period is recorded and held. Of these, the second still image data (B) is recorded with an “audio generation start flag” added thereto.

  Then, the second still image data (B) to which the “sound generation start flag” is added is extracted (step S9), and as shown in FIG. The recorded audio data is associated with the still image data (B) and stored and managed in the memory 12 (step S10). In this case, the still image (B) and the recorded audio data are associated with each other by associating a part of the file name (CIMG0001.), For example.

  Therefore, according to the image and sound recording function of the first embodiment by the digital camera 10 having the above-described configuration, the sound data recorded from the start to the end of continuous shooting is captured at the first timing when the sound is actually emitted. However, since it can be stored and managed in association with still image data, when continuous reproduction (simple moving image reproduction) of continuous shot images with sound is performed, a plurality of still image data (A to D) The recorded audio data is reproduced and output in accordance with the sequential reproduction and display of the image, and the simple video reproduction can be performed without any sense of incongruity with the timing of the image and audio. Even when playing back, the recorded voice data is played back and output only when the still image (B) taken at the first timing when the voice is actually played is played back and displayed. It is possible to perform the voice with individual still image without feeling playback.

  Therefore, it is possible to solve the problem that the audio with the shifted timing is added and reproduced along with the reproduction output of the individual still image that is actually a silent period.

  Specifically, for example, when a golf shot is shot continuously with sound, the recorded impact sound can be played only when a still image shot near the ball impact timing is individually selected and played back. Thus, it is possible to eliminate the unnaturalness that the recorded sound of the impact is reproduced when the still images photographed during the backswing are individually selected and reproduced.

  In the image and sound recording function of the first embodiment, the sound data recorded in the continuous shooting is stored and managed in association with the still image captured at the first timing when the sound is actually emitted. However, as in the image / sound recording function described in the second embodiment, the sound is recorded only during a period in which sound is actually emitted during continuous shooting, and the actual sound generation period. The recorded audio is stored and managed in association with only one or a plurality of still images taken in an image, and an efficient and efficient simple moving image reproduction process and a reproduction process with audio of individual still images without a sense of incongruity are performed. You may make it perform.

(Second Embodiment (Part 1))
FIG. 4 is a flowchart showing the image / audio recording process of the second embodiment (part 1) by the digital camera 10.

  FIG. 5 is a diagram showing an image / sound recording state and a management state of recorded data associated with the image / sound recording process of the second embodiment by the digital camera 10.

  When an input signal accompanying pressing the shutter from the key input unit 14 is detected in the state where the continuous shooting mode with sound is set (step A1), for example, every second of image data captured by the image input unit 15 One still image shooting is started (step A2).

  Then, each time a still image is taken by continuous shooting, the surrounding sound generation state is checked based on the sound signal input by the sound input unit 16 (steps A3 and A6), and the input sound signal is constant. Whether or not the “sound generation flag” is not set for the still image that has exceeded the level and has been captured this time (step A3), or the input audio signal is below a certain level and the still image that has been captured this time On the other hand, it is determined whether the “voice end flag” is not set (step A6).

  For example, when the first still image (A) is photographed (step A2), the input sound signal exceeds a certain level and the “sound generation flag” is not set for the still image (A) photographed this time. If it is determined (step A3 (yes)), recording of audio data input by the audio input unit 16 is started (step A4), and the still image (A) taken this time is recorded. “Sound generation flag” is set for recording (step A5).

  Then, it is determined whether or not the shutter has been opened based on the signal input from the key input unit 14 (step A9), and if it is determined that the shutter pressing operation without opening the shutter is in progress (step S9). A9 (no)), the next still image shooting based on the image data picked up by the image input unit 15 is performed again with the audio data recording state in step A4 (step A2).

  When the second still image (B) is photographed (step A2), the “sound generation flag” is set for the still image (B) photographed this time when the input audio signal still exceeds a certain level. If it is determined that it has not been set (step A3 (yes)), the recording process of the audio data input by the audio input unit 16 is continued (step A4), and the still image (B) taken this time Also, the “voice generation flag” is recorded and set (step A5).

  Further, when it is determined that the shutter pressing operation is being continued (step A9 (no)) and the third still image (C) is photographed (step A2), the input audio signal is below a certain level. If it is determined that the “audio end flag” is not set for the still image (C) taken this time (step A6 (yes)), recording of audio data input by the audio input unit 16 is performed. At the end of the process (step A7), the “audio end flag” is recorded and set for the still image (C) taken this time (step A8).

  Furthermore, when it is determined that the shutter pressing operation is being continued (step A9 (no)) and the fourth still image (D) is shot (step A2), the input audio signal continues to be below a certain level. If it is determined that the “audio end flag” is not set for the still image (D) taken this time (step A6 (yes)), the audio data input by the audio input unit 16 The recording end is continued (step A7), and the “sound end flag” is also set for the still image (D) taken this time (step A8).

  Thereafter, when it is determined that the shutter has been opened (step A9 (yes)), it is determined whether or not audio recording is in progress (step A10), and if it is determined that audio recording is in progress. (Step A10 (yes)), the recording process of the input voice is terminated (Step A11).

  At this time, for the audio / image memory in the memory 12, as shown in FIG. 5A, still image data (A to D) continuously shot from the time when the shutter is pressed to the time when the shutter is opened, and Audio data input during the period from the actual audio generation time to the audio end time is recorded and held. The first and second still image data (A) and (B) corresponding to this audio recording period are set to record “sound generation flag”, while corresponding to the outside of the audio recording period. In the third and fourth still image data (C) (D), an “audio end flag” is recorded and set.

  Then, the first and second still image data captured between the still image with the “sound generation flag” and the still image with the “sound end flag” or at the end of the sound recording. (A) and (B) are extracted (step A12), and as shown in FIG. 5B, for each of the extracted first and second still image data (A) and (B). The voice data recorded according to the actual voice generation period is associated and stored in the memory 12 (step A13).

  Therefore, according to the image / audio recording function of the second embodiment (part 1) by the digital camera 10 having the above-described configuration, the audio data recorded in accordance with the actual audio generation period during continuous shooting is used as the actual audio. Can be stored and managed in association with still image data shot at the place where the image is emitted, so when performing continuous playback (simple video playback) of continuous shot images with sound, As the still image data (A to D) are sequentially reproduced and displayed, the recorded audio data is reproduced and output at the recording timing, and the simple moving image reproduction without any sense of incongruity between the timings of the images and sounds is efficiently performed. Of course, even when individual still image data is reproduced with sound, when still images (A) and (B) taken at the timing when the sound is actually reproduced are reproduced and displayed. It is possible to perform only the recorded voice with individual still image playback more without discomfort to reproduce and output audio data.

  Therefore, even in the case of the image / audio recording function of the second embodiment (part 1), the sound with a shifted timing is added along with the reproduction output of the individual still images (C) and (D) that were actually silent periods. The problem of being played back can be solved.

  In the image and sound recording function of the second embodiment (part 1), sound data is recorded only during the actual sound generation period during continuous shooting, and a “sound generation flag” is set according to this sound generation period. The recorded audio data is stored and managed only in association with the still image data, but from the start of continuous shooting as in the image / audio recording function described in the second embodiment (part 2). While recording the input audio data until the end, only the recorded audio data of the still image shooting period in which the “audio generation flag” is set according to the actual audio generation period is cut out, and the cut out recorded audio data is the second embodiment Similarly to the mode (part 1), it may be configured to store and manage only the still image data in which the “sound generation flag” is set.

(Second embodiment (part 2))
FIG. 6 is a flowchart showing the image / audio recording process of the second embodiment (part 2) by the digital camera 10.

  When an input signal accompanying pressing the shutter from the key input unit 14 is detected in the state where the continuous shooting mode with audio is set (step B1), first, the audio data input by the audio input unit 16 is detected. Recording starts (step B2), and still image shooting of, for example, one image per second of image data captured by the image input unit 15 is started (step B3).

  Then, each time a still image is taken by continuous shooting, the surrounding sound generation state is checked based on the sound signal input by the sound input unit 16 (steps B4 and B6), and the input sound signal is constant. Whether or not the “sound generation flag” is not set for the still image that has exceeded the level and is captured this time (step B4), or the input audio signal is below a certain level and the still image captured this time On the other hand, it is determined whether the “voice end flag” is not set (step B6).

  For example, when the first still image (A) is captured (step B3), the input sound signal exceeds a certain level and the “sound generation flag” is not set for the still image (A) captured this time. Is determined (step B4 (yes)), the “sound generation flag” is recorded and set for the still image (A) taken this time (step B5).

  Then, it is determined whether or not the shutter has been opened based on the signal input from the key input unit 14 (step B8), and if it is determined that the shutter pressing operation without opening the shutter is in progress (step S8). B8 (no)), the next still image shooting based on the image data captured by the image input unit 15 is performed again (step B3).

  Then, when the second still image (B) is shot (step B3), the “voice generation flag” is set for the still image (B) that has been input and the input audio signal still exceeds a certain level. If it is determined that it has not been set (step B4 (yes)), the “sound generation flag” is also recorded and set for the still image (B) taken this time (step B5).

  Further, it is determined that the shutter pressing operation is being continued (step B8 (no)), and when the third still image (C) is photographed (step B3), the input audio signal is below a certain level. If it is determined that the “audio end flag” is not set for the still image (C) captured this time (step B6 (yes)), the still image (C) captured this time is selected. The “voice end flag” is recorded and set (step B7).

  Furthermore, when it is determined that the shutter pressing operation is being continued (step B8 (no)) and the fourth still image (D) is shot (step B3), the input audio signal continues to be below a certain level. If it is determined that the “sound end flag” is not set for the still image (D) captured this time (step B6 (yes)), the still image (D) captured this time is determined. However, the “voice end flag” is recorded and set (step B7).

  Thereafter, when it is determined that the shutter has been opened (step B8 (yes)), the recording process of the input voice is ended (step B9).

  At this time, with respect to the audio / image memory in the memory 12, still image data (A to D) continuously shot from the time when the shutter is pressed to the time when the shutter is released and the sound input during the continuous shooting period. Data is being recorded. The first and second still image data (A) and (B) corresponding to the actual sound generation period are recorded and set with the “sound generation flag”, but outside the actual sound generation period. In the corresponding third and fourth still image data (C) (D), an “audio end flag” is recorded and set.

  Then, the first and second still image data (A) and (B) captured between the still image with the “sound generation flag” and the still image with the “sound end flag” are extracted. (Step B10), the recorded audio data corresponding to the shooting period of the still image (A) (B) with the “sound generation flag” is cut out from the recorded audio data over the continuous shooting period. And extracted (step B11).

  Then, as shown in FIG. 5B, the “sound generation flag” is set for each of the extracted first and second still image data (A) and (B). The voice data extracted according to the actual voice generation period is associated and stored in the memory 12 (step B12).

  Therefore, according to the video / audio recording function of the second embodiment (part 2) by the digital camera 10 having the above-described configuration, it is extracted from the audio data recorded over the entire continuous shooting period according to the actual audio generation period. Audio data can be stored and managed in association with still image data taken where the sound is actually being emitted. Therefore, when performing continuous playback (simple video playback) of continuous shot images with sound, Along with the sequential reproduction and display of a plurality of still image data (A to D) taken continuously, the recorded audio data is reproduced and output at the recording timing, and the sense of incongruity in which the timing of the image / sound is matched. In addition to being able to efficiently perform simple video playback without sound, even when individual still image data is played back with sound, it is possible to record still images captured at the time when the sound was actually emitted. Image (A) (B) can only be the sound data extracted in accordance with the photographing timing by reproducing outputs do more with sound without discomfort individual still image playback when the playback display.

  Therefore, even in the case of the image / audio recording function of the second embodiment (No. 2), a sound with a shifted timing is added along with the reproduction output of the individual still images (C) and (D) that were actually silent periods. The problem of being played back can be solved.

  In the image and sound recording function of each of the above embodiments, the recorded sound is associated with only the photographed still image data corresponding to the actual sound generation time among the plurality of still image data shot continuously. The storage management and selection of individual still images and reproduction with sound eliminate the problem that some sound is reproduced together with the captured still image that was originally a silent period. As in the case of the image / audio recording function described in the embodiment, after continuous shooting with simultaneous audio recording, the user selects and designates a still image to be reproduced individually with sound, so that the designated still image A configuration may be adopted in which audio data recorded at a fixed time before and after the photographing time is extracted and stored and managed in association with the designated still image data.

(Third embodiment)
FIG. 7 is a flowchart showing image / audio recording processing of the third embodiment by the digital camera 10.

  FIG. 8 is a diagram showing an image / sound recording state and a management state of recorded data associated with the image / sound recording process of the third embodiment by the digital camera 10.

  When an input signal accompanying the pressing of the shutter from the key input unit 14 is detected in the state where the continuous shooting mode with sound is set (step C1), recording of the sound data input by the sound input unit 16 is performed. At the same time (step C2), for example, one still image shooting of the image data captured by the image input unit 15 is started every second (step C3).

  Then, based on the signal input from the key input unit 14, it is determined whether or not the shutter has been opened (step C4), and if it is determined that the shutter pressing operation without opening the shutter is in progress (step S4). C4 (no)), the next still image shooting based on the image data captured by the repeated image input unit 15 is performed (step C3).

  In this way, it is determined that the shutter is opened after, for example, four still images (A to D) are shot and recorded by continuous shooting with recording of audio data (steps C2, C3, C4 → C3). Then (step C4 (yes)), the recording process of the input sound is also ended (step C5) as the still image shooting process thereafter is stopped.

At this time, for the audio / image memory in the memory 12, as shown in FIG.
The still image data (A to D) continuously shot from the time when the shutter is pressed to the time when the shutter is released and the audio data input during the continuous shooting period are recorded and held.

  Then, while the still image data (A to D) taken continuously is displayed, the photographed still image (B) to be individually reproduced with sound is selected and designated in accordance with the key input operation by the user. (Step C6), the audio data recorded at a fixed time before and after the photographing time of the designated still image (B) is extracted (Step C7), and as shown in FIG. The image data (B) is stored and managed in the memory 12 in association with the image data (B) (step C8).

  Therefore, according to the image / audio recording function of the third embodiment by the digital camera 10 having the above-described configuration, the fixed time corresponding to the user-specified still image shooting time out of the audio data recorded from the start to the end of the continuous shooting. Can be extracted and recorded and managed in association with the still image data specified by the user. Therefore, when continuous playback (simple video playback) of continuous shot images with sound is performed, The audio data recorded during the continuous shooting period is reproduced and output as it is in accordance with the sequential reproduction and display of a plurality of shot still image data (A to D), and the image / sound timing does not feel uncomfortable. In addition to being able to play a movie, even if individual still image data selected and specified in advance is played with sound, it is audio data recorded at the time of shooting the specified still image. The possible simultaneous playback output, it is possible to perform the voice with individual still image playback with no discomfort.

  In the image and sound recording function of the third embodiment, after the continuous shooting with sound recording, the sound data recorded at a fixed time before and after the shooting time of the still image specified by the user is extracted, and the specified still image is recorded. Although it is configured to store and manage in association with image data, along with still image extraction accompanying user operation at an arbitrary timing during moving image recording, like the image and sound recording function described in the next fourth embodiment, A configuration may be adopted in which input audio at the same timing is recorded and stored and managed in association with the extracted still image data.

  According to this, even when an individual still image extracted during moving image shooting is reproduced with sound, it is possible to reproduce and output the recorded sound corresponding to the still image without a sense of incongruity.

(Fourth embodiment)
FIG. 9 is a flowchart showing image / audio recording processing of the fourth embodiment by the digital camera 10.

  FIG. 10 is a diagram showing an image / sound recording state and a management state of the recorded data associated with the image / sound recording process of the fourth embodiment by the digital camera 10.

  When a pressing operation of the moving image shutter in the key input unit 14 is detected (step D1), shooting and recording of moving image data input by the image input unit 15 is started (step D2).

  During the moving image data shooting / recording process, when a pressing operation of the still image shutter at a user's arbitrary timing is detected (step D3), as shown in FIG. 10A, the moving image data is shot. After the recording process is temporarily interrupted (step D4), recording of the voice input by the voice input unit 16 is started (step D5), and still image data at that time is shot and recorded (step D6). The recording of the voice is finished (step D7). Then, the shooting and recording process of the moving image data is resumed (step D8).

  Thereafter, when the re-pressing operation of the moving image shutter is detected (step D9), the moving image data shooting and recording process is ended, and the recording of the previous and next moving images temporarily suspended due to the still image shooting is completed. Data are combined and stored (step D10).

  Then, the still image data photographed and recorded with the pressing operation of the still image shutter is stored and managed in the memory 12 in association with the audio data recorded at that time (step D11).

  Therefore, according to the image and sound recording function of the fourth embodiment by the digital camera 10 having the above-described configuration, the input sound at the time of still image extraction is extracted along with the extraction of still image data accompanying user operation at an arbitrary timing during moving image shooting. Can be stored and managed in association with the still image data, so that it is possible not only to shoot and play a movie, but also to play back individual still images extracted during the shooting of the movie. Recorded audio can be played without any discomfort.

  The method described in each of the above embodiments, that is, the image / audio recording process of the first embodiment shown in the flowchart of FIG. 2, the image / audio recording process of the second embodiment (part 1) shown in the flowchart of FIG. 6 is the image / audio recording process of the second embodiment (part 2) shown in the flowchart of FIG. 6, the image / audio recording process of the third embodiment shown in the flowchart of FIG. 7, and the image / audio recording process of the fourth embodiment shown in the flowchart of FIG. Each method such as memory card (ROM card, RAM card, etc.), magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, etc. The external storage medium 13 can be stored and distributed. The computer of the digital camera 10 reads the program stored in the external storage medium 13 into the memory 12, and the operation is controlled by the read program, so that the continuous shooting described in each embodiment or An audio recording function corresponding to an individual still image associated with moving image shooting can be realized, and the same processing can be executed by the method described above.

  In addition, program data for realizing each of the above methods can be transmitted on a network (public line) in the form of a program code, and the memory 12 of the digital camera 10 is connected by a communication terminal device connected to the network. It is also possible to incorporate the program data into the above and realize an audio recording function corresponding to individual still images accompanying the above-described continuous shooting or moving image shooting.

  Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in each embodiment or some configuration requirements are combined, the problems described in the column of problems to be solved by the invention can be solved, When the effects described in the “Effects of the Invention” can be obtained, a configuration in which these constituent elements are deleted or combined can be extracted as an invention.

1 is a block diagram showing a configuration of an electronic circuit of a digital camera 10 according to an embodiment of an image / audio recording apparatus of the present invention. 3 is a flowchart showing image / audio recording processing of the first embodiment by the digital camera 10; FIG. 3 is a diagram showing an image / sound recording state and a management state of recorded data associated with the image / sound recording process of the first embodiment by the digital camera. 6 is a flowchart showing image / audio recording processing of the second embodiment (part 1) by the digital camera 10; The figure which shows the recording state of the image and sound accompanying the image sound recording process of 2nd Embodiment by the said digital camera 10, and the management state of the recorded data. 7 is a flowchart showing image / audio recording processing of the second embodiment (part 2) by the digital camera 10; 10 is a flowchart showing image / audio recording processing of the third embodiment by the digital camera 10; The figure which shows the recording state of the image and sound accompanying the image sound recording process of 3rd Embodiment by the said digital camera 10, and the management state of the recording data. 10 is a flowchart showing image / audio recording processing of the fourth embodiment by the digital camera 10; The figure which shows the recording state of the image and sound accompanying the image sound recording process of 4th Embodiment by the said digital camera 10, and the management state of the recorded data.

Explanation of symbols

10 ... Digital camera 11 ... CPU
DESCRIPTION OF SYMBOLS 12 ... Memory 13 ... External memory drive 14 ... Key input part 15 ... Image input part 16 ... Sound input part 17 ... Monitor (image / sound)

Claims (6)

An image audio recording apparatus having a photographing means and an audio input means,
Continuous shooting control means for continuously shooting a plurality of still images by the shooting means;
A sound level determination means for determining whether or not the sound input by the sound input means exceeds a certain level during the continuous shooting control by the continuous shooting control means;
Voice recording means for recording voice input by the voice input means in accordance with continuous shooting control of a plurality of still images by the continuous shooting control means;
Of the plurality of still images continuously shot by the continuous shooting control means, the voice recording means for the still image shot when the voice level determination means determines that a sound exceeding a certain level has been input. A still image audio correspondence storage means for storing the audio recorded in association with each other;
An audio / video recording apparatus comprising: The voice recording unit is configured to perform a continuous shooting control of a plurality of still images by the continuous shooting control unit, and when the voice level determining unit determines that the level exceeds a certain level, Record the voice input by the voice input means in between,
The still image / sound correspondence storage means is photographed in a period when a sound exceeding a certain level is input by the sound level determination means among a plurality of still images continuously shot by the continuous shooting control means. The recorded still image is stored in association with the sound recorded by the sound recording means.
The video / audio recording apparatus according to claim 1, wherein: Among the recorded voices by the voice recording means, comprising: recorded voice extraction means for extracting the voice recorded in a period in which the voice level judgment means judges that a voice exceeding a certain level has been input,
The still image / sound correspondence storage means is photographed in a period when a sound exceeding a certain level is input by the sound level determination means among a plurality of still images continuously shot by the continuous shooting control means. Storing the voice extracted by the recorded voice extraction means in association with the still image that has been recorded.
The video / audio recording apparatus according to claim 1, wherein: An image audio recording apparatus having a photographing means and an audio input means,
Continuous shooting control means for continuously shooting a plurality of still images by the shooting means;
A voice recording means for recording the voice input by the voice input means in accordance with the continuous shooting control of a plurality of still images by the continuous shooting control means;
Image designation control means for allowing a user to designate an arbitrary still image among a plurality of still images continuously photographed by the continuous shooting control means,
Recorded sound extraction means for extracting recorded sound when a user-designated still image is taken out of the sound recorded by the sound recording means,
Of the plurality of still images continuously shot by the continuous shooting control means, the voice extracted by the recorded voice extraction means is associated with the still image specified by the user under the control of the image designation control means. Storage means for storing still image audio;
An audio / video recording apparatus comprising: An image audio recording apparatus having a photographing means and an audio input means,
Moving image shooting control means for shooting a moving image by the shooting means;
Still image capture designation control means for allowing the user to designate capture of a still image at an arbitrary timing during moving image capture control by the moving image capture control means,
Still image shooting control for temporarily stopping the moving image shooting control by the moving image shooting control unit and shooting the still image by the shooting unit when the still image loading specification control unit specifies the still image loading. Means,
Voice recording means for recording the voice input by the voice input means in accordance with the still picture shooting control means when a still image is shot;
A still image audio corresponding storage means for storing the audio recorded by the audio recording means in association with the still image captured by the control of the still image shooting control means;
An audio / video recording apparatus comprising: An image sound recording control program for controlling a computer of an image sound recording apparatus having a photographing means and a sound input means,
The computer,
Continuous shooting control means for continuously shooting a plurality of still images by the shooting means;
A sound level determining means for determining whether or not the sound input by the sound input means exceeds a certain level during the continuous shooting control by the continuous shooting control means;
Voice recording control means for recording in the memory the voice input by the voice input means in accordance with continuous shooting control of a plurality of still images by the continuous shooting control means;
Of the plurality of still images continuously shot by the continuous shooting control unit, the voice recording control is performed on the still image shot when the voice level determination unit determines that a sound exceeding a certain level is input. Still image audio correspondence management means for managing the sound recorded in the memory in association with the means,
A computer-readable image / sound recording control program that functions as a computer.

Images