JP5168375B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program suitable for a digital camera or the like that can record audio together with still image shooting.

  Many digital cameras employ a function capable of storing audio data together with still image shooting, and associating the obtained still image data with audio data and recording them as one data file.

  In this type of digital camera, voice recording is started with a still image shooting timing by a shutter key operation as a trigger, and the shutter key is operated again, or when a maximum time (for example, 10 [seconds]) has elapsed. Then, the storage of the sound is stopped and the acquired sound data is recorded in association with the image data of the still image in accordance with the DCF (Design rule for Camera File system) standard.

  In addition, as described above, instead of starting from the still image shooting timing, the audio data is continuously stored in the buffer memory while being updated in advance, and the audio data for each fixed time before and after the still image shooting timing is the center. There is also a technique that can record these. (For example, Patent Document 1)

JP 2004-297177 A

  Including the technique described in Patent Document 1, the audio data acquisition timing is uniformly determined based on the associated still image shooting timing, that is, the timing at which the shutter button is pressed. However, the optimal shooting timing for still images does not always match the optimal timing for acquiring the corresponding audio as it is, and some recording sounds that are necessary for actual shooting are interrupted. It is also possible that

  The present invention has been made in view of the above circumstances, and the purpose of the present invention is not determined only by the shooting timing of a still image at the time of shooting a still image with sound, but can be acquired according to the situation. An object of the present invention is to provide an imaging apparatus, an imaging method, and a program capable of appropriately controlling each timing of start and end.

According to the present invention, there are provided an imaging unit for capturing a still image, a voice input unit for inputting voice, a registration unit for registering a voice print of an arbitrary person in advance, and a voice voice pattern input to the voice input unit described above. An audio period determining unit that determines an acquisition start timing and an acquisition end timing including a still image shooting timing in the imaging unit according to a period that coincides with a voice print of a person registered in the registration unit; and the imaging unit The recording unit that records the still image and the sound captured in step S3, and the audio input to the audio input unit from the acquisition start timing to the acquisition end timing determined by the audio period determination unit are cut out, and the cut out audio is captured Recording control means for recording in the recording means in association with the still image obtained by the means, and voice in which the voiceprint of the person registered in the registration means matches the voiceprint When a plurality of associated still images are recorded in the recording unit, an image reconstructing unit for creating a new image with sound by collecting the corresponding still images and recording the image with the recording unit is provided. An imaging apparatus or an imaging method and program thereof characterized by the above.
According to another aspect of the present invention, there is provided an imaging unit that captures a still image, an audio input unit that inputs audio, and the imaging according to a period in which a sound quality of audio input to the audio input unit satisfies a predetermined condition. A sound period determining means for determining the acquisition start timing and the acquisition end timing of the sound including the still image capturing timing at the means, a recording means for recording the still image and sound captured by the imaging means, and the sound period. Recording control means for cutting out the sound input to the sound input means from the acquisition start timing to the acquisition end timing determined by the determination means, and recording the cut sound in association with the still image obtained by the imaging means. The sound period determining means detects the voice of a specific person at the still image shooting timing, and then Based on the time to voice of the particular person detected by the timing is not detected, an imaging device, or imaging method and a program thereof, characterized in that to determine the acquisition end timing of the voice.

  According to the present invention, when capturing a still image with sound, it is possible to appropriately control the start and end timings of sound acquisition according to the situation without being determined only by the still image capturing timing.

1 is a block diagram showing a functional configuration of an electronic circuit of a digital camera according to a first embodiment of the present invention. The flowchart which shows the processing content at the time of still image photography with a sound concerning the embodiment. The figure explaining acquisition and recording of sound data concerning the embodiment. The flowchart which shows the processing content at the time of still image photography with a sound concerning the 2nd Embodiment of this invention. The figure explaining acquisition and recording of sound data concerning the embodiment. The figure which shows an example of the image for slideshows concerning the embodiment.

(First embodiment)
A first embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.

  FIG. 1 shows a circuit configuration of a digital camera 10 according to the present embodiment. In the figure, a light image of a subject is formed on the imaging surface of a CCD 12 that is a solid-state imaging device by an optical lens unit 11 disposed on the front surface of the camera casing.

  In the monitor state, also referred to as through image display or live view image display, the image signal obtained by imaging with the CCD 12 is sent to the image processing unit 13 to execute correlation square sampling, automatic gain adjustment, and A / D conversion processing. And digitize. The image processing unit 13 further performs color process processing including pixel interpolation processing and γ correction processing on the digital image data, and then temporarily stores the digital data in the image buffer 14 via the system bus SB.

  The image data held in the image buffer 14 is read out to the image processing unit 13 via the system bus SB, sent again to the display unit 15 via the system bus SB, and displayed as a through image.

  Similarly to the optical lens unit 11, a microphone 16 having an acoustic directivity substantially equal to the shooting angle of view of the optical lens unit 11 is disposed on the front surface of the camera housing, and audio in the subject direction is input. The microphone 16 converts the input sound into an electrical signal and outputs it to the sound processing unit 17.

  The voice processing unit 17 converts the voice signal input from the microphone 16 into digital data when recording the voice, and temporarily stores it in the voice buffer 18 constituted by a ring buffer. Furthermore, the audio processing unit 17 partially cuts out audio data stored in the audio buffer 18 as necessary, and compresses the data in a predetermined data file format, for example, AAC (moving picture experts group-4 Advanced Audio Coding) format. An audio data file is created and sent to a recording medium to be described later.

  In addition, the sound processing unit 17 includes a sound source circuit such as a PCM sound source, and uncompresses and converts the sound data file sent at the time of sound reproduction into an analog signal, and drives a speaker 19 provided on the back side of the digital camera 10. Then, a loud sound is emitted.

  The control unit 20 performs overall control of the above circuit. The control unit 20 is composed of a CPU and is directly connected to the main memory 21 and the program memory 22. The main memory 21 is composed of SDRAM (synchronous DRAM) and functions as a work memory. The program memory 22 is composed of an electrically rewritable non-volatile memory, and fixedly stores an operation program including control in a shooting mode to be described later, voice print data of a specific person, and the like.

  The control unit 20 reads out necessary programs, data, and the like from the program memory 22 and executes the control operation of the entire digital camera 10 while temporarily expanding and storing it in the main memory 21 as appropriate.

  Further, the control unit 20 executes various control operations in response to key operation signals directly input from the key input unit 23. In addition to the image processing unit 13, the image buffer 14, and the display unit 15, the control unit 20 further includes a lens driving unit 24, a flash driving unit 25, a CCD driver 26, a compression / decompression processing unit 27, and a memory card. A controller 28 and a USB interface (I / F) 29 are also connected.

  The key input unit 23 includes, for example, a power key, shutter key, zoom key, shooting mode key, playback mode key, menu key, cursor (“↑”, “→”, “↓”, “←”) key, set key, scene program key, and the like. Is provided.

  The lens driving unit 24 receives a control signal from the control unit 20 and controls the rotation of the lens stepping motor (M) 30, and a part of the plurality of lenses constituting the optical lens unit 11, specifically, Moves the position of the focus lens and the zoom lens individually along the optical axis direction.

  The flash drive unit 25 receives a control signal from the control unit 20 during still image shooting, and drives the flash unit 31 including a plurality of white high-intensity LEDs to be lit in synchronization with the shooting timing.

  The CCD driver 26 operates and drives the CCD 12 according to the photographing conditions set at that time.

  The compression / decompression processing unit 27 converts the image data stored in the image buffer 14 into a predetermined data file format, for example, DCT if it is a JPEG (Joint Photographic Experts Group), at the time of shooting an image accompanying the shutter key operation of the key input unit 23. Data compression processing such as (discrete cosine transform) and Huffman coding is performed to create an image data file with a greatly reduced data amount. The created image data file is recorded on the memory card 32 via the system bus SB and the memory card controller 28.

The compression / decompression processing unit 27 receives the image data read from the memory card 32 via the memory card controller 28 in the playback mode via the system bus SB, and decompresses the decompression process in the reverse order of the recording process. Thus, the original size image data is obtained and held in the image buffer 14 via the system bus SB. Then, display for reproduction is executed on the display unit 15 by the image data held in the image buffer 14.
The memory card controller 28 is connected to the memory card 32 via the card connector 33. The memory card 32 is a memory for recording image data and the like, which is detachably attached to the digital camera 10 and serves as a recording medium for the digital camera 10, and has a nonvolatile memory that can be electrically rewritten in units of blocks. A flash memory and a driving circuit thereof are provided.

  The USB interface 29 controls transmission / reception of data when the digital camera 10 is connected to an external device such as a personal computer via the USB connector 34.

Next, the operation of the above embodiment will be described.
In the following operation, when a still image is shot in the shooting mode, the control unit 20 uses the operation program and data stored in the program memory 22 and the voice print data of a registered specific person's voice. The data is read out, developed and stored in the main memory 21, and then executed.

  For example, when the digital camera 10 is upgraded, the operation program stored in the program memory 22 is stored in the program memory 22 when the digital camera 10 is shipped from the factory. And a new operation program, data, etc. downloaded and stored from the outside via the USB connector 34 and the USB interface 29.

  The shutter key that constitutes a part of the key input unit 23 has a two-step operation stroke. The first-step operation stroke (hereinafter referred to as “half-press”) enters a shooting preparation state, and AF (automatic) It is assumed that the in-focus position and the AE (automatic exposure) process are executed to lock the in-focus position and the exposure value, and further, shooting is performed with a second stage operation stroke (hereinafter referred to as “full press”).

  FIG. 2 mainly shows the processing contents of handling of audio data in the still image shooting mode with audio. Initially, it is determined whether or not the shutter key of the key input unit 23 has been pressed halfway, thereby waiting for the shutter key to be pressed halfway (step S101).

  When the shutter key is half-pressed, it is determined in step S101, the focus position and exposure value are locked as described above, and the microphone 16, the audio processing unit 17, and the audio buffer 18 are used. The sound circulation storage is started (step S102).

  In this audio cyclic storage state, the storage capacity of the audio buffer 18 composed of a ring buffer is effectively used, and new audio data is acquired and accumulated while sequentially deleting old audio data, so that the past data is always stored in the past. Audio data for a fixed time, for example, 30 seconds is temporarily stored.

  It is determined whether or not the shutter key of the key input unit 23 is further fully pressed while continuing the sound circulation storage (step S103). If it is determined that the shutter key is not fully pressed, it is then determined whether or not the half-pressed state of the shutter key is released (step S104).

  If the half-pressed state of the shutter key is maintained, the process returns to step S103 again. Thereafter, the processes in steps S103 and S104 are repeatedly executed to wait until the shutter key is fully pressed or the half-pressed state is released.

  When the half-pressed state of the shutter key is released, it is determined in step S104, and the circulating storage state of the voice in the voice buffer 18 is stopped (step S105). In order to wait for the pressing operation, the process returns to step S101.

  If the shutter key is fully pressed while the processes of steps S103 and S104 are repeatedly executed, the determination is made in step S103, and the image is stopped according to the focus position and the exposure value locked at that time. The actual shooting of the image is executed, and the image data obtained by shooting is compressed by the compression / decompression processing unit 27 into a data file and recorded in the memory card 32 (step S106).

  At the same time, a clipping process is performed according to the state of the audio data stored in the audio buffer 18 at that time. That is, it waits for the audio data stored in the audio buffer 18 to be in a state of continuing for a preset time, for example, 3 seconds or more, at a preset sound pressure or higher (step S107).

  Then, when it is determined that the voice data is in a state where the voice data is equal to or higher than a preset sound pressure and has been continued for a preset time, the voice data to be stored in the voice buffer 18 is set in advance below a preset sound pressure. It waits for a period of time, for example, 10 seconds or longer (step S108).

  Then, when it is determined that the voice data is less than a preset sound pressure and has continued for a preset time or more, the voice data has continued for a preset time or more for a preset time Is set to be the end position of the section of the audio data corresponding to the photographed still image (step S109).

  Thus, the circular storage of audio data in the audio buffer 18 is stopped (step S110).

  Next, processing for determining the storage state of the audio data in the audio buffer 18 is started retrospectively before the shutter key is fully pressed (step 111).

  In the determination process going back this time, a search is performed for a portion in which the audio data continues for a preset time, for example, 3 seconds or more, at a preset sound pressure or higher (step S112).

  Then, the sound data further goes back from the time position where the sound data has been set to a state higher than a preset sound pressure and continued for a preset time, and then continued for a preset time, for example, 10 seconds or less, below the preset sound pressure. The part is searched (step S113).

  When a state in which the audio data is less than a preset sound pressure and continues for a preset time is detected, the start position where the sound pressure is greater than or equal to the preset sound pressure is detected as the captured still image. The start position of the corresponding audio data section is set (step S114).

  Thus, since the start position and end position of the section of the audio data stored in the audio buffer 18 are determined, the audio processing unit 17 cuts out the audio data in the range and compresses the data. An audio data file associated with the still image recorded in step S106 is created and recorded on the memory card 32 by the memory card controller 28 (step S115), and the series of processing shown in FIG.

  When the file name of the still image data recorded on the memory card 32 is, for example, “CIMG0001.JPG”, when storing the audio data file in association with the still image data, the file name is changed as described above. By setting the same, for example, “CIMG0001.AAC” may be set.

  In this case, due to having the same file name “CIMG0001” and the extension, the still image data file “CIMG0001.JPG” recorded in the JPEG format and the audio data file “CIMG0001.JPG” recorded in the AAC format are used. It can be seen that “AAC” is associated. Accordingly, at the time of reproduction, both these files may be read out from the memory card 32 in parallel, and the corresponding audio data may be emitted from the speaker 19 while the still image data is displayed on the display unit 15.

  FIG. 3 exemplifies a case where audio is temporarily stored at the time of still image shooting and a voice section related to a still image is cut out and recorded from the stored contents. As shown in FIG. 3A, the temporary storage of the audio data in the audio buffer 18 is started at the timing t11 when the shutter key of the key input unit 23 is half-pressed.

  Thereafter, audio data is sequentially stored in the audio buffer 18. When the audio data becomes full in the audio buffer 18, thereafter, the old audio data is deleted and at the same time the new audio data input at that time is stored. As a result, the audio buffer 18 always stores audio data for a fixed time according to the storage capacity.

  Thereafter, the storage of the audio data in the audio buffer 18 is continued even after the shutter key is fully pressed at timing t12 and still image shooting is executed. Then, the recording is temporarily terminated at a timing t13 when a predetermined time has elapsed after the sound is interrupted and becomes less than a preset sound pressure.

  In this way, the audio data in the above-described section including the shooting timing t12 is cut out from the audio data stored in the audio buffer 18.

  FIG. 3B shows that the sound pressure of the audio data is lower than the preset sound pressure level at the still image capturing timing t12, and the preset sound pressure level is set at each of the timing before and after that. The change of the sound pressure P when the above continues for the preset time or more is shown.

  In such a case, by the processing described with reference to FIG. 2, the audio section for recording the start position of the section located on the front side of the photographing timing t12 and continuing for a preset time or more at a preset sound pressure level or more. The start timing t14. Similarly, the end position of the section located behind the shooting timing t12 and continuing for a preset time or more is set as the end timing t15 of the recording voice section.

  As a result, a section from timing t14 to timing t15 including two sections before and after a preset sound pressure level continues for a preset time or more with a shooting timing t12 by pressing the shutter key fully pressed is cut out as audio data. And recorded in association with still image data.

  FIG. 3C shows the change in the sound pressure P when the sound pressure of the audio data is equal to or higher than a preset sound pressure level and continues for a preset time at the still image capturing timing t12. Show.

  In such a case, the processing described with reference to FIG. 2 described above is performed to record the start position of the section where the shooting timing t12 itself exists and where the sound pressure level that has been set in advance continues for a preset time or longer. The section start timing is t16. Similarly, the end position of the section where the shooting timing t12 itself is located and where the sound pressure level set in advance is continued for the preset time or longer is set as the end timing t17 of the recording voice section.

  As a result, a section from the timing t16 to the timing t17 including the section in which the predetermined sound pressure level or higher continues for the preset time or more including the shooting timing t12 itself when the shutter key is fully pressed is cut out as audio data. Recorded in association with still image data.

  In the operation example shown in FIG. 2, it is ensured that audio data of at least 3 seconds before and after is recorded in association with a still image even when there is no audio at the time of shooting. Further, it is guaranteed that the recorded audio data has no audio interruption for 10 seconds or more. However, the case where a sound interruption of up to 20 seconds occurs before and after the photographing timing is allowed.

  In both steps S107 and S112, the sound data waits for a preset time at a preset sound pressure or higher, for example, for 3 seconds or more. This standby state is, for example, 20 seconds or more. If it is not desired to detect a sound with a predetermined sound pressure or higher even after a lapse of time, the standby state may be canceled and recording of the sound data may be stopped.

  In this way, it is possible to prevent even audio data that is generated at a timing that is completely unrelated to the imaging timing and has no continuity with the audio at the imaging timing from being recorded in association with the still image.

  Similarly, in steps S108 and S113, it is assumed that the voice data waits for a preset time less than the preset sound pressure, for example, 10 seconds or more. For example, recording of audio data may be stopped if the specified state is not detected even after 30 seconds have elapsed. In this way, it is possible to limit the maximum length of audio data recorded in association with one still image and prevent the audio data from being unnecessarily prolonged.

  Furthermore, in the above operation example, the standby times are set to 3 seconds, 10 seconds, 3 seconds, and 10 seconds in order, but each time may be arbitrarily set according to the shooting situation.

  As described above in detail, according to the present embodiment, at the time of still image shooting with sound, it is not determined uniformly only by the shooting timing of the still image, but each of the start and end of acquisition corresponding to the state of the sound. The timing can be appropriately controlled.

  In the above embodiment, the sound acquisition start timing and acquisition end timing are determined based on a period in which the sound pressure of the sound stored in the sound buffer 18 is maintained at a predetermined level or higher. Can be reproduced more faithfully.

  Furthermore, in the above-described embodiment, as described with reference to FIG. 3B, even when a sound having an appropriate sound pressure cannot be obtained at the timing of shooting, a section where an appropriate sound pressure can be obtained before and after the sound is obtained. Since the recording is extended, the situation at the time of shooting can be faithfully reproduced without a sense of incongruity.

(Second Embodiment)
A second embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.

  The circuit configuration of the digital camera 10 ′ according to the present embodiment is basically the same as that shown in FIG. 1, and therefore the same reference numerals are used for the same parts, and the illustration and explanation thereof are as follows. Omitted.

  In addition, in the present embodiment, voice prints of a plurality of persons can be registered in the program memory 22 in advance, and the voice processing unit 17 inputs the voice prints of the persons registered in the program memory 22 from the microphone 16 and the voice buffer 18. Assume that it has an analysis function for comparing and matching the voiceprints in the voice data stored in.

  In addition, the sound processing unit 17 has various sound processing functions such as an analysis function for determining whether or not a voice input from the microphone 16 includes a human voice at a predetermined sound pressure level or higher. .

Next, the operation of the above embodiment will be described.
In the following operation, when a still image is shot in the shooting mode, the control unit 20 uses the operation program and data stored in the program memory 22 and the voice print data of a registered specific person's voice. The data is read out, developed and stored in the main memory 21, and then executed.

  For example, when the digital camera 10 is upgraded, the operation program stored in the program memory 22 is stored in the program memory 22 when the digital camera 10 is shipped from the factory. And a new operation program, data, etc. downloaded and stored from the outside via the USB connector 34 and the USB interface 29.

  FIG. 4 mainly shows the processing contents of handling audio data in the still image shooting mode with audio.

  Initially, a voice print of a person who is a recording target of a sound accompanying a still image shooting is selected and specified from the voice prints of the person registered in advance in the program memory 22 (step S201).

  When this voiceprint is designated, a list of registered voiceprint character names is displayed on the display unit 15 together with a guide message for prompting a key operation on the key input unit 23 to designate one of the voiceprints. It is assumed that when a name is selected, a voice print of the selected person name is designated.

  Thereafter, it is determined using the voice processing unit 17 whether or not the voice input from the microphone 16 includes a human voice (step S202).

  Here, the voice processing unit 17 analyzes the frequency spectrum of the voice input from the microphone 16 and determines whether or not the voice level is higher than a predetermined value in the frequency band specific to the human voice. Determine if voice is included.

  By repeating the same process until it is determined in step S202 that the voice input from the microphone 16 includes a human voice, the process waits for a human voice to be input.

  Then, if it is determined in step S202 that a human voice is included, then the sound storage using the microphone 16, the sound processing unit 17, and the sound buffer 18 is started (step S203).

  In this audio cyclic storage state, the storage capacity of the audio buffer 18 composed of a ring buffer is effectively used, and new audio data is acquired and accumulated while sequentially deleting old audio data, so that the past data is always stored in the past. Audio data for a fixed time, for example, 30 seconds is temporarily stored.

  It is determined whether or not the shutter key of the key input unit 23 has been operated while continuing the circular storage of the sound (step S204). Until it is determined that the shutter key has been operated, the same processing is repeatedly executed to wait for the operation of the shutter key while continuing to store the audio data.

  When the shutter key is operated, it is determined in step S204, the still image is actually captured, and the image data obtained by the capture is compressed by the compression / decompression processing unit 27 into a data file. 32 (step S205).

  At the same time, the sound input from the microphone 16 at that time is analyzed (step S206). As a result of this analysis, it is determined whether or not the voice of the person specified in step S201 is included in the current voice (step S207).

  If it is determined that the voice print of the designated person is included, the voice print of the designated person is set as a recording target as designated in step S201 (step S208).

  If it is determined that the voice print of the person specified in step S207 is not included, all the voice prints of the analyzed persons are set as recording targets (step S209).

  Thereafter, it is repeatedly determined whether or not the period during which the voice print of the person to be recorded set in step S208 or step S209 cannot be detected is a certain time, for example, 10 seconds or more (step S210).

  Here, when it is determined that there is a period during which the voice print of the person to be recorded cannot be detected for a certain time or more, the voice of the person to be recorded has stopped for a certain time. The detected time is set as the end position of the section of the audio data corresponding to the photographed still image (step S211).

  Next, a process for determining the storage state of the audio data in the audio buffer 18 is started retroactively before the shutter key is fully pressed (step S212).

  In the determination process going back this time, a search is performed for a portion where the designated voiceprint detection continues for a preset time, for example, 3 seconds or more (step S213).

  As a result of the search, the start position in a state where the specified voice print detection continues for a preset time or longer is set as the start position of the section of the audio data corresponding to the photographed still image (step S214).

  Thus, since the start position and end position of the section of the audio data stored in the audio buffer 18 are determined, the audio processing unit 17 cuts out the audio data in the range and compresses the data. An audio data file associated with the still image recorded in step S205 is created and recorded in the memory card 32 by the memory card controller 28 (step S215).

  Thereafter, it is further determined using the voice processing unit 17 whether or not the voice input from the microphone 16 at that time includes a human voice (step S216).

  If it is determined that the voice input from the microphone 16 includes a human voice, the process returns to step S204 in order to continuously capture the next still image.

  In this way, while the human voice is included in the voice input from the microphone 16, the processes from the above steps S204 to S216 are repeatedly executed.

  If it is determined that the voice input in step S216 does not contain a human voice, the circular storage of the voice data in the voice buffer 18 is stopped (step S217).

  After that, apart from the recorded still image data file, one image for reproducing them as a slide show based on a plurality of captured still image data and audio data recorded corresponding to each still image data. A data file, specifically, for example, a motion JPEG file with an extension “.AVI” is created and recorded in the memory card 32 (step S218), and the series of processing shown in FIG.

  FIG. 5 exemplifies a case where audio is temporarily stored at the time of still image shooting and a voice section related to a still image is cut out and recorded from the stored contents.

  As shown in FIG. 5B, temporary storage of audio data in the audio buffer 18 is started at a timing t21 when a human voice is input and recognized by the audio processing unit 17. However, since the voice of the person at this time is that of another person A who has not been registered in advance, it is not determined to be a recording target at this time.

  Thereafter, audio data is sequentially stored in the audio buffer 18. When the audio data becomes full in the audio buffer 18, thereafter, the old audio data is deleted and at the same time the new audio data input at that time is stored. As a result, the audio buffer 18 always stores audio data for a fixed time according to the storage capacity.

  Further, the voice of another person B who is not registered as shown in FIG. 5C and the voice of his child who has been registered as shown in FIG. 5D and specified at the beginning of the process shown in FIG. Are sequentially input with a time difference.

  After that, after the shutter key is operated at timing t22 and still image shooting is performed, the voice data is continuously stored in the voice buffer 18 as long as a human voice is input including registration / unregistration. Then, the recording is temporarily terminated at a timing t23 when the voice of the human voice is interrupted and becomes less than the preset sound pressure.

  In this way, the audio data in the above-described section including the shooting timing t22 is cut out from the audio data stored in the audio buffer 18.

  In this case, as shown in FIG. 5 (D), since the voice of his / her child who has been specified and has been registered is included in the sound including the photographing timing t22, the sound processing unit 17 performs the processing shown in FIG. The voice of the child shown in (D) is analyzed and recognized, and the voice section is recorded from the start timing t24 at which a match with the designated voiceprint is detected to the end timing t25 at which no match can be detected.

  As a result, the interval from the timing t24 at which the voice matching the designated voiceprint starts to be input to the timing t25 at which the input of the voice matching the designated voiceprint is interrupted is sandwiched between the shooting timing t22 by the operation of the shutter key. And recorded in association with still image data.

  In FIG. 5, when the input of the voice of his / her child designated in advance shown in FIG. 5 (D) is not detected, the voice is not a designated voice print but is a human voice instead. The section in which the voice of the other person A shown in FIG. 5B and the voice of the other person B shown in FIG. 5C are input is cut out and recorded in association with the still image data.

  FIG. 6 shows a case where the digital camera 10 'is turned on by the process of FIG. 4 and a human voice is continuously inputted, and a child's athletic meet is continuously photographed without turning off the power. FIG. 4 illustrates image data automatically created for slide show display.

  In this case, still images are taken for each eye shown in FIGS. 6 (A) to 6 (E), and if the designated child's voice is included in the audio data, the child's voice is detected. If the designated child's voice is not included in the range, an audio data file is created in association with the still image data in the range where the human voice is continuously input.

  For this reason, when the human voice is completely interrupted, image data for a slide show using the still image of FIGS. 6A to 6E and the corresponding audio is separately created by the process of step S218, and the memory card 32.

  At the time of reproducing the image data for the slide show, the still images in FIGS. 6A to 6E and the corresponding audio are continuously reproduced in an endless manner until the stop of the reproduction is instructed.

  As described above in detail, according to the present embodiment, the voice acquisition start timing and the acquisition end based on a period of time that satisfies a predetermined condition of a specific sound quality, such as a human voice, with respect to the temporarily stored voice. Since the timing is determined, by setting the sound quality suitable for the subject, it is possible to control the start and end timings of the sound acquisition appropriately corresponding to the situation.

  In addition, in the above embodiment, since the voice of a person is specified as the specific sound quality, the operation for setting in many cases where the subject is a person such as a snap or a portrait becomes easy, and the acquisition of the voice Can be greatly simplified.

  In the above embodiment, by registering a voice print in advance, when a voice of a specific person is detected, a section in which the voice can be obtained can be set to be recorded as audio data. Only the audio data portion suitable for the subject can be recorded as audio data in association with still image data without being confused by the human voice.

  Further, in the above embodiment, when a plurality of still image data is obtained in a series of shooting processes after the acquisition of the audio data, slide show image data is separately created from the plurality of still image data with sound. Therefore, it is possible to easily create slideshow data and enjoy viewing without bothering the user.

  In each of the first and second embodiments, the audio stored in the audio buffer 18 includes the still image shooting timing according to a period that satisfies a predetermined condition without exceeding a preset missing period. Since the acquisition start timing and the acquisition end timing are determined, the storage capacity of the audio buffer 18 is effectively used, and a soundless portion that seems to be unrelated to the image is not included in the audio. Can record audio data in line with the actual situation.

  In the above embodiment, the present invention is applied to a digital camera. However, the present invention is not limited to this, and a video movie camera, a mobile phone terminal having a camera function, a mobile computer equipped with a web camera, etc. The present invention can be similarly applied to other various electronic devices.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the embodiment, if an effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

  DESCRIPTION OF SYMBOLS 10,10 '... Digital camera, 11 ... Optical lens unit, 12 ... CCD, 13 ... Image processing part, 14 ... Image buffer, 15 ... Display part, 16 ... Microphone, 17 ... Sound processing part, 18 ... Sound buffer (ring) Buffer), 19 ... Speaker, 20 ... Control unit, 21 ... Main memory, 22 ... Program memory, 23 ... Key input unit, 24 ... Lens drive unit, 25 ... Flash drive unit, 26 ... CCD driver, 27 ... Compression / decompression process , 28 ... Memory card controller, 29 ... USB interface (I / F), 30 ... Lens stepping motor (M), 31 ... Flash unit, 32 ... Memory card, 33 ... Card connector, 34 ... USB connector, SB ... System bus.

Claims (9)

Imaging means for capturing still images;
Voice input means for inputting voice;
Registration means for registering a voice print of an arbitrary person in advance;
The voice acquisition start timing and the acquisition end including the still image shooting timing in the imaging unit according to the period in which the voice print of the voice input to the voice input unit coincides with the voice print of the person registered in the registration unit An audio period determining means for determining timing;
Recording means for recording a still image and sound taken by the imaging means;
The audio input to the audio input unit from the acquisition start timing to the acquisition end timing determined by the audio period determination unit is cut out, and the cut out audio is recorded in the recording unit in association with the still image obtained by the imaging unit. Recording control means;
When a plurality of still images associated with a voice whose voice print matches a person's voice print registered in the registration means are recorded in the recording means, the corresponding still images are combined to create a new image with sound. And an image reconstructing unit that causes the recording unit to record the image. Imaging means for capturing still images;
Voice input means for inputting voice;
A sound period determining means for determining a sound acquisition start timing and an acquisition end timing including a still image shooting timing in the image pickup means according to a period in which the sound quality of the sound input to the sound input means satisfies a predetermined condition. When,
Recording means for recording a still image and sound taken by the imaging means;
The audio input to the audio input unit from the acquisition start timing to the acquisition end timing determined by the audio period determination unit is cut out, and the cut out audio is recorded in the recording unit in association with the still image obtained by the imaging unit. Recording control means;
Comprising
The sound period determining means detects the voice of the specific person based on a period until the voice of the specific person detected at the shooting timing is not detected after the voice of the specific person is detected at the shooting timing of the still image. An imaging apparatus characterized by determining acquisition end timing. The sound period determining means includes a timing at which the sound input to the sound input means satisfies a predetermined condition without exceeding a preset missing period and includes a still image shooting timing at the image pickup means. The imaging apparatus according to claim 1, wherein an acquisition start timing and an acquisition end timing are determined. Voice temporary storage means that continues to store while updating the voice for a predetermined time length input to the voice input means,
The sound period determining means determines the sound acquisition start timing before the still image shooting timing in the imaging means according to a period in which the sound stored in the sound temporary storage means satisfies a predetermined condition. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized in that:   The sound period determining means detects a position where the sound input to the sound input means satisfies a predetermined condition both before and after the shooting timing, and starts acquiring the sound up to the detected position. The imaging apparatus according to claim 1, wherein the timing or the acquisition end timing is extended. An imaging unit including an imaging unit that captures still images, an audio input unit that inputs audio, a recording unit that records still images and audio captured by the imaging unit, and a registration unit that registers a voice print of an arbitrary person in advance An imaging method using an apparatus,
The voice acquisition start timing and acquisition end including the still image shooting timing in the imaging unit according to a period in which the voice voiceprint input to the voice input unit matches the voiceprint of the person registered in the registration unit An audio period determining step for determining timing;
The audio input to the audio input unit from the acquisition start timing to the acquisition end timing determined in the audio period determination step is cut out, and the cut out audio is recorded in the recording unit in association with the still image obtained by the imaging unit. Recording control process;
When a plurality of still images associated with a voice whose voiceprint matches the voiceprint of the person registered in the registration unit are recorded by the recording control step, the corresponding still images are added together with a new voice. An image reconstructing step of creating an image and recording the image on the recording unit. An imaging method in an imaging apparatus including an imaging unit that captures a still image, an audio input unit that inputs audio, and a recording unit that records still images and audio captured by the imaging unit,
An audio period determining step of determining an acquisition start timing and an acquisition end timing including a still image shooting timing in the imaging unit according to a period in which sound quality of the audio input to the audio input unit satisfies a predetermined condition When,
The audio input to the audio input unit from the acquisition start timing to the acquisition end timing determined in the audio period determination step is cut out, and the cut out audio is recorded in the recording unit in association with the still image obtained by the imaging unit. Recording control process;
Have
The audio period determining step is based on a period from when a voice of a specific person is detected at the shooting timing of the still image until a voice of the specific person detected at the shooting timing is not detected. An imaging method characterized by determining an acquisition end timing. An imaging unit including an imaging unit that captures still images, an audio input unit that inputs audio, a recording unit that records still images and audio captured by the imaging unit, and a registration unit that registers a voice print of an arbitrary person in advance A program executed by a computer built in the apparatus, wherein the computer is
The voice acquisition start timing and acquisition end including the still image shooting timing in the imaging unit according to a period in which the voice voiceprint input to the voice input unit matches the voiceprint of the person registered in the registration unit Audio period determining means for determining timing;
The audio input to the audio input unit from the acquisition start timing to the acquisition end timing determined by the audio period determining unit is cut out, and the cut out audio is recorded in the recording unit in association with the still image obtained by the imaging unit. Recording control means,
In the case where a plurality of still images associated with voices whose voice prints match the person's voice print registered in the registration unit are recorded in the recording unit, the corresponding still images are combined into a new image with sound. And a program that functions as image reconstruction means for recording in the recording unit. A program executed by a computer built in an imaging apparatus including an imaging unit that captures a still image, an audio input unit that inputs audio, and a recording unit that records still images and audio captured by the imaging unit, Computer
Audio period determination for determining audio acquisition start timing and acquisition end timing including still image shooting timing in the imaging unit according to a period in which sound quality of the audio input to the audio input unit satisfies a predetermined condition And the recording means associated with the still image obtained by the imaging means and cut out the sound input to the sound input unit from the acquisition start timing to the acquisition end timing determined by the sound period determining means. Recording control means for recording to
Function as
The sound period determining means detects the voice of the specific person based on a period until the voice of the specific person detected at the shooting timing is not detected after the voice of the specific person is detected at the shooting timing of the still image. A program for determining an acquisition end timing.

Images