JP2008091978A - Imaging apparatus and image storing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To add data related to a voice to image data while suppressing an increase in the amount of data. <P>SOLUTION: During a photographing mode, a CPU 20 stores voice data in a voice memory 29. When a release button 8 is half pressed, the CPU 20 performs focus adjustment by a focus motor 32. When the release button 8 is fully pressed, photographing is performed, and photographed image data are stored in a buffer memory 24 temporarily. In this case, a feature extraction section 31 measures the amount of effective sound pressure in the voice data stored in the voice memory 29 for 2 seconds before and after with a point of time of photographing as the center. The CPU 20 adds the measured sound pressure data to the image data stored in the buffer memory 24, and stores the image data to which the sound pressure data are added in a RAM 26. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an image storage method.

  In recent years, digital cameras that can store a captured image as image data and display the stored image data on an LCD or the like so that the captured image can be viewed without printing are widely used. Printed print photos can be efficiently classified and searched by organizing them into albums or the like. On the other hand, image data taken with a digital camera has the merit that it does not deteriorate as compared with a printed photograph, but there is a problem that it takes time and effort to classify and search. Therefore, a technique has been proposed for enabling easy classification and search of stored image data (see, for example, Patent Documents 1 to 3).

  Patent Document 1 proposes an imaging apparatus that associates captured image data with explanatory data that describes a subject of the image data, a control method thereof, and a control program. As the explanation data, still picture data, text data, voice data, audio data, and moving picture data are described.

  Patent Document 2 describes an electronic camera, an image display device, and an image display method that record a voice of a subject at the time of shooting and store the recorded data in an image file in association with positional information on the subject.

Patent Document 3 proposes a digital camera that captures sound when shooting by operating a shutter button, and stores image data and sound data in association with each other in a memory.
JP 2003-198909 A JP 2003-174578 A JP 2003-283904 A

  However, Patent Documents 1 to 3 have a problem in that since the audio data is stored as it is, the amount of data increases, and the amount of image data that can be stored in the memory decreases.

  The present invention has been made to solve the above-described problems, and provides an imaging apparatus and an image storage method that can add audio data to image data while suppressing an increase in the amount of data. With the goal.

  In order to achieve the above object, an imaging apparatus of the present invention is an imaging apparatus that includes an imaging unit that performs imaging and an audio storage unit that stores external audio as audio data, and is stored in the audio storage unit. Feature extraction means for extracting feature data as features from the voice data, and associated data storage means for storing the image data photographed by the photographing means and the feature data extracted by the feature extraction means in association with each other. It is characterized by that. The feature data preferably has a smaller data amount than the audio data.

  Further, it comprises mode switching means for switching between a photographing mode for photographing with the photographing means and a control mode for performing control other than photographing, and the sound storage means stores the sound data during the photographing mode, It is preferable not to store the audio data during the control mode. Examples of the control mode include a playback mode for playing back captured image data, a setting mode for performing various settings of the imaging device, a power saving mode for reducing power consumption, and the playback mode includes an LCD or the like. When the display means is provided, the image data is reproduced and displayed on the LCD, and when the imaging device does not have the LCD, the image data is sent to a personal computer (PC) connected to the imaging device, and the PC monitor The image data is reproduced and displayed.

  Furthermore, an operation member provided so as to be operable, an operation sound generating means for generating an operation sound when the operation member is operated, and the operation sound when the operation member is operated during the photographing mode. It is preferable to include operation sound stop means for stopping the generation of operation sound by the generation means.

The voice storage means is provided so that it can be pressed, performs a shooting preparation operation when half-pressed, and further presses from the half-pressed state to perform shooting by the shooting means when fully pressed. Preferably, the storage of the audio data is started in response to the shooting button being half-pressed.

  Further, the feature extracting means is stored for a period from a first predetermined time when the photographing is performed by the photographing means to a second predetermined time when the photographing is performed by the photographing means. It is preferable to extract the feature data from the voice data.

  Preferably, the feature extraction unit extracts the feature data from audio data stored in a period from when the image was taken by the image taking unit to a third predetermined time before. .

  Further, an adjustment member that adjusts focus by moving a focus lens before photographing by the photographing means is provided, and the feature extraction means is from when the focus adjustment by the adjustment member is finished to after a fourth predetermined time. It is preferable to extract the feature data from the voice data stored during the period.

  In addition, it is preferable that the fourth predetermined time is a time from when the focus adjustment by the adjustment member is completed to when the photographing is performed by the photographing unit.

  Further, it is preferable that the audio data erasure unit for erasing the audio data that has passed the fifth predetermined time out of the audio data stored in the audio storage unit.

Furthermore, it is preferable that the feature extraction means extracts sound pressure as feature data from the sound data stored in the sound storage means. Examples of the sound pressure include sound pressure (N / m ² ) and sound pressure level (dB).

  In addition, the feature extraction means detects which voice data stored in the voice storage means is most similar to a plurality of voice model data classified in advance for each voice feature. Preferably, the level is calculated, and the calculated similarity level is extracted as the feature data. The similarity level includes one voice model data name in which the voice data is most similar among the plurality of voice model data, and a numerical value when the similarity level is expressed as a percentage. preferable. Examples of the voice model data include in-car voice model data indicating the voice in the car, in-train voice model data indicating the voice in the train, and soccer field voice model data indicating the voice in the soccer field.

  Furthermore, it is preferable that the feature extraction unit extracts data of a preset ratio of the voice data stored in the voice storage unit as the feature data.

As described above, the feature data extracted from the voice data by the feature extraction means includes sound pressure (sound pressure (N / m ² ), sound pressure level (dB), etc.), a similarity level for a plurality of sound model data, and sound data. Of these, it is preferable that the data is any one of the data set in advance, but any data that has a smaller data amount than the voice data and is characteristic can be changed as appropriate.

  Moreover, it is preferable to provide a model data storage means for storing the plurality of voice model data.

  Furthermore, it is preferable that image data search means for searching image data associated with the specified feature data from image data stored in the related data storage means based on the feature data is provided.

  Further, it is preferable to include a display unit for reproducing and displaying the image data searched by the image data search unit.

  Furthermore, the imaging device is preferably a digital camera.

  In addition, the image storage method of the present invention stores external sound as sound data when shooting, extracts feature data that is characteristic from the stored external sound data, and captures image data and extracted feature data. Are stored in association with each other.

  According to the imaging apparatus of the present invention, feature data serving as features is extracted from the sound data stored in the sound storage means, and the captured image data and the extracted feature data are stored in association with each other, so the sound data is stored as it is. Compared with the type to perform, it is possible to correlate audio data and image data while suppressing the amount of data to be stored.

  In addition, since the audio data is not stored during the control mode and is stored only during the shooting mode, it is possible to suppress power consumption related to the storage of the audio data.

  Furthermore, since the storage of the sound data is started in response to the half-press of the shooting button, it is possible to further suppress the power consumption related to the storage of the sound data.

  Furthermore, according to the image storage method of the present invention, features are extracted as feature data from external audio data stored at the time of shooting, and the captured image data and the extracted feature data are stored in association with each other. Compared with a type that stores data as it is, it is possible to associate audio data and image data while suppressing the amount of data to be stored.

  As shown in FIGS. 1 and 2, a digital camera 2 embodying the present invention is provided with a lens barrel 5 incorporating a plurality of photographing lenses 4, a microphone 6 for capturing sound, and the like on the front surface of a camera body 3. ing. On the upper surface of the camera body 3, a power button 7 that is pressed when the power is turned on / off, a release button (shooting button) 8 that is pressed when shooting, and the digital camera 2, a shooting mode for shooting and a shot image A mode changeover switch (mode changeover means) 9 or the like for changing over between the reproduction mode (control mode) for reproducing and displaying the image is provided. The lens barrel 5 is housed inside the camera body 3 when the digital camera 2 is in a power-off state, and protrudes from the front surface of the camera body 3 when the power is turned on. The mode changeover switch 9 is rotatably provided, and the mode of the digital camera 2 is changed by rotating.

  The release button 8 has a two-stage push structure. When the release button 8 is lightly pressed (half-pressed), a shooting preparation operation such as focusing is performed. When further pressed (fully pressed) in this state, a photographing operation is performed.

  On the back of the camera body 3, an LCD (display means) 10 for displaying a photographed image and various setting conditions, a menu key (operation member) 11 for switching various settings and display images, and an image to be displayed on the LCD 10 are displayed. A zoom button (operation member) 12 for zooming in and out and a speaker (operation sound generating means) 13 are provided.

  The LCD 10, the menu key 11, the zoom button 12, and the speaker 13 are connected to a CPU 20 (see FIG. 3) that controls driving of the digital camera 2. When the user operates the menu key 11 and the zoom button 12 when the digital camera 2 is in the playback mode, the CPU 20 emits an operation sound indicating that the menu key 11 and the zoom button 12 are operated from the speaker 13. Control. When the digital camera 2 is in the shooting mode, the CPU 20 performs control so that the operation sound is not emitted. Thereby, at the time of audio | voice acquisition mentioned later, the said operation sound is not acquired, but only the audio | voice outside the digital camera 2 can be acquired. In the present embodiment, the CPU 20 also functions as an operation sound stop unit that stops the generation of the operation sound from the speaker 13 when the menu key 11 and the zoom button 12 are operated during the shooting mode.

  FIG. 3 is a block diagram showing an electrical configuration inside the digital camera 2, and a CCD 14 that images subject light transmitted through the photographing lens 4 is disposed behind the photographing lens 4. A timing signal (clock signal) is input to the CCD 14 from a timing generator 19 controlled by the CPU 20. The signal output from the CCD 14 is input to a correlated double sampling circuit (CDS) 15 and output as R, G, and B image data corresponding to the accumulated charge amount of each cell of the CCD 14 accurately. Image data output from the CDS 15 is amplified by an amplifier (AMP) 16 and converted into digital data by an A / D converter 17.

  The image input controller 18 is connected to the CPU 20 via the data bus 21, and controls the CCD 14, CDS 15, AMP 16, and A / D converter 17 according to instructions from the CPU 20. In addition, the image data output from the A / D converter 17 is written into the video memory 22 or the buffer memory 24.

  The video memory 22 temporarily stores low-resolution image data when the LCD 10 is used as a viewfinder. The image data stored in the video memory 22 is sent to the LCD driver 23 via the data bus 21 and displayed on the LCD 10. The buffer memory 24 temporarily stores captured high-resolution image data. The image data read from the buffer memory 24 is stored in the RAM 26 by a data reader that is driven and controlled by the memory controller 25.

  The image signal processing circuit 27 performs, for example, gradation conversion, color conversion, and hyper to compress the gradation of the ultra-low frequency density component of the image while the captured high-resolution image data is stored in the buffer memory 24. Image processing such as tone processing and hyper sharpness processing that enhances sharpness while suppressing graininess is performed.

  The microphone 6 captures sound and sends the captured analog sound data to the A / D converter 28. The A / D converter 28 converts the sent analog audio data into digital audio data. The CPU 20 temporarily stores the digital audio data in the audio memory (audio storage means) 29 via the data bus 21. In the present embodiment, the CPU 20 stores audio data in the audio memory 29 when the digital camera 2 is in the shooting mode, and does not store audio data in the audio memory 29 when the digital camera 2 is in the playback mode. Has been. That is, in response to the switching from the playback mode to the shooting mode, the storage of the voice data is started in the voice memory 29, and in response to the switching from the shooting mode to the playback mode, the storage of the voice data is stopped.

  The feature extraction unit (feature extraction means) 31 measures the sound pressure level (dB) as a feature of the voice data stored in the voice memory 29 by a known measurement method. The CPU 20 adds the measured sound pressure level data to the image data stored in the buffer memory 24, and stores the image data to which the sound pressure level data is added in a RAM (related data storage means) 26.

  In response to the release button 8 being fully pressed, the CPU 20 outputs an extraction signal to the feature extraction unit 31 via the data bus 21. In the present embodiment, the feature extraction unit 31 responds to the input of the extraction signal, and takes 1 second (first time) from the base point when shooting is performed (when the release button 8 is fully pressed). The sound pressure level of the sound data stored in the sound memory 29 is measured during a period (2 seconds in total) from 1 second (second predetermined time) before the base point. For this reason, the audio memory 29 has a storage capacity capable of storing audio data for at least 2 seconds. In the present embodiment, the audio memory 29 has a storage capacity capable of storing audio data for 5 seconds. The number of seconds (1 second) described above can be changed as appropriate.

  The CPU 20 erases the audio data in the audio memory 29 after 4 seconds (fifth predetermined time) have elapsed since the storage. Thereby, the storage capacity of the audio memory 29 can be reduced as compared with the type in which the audio data stored in the audio memory 29 is permanently stored. In the present embodiment, the CPU 20 also functions as audio data erasing means for erasing audio data that has passed 4 seconds (fifth predetermined time) from the audio data stored in the audio memory 29.

  The focus motor (adjustment member) 32 is for adjusting the focus by moving the plurality of photographing lenses 4 before photographing, and the drive is controlled by the CPU 20 via a motor driver (not shown). In response to the release button 8 being half-pressed, the CPU 20 drives the focus motor 32 and moves the photographing lens 4 to perform focus adjustment.

  As shown in FIG. 4, when the digital camera 2 is set to the playback mode, the CPU 20 displays a display method selection screen 35 on the LCD 10. On the display method selection screen 35, a selection comment image 40 “Please select an image display method” is displayed. Below the selection comment image 40, a first comment image 41 “Display in order of photographing”, and A second comment image 42 “displayed in order of sound pressure level” and a third comment image 43 “designated and displayed by sound pressure level” are displayed. Below the third comment image 43, the sound pressure is displayed. An input unit 44 for inputting a level and a search start button unit 45 are provided.

  The user operates the menu key 11 to select one of the first to third comment images 41 to 43 described above. When the user selects the first comment image 41, the CPU 20 searches the image data stored in the RAM 26, and controls the image data to be displayed on the LCD 10 in the shooting order. Note that the menu key 11 is operated to switch the image data to be displayed on the LCD 10.

  When the user selects the second comment image 42, the CPU 20 searches the image data stored in the RAM 26 and controls the image data to be displayed on the LCD 10 in order of sound pressure level (large → small).

  When the user selects the third comment image 43, the CPU 20 performs control so that a numerical value can be input to the input unit 44, and the user operates the menu key 11 to input a numerical value to the input unit 44. When entered, the CPU 20 controls the search start button unit 45 to be validated. When the user operates the search key button 45 by operating the menu key 11, the CPU 20 searches the image data stored in the RAM 26, and the added sound pressure level data is input to the input value (input unit 44). Control is performed so that the image data is displayed on the LCD 10 in the order close to the input numerical value. For example, when the sound pressure level (dB) of the sound pressure level data added to the five image data stored in the RAM 26 is 70, 75, 80, 85, 90 and the input numerical value is 100, the CPU 20 Are displayed in the order of image data of sound pressure level 90 → image data of sound pressure level 85 → image data of sound pressure level 80 → image data of sound pressure level 75 and image data of sound pressure level 70.

  In the present embodiment, the CPU 20 also functions as image data search means for searching image data associated with specified feature data (sound pressure level) from image data stored in the RAM 26.

  The operation of the digital camera 2 configured as described above will be described with reference to the flowchart of FIG. When photographing with the digital camera 2, the digital camera 2 is set to the photographing mode (Y in step (hereinafter, S) 1). In the photographing mode, the CPU 20 stores the audio data captured by the microphone 6 and converted into digital data by the A / D converter 28 in the audio memory 29 (S2).

  The user performs shooting by operating the release button 8. In response to the release button 8 being half-pressed (Y in S3), the CPU 20 performs focus adjustment by the focus motor 32 (S4). Then, in response to the release button 8 being fully pressed (Y in S5), shooting is performed, the shot image data is temporarily stored in the buffer memory 24, and feature extraction is performed via the data bus 21. The extraction signal is output to the unit 31. In response to the input of the extraction signal, the feature extraction unit 31 starts from one second before the base point to one second from the base point when shooting is performed (when the release button 8 is fully pressed). The sound pressure level of the sound data stored in the sound memory 29 is measured for a period until the next time (2 seconds in total) (S6). The CPU 20 adds the measured sound pressure level data to the image data stored in the buffer memory 24 (S7), and stores the image data to which the sound pressure level data is added in the RAM 26 (S8).

  Next, the flow of selecting an image display method when the digital camera 2 is in the playback mode will be described using the flowchart shown in FIG.

  When the digital camera 2 is set to the playback mode (Y in S1), the CPU 20 displays the display method selection screen 35 on the LCD 10 (S2). The user operates the menu key 11 to select one of the first to third comment images 41 to 43 displayed on the display method selection screen 35. When the user selects the first comment image 41 (Y in S3), the CPU 20 controls the image data stored in the RAM 26 to be displayed on the LCD 10 in the shooting order (S4).

  When the user selects the second comment image 42 (Y in S5), the CPU 20 controls the image data stored in the RAM 26 to be displayed on the LCD 10 in order of sound pressure level (large → small) ( S6).

  When the user selects the third comment image 43 (Y in S7), the user inputs a numerical value into the input unit 44 (Y in S8) and operates the search start button unit 45 (Y in S9). The CPU 20 controls to display the image data on the LCD 10 in the order in which the added sound pressure level data is close to the input numerical value (the numerical value input to the input unit 44) (S10).

  Thus, since the CPU 20 stores the image data to which the measured sound pressure level data is added in the RAM 26, the data amount stored in the RAM 26 is suppressed as compared with the type in which the sound data is stored in the RAM 26 as it is. Data related to sound and image data can be associated with each other.

  Further, the image data can be displayed on the LCD 10 in the order of sound pressure levels, and further, image data close to an arbitrary sound pressure level can be searched.

  Further, since the CPU 20 does not store audio data in the audio memory 29 when the digital camera 2 is in the playback mode, but stores audio data only when in the shooting mode, the power consumption associated with storing the audio data is suppressed. be able to.

  Also, the period for measuring the sound pressure level is set to 2 seconds, and furthermore, the sound data in the sound memory 29 that has passed 4 seconds after being stored is deleted, so the storage capacity of the sound memory 29 is set to 5 seconds. The storage capacity can be increased, and the storage capacity of the audio memory 29 can be reduced.

  In the above embodiment, the period for measuring the sound pressure level is set from 1 second before the base point to 1 second (after the base point) when shooting is performed (when the release button 8 is fully pressed). However, the period during which the sound pressure level is measured can be changed as appropriate.

  In the above embodiment, the image data is stored in the RAM 26. However, the memory card slot for inserting the memory card is provided in the digital camera 2, and the image data is stored in the memory card inserted in the memory card slot. It may be.

  Furthermore, in the above embodiment, the LCD 10 is provided in the digital camera 2, but without providing the LCD 10 in the digital camera 2, the digital camera 2 is connected to the PC in the playback mode, and the image data stored in the RAM 26 is sent to the PC. The image data may be reproduced and displayed on a PC monitor.

  7 and 8 show another embodiment. Constituent members similar to those of the embodiment shown in FIGS. 1 to 6 are denoted by the same reference numerals, and detailed description thereof is simplified. In this embodiment, the CPU 20 starts storing audio data in the audio memory 29 in response to the release button 8 being pressed halfway, and in response to the release button 8 being fully pressed, Storage of audio data in the memory 29 is stopped. The RAM 26 stores a plurality of voice model data (for example, in-car voice model data indicating the voice in the car, in-train voice model data indicating the voice in the train, and soccer field voices classified in advance for each voice feature. The soccer field voice model data shown) is stored. In the present embodiment, the RAM 26 also functions as a model data storage unit that stores a plurality of sound model data. Note that the speech model data stored in the RAM 26 can be changed as appropriate.

  When shooting with the digital camera 2, the digital camera 2 is set to the shooting mode (Y in S1). In response to the user half-pressing the release button 8 (Y in S2), the CPU 20 performs focus adjustment by the focus motor 32 (S3), and at the same time, the CPU 20 takes in the A / D converter 28. Then, the storage of the audio data converted into digital data in the audio memory 29 is started (S4). In this embodiment, the flow of processing when shooting is performed on a soccer field will be described.

  When the release of the release button 8 is half-pressed and the half-press is released before it is fully pressed (Y in S5), the CPU 20 stops storing the voice data in the voice memory 29. (S6). When the half-press is released, the voice data stored so far may be deleted.

  If the user does not release the half-press of the release button 8 (N in S5) and fully presses the release button 8 (Y in S7), the CPU 20 performs shooting and the captured image data is stored in the buffer memory 24. And the extracted signal is output to the feature extraction unit 31 via the data bus 21. In the present embodiment, in response to the input of the extraction signal, the feature extraction unit 31 starts from the shooting time point (when the release button 8 is fully pressed and the shooting is performed) from the shooting time point for 1 second (first time). 3 is a known detection method (analysis by voiceprint) that the voice data stored in the voice memory 29 in the period up to a predetermined time) is most similar to the voice model data stored in the RAM 26. , Analysis by sound frequency, sound volume analysis, etc. (detects that the soccer field sound model data is the most similar), and calculates the similarity level by a known calculation method (voice print analysis, sound frequency analysis, sound volume (E.g., 80%) (S8), and the calculated similar level data (soccer field voice model data, similar level 80%) is stored in the buffer memory 24. It was added to the stored image data (S9), and stores the image data similar level data is added to the RAM 26 (S10).

  Note that the above-described similarity level data includes one voice model data name in which the voice data among the plurality of voice model data is most similar, and a numerical value when the similarity level is expressed as a percentage. For example, if the volume data of the soccer field voice model data is stored as volume data when the audience cheers are large, when the audience cheers are large when shooting at the soccer field (similar level) The numerical value indicating the similarity level is different when the numerical value is high (for example, 90%) and when the audience cheer is small (the numerical value for the similarity level is low, for example, 50%).

  As shown in FIG. 8, when the digital camera 2 is set to the playback mode, the CPU 20 displays a display method selection screen 49 on the LCD 10. On the display method selection screen 49, a selection comment image 50 “Please select an image display method” is displayed. Below this selection comment image 50, a first comment image 51 “display in order of photographing”, and A second comment image 52 “display for each similar speech model data” is displayed.

  The user operates the menu key 11 to select one of the first and second comment images 51 and 52 described above. When the user selects the first comment image 51, the CPU 20 searches the image data stored in the RAM 26 and controls the image data to be displayed on the LCD 10 in the order of photographing. Note that the menu key 11 is operated to switch the image data to be displayed on the LCD 10.

  When the user selects the second comment image 52, the CPU 20 searches the image data stored in the RAM 26 and controls the image data to be displayed on the LCD 10 for each similar voice model data. At this time, the CPU 20 performs control so that the similar level numerical values (%) are displayed in descending order.

  As described above, since the CPU 20 starts storing the audio data in the audio memory 29 in response to the release button 8 being pressed halfway, the power consumption related to the storage of the audio data can be suppressed.

  Further, since the sound data is detected and calculated to which of the sound model data stored in the RAM 26 is most similar, and the image data to which the calculated similarity level data is added is stored in the RAM 26, the image data is stored in the RAM 26. The voice model data can be classified for each similar voice model data, and the image data can be displayed on the LCD 10 for each similar voice model data.

  Furthermore, since the CPU 20 performs the above detection and calculation based on the audio data stored in the audio memory 29 during the period from the shooting time to 1 second before the shooting time, the digital camera 2 performs continuous shooting. Cases can also be handled.

  In the above embodiment, the CPU 20 starts storing the audio data in the audio memory 29 in response to the release button 8 being pressed halfway. However, the timing for starting the audio data storage can be changed as appropriate. It is.

  In the above embodiment, the CPU 20 performs the above detection and calculation based on the audio data stored in the audio memory 29 during the period from the shooting time to 1 second before the shooting time. The period of the audio data for performing can be changed as appropriate.

  Furthermore, in the above embodiment, the voice model data is stored in the RAM 26. However, the digital camera 2 may be provided with a communication unit that can be connected to a data server that stores the voice model data via the Internet. First, the CPU 20 connects to the data server via the communication unit and the Internet, and performs the detection and calculation described above.

  FIG. 9 shows another embodiment. Constituent members similar to those of the embodiment shown in FIGS. 1 to 6 are denoted by the same reference numerals, and detailed description thereof is simplified. In this embodiment, the CPU 20 outputs an extraction signal to the feature extraction unit 31 via the data bus 21 in response to the release button 8 being fully pressed. The feature extraction unit 31 responds to the input of the extraction signal, from the time when the focus adjustment when the release button 8 is half-pressed to the time when 2 seconds elapse after shooting by the full release button 8 press. Of the audio data stored in the audio memory 29 at (the fourth predetermined time), for example, 30% (a preset ratio) of data (hereinafter referred to as limited audio data) is extracted as feature data. The feature extraction unit 31 extracts 30% of audio data as limited audio data in order from the audio having the highest frequency in the audio data.

  Note that the method for extracting limited audio data from audio data is not limited to the method for extracting high-frequency audio as described above, and the stored audio data is divided every 0.5 seconds, for example. Of these data, data with a high sound pressure level (dB) may be extracted by 30%, and can be changed as appropriate. The period for extracting the limited audio data may be a period from when the focus adjustment is finished to a predetermined time later, and is preferably at least a period from when the focus adjustment is finished to when shooting is performed. These can be changed as appropriate.

  When shooting with the digital camera 2, the digital camera 2 is set to the shooting mode (Y in S1). In the photographing mode, the CPU 20 stores the audio data captured by the microphone 6 and converted into digital data by the A / D converter 28 in the audio memory 29 (S2).

  When the user half-presses the release button 8 (Y in S3), focus adjustment by the focus motor 32 is performed (S4). Then, in response to the user fully pressing the release button 8 (Y in S5), the CPU 20 performs shooting, temporarily stores the shot image data in the buffer memory 24, and stores the data bus 21 in the buffer memory 24. Then, an extraction signal is output to the feature extraction unit 31. In response to the input of the extraction signal, the feature extraction unit 31 obtains limited audio data from the audio data stored in the audio memory 29 during the period from when focus adjustment is completed until 2 seconds have passed after shooting. Extract (S6).

  The CPU 20 adds the extracted limited sound data to the image data stored in the buffer memory 24 (S7), and stores the image data with the limited sound data added in the RAM 26 (S8).

  In this embodiment, the CPU 20 reproduces the limited audio data added to the image data to be displayed and outputs it from the speaker 13 when displaying the image data stored in the RAM 26 on the LCD 10. .

  As described above, the limited audio data is extracted from the audio data stored in the audio memory 29 during the period from the end of the focus adjustment to the time when 2 seconds have passed after the shooting. Since the drive sound of the focus motor 32 at the time of focus adjustment is not stored, limited sound data can be extracted only from the sound outside the digital camera 2.

  In addition, since the CPU 20 stores the extracted image data to which the limited audio data is added in the RAM 26, the audio data can be stored while suppressing the amount of data stored in the RAM 26 as compared with the type in which the audio data is stored in the RAM 26 as it is. The sound at the time of shooting can be confirmed by reproduction, and furthermore, the power consumption of the CPU 20 when reproducing the audio data can be suppressed as compared with the type in which the audio data is stored as it is.

It is a front perspective view which shows the digital camera which implemented this invention. It is a back perspective view showing a digital camera. It is a block diagram which shows the electrical structure inside a digital camera. It is explanatory drawing which shows a display method selection screen. It is a flowchart which shows the flow of the process at the time of imaging | photography. It is a flowchart which shows the flow of a process in the display of image data. It is a flowchart which shows the flow of the process at the time of imaging | photography of embodiment which starts the memory | storage of the audio | voice data to an audio | voice memory in response to half-pressing the release button. It is explanatory drawing which shows the display method selection screen of embodiment shown in FIG. It is a flowchart which shows the flow of the process at the time of imaging | photography of embodiment which extracts limited audio | voice data from the audio | voice data memorize | stored in the audio | voice memory in the period from the time of completion | finish of focus adjustment to the time of 2 second passed after completion | finish of imaging | photography.

Explanation of symbols

2 Digital camera 8 Release button (shooting button)
9 Mode selector switch (Mode selector)
10 LCD (display means)
11 Menu key (operation member)
12 Zoom button (operation member)
13 Speaker (operation sound generating means)
20 CPU
26 RAM (related data storage means)
29 Voice memory (voice storage means)
31 Feature extraction unit (feature extraction means)
32 Focus motor (adjustment member)

Claims (17)

Photographing means for photographing,
In an imaging apparatus comprising: voice storage means for storing external voice as voice data;
Feature extraction means for extracting feature data as features from the voice data stored in the voice storage means;
An image pickup apparatus comprising: related data storage means for storing image data photographed by the photographing means and feature data extracted by the feature extraction means in association with each other. A mode switching means for switching between a photographing mode for photographing with the photographing means and a control mode for performing control other than photographing;
The imaging apparatus according to claim 1, wherein the voice storage unit stores the voice data during the shooting mode and does not store the voice data during the control mode. An operation member provided to be operable;
Operation sound generating means for generating an operation sound when the operation member is operated;
The imaging apparatus according to claim 2, further comprising: an operation sound stop unit that stops generation of an operation sound by the operation sound generation unit when the operation member is operated during the photographing mode. Provided with a shooting button that is provided so that it can be pressed, performs a shooting preparation operation when half-pressed, and further presses from the half-pressed state and performs shooting by the shooting means when fully pressed,
The imaging apparatus according to claim 1, wherein the voice storage unit starts storing the voice data in response to the shooting button being pressed halfway.   The feature extracting means stores the sound stored in a period from a first predetermined time when the photographing is performed by the photographing means to a second predetermined time when the photographing is performed by the photographing means. The imaging apparatus according to claim 1, wherein the feature data is extracted from data.   5. The feature extraction unit according to claim 1, wherein the feature extraction unit extracts the feature data from audio data stored in a period from when the photographing is performed by the photographing unit to a third predetermined time before. An imaging apparatus according to claim 1. An adjustment member that adjusts the focus by moving the focus lens before shooting by the shooting means;
5. The feature extraction unit according to claim 1, wherein the feature extraction unit extracts the feature data from audio data stored in a period from when the focus adjustment by the adjustment member is completed to after a fourth predetermined time. An imaging apparatus according to claim 1.   8. The image pickup apparatus according to claim 7, wherein the fourth predetermined time is a time from when at least focus adjustment by the adjustment member is completed to when shooting is performed by the shooting unit.   9. The imaging apparatus according to claim 1, further comprising a voice data erasing unit that erases voice data that has passed a fifth predetermined time out of the voice data stored in the voice storage unit. .   The imaging apparatus according to claim 1, wherein the feature extraction unit extracts a sound pressure from the voice data stored in the voice storage unit as the feature data.   The feature extraction means detects which voice data stored in the voice storage means is most similar to a plurality of voice model data classified in advance for each voice feature, and sets the similarity level. The imaging apparatus according to claim 1, wherein the imaging device calculates and calculates the calculated similarity level as the feature data.   The imaging according to any one of claims 1 to 9, wherein the feature extraction unit extracts, as the feature data, data of a preset ratio of the voice data stored in the voice storage unit. apparatus.   12. The imaging apparatus according to claim 11, further comprising model data storage means for storing the plurality of voice model data.   2. An image data search unit for searching image data associated with the specified feature data from image data stored in the related data storage unit based on the feature data. 14. The imaging device according to any one of thirteen.   15. The imaging apparatus according to claim 14, further comprising display means for reproducing and displaying the image data searched by the image data search means.   16. The imaging apparatus according to claim 1, wherein the imaging apparatus is a digital camera. When shooting, external audio is stored as audio data,
Extract feature data that is characteristic from stored external audio data,
An image storage method characterized by storing photographed image data and extracted feature data in association with each other.

Images