JP4656395B2 - Recording apparatus, recording method, and recording program - Google Patents

Description

  The present invention relates to a recording apparatus, a recording method, a recording program, a reproducing apparatus, a reproducing method, a reproducing program, and a recording / reproducing apparatus.

  In meetings, etc., it is possible to record a video with video to record the contents of the meeting, but in the case of a video, the data capacity is large, so it is difficult to shoot for a long time. . So, I want to record everything with just audio. However, there is a problem that information cannot be obtained by voice alone, and it is impossible to know or remember the state of the meeting, for example, who is talking.

Therefore, conventionally, a technique for recording audio and a still image in association with each other has been proposed. For example, a technique for capturing and recording a still image only when the volume changes during recording of audio data (for example, see Patent Document 1), or a technique for performing imaging with a camera directed in the direction in which sound is detected (for example, Patent Document 2) is known.
JP 2004-135233 A Japanese Patent Application Laid-Open No. 07-057199

  However, the above-described conventional technique is a technique for capturing still images using audio data, and cannot use still image data captured during reproduction of audio data. In other words, when playing back audio data, there is no choice but to play from the beginning or determine the playback start position by performing fast forward or rewind operation with an approximate feeling, and even if you try to play from the desired position There was a problem of becoming complicated.

  Accordingly, the present invention provides a recording apparatus, a recording method, and a recording method that can easily and flexibly control the reproduction of audio data by using still image data captured during recording of the audio data for reproduction control of the audio data. It is an object to provide a recording program, a reproducing apparatus, a reproducing method, a reproducing program, and a recording / reproducing apparatus.

In order to achieve the above object, a recording apparatus according to the first aspect of the present invention comprises a recording means for recording voice and recording it as voice data, and a voice change detecting means for detecting a voice change during recording of the voice data by the recording means. Each time a change in sound that satisfies a predetermined still image shooting condition is detected by the sound change detection unit, a shooting unit that takes a still image and captures it as still image data; and a shooting in which a still image is shot by the shooting unit Recording time acquisition means for acquiring time, still image data acquired by the imaging means, and imaging time acquired by the imaging time acquisition means are recorded in association with the audio data acquired by the recording means. If a recording unit, given the still image shooting condition is satisfied voice change by the voice change detecting means is a direction change of the sound source, the voice source Discriminating means for discriminating whether or not there is still image data photographed in the past in the direction, and discriminating that there is still image data photographed in the past in the direction of the sound source by the discriminating means. In this case, the still image data photographed in the past is used as still image data corresponding to the sound change, instead of the still image data to be captured by the photographing means .

  Further, as a preferred aspect, for example, as in claim 2, in the recording apparatus according to claim 1, the photographing time acquisition means measures an elapsed recording time from the start of recording by the recording means, and the photographing means The elapsed recording time at the time when the still image was shot may be acquired as the shooting time of the still image.

  Further, as a preferred aspect, for example, as in claim 3, in the recording apparatus according to claim 1 or 2, the photographing unit is configured to change the sound that satisfies the predetermined still image photographing condition by the sound change detecting unit. If a change in volume, a change in frequency band, or a change in voice direction is detected, a still image may be captured and captured as still image data.

  Further, as a preferred aspect, for example, as in claim 4, in the recording apparatus according to any one of claims 1 to 3, the sound change detection means causes a sound change that satisfies a change condition of a shooting parameter of the shooting means. When detected, the camera further includes a shooting parameter changing unit that changes a shooting parameter of the shooting unit based on the sound change, and the shooting unit is configured to change a sound that satisfies a predetermined still image shooting condition by the sound change detecting unit. Is detected, a still image may be captured based on the imaging parameter changed by the imaging parameter changing means and captured as still image data.

  Further, as a preferable aspect, for example, as in claim 5, in the recording apparatus according to claim 4, the photographing parameter changing unit is configured to change the direction of the sound source by the sound change detecting unit as the photographing parameter changing condition. When it is detected that the camera has changed more than a predetermined angle, the shooting parameter is changed so that the shooting direction of the shooting unit is directed to the direction of the sound source, and the shooting direction by the shooting unit is generated based on the shooting parameter. You may make it further comprise the imaging | photography direction change means which orient | assigns to the direction of a source.

Further, as a preferred aspect, for example, as in claim 6, in the recording apparatus according to claim 4, the shooting parameter changing means sets the sound volume more than a predetermined volume by the sound change detecting means as the changing condition of the shooting parameter. When it is detected that the sound direction of the frequency band has changed by a predetermined angle or more, the shooting parameter is changed so as to change the shooting direction of the shooting unit, and based on the shooting parameter changed by the shooting parameter changing unit Further, it may further comprise a photographing direction changing means for directing the photographing direction of the photographing means to the sound direction of a frequency band having a predetermined volume or higher .

Further, as a preferred aspect, for example, as in claim 7, in the recording apparatus according to claim 1 , the photographing unit is captured by audio data corresponding to the still image data photographed in the past and the recording unit. If there is a change in sound that satisfies a predetermined still image shooting condition with the sound data, the still image may be shot and captured as new still image data.

In order to achieve the above object, the recording method according to the eighth aspect of the invention detects a change in sound during recording of sound data, and each time a change in sound that satisfies a predetermined still image shooting condition is detected, a still image is recorded. Is captured and captured as still image data, the shooting time when the still image was captured is acquired, and the captured still image data and the acquired shooting time are recorded in association with the audio data being recorded. If it is determined that the sound change that satisfies the predetermined still image shooting condition is a change in the direction of the sound generation source and there is still image data shot in the past in the direction of the sound generation source, Instead of still image data, still image data taken in the past is used as still image data corresponding to the sound change .

In order to achieve the above object, a recording program according to claim 9 includes a procedure for recording voice and recording it as voice data, a procedure for detecting a voice change in the voice data, and predetermined still image shooting conditions. Each time a change in sound is detected, a procedure for capturing a still image and capturing it as still image data, a procedure for acquiring a shooting time when the still image was captured, and the captured still image data and the acquired If the change in sound that satisfies the predetermined still image shooting condition is a change in direction of the sound source, the past recording is performed in the direction of the sound source. If it is determined that there is still image data captured in the past in the direction of the sound source, it should be captured. Tomega instead data, characterized in that to execute the still image data captured in the past and steps to still image data, to a computer for the voice change.

According to the present invention, if the shooting time of still image data is used for the reproduction control of the audio data, there is an advantage that the reproduction control of the audio data can be easily and flexibly performed. Moreover, there is an advantage that the data capacity can be reduced by diverting existing still image data taken in the past in the direction of the sound source.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

A. First embodiment A-1. Configuration of First Embodiment FIG. 1 is a block diagram showing a configuration of a digital camera according to a first embodiment of the present invention. In the figure, the image acquisition unit 10 includes a lens 11, a shutter 12, and an LPF 13. The lens 11 is a normal optical lens and includes a lens group in which aspherical lenses are stacked. The shutter 12 is a so-called mechanical shutter that is operated by a driver 14 driven by the control unit 20 when a shutter button is operated. Depending on the digital camera, a mechanical shutter may not be provided. In the case of a model equipped with a retractable lens structure and a mechanical zoom, these drivers are also controlled by the driver 14. The LPF 13 is a crystal low-pass filter and is mounted to prevent the occurrence of moire.

  Next, the analog signal processing unit 15 includes an image sensor (CCD, CMOS) 16, a sampling / signal amplification processing unit 17, and an A / D converter 18. The imaging sensor 16 forms a subject image (image), and converts the intensity of light of each color of RGB into a current value. The sampling / signal amplification processing unit 17 performs correlated double sampling processing and signal amplification processing for suppressing noise and color unevenness. The A / D converter 18 is also called an analog front end, and converts the sampled / amplified analog signal into a digital signal (converts each color of RGB and CMYG into 12-bit data and outputs it to the bus line).

  Next, the control unit (CPU) 20 controls the entire digital camera 1 (imaging device) according to a program stored in a program memory described later. In particular, in the first embodiment, when there is a change in sound that satisfies the still image shooting condition during recording of the sound data, the still image is shot, and the shooting time (elapsed time from the start of recording of the audio data). And still image data are recorded and saved together with the audio data, and when the recorded audio data is played back, the shooting time of the still image data (elapsed time from the start of recording of the audio data = elapsed time from the start of playback of the audio data) Accordingly, the playback start position of the audio data is controlled.

  The preview engine 22 is stored in the image buffer 26 immediately after detection of digital data input via the image acquisition unit 10 or the analog signal processing unit 15 in the recording mode (also referred to as recording mode or photographing mode) or immediately after the shutter operation is detected. Thinning processing is performed in order to display the digital data and the digital data stored in the image memory 31 on the display unit 25. The D / A converter 23 converts the digital data thinned out by the preview engine 22 and outputs it to the driver 24 at the subsequent stage. The driver 24 includes a buffer area for temporarily storing digital data displayed on the display unit 25 at the subsequent stage, and drives the display unit 25 based on a control signal input via the key operation unit 27 and the control unit 20. The display unit 25 includes a color TFT liquid crystal, an STN liquid crystal, or the like, and displays a preview image, image data after shooting, a setting menu, and the like.

  The image buffer 26 temporarily stores digital data immediately after photographing until it is input via the analog signal processing unit 15 or the digital signal processing unit 28 and passed to the digital signal processing unit 28. The key operation unit 27 includes a shutter button, a recording / playback mode selection slide switch, a menu button, a cross key (determined by pressing the center), and the like.

  The digital signal processing unit 28 performs white balance processing, color processing, gradation processing, contour emphasis, conversion from RGB format to YUV format, YUV format for digital data input via the analog signal processing unit 15. To JPEG format. The digital signal processing unit 28 also generates an image file according to the Exif standard from the image data captured by the image acquisition unit 10 and the analog signal processing unit 15. The image compression / decompression processing unit 29 compresses and encodes the digital data input via the digital signal processing unit 28 into the JPEG format, or decompresses the JPEG format file in the reproduction mode.

  The program memory 30 stores various programs loaded in the control unit 20, EV values in the best shot function, color correction information, and the like. The image memory 31 stores image data temporarily held in the image buffer 26 and digital data converted into various file formats. The card I / F 32 controls data exchange between the external recording medium 33 and the imaging apparatus main body. The external recording medium 33 is a detachable recording medium composed of a compact flash (registered trademark), a memory stick, an SD card, or the like. The external connection I / F 34 includes a USB connector slot and the like, is connected to a personal computer or the like, and is used for transferring photographed image data. The battery 35 includes a disposable primary battery, a rechargeable secondary battery, and the like, and supplies power for driving the above-described units.

A-2. Operation of First Embodiment Next, the operation of the first embodiment described above will be described.
(1) Recording Process FIG. 2 is a flowchart for explaining the operation in the recording process of the digital camera 1 according to the first embodiment. First, it is determined whether or not an instruction to start recording is given (step S10). When there is an instruction to start recording, voice data newly input from the microphone is recorded (step S12). Next, it is determined whether or not there is a change in sound that satisfies the still image shooting condition during recording of the sound data (step S14).

  Here, in the first embodiment, as the still image shooting conditions, as shown in FIG. 4, when the change in volume is 10 dB or more, when the change in frequency band is 2 kHz or more, It is assumed that the change is 10 degrees or more. A still image is shot when any one of the exemplified shooting conditions is met or when a combination of two or more of the shooting conditions is met. Further, these shooting conditions and combinations thereof may be arbitrarily registered by the user.

  If there is no change in audio that satisfies the still image shooting condition, it is determined whether or not an instruction to end recording is given (step S20). If there is no instruction to end recording, the process returns to step S14 to record audio data. Continue.

  On the other hand, if there is an audio change that satisfies the above-described still image shooting conditions during recording of the audio data, the image data obtained from the image sensor is recorded as a still image (step S16). Marking information that correlates the shooting time (elapsed time from the start of recording of audio data) is stored (step S18). Then, as described above, it is determined whether or not an instruction to end recording is given (step S20). If there is no instruction to end recording, the process returns to step S14 and recording of audio data is continued.

  Thereafter, when there is a change in sound that satisfies the still image shooting condition during recording of the sound data, the image data obtained from the image sensor is recorded as a still image (step S16), and the still image data and the shooting time are recorded. The operation of storing the marking information that associates (the elapsed time from the start of recording of the audio data) is repeated (step S18).

  When there is an instruction to end recording, a storage file format (WAV format, Motion-JPEG format, etc.) is designated (step S22), and the recorded audio data and marking information in the designated file format are stored in the file. Store and save (step S24). Then, the recording process ends.

(2) Reproduction Process Next, FIG. 3 is a flowchart for explaining the operation in the reproduction process of the digital camera 1 according to the first embodiment. First, the user designates an audio data file to be reproduced (step S30). When the audio data is designated, each still image data is reduced based on the marking information in the file of the designated audio data, and a list is displayed in the index display area 251 of the display unit 25 as shown in FIG. (Step S32).

  Next, the playback position of the audio data is set to the start time (step S34), and it is determined whether still image data has been selected in the index display area (step S36). That is, the user views still image data displayed in a list in the index display area, and selects still image data corresponding to the reproduction position (reproduction time) in order to indicate the reproduction position of the audio data.

  If any of the still image data is selected by the user, the shooting time of the selected still image data (the elapsed time from the start of recording of the audio data) is set as the audio data reproduction position (step S38). ), Audio data is reproduced from the reproduction position (step S40). On the other hand, if still image data is not selected, the audio data is reproduced with the beginning of the audio data set in step S34 as the reproduction position (step S40).

  Next, it is determined whether or not the marking information closest to the reproduction position has changed (step S42). If the marking information has changed, the still image data corresponding to the marking information is displayed on the still image on the display unit 25. It displays on the display area 252 (step S44). Next, it is determined whether or not an instruction to end reproduction is given (step S46). If there is no instruction to end reproduction, the process returns to step S36 and the above-described processing is repeated.

  That is, each time still image data is selected from among the still image data listed in the index display area during the reproduction of the audio data, the shooting time of the still image data (recording of audio data starts) (Elapsed time from) is set as the reproduction position of the audio data, and a series of processes of reproducing the audio data from the reproduction position is executed. If there is an instruction to end playback, the playback of the audio data is ended and the processing is ended.

  According to the above-described first embodiment, during audio data recording, if there is a change in audio that satisfies the still image shooting condition, a still image is shot, and the shooting time (elapsed time from the start of audio data recording) ) And still image data are recorded and saved together with the audio data. When the recorded audio data is reproduced, the shooting time of the still image data (elapsed time from the start of recording of the audio data = elapsed time from the start of reproduction of the audio data) ), The playback start position of the audio data is controlled according to the above, so that playback control can be performed easily and flexibly.

B. Second Embodiment Next, a second embodiment of the present invention will be described. The second embodiment can be applied to a digital camera as will be described later, but is a technique that is particularly useful for a surveillance camera or a web camera having a mechanism for changing a shooting direction. In the second embodiment, when a change in sound that satisfies the change condition of the shooting parameter (shooting direction, zoom magnification, etc.) is detected, the sound is changed to the shooting parameter corresponding to the change in sound, and the sound change that satisfies the still image shooting condition is detected. If there is, the still image at that time is shot according to the shooting parameters.

B-1. Configuration of Second Embodiment FIG. 6 is a block diagram showing the configuration of the surveillance camera 40 according to the second embodiment. In the figure, the image acquisition unit 41 includes a lens 42 and an LPF 43. The lens 42 is a normal optical lens and includes a lens group in which aspherical lenses are stacked. The LPF 43 is a crystal low-pass filter and is mounted to prevent the occurrence of moire.

Next, the analog signal processing unit 45 includes an image sensor (CCD, CMOS) 46, a sampling / signal amplification processing unit 47, and an A / D converter 48. The imaging sensor 46 forms a subject image (image) and converts the intensity of light of each color of RGB into a current value. The sampling / signal amplification processing unit 47 performs correlated double sampling processing and signal amplification processing for suppressing noise and color unevenness. The A / D converter 48 is also called an analog front end, and converts the sampled / amplified analog signal into a digital signal (converts each color of RGB and CMYG into 12-bit data and outputs it to the bus line). The driver 49 drives the image acquisition unit 40 and the analog signal processing unit 45 under the control of the control unit 50.
Mechanical zoom

  Next, the control unit (CPU) 50 controls the entire surveillance camera 40 (imaging device) according to a program stored in a program memory described later. In particular, in the second embodiment, if there is a change in sound that satisfies the shooting parameter change condition during recording of the sound data, the shooting parameter is changed according to the sound change and the still image shooting condition is satisfied. When there is a change in audio, a still image is taken according to the shooting parameters, and the shooting time (elapsed time from the start of recording of the audio data) and the still image data are recorded and saved together with the audio data, while the recorded audio data is played back. In some cases, the playback start position of the audio data is controlled according to the shooting time of the still image data.

  The program memory 51 stores various programs loaded on the control unit 50. The image buffer 52 temporarily stores the digital data immediately after shooting from the analog signal processing unit 45 until it is passed to the digital signal processing unit 53. The digital signal processing unit 53 performs various types of image processing on the imaging data supplied from the analog signal processing unit 45. The processing by the digital signal processing unit 53 may be performed on the computer side to which the monitoring camera 40 is connected.

  The microphone 54 is disposed in the vicinity of the image acquisition unit 41 and collects external sounds. The audio processing unit 55 converts the audio signal collected by the microphone 54 into audio data that is digital data. The zoom drive unit 56 drives the lens 42 of the image acquisition unit 4 under the control of the control unit 50 to perform mechanical zoom. Note that zooming can be performed only by digital processing. In this case, zooming is performed on the above-described digital signal processing unit 53 or the computer connected to the monitoring camera 40 without driving the lens unit 42. May be.

  The pan drive unit 57 drives the image acquisition unit 41 under the control of the control unit 50 and performs so-called pan drive that rotates in the horizontal direction and / or the vertical direction. Note that Pann may also be realized by trimming still image data captured with a wide-angle lens, as with zooming. The external connection I / F 58 includes a USB connector slot and the like, is connected to a personal computer or the like, and is used to transfer captured image data and audio data.

  Here, FIG. 7 is a conceptual diagram showing an example of the shooting parameter changing condition and the shooting parameter changing contents in the second embodiment. For example, when the change in the voice direction is 20 degrees or more, when the camera (image acquisition unit) is panned in the voice direction, or when the voice direction in the frequency band with a volume of 50 dB or more is changed by 10 degrees or more. The zoom magnification is changed by one step to the wide angle side.

B-2. Operation of the Second Embodiment Next, the operation of the second embodiment described above will be described. In the following, only the parts different from the first embodiment will be described, and the same processing as that of the first embodiment will be executed for the parts that are not particularly described. Here, FIG. 8 is a flowchart for explaining a partial operation in the recording process of the digital surveillance camera 40 according to the second embodiment.

  First, when there is an instruction to start recording, voice data newly input from the microphone 54 is recorded (step S12). Next, it is determined whether or not there is a sound change that satisfies the shooting parameter change condition during recording of the sound data (step S50). If there is no sound change that satisfies the shooting parameter change condition, it is determined whether or not there is a sound change that satisfies the still image shooting condition without changing the shooting parameter (step S14). The same processing as in the first embodiment is executed. Therefore, in this case, if there is a change in the sound that satisfies the still image shooting conditions, the still image is shot with the same shooting parameters, the shooting time (the elapsed time from the start of recording the audio data), the still image data, Are recorded and saved together with the audio data.

  On the other hand, if there is a sound change that satisfies the shooting parameter change condition, the shooting parameter is changed to a shooting parameter corresponding to the sound change (step S52), and whether or not there is a sound change that satisfies the still image shooting condition. Is determined (step S14), and the same processing as in the first embodiment described above is executed. When there is a change in sound that satisfies the shooting parameter change condition, for example, when the sound direction changes by 20 degrees or more, the image acquisition unit 41 (camera part) pans in the sound direction.

  In this state, as described in the first embodiment, when there is a change in sound that satisfies the still image shooting condition, the still image in the panned direction is shot. As a result, a still image in the direction of the sound source of the speaker or the like is taken. After shooting a still image, the shooting time (elapsed time from the start of recording audio data) and the still image data are recorded and saved together with the audio data.

  Since the reproduction operation is the same as that of the first embodiment described above, description thereof is omitted.

  In the second embodiment described above, the surveillance camera has a panning function and a zoom function. However, the panning function is not limited to this, and the panning function is not mechanically panned as described above. It can be realized by trimming the part corresponding to the audio direction from still image data shot with a wide-angle lens, and the zoom function can be changed digitally for the shot still image data. Also good. As a result, the second embodiment can be applied to a digital camera that does not have a mechanical panning function or zoom function. In addition to panning and zooming, shooting parameters such as aperture and shutter speed may be changed.

  According to the second embodiment described above, when a change in sound that satisfies a change condition of the shooting parameters (shooting direction, zoom magnification, etc.) is detected, the sound is changed to a shooting parameter corresponding to the change in sound, and the sound satisfies the still image shooting condition. When there is a change, the still image at that time is shot according to the shooting parameters, so the still image data can be related to the source of the audio data, and the playback position of the audio data can be grasped more easily can do.

C. Third Embodiment Next, a third embodiment of the present invention will be described. In the third embodiment, when there is a sound change that satisfies the still image shooting condition, the sound change is a change in the sound direction, and still image data shot in the past in that direction already exists. Rather than taking a new still image, the elapsed time from the start of recording of the audio data at that time is taken as the shooting time (not actually shot), and the shooting time and the existing still image data are combined with the audio data. The record is to be saved.

  The third embodiment can be applied to either the digital camera according to the first embodiment described above or the surveillance camera according to the second embodiment, and the configuration thereof is the same as in FIG. 1 or FIG. Description is omitted. Below, the example applied to the digital camera is demonstrated.

C-1. Operation of Third Embodiment Next, the operation of the third embodiment will be described. In the following, only the parts different from the first or second embodiment described above will be described, and the same processes as those of the first or second embodiment described above will be executed for parts not specifically described. Here, FIG. 9 is a flowchart for explaining a partial operation in the recording process of the digital camera 1 according to the third embodiment.

  First, when there is an instruction to start recording, recording of audio data newly input from the microphone 54 is started, and it is determined whether or not there is an audio change that satisfies the still image shooting condition during recording of the audio data. (Step S14) If there is no audio change that satisfies the still image shooting condition, the process proceeds to Step S20 shown in FIG. 1, and the same processing as in the first embodiment described above is executed.

  On the other hand, if there is a sound change that satisfies the still image shooting condition, it is determined whether or not the sound change is a change in the sound direction (step S62). The image data newly obtained from (1) is recorded as a still image (step S16), and marking information for associating the still image data with the photographing time (elapsed time from the start of recording of audio data) is stored (step S18). Thereafter, the process proceeds to step S20 shown in FIG. 1, and the same processing as in the first embodiment described above is executed.

  Furthermore, if there is a sound change that satisfies the still image shooting condition and the sound change is a change in the sound direction, it is determined whether or not there is existing still image data that has been shot in the past in the sound direction. If there is no existing still image data in the same audio direction (step S64), as described above, the image data newly obtained from the image sensor is recorded as a still image (step S16). Marking information that associates the data with the photographing time (the elapsed time from the start of recording of the audio data) is stored (step S18). Thereafter, the process proceeds to step S20 shown in FIG. 1, and the same processing as in the first embodiment described above is executed.

  On the other hand, if there is an audio change that satisfies the still image shooting condition, the audio change is a change in the audio direction, and there is existing still image data in the same audio direction, the existing still image data is The voice at the time of shooting is compared with the current voice, and it is determined whether there is a voice change that satisfies the shooting conditions (step S66). As a result of comparing the two, if there is a change in sound that satisfies the shooting condition, that is, if the change in sound in the past shooting and the change in sound in this time change significantly, as described above, a new image is acquired from the image sensor. The obtained image data is recorded as a still image (step S16), and marking information for associating the still image data with the photographing time (elapsed time from the start of recording of audio data) is stored (step S18). Thereafter, the process proceeds to step S20 shown in FIG. 1, and the same processing as in the first embodiment described above is executed.

  On the other hand, as a result of comparing both, if there is no audio change that satisfies the shooting conditions, that is, if the audio change during the past shooting and the current audio change do not change significantly, the existing still image data is In place of the still image data to be photographed (step S68), marking information for associating the existing still image data with the photographing time (elapsed time from the start of recording of audio data) without newly photographing image data. Store (step S18). Thereafter, the process proceeds to step S20 shown in FIG. 1, and the same processing as in the first embodiment described above is executed.

  Since the reproduction operation is the same as that in the first embodiment described above, the description thereof is omitted.

  According to the third embodiment described above, when there is a sound change that satisfies the still image shooting condition, the sound change is a change in the sound direction, and still image data previously captured in that direction already exists. In this case, instead of newly taking a still image, the elapsed time from the start of recording of the audio data at that time is set as the shooting time (not actually shot), and the shooting time and the existing still image data are Since it is recorded and saved together with the audio data, the storage capacity can be saved.

  In the first to third embodiments described above, a change in sound is detected during recording of audio data, and still image data is recorded in association with the recording elapsed time of the audio data. This is because video recording with sound has a premise that it is difficult to record for a long time because the data capacity increases. However, in recent years, a recording medium having a large capacity and a high compression technology for moving image data are being realized, and therefore it is possible to record a moving image for a considerably long time.

  Therefore, in the first to third embodiments described above, when a change in sound is detected during moving image recording with sound, still image data may be recorded in association with the elapsed recording time of the moving image with sound. In this case, one frame at the time of detecting a voice change may be extracted from the moving image and used as still image data. Alternatively, at the time of recording, only the marking information (time stamp) is recorded at the time of detecting a voice change, and at the time of reproduction, still image data is generated from the recorded moving image with sound according to the marking information and displayed in a list in the index display area It may be.

It is a block diagram which shows the structure of the digital camera by 1st Embodiment of this invention. It is a flowchart for demonstrating the operation | movement in the recording process of the digital camera 1 by this 1st Embodiment. 4 is a flowchart for explaining an operation in a reproduction process of the digital camera 1 according to the first embodiment. It is a conceptual diagram which shows an example of the imaging condition of a still image. It is a schematic diagram which shows the example of a display screen at the time of recorded audio | voice data reproduction | regeneration. It is a block diagram which shows the structure of the monitoring camera 40 by this 2nd Embodiment. It is a conceptual diagram which shows an example of the change condition of the imaging parameter in this 2nd Embodiment, and the change content of an imaging parameter. It is a flowchart for demonstrating a partial operation | movement in the recording process of the digital surveillance camera 40 by this 2nd Embodiment. It is a flowchart for demonstrating a partial operation | movement in the recording process of the digital camera 1 by this 3rd Embodiment.

Explanation of symbols

1 Digital camera (imaging device)
10 Image Acquisition Unit 11 Lens 12 Shutter 13 LPF
14 Driver 15 Analog signal processor 16 Image sensor (CCD, CMOS)
17 Sampling / Signal Amplification Processing Unit 18 A / D Converter 20 Control Unit 22 Preview Engine 23 D / A Converter 24 Driver 25 Display Unit 26 Image Buffer 27 Key Operation Unit 28 Digital Signal Processing Unit 29 Image Compression / Expansion Processing Unit 30 Program Memory 31 Image memory 32 Card I / F
33 External recording medium 34 I / F for external connection
35 Battery 40 Surveillance camera (imaging device)
41 Image acquisition unit 42 Lens 43 LPF
45 Analog signal processor 46 Image sensor (CCD, CMOS)
47 Sampling / Signal Amplification Processing Unit 48 A / D Converter 49 Driver 50 Control Unit 51 Program Memory 52 Image Buffer 53 Digital Signal Processing Unit 54 Microphone 55 Audio Processing Unit 56 Zoom Drive Unit 57 Pan Drive Unit 58 External Connection I / F

Claims (9)

Recording means for recording voice and recording it as voice data,
A voice change detecting means for detecting a voice change during recording of voice data by the recording means;
Photographing means for photographing a still image and capturing it as still image data each time a sound change that satisfies a predetermined still image photographing condition is detected by the sound change detecting means;
Shooting time acquisition means for acquiring a shooting time at which a still image was shot by the shooting means;
Recording means for recording the still image data captured by the photographing means and the photographing time acquired by the photographing time acquisition means in association with the sound data captured by the recording means ;
When the sound change satisfying a predetermined still image shooting condition by the sound change detection means is a direction change of the sound generation source, it is determined whether or not still image data shot in the past in the direction of the sound generation source exists. Discriminating means, and
If it is determined by the determining means that there is still image data captured in the past in the direction of the sound source, the still image data captured in the past is used instead of the still image data to be captured by the image capturing means. A recording apparatus characterized in that it is still image data corresponding to the sound change .   The shooting time acquisition means measures the elapsed recording time from the start of recording by the recording means, and acquires the elapsed recording time when the still image was shot by the shooting means as the shooting time of the still image. The recording apparatus according to claim 1, wherein:   When the sound change detecting means detects that the sound change satisfying the predetermined still image shooting condition is at least one of a volume change, a frequency band change, and a sound direction change, The recording apparatus according to claim 1, wherein an image is captured and captured as still image data. When the sound change detecting means detects a change in sound that satisfies the change condition of the shooting parameter of the shooting means, the camera further includes a shooting parameter changing means for changing the shooting parameter of the shooting means based on the change in sound.
When the sound change detecting unit detects a sound change that satisfies a predetermined still image shooting condition, the shooting unit takes a still image based on the shooting parameter changed by the shooting parameter changing unit, and generates still image data. The recording apparatus according to claim 1, wherein the recording apparatus is incorporated as a recording apparatus. The photographing parameter changing means changes the photographing direction of the photographing means to the sound generating source when the sound change detecting means detects that the direction of the sound generating source has changed by a predetermined angle or more as the photographing parameter changing condition. Change the shooting parameters so that they point in the direction,
5. The recording apparatus according to claim 4, further comprising photographing direction changing means for directing a photographing direction by the photographing means to a direction of a sound source based on the photographing parameter. The photographing parameter changing means, when the sound change detecting means detects that the sound direction of a frequency band having a predetermined volume or more has changed by a predetermined angle or more as the photographing parameter changing condition. Change the shooting parameters to change the direction,
The imaging direction changing means for directing the imaging direction of the imaging means to a sound direction in a frequency band having a volume equal to or higher than a predetermined volume based on the imaging parameters changed by the imaging parameter changing means. 4. The recording apparatus according to 4. The photographing unit is configured to display a still image when there is a sound change that satisfies a predetermined still image photographing condition between the audio data corresponding to the still image data photographed in the past and the audio data captured by the recording unit. recording apparatus according to claim 1, wherein the incorporation as a new still image data by photographing a. When a change in sound is detected during recording of sound data, and a sound change that satisfies the predetermined still image shooting conditions is detected, a still image is shot and captured as still image data, and the shooting time at which the still image was shot is set. The acquired still image data and the acquired shooting time are recorded in association with the audio data being recorded, and an audio change that satisfies the predetermined still image shooting direction is a direction of the audio source. If it is determined that there is still image data captured in the past in the direction of the sound source, the still image data captured in the past is used as the audio instead of the still image data to be captured. A recording method characterized in that it is still image data corresponding to a change . And procedures to incorporate as voice data to record the voice,
A step of detecting a voice change of the audio data,
Each time a sound change that satisfies a predetermined still image shooting condition is detected, a procedure for shooting a still image and importing it as still image data;
A procedure for obtaining a shooting time when the still image was shot;
A procedure for recording the captured still image data and the acquired shooting time in association with the captured audio data ;
A procedure for determining whether there is still image data captured in the past in the direction of the sound source when the sound change that satisfies the predetermined still image shooting condition is a direction change of the sound source;
If it is determined that there is still image data captured in the past in the direction of the sound source, the still image data captured in the past is used instead of the still image data to be captured. And the procedure
A recording program for causing a computer to execute.

Images