JP2006238219A - Output device, output method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an output device whereby a user can easily enjoy a characteristic sound with respect to an image. <P>SOLUTION: The output device includes: an image storage section for storing an imaged image and an imaging time while they are associated with each other; an image output control section for outputting an image stored in the image storage section; a sound storage section that stores at least one sound and its recording time recorded when the image stored in the image storage section is imaged or outputted in association with the image stored in the image storage section, while they are associated with each other; an output permissible time setting section for setting an output permissible time on the basis of an imaged time stored in the image storage section and an output time when receiving an instruction of image output; a sound selection section for selecting a sound recorded from the imaging time stored in the image storage section until a lapse of the output permissible time from at least one sound stored in the sound storage section; and a sound output control section for outputting the sound selected by the sound selection section synchronously with image output by the image output control section. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an output device, an output method, and a program. In particular, the present invention relates to an output device and an output method for outputting images and sounds, and a program for the output device.

Conventionally, there is a digital still camera that can record not only a still image but also a moving image on a memory card, and can record a sound detected by a microphone at the time of shooting and recording a still image or a moving image corresponding to the image (for example, patents). Reference 1). There is also known an electronic photo stand that can reproduce sound recorded in correspondence with an image while displaying still images and moving images taken with a digital still camera.
JP-A-7-154734

  However, if no sound is recorded at the time of shooting and recording, the sound is not reproduced when the image is reproduced by the electronic photo stand, and the image becomes unsavory. In addition, when the sound at the time of shooting and recording includes undesired sound such as noise, noise or the like is reproduced when the image is reproduced on the electronic photo stand, and the user cannot enjoy watching. In addition, it is desirable for the user to be able to easily appreciate the audio included in the image to be reproduced without performing complicated operations such as editing of the image and audio.

  Therefore, an object of the present invention is to provide an output device, an output method, and a program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  An output device according to a first aspect of the present invention includes an image storage unit that stores a captured image and an imaging time in association with each other, an image output unit that outputs an image stored in the image storage unit, and an image storage unit. An image output control unit that outputs an image to be stored to the image output unit, an output time detection unit that detects an output time that is an instruction input to output an image to the image output unit, and an image storage unit A sound storage unit that stores at least one sound recorded when an image stored in the image storage unit is captured or output in association with an image to be recorded, and a sound stored in the sound storage unit. An output output time setting unit that sets an allowable output time based on a difference between an imaging time stored in the image storage unit and an output time detected by the output time detection unit, and an image storage unit Shoot to store An audio selection unit that selects from at least one audio stored in the audio storage unit, and an image output control unit that outputs the audio recorded from the time until the time when the allowable output time set by the output allowable time setting unit elapses And an audio output control unit that outputs the audio selected by the audio selection unit to the audio output unit in synchronization with the timing at which the image is output to the unit.

  The output allowable time setting unit may set the output allowable time larger when the difference between the imaging time when the image stored in the image storage unit is captured and the output time detected by the output time detection unit is larger. .

  When the difference between the recording unit for recording the sound around the image output unit, the imaging time stored in the image storage unit, and the output time detected by the output time detection unit is smaller than the preset allowable recording time, The audio recording unit may further include a recording control unit that causes the recording unit to record audio, and the audio storage unit may store the audio recorded by the recording unit in association with the image stored in the image storage unit.

  The sound collection unit further includes a sound collection unit that collects the sound and supplies the sound to the recording unit, and the recording control unit includes the sound collection unit when the sound storage unit stores the sound in association with the image stored in the image storage unit. If the volume of the sound collected is larger than the volume of the voice stored in the voice storage unit, the voice storage unit stores the volume of the sound collected by the recording unit. When the volume is lower than the sound volume, the sound recording unit need not be recorded.

  An image capturing unit that captures an image may be further included, and the image storage unit may store the image captured by the image capturing unit in association with the image capturing time.

  The output method according to the second aspect of the present invention includes an image storage stage that stores a captured image and an imaging time in association with each other, an image output stage that outputs an image stored in the image storage stage, and an image storage stage. An image output control stage that outputs an image stored in the image output stage, an output time detection stage that detects an output time that is an instruction input to output an image in the image output stage, and an image storage stage An audio storage stage for associating and storing at least one voice recorded when the image stored in the image storage stage is captured or output in association with the image stored in the video storage stage; and a voice storage stage The sound output stage for outputting the sound stored in the image, the imaging time stored in the image storage stage, and the detection in the output time detection stage Output allowable time setting stage for setting the output allowable time based on the difference between the output time and the output allowable time set in the output allowable time setting stage from the imaging time stored in the image storage stage A voice selection stage in which the voices recorded so far are selected from at least one voice stored in the voice storage stage, and a voice selection stage in synchronization with the timing of outputting an image in the image output stage in the image output control stage A sound output control step of outputting the sound selected in step S1 in the sound output step.

  According to the third aspect of the present invention, there is provided a program for an output device that outputs an image, and an image storage unit that stores an image obtained by capturing the output device in association with an imaging time, and an image storage unit store the program. An image output unit that outputs an image, an image output control unit that outputs an image stored in the image storage unit to the image output unit, and an output time that is a time when an instruction input to output the image to the image output unit is received Audio storage that associates and stores at least one sound recorded when an image stored in the image storage unit is captured or output in association with an image stored in the output time detection unit and the image storage unit Output allowable time for setting the output allowable time based on the difference between the imaging time stored in the image storage unit and the image output time detected by the output time detection unit Time Voice selection for selecting sound recorded from the imaging time stored in the setting unit and the image storage unit to the time when the output allowable time set by the output allowable time setting unit elapses from at least one voice stored in the audio storage unit The image output control unit functions as an audio output control unit that causes the audio output unit to output the audio selected by the audio selection unit in synchronization with the timing at which the image output unit outputs an image.

  An output device according to a fourth aspect of the present invention includes an image storage unit that stores a captured image and an imaging time in association with each other, an image output unit that outputs an image stored in the image storage unit, and an image storage unit. An image output control unit that outputs an image to be stored to the image output unit, an output time detection unit that detects an output time that is an instruction input to output an image to the image output unit, and a periphery of the image output unit The difference between the recording unit that records the sound of the image, the imaging time stored in the image storage unit, and the output time detected by the output time detection unit is smaller than a preset recording allowable time, and the image output unit When the volume of the surrounding sound is larger than a predetermined threshold volume, the recording control unit that records the sound in the recording unit and the sound recorded by the recording unit in association with the image stored in the image storage unit With voice storage The recording control unit is configured such that when the image output unit outputs an image and the sound volume around the image output unit is lower than the threshold volume and the sound is not recorded by the recording unit, the image output unit displays the image. When the sound volume around the image output unit becomes higher than the threshold volume after the output of the sound is stopped, the sound is recorded by the recording unit.

  An output method according to a fifth aspect of the present invention includes an image storage stage for storing a captured image and an imaging time in association with each other, and an image output stage for outputting the image stored in the image storage stage from the image output unit. An image output control stage for outputting the image stored in the image storage stage in the image output stage, and an output time detection stage for detecting an output time that is an instruction input for outputting an image to the image output unit; The difference between the recording stage for recording the sound around the image output unit, the imaging time stored in the image storage stage, and the output time detected in the output time detection stage is smaller than a preset recording allowable time. A recording control stage for recording sound in the recording stage when the volume of the sound around the image output unit is larger than a predetermined threshold volume; A sound storage stage for storing the sound recorded in the recording stage in association with the image stored in the storage stage, and the recording control stage includes a function of the image output section when the image output section outputs an image. When the sound is not recorded at the recording stage because the volume of the surrounding sound is lower than the threshold volume, the volume of the surrounding sound of the image output section becomes larger than the threshold volume after the image output section stops outputting the image. The sound is recorded at the recording stage.

  According to a sixth aspect of the present invention, there is provided an output device program for outputting an image, wherein the output device stores an image storage unit and an image storage unit that store a captured image and an imaging time in association with each other. An image output unit that outputs an image to be output, an image output control unit that outputs an image stored in the image storage unit to the image output unit, and an output time that is a time when an instruction input to output an image to the image output unit is received Output time detection unit, recording unit for recording sound around the image output unit, difference between the imaging time stored in the image storage unit and the output time detected by the output time detection unit is a preset recording allowable time If the volume of the sound around the image output unit is greater than a predetermined threshold volume, the recording control unit that causes the recording unit to record the sound and the image stored in the image storage unit are associated with each other. The recording section Function as an audio storage unit that stores the recorded audio, and when the image output unit outputs an image, the recording control unit causes the audio to be recorded to the recording unit because the sound volume around the image output unit is lower than the threshold volume. Is not recorded, the sound is recorded in the recording unit when the volume of the sound around the image output unit becomes larger than the threshold volume after the image output unit stops outputting the image.

  Note that the above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, the user can easily appreciate the sound characteristic of the image.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are inventions. It is not always essential to the solution.

  FIG. 1 shows an example of an audio output system according to an embodiment of the present invention. The audio output system includes an imaging device 100 and an output device 140. In this example, the user 180 captures an image of a child who is playing on the beach using the imaging device 100. At this time, the imaging apparatus 100 collects and records the sound around the imaging apparatus 100 from the sound collection unit 102. In addition, the imaging apparatus 100 collects and records the sound around the imaging apparatus 100 from the sound collection unit 102 even when the image captured by the imaging apparatus 100 is displayed. Then, the imaging apparatus 100 transmits the image captured by the imaging apparatus 100 and the recorded sound to the output apparatus 140 through the communication line 150 such as the Internet.

  When reproducing the image received from the imaging device 100, the output device 140 reproduces the audio received from the imaging device 100 in synchronization. At this time, for example, when reproducing an image captured one month ago, the output device 140 selects a sound having a higher volume from the sound recorded on the date of capturing, and reproduces it in synchronization with the image reproduction. To do. Also, when playing back an image captured 10 years ago, a larger volume of audio is selected from the audio recorded for a period of one year before and after the date of imaging and is played back in synchronization with the playback of the image. . For this reason, the user 180 can appreciate the more characteristic sound when the image is captured together with the image.

  The output device 140 may be a device that outputs images and sounds, such as an HDTV, an electronic photo stand, and a computer. Further, the output device 140 may output the voice as characters. For example, when displaying an image on a display device such as a liquid crystal, the output device 140 displays sound on the display device as characters. Note that the output device 140 may display characters on a display device that displays an image, and may display characters on a display device that is different from the display device that displays an image. In addition, the output device 140 may be a printing device that prints an image, such as a printer, and may print the image and sound as characters.

  The imaging device 100 may be, for example, a digital still camera, a camera-equipped mobile phone, or the like. Further, the image capturing apparatus 100 may record image and sound data on a recording medium, and the output apparatus 140 may output the image and sound by receiving data from the recording medium. In addition, the imaging apparatus 100 may store the image and audio data in a directory provided for each user 180 of the server connected to the communication line 150, for example, a directory associated with the imaging apparatus 100. The output device 140 may receive image and sound data stored in the server for each user 180.

  FIG. 2 shows an example of a block configuration of the imaging apparatus 100. The imaging apparatus 100 includes an imaging unit 202, an image storage unit 210, an image output control unit 212, an image output unit 214, an audio storage unit 220, a recording unit 250, a sound collection unit 102, an output instruction reception unit 240, a recording control unit 246, And an output time detection unit 244.

  The imaging unit 202 captures an image. Specifically, the imaging unit 202 receives light from the subject with an imaging device such as a CCD and images the subject. The image storage unit 210 stores the image captured by the imaging unit 202 and the imaging time when the image is captured in association with each other.

  Note that the imaging unit 202 may continuously capture the subject at predetermined time intervals. The imaging unit 202 may hold a predetermined number of images obtained by continuously capturing images. Then, the image storage unit 210 may acquire an image captured at a timing closest to the time when the imaging unit 202 is instructed to capture among the images held by the imaging unit 202.

  The output instruction accepting unit 240 accepts an instruction indicating that the image output unit 214 should output a plurality of images stored in the image storage unit 210. At this time, the image output control unit 212 causes the image output unit 214 to output the image stored in the image storage unit 210. For example, the output instruction reception unit 240 notifies the image output control unit 212 of a plurality of images to be output selected by the user 180. Then, the image output control unit 212 instructs the image output unit 214 to select a plurality of images to be output notified from the output instruction receiving unit 240 from the images stored in the image storage unit 210.

  The image output unit 214 outputs an image stored in the image storage unit 210 based on an instruction from the image output control unit 212. The image output unit 214 may be a display device such as a liquid crystal that displays an image, or may be a printing device that prints an image. The output time detection unit 244 detects an output time that is a time when the output instruction reception unit 240 receives an instruction input for causing the image output unit 214 to output an image.

  The sound collection unit 102 collects sound around the image output unit 214 and supplies the collected sound to the recording unit 250. The recording unit 250 records the sound around the image output unit 214 collected by the sound collection unit 102.

  The recording control unit 246 sends a sound to the recording unit 250 when the difference between the imaging time stored in the image storage unit 210 and the output time detected by the output time detection unit 244 is smaller than a preset allowable recording time. Let them record. The sound storage unit 220 associates with the image stored in the image storage unit 210 and records at least one sound recorded by the recording unit 250 when the image stored in the image storage unit 210 is captured or output. Are stored in association with each other. Therefore, the user 180 can record voice such as narration while outputting the captured image.

  Note that the recording control unit 246 is configured such that when the sound storage unit 220 stores sound in association with the image stored in the image storage unit 210, the sound volume collected by the sound collection unit 102 is determined by the sound storage unit 220. When the volume is higher than the volume of the stored voice, the voice is recorded by the recording unit 250 and the volume collected by the sound collection unit 102 is smaller than the volume of the voice stored in the voice storage unit 220. The sound is not recorded in the recording unit 250. For this reason, the imaging apparatus 100 can record a sound with a higher volume and a more characteristic sound when outputting an image, and a sound with a lower volume such as noise can be recorded. Can be prevented.

  The recording control unit 246 is a case where the difference between the imaging time stored in the image storage unit 210 and the output time detected by the output time detection unit 244 is smaller than a preset recording allowable time, When the volume of the sound around the unit 214 is larger than a predetermined threshold volume, the recording unit 250 records the sound.

  Specifically, the recording control unit 246 does not cause the recording unit 250 to record sound because the sound volume around the image output unit 214 is lower than the threshold sound volume when the image output unit 214 outputs an image. In this case, after the image output unit 214 stops outputting an image, the sound volume of the sound around the image output unit 214 becomes larger than the threshold sound volume so that the sound is recorded by the recording unit 250. For this reason, the imaging apparatus 100 can easily record characteristic sounds generated around the imaging apparatus 100.

  FIG. 3 shows an example of a block configuration of the output device 140. The output device 140 includes an image storage unit 310, an image output control unit 312, an image output unit 314, an output instruction reception unit 340, an output allowable time setting unit 342, an output time detection unit 344, an audio storage unit 320, an audio selection unit 326, An audio output control unit 322 and an audio output unit 324 are provided.

  The image storage unit 310 stores the captured image and the imaging time when the image is captured in association with each other. Specifically, the image captured by the imaging device 100 and the sound recorded by the recording unit 250 of the imaging device 100 are stored in association with each other.

  The audio storage unit 320 is associated with the image stored in the image storage unit 310, at least one sound recorded when the image stored in the image storage unit 310 is captured or output, and the recording in which the sound is recorded. Store time in association with each other.

  The output instruction receiving unit 340 receives an instruction that the image output unit 314 should output a plurality of images stored in the image storage unit 310. For example, the output instruction reception unit 340 causes the user 180 to select an image and instructs the image output control unit 312 to output the selected image to the image output unit 314.

  The image output control unit 312 causes the image output unit 314 to output the image stored in the image storage unit 310. Specifically, the image output unit 314 is caused to output an image instructed to be output from the output instruction receiving unit 340. The image output unit 314 outputs an image stored in the image storage unit 310 based on an instruction from the image output control unit 312. The image output unit 314 may be a display device such as a liquid crystal that displays an image, or may be a printing device that prints an image.

  The output time detection unit 344 detects an output time that is a time when an instruction input for causing the image output unit 314 to output an image is received. The allowable output time setting unit 342 sets the allowable output time based on the difference between the imaging time stored in the image storage unit 310 and the output time detected by the output time detection unit 344. Specifically, the output allowable time setting unit 342 outputs the output when the difference between the imaging time when the image stored in the image storage unit 310 is captured and the output time detected by the output time detection unit 344 is larger. Set the time larger. For example, the output allowable time setting unit 342 sets a period obtained by dividing the difference between the output time instructed to be output and the imaged imaging time by a predetermined number as the output allowable time.

  The sound selection unit 326 stores at least one sound recorded by the sound storage unit 320 from the imaging time stored in the image storage unit 310 to the time when the output allowable time set by the output allowable time setting unit 342 elapses. Select from audio. Then, the audio output control unit 322 causes the audio output unit 324 to output the audio selected by the audio selection unit 326 in synchronization with the timing at which the image output control unit 312 outputs an image to the image output unit 314.

  The audio output unit 324 outputs the audio selected by the audio selection unit 326. Specifically, the audio output unit 324 may be a reproduction device that reproduces audio. The audio output unit 324 may include a display device that outputs characters, such as a liquid crystal display, and may cause the display device to output the audio stored in the audio storage unit 220 as characters. The voice output unit 324 may include a printing device that prints as characters, such as a printing device, and may output the voice stored in the voice storage unit 320 as characters.

  Since the output device 140 selects and outputs an image captured in the near past from the audio recorded near the imaging time, the audio output together with the image is unnatural for the user 180. Can be prevented. In addition, since the voice selection unit 326 selects a voice from voices recorded in a wider time range when outputting a distant past image, the user 180 can select and provide a characteristic voice. it can. Therefore, according to the imaging device 100 and the output device 140 of the present embodiment, the user 180 can easily appreciate the characteristic sound when the image is captured together with the image.

  FIG. 4 shows an example of the time relationship between audio recording and image capturing. The imaging apparatus 100 has a standby mode, an imaging mode, and an output mode as operation modes. And the imaging device 100 stores the sound recorded in the period set in any of standby mode, imaging mode, and output mode. Note that the imaging mode may be an operation mode in which the imaging apparatus 100 can capture and / or record. The output mode may be an operation mode in which the imaging device 100 can output an image and / or sound, for example.

  Note that the imaging apparatus 100 is set to the standby mode immediately after being activated. Note that when the operation mode is set to the standby mode or the output mode, the imaging apparatus 100 transitions to the imaging mode when the user 180 performs an operation related to the imaging operation or the recording operation. The operation related to the imaging operation includes, for example, an operation for imaging an image, an operation for adjusting imaging conditions such as a shutter speed and a focal length, and the like. The operation related to the recording operation includes, for example, an operation for adjusting recording conditions such as an operation for recording sound and an adjustment of recording sensitivity. In addition, when the operation mode is set to the standby mode or the imaging mode, the imaging device 100 transitions to the output mode when the user 180 performs an operation related to the output operation of the imaging device 100. The operation related to the output operation includes, for example, an operation for outputting an image, an operation for selecting an image to be output, an operation for adjusting output conditions such as adjustment of an output speed, and the like. Note that when the imaging apparatus 100 is set to the imaging mode or the output mode, the imaging apparatus 100 transitions to the standby mode on condition that the operation of the imaging apparatus 100 by the user 180 is not operated for a predetermined period. It's okay.

  The image storage unit 210 stores an image captured by the imaging unit 202 at the imaging time t411 in association with the imaging time t411. At this time, the audio storage unit 220 outputs the audio # 431 recorded by the recording unit 250 during the period (t409 to t413) when the imaging apparatus 100 is set to the imaging mode during the period including the imaging time t411 at the imaging time t411. The image is stored in association with the captured image.

  Note that the audio storage unit 220 may store audio recorded at a time closest to the imaging time in association with an image captured at the imaging time. For example, when no sound is recorded during the period (t409 to t413) set in the imaging mode including the imaging time t411, the audio storage unit 220 records the audio recorded at a time close to the imaging time, for example, standby The sound # 430 recorded by the recording unit 250 during the period set to the mode (t408 to t409) may be stored in association with the image captured at the imaging time t411.

  When the user 180 instructs to output the image captured at the imaging time t411 at time t414, the recording control unit 246 captures the output time t414 instructed to be output and the image to be output. When the difference (t414-t411) from the imaging time t411 is smaller than the preset recording allowable time Δt460, the recording unit 250 records the sound around the image output unit 214. Note that the recording control unit 246 sends the image output unit 214 to the recording unit 250 on the condition that the volume of the sound # 432 collected by the sound collection unit 102 is higher than the sound # 431 stored in the sound storage unit 220. Let's record the sound around the. The audio storage unit 220 stores the audio # 432 recorded by the recording unit 250 in association with the image captured at the imaging time t411.

  Similarly, when the user 180 instructs to output the image captured at the imaging time t411 at the time t421, the recording control unit 246 captures the image output at the output time t421 instructed to be output. On condition that the difference (t421-t411) from time t411 is smaller than preset recording allowable time Δt460, and volume # 433 collected by sound collection unit 102 is larger than volume of voice # 432, The recording unit 250 records the sound collected by the sound collection unit 102. Note that the audio storage unit 220 stores one or more audios (# 431, # 432, and # 433) in association with the image captured at the imaging time t411.

  For this reason, the imaging apparatus 100 can record a more characteristic sound with a larger volume when outputting an image. For example, when an image captured by the user 180 on the beach is viewed in a car on the way home, a pleasant situation in the car when the user is viewing the image can be recorded in voice. Therefore, when viewing the image again after returning home, it can be enjoyed with the sound of the state in the car. In addition, it is possible to prevent recording of low noise around the imaging device 100 when the imaging device 100 outputs an image.

  FIG. 5 shows another example of the time relationship between audio recording and image capturing. The imaging apparatus 100 is set in the standby mode during the period (t502 to t504), and takes an image at time t506 within the period (t504 to t508) set in the subsequent imaging mode. The imaging apparatus 100 receives an instruction to output the image captured at the imaging time t506 at time t509 within the period (t508 to t510) set in the output mode. The imaging apparatus 100 is set to the standby mode during a period (t510 to t516) after the image captured at the imaging time t506 is output.

  At this time, the recording control unit 246 collects the sound by the sound collection unit 102 during the period (t504 to t508) set in the imaging mode including the imaging time when the image was captured and the period (t508 to t510) set in the output mode. When the sound to be sounded falls below a predetermined threshold volume, the sound recording unit 250 is not allowed to record the sound. In this case, the audio storage unit 220 does not store the audio associated with the image captured at the imaging time t506 at the time t510.

  When the volume of the sound collected by the sound collection unit 102 exceeds the threshold volume during the period (t510 to t516) when the output mode in which the imaging apparatus 100 outputs an image ends and the standby mode is set, The recording unit 250 records the sound collected by the sound collection unit 102. Specifically, the recording control unit 246 records voices in a period (t512 to t514) exceeding the threshold volume.

  Since the recording control unit 246 causes the recording unit 250 to record a sound exceeding the threshold volume, noise or the like having a low volume when an image is captured and / or when an image is output is recorded by the recording unit 250. Can be prevented. In addition, for example, even when the sound when the user 180 is imaging on the beach is low and the sound is not recorded in the imaging device 100, the image captured by the user 180 on the beach is returned in the vehicle. After watching, you can record music that was playing on the radio inside the car. Therefore, when the user 180 views the image again after returning home, the user 180 can enjoy watching the music with the music listened to in the car.

  FIG. 6 shows an example of a time range in which the voice selection unit 326 selects a voice. For example, when the output instruction receiving unit 340 receives an instruction to output an image captured at time t804 at time t806, the output allowable time setting unit 342 outputs an image that is output as the output time t806 instructed to be output. Is determined based on the difference (t806 to t804) from the imaging time t804 when the image is picked up. The allowable range Δt852 for selecting the audio to be output from the audio output unit 324 is determined. The voice selection unit 326 then records the voices (# 841 to # 841) recorded in the time range (time t804−Δt852 to time t804 + Δt852) before or after Δt852 from the time t804 among the voices stored in the voice storage unit 320. The audio is selected from # 849) and is output to the audio output unit 324.

  Note that the voice selection unit 326 may select a voice recorded during a period from a time before the allowable range Δt852 to the time t804 from the time t804, and during a period from the time t804 to a time after the allowable range Δt852. A recorded voice may be selected.

  In addition, the allowable output time setting unit 342 outputs the audio to be output from the audio output unit 324 as the difference between the imaging time when the captured image stored in the image storage unit 310 is captured and the time when the instruction to output is received is large. Set a larger tolerance for selection. In the example of FIG. 6, when the output allowable time setting unit 342 is instructed at time t806 to output an image captured at time t802 prior to time t804, the output allowable time setting unit 342 is more temporally compared with the allowable range Δt852. A long allowable range Δt850 is set. Then, the voice selection unit 326 selects a voice from the voices (# 811 to # 834) recorded within the time range from the time (t802-Δt850) to the time (t802 + Δt850).

  For example, when outputting an image captured 10 days ago, the audio selection unit 326 selects the audio to be output from the audio recorded for 1 day before and after the imaged imaging time. In addition, when appreciating an athletic meet image taken when the user 180 is in the third grade of elementary school, the voice selection unit 326 picks up the voices recorded during the four years before and after the time of shooting. Select audio. In this case, the user 180 can view the image of the athletic meet when he is in the third grade of elementary school with more characteristic sounds such as an entrance ceremony and a graduation ceremony. Further, when the user 180 is in the sixth grade of elementary school, if he / she sees the image of the athletic meet when he is in the third grade of elementary school, the voice when he / she is viewing the image is recorded. Then, when the user 180 replays the image of the athletic meet when he is in the third grade of elementary school 40 years later, the state of the appreciation when he was in the sixth grade of the elementary school can be viewed together with the recorded voice, and the user 180 can enjoy the image. Can be appreciated.

  Note that the voice selection unit 326 may select the voice with the highest volume among the voices recorded within the range of the allowable output time. In addition, the voice selection unit 326 may select a voice including a human voice among voices recorded within the range of the allowable output time.

  The audio selection unit 326 selects the first audio from among a plurality of audios recorded within the allowable output time range when the image output unit 314 outputs the captured image, and the image output unit When 314 outputs the same image again, a second sound different from the first sound may be selected. At this time, the voice selection unit 326 may select voices in descending order of volume. In addition, the audio selection unit 326 may select audio in the order in which the recorded time is closer to the imaging time when the image was captured. The voice selection unit 326 also outputs an output ratio that is a ratio of the number of times to be output to the voice output unit 324 for each of a plurality of voices stored in the voice storage unit 320, and the number of voices selected by the voice selection unit 326. May be stored, and the sound may be selected so that the ratio of the number of times of sound output to the sound output unit 324 approaches the output ratio.

  According to the audio output system described above, the user 180 can easily appreciate the characteristic audio when the image is captured and / or when the image is output together with the image. Note that the imaging apparatus 100 may include components having the same operations and functions as the components included in the output device 140. Further, the output device 140 may include a component having the same operation and function as the component included in the output device 140.

  FIG. 7 illustrates an example of a hardware configuration of a computer 1500 related to the imaging device 100 and the output device 140. The computer 1500 includes a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a communication interface 1530 connected to the host controller 1582 by an input / output controller 1584. An input / output unit having a hard disk drive 1540 and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584.

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505 in the computer 1500. The communication interface 1530 communicates with the imaging device 100 or the output device 140 via a network, and provides a program and data to the imaging device 100 or the output device 140. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the computer 1500 is started up, a program depending on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the communication interface 1530 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program is read from the recording medium, provided to the communication interface 1530 via the RAM 1520, and transmitted to the imaging device 100 or the output device 140 via the network. The program transmitted to the imaging device 100 or the output device 140 is installed and executed in the imaging device 100 or the output device 140.

  A program that is installed and executed in the imaging apparatus 100 causes the imaging apparatus 100 to function as the imaging apparatus 100 described with reference to FIGS. 1, 2, 4, and 5. The program installed and executed in the output device 140 causes the output device 140 to function as the output device 140 described with reference to FIGS. 1, 3, and 6.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1500 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a figure which shows an example of an audio | voice output system. 1 is a diagram illustrating an example of a block configuration of an imaging apparatus 100. FIG. 3 is a diagram illustrating an example of a block configuration of an output device 140. FIG. It is a figure which shows an example of the time relationship between audio | voice recording and the imaging of an image. It is a figure which shows another example of the time relationship between sound recording and image pick-up. It is a figure which shows an example of the time range which the audio | voice selection part 326 selects an audio | voice. FIG. 3 is a diagram illustrating an example of a hardware configuration of a computer 1500 related to the imaging device 100 and the output device 140.

Explanation of symbols

100 imaging device 102 sound collecting unit 140 output device 150 communication line 180 user 202 imaging unit 210 image storage unit 212 image output control unit 214 image output unit 220 audio storage unit 240 output instruction reception unit 244 output time detection unit 246 recording control unit 250 Recording unit 310 Image storage unit 312 Image output control unit 314 Image output unit 320 Audio storage unit 322 Audio output control unit 324 Audio output unit 326 Audio selection unit 340 Output instruction reception unit 342 Output allowable time setting unit 344 Output time detection unit

Claims (10)

An image storage unit that stores the captured image and the imaging time in association with each other;
An image output unit for outputting an image stored in the image storage unit;
An image output control unit that causes the image output unit to output an image stored in the image storage unit;
An output time detection unit for detecting an output time which is a time when an instruction input for outputting an image to the image output unit is received;
An audio storage unit that associates and stores at least one audio recorded when the image stored in the image storage unit is captured or output in association with the image stored in the image storage unit; and
An audio output unit for outputting audio stored in the audio storage unit;
An output allowable time setting unit that sets an output allowable time based on a difference between an imaging time stored in the image storage unit and an output time detected by the output time detection unit;
Audio that selects audio recorded from the imaging time stored in the image storage unit to the time when the output allowable time set by the output allowable time setting unit elapses from at least one audio stored in the audio storage unit A selection section;
An output device comprising: an audio output control unit that outputs the audio selected by the audio selection unit to the audio output unit in synchronization with a timing at which the image output control unit outputs an image to the image output unit. The output allowable time setting unit increases the output allowable time when the difference between the imaging time when the image stored in the image storage unit is captured and the output time detected by the output time detection unit is larger. The output device according to claim 1 to set. A recording unit for recording sound around the image output unit;
A recording control unit that causes the recording unit to record a sound when a difference between an imaging time stored in the image storage unit and an output time detected by the output time detection unit is smaller than a preset allowable recording time; Further comprising
The output device according to claim 1, wherein the sound storage unit stores sound recorded by the recording unit in association with an image stored by the image storage unit. A sound collecting unit for collecting sound and supplying the sound to the recording unit;
In the case where the sound storage unit stores sound in association with the image stored in the image storage unit, the recording control unit stores the sound volume collected by the sound collection unit in the sound storage unit. If the sound volume is higher than the volume of the sound stored in the sound storage section, the sound is recorded by the recording section. The output device according to claim 3, wherein the recording unit does not record voice. It further includes an imaging unit that captures an image,
The output device according to claim 3, wherein the image storage unit stores an image captured by the imaging unit in association with an imaging time. An image storage stage for storing the captured image and the imaging time in association with each other;
An image output stage for outputting an image stored in the image storage stage;
An image output control step for outputting the image stored in the image storage step in the image output step;
An output time detection step of detecting an output time which is a time of receiving an instruction input for outputting an image in the image output step;
An audio storage step of storing in association with at least one audio recorded when the image stored in the image storage step is captured or output in association with the image stored in the image storage step. When,
An audio output stage for outputting the audio stored in the audio storage stage;
An allowable output time setting step for setting an allowable output time based on the difference between the imaging time stored in the image storage step and the output time detected in the output time detection step;
Audio recorded from the imaging time stored in the image storage stage to the time when the output allowable time set in the output allowable time setting stage elapses is obtained from at least one audio stored in the audio storage stage. The audio selection stage to select,
An output method comprising: an audio output control step in which, in the image output control step, the audio selected in the audio selection step is output in the audio output step in synchronization with a timing at which an image is output in the image output step. An image storage unit for outputting an image, the image storage unit storing an image captured by the output device in association with an imaging time;
An image output unit for outputting an image stored in the image storage unit;
An image output control unit that causes the image output unit to output an image stored in the image storage unit;
An output time detection unit for detecting an output time which is a time when an instruction input for outputting an image to the image output unit is received;
An audio storage unit that associates and stores at least one audio recorded when the image stored in the image storage unit is captured or output in association with the image stored in the image storage unit;
An audio output unit for outputting audio stored in the audio storage unit;
An output allowable time setting unit that sets an output allowable time based on a difference between an imaging time stored in the image storage unit and an output time detected by the output time detection unit;
Audio that selects audio recorded from the imaging time stored in the image storage unit to the time when the output allowable time set by the output allowable time setting unit elapses from at least one audio stored in the audio storage unit Selection part,
A program that causes the audio output unit to function as an audio output control unit that outputs the audio selected by the audio selection unit in synchronization with the timing at which the image output control unit outputs an image to the image output unit. An image storage unit that stores the captured image and the imaging time in association with each other;
An image output unit for outputting an image stored in the image storage unit;
An image output control unit that causes the image output unit to output an image stored in the image storage unit;
An output time detection unit that detects an output time that is a time when an instruction input for outputting an image to the image output unit is received;
A recording unit for recording sound around the image output unit;
When the difference between the imaging time stored in the image storage unit and the output time detected by the output time detection unit is smaller than a preset allowable recording time, the sound volume around the image output unit Is greater than a predetermined threshold volume, a recording control unit for recording the voice in the recording unit,
An audio storage unit that stores the audio recorded by the recording unit in association with the image stored by the image storage unit;
When the recording control unit does not allow the recording unit to record a sound because the sound volume around the image output unit is lower than the threshold volume when the image output unit is outputting an image, An output device that causes the recording unit to record sound when the volume of sound around the image output unit becomes larger than the threshold volume after the image output unit stops outputting an image. An image storage stage for storing the captured image and the imaging time in association with each other;
An image output step of outputting an image stored in the image storage step from an image output unit;
An image output control step for outputting the image stored in the image storage step in the image output step;
An output time detection step of detecting an output time which is a time when an instruction input for outputting an image to the image output unit is received;
A recording stage for recording sound around the image output unit;
The difference between the imaging time stored in the image storage stage and the output time detected in the output time detection stage is smaller than a preset recording allowable time, and the sound around the image output unit A recording control step of recording sound in the recording step when the volume of the sound is greater than a predetermined threshold volume;
A voice storage stage for storing the voice recorded in the recording stage in association with the image stored in the image storage stage,
In the recording control step, when the sound is not recorded in the recording step because the sound volume around the image output unit is lower than the threshold sound volume when the image output unit is outputting an image, An output method in which sound is recorded in the recording stage when the sound volume around the image output unit becomes larger than the threshold sound volume after the image output unit stops outputting an image. An image storage unit for outputting an image, the image storage unit storing an image captured by the output device in association with an imaging time;
An image output unit for outputting an image stored in the image storage unit;
An image output control unit that causes the image output unit to output an image stored in the image storage unit;
An output time detection unit for detecting an output time which is a time when an instruction input for outputting an image to the image output unit is received;
A recording unit for recording sound around the image output unit;
When the difference between the imaging time stored in the image storage unit and the output time detected by the output time detection unit is smaller than a preset allowable recording time, the sound volume around the image output unit Is greater than a predetermined threshold volume, a recording control unit for recording the voice in the recording unit,
In association with the image stored in the image storage unit, function as a sound storage unit that stores the sound recorded by the recording unit,
When the recording control unit does not allow the recording unit to record sound because the volume of the sound around the image output unit is lower than the threshold volume when the image output unit is outputting an image, A program that causes the recording unit to record a sound when the volume of sound around the image output unit becomes higher than the threshold volume after the image output unit stops outputting an image.

Images