JP5683863B2 - Image reproduction apparatus and sound information output method of image reproduction apparatus - Google Patents

Description

The present invention relates to an image reproduction apparatus for adding sound information to a recorded image and a sound information output method for the image reproduction apparatus .

  In recent years, portable devices with a photographing function (photographing devices) such as digital cameras have become widespread. Many of these types of photographing devices compress captured images and store them in a recording medium such as a semiconductor memory. With the increase in the compression technology and the recording capacity of the recording medium, enormous images tend to be accumulated in the recording medium. It is extremely difficult to retrieve a desired image from such an enormous amount of images in a short time.

  Therefore, Patent Document 1 discloses a technique for extracting search information from an image. Thereby, in the invention of Patent Document 1, a photographed image having a desired content and configuration can be searched.

    JP 2007-96379 A

    However, the invention of Patent Document 1 has a drawback that the setting for search is extremely complicated. Further, the search method in the invention of Patent Document 1 is logical and not an intuitive search method, and cannot be said to be user friendly. Also, the five senses of human beings cannot be used effectively.

It is an object of the present invention to provide an image reproducing apparatus and a sound information output method for the image reproducing apparatus that can intuitively and quickly retrieve images.
In addition, since the image is converted into sound and stimulation of five senses other than vision is possible, the use of the device can be promoted.

According to an image reproduction device of one embodiment of the present invention, in the image reproduction device, a subject feature detection unit that detects the subject by obtaining a feature of the subject in the image, and assigns sound information to the detected subject. A sound information allocating unit, an output control unit that outputs the sound information allocated by the sound information allocating unit in correspondence with the image including the subject, and the output control corresponding to the display of the image including the photographic subject. A sound output unit that outputs sound based on the sound information output by the unit , a posture determination unit that determines whether the image playback device is tilted, and the posture determination that the image playback device is tilted A control unit that sequentially reads and reproduces the sound information when the determination is made, and controls to stop the reproduction when the tilt of the image reproduction apparatus is restored.
The sound information output method of the image reproduction device according to one aspect of the present invention is a sound information output method of the image reproduction device, wherein the subject feature detection unit detects the subject by obtaining a feature of the subject in the image. A step in which the sound information assigning unit assigns sound information to the detected subject, and an output control unit outputs the sound information assigned by the sound information assigning unit in association with an image including the subject. A step in which the sound output unit outputs sound based on the sound information output from the output control unit in correspondence with display of an image including the subject, and a posture determination unit includes the image reproduction device. If the control unit determines that the image reproduction device is inclined, the control unit reads and reproduces the sound information sequentially when the image determination device determines that the image reproduction device is inclined. If the tilt of the image reproducing apparatus is returned to the original is provided with a step of controlling so as to stop the regeneration, the.

  According to the present invention, there is an effect that an image can be searched intuitively and quickly.

1 is a block diagram showing a photographing device in which an image recording / reproducing apparatus according to a first embodiment of the present invention is incorporated. Explanatory drawing which shows an example of the correlation of the person and sound information by the control part. Explanatory drawing for demonstrating the acoustic output by the control part 1 corresponding to FIG. Explanatory drawing for demonstrating the acoustic output by the control part 1 corresponding to FIG. Explanatory drawing for demonstrating the acoustic output by the control part 1 corresponding to FIG. Explanatory drawing for demonstrating the acoustic output by the control part 1 corresponding to FIG. 5 is a flowchart showing a main flow of the photographing apparatus 10. The flowchart which shows the specific flow of the sound information determination process at the time of face detection of step S15 in FIG. Explanatory drawing which shows a sound information registration screen. The flowchart which shows the specific flow of the sound information determination process at the time of face undetection of step S16 in FIG. The flowchart for demonstrating the operation | movement at the time of reproduction | regeneration mode. Explanatory drawing which shows the example of a score display. Explanatory drawing which shows the example of a display of an image. The block diagram which shows the sound information addition apparatus which concerns on the 2nd Embodiment of this invention. The block diagram which shows the sound information addition apparatus which concerns on the 3rd Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a photographing apparatus in which an image recording / reproducing apparatus according to a first embodiment of the present invention is incorporated. This embodiment is applied to a photographing device such as a camera.

  The imaging device 10 has an imaging unit 2 configured by an imaging device such as a CCD or a CMOS sensor. The imaging unit 2 converts the subject optical image formed on the imaging surface of the imaging element into an electrical signal and outputs the image signal to the control unit 1.

  The control unit 1 performs predetermined signal processing, such as color signal generation processing, matrix conversion processing, and other various digital processing, on the image signal from the imaging unit 2. The control unit 1 includes a recording / playback control unit 1d. The recording / playback control unit 1d performs coding processing on the image signal and the audio signal that are signal-processed by the control unit 1 and compresses the image information and the audio information. Etc. can be given to the recording unit 3 for recording.

  For example, a card interface can be adopted as the recording / playback control unit 1d, and the recording / playback control unit 1d can record image information, audio information, and the like in the recording unit 3 such as a memory card. The recording / playback control unit 1 d can read out image information and audio information recorded on the recording medium and supply them to the control unit 1. The control unit 1 can decode the image information and audio information from the recording / playback control unit 1d to obtain an image signal and an audio signal.

  The photographing device 10 is also provided with a clock unit 4, an operation unit 5, and a touch panel 6. The clock unit 4 generates time information used by the control unit 1. The operation unit 5 includes a release button (not shown) provided in the photographing device 10 and various switches (not shown) such as a shooting mode setting. The operation unit 5 and the touch panel 6 generate operation signals based on user operations and output them to the control unit 1. The control unit 1 controls each unit based on the operation signal.

  The photographing apparatus 10 is also provided with a posture determination unit 7. The posture determination unit 7 can be configured by an acceleration sensor or the like, and detects the posture of the photographing apparatus 10 main body. For example, the posture determination unit 7 detects the tilt or shake of the main body of the photographing apparatus 10 and gives the detection result to the control unit 1.

  The control unit 1 is provided with a display control unit 1b. The display control unit 1 b can receive the captured image from the imaging unit 2 and the reproduction image from the recording / reproduction control unit 1 d from the control unit 1, and display these images on the display unit 8. The display control unit 1b can also display a menu display for operating the photographing apparatus 10 on the display unit 8.

  The control unit 1 is provided with a voice control unit 1c. The audio control unit 1 c can output sound information to the speaker 9 when the audio information reproduced by the recording / reproduction control unit 1 d is supplied from the control unit 1.

  In the present embodiment, the control unit 1 is provided with a face detection unit 1a as an object feature amount detection unit. The face detection unit 1a receives an image signal from the imaging unit 2, and detects whether or not a shadow pattern having a human face feature exists in the image for each frame (frame). The face detection unit 1a provides the recording unit 3 with the feature amount of the detected face area by the recording / playback control unit 1d for recording. The face feature amount differs for each person, and the face detection unit 1a records the feature amount in the recording unit 3 only when the feature amount corresponding to the new person is detected.

  The recording unit 3 includes a face feature information recording area 3a, a sound information recording area 3b, and an image / audio information recording area 3c. In the face feature information recording area 3a, the feature amount of the face detected by the face detection unit 1a is recorded for each person. Sound information is recorded in the sound information recording area 3 b of the recording unit 3.

  As the sound information, for example, information for outputting an arbitrary sound on a predetermined scale, that is, a musical sound, is used. Further, the sound information may include not only information on frequency (scale) but also information on volume, tone color, and the like.

  In the present embodiment, the control unit 1 can assign predetermined sound information to a person (face) specified by a facial feature quantity.

  FIG. 2 is an explanatory diagram showing an example of sound information assignment to a face (person) by the control unit 1. In FIG. 2, the sound information is shown by a musical score for the sake of simplicity.

  The example of FIG. 2 shows an example in which the sounds G, B, and D (English pitch name notation) are associated with the three faces A to C, respectively. In addition, although the example which selects the sound used as a consonant chord in consideration of the reverberation at the time of reproducing | regenerating a sound so that it may mention later is shown here, you may select the sound which becomes a dissonant chord. Note that the Kyowa chord has a relationship between Kyowa intervals where the pitch of the two sounds is 1 degree, 8 degrees, 5 degrees, 4 degrees, 3 degrees, 6 degrees, 3 degrees, or 6 degrees. This is a chord that is composed of only the sounds that it has. Normally, when a person hears a chord, it often feels a familiar chord or a comfortable chord.

  Furthermore, the control unit 1 can also assign sound information to an image in which no face is detected (hereinafter referred to as a background image). The control unit 1 can also assign chords as sound information. The example of FIG. 2 indicates that three chords E, C, and F (code names) can be assigned to the background image. In the example of FIG. 2, the control unit 1 selectively assigns one of three chords according to, for example, the brightness of the image.

  The control unit 1 associates the assigned sound information for each image. The sound information is recorded in the image / audio information recording area 3c of the recording unit 3 in association with the image information of each image by the recording / playback control unit 1d. The image / sound information recording area 3c is an area in which images and sound information are recorded in association with each other.

  Note that the control unit 1 may determine in advance the assignment between the face and the sound information. For example, sounds may be sequentially assigned in order of frequency in the order of detected faces. In addition, sounds may be sequentially assigned in order of frequency according to the detected face size. Alternatively, the control unit 1 may detect a facial expression from the facial feature amount and assign sound information having a frequency that is higher for a smile. Furthermore, the control unit 1 may select sound information to be assigned to the user every time a new human face is detected. Furthermore, the control unit 1 may change the volume, tone, and the like according to the detected facial feature amount. For example, a louder sound may be assigned as the face size in the image is larger, or sounds corresponding to different instruments may be assigned according to the face size. Furthermore, the control unit 1 may set all of the frequency, volume, tone color, and the like to different values for each detected face.

  Similarly, the control unit 1 may determine in advance the assignment of sound information to the background image. For example, sounds may be sequentially assigned in order of frequency according to the brightness of the background image. Moreover, you may make it the control part 1 select the sound information allocated to a user for every background image.

  Note that the control unit 1 does not necessarily have to assign sound information to all faces or background images. For example, a predetermined number of sound information can be assigned to the face and the background image. Alternatively, the control unit 1 may cause the user to select a face and a background image to which sound information is not assigned.

  Furthermore, the control unit 1 is configured not only to detect the face detection unit 1a but also to provide a feature amount detection unit so that a specific object other than the face can be detected, and sound information is assigned to each specific object. Also good.

  The control unit 1 can control the audio control unit 1c to read sound information associated with each image and output the sound when reproducing the image.

  3 to 6 are explanatory diagrams for explaining the sound output by the control unit 1 corresponding to FIG. In FIG. 3 to FIG. 6, the output sound is shown by a musical score in order to simplify the description.

  The control unit 1 can control the recording / playback control unit 1d and the display control unit 1b to read the image information recorded in the recording unit 3 and display the image information on the display unit 8 by normal display or thumbnail display. At the time of this display, the control unit 1 can read sound information recorded in association with an image, and can control the audio control unit 1c to output sound from the speaker 9.

FIG. 3A shows an image including the face C of FIG. When displaying this image, the control unit 1 outputs a sound D as shown in FIG. FIG. 4A shows an image including three faces, face A to face C in FIG. At the time of displaying this image, the control unit 1 outputs sound G, B, and D shown in FIG. The control unit 1 may output the sounds G, B, and D in order, not simultaneously.
In the sound information recording area 3b, priority sound information which is sound information information to be preferentially assigned is also recorded. When assigning a plurality of pieces of sound information, the control unit 1 may preferentially assign the priority sound information. For example, the priority sound information is set so that sounds based on each sound information form a Kyowa interval. When the priority sound information is used, when a plurality of faces are included in the image, a consonant chord is output as a sound, and the user can hear a familiar chord or a comfortable chord.

  FIG. 5 is an explanatory diagram showing an example of assignment of sound information to a background image. 5A and 5C are histograms showing the number of pixels for each luminance in the image, with luminance on the horizontal axis and the number of pixels on the vertical axis. FIG. 5A shows an image with many pixels with relatively low luminance, that is, a relatively dark image, and FIG. 5C shows an image with many pixels with relatively high luminance, that is, a relatively bright image. Yes. The control unit 1 assigns a chord composed of a relatively low frequency sound as sound information for a relatively dark image, and assigns a chord composed of a relatively high frequency sound as sound information for a relatively bright image. FIG. 5B shows a chord (G) assigned to a relatively dark image as shown in FIG. 5A, and FIG. 5D shows a chord assigned to a relatively bright image as shown in FIG. 5C. (F) is shown.

  In addition, although the control part 1 showed the example which assigns the 3 chord which consists of a low frequency sound to a dark image, and assigns the 3 chord which consists of a high frequency sound to a bright image, the allocation method of sound information can be considered variously. For example, the control unit 1 may assign a minor code to a dark image, assign a major code to a bright image, and assign a tension code or the like to a particularly bright image. 5 shows an example in which chords are assigned according to the brightness of the image, sound information may be assigned according to the fineness of the pattern. For example, you may assign the chord which consists of a high frequency sound, so that a pattern is fine. Note that the control unit 1 can also assign a single sound to the background image.

  FIG. 6 is an explanatory diagram showing an example of sound output for continuously reproduced images. FIG. 6A shows images that are continuously reproduced and displayed. A square frame indicates each image, and a plain frame indicates a background image in which no face is detected. FIG. 6B shows the sound output corresponding to the reproduction display of each image in FIG. That is, FIG. 6B corresponds to the display of the image including the face A by sequentially outputting the chords G, C, C, G, and F with respect to the five images from the left in FIG. As a result, a single sound G is acoustically output, and chords G and F are sequentially acoustically output with respect to the right two images in FIG.

  The user confirms the sequentially output sound with his / her ear. The user can recognize that an image including the face A is reproduced by outputting a single sound G, for example. The human ear can distinguish sounds at very short time intervals in the time axis direction, and the user can detect, for example, an image including the face A from a huge amount of images in a very short time. Is possible.

  Next, an example of specific operations during image recording and reproduction will be described with reference to FIGS. FIG. 7 is a flowchart showing a main flow of the photographing apparatus 10.

  When the photographing apparatus 10 is turned on, the control unit 1 determines in step S1 of FIG. 7 whether or not a mode for recording the captured image and the sound information in association with each other (hereinafter referred to as a sound image mode) is instructed. judge. When the sound image mode is not instructed, the control unit 1 determines whether or not another mode is instructed in step S2. For example, when the reproduction mode is instructed, the control unit 1 shifts to the reproduction mode in step S3 and reproduces the captured image. If another mode is not designated, the control unit 1 determines whether or not a shutdown operation has been performed in step S4. When the shutdown operation is performed, the control unit 1 ends the process. If not, the control unit 1 returns the process to step S1 and repeats the determination as to whether the sound image mode is instructed.

  When the sound image mode is instructed, the control unit 1 starts photographing in step S10. That is, the control unit 1 displays a captured image (through image) on the display unit 8 based on the imaging signal from the imaging unit 2. Next, the control unit 1 determines whether or not the release button has been pressed (step S11).

  When the release button is pressed, the control unit 1 records a captured image in step S12. The control unit 1 performs predetermined signal processing on the captured image from the imaging unit 2 and then performs encoding processing. The recording / playback control unit 1d gives the compressed image information to the recording unit 3 for recording.

  Next, the face detection unit 1a performs image recognition processing on the recorded image, and detects a face included in the image (step S13). When the face is detected, the control unit 1 shifts the process from step S14 to step S15, and executes face detection sound information determination processing. If the face is not detected in the image, the control unit 1 moves the process to step S16 and executes the sound information determination process when no face is detected.

  In the face detection sound information determination process, a process of assigning sound information to the face detected from the image is performed. In the face non-detection sound information determination process, a process of assigning sound information to the background image is performed. In the next step S17, the control unit 1 records the sound information assigned in association with the image in association with the image. In step S18, the control unit 1 determines whether or not the photographing is finished. When shooting is completed, the process proceeds to step S4. When shooting is not completed, the process returns to step S11 to wait for the release button to be pressed.

  FIG. 8 is a flowchart showing a specific flow of the sound information determination processing at the time of face detection in step S15 in FIG.

  When a face is detected in the image, the control unit 1 determines in step S21 whether sound information has been registered for the detected face. If registered, in step S22, the control unit 1 sets the registered sound information for the detected face.

  On the other hand, if not registered, the control unit 1 displays a screen for registering sound information to be assigned to the face in step S23.

  FIG. 9 is an explanatory view showing such a sound information registration screen. In FIG. 9, one face 22 detected from the image is displayed on the image 21. Sound information to be registered corresponding to the face 22 is displayed as musical scores 24 and 26. On the image 21, a registration display 23 "Do you want to register?" Or a non-registration display 25 "Do not register" is displayed. Below the registration display 23, sound information to be registered is indicated by notes on the score 24. It is assumed that only musical notes based on sound information that has never been registered are displayed on the score 24 of FIG. Also, below the non-registration display 25, sound information at the time of non-registration is indicated by notes on the score 26.

  When the user performs an operation of selecting one of the notes 24, sound information corresponding to the note selected by the control unit 1 is assigned to the face 22 and registered. In this case, the control unit 1 returns the process from step S24 to step S21, and further sets the sound information registered in the face detected in step S22.

  On the other hand, when the user performs an operation of selecting a note on the score 26, it is instructed not to register sound information for the detected face. In this case, the control unit 1 assigns a prescribed sound (sound E in the example of FIG. 9) to the face detected in step S25. In this case, the prescribed sound information may be silent information.

  In step S26, the control unit 1 chords one or more pieces of sound information set corresponding to each face in one image. As described above, even when a plurality of faces are detected in one image and sound information is assigned to each face, the control unit 1 outputs the assigned sounds in a time division manner without being chorded. You may do it.

  In the example of FIG. 9, the sound information that can be registered is the three sounds G, B, and D, and the prescribed sound when not registered is the sound E. You may comprise so that a sound can be selected. In this case, the registered sound information may not be selected, and the registered sound information may be assigned to a plurality of faces.

  FIG. 10 is a flowchart showing a specific flow of the sound information determination process when no face is detected in step S16 in FIG.

  If no face is detected in the image, the control unit 1 calculates the average luminance of the image in step S31. Next, the control unit 1 determines whether or not the average luminance corresponds to the brightness of the night scene (step S32). When the average luminance corresponds to the brightness of the night scene, the control unit 1 sets a low-pitched chord (for example, the chord G in FIG. 2) in the background image in step S36.

  Next, the control unit 1 determines whether or not the average luminance corresponds to the indoor brightness (step S33). When the average luminance corresponds to the room brightness, the control unit 1 sets a middle chord (for example, the chord C in FIG. 2) in the background image in step S35.

  Next, when the control unit 1 determines in step S33 that the average luminance does not correspond to room brightness, that is, corresponds to daytime outdoor brightness, in step S34, the control unit 1 adds a high-pitched chord (for example, Set the chord F) of FIG. Thus, a chord having a height corresponding to the brightness of the image is set for the background image.

  In the sound information recording process in the next step S17, the control unit 1 controls the recording / playback control unit 1d to be assigned to the image / audio information recording area 3c of the recording unit 3 for each image and each image. Record sound information. In the above example, the control unit 1 assigns a single sound to the face and assigns a chord to the background image, but may assign a chord to the face and assign a single sound to the background image. In the above example, the control unit 1 assigns a sound with a relatively high frequency to the face and assigns a sound with a relatively low frequency to the background image, but assigns a high sound to the face and assigns a low sound to the background image. Good. Alternatively, the control unit 1 can also assign silence to the background image.

  Next, the operation in the playback mode will be described with reference to FIG.

  When it is detected in step S41 that the reproduction mode has been instructed, the control unit 1 displays a reproduction image (step S42). That is, the control unit 1 controls the recording / playback control unit 1d to read out the image recorded in the recording unit 3. The control unit 1 performs a decoding process or the like on the read image, and then controls the display control unit 1b to display on the display unit 8.

  Next, the control part 1 determines whether the imaging device 10 inclines in step S43. The control unit 1 can grasp the tilt angle of the photographing device 10 based on the output of the posture determination unit 7. When the photographing apparatus 10 is not inclined at a predetermined angle, the control unit 1 performs a playback image sending / returning operation in step S48.

Here, it is assumed that the user tilts the photographing device 10 by a predetermined angle or more. If it does so, the control part 1 will transfer a process to step S44 from step S43, and will sequentially read and reproduce | regenerate from the sound information corresponding to the image currently displayed about each sound information corresponding to each image of predetermined reproduction | regeneration order. That is, the control unit 1 controls the audio control unit 1c to output sound based on the sequentially read sound information from the speaker 9. In this case, the control unit 1 outputs sound at a reproduction speed corresponding to the tilt angle of the photographing device 10. That is, each sound is output at a higher speed as the tilt angle of the photographing apparatus 10 is larger, and each sound is output at a lower speed as the tilt angle is smaller.
For example, when the control unit 1 outputs 10 sounds corresponding to 10 images per second, sounds corresponding to 100 images can be output in 10 seconds. By listening to the sound output from the speaker 9, the user can determine whether each image includes a face (person), if it includes a face, who's face, a bright image or a dark image, etc. Judgment can be made instantly by sound.

  In this case, the control unit 1 may control the display control unit 1b to display a score corresponding to the sequentially output sound. FIG. 12 is an explanatory diagram showing a display example in this case. As shown in FIG. 12, a score 32 is displayed on the image 31. The score 32 corresponds to the sound that is currently output sequentially, and the score 32 also changes as the sound is played back. A marker 33 in FIG. 12 indicates the position of a note corresponding to the sound currently being output. Further, the control unit 1 may display the currently output sound in a color different from other sounds.

  Further, the control unit 1 may reverse the sound reproduction order when the tilt direction of the photographing apparatus 10 is reversed. Further, the control unit 1 may display an image corresponding to the sound being reproduced on the image 31 instead of the score of FIG.

  In step S45, the control unit 1 determines whether or not the inclination angle of the imaging device 10 has become equal to or smaller than a predetermined angle. The sound reproduction process is continued until the inclination angle of the photographing apparatus 10 is returned to a predetermined angle or less. By the operation of returning the tilt of the photographing apparatus 10, the control unit 1 stops the sound reproduction (step S46).

  When the reproduction of the sound is stopped, the control unit 1 reads out the information of the image corresponding to the last output sound and displays it on the display unit 8 (step S47). FIG. 13 is an explanatory diagram showing a display example in this case. As shown in FIG. 13, an image 34 corresponding to the sound output last is displayed on the image 31.

  When the end of reproduction is instructed in step S49, the control unit 1 returns the process to the main process of FIG.

  Note that although FIG. 11 illustrates an example in which the method of tilting the photographing device 10 is employed as an operation for reproducing sound, an appropriate method such as operating a button for sound reproduction can be employed. is there.

  As described above, in this embodiment, sound information is recorded in association with a face or background image in an image. By reading out the sound during reproduction and sequentially reproducing the sound, the user can recognize the face (person) and the background image in the image by the reproduced sound. In other words, in the present embodiment, it becomes possible to quickly search for an image using hearing as an aid. Since humans can recognize a single sound in about 1/50 seconds, it is possible to determine the contents of 100 images in 2 seconds without focusing on the screen. Thereby, it is possible to search for a desired image in a very short time from an enormous amount of images recorded in the recording unit.

  In the embodiment described above, sound information is not assigned to the background image of the image in which the face is detected, but sound information may be assigned to both the face and the background image.

(Second Embodiment)
FIG. 14 is a block diagram showing a sound information adding apparatus according to the second embodiment of the present invention.

  In the first embodiment, sound information is added to each image when the image is captured by being applied to a photographing apparatus. On the other hand, the present embodiment shows an example applied to a computer that records sound information added to an already recorded image.

  A plurality of images are recorded in the image recording / playback unit 51. The computer 52 reads the image reproduced by the image recording / reproducing unit 51. The computer 52 is provided with a feature amount detection unit 53 and a sound information allocation unit 54. The feature amount detection unit 53 obtains feature amounts such as a face and a background image in the image. The sound information assigning unit 54 has the same configuration as the control unit 1 and the recording unit 3 in FIG. 1 and assigns sound information to the face and background image in the image. Note that the sound information assigning unit 54 may sequentially assign sound information according to a predetermined rule for the detected face and background image, or may assign sound information in accordance with user settings. The computer 52 records the sound information allocated by the sound information allocation unit 54 in the recording unit 55 together with the corresponding image.

  The monitor 56 can display an image read by the computer 52 from the recording unit 55 and can sequentially output sound information read by the computer 52 as a sound.

  Other configurations, operations and effects are the same as those in the first embodiment.

(Third embodiment)
FIG. 15 is a block diagram showing a sound information adding apparatus according to the third embodiment of the present invention.

  This embodiment shows an example in which the present invention is applied to a television display device that outputs sound information added to an already recorded image.

  A plurality of images are recorded in the image recording / playback unit 51. The television display device 61 reads the image reproduced by the image recording / reproducing unit 51. The television display device 61 is provided with a feature amount detection unit 62 and a sound information allocation unit 63. The feature amount detection unit 62 obtains a feature amount such as a face or a background image in the image. The sound information assigning unit 63 has the same configuration as that of the control unit 1 and the recording unit 3 in FIG. 1 and assigns sound information to the face and background image in the image. In the present embodiment, the television display device 61 can sequentially give the assigned sound information to the speaker control unit 64 for sound output.

  As a result, in the present embodiment, the sound based on the sound information corresponding to the image recorded in the image recording / reproducing unit 51 can be sequentially reproduced, and the image recording / reproducing unit 51 in which a huge amount of images are recorded. It is possible to search in a short time what kind of images are recorded in the image.

  Other functions and effects are the same as those of the first and second embodiments.

    DESCRIPTION OF SYMBOLS 1 ... Control part, 2 ... Imaging part, 3 ... Recording part, 5 ... Operation part, 7 ... Attitude determination part, 8 ... Display part, 9 ... Speaker.

Claims (4)

In an image playback device,
A subject feature detection unit that detects the subject by obtaining a feature of the subject in the image;
A sound information assigning unit for assigning sound information to the detected subject;
An output control unit that outputs the sound information allocated by the sound information allocation unit in correspondence with an image including the subject;
A sound output unit that outputs sound based on the sound information output by the output control unit in correspondence with display of an image including the subject ;
An attitude determination unit that determines whether or not the image reproduction device is inclined;
When the posture determination unit determines that the image playback device is tilted, the sound information is sequentially read and played back, and when the tilt of the image playback device is restored, the playback is stopped. A control unit for controlling
An image reproducing apparatus comprising:   2. The image reproducing apparatus according to claim 1, wherein the sound information is reproduced at a higher speed as the inclination of the image reproducing apparatus is larger.   3. The image reproduction device according to claim 2, wherein the control unit performs control so that the reproduction order of the sound information is reversed when the image reproduction device is inclined opposite to the inclination. .   In the sound information output method of the image playback device,
  A subject feature detection unit detecting the subject by obtaining a feature of the subject in the image;
A sound information assigning unit assigning sound information to the detected subject;
An output control unit outputting the sound information assigned by the sound information assigning unit in correspondence with an image including the subject;
A step of outputting sound based on the sound information output by the output control unit in response to display of an image including the subject;
  A step of determining whether or not the image reproduction device is inclined;
  When the posture determination unit determines that the image playback device is tilted, the control unit sequentially reads and plays the sound information, and when the tilt of the image playback device is restored, the control unit Controlling to stop playback,
  A sound information output method for an image reproducing apparatus.

Images