JP5375165B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus capable of recording sound associated with an image.

  An imaging device that captures an image and records the audio data in association with the still image by reproducing the image and recording the voice memo when the shutter button is kept pressed for a predetermined time or longer after the image recording process Is known (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 9-322043

  However, in this imaging apparatus, only one audio data can be associated with one image file.

  An object of the present invention is to perform recording and recording in which a plurality of audio data are associated with one image file.

An imaging apparatus according to the present invention includes an imaging unit that images a subject and outputs image data, a face detection unit that detects a face area in the image captured by the imaging unit, and generates position information of the face area; A storage unit that stores the image data and the position information; a display unit that reads the image data from the storage unit and displays an image based on the image data; and a part of the image displayed on the display unit A touch panel for touching, an audio data acquisition unit for acquiring audio data, an audio recording unit for recording audio data acquired by the audio data acquisition unit, and audio based on the audio data recorded in the audio recording unit And when the audio recording unit records the audio data, the display unit displays an image based on the image data and the image data. The face region indicated position information is recognizably displayed within, when said one of said face region in an image is selected, and displays the balloon to the face area in the selected said image by said touch panel When the balloon in the image is touched by the touch panel, the voice data acquisition unit starts acquiring voice data, and the voice data is being recorded by changing the display form of the balloon in the image. When the balloon is touched again by the touch panel or when a predetermined time has elapsed, the acquisition of the audio data by the audio data acquisition unit is terminated, and the audio acquired by the audio data acquisition unit Data is recorded in the voice recording unit in association with position information of the face area selected by the touch panel, and the voice data is recorded. Is recorded in association with the position information of the face area, the audio data corresponds to the position information in or near the face area in the image indicated by the position information associated with the audio data. When the voice data is reproduced and the audio data is reproduced, when the face area in the image displayed on the display unit or its vicinity is touched by the touch panel, the face is displayed. The sound based on the sound data associated with the position information of the area is reproduced by the sound reproduction unit.

  According to the imaging apparatus of the present invention, recording and recording in which a plurality of audio data are associated with one image file can be performed.

It is a perspective view which shows the back surface of the camera which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the system configuration | structure of the camera which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the recording process which concerns on the 1st Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 1st Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 1st Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image file and audio | voice file which were recorded on the data storage part which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image file and audio | voice file which were recorded on the data storage part which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the reproduction | regeneration processing based on the 1st Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the system configuration | structure of the camera which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the recording process which concerns on the 2nd Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 2nd Embodiment of this invention. It is a figure which shows the matrix which concerns on the 2nd Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 2nd Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the reproduction | regeneration processing based on the 2nd Embodiment of this invention. It is a figure which shows the display of the LCD display part which concerns on the 2nd Embodiment of this invention.

  A camera according to a first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view showing the back surface of the camera according to the first embodiment. A photographing lens (not shown) is provided on the front surface of the camera 2, and a power switch 6 for turning on / off the power of the camera 2 and a shutter button 8 for instructing a release operation are provided on the upper surface. In addition, on the back of the camera 2, an LCD display unit 10 that displays a captured image, a touch sensor 12 that specifies a part of the image that is arranged and displayed on the LCD display unit 10, and a selection of a reproduction image A multi-selector 14 for performing image reproduction, a playback button 16 for instructing image reproduction, a stop button 18 for instructing to stop image reproduction, and switching between an image reproduction mode for reproducing only an image and an audio reproduction mode for reproducing an image together with sound. A mode switching button 20, a microphone 22 for acquiring sound, and a speaker 24 for reproducing sound are provided.

  FIG. 2 is a block diagram showing a system configuration of the camera according to the first embodiment. The camera 2 is provided with a CPU 26. The CPU 26 captures subject light via the operation unit 28, the display control unit 30 that controls the display of the LCD display unit 10, the touch sensor 12, and the photographing lens, and captures an image signal. (Analog signal as stored charge) is generated by CCD / CMOS or the like, and an A / D converter (not shown) performs A / D conversion on an imaging signal output from the imaging element 32. A built-in memory 34 that temporarily stores the image data, an image processing unit 36 that performs image processing such as white balance adjustment, contour compensation, and gamma correction on the image data based on the imaging signal output from the imaging device 32, and image data Position information of face area is generated from face recognition data such as face area and face size detected by extracting feature points from The face detection unit 38, the microphone 22 for acquiring audio data, the audio reproduction control unit 40 for controlling the speaker 24 for reproducing audio, and the A / D conversion unit (not shown) A memory card 42 for storing audio data that has been / D converted is connected. Here, the operation unit 28 includes a power switch 6, a shutter button 8, a multi-selector 14, a playback button 16, a stop button 18, and a mode switching button 20. Further, the CPU 26 stores a program for recording and recording a plurality of audio data in association with one image file having face recognition data, and an image file recorded and recorded in association with a plurality of audio data. And a program for reproducing an audio file is incorporated in advance.

  Next, the recording process of the camera according to the first embodiment will be described with reference to the flowchart shown in FIG. First, when a face of a person is detected by the face detection unit 38 when imaging is performed by the camera 2 according to the first embodiment, the position information of the face area of the person is detected for each detected person. And stored in the memory card 42 together with the image data of the photographed image. At this time, when a plurality of persons are detected, for example, a number is assigned so that each person can be identified. For example, the position information of the face area is stored as tag information of an Exif format file. Is done.

  When a captured image is selected by operating the multi selector 14, the selected captured image is read from the memory card 42, and the read image 44 is displayed on the LCD display unit 10 as shown in FIG. 4, for example (step S1). In the image data of the image 44, position information of the face areas of the persons 46, 48, and 50 is stored as face recognition data. Accordingly, as shown in FIG. 5, the frame 52 is displayed on the face of the person indicated by the position information of the face area, the face of the person is displayed in color, and the other area is displayed in gray scale. May be displayed in a recognizable manner.

  Next, it is determined whether or not any region of the image displayed on the LCD display unit 10 is touched by the user's finger or the like (step S2). If it is not touched, image playback continues. If touched, it is determined whether the area detected by the touch sensor 12 matches the area indicated by the position information of the face area (step S3). If the touched area does not match the area indicated by the position information of the face area, the image reproduction is continued.

When the touched area matches the area indicated by the position information of the face area, for example, as shown in FIG. 6, a balloon 54 is displayed on the face of the person 46 indicated by the position information of the face area (step S4). Then, it is determined whether or not the balloon 54 has been touched (step S5). When the balloon 54 is not touched, it is determined whether or not a predetermined time has elapsed (step S6). When the predetermined time has elapsed, for example, 10 seconds, the display of the balloon 54 is stopped and image reproduction is continued. To do.

  When the balloon 54 is touched with a user's finger or the like, the sound is detected by the touch sensor 12 and recording of the voice acquired by the microphone 22 is started (step S7). A balloon 54 is displayed together with the fact that recording is in progress, and it is further determined whether or not the balloon has been touched (step S8). Here, the fact that recording is in progress is displayed by blinking of a balloon 54 or the like. When the balloon 54 is touched, the recording is finished (step S10). If the balloon 54 is not touched, it is determined whether or not a predetermined time has elapsed (step S9). If the predetermined time has not elapsed, recording is continued. If the predetermined time has elapsed, recording is performed. Is finished (step S10). Here, for example, the longest recording time that can be recorded in the memory card 42 or the longest recording time set by the user or preset is used as the predetermined time.

  Next, the recorded audio data is stored in the memory card 42 in association with the image. First, it is confirmed whether an audio file has already been created in the image data associated with the recorded audio data (step S11).

  If no audio file has been created, an audio file associated with the image data is created (step S12), and the recorded audio data is recorded in the audio file (step S13). If an audio file has already been created, the recorded audio data is added to the audio file and recorded (step S13). Then, an index corresponding to the person in the image is added to the audio data (step S14).

  Recording and recording of audio data corresponding to one designated person among the persons having face recognition data in the image reproduced and displayed on the LCD display unit 10 in the processing of steps S1 to 14 is performed. When recording and recording audio data corresponding to the above, the process returns to step S1 again to display and reproduce the image, specify another person in step S2, and audio data corresponding to the other person in steps S3 to S14. Recording and recording process.

  In addition, although the image file of the picked-up image imaged with the camera 2 was demonstrated to the example, it is not restricted to the image file imaged with the camera 2, Even if it is an image file imaged with the other camera, it may have face recognition data. For example, an audio file associated with audio data can be recorded and recorded.

  FIG. 7 is a diagram for explaining an image file and an audio file recorded on the memory card 42. Files and folders recorded on the memory card 42 are given file names and folder names so as to comply with the DCF standard.

  The memory card 42 stores folders “100NIKON” and “101NIKON”. The folder “100NIKON” stores audio files “DSCN0001” associated with the image files “DSCN0001.JPG”, “DSCN0002.JPG”, and “DSCN0001.JPG”. .WAV "is stored. At this time, “DSCN0001.JPG” is reproduced and displayed in step S1, and when the recording process in steps S3 to S10 is performed, it is confirmed in S11 that an audio file has already been created. The recorded audio data is recorded in “DSCN0001.WAV”. In step S14, an index associated with the position information of the face area of the one person specified in step S3 is added to the audio data recorded in the audio file “DSCN0001.WAV”.

  When the image files “DSCN0001.JPG” and “DSCN0002.JPG” are stored in the folder “100NIKON” and the audio file “DSCN0001.WAV” is not stored, for example, “DSCN0001.JPG” is reproduced in step S1. After the display and the recording process of steps S3 to S10, the audio file “DSCN0001.WAV” associated with the image file “DSCN0001.JPG” is checked in step S12 to confirm that no audio file is created in S11. create. In step S13, the voice data recorded in “DSCN0001.WAV” is recorded, and in step S14, the index associated with the position information of the face area of one person designated in step S3 is recorded in the voice file “DSCN0001.WAV”. To the audio data recorded in

  Note that the audio data may be recorded by a method that does not comply with the DCF standard. For example, audio data is recorded by creating an audio file for each person without adding an index to the audio data. In this case, a folder “SOUND” for storing the audio file is created as shown in FIG.

  Then, “DSCN0001.JPG” is reproduced and displayed in step S1, and when a plurality of face recognition data are stored in “DSCN0001.JPG”, one person designated through the same processing as steps S2 to S10. After recording the voice corresponding to the voice file “DSCN0001 — 01.WAV” with the file name associated with the position information of the face area of one person designated when recording voice data in the folder “SOUND” To create. Here, “DSCN0001” is associated with the image file “DSCN0001.JPG”, and “_01” corresponds to the first person among the persons having the position information of the face area of “DSCN0001.JPG”. It shows that When recording voice data corresponding to another person, the voice data corresponding to the other person specified through steps S1 to S10 is recorded and then specified when recording the voice data. An audio file “DSCN0001 — 02.WAV” with a file name associated with the position information of the other person's face area is created in the folder “SOUND”.

  Next, image playback processing of the camera according to the first embodiment will be described with reference to the flowchart shown in FIG. When a captured image to be reproduced is selected by operating the multi selector 14 (step S21), the selected captured image is read from the memory card 42 and displayed on the LCD display unit 10 (step S22), and the mode switching button 20 is operated. It is determined whether or not (step S23). When the mode switching button 20 is not operated, the image display mode is continued because the image reproduction mode is set.

  When the mode switching button 20 is operated, the mode is switched to the audio reproduction mode, and it is confirmed whether the audio file associated with the image file of the displayed image is stored in the memory card 42 (step S24). If the audio file associated with the image file is not stored, the image display is continued. When it is confirmed that the audio file associated with the image file is stored in the memory card 42, a note mark is added to the person whose corresponding audio data is recorded in the image displayed on the LCD display unit 10. Displayed (step S25). For example, as shown in FIG. 10, when there is audio data associated with the persons 46 and 50 in the image 44, a musical note mark 56 is displayed on the persons 46 and 50.

  Then, the user specifies the person by touching the face of the person on which the note mark is displayed (step S26). The sound of the sound data stored in association with the touched person is reproduced from the speaker 24 via the sound reproduction control unit 40 (step S27). For example, when displayed on the LCD display unit 10 as shown in FIG. 10, when the face of the person 46 or the person 50 is touched, the sound of the sound data associated with each person is reproduced. Note that even if the face of the person 48 is touched, the sound is not reproduced.

  According to the camera of the first embodiment, a plurality of audio data can be associated with one image file having face recognition data.

  Next, a camera according to a second embodiment of the present invention will be described with reference to the drawings. The configuration of the camera according to the second embodiment is obtained by changing the face recognition unit of the camera 2 according to the first embodiment to a divided area storage unit. Therefore, a detailed description of the same configuration as that of the first embodiment is omitted, and only different portions will be described in detail. Further, the same components as those in the first embodiment will be described with the same reference numerals.

  FIG. 11 is a block diagram showing a system configuration of a camera according to the second embodiment. In the camera 58 according to the second embodiment, a divided area storage unit 62 that stores a matrix pattern for dividing image data is connected to the CPU 60. In addition, the CPU 60 has a recording and recording program in which a plurality of audio data is associated with one image file, and reproduction of an image file and an audio file recorded and recorded in association with a plurality of audio data. The program which performs is incorporated in advance.

  Next, the recording process of the camera according to the second embodiment will be described with reference to the flowchart shown in FIG. The captured image selected by the operation of the multi-selector 14 is read from the memory card 42, and the read image 64 is displayed on the LCD display unit 10 as shown in FIG. 13, for example (step S31). Next, it is determined whether any area of the image displayed on the LCD display unit 10 is touched by the user's finger or the like (step S32). If it is not touched, image playback continues. When touched, it is detected by the touch sensor 12 and, for example, a matrix 66 for dividing the image area shown in FIG. 14 is read from the divided area storage unit 62. A matrix 66 shown in FIG. 14 is an example of a matrix stored in the divided area storage unit 62, and is an example in which an image is equally divided into 16. Each divided region of the matrix can be identified by a position number or coordinates. Then, as shown in FIG. 15, the matrix 66 is displayed so as to overlap the image 64 displayed on the LCD display unit 10 (step S33).

  Further, the balloon 54 is displayed in the divided area including the touched area (step S34). For example, as shown in FIG. 16, when the touched area is an area including the bell 68, the balloon 54 is displayed in the divided area including the bell 68. Next, it is determined whether or not the balloon 54 has been touched (step S35). When the balloon 54 is not touched, it is determined whether or not a predetermined time has elapsed (step S36). When the predetermined time has elapsed, for example, 10 seconds, the balloon display is stopped and image reproduction is continued. .

  When the balloon 54 is touched by the user's finger or the like, recording of voice is started, for example, the sound of the bell 68 is recorded (step S37). Note that the processing in steps S38 to S40 is the same as the processing in steps S8 to S10 in the flowchart shown in FIG.

  Next, the recorded voice data is associated with the image and stored in the memory card 42. The processes in steps S41 to S43 are the same as the processes in steps S11 to S13 of the flowchart shown in FIG. Therefore, explanation is omitted. Then, an index corresponding to the divided area in the image is added to the recorded audio data (step S44).

  Recording and recording of audio data corresponding to one divided area in the image reproduced and displayed by the processing of steps S31 to S44 is performed. However, when recording and recording of audio data corresponding to another divided area is performed, the recording is performed again. Returning to step S31, the image is reproduced and displayed. After any area of the image is touched in step S32, the matrix is overlaid and displayed in step S33, and sound recording and recording processes in S34 to S44 are performed.

  Note that when the matrix displayed on the image displayed on the LCD display unit 10 is not superimposed, it is detected that the touch sensor is touched, and the audio data associated with the divided area including the touched area is recorded. The configuration has been described as an example, but it is detected that the touch sensor is touched in a state where the matrix is displayed over the image displayed on the LCD display unit, and audio data associated with the touched divided area is recorded. It is good.

  Next, an image reproduction process of the camera according to the second embodiment will be described with reference to a flowchart shown in FIG. The processing in S51 to S54 is the same as the processing in S21 to S24 in the flowchart shown in FIG.

  If it is confirmed in step S54 that the audio file associated with the image file is stored in the memory card 42, the audio data associated with the image displayed on the LCD display unit 10 is in a divided area. A note mark is displayed (step S55). For example, as shown in FIG. 18, when there is audio data associated with a divided area including the bell 68 in the image 64, a musical note mark 56 is displayed in the divided area including the bell 68.

  Then, when the user touches, the divided area where the note mark is displayed is specified (step S56). The sound of the sound data stored in association with the touched divided area is reproduced from the speaker 24 via the sound reproduction control unit 40 (step S57). For example, when displayed on the LCD display unit 10 as shown in FIG. 18, when a divided area including the bell 68 is touched, the sound of the audio data associated with the divided area is reproduced. Note that when another divided area is touched, the sound is not reproduced.

  According to the camera of the second embodiment, a plurality of audio data can be associated with one image file even if the image file does not have face recognition data. Therefore, even an image file captured by another camera can record and record an audio file in which a plurality of audio data is associated with one image file.

  Although the second embodiment has been described using a matrix that equally divides an image into 16 parts, the method of dividing an image is not limited to this, and it may be equally divided into 9 parts, 25 parts, 36 parts, and the like. Moreover, it does not need to divide equally and a user may set a matrix arbitrarily.

  In each of the above-described embodiments, the description has been given using the example in which the balloon is displayed on the face of the person and the divided area. However, the balloon may be displayed in the vicinity of the face of the person and the periphery of the divided area.

  Further, in each of the above-described embodiments, the configuration in which the voice is recorded in association with the face of the person whose contact is detected by the touch sensor and the divided area has been described as an example, but the voice is supported by the operation of the multi selector or the like. A person's face to be recorded and a divided area may be designated. Similarly, when playing back the recorded voice, the face or divided area of the person recorded in association with the voice may be designated by operating the multi selector or the like. In this case, the face of the person designated at the time of recording or reproduction, the color of the divided area is changed, and the like is displayed so as to be recognized.

  Further, in each of the above-described embodiments, the configuration in which the touch sensor detects contact with the LCD display unit by the touch sensor has been described as an example. However, the touch sensor may detect the touch pen contact using a touch pen or the like. Good.

  Further, in each of the above-described embodiments, the explanation has been made using the example in which the musical mark is displayed on the face and the divided area of the person associated with the audio data at the time of the reproduction process. What is the configuration that displays the face and divided area of the person associated with the audio data in a recognizable manner, such as displaying the face and divided area of the associated person in color and displaying the others in grayscale? It may be displayed.

  In each of the above-described embodiments, a camera has been described as an example. However, a digital photo frame or the like that displays image data read from a storage medium such as a memory card on a display unit including a liquid crystal display may be used.

  Further, in each of the above-described embodiments, recording and recording of a plurality of audio data associated with one image file and reproduction of the image file associated with the plurality of audio data using a program pre-installed in the camera. However, by downloading the program via a network such as the Internet and incorporating it into the computer, the computer can be made to function so that the recording, recording, and playback processes described above can be performed. Good.

  The program may be recorded on a computer-readable recording medium such as a flexible disk, a CD-ROM, or a DVD. That is, by reading from a computer-readable recording medium and incorporating it in the computer, the computer may function so that the above-described recording, recording, and reproduction processes can be performed.

DESCRIPTION OF SYMBOLS 2 ... Camera, 10 ... LCD display part, 12 ... Touch sensor, 22 ... Microphone, 24 speaker, 32 ... Image sensor, 38 ... Face detection part, 42 ... Memory card, 54 ... Speech balloon, 56 ... Musical note mark, 62 ... Division Area storage unit.

Claims (1)

An imaging unit for imaging a subject and outputting image data;
A face detection unit that detects a face area in an image captured by the imaging unit and generates position information of the face area;
A storage unit for storing the image data and the position information;
A display unit that reads the image data from the storage unit and displays an image based on the image data;
A touch panel for touching a part of the image displayed on the display unit;
An audio data acquisition unit for acquiring audio data;
An audio recording unit for recording the audio data acquired by the audio data acquisition unit;
An audio reproduction unit that reproduces audio based on the audio data recorded in the audio recording unit;
When the audio data is recorded by the audio recording unit, an image based on the image data is displayed on the display unit, and a face area indicated by the position information is displayed in the image so as to be recognizable. When any of the face areas in the image is selected , a speech bubble is displayed in the face area in the selected image, and when the speech balloon in the image is touched by the touch panel, the voice data acquisition Start to acquire voice data, change the display form of the balloon in the image to indicate that the voice data is being recorded, and when the balloon is touched again by the touch panel, or predetermined when the time has elapsed, before said voice data acquisition unit terminates the acquisition of audio data, acquired by the speech data acquiring unit In association with audio data on the position information of the face area selected by the touch panel was recorded to the audio recording portion,
When the audio data is recorded in association with the position information of the face area, the audio data is located at or near the face area in the image indicated by the position information associated with the audio data. Display that it is recorded in association with the information,
When reproducing the audio data, when the face area in the image displayed on the display unit or the vicinity thereof is touched by the touch panel, the position information associated with the position information of the face area is touched. An imaging apparatus, wherein audio based on audio data is reproduced by the audio reproduction unit.

Images