JP2011119936A - Photographing device and reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently select and reproduce a desired still image when automatically photographed still images are reproduced. <P>SOLUTION: A video camera 100 is an example of a photographing device which photographs the still images during photographing of moving images to reproduce the photographed still images, and is provided with: an imaging part 110 which photographs the moving images, and photographs the still images during photographing of the moving images; an attribute information generation part 120 which generates one or more kinds of attribute information showing a photographing state of at least one of the moving images and the still images photographed by the imaging part 110; a recording part 130 which associates the still images photographed by the imaging part 110 with the attribute information generated by the attribute information generation part 120 to be recorded in a memory 160; an acceptance part 140 which accepts an instruction for selecting a kind of the attribute information; and a playback part 150 which reads the still images associated with the attribute information of the kind corresponding to the instruction accepted by the acceptance part 140 from the memory 160 to be played back. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging device that captures both a moving image and a still image, and more particularly to a technique for reproducing a still image captured during moving image shooting.

  In a photographing apparatus such as a video camera, a function of photographing a still image in parallel with moving image photographing is realized. In such a photographing apparatus, a user can simultaneously photograph and record a still image together with a moving image by pressing a still image photographing button or the like during moving image photographing.

Also, a function has been devised that automatically captures still images during moving image shooting.
For example, Patent Document 1 discloses an imaging apparatus that evaluates a plurality of images that are continuously captured and determines whether to record an image based on the evaluation result. According to the imaging device described in Patent Document 1, for example, an image affected by an external flash or the like can be automatically excluded and the remaining image can be recorded.

  Also, Patent Document 2 discloses zoom operation information executed at the time of capturing a moving image, pan / tilt processing information analyzed based on detection information by an acceleration sensor, input audio signal level information, and input from GPS (Global Positioning System). Highlight point information that can identify important scene parts by identifying important scene parts based on information such as specific anniversary dates identified based on location information, clock information, or information such as still image shooting information An image pickup apparatus that generates and records in association with photographed image data is disclosed. According to the imaging device described in Patent Literature 2, it is possible to easily reproduce the important scene portion using highlight point information after shooting.

JP 2007-306225 A JP 2007-134770 A

  However, when playing back still images automatically shot during moving image shooting according to the above-described prior art, there is a problem that it is not always possible to play back only the still images that the viewer wants to see.

  For example, according to the imaging devices described in Patent Documents 1 and 2, images are recorded based on various factors. Therefore, when playing back all the still images that were automatically shot in order, the still images that were shot with excellent camera work and still images in the category that were shot with smile recognition, etc. Are mixed, so it is not always the still image of the category that the viewer wants to see. Also, if the number of still images taken is large, the playback time may be longer than desired by the viewer. Such a situation occurs because a still image desired to be saved by automatic shooting and a still image desired to be reproduced do not always match.

  In addition, it is also possible to use a playback method in which a viewer selects and plays back a still image to be played back from a still image list or the like that has been realized in the past in order to view only a desired still image. However, since the viewer needs to select one still image to be viewed from the still image list, it is not convenient.

  Accordingly, the present invention has been made to solve the above-described problems, and an object of the present invention is to provide a photographing apparatus that can efficiently select and reproduce a desired still image.

  In order to solve the above-described problem, a photographing apparatus according to the present invention is a photographing apparatus that captures a still image while capturing a moving image, and reproduces the captured still image. An image capturing unit that captures a still image while capturing a moving image; an attribute information generating unit that generates at least one type of attribute information indicating a shooting state of at least one of the moving image and the still image captured by the image capturing unit; A recording unit that records the still image captured by the imaging unit and the attribute information generated by the attribute information generation unit in association with each other, and a reception unit that receives an instruction for selecting the type of the attribute information And a reproduction unit that reads out and reproduces a still image associated with attribute information of a type corresponding to the instruction received by the reception unit from the memory.

  Thus, the selection of the type of attribute information desired by the user is received and the still image associated with the corresponding attribute information is reproduced, so that the still image desired by the user can be efficiently reproduced. Therefore, it is possible to efficiently reproduce the still image desired by the user without forcing the user to select the still images desired by the user one by one.

  The attribute information generation unit may generate attribute information indicating a shooting state of a still image captured by the imaging unit for each frame.

  As a result, attribute information can be recorded in association with each still image, so that a still image desired by the user can be accurately selected.

  In addition, the attribute information includes operation information indicating the operation of the image capturing apparatus, object information indicating the characteristics of the object, operation information, and the object information, during shooting of at least one of the moving image and the still image. The receiving unit may receive an instruction for selecting at least one of the motion information, the subject information, and the evaluation value.

  As a result, since the operation of the photographing apparatus, the characteristics of the subject, and the evaluation thereof are associated with the still image, the still image can be selected based on more information, and the still image desired by the user can be selected. Can be selected accurately.

  In addition, the reception unit receives a first instruction for selecting a still image whose evaluation value is higher than a predetermined threshold, and the reproduction unit receives the first instruction when the reception unit receives the first instruction, Still images associated with evaluation values higher than the threshold may be reproduced.

  Thereby, since a still image with a high evaluation value can be selected, a still image desired by the user can be selected.

  The attribute information includes, as the subject information, personal information indicating that a person is shown in the associated still image, and the reception unit selects a still image in which the person is shown. 2 instructions are received, and the playback unit may play back a still image associated with the person information when the receiving unit receives the second instruction.

  Thereby, since the still image in which the person is reflected can be selected, the still image desired by the user can be selected.

  In addition, the recording unit further records, in the memory, specific person information indicating a predetermined person in association with a still image captured by the imaging unit, and the reception unit records the second instruction. Is received, a third instruction for selecting a predetermined person is further received, and the playback unit is received by the receiving unit from among the still images associated with the person information. The still image associated with the specific person information corresponding to the third instruction may be reproduced.

  Thereby, since the still image in which a specific person is reflected can be selected, the still image desired by the user can be selected.

  Further, the recording unit further records a plurality of specific person information indicating a plurality of predetermined persons in association with the still image captured by the imaging unit, and records the information in the memory. When the second instruction is received, a fourth instruction for selecting a plurality of predetermined persons is further received, and the playback unit includes the receiving unit among the still images associated with the person information. The still image associated with the specific person information corresponding to the third instruction received by may be reproduced.

  As a result, a still image in which a plurality of specific persons are captured can be selected, and thus a still image desired by the user can be selected.

  The reproduction unit reproduces a still image in which the distance between a plurality of persons is smaller than a predetermined distance among the still images associated with the specific person information corresponding to the fourth instruction received by the reception unit. May be.

  As a result, a still image that is close to the person in the image can be selected, so that a still image desired by the user can be selected. This is because a still image with a close distance between persons is likely to be an image having high importance for a user, such as a group photo.

  In addition, the reproduction unit may include a still image in which the predetermined person is a predetermined facial expression among the still images associated with the specific person information corresponding to the third instruction received by the reception unit. You may replay it.

  Thus, a still image in which the person in the image has a specific facial expression (for example, a smile or a face whose eyelids are not closed) can be selected, so that the user can select a still image desired by the user. it can.

  In addition, the reception unit receives a fifth instruction for selecting a still image based on attribute information of the moving image, and the playback unit receives the fifth instruction when the reception unit receives the fifth instruction. Still images taken during a period in which the attribute information satisfies a predetermined condition may be extracted.

  Thus, not only the still image attribute information but also the moving image attribute information including the still image can select a still image that satisfies a predetermined condition, so that the user can select a still image desired by the user. Can do.

  In addition, the photographing apparatus further includes a display unit that displays one or more menu items associated with the attribute information, and the reception unit includes one or more menu items displayed on the display unit. The selection may be accepted as the instruction.

  Thus, by displaying the menu item for selection, the user can easily select attribute information, and convenience is improved.

  The playback method according to the present invention is a playback method for reading out and playing back a still image taken during moving image shooting from a memory, and storing the still image shot during shooting of the moving image in the memory. One or more types of attribute information indicating at least one of the moving image and the still image is stored in association with each other, and the reproduction method receives an instruction for selecting the type of the attribute information. And a playback step of reading out and playing back a still image associated with the attribute information of the type corresponding to the instruction received in the receiving step.

  According to the photographing apparatus of the present invention, when a still image that has been automatically photographed is reproduced, it is possible to efficiently select and reproduce the still image desired by the user.

1 is an external view of a video camera that is an example of an imaging device that captures moving images and still images. FIG. It is a figure which shows the outline of the hardware constitutions inside the video camera which concerns on embodiment of this invention. It is a block diagram which shows an example of a function structure of the video camera which concerns on embodiment of this invention. It is a block diagram which shows an example of the detailed functional structure of the video camera which concerns on embodiment of this invention. It is a figure which shows the structure of the moving image image | photographed with the video camera which concerns on embodiment of this invention. It is a figure which shows an example of the information which identifies the scene which concerns on embodiment of this invention. It is a figure which shows an example of the relationship between the attribute information which concerns on embodiment of this invention, and evaluation. It is a figure which shows the result of the scene analysis part which concerns on embodiment of this invention assigning evaluation to each scene. It is a figure which shows an example of the information content of the reproduction | regeneration information which concerns on embodiment of this invention. It is a figure which shows an example of the relationship between the attribute information for still image extraction which concerns on embodiment of this invention, and evaluation. It is a flowchart which shows an example of the operation | movement which image | photographs a still image during imaging | photography of a moving image among operation | movement of the video camera which concerns on embodiment of this invention. It is a figure which shows the result of having evaluated the flame | frame image | photographed from the viewpoint of the still image extraction which concerns on embodiment of this invention. It is a figure which shows the list of the attribute information with high evaluation score among the attribute information used for evaluation of the still image which concerns on embodiment of this invention. It is a figure which shows an example of the operation menu screen at the time of reproducing | regenerating the picked-up still image which concerns on embodiment of this invention. It is a figure which shows an example of the selection conditions corresponding to each menu item which concerns on embodiment of this invention. It is a figure which shows an example of the operation menu screen at the time of selecting the specific person which concerns on embodiment of this invention. It is a figure which shows an example of the table | surface which matched the image | photographed still image and person flag which concern on embodiment of this invention. It is a figure which shows an example of the screen transition of the operation menu for selecting the still image in which the specific person which concerns on embodiment of this invention is reflected. It is a figure which shows an example of the operation menu screen for selecting the designation | designated of the specific person based on embodiment of this invention, the distance between persons, and a facial expression. It is the figure which added an example of the threshold value to the result of having evaluated the frame from the viewpoint of still image extraction concerning an embodiment of the invention. It is the figure which added the example of the reproduction | regeneration information of a moving image to the result of having evaluated the frame from the viewpoint of the still image extraction which concerns on embodiment of this invention. It is a flowchart which shows an example of the operation | movement which reproduces | regenerates a still image among the operation | movement of the video camera which concerns on embodiment of this invention.

  Hereinafter, an embodiment of a photographing apparatus according to the present invention will be described in detail with reference to the drawings.

  The image capturing apparatus according to the present embodiment is an image capturing apparatus that captures a still image while capturing a moving image, and reproduces the captured still image. An image capturing unit that captures an image, an attribute information generating unit that generates one or more types of attribute information indicating a shooting situation of at least one of a moving image and a still image captured by the image capturing unit, and a still image captured by the image capturing unit Corresponding to the instruction received by the receiving unit, the recording unit that records in the memory in association with the attribute information generated by the attribute information generating unit, the receiving unit that receives an instruction for selecting the type of attribute information And a reproducing unit that reads out and reproduces a still image associated with the type of attribute information from the memory.

  Thus, since the selection of the type of attribute information desired by the user is received and the still image associated with the corresponding attribute information is reproduced, the imaging apparatus according to the present embodiment efficiently converts the still image desired by the user. Can play well. Therefore, it is possible to efficiently reproduce the still image desired by the user without forcing the user to select a desired still image one by one.

<Configuration of photographing apparatus>
First, the configuration of the photographing apparatus according to the present embodiment will be described.

  FIG. 1 is an external view of a movie camera or video camera 100 that is an example of a photographing apparatus that captures moving images and still images. In this embodiment, the video camera 100 is used for description.

FIG. 2 is a diagram showing an outline of the hardware configuration inside the video camera 100.
The video camera 100 includes a lens group 200, an image sensor 201, a video ADC (Analog Digital Converter) 202, a video signal conversion circuit 203, a CPU (Central Processing Unit) 204, a clock 205, a lens control module 206, and the like. , Attitude detection sensor 207, input button 208, display 209, speaker 210, output I / F (Interface) 211, compression / decompression circuit 212, ROM (Read Only Memory) 213, RAM (Random Access Memory) ) 214, HDD (Hard Disk Drive) 215, audio ADC (Analog Digital Converter) 216, and microphone 217. It provided as a source.

  The lens group 200 is a set of one or more lenses that adjust light incident from a subject in order to form a subject image on the image sensor 201. Specifically, the lens group 200 adjusts the focal length and zoom (moving image magnification) by changing the distance between a plurality of lenses having various characteristics. These adjustments may be made manually by the photographer of the video camera 100 or automatically by control from the CPU 204 or the like through the lens control module 206 described later.

  The image sensor 201 is a photoelectric conversion unit that converts light incident through the lens group 200 into an electrical signal. An image sensor such as a CCD (Charge Coupled Device) and a C-MOS (Complementary Metal Oxide Semiconductor) can be used for the image sensor 201.

  The video ADC 202 converts an analog electrical signal output from the image sensor 201 into a digital electrical signal (digital signal). The digital signal is output to the video signal conversion circuit 203.

  The video signal conversion circuit 203 converts a digital signal output from the video ADC 202 into a moving image signal of a predetermined standard such as NTSC (National Television System Committee) or PAL (Phase Alternating Line).

  The CPU 204 is a control unit that controls the entire video camera 100. As the type of control, for example, there is lens control for controlling the incident light to the image sensor 201 by controlling the focal length and zoom of the lens via the lens control module 206. Further, there are input control for external input from the input button 208 and the posture detection sensor 207, operation control of the compression / decompression circuit 212, and the like. The CPU 204 executes these control algorithms with software or the like.

  The clock 205 outputs a clock signal serving as a reference for processing operation to a circuit such as the CPU 204 operating in the video camera 100. Note that the clock 205 can output a single or a plurality of clock signals depending on an integrated circuit to be used or data to be handled. The clock 205 may output a single clock signal or a plurality of clock signals by multiplying a clock signal of one oscillator by an arbitrary multiple.

  The lens control module 206 detects the state of the lens group 200 and operates one or more lenses included in the lens group 200 based on the control from the CPU 204. The lens control module 206 includes a lens control motor 206a and a lens position sensor 206b.

  The lens position sensor 206b detects a distance or a positional relationship between a plurality of lenses constituting the lens group 200. Position information between the plurality of lenses detected by the lens position sensor 206b is transmitted to the CPU 204. The CPU 204 transmits a signal for properly arranging a plurality of lenses to the lens control motor 206a based on information from the lens position sensor 206b and information from other components such as the image sensor 201.

  The lens control motor 206 a drives a motor that operates the lens based on the control signal transmitted from the CPU 204. As a result, the distance between the plurality of lenses of the lens group 200 is changed, and the focal length and zoom of the lens can be adjusted. As a result, the lens control module 206 can collect the incident light that has passed through the lens group 200 on the image sensor 201 and form a subject image accurately.

  In addition to the above, the CPU 204 may detect a camera shake at the time of moving image shooting with the video camera 100 with a lens position sensor 206b or a posture detection sensor 207, which will be described later, and drive the lens control motor 206a. . Thereby, the CPU 204 can also execute an operation for preventing camera shake via the lens control module 206.

  The posture detection sensor 207 detects the posture state of the video camera 100. The posture detection sensor 207 includes an acceleration sensor 207a, an angular velocity sensor 207b, and an elevation angle / decline angle sensor 207c. With these various sensors, the CPU 204 detects in what state the video camera 100 is shooting. Note that these sensors are preferably capable of detecting in three axial directions (vertical direction (z axis), horizontal direction (x axis, y axis, etc.)) in order to detect the attitude of the video camera 100 in detail. .

  The input button 208 is one of input interfaces used by the photographer of the video camera 100. Accordingly, the photographer can transmit various requests to the video camera 100, such as the start and end of shooting, and the insertion of a marking into a moving image during video shooting. The input button 208 is used to input information for reproducing a moving image or a still image or to select a moving image or a still image when reproducing a moving image or a still image captured by the video camera 100. Is possible.

  The display 209 is a display unit provided to view a moving image shot by the video camera 100 and to be used as a shooting finder or the like. As a result, the photographer can check the captured video on the spot. In addition to the above, the display 209 displays various information of the video camera 100, so that more detailed information such as shooting information and device information can be transmitted to the photographer.

  The speaker 210 is used for audio output when playing back a captured moving image. In addition, the speaker 210 can transmit a warning output from the video camera 100 to the photographer with sound.

  The output I / F 211 is used to output a moving image shot by the video camera 100 to an external device. Specifically, the output I / F 211 is a cable interface when the external device and the video camera 100 are connected by a cable. Alternatively, the output I / F 211 is a memory card interface or the like for recording a captured moving image on a memory card. As a result, the captured moving image can be viewed using an external display larger than the display 209 provided in the video camera 100.

  The compression / decompression circuit 212 is a circuit that performs an encoding process for changing a captured moving image or sound into a predetermined digital data format. Specifically, moving picture experts group (MPEG) or H.264 is used for captured moving image and audio data. An encoding process is performed in accordance with a standard such as H.264, and converted (compressed) into a predetermined digital data system. The compression / decompression circuit 212 is a circuit that performs a decoding process of decompressing moving image data in a predetermined digital data format and displaying it on the display 209 or the like when reproducing the captured data.

  The ROM 213 is an example of a memory that records software programs processed by the CPU 204 and various data for operating the programs.

  The RAM 214 is an example of a memory used as a memory area or the like used when executing a software program processed by the CPU 204. Further, the CPU 204 may use the RAM 214 in common with the compression / decompression circuit 212.

  The HDD 215 is an example of a recording medium used for the purpose of storing moving image data encoded by the compression / decompression circuit 212 and other captured still image data. In addition to the moving image data and the still image data, the HDD 215 can also record reproduction information data, which will be described later.

  The audio ADC 216 converts an audio analog electric signal acquired from the outside by the microphone 217 into a digital electric signal.

  The microphone 217 converts audio outside the video camera 100 into an analog electrical signal and outputs the analog electrical signal.

  As described above, the hardware configuration of the video camera 100 has been described with reference to FIG. 2, but the present invention is not limited to the above configuration. For example, the video ADC 202 and the video signal conversion circuit 203 can be realized as a single integrated circuit. Alternatively, a part of the software program executed by the CPU 204 can be separately realized as hardware by using an FPGA (Field Programmable Gate Array).

  Next, the functional configuration of the video camera 100 will be described with reference to FIGS. 3A and 3B. FIG. 3A is a block diagram illustrating an example of a functional configuration of the video camera 100.

  As illustrated in FIG. 3A, the video camera 100 includes an imaging unit 110, an attribute information generation unit 120, a recording unit 130, a reception unit 140, and a playback unit 150.

  The imaging unit 110 captures a moving image and also captures a still image while capturing the moving image. The imaging unit 110 corresponds to the lens group 200, the imaging element 201, the video ADC 202, the video signal conversion circuit 203, and the like in FIG.

  The attribute information generation unit 120 generates one or more types of attribute information indicating a shooting situation of at least one of a moving image and a still image shot by the imaging unit 110. The attribute information generation unit 120 corresponds to an algorithm that is software processed by the CPU 204 of FIG.

  The recording unit 130 records the moving image and the still image captured by the imaging unit 110 in association with the attribute information generated by the attribute information generation unit 120 in the memory 160. Specifically, the recording unit 130 records attribute information indicating the shooting state of the still image generated by the attribute information generating unit 120 and the still image in association with each other.

  Further, the recording unit 130 records attribute information indicating the shooting state of the moving image generated by the attribute information generating unit 120 and the moving image in association with each other. Alternatively, the recording unit 130 may record attribute information indicating the shooting state of the moving image generated by the attribute information generating unit 120 and a still image included in the moving image in association with each other. The recording unit 130 corresponds to an algorithm that is software-processed by the CPU 204 in FIG.

  Note that the memory 160 may not be included in the video camera 100 as shown in FIG. 3A. When the video camera 100 includes the memory 160, the memory 160 corresponds to the RAM 214 and the HDD 215 in FIG.

  The accepting unit 140 accepts an instruction for selecting the type of attribute information. The accepting unit 140 corresponds to the input button 208 in FIG.

  The reproduction unit 150 reads out and reproduces a still image associated with the type of attribute information corresponding to the instruction received by the reception unit 140 from the memory 160. Further, the reproduction unit 150 may read out and reproduce the still image included in the moving image associated with the type of attribute information corresponding to the instruction received by the reception unit 140 from the memory 160. The playback unit 150 corresponds to an algorithm processed by the CPU 204 shown in FIG. 2, a compression / decompression circuit 212, a display 209, a speaker 210, and an output I / F 211.

  Hereinafter, a more detailed functional configuration of the video camera 100 will be described with reference to FIG. 3B. FIG. 3B is a block diagram illustrating an example of a detailed functional configuration of the video camera 100.

  The video camera 100 includes, as functional components, a lens unit 300, an imaging unit 301, a video AD conversion unit 302, a signal processing unit 303, a video signal compression unit 304, an imaging control unit 305, and video analysis. Unit 306, lens control unit 307, posture detection unit 308, attribute information generation unit 309, scene analysis unit 310, reproduction information generation unit 311, audio analysis unit 312, audio signal compression unit 313, and multiplexing Conversion unit 314, storage unit 315, display unit 318, audio AD conversion unit 321, microphone unit 322, external input unit 323, still image analysis unit 324, still image signal expansion unit 325, still image And an extraction unit 326.

  The lens unit 300 adjusts the focal length of the light incident from the subject and the zoom magnification (magnification magnification of the moving image). This adjustment is performed under the control of the lens control unit 307. The lens unit 300 corresponds to the lens group 200 in FIG.

  The imaging unit 301 converts the light transmitted through the lens unit 300 into an electrical signal. The imaging unit 301 outputs data in an arbitrary range on the imaging element as moving image data under the control of the imaging control unit 305. In addition to the moving image data, the imaging unit 301 also includes color space information of three primary colors, white coordinates, gain information of at least two of the three primary colors, color temperature information, Δuv (delta uv), and three primary colors or It is also possible to output information such as gamma information of the luminance signal. These pieces of information are output to the attribute information generation unit 309 via the imaging control unit 305. The imaging unit 301 corresponds to the imaging element 201 in FIG.

  The video AD conversion unit 302 performs analog / digital conversion on the electrical signal indicating the moving image data from the imaging unit 301 according to predetermined processing content. The video AD conversion unit 302 corresponds to the video ADC 202 in FIG.

  The signal processing unit 303 converts the digital signal output from the video AD conversion unit 302 into a moving image signal having a predetermined format. For example, the moving image signal in a predetermined format is a moving image signal in a format conforming to the number of horizontal lines, the number of scanning lines, and the frame rate specified by NTSC. The signal processing unit 303 corresponds to the video signal conversion circuit 203 in FIG.

  The video signal compression unit 304 performs a predetermined encoding process on the digital moving image signal output from the signal processing unit 303, thereby realizing data compression and the like. Specific examples include MPEG2, MPEG4, H.264. There are H.264 encoding schemes. The video signal compression unit 304 corresponds to the compression function of the compression / decompression circuit 212 of FIG.

  The imaging control unit 305 controls the operation of the imaging unit 301. Specifically, the imaging control unit 305 controls the imaging unit 301 such as an exposure amount at the time of shooting, a shooting speed, and sensitivity. These control information are also output to the attribute information generation unit 309. The imaging control unit 305 is one of control algorithms that are software processed by the CPU 204 of FIG.

  The video analysis unit 306 extracts the feature of the moving image from the captured moving image signal. In the present embodiment, the video analysis unit 306 extracts color information (for example, detection of a color distribution included in a moving image) and information such as white balance. In addition, when the moving image includes a human face, the video analysis unit 306 extracts the feature of the moving image by analyzing the moving image signal such as performing face detection. The color distribution can be detected by confirming color information included in the data forming the moving image signal. Further, face detection can be realized by using pattern matching or the like. The video analysis unit 306 is one of algorithms processed by the CPU 204 in FIG.

  The lens control unit 307 controls the operation of the lens unit 300. The lens control unit 307 includes a zoom control unit 307a, a focus control unit 307b, a camera shake correction control unit 307c, and the like. The lens control unit 307 controls the lens unit 300 and outputs control information related to the control of the lens unit 300 to the attribute information generation unit 309. The lens control unit 307 corresponds to the lens control module 206 in FIG.

  The posture detection unit 308 includes an acceleration sensor 308a, an angular velocity sensor 308b, and an elevation angle / decline angle sensor 308c, and detects the acceleration, angular velocity, elevation angle, depression angle, and the like of the video camera 100. The detected information is information used for the purpose of detecting the attitude of the video camera 100 and its change state. Note that it is desirable that acceleration and angular velocity can be detected in three directions, vertical (z-axis) and horizontal (two directions of x-axis and y-axis). The posture detection unit 308 corresponds to the posture detection sensor 207 in FIG.

  The microphone unit 322 converts ambient sounds into electrical signals and outputs them as audio signals. The microphone unit 322 corresponds to the microphone 217 in FIG.

  The audio AD conversion unit 321 converts the analog audio signal output from the microphone unit 322 into digital audio data. The audio AD conversion unit 321 corresponds to the audio ADC 216 in FIG.

  The voice analysis unit 312 extracts a characteristic sound from the voice data. Here, the characteristic sounds are, for example, a photographer's voice, pronunciation of a specific word, cheers, gunshots, and the like. The identification of these sounds is performed by using a method in which specific frequencies of these sounds (speech) are registered in advance and discriminated based on a comparison result with the registered frequencies. Thereby, the voice analysis unit 312 can extract a characteristic sound. The voice analysis unit 312 also detects characteristics such as the input level of the sound captured by the microphone unit 322. The voice analysis unit 312 is one of the algorithms processed by the CPU 204 in FIG.

  The audio signal compression unit 313 converts the audio data output from the audio AD conversion unit 321 using a predetermined encoding algorithm. Examples of audio encoding algorithms include MP3 (MPEG Audio Layer-3) and AAC (Advanced Audio Coding). The audio signal compression unit 313 is one of the compression functions in the compression / decompression circuit 212 of FIG.

  The external input unit 323 is an interface that outputs various types of information received from the outside at the time of moving image shooting, for example, button input by a photographer, shooting index information received from the outside via communication, and the like. Note that the shooting index information is, for example, an identification number used for identifying each shooting such as a number for identifying a shooting scene and a number indicating the number of shooting times during movie shooting.

  The external input unit 323 is an interface that accepts input of information for selecting a moving image or still image, button input for selecting a moving image or still image, and the like when reproducing a moving image or still image. But there is. The external input unit 323 corresponds to the input button 208 in FIG.

  The attribute information generation unit 309 generates shooting information at the time of shooting a moving image or a still image, external input information, and other information as attribute information (metadata). The following information can be considered as an example of attribute information.

-White balance information-Exposure information-Focal length information-Shooting speed information-Zoom magnification information-Sensitivity information-Color space information for the three primary colors-Gain information for at least two of the three primary colors-Color temperature information-Color distribution information-Face Detection information, face recognition information ・ Camera posture information (acceleration, angular velocity, elevation angle, depression angle, etc.)
・ Shooting time information (shooting start time, end time)
・ Shooting index information ・ User input information ・ Frame rate information ・ Sampling frequency information

  The attribute information includes new information characterizing the moving image scene calculated from the various information at the time of shooting (information calculated by combining various information at the time of shooting and analyzing the combined information, etc. ) Is also included. For example, the attribute information generation unit 309 can calculate camera work such as panning and tilting at the time of shooting by the video camera 100 from information on the camera posture (acceleration, angular velocity, elevation angle, depression angle, etc.). Further, the attribute information generation unit 309 can output the focal length and zoom magnification information as attribute information as it is. The attribute information generation unit 309 generates attribute information by extracting and calculating information useful for scene evaluation from various types of information at the time of shooting.

  The scene analysis unit 310 evaluates each of a plurality of scenes constituting the moving image based on the attribute information generated by the attribute information generation unit 309. That is, the scene analysis unit 310 assigns one or more corresponding attribute information for each scene, and evaluates the target scene based on the one or more assigned attribute information. Then, the scene analysis unit 310 selects a scene to be reproduced based on the evaluation result. The scene evaluation and selection method will be described in detail later.

  The reproduction information generation unit 311 generates reproduction information indicating the scene to be reproduced selected by the scene analysis unit 310. The generation of reproduction information will also be described later.

  The attribute information generation unit 309, the scene analysis unit 310, and the reproduction information generation unit 311 are processed as software in the CPU 204 in FIG.

  The multiplexing unit 314 multiplexes and outputs the encoded moving image data from the video signal compression unit 304, the encoded audio data from the audio signal compression unit 313, and the reproduction information from the reproduction information generation unit 311. The multiplexing unit 314 may be software executed by the CPU 204 in FIG. 2, or may be processed by the compression / decompression circuit 212.

  The storage unit 315 temporarily or long-term retains the encoded moving image data, the encoded audio data, the data multiplexed with the reproduction information, and the still image data output from the multiplexing unit 314. The storage unit 315 corresponds to the HDD 215 or the RAM 214 in FIG.

  The still image analysis unit 324 extracts a suitable screen from the captured moving image as a still image based on the information generated by the attribute information generation unit 309 or the scene information analyzed by the scene analysis unit 310. A specific extraction method will be described later. The extracted still image is subjected to processing such as image compression as necessary, and is recorded in the storage unit 315. The still image analysis unit 324 is one of algorithms processed by the CPU 204 in FIG.

  The still image signal expansion unit 325 reads out still image data recorded in the storage unit 315 and displays the read image on the display unit 318. Note that the still image recorded in the storage unit 315 is not necessarily subjected to processing such as image compression. When the still image recorded in the storage unit 315 is compressed, the still image signal decompressing unit 325 reads the still image data, decompresses the read still image data, and outputs the decompressed data to the display unit 318. The still image signal expansion unit 325 is one of the functions of the compression / expansion circuit 212 of FIG.

  The still image extraction unit 326 selects a still image to be reproduced based on information output from the external input unit 323 during reproduction of the still image, reads the selected still image from the storage unit 315, and extracts a still image signal expansion unit. To 325. The information input from the external input unit 323 is information for specifying one or a plurality of still images, and the still image extraction unit 326 is based on the information input from the external input unit 323 and corresponds to the still image. Is read from the storage unit 315 and output to the display unit 318. The still image extraction unit 326 is one of algorithms processed by the CPU 204 in FIG.

  The display unit 318 displays still images and moving images. The display unit 318 corresponds to the display 209 in FIG.

  With the above configuration, it is possible to select and reproduce a still image captured during moving image shooting by the video camera 100 according to information input by the user.

  Note that the imaging unit 110 illustrated in FIG. 3A corresponds to, for example, the lens unit 300, the imaging unit 301, the video AD conversion unit 302, and the signal processing unit 303 illustrated in FIG. 3B. The attribute information generation unit 120 corresponds to, for example, a part of the attribute information generation unit 309, the scene analysis unit 310, and the still image analysis unit 324. The recording unit 130 corresponds to a part of the still image analysis unit 324, for example. The reception unit 140 corresponds to the external input unit 323, for example. The reproduction unit 150 corresponds to, for example, the still image extraction unit 326 and the still image signal expansion unit 325. Note that the above correspondence is not limited to this.

  Also, the hardware configuration diagram of FIG. 2 and the functional block diagrams of FIG. 3A and FIG. 3B are one mode for implementing the photographing apparatus according to the present invention, and the present invention is not limited to this. For example, in FIG. 3B, the scene analysis unit 310 and the reproduction information generation unit 311 are processed before recording data in the storage unit 315, but are compressed into a moving image signal and a compressed audio signal in the storage unit 315. And attribute information at the time of shooting may be multiplexed and recorded once, and the recorded data may be read from the storage unit 315 and then subjected to scene analysis, generation of reproduction information, and the like.

  The correspondence relationship between the hardware configuration in FIG. 2 and the functional configuration in FIGS. 3A and 3B is not limited to the above description. The above description is shown as one form for implementing the imaging device according to the present invention, and the functional configuration and the hardware configuration may be different.

<Analysis of shot scenes and generation of playback information>
Next, the scene analysis of the captured moving image and the reproduction information generation process will be described.

  FIG. 4 is a diagram illustrating a configuration of a moving image captured by the video camera 100. The unit of the moving image that is taken until the photographer instructs to start shooting and instructs the end of shooting or pause of shooting is referred to as “clip”. When the photographer repeats the start of shooting, the end of shooting, or the pause repeatedly, a plurality of clips are generated. In this case, as shown in FIG. 4, a clip number (Clip # 1 to #n) is assigned to each clip.

  One clip is composed of one or a plurality of “scenes”. A scene is a series of videos that are logically connected. The scene can be arbitrarily set by the scene analysis unit 310. For example, one clip may be set as one scene, that is, “1 clip” = “1 scene”. Further, a scene may be set on the boundary of a large screen change. In this case, when the video analysis unit 306 calculates a motion vector between frames and the magnitude (change) of “motion” is larger than a predetermined value, the scene switching portion may be used.

  Further, the scene may be divided based on other shooting information or the like. For example, the scene may be divided by a button input from the photographer. In this case, the scene in the clip can be configured with the clear intention of the photographer. When a plurality of scenes are included in one clip, as shown in FIG. 4, scene numbers (Scene # 1 to #n) are assigned to each scene.

  A scene is composed of one or more “frames”. A frame is an individual still image constituting a moving image. As shown in FIG. 4, frame numbers (Frame # 1 to #n) are assigned to each frame.

  FIG. 5 is a diagram illustrating an example in which the scene analysis unit 310 divides the clip into a plurality of scenes. The scene analysis unit 310 divides the clip based on the attribute information and the like as described above. In FIG. 5, each scene is defined by a “start time” and an “end time”, but the start and end of the scene may be defined by a frame number or the like.

  The “representative time” shown in FIG. 5 indicates the time of a representative frame among a plurality of frames included in each scene. For example, the frame of the representative time is displayed when the scene is displayed as a thumbnail.

  FIG. 6 is a diagram illustrating an example of a relationship between the attribute information used when the scene analysis unit 310 evaluates each scene and the evaluation. For example, the clip-in (shooting start part) and the clip-out (pre-shooting end part) part can be considered as the introduction part and the important part of the movie, and the taken movie has a high logical meaning. Inferred. Therefore, in the example shown in FIG. 6, “A” in “Clip In” and “F” in “Clip Out” have an evaluation score of 100.

  In addition, “D” for “zoom up” and “G” for “zoom down” as camera work at the time of shooting are also set as 30 from the viewpoint of increasing the degree of attention to a specific subject. ing. As described above, the scene analysis unit 310 stores a numerical evaluation for each attribute information in advance.

  In the example of FIG. 6, the higher the evaluation score, the higher the evaluation (preferred). The scene analysis unit 310 evaluates each scene based on the relationship between the attribute information and evaluation in FIG.

  When a plurality of pieces of attribute information are given to one scene, evaluations (evaluation points) assigned to the respective attribute information may be added. Further, when a plurality of pieces of attribute information are given to one scene, an evaluation (evaluation point) of the attribute having the highest evaluation among the attribute information may be used as the evaluation point of the scene. Furthermore, if various attributes included in the scene are taken into consideration, an average value of evaluation points of a plurality of attributes may be evaluated. Furthermore, when evaluating in more detail, you may evaluate for every flame | frame contained in a scene.

  Note that the evaluation need not be performed only on a preferable scene. For example, camera shake at the time of shooting may result in a movie that is difficult for the viewer of the movie to see, so a deduction (minus point) may be evaluated for a scene having such attributes. In the example of FIG. 6, the evaluation for “I” of “hand shake” is set as −20, and the evaluation for “J” of “shooting the ground (vertically downward)” is set as −10.

  Note that the relationship between the attribute information and the evaluation in FIG. 6 is not limited to one. For example, the combination data of a plurality of attribute information and evaluation may be switched depending on a mode (for example, landscape shooting, person (portrait) shooting, still life shooting, etc.) taken by the photographer of the video camera 100. Also, a plurality of combination data may be provided in advance, and a plurality of data may be combined (addition of respective evaluation values at a certain ratio, etc.) depending on the shooting mode. In this case, the combination data of the attribute information and the evaluation can be dynamically changed by changing the composition ratio.

  Furthermore, the user may change the item of attribute information and the evaluation score using the external input unit 323 or the like. Thereby, since the evaluation with respect to the attribute which the user considers more important can be enhanced, the scene analysis unit 310 can perform the evaluation more in line with the user's intention.

  The scene evaluation indicates the priority. In other words, a scene with a high evaluation score is a scene that the user or the video camera 100 determines is important, and is a scene that the user desires to reproduce over a scene with a low evaluation score.

  FIG. 7 is a diagram illustrating a result of assigning an evaluation (priority) to each scene by the scene analysis unit 310. FIG. 7 shows time (scene) on the horizontal axis and evaluation (priority) of each scene on the vertical axis.

  The scene with the symbol “A” in the vicinity of time 0 in FIG. 7 has an attribute of “clip-in” since it is immediately after the start of shooting. According to FIG. 6, the attribute of “clip-in” has an evaluation (priority) of 100.

  A scene to which “B” is attached has an attribute of “extraction of specific sound”. The attribute of “extraction of specific audio” is assigned to the target scene by the scene analysis unit 310 based on the audio information obtained by the audio analysis unit 312 and the like. According to FIG. 6, the attribute of “specific voice extraction” has an evaluation (priority) 70.

  A scene to which “C” is attached has an attribute of “photographed still (after camera work)”. That is, the “C” scene indicates an attribute that means that the photographer takes a picture after moving the main body of the video camera 100 such as pan and tilt, and then takes a picture. It is conceivable that the “C” scene can be determined to have a high value as a moving image for a subject when shooting still. According to FIG. 6, the attribute of “shooting still after camera work” has an evaluation (priority) 40.

  A scene labeled “D” has a “zoom-up” attribute. That is, the “D” scene is a scene in which the video camera is zoomed in and photographed. In FIG. 6, the “zoom-up” attribute has an evaluation (priority) 30.

  As shown in FIG. 6, the “zoom-down” attribute also has an evaluation (priority) 30. However, it is possible to vary the evaluation value between zoom-up and zoom-down. For example, by setting the zoom-up “D” to a higher evaluation than the zoom-down “G”, a scene that is shot with zoom-up, that is, a scene in which the enlargement magnification of the movie is large (a subject that is shot with an enlarged zoom A high evaluation (priority) can be assigned to a certain scene. On the other hand, a relatively low evaluation (priority) can be assigned to a scene with a small moving image magnification.

  A scene labeled “E” has an attribute of “pan, tilt”. In other words, the “E” scene is a scene in which the video camera 100 has performed shooting (camera work) with movement such as panning and tilting. In FIG. 6, the attribute of “pan, tilt” has an evaluation (priority) of 25.

  A scene with the symbol “I” has a “hand shake” attribute. That is, the “I” scene indicates a scene that is shot with camera shake at the time of shooting. In FIG. 6, the “shake” attribute has an evaluation (priority) of −20. This is because the “I” scene may be difficult to see, such as a screen shaking when viewing a moving image, and is deducted.

  A scene to which “J” is attached has an attribute of “shooting the ground (vertically downward)”. In other words, the scene of “J” seems to continue to shoot the ground, which is likely to occur when the photographer accidentally moves while holding the video camera 100 without stopping or temporarily stopping shooting. Indicates a scene. In FIG. 6, the attribute of “ground (vertical downward direction) shooting” has evaluation (priority) −10.

  As described above, the scene analysis unit 310 assigns an evaluation (priority) for each scene. In the example of FIG. 7, the evaluation is assigned in units of scenes. However, the scene analysis unit 310 may perform the above-described evaluation assignment in units of clips or frames.

  The scene analysis unit 310 further extracts only a preferable scene based on the evaluation assigned to each scene. Specifically, the scene analysis unit 310 extracts only highly evaluated scenes. In the example of FIG. 7, the scene analysis unit 310 extracts only the scenes of the portions (i) to (v).

  As for the extraction method, extraction can be performed from various viewpoints such as that the total playback time of the extracted scenes is within a predetermined time, or that the evaluation of the scene is more than a certain level.

  The reproduction information generation unit 311 generates reproduction information describing a moving image reproduction procedure and method according to the scene extracted by the scene analysis unit 310. The reproduction information is information for specifying the extracted scene, and by referring to the reproduction information at the time of reproduction, it is possible to easily and quickly reproduce only a desired scene.

  For example, the reproduction information may be indicated by a start time and an end time of a scene to be reproduced as shown in FIG. In this case, if the time of a representative moving picture screen in each scene (such as a moving picture screen having the highest evaluation in the scene) is recorded separately as the representative time, it is also effective for searching the reference screen.

  As another method for specifying a scene, a scene specifying method according to the storage method of the storage unit 315 in which a moving image is recorded may be used. Specifically, when each scene is recorded in the storage unit 315 in units of files, it is possible to select and reproduce only a specific scene by identifying this file.

  Note that the management of reproduction information is not limited to the above contents, and other methods may be used. For example, designation by a frame number is also possible. In addition, when the reproduction information generated by the reproduction information generation unit 311 is multiplexed by the multiplexing unit 314 as a TS (Transport Stream) such as MPEG, time information (for example, PTS (Presentation Time), for example) is used. It is also possible to record reproduction information by using (Stamp) or DTS (Decoding Time Stamp) time information). H. Similarly, in the case of H.264, time information at the time of predetermined multiplexing may be used.

  Furthermore, when recording moving image data using a standard such as AVCHD (Advanced Video Code High Definition), which is used as a data recording method of some video cameras, a method of recording reproduction information in a PlayList file or the like. It may be used.

  As described above, a digest video (summarized video) can be automatically generated from the captured video.

<Automatic extraction of still images>
Next, the automatic extraction of still images, which is a feature of the video camera 100 according to the present invention, will be described. First, a technique for automatically extracting still images using evaluation used for digest reproduction of captured moving images will be described.

  The still image analysis unit 324 acquires an evaluation for each scene from the scene analysis unit 310 and determines a still image based on the evaluation. Specifically, first, the still image analysis unit 324 acquires the evaluation of FIG. 7 performed by the scene analysis unit 310 for each scene. The still image analysis unit 324 determines a scene whose evaluation is larger than a predetermined value as a still image acquisition target scene based on the evaluation result for each scene evaluated by the scene analysis unit 310.

  In the example of FIG. 7, for example, if a scene with an evaluation of 50 or more is a target scene for acquiring a still image, a scene with a symbol “A” or “B” is a target. In this case, the still image analysis unit 324 identifies a frame to which “A” or “B” is attached from these scenes, and extracts the identified frame as a still image. The still image analysis unit 324 records the extracted still image in the storage unit 315 as still image data.

  Note that the still image analysis unit 324 can acquire still image data to be extracted from either data output from the signal processing unit 303 or data output from the video signal compression unit 304. However, when the still image analysis unit 324 extracts still image data from the data output from the video signal compression unit 304, that is, the encoded video data, some data (related to the image) is encoded. Data) may be deleted. For this reason, it is preferable to extract still image data from data output from the signal processing unit 303, which is data before encoding.

  Still image analysis unit 324 may record the extracted still image data in storage unit 315 using a still image compression technique such as JPEG (Joint Photographics Experts Group). In this case, since the amount of data can be reduced compared to the case of non-compression, recording processing can be performed in the storage unit 315 at a relatively high speed.

  The still image signal decompressing unit 325 reads the still image data recorded in the storage unit 315, and when compression processing such as JPEG is performed, decompresses the read still image data and outputs it to the display unit 318. .

  As described above, with the configuration shown in the present embodiment, the video camera 100 performs evaluation for each scene while generating video, generates reproduction information for digest reproduction, and automatically extracts a suitable scene. Can also be performed.

  Next, a technique for extracting a still image by performing evaluation independent of evaluation for moving images such as digest playback will be described.

  That is, the still image analysis unit 324 uses the evaluation result evaluated for each scene by the scene analysis unit 310 for the extraction of the still image, but may perform evaluation independent of the scene analysis unit 310.

  For example, “B” and “specific audio extraction” in FIG. 6 are effective information for moving images, but are not always effective for extracting still images. In such a case, the still image analysis unit 324 evaluates the still image by a method different from that of the scene analysis unit 310. When the still image analysis unit 324 evaluates a still image by a method different from that of the scene analysis unit 310, the relationship between the type of attribute information and the evaluation point is as shown in FIG.

  For example, the evaluation score for “B” “extraction of specific speech” is 70 in FIG. 6, but is 10 in FIG.

  When evaluating a still image, the still image analysis unit 324 uses the relationship between the type of attribute information and the evaluation point shown in FIG. 9 instead of using the relationship between the type of attribute information and the evaluation point shown in FIG. May be.

  FIG. 10 is a flowchart illustrating an example of an operation of capturing a still image during capturing of a moving image, among the operations of the video camera 100 according to the present embodiment.

  First, the video camera 100 starts shooting a moving image (S101). Specifically, when the external input unit 323 receives an instruction to start capturing a moving image from the user, the imaging unit 301 captures a moving image based on the control of the imaging control unit 305.

  When shooting of a moving image is started, the attribute information generation unit 309 generates attribute information for each scene or frame (S102). Then, based on the attribute information generated by the attribute information generation unit 309, the scene analysis unit 310 performs scene analysis of the moving image, and the still image analysis unit 324 performs evaluation of the still image. For example, the scene analysis unit 310 performs scene analysis of a moving image with reference to the table illustrated in FIG. 6, and the still image analysis unit 324 performs analysis of a still image with reference to the table illustrated in FIG.

  Next, the still image analysis unit 324 determines whether or not the result of the still image or moving image analysis satisfies a predetermined condition (S103). For example, the still image analysis unit 324 determines whether or not the evaluation of the attribute information associated with the still image or the moving image exceeds a predetermined threshold value.

  When the evaluation of the attribute information exceeds the predetermined threshold (Yes in S103), the still image analysis unit 324 records the corresponding still image in the storage unit 315 in association with the attribute information and the evaluation value of the attribute information. (S104). If the evaluation of the attribute information does not exceed the predetermined threshold (No in S103), the process is repeated from the attribute information generation process (S102).

  The video camera 100 repeats the above processing until it finishes shooting the moving image (S105).

  As described above, video camera 100 according to the present embodiment captures a moving image and also captures a still image while capturing the moving image.

<About still image playback>
Hereinafter, an operation for reproducing a still image taken by the video camera 100 will be described in detail.

  FIG. 11 shows the results of evaluating the frames shot by the video camera 100 from the viewpoint of still image extraction.

  In FIG. 11, the still image analysis unit 324 extracts a still image from a scene whose evaluation is greater than a threshold value (40). The scenes from which still images are extracted are the periods (a), (b), and (c) in FIG. 11, and the still image analysis unit 324 extracts still images based on predetermined conditions from each period. Extracting.

  Actually, the point in time when the still image is extracted in the scene of FIG. In the example shown in FIG. 11, four sheets from P1 to P4 from period (a), five sheets from P5 to P9 from period (b), and 17 sheets from P10 to P26 from period (c), a total of 26 This means that still images have been extracted. These still images are created at the same time when a video is shot by the video camera 100 and stored in the storage unit 315.

  Next, FIG. 12 shows a list of attribute information having a high evaluation score among the attribute information used for evaluation for each of the 26 still images P1 to P26 taken by the video camera 100. FIG. FIG. 12 is a diagram illustrating a list of attribute information having a high evaluation score among the attribute information used for evaluating the still image. As shown in FIG. 12, evaluation points and attribute information are shown for each still image.

  For example, still images having “C” written in the attribute information, such as still images P2, P4, P8, P12, and P25, are taken and extracted after camera work. Further, still images such as the still images P4, P8, and P25, in which “Z” is written in the attribute information, are further detected by face detection and extracted.

  Note that the attribute information shown in FIG. 12 shows only attribute information having a high evaluation score among the attribute information used for evaluating the still image. For this reason, the relationship between the attribute information and the evaluation score shown in FIG. 12 does not match the relationship between the attribute information and the evaluation score shown in FIG. 9 (for example, the evaluation score is 57 for P1 in FIG. 12). However, in FIG. 9, the evaluation score of the attribute information “G” is 20). That is, the evaluation score shown in FIG. 12 is a score calculated in consideration of the evaluation score of attribute information other than the attribute information shown in FIG.

  The list of the still images, the evaluation points, and the attribute information with the high evaluation points shown in FIG. 12 may be stored in the storage unit 315 as a table as shown in FIG. 12, for example. Alternatively, it may be created when a still image is reproduced and temporarily referred to.

  Next, FIG. 13A shows an example of an operation menu screen for reproducing a still image taken by the video camera 100.

  The operation menu M500 is an example of a menu screen displayed on the display unit 318 of the video camera 100, for example.

  The operation menu M500 includes menu items M501, M502, M503, M504, M505, M521, and M522. Menu items M501, M502, M503, M504, and M505 display icons and characters corresponding to conditions for selecting a still image that the user wants to reproduce. The user can select a still image to be reproduced by selecting one or more of these menu items.

  In FIG. 13A, an icon corresponding to a condition for selecting a still image is displayed, but the menu design is not limited to this. When the menu item M521 is selected, the selection of the still image can be canceled. When the menu item M522 is selected, selection of a still image can be determined and reproduction can be started.

  The operation menu M500 may be selectable by using an input means (not shown) that includes a cursor and allows the user to make an input such as determination of up / down / left / right. Alternatively, the display unit 318 may be a touch panel screen, and selection may be made by directly touching a menu that the user wants to select. The user can input information necessary for selection from the external input unit 323.

FIG. 13B is a diagram illustrating an example of still image selection conditions for each menu item.
Menu item M501 indicates an instruction for selecting a still image in which one person is shown. When the menu item M501 is selected, the still image extraction unit 326 refers to the list showing the correspondence between the still image and the attribute information shown in FIG. 12, and the attribute information includes “Z” and “face detection”. Select a still image. Note that the attribute information “Z” is an example of person information associated with a still image that is captured because a face is detected.

  Furthermore, the still image extraction unit 326 selects a still image in which a specific person is detected from the selected still images based on an instruction from the user input via the external input unit 323. Therefore, when the menu item M501 shown in FIG. 13A is selected, a still image in which a face of a specific person is detected can be selected from the still images stored in the storage unit 315.

  A menu item M502 indicates an instruction for selecting a still image in which a plurality of persons are shown. When the menu item M502 is selected, the still image extraction unit 326 refers to the list showing the correspondence between the still image and the attribute information shown in FIG. 12, and the attribute information is “Z” “face detection / face identification”. ”Is selected.

  Furthermore, the still image extraction unit 326 selects a still image in which a plurality of specific persons are detected from the selected still images based on an instruction from the user input via the external input unit 323. . Therefore, when the menu item M502 shown in FIG. 13A is selected, a still image in which a plurality of specific human faces are detected can be selected from the still images stored in the storage unit 315.

  A menu item M503 indicates an instruction for selecting a still image that is photographed still after camera work. When the menu item M503 is selected, the still image extraction unit 326 refers to the list showing the correspondence between the still image and the attribute information shown in FIG. 12, and the attribute information is “C” (after camera work). Select a still image that includes “Still and Capture”. Accordingly, when the menu item M503 shown in FIG. 13A is selected, a still image captured after camera work can be selected from the still images stored in the storage unit 315.

  A menu item M504 indicates an instruction for selecting a still image taken during camera work such as panning and tilting. When the menu item M504 is selected, the still image extraction unit 326 refers to the list showing the correspondence between the still image and the attribute information shown in FIG. 12, and the attribute information is “E”, “Pan, Tilt”. Select a still image to include. Therefore, when the menu item M504 shown in FIG. 13A is selected, it is possible to select a still image taken at the time when the pan / tilt operation is performed during moving image shooting.

  A menu item M505 indicates an instruction for selecting a still image photographed with zooming up. When the menu item M505 is selected, the still image extraction unit 326 refers to the list showing the correspondence between the still image and the attribute information shown in FIG. 12, and the attribute information includes “D” and “zoom up”. Select a still image. Therefore, when the menu item M505 shown in FIG. 13A is selected, it is possible to select a still image that has been zoomed up.

  Menu item M506 indicates an instruction for selecting a still image having an evaluation value higher than a predetermined threshold. When the menu item M506 is selected, the still image extraction unit 326 selects a still image whose evaluation score is equal to or higher than a predetermined threshold with reference to the list showing the correspondence between the still image and the attribute information shown in FIG. To do.

  Therefore, when the menu item M506 shown in FIG. 13A is selected, evaluation points of still images taken during moving image shooting can be analyzed, and still images with a predetermined evaluation point or more can be extracted and selected. For example, at the time of shooting, a still image is extracted from a scene with an evaluation score of 40 or more, but when reproducing, only a still image extracted from a scene with an evaluation score of 80 or more can be reproduced.

  A menu item M507 indicates an instruction for selecting a still image based on the attribute information of the moving image. Specifically, the menu item M507 is an instruction for selecting a still image shot during a period in which the attribute information of the moving image satisfies a predetermined condition. For example, the menu item M507 is an instruction for selecting a still image shot during a period in which the evaluation value of the moving image is higher than a predetermined threshold.

  When the menu item M507 is selected, the still image extraction unit 326, when the menu item M507 is selected, the moving image shooting time corresponding to the shooting time of the shot still image is included in the representative section of the moving image. The still image can be extracted and selected. Here, the representative section is a period in which the evaluation value of the attribute information of the moving image is higher than a predetermined threshold. For example, the representative section is a digest reproduction period of the moving image determined by the start time and end time of the reproduction information shown in FIG. is there.

  As described above, the still image extraction unit 326 associates and stores the menu items presented to the user and at least one of shooting information such as attribute information, evaluation points, and shooting time. Accordingly, the still image extraction unit 326 selects a still image having attribute information associated with the menu item selected by the user based on an instruction from the user input via the external input unit 323. Can do.

  Hereinafter, the operation of the video camera 100 when the user reproduces a still image shot during moving image shooting will be described for each menu item.

<Reproduction of a still image in which the face of a specific person is detected>
First, a procedure for selecting and playing back only a still image in which a specific person's face is detected when a user plays back a still image taken during moving image shooting will be described.

  First, the user displays an operation menu M500 for selecting a still image to be reproduced on the display unit 318. Specifically, when the external input unit 323 accepts an instruction from the user to display the operation menu screen, the control unit (not shown in FIG. 3B, corresponding to the CPU 204), the menu screen according to the instruction. Is displayed on the display unit 318.

  Next, in order to select a still image in which the face of a specific person is detected, the user inputs necessary information from the external input unit 323 and selects the menu item M501. For example, the user may select the focus displayed on the operation menu M500 with the up / down / left / right decision buttons or the like, or when the display unit 318 is a touch panel screen, the user touches and selects the menu item M501. Also good.

  When information for selecting the menu item M501 is input to the external input unit 323, the external input unit 323 outputs information indicating that the menu item M501 is selected to the still image extraction unit 326.

  When the information indicating that the menu item M501 is selected is input from the external input unit 323, the still image extraction unit 326 is a list of the still image illustrated in FIG. 12 and the attribute information having a high evaluation score. The still image having the attribute information corresponding to the selected menu item M501 is selected. When the menu item M501 is selected, a still image having a high evaluation score of “Z” in “Face detection / face identification” of the attribute information is applicable, so the still image extraction unit 326 is assigned “Z”. Still image is selected. In the case of FIG. 12, seven sheets of P4, P8, P9, P16, P22, P25, and P26 are applicable.

  When the still image extraction unit 326 specifies a still image to be reproduced, the still image extraction unit 326 reads out the corresponding still image from the storage unit 315 and outputs it to the still image signal decompression unit 325. The still image signal expansion unit 325 expands the input still image and outputs it to the display unit 318. The display unit 318 displays the still image input from the still image signal expansion unit 325.

  As a result, the user can view only the still image that meets the selected condition, that is, only the still image in which the face of a specific person is shown.

<Playing back still images taken by zooming in on a specific person's face>
Next, as an example in which a plurality of conditions are selected and played back, when a user plays back a still image taken at the time of shooting a video, the video camera 100 detects a face of a specific person and zooms in further. A procedure for selecting and playing back only still images taken in this manner will be described.

  First, the user displays an operation menu M500 for selecting a still image to be reproduced on the display unit 318.

  Next, the user inputs necessary information from the external input unit 323 and selects the menu item M501 and the menu item M504. For example, the user may select the focus displayed on the operation menu M500 with the up / down / left / right decision buttons or the like, or when the display unit 318 is a touch panel screen, the user touches the menu item M501 and the menu item M504. May be selected.

  When information for selecting the menu item M501 and the menu item M504 is input to the external input unit 323, the external input unit 323 displays information indicating that the menu item M501 and the menu item M504 are selected as a still image extraction unit. To 326.

  When the information indicating that the menu item M501 and the menu item M504 are selected is input from the external input unit 323, the still image extraction unit 326 is attribute information that has a high evaluation score with the still image illustrated in FIG. The still image having the attribute information corresponding to the selected menu items M501 and M504 is selected. When the menu item M501 is selected, a still image having a high “Z” evaluation score of “face detection / face identification” of the attribute information is applicable, and when the menu item M504 is selected, the attribute information This corresponds to a still image having a high “D” evaluation score for “zoom up”. Therefore, the still image extraction unit 326 selects a still image in which “D” and “Z” are described. In the case of FIG. 12, three sheets of P3, P16, and P25 are applicable.

  When the still image extraction unit 326 specifies a still image to be reproduced, the still image extraction unit 326 reads out the corresponding still image from the storage unit 315 and outputs it to the still image signal decompression unit 325. The still image signal expansion unit 325 expands the input still image and outputs it to the display unit 318. The display unit 318 displays the still image input from the still image signal expansion unit 325.

  As a result, the user can view only the still images that meet the selected conditions, that is, only the still images that are captured with the zoom-up in which the face of a specific person is captured.

  Hereinafter, a menu screen for selecting a still image in which a specific person is captured and information associated with the still image will be described.

  FIG. 14A is a diagram illustrating an example of an operation menu screen when a specific person is selected. FIG. 14B is a diagram illustrating an example of a table in which captured still images are associated with person flags.

  The operation menu M610 illustrated in FIG. 14A includes menu items M611, M612, M613, M614, M615, M616, and M617. Menu items M611, M612, M613, M614, M615, and M616 indicate instructions for selecting one or more predetermined persons, and icons for specifying the registered persons. Still images and names of people are displayed. These menu items increase or decrease according to the number of people registered in advance.

  In the example shown in FIG. 14A, Aiko-chan, Rina-chan, Ayumi-chan, Ichiro-kun, Kentaro-kun, and Yuko-chan are registered in advance, and menu items M611 to M616 corresponding to each of the six persons are displayed. Yes. When menu item M617 is selected, selection of a person can be determined, and reproduction can be started.

  Further, as shown in FIG. 14B, specific person information (person flag) indicating whether or not a registered person is captured is associated with each still image in the still image recorded in the storage unit 315. ing. Note that the storage unit 315 may associate the person flag with all of the still images, or store the person flag in association with only the still image having the attribute information “Z”.

  For example, in the example shown in FIG. 14B, it is shown that Aiko and Ayumi are reflected in the still image P3. The still image P9 shows that all of the registered specific persons are shown.

  The association of the person flag uses, for example, a face detection and face identification function performed when a still image is captured. For example, the still image analysis unit 324 detects a human face by performing ellipse detection or template matching on the captured still image. Further, the still image analysis unit 324 performs template matching with higher accuracy on the detected face, and whether or not each detected face corresponds to a person registered in advance. It detects which person it is.

  Hereinafter, a procedure for selecting a still image in which a specific person is shown will be specifically described. FIG. 15 is a diagram illustrating an example of screen transition of an operation menu for selecting a still image in which a specific person is shown.

  For example, when the menu item M501 or the menu item M502 is selected on the operation menu M500 in FIG. 13A, the operation menu as shown in FIG. 15 is displayed, and the user can select a person by operating. Is possible.

  When selecting a still image in which a specific person is shown, in the operation menu M600, the user selects “face designation” in the menu item M601 and selects “decision” in the menu item M603. The menu item M601 indicates an instruction for starting selection of one or more predetermined specific persons.

  When menu item M603 “OK” is selected in operation menu M600, operation menu M610 shown in FIG. 14A is also displayed on display unit 318.

  In the operation menu M610, a representative face photograph or image of a person actually captured as a still image and / or a character string such as a person's name or nickname is displayed. For example, the menu item M611 displays a face photo or image showing Aiko-chan and a name or nickname.

  When playing back a still image in which Aiko-chan and Kentaro-kun are reflected, the user selects menu item M611 corresponding to Aiko-chan and menu item M615 corresponding to Kentaro-kun, and selects “OK” in menu item M617. . The external input unit 323 accepts that the menu items M611, M615, and M617 are selected, and outputs information indicating that the menu items M611 and M615 are selected to the still image extraction unit 326.

  When the person to be reproduced is specified and selected in the operation menu M610, the still image extraction unit 326 reads the corresponding still image from the storage unit 315, and determines the number of still images and one preset image. The playback time of the selected still image is calculated based on the playback time per still image.

  When the person to be reproduced is designated in the operation menu M610 and the menu item M617 “OK” is selected, the operation menu M620 is displayed on the display unit 318.

  The operation menu M620 is displayed in a waiting time until the still image of the person selected by the operation menu M610 is extracted from the storage unit 315.

  When the still image extraction unit 326 calculates the playback time of the selected still image, an operation menu M630 is displayed on the display unit 318.

  In the operation menu M630, the playback time of a still image in which the person selected in the operation menu M620 is captured is displayed. Here, it is assumed that one still image is reproduced for 4 seconds.

  For example, the playback time of a still image in which Aiko is shown is 2 minutes 30 seconds as shown in the menu item M631, and the playback time of a still image in which Kentaro is shown is 1 as shown in the menu item M632. 20 minutes. The total playback time of a still image in which one or both of Aiko and Kentaro-kun is shown is 3 minutes and 10 seconds as shown in the menu item M633. The total playback time indicated by the menu item M633 is the playback time of the still images in which Aiko and Kentaro are reflected (2 minutes 30 seconds indicated by the menu item M631 and 1 minute 20 seconds indicated by the menu item M632). The reason why it is shorter than the total is that it includes the case where both Aiko and Kentaro are reflected in one still image.

Through the above operation, a specific person can be selected and reproduced.
Note that the still image analysis unit 324 may calculate the distances of a plurality of faces when a plurality of faces are detected when performing face detection and face identification. Then, the still image analysis unit 324 records the calculated distance information in the storage unit 315 in association with the still image, similarly to the person flag.

  At the time of reproduction, the external input unit 323 accepts selection of whether or not a distance is specified, for example, as shown in menu items M604 and M605 in FIG. When “with distance designation” is selected in the menu item M604, the still image extraction unit 326 determines that the distance between the persons shown in the still image is a predetermined threshold from among the still images from which a plurality of persons are detected. Select a smaller still image.

  Still image analysis unit 324 may also detect the facial expressions of a plurality of faces when a plurality of faces are detected when performing face detection and face identification. For example, the still image analysis unit 324 detects whether or not the eyes are open, that is, whether or not the eye lid is closed. Alternatively, the still image analysis unit 324 detects whether or not the face is smiling based on the inclination of the mouth or the corners of the eyes. Then, the still image analysis unit 324 records information indicating the detected facial expression in the storage unit 315 in association with the still image, similarly to the person flag.

  At the time of reproduction, the external input unit 323 accepts selection of whether or not a facial expression is specified, for example, as shown in menu items M606 and M607 in FIG. When the menu item M606 “Expression of expression” is selected, the still image extraction unit 326 selects a facial expression of a person appearing in the still image from a predetermined number of still images from which a plurality of persons are detected (a predetermined condition ( For example, the still image corresponding to “the eyelid is not closed or a smile” is selected.

<Reproduction of still image whose evaluation score is higher than a predetermined threshold>
Next, in the video camera 100, when a user plays back a still image taken during moving image shooting, a procedure for selecting and playing back only a still image with a high evaluation score among the shot still images will be described.

  First, the user displays an operation menu M500 for selecting a still image to be reproduced on the display unit 318.

  Next, necessary information is input from the external input unit 323 and the menu item M506 is selected. For example, the user may select the focus displayed on the operation menu M500 with the up / down / left / right decision buttons or the like, or when the display unit 318 is a touch panel screen, the user touches and selects the menu item M506. Also good.

  When information for selecting the menu item M506 is input to the external input unit 323, the external input unit 323 outputs information indicating that the menu item M506 has been selected to the still image extraction unit 326.

  When information indicating that the menu item M506 has been selected is input from the external input unit 323, the still image extraction unit 326 refers to the list of still images and still image evaluation points illustrated in FIG. A still image having an evaluation value equal to or higher than a predetermined threshold is selected. For example, when the menu item M506 is selected, still image evaluation points and threshold values when a still image having an evaluation score equal to or higher than the threshold value (80) is reproduced are shown in FIG. In the case of FIG. 17, 11 sheets of P3, P4, P9, P12, P13, P14, P15, P16, P17, P21, and P22 are applicable.

  When the still image extraction unit 326 specifies a still image to be reproduced, the still image extraction unit 326 reads out the corresponding still image from the storage unit 315 and outputs it to the still image signal decompression unit 325. The still image signal expansion unit 325 expands the input still image and outputs it to the display unit 318. The display unit 318 displays the still image input from the still image signal expansion unit 325.

  As a result, the user can view only the still images that meet the selected condition, that is, only the still images having the evaluation score equal to or greater than a predetermined threshold among the captured still images.

  In this embodiment, when the menu item M506 is selected, the evaluation point of the still image taken at the time of moving image shooting is analyzed, and a still image equal to or higher than a predetermined evaluation point is extracted and selected. The number of images to be reproduced may be determined in advance, and the lower limit of the evaluation points of still images to be reproduced may be determined so as to correspond to the number of images. For example, the still image extraction unit 326 sequentially selects still images with the highest evaluation score, and ends the selection when the number of selected still images reaches a predetermined number.

  Alternatively, the time for reproducing and the time for displaying one image may be determined in advance, and the lower limit of the evaluation point of the still image to be reproduced may be determined so as to correspond to the total time calculated from these. Of course, a menu item for selecting a still image by the above procedure may be provided separately from the menu item M506.

<Playing back still images taken during the movie playback section>
Next, in the video camera 100, when a user plays back a still image taken during moving image shooting, a procedure for selecting and playing back only a still image shot during a moving image playback section will be described.

  First, the user displays an operation menu M500 for selecting a still image to be reproduced on the display unit 318.

  Next, the user inputs necessary information from the external input unit 323 and selects the menu item M507. For example, the user may select the focus displayed on the operation menu M500 with the up / down / left / right decision buttons or the like, or when the display unit 318 is a touch panel screen, the user touches and selects the menu item M507. Also good.

  When information for selecting the menu item M507 is input to the external input unit 323, the external input unit 323 outputs information indicating that the menu item M507 is selected to the still image extraction unit 326.

  When the information indicating that the menu item M507 has been selected is input from the external input unit 323, the still image extraction unit 326 receives the scene start time and end time shown in FIG. With reference to the shooting time of each still image, a still image in which the shooting time of the still image is included in any of the scenes shown in FIG. 8 is extracted.

  FIG. 18 is a diagram in which the reproduction section of the moving image shown in FIG. 8 is entered in the graph of FIG. As shown in FIG. 18, when still images included in the moving image playback section are extracted, P1, P5, P6, and P8 are applicable.

  When the still image extraction unit 326 specifies a still image to be reproduced, the still image extraction unit 326 reads out the corresponding still image from the storage unit 315 and outputs it to the still image signal decompression unit 325. The still image signal expansion unit 325 expands the input still image and outputs it to the display unit 318. The display unit 318 displays the still image input from the still image signal expansion unit 325.

  Thereby, the user can view only the still image included in the playback section of the moving image.

  Note that the operation menu M500 may be displayed on the display unit 318 when a user inputs a command for displaying a menu from the external input unit 323. Alternatively, the operation menu M500 may be automatically displayed on the display unit 318 when the video camera 100 has a shooting mode and a playback mode and is switched from the shooting mode to the playback mode by some input.

  In addition, in the embodiment, information for selecting a still image to be reproduced is input at the time of reproduction. However, a reproduction condition to be preferentially set by a setting item for reproduction or the like may be set in advance. In that case, when the reproduction of the still image is executed, the corresponding still image is automatically selected and reproduced in accordance with predetermined setting contents.

  FIG. 19 is a flowchart illustrating an example of an operation for reproducing a still image among the operations of the video camera 100 according to the present embodiment.

  First, the external input unit 323 receives an instruction from the user (S201). Specifically, when the reproduction process is started, the display unit 318 displays an operation menu M500 as shown in FIG. 13A, and the external input unit 323 accepts selection of a menu item as an instruction from the user.

  Next, the still image extraction unit 326 extracts a still image based on the instruction received by the external input unit 323 (S202). That is, the still image extraction unit 326 extracts a still image associated with the type of attribute information corresponding to the instruction received by the external input unit 323. A specific example of the still image extraction is as described above. The extracted still image is expanded by the still image signal expansion unit 325 as necessary.

Then, the display unit 318 displays only the extracted still image (S203).
As described above, the video camera 100 according to the present embodiment accepts selection of the type of attribute information desired by the user and reproduces a still image associated with the corresponding attribute information. Still images can be efficiently reproduced. Therefore, it is possible to efficiently reproduce the still image desired by the user without forcing the user to select a desired still image one by one.

  As mentioned above, although the imaging device and the reproduction method according to the present invention have been described based on the embodiments, the present invention is not limited to these embodiments. Unless it deviates from the meaning of this invention, the form which carried out the various deformation | transformation which those skilled in the art can think to the said embodiment, and the form constructed | assembled combining the component in a different embodiment is also contained in the scope of the present invention. .

  As described above, the present invention can be realized not only as a photographing apparatus and a reproduction method, but also as a program for causing a computer to execute the reproduction method of the present embodiment. Moreover, you may implement | achieve as recording media, such as computer-readable CD-ROM which records the said program. Furthermore, it may be realized as information, data, or a signal indicating the program. These programs, information, data, and signals may be distributed via a communication network such as the Internet.

  In the present invention, some or all of the components constituting the photographing apparatus may be configured by one system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip. Specifically, the system LSI is a computer system including a microprocessor, a ROM, a RAM, and the like. .

  The photographing apparatus and the reproduction method according to the present invention have an effect that it is possible to efficiently select a still image to be reproduced from automatically photographed still images, and can be used for a video camera or the like.

DESCRIPTION OF SYMBOLS 100 Video camera 110, 301 Image pick-up part 120, 309 Attribute information generation part 130 Recording part 140 Reception part 150 Playback part 160 Memory 200 Lens group 201 Image pick-up element 202 Image | video ADC
203 Video signal conversion circuit 204 CPU
205 Clock 206 Lens control module 206a Lens control motor 206b Lens position sensor 207 Posture detection sensors 207a and 308a Acceleration sensors 207b and 308b Angular velocity sensors 207c and 308c Elevation and depression angle sensors 208 Input button 209 Display 210 Speaker 211 Output I / F
212 Compression / decompression circuit 213 ROM
214 RAM
215 HDD
216 Audio ADC
217 Microphone 300 Lens unit 302 Video AD conversion unit 303 Signal processing unit 304 Video signal compression unit 305 Imaging control unit 306 Video analysis unit 307 Lens control unit 307a Zoom control unit 307b Focus control unit 307c Camera shake correction control unit 308 Attitude detection unit 310 Scene Analysis unit 311 Playback information generation unit 312 Audio analysis unit 313 Audio signal compression unit 314 Multiplexing unit 315 Storage unit 318 Display unit 321 Audio AD conversion unit 322 Microphone unit 323 External input unit 324 Still image analysis unit 325 Still image signal expansion unit 326 Still image extraction unit M500, M600, M610, M620, M630 Operation menu M501, M502, M503, M504, M505, M506, M507, M521, M522, M601, M602, M603, M604, M605 M606, M607, M611, M612, M613, M614, M615, M616, M617, M631, M632, M633 menu item

Claims (12)

A shooting device that takes a still image while shooting a moving image and plays back the shot still image,
An imaging unit that captures the moving image and captures a still image while capturing the moving image;
An attribute information generation unit that generates one or more types of attribute information indicating a shooting situation of at least one of a moving image and a still image captured by the imaging unit;
A recording unit that records a still image captured by the imaging unit in association with attribute information generated by the attribute information generation unit in a memory;
A reception unit that receives an instruction to select a type of the attribute information;
An imaging apparatus comprising: a reproduction unit that reads out and reproduces a still image associated with attribute information of a type corresponding to an instruction received by the reception unit from the memory. The imaging apparatus according to claim 1, wherein the attribute information generation unit generates attribute information indicating a shooting state of a still image captured by the imaging unit for each frame. The attribute information includes operation information indicating an operation of the image capturing apparatus, object information indicating a feature of the object, and evaluation values of the operation information and the object information during at least one of the moving image and the still image. And at least one of
The imaging device according to claim 2, wherein the reception unit receives an instruction for selecting at least one of the operation information, the subject information, and the evaluation value. The accepting unit accepts a first instruction for selecting a still image having the evaluation value higher than a predetermined threshold,
The imaging device according to claim 3, wherein the reproduction unit reproduces a still image associated with an evaluation value higher than the threshold when the reception unit receives the first instruction. The attribute information includes person information indicating that a person is shown in the associated still image as the subject information,
The reception unit receives a second instruction for selecting a still image in which a person is shown,
The imaging device according to claim 3, wherein the reproduction unit reproduces a still image associated with the person information when the reception unit receives the second instruction. The recording unit further associates the still image captured by the imaging unit with specific person information indicating a predetermined person and records it in the memory,
When the reception unit receives the second instruction, the reception unit further receives a third instruction for selecting one predetermined person,
The photographing unit according to claim 5, wherein the reproduction unit reproduces a still image associated with specific person information corresponding to the third instruction received by the reception unit among the still images associated with the person information. apparatus. The recording unit further associates a plurality of specific person information indicating a plurality of predetermined persons with the still image taken by the imaging unit, and records the information in the memory.
When the receiving unit receives the second instruction, the receiving unit further receives a fourth instruction for selecting a plurality of predetermined persons,
The photographing unit according to claim 5, wherein the reproduction unit reproduces a still image associated with specific person information corresponding to the third instruction received by the reception unit among the still images associated with the person information. apparatus. The reproduction unit reproduces a still image in which a distance between a plurality of persons is smaller than a predetermined distance among still images associated with specific person information corresponding to a fourth instruction received by the reception unit. 8. The photographing apparatus according to 7. The reproduction unit reproduces a still image in which the predetermined person is a predetermined facial expression among the still images associated with the specific person information corresponding to the third instruction received by the reception unit. The imaging device according to claim 6. The receiving unit receives a fifth instruction for selecting a still image based on the attribute information of the moving image;
The photographing unit according to claim 1, wherein, when the reception unit receives the fifth instruction, the reproduction unit extracts a still image that is captured during a period in which attribute information of the moving image satisfies a predetermined condition. apparatus. The imaging device further includes:
A display unit that displays one or more menu items associated with the attribute information;
The imaging device according to claim 1, wherein the reception unit receives selection of one or more menu items displayed on the display unit as the instruction. A playback method for reading and playing back still images taken during moving image shooting from a memory,
In the memory, a still image taken during shooting of the moving image and one or more types of attribute information indicating a shooting situation of at least one of the moving image and the still image are stored in association with each other,
The playback method is:
A reception step of receiving an instruction for selecting the type of the attribute information;
A reproduction method comprising: a reproduction step of reading out and reproducing a still image associated with attribute information of a type corresponding to the instruction received in the reception step from the memory.