JP2010237911A - Electronic apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic apparatus capable of regenerating only a portion with a specified subject included in an image. <P>SOLUTION: The electronic apparatus includes an animation image generating means for generating an animation image, by acquiring an image by photographing in every prescribed time, and the electronic apparatus detects the subject included in the image for a prescribed time or more, from the image, by executing subject detection processing and subject identification processing, records the subject, an animation file name included with the subject, a start point and a period included with the subject, or the like in association with one another, thereby retrieves easily the image photographed with the subject, and regenerates only the portion with the subject included in the image. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, and more particularly to a technique for detecting a specific subject corresponding to the same person from a moving image.

  An example of this type of device is disclosed in Patent Document 1. According to Patent Document 1, when a playback mode based on personal authentication is selected by a mode switch, the personal authentication device is detected from the last recorded image file among the image files recorded on the recording medium. The feature amount of the face X is acquired. Next, an image file (related image file) including the same face as the face X is identified by comparing the feature amount of the face X with the face feature amount included in another image file in the recording medium. , Output to the CPU 30. The CPU 30 acquires the related image file selected by the personal authentication device and displays it on the liquid crystal monitor.

JP 2007-329679 A

  However, according to the invention according to Patent Document 1, since the related image file is specified at the time of reproduction, for example, when there are a large number of recorded image files, it takes time to specify the related image file. As a result, there is a problem that it takes time to display the related image file.

  The electronic apparatus according to claim 1 of the present application acquires a captured image by capturing every predetermined time, and also generates a first moving image based on the captured image, and continues to the moving image for a predetermined period or longer. A subject detection unit for detecting a subject included in the image, a period information deriving unit for deriving period information indicating a start point and a period in which the subject is continuously included in the moving image, and among the captured images constituting the moving image , A subject extracting means for extracting the subject image from any of the captured images constituting a moving image of a period in which the subject is continuously included, a recording medium in association with the moving image, the subject image, and the period information And a reproducing unit for reproducing the period in which the subject is continuously included in the moving image based on the period information.

  An electronic device according to a second aspect of the present invention is dependent on the first aspect, and when the second moving image generated by the moving image generating unit is recorded on the recording medium, the second moving image is recorded on the second moving image. An identification unit that determines whether or not the subject is continuously included for the predetermined period or longer is provided, and the identification unit determines that the subject is continuously included in the second moving image for the predetermined period or longer. The period information deriving unit derives second period information indicating a period during which the subject is continuously included in the second moving image from the second moving image, and the associating unit includes: The moving image, the subject image, the period information, the second moving image, and the second period information are associated with each other and recorded on the recording medium.

  An electronic device according to a third aspect of the present invention is dependent on the first or second aspect, wherein the reproduction means includes a subject image, one or a plurality of moving images including the subject of the subject image continuously for a predetermined period, and First display means for extracting the subject image from a recording medium in which period information indicating a period during which the subject is included in each of the moving images is recorded in association with the subject and displaying the extracted subject image as a first subject image on the display device; Extracting a part of a plurality of captured images constituting each moving image during a period in which the subject is continuously included from each moving image, and using each of the extracted captured images as a second subject image 2nd display means to display on a display apparatus, It is characterized by the above-mentioned.

  An electronic device according to a fourth aspect of the present invention is dependent on the first to third aspects, the selection means for selecting any one of the second subject images displayed by the second display means, and the selected second A moving image reproducing means for reproducing a moving image including a subject image only during a period in which the second subject image is included is provided.

  The present invention has been made in view of the above problems, and by recording characteristic information and time information of a subject existing for a predetermined time or longer in a moving image during shooting, the time required for displaying the subject during playback is reduced. It is an object of the present invention to provide an electronic device that can be used.

1 is a block diagram illustrating an outline of a configuration of an imaging apparatus 1. FIG. It is an illustration figure which shows an example of the mapping state of the memory. It is an illustration figure which shows an example of a frame image. 3 is a block diagram illustrating an outline of an internal structure of an association processing unit 24. FIG. 3 is an illustrative view showing one example of a directory structure of a recording medium 28. FIG. It is an illustration figure which shows an example of a management table. FIG. 6 is an illustrative view showing a display example of the LCD monitor 14. 6 is a flowchart illustrating a part of processing operation in an imaging mode in the embodiment. It is a flowchart which shows a part of other processing operation | movement of the imaging | photography mode in an Example. It is a flowchart which shows the processing operation | movement of the correlation process in an Example. It is a flowchart which shows the processing operation of the attention object reproduction | regeneration mode in an Example.

  FIG. 1 is a block diagram showing an outline of an imaging apparatus 1 according to an embodiment of the present invention.

  The imaging apparatus 1 includes a zoom lens that can freely change a focal length within a certain range, a focus lens that forms an optical image of a subject on an imaging device, an aperture that controls exposure, and incident light in a frame period. An image pickup unit 2 including an image pickup device that converts an analog image signal, an A / D conversion unit 4 that performs A / D conversion on the analog image signal output from the image pickup unit 2, and an output from the A / D conversion unit 4 A memory 6 for temporarily recording a digital image signal (hereinafter referred to as a frame image signal or a frame image), a memory control unit 8 for controlling the memory 6, and a white balance adjustment for the frame image temporarily recorded in the memory 6 A signal processing unit 10 including a white balance adjustment unit for performing color synchronization, a color synchronization processing unit for performing color synchronization processing (also referred to as color separation processing) by performing color interpolation processing, and the like. If the frame image processed by the processing unit 10 is a still image taken, the image is obtained by the JPEG (Joint Photographic Experts Group) method, and if the frame image is taken a moving image by the MPEG (Moving Picture Experts Group) method. An image codec section 12 that performs compression encoding processing on the signal to generate a compressed image signal, an LCD (Liquid Crystal Display) monitor 14 that displays an expanded frame image, an LCD driver 16 that controls driving of the LCD monitor 14, a frame A subject detection unit 18 that detects a subject such as a person included in the frame image from the image, and whether the subject detected by the subject detection unit 18 and the subject detected in the frame image one frame before are the same subject. The subject identification processing unit 20 to determine, the frame number of the frame image in which the subject is first detected, and the frame number A time information acquisition unit 22 for acquiring time information including the number of elapsed frames from a frame image, an association processing unit 24 for associating and recording subject feature information, a moving image file name, and time information about the subject, An F (interface) circuit 26, a recording medium 28 for recording information associated with the frame image signal and the association processing unit 24, a CPU (Central Processing Unit) 30, and an operation unit 32 for operating the imaging device 1 are provided. Yes.

As the image sensor, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like is used.
In addition, as the memory 6, for example, a commonly used memory such as a video random access memory (VRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), or a synchronous DRAM (SDRAM) is used. used.
As the recording medium 28, for example, an internal recording medium built in the imaging apparatus 1 such as a flash memory, or an external recording medium that can be freely attached to and detached from the imaging apparatus 1 such as an SD memory card or a Memory Stick (registered trademark). used.
The LCD monitor 14 may be an organic EL monitor.

  When the operation unit 32 is operated and the photographing mode is selected, the CPU 30 instructs the imaging unit 2 to repeat the pre-exposure operation and the thinning-out reading operation in order to execute a through image (also referred to as a preview image) process. The imaging unit 2 performs pre-exposure on the light receiving surface of the image sensor at a frame period, and generates a charge representing an optical image of the imaging region imaged on the light receiving surface of the image sensor by photoelectric conversion. A part of the generated charge is read from the light receiving surface in a raster scanning manner. As a result, an analog image signal representing the imaging region is output from the imaging unit 2 at a frame period.

  The A / D conversion unit 4 performs A / D conversion processing on the analog image signal output from the imaging unit 2. The frame image signal generated by the A / D conversion process is written into the work area 6c (see FIG. 2) of the memory 6 via the memory control unit 8. The signal processing unit 10 reads out the frame image signal written in the work area 6 c via the memory control unit 8, performs white balance adjustment, color synchronization processing, etc. on the read digital image signal, and passes through the memory control 8. Write to work area 6c. The LCD driver 16 reads the frame image signal written in the work area 6c, and drives the LCD monitor 14 based on the read frame image signal. As a result, a through image representing the shooting area is displayed on the LCD monitor 14.

  When a moving image shooting operation is performed from the operation unit 32, the imaging apparatus 1 starts moving image shooting. The CPU 30 commands the imaging unit 2 to execute a series of operations for outputting an analog image signal. The imaging unit 2 performs main exposure on the light receiving surface of the imaging device, generates charges representing an optical image of the imaging region imaged on the imaging device by photoelectric conversion, and reads the generated charges in a raster scanning manner. As a result, a high-resolution analog image signal representing the imaging region is output from the imaging unit 2.

Analog image signals sequentially output from the imaging unit 2 are subjected to signal processing similar to that described above by the A / D conversion unit 4 and the signal processing unit 10 and converted into frame image signals. The converted frame image signal is written into the work area 6 c via the memory control unit 8.
In addition, the CPU 30 gives a compression command and a recording command to the image codec unit 12 and the I / F circuit 26 in response to the photographing operation of the operation unit 32. The image codec unit 12 reads out the frame image signal written in the work area 6c via the memory control unit 8, and performs a compression encoding process such as MPEG on the read frame image signal, thereby compressing the frame image signal. The signal is written into the work area 6c via the memory control unit 8.
The I / F circuit 26 reads the compressed frame image signal written in the work area 6 c via the memory control unit 8 and records it on the recording medium 28.

  The imaging apparatus 1 repeats the above process, generates a single moving image signal (hereinafter also referred to as a moving image) from a plurality of frame image signals, and records a moving image.

When an operation for ending the shooting is performed from the operation unit 32, the imaging device 1 ends the video shooting,
The moving image signal recorded from the start of shooting to the end of shooting is saved as a moving image file.

  When the operation unit 32 is operated, the reproduction mode is selected, and a desired moving image file is designated, the CPU 30 gives a reproduction command and an expansion command to the I / F circuit 26 and the image codec unit 12, respectively.

The I / F circuit 26 reads the moving image included in the designated moving image file from the recording medium 28 and writes the read moving image to the memory via the memory control unit 8. The image codec unit 12 reads out the moving image stored in the memory via the memory control unit 8, performs an expansion process on the read out moving image, and reads the expanded moving image through the memory control unit 8. Is written in the work area 6c.
The LCD driver 16 sequentially reads the moving image data stored in the memory 6 via the memory control unit 8 and drives the LCD monitor 14 based on the read moving image. As a result, a moving image is displayed on the LCD monitor 14.

  When the operation unit 32 is operated and a moving image update operation is performed, the CPU 30 gives a reproduction command and an expansion command to the I / F circuit 26 and the image codec unit 12, respectively. As a result, the moving image of the next moving image file is displayed on the LCD monitor 14.

  The imaging apparatus 1 acquires “feature information included in a moving image for a predetermined time or more during shooting and time information related to the subject, and captures the face image of the subject, the feature information, the time information, and the The file name of the moving image is recorded in association with each other. Here, the feature information of the subject is the position and size of the subject in the frame image, the position and size of the eyes, nose, ears, mouth, etc., and the time information about the subject is, for example, the first subject detected The frame number of the frame image, the number of elapsed frames from the frame number, and the like.

The association function is realized as follows, for example. FIG. 3 shows a frame image acquired by the imaging apparatus 1. In FIG. 3, subject A and subject B, which are persons, are included in the frame image. The CPU 30 gives a subject detection command to the subject detection unit 18. The subject detection unit 18 performs face detection processing on the acquired frame image.
Face detection is realized as follows, for example. General facial features (features such as face outline, facial color, eyes, nose, ears, hair, etc.) are recorded in advance in the subject detection unit 18, and a portion that matches the features from the acquired frame image Scan whether there is any. If there is an area that matches the facial feature as a result of scanning, it is determined that the face is included in the frame image. This face detection process can also be applied to the faces of animals such as dogs and cats by using the method described above. In this embodiment, a case where the subject is a person will be described.

  When the subject detection unit 18 detects a face in the frame image, the subject detection unit 18 generates a face frame surrounding the face. Since the subject A and the subject B exist in the frame image of FIG. 3, a face frame KA surrounding the face of the subject A and a face frame KB surrounding the face of the subject B are generated. The subject detection unit 18 derives feature information of each subject and writes it in the header of the frame image.

  The subject identification processing unit 20 performs subject identification processing for determining whether or not the detected subject is also included in a frame image one frame before (hereinafter referred to as a previous frame image). In order to determine whether or not the subject detected in the current frame image is included in the previous frame image, for example, based on the size of the face frame, a rectangular frame having a size corresponding to the upper body of the subject is placed below the face frame. It is generated at a position where the upper body is considered to be in the direction, the color within the rectangular frame (for example, the color of clothing) is detected, and the upper body of the subject whose detected color is detected in the previous frame image If it is almost the same as the color of the subject, the distance between the center of the face frame generated with the current frame image corresponding to the face frame generated with the subject identification method or the previous frame image is derived as the same person If the distance is equal to or smaller than a predetermined threshold, a subject identification method that determines that the subject is the same is used. If the frame image in which the subject is detected is the first frame image, the previous frame image does not exist, and thus the subject identification process is not performed.

  As a result of subject identification processing, if it is determined that the subject detected in the previous frame image and the subject detected in the current frame image are not the same subject, an image of the area surrounded by the generated face frame is extracted from the current frame image. The extracted and derived feature information is written together with the subject information holding unit 6a of the memory 6. The time information acquisition unit 22 acquires time information regarding the detected subject and writes it in the time information holding unit 6 b of the memory 6. At the stage where the subject is detected for the first time, “0” is written as the frame number of the frame image and the number of elapsed frames from the frame number.

  If it is determined that the subject detected in the current frame image and the subject detected in the previous frame are the same person, the image of the area surrounded by the face frame is not cut out, and the time information holding unit 6b The number of frames that have elapsed since the subject was first detected among the time information about the subject that is held is updated.

  In addition, when the subject detected in the previous frame image is not detected in the current frame image, the subject identification processing unit 20 determines that the subject is out of frame. When the subject is out of frame, the time information acquisition unit 22 derives the time during which the subject was continuously included in the moving image being shot. The time is derived, for example, from the difference between the frame number of the frame image in which the subject is determined to be out of frame and the frame number of the frame image in which the subject is first detected. The derived time is compared with a predetermined threshold, and if the time <threshold, the face image, feature information, and time information of the subject held in the memory 6 are deleted. If the time is greater than or equal to the threshold, the association processing unit 24 associates the face image of the subject, the feature information, the time information, and the name of the moving image file being photographed and stores them in the recording medium 28.

FIG. 4 shows the internal configuration of the association processing unit 24. The association processing unit 24 includes a person verification unit 24a and an information registration unit 24b.
FIG. 5 shows an example of the directory structure of the recording medium 28. In the example shown in FIG. 5, the generated moving image file is recorded in the moving image directory. The extracted face image of the subject is compressed by the image codec unit 12, and feature information is written in the header area of the compressed face image, and is recorded in the subject image directory as an image file. Time information about the subject is written in a management table generated in the management information directory.

  FIG. 6 shows an example of time information related to the subject recorded in the management information directory. The time information is managed by, for example, a management table as shown in FIG. A management table is created for each subject recorded in the subject image directory. The row items of the management table are composed of moving image file names, and the column items are composed of scene IDs. The scene ID is an identifier for individually identifying each scene when there are a plurality of scenes in which the subject is included for a predetermined time or more in the same moving image file. IDs 1, 2,... M (M is a positive integer) is assigned. Then, the time zone is recorded in the cells corresponding to the scene IDs 1, 2,. Thus, it is managed in which time zone of which moving image file the subject is included. The time zone is derived based on the time information. Specifically, the time zone is derived based on the frame number of the frame image in which the subject is first detected and the number of elapsed frame images from the frame image. For example, when the frame number of the first frame image in which the subject is detected is “1” and the number of elapsed frame images is “99”, the frame number is 1 + 99 = 100 from the frame image with the frame number 1. This means that the subject is included in the image. In this case, “1 to 100” is written as the time zone in the cell of the management table. For example, as shown in FIG. 6A, the subject A is included in two scenes of the frame image of frame number 2000 to 5000 and the frame image of frame number 10000 to 15000 in the moving image 2. The time zone “2000-5000” is written in the cell corresponding to the scene ID1, and the time zone “10000-15000” is written in the cell corresponding to the scene ID2.

The association processing unit 24 performs person verification to determine whether or not a subject included in a moving image being shot for a predetermined time or longer has been recorded in the management table of the management information directory in the past.
Now, it is assumed that a management table related to the subject A (hereinafter referred to as management table A) and a management table related to the subject B (hereinafter referred to as management table B) in FIG. It is assumed that a subject included in the middle moving image for a predetermined time or more is newly detected (hereinafter, the subject is referred to as a detected subject).

  The person verification unit 26a refers to the management table A stored in the management information directory of the recording medium 28, and determines whether or not the detected subject is the same person as the subject A. Specifically, the person verification unit 26a compares the feature information in the image file of the subject A stored in the subject image directory of the recording medium 28 in association with the management table A with the feature information of the detected subject. Next, the moving image file “moving image 1” written in the management table A is read from the moving image directory, and the feature information of the subject A recorded in the header area of the frame images from the frame numbers 1 to 1000 and the detected subject. Compare with feature information. As the feature information of the detected subject, feature information stored in the subject information holding unit 6a of the memory 6 together with the face image of the detected subject can be employed.

Similarly, the person collating unit 26a performs the feature information of the subject A recorded in the header areas of the frame images of the frame number 2000 to 5000 and the frame numbers 10000 to 15000 of “Movie 2”,. N ”The feature information of the subject A recorded in the header area of the frame images from frame numbers 1 to 2500 is compared with the feature information of the detected subject.
As a result of the comparison, when it is determined that the detected subject and the subject A are the same, the information registration unit 24b relates to the name of the moving image file being captured and the detected subject in the subject management table A included in the frame image. The time information is additionally written, and the face image and feature information of the detected subject and the time information temporarily stored in the memory 6 are deleted.
As a result of the comparison, when it is determined that the detected subject and the subject A are not the same, the person verification unit 26a and the information registration unit 24b perform the same processing on the management table B.

  When it is determined that the detected subject is not the same as the subjects A and B, the information registration unit 24b generates an image file of the detected subject, records it in the subject image directory of the recording medium 28, and creates a detected subject management table. A new file is created, the moving image file name and time information are written in the management table, and the information is stored in the management information directory in association with the face image file of the detected subject. The association between the face image file and the management table can be realized, for example, by assigning the same unique identification symbol to both. As a result, the face image, feature information, time information, and moving image file name of the subject included in the moving image being shot for a predetermined time or more are recorded in association with each other. In the case where no moving image has been shot in the past (in other words, when no other moving image file is recorded in the moving image directory of the recording medium 28), there is no data in the subject image directory and the management information directory. No person verification process is performed.

  The imaging apparatus 1 has a subject reproduction function of “reproduce a scene of a subject included in a moving image for a predetermined time or more”. The attention subject reproduction function is realized as follows, for example.

  FIG. 7 shows an example of the display on the LCD monitor 14 when the attention subject reproduction mode is selected. When the operation unit 32 is operated in the subject reproduction mode, the CPU 30 gives a subject information reproduction command and an expansion command to the I / F circuit 26 and the image codec unit 12. The I / F circuit 26 reads the face image files of all the subjects recorded in the subject image directory of the recording medium 28 and writes them in the work area 6 c of the memory 6. The image codec unit 12 performs a decompression process on the face image written in the work area 6c. The LCD driver 16 reads the face image subjected to the decompression process via the memory control unit 8 and drives the LCD monitor 14. As a result, it is displayed in the area 14a of the LCD monitor 14. When the cursor CU is operated and a face image of a desired subject is selected, the CPU 30 reads a management table associated with the face image, and a corresponding moving image file based on the time zone recorded in the management table From the beginning frame image of the scene including the subject (for example, when the time zone of the scene is frame number 100 to 1000, it corresponds to the frame image of frame number 100) This is given to the I / F circuit 26 and the image codec unit 12. The I / F circuit 26 reads the frame image from the moving image file directory of the recording medium 28 and writes it to the work area 6 c of the memory 6 via the memory control unit 8. The image codec unit 12 performs an expansion process on the frame image written in the work area 6c. The CPU 30 generates a thumbnail image based on the decompressed frame image, and the LCD driver 16 reads the thumbnail image via the memory control unit 8 and drives the LCD monitor 14. As a result, the frame image is displayed as a thumbnail in the area 14 b of the LCD monitor 14. When a desired moving image file is selected from the displayed thumbnail images, only the frame image including the subject is reproduced in the manner described above based on the time zone.

  8 and 9 are flowcharts illustrating the imaging operation of the imaging apparatus 1 in the present embodiment.

  In step S <b> 100, an image signal for a preview image is acquired from the imaging unit 2 at a frame period, and stored in the memory 6 via the A / D conversion unit 4. In step S <b> 102, the signal processing unit 10 performs signal processing such as white balance adjustment and color synchronization processing on the frame image signal stored in the memory 6. In step S <b> 104, the LCD driver 16 drives the LCD monitor 14 and displays a preview image based on the frame image signal output from the signal processing unit 10.

  In step S106, it is determined whether or not to start shooting. When shooting is started, the process proceeds to step S108; otherwise, the process returns to step S100.

  In step S <b> 108, an analog image signal for image recording is acquired from the imaging unit 2 at a frame period, and is stored in the memory 6 via the A / D conversion unit 4. In step S110, the signal processing unit 10 performs signal processing such as white balance adjustment and color synchronization processing on the frame image signal for image recording stored in the memory 6.

  In step S112, face detection is performed on the acquired frame image signal. If a face is detected, the process proceeds to step S114. If not, the process proceeds to step S126. In step S114, a face frame surrounding the face detected in step S112 is generated, and the face feature information is derived. In step S116, the face feature information derived in step S114 is written in the header of the frame image.

  In step S118, subject identification is performed. It is determined whether or not a face detected from the acquired frame image is included in the previous frame image. If the subject is included in the frame image one frame before, the process proceeds to step S124, and if not, the process proceeds to step S120.

  In step S120, the face image surrounded by the face frame generated in step S114 is cut out and written in the memory 6 together with the feature information. In step S122, the time information of the subject written in the memory 6 in step S120 is written in the memory 6. . In step S124, the time information is updated.

  In step S126, it is determined whether or not the subject is out of frame from the shooting area. If the subject detected in the previous frame image is not detected from the acquired frame image, it is determined that the subject is out of frame. If the subject is out of frame, the process proceeds to step S128; otherwise, the process proceeds to step S134.

  In step S128, it is determined whether or not the moving-out subject has been included in the moving image for a predetermined time or more. Based on the time information, the time when the subject was included is derived, and the time is compared with a predetermined threshold. If the time is equal to or greater than the threshold, it is determined that the moving image is included in the moving image for a predetermined time or more. If the subject is included in the moving image for a predetermined time or more, the process proceeds to step S132, and if not, the process proceeds to step S130.

  In step S130, the face image, feature information, and time information of the frame-out subject recorded in the memory 6 are deleted.

  In step S132, the subject is associated with the time information and recorded on the recording medium 28. In step S134, the frame image is stored in the recording medium 28. In step S136, it is determined whether or not shooting has been completed. When the photographing is finished, the frame image recording process is stopped and the photographing mode is finished. Otherwise, the process returns to step S108.

  FIG. 10 is a flowchart showing the operation of the association process in step S132. The association process is executed according to the following subroutine.

  In step S200, it is determined whether there is a subject recorded in the subject image directory. If there is a subject recorded in the subject image directory, the process proceeds to step S202. If not, the process proceeds to step S206.

  In step S202, the face image recorded in the memory 6 is compared with all frame images including the subject registered in the subject image directory, and the same subject as the face image recorded in the memory 6 is found in the subject image directory. It is discriminated whether or not it is recorded. If the same subject as the face image recorded in the memory 6 has already been recorded in the subject image directory, the process proceeds to step S204. If not, the process proceeds to step S208.

  In step S204, the face image and feature information recorded in the memory 6 are deleted.

  In step S206, the management table corresponding to the subject determined to be the same subject as the face image in step S202 is read, and the time zone derived from the moving image file name and the time information recorded in the memory 6 is read in the management table. Append.

  In step S208, feature information is written in the header of the face image stored in the memory 6. In step S210, a management table corresponding to the face image in which the feature information is written in step S208 is newly created, and an identifier is assigned. Then, the moving image file name and time information are recorded in the management table. In step S210, the identifier of the management table created in step S208 is written in the header area of the face image created in step S206. Then, the face image and the management table are recorded in the subject image directory and the management information directory, respectively.

  FIG. 11 is a flowchart showing the processing operation in the noticeable subject reproduction mode.

  In step S300, all face images recorded in the subject image directory are read and displayed on the LCD monitor 14 as a list.

  In step S302, it is determined whether or not a subject has been selected. If a subject has been selected, the process proceeds to step S304, and if not, step S302 is repeated.

  In step S304, the management table corresponding to the face image selected in step S302 is read, and the first frame image of each scene in which the subject corresponding to the face image is captured based on the time information recorded in the management table. Are displayed as thumbnails on the LCD 14.

  In step S306, it is determined whether or not the scene desired by the user has been selected. If a scene is selected, the process proceeds to step S308, and if not, step S306 is repeated.

  In step S308, the frame image of the selected scene is reproduced. Only the frame image including the subject is reproduced based on the time zone recorded in the management table.

  In step S310, it is determined whether or not the subject reproduction mode has been terminated. When the CPU 30 determines that the attention subject reproduction mode is ended by operating the operation unit 32, the attention subject reproduction mode is ended. Otherwise, the process returns to step S300.

In the embodiment described above, when the subject is out of the frame, the time that the subject was in the shooting area is derived and compared with a predetermined threshold, but the time is derived after the subject is out of the shooting area. A predetermined grace time may be provided until the time is set, and when the subject has entered the frame again within the predetermined grace time, the time information may be continuously acquired from the time before the frame out.
Further, the association between the moving image information and the subject of interest may be performed manually.
Further, the above-described processing may be applied to still image shooting. In that case, the derivation process may be performed for all the faces detected from the captured still image without deriving the time.

  As mentioned above, although the Example of this invention was described, this invention is not limited to these embodiment, A various change and deformation | transformation are possible within the range of the summary.

2 Imaging unit 4 A / D conversion unit 6 Memory 8 Memory control unit 10 Signal processing unit 12 Image codec unit 14 LCD monitor 16 LCD driver 18 Subject detection unit 20 Subject identification processing unit 22 Time information acquisition unit 24 Association processing unit 26 I / F circuit 28 Recording medium 30 CPU
32 Operation unit

Claims (4)

A moving image generating means for acquiring a captured image by shooting every predetermined time and generating a first moving image based on the captured image;
Subject detection means for detecting a subject continuously included in the moving image for a predetermined period or longer;
Period information deriving means for deriving period information indicating a start point and a period in which the subject is continuously included in the moving image;
Subject extraction means for extracting the subject image from any of the photographed images constituting the moving image of the period in which the subject is continuously included among the photographed images constituting the moving image;
Association means for associating and recording the moving image, the subject image, and the period information on a recording medium;
Reproduction means for performing reproduction of a period in which the subject is continuously included in the moving image based on the period information;
An electronic device comprising: When the second moving image generated by the moving image generating means is recorded on the recording medium,
An identification means for determining whether or not the subject is continuously included in the second moving image for the predetermined period or longer;
When the identification unit determines that the subject is continuously included in the second moving image for the predetermined period or longer, the period information deriving unit determines that the subject is the second moving image from the second moving image. Deriving second period information indicating a period continuously included in the moving image,
2. The association unit according to claim 1, wherein the association unit associates and records the moving image, the subject image, the period information, the second moving image, and the second period information on the recording medium. Electronics. The reproduction means records the subject image, one or a plurality of moving images in which the subject of the subject image is continuously included for a predetermined period or more, and period information indicating a period in which the subject is included in each of the moving images. From the recorded recording medium,
First display means for extracting the subject image and displaying it on a display device as a first subject image;
Extracting a part of a plurality of captured images constituting each moving image during a period in which the subject is continuously included from each moving image, and extracting each of the extracted captured images as a second subject image Second display means for displaying on the display device as
The electronic apparatus according to claim 1, further comprising: Selection means for selecting any one of the second subject images displayed by the second display means;
Moving image reproduction means for reproducing the selected moving image including the second subject image for a period in which the second subject image is included;
The electronic apparatus according to claim 1, further comprising:

Images