JP2010124323A - Image processor, erasure candidate image sorting method, and erasure candidate image sorting program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To sort moving picture data or still picture data as an erasure candidate by utilizing information on a correlation between the moving picture data and the still picture data, thereby enhancing usability for data erasure. <P>SOLUTION: An image processor includes: a data storing section for storing plural moving picture data and still picture data; a data readout section for reading out predetermined moving picture data and still picture data from the data storing section; and an erasure candidate image selecting section for selecting only the moving picture data or the still picture data as the erasure candidate from the plural moving picture data and still picture data read out successively by the data readout section based on the information on the correlation between the moving picture data and the still picture data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, a deletion candidate image selection method, and a deletion candidate image selection program.

  In recent years, an imaging apparatus such as a digital camera or a digital video camera can record a large amount of moving images and still images with an increase in capacity of a recording memory. In addition, for example, as described in Patent Document 1, an imaging device capable of capturing a still image simultaneously during moving image capturing is also known. By using such an imaging device, for example, a user can simultaneously shoot a still image when there is a favorite scene while shooting a moving image while traveling.

JP 2007-336281 A

  However, as the quality required for moving images and still images increases, the capacity of each image data also increases. Therefore, for example, when a large number of moving images and still images are taken at a travel destination, the capacity of the recording memory may be insufficient. In such a case, the user needs to erase a part of the large amount of data recorded in the recording memory to ensure a capacity for recording a new moving image and still image. However, since a large amount of data is recorded in the recording memory, there is a problem that it is difficult to select data to be erased and the usability is not excellent.

  Here, in recent years, for example, a technique for extracting only similar still images from a plurality of still images by using feature point analysis such as face recognition is also known. By using such feature point analysis, only similar images can be extracted from a large amount of still image data recorded in the recording memory and presented to the user as still image data as erasure candidates. Conceivable. However, for a user, a similar still image is not necessarily important and is not necessarily a still image that may be deleted. For example, even if the subject has the same face, it may be still image data that is important for the user when the background is different or the shooting time is different. Therefore, even if the feature point analysis is used, there is a problem that it is difficult to select and present still image data that is not important to the user from a large amount of still image data recorded in the recording memory. . Similarly, for moving image data with completely different shooting times, shooting targets, shooting locations, etc., it is difficult to select and present moving image data that is not important to the user.

  Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to use moving image data or still images that are candidates for erasure by using related information that associates moving image data and still image data. It is an object of the present invention to provide a new and improved image processing apparatus, an erasure candidate image selection method, and an erasure candidate image selection program capable of selecting image data and improving usability regarding data erasure.

  In order to solve the above problems, according to an aspect of the present invention, a data storage unit that stores a plurality of moving image data and still image data, and data reading that reads predetermined moving image data and still image data from the data storage unit Moving image data or still image data that are candidates for erasure from the plurality of moving image data and still image data that are sequentially read out by the data reading unit based on related information that associates the moving image data with the moving image data and the still image data An erasure candidate image selection processing unit that selects only the image processing apparatus is provided.

  With this configuration, the image processing apparatus can store a plurality of moving image data and still image data. In addition, the data reading unit of the image processing apparatus can read predetermined moving image data and still image data from the data storage unit. Further, the erasure candidate image selection processing unit of the image processing apparatus becomes an erasure candidate from a plurality of moving image data and still image data sequentially read by the data reading unit based on related information associating moving image data and still image data. Only moving image data or still image data can be selected.

  Further, the erasure candidate image selection processing unit is configured to store still image data read by the data reading unit during recording or reproduction of the moving image data read by the data reading unit based on the related information. It is determined whether or not it is recorded, and only moving image data that is determined not to record any still image data read by the data reading unit during recording or reproduction of the moving image data is set as an erasure candidate. It can also be selected.

  The erasure candidate image selection processing unit further selects only still image data determined to be recorded during recording or reproduction of any moving image data read by the data reading unit as erasure candidates. You can also.

  Further, the erasure candidate image selection processing unit is based on related information associating the moving image data and the still image data, and the erasure candidate is selected from among the plurality of moving image data and the still image data sequentially read by the data reading unit. First erasure candidate image selection process for selecting only moving image data or still image data to be selected, and a second erasure candidate for selecting all moving image data or still image data recorded in the data storage unit as erasure candidates The image selection process can also be executed by appropriately switching according to the selection by the user.

  In addition, the image processing apparatus, when the still image data recorded in the data storage unit is erased, based on the erased image information, an erase history storage unit that stores erased image information related to the still image data, It can further comprise a still image data restoration processing unit for restoring the erased still image data.

  The erasure history storage unit stores the related information of the erased still image data as the erased image information, and the still image data restoration processing unit stores the erased still image based on the related information. The erased still image data can be restored from the frame image of the moving image data associated with the image data.

  Further, the related information is recorded in the frame image data of the moving image data and the still image data recorded in the data storage unit, and the erasure candidate image selection processing unit is configured to store the frame image data of the moving image data. By comparing the related information recorded in the still image data with the related information recorded in the still image data, the data can be recorded during recording or reproduction of the moving image data read by the data reading unit. It can also be determined whether still image data read by the reading unit is recorded.

The related information may include at least position information and / or date / time information acquired by GPS.

  In order to solve the above problem, according to another aspect of the present invention, a data reading step of reading moving image data and still image data from a data storage unit that stores a plurality of moving image data and still image data, and the moving image A related information reading step for reading related information for associating data and the still image data, and moving image data and still image data read by the data reading step based on the related information read by the related information reading step An erasure candidate image selection method including an erasure candidate image selection step for selecting only moving image data or still image data as erasure candidates from the image data is provided.

  In order to solve the above problems, according to another aspect of the present invention, a data read process for reading moving image data and still image data from a data storage unit that stores a plurality of moving image data and still image data, and the moving image Related information reading process for reading related information for associating data and the still image data, and moving image data and still image data read by the data reading process based on the related information read by the related information reading process An erasure candidate image selection program for causing a computer to execute an erasure candidate image selection process for selecting only moving image data or still image data as erasure candidates from the image data is provided.

  As described above, according to the present invention, it is possible to select moving image data or still image data as deletion candidates by using related information that associates moving image data and still image data, and to improve usability regarding data deletion. It is.

Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol. The description will be made in the following order.
1. Outline of Embodiment of the Present Invention 2. Functional configuration related to image recording processing of imaging apparatus 100 according to one embodiment. 3. Details of image recording processing by imaging apparatus 100 4. Functional configuration related to erasure candidate image selection processing of imaging apparatus 100 5. Details of erasure candidate image selection process by imaging apparatus 100 Modified example of imaging device 100 6-1. Modification 1 (Additional example of still image restoration processing function)
6-2. Modification 2 (Additional example of another still image erasure candidate image selection processing function)
7). 7. Hardware configuration of imaging apparatus 100 Summary

(1. Overview of Embodiment of the Present Invention)
In describing the details of an image processing apparatus according to one of the embodiments of the present invention, an outline of the present embodiment will be described first. In the following description, an imaging apparatus such as a digital camera or a digital video camera having an imaging function will be described as an example of the image processing apparatus. However, the image processing apparatus of the present invention is not limited to these. . As long as the image processing device can store moving image data and still image data, the image processing device does not have an imaging function, such as a personal computer, a PDA, or a playback device (DVD recorder, HDD recorder). It may be.

  As described above, the conventional imaging apparatus can record a large amount of moving images and still images as the recording memory capacity increases. In addition, the conventional imaging device has a function that can capture a still image at the same time during moving image shooting. By using such a conventional imaging device, for example, a user can shoot a still image at the same time when there is a favorite scene while shooting a moving image while traveling.

  However, as the quality required for moving images and still images increases, the capacity of each image data also increases. Therefore, for example, when a large number of moving images and still images are taken at a travel destination, the capacity of the recording memory may be insufficient. In such a case, the user needs to erase a part of the large amount of data recorded in the recording memory to ensure a capacity for recording a new moving image and still image. However, since a large amount of data is recorded in the recording memory, there is a problem that it is difficult to select data to be erased and the usability is not excellent.

  Here, in recent years, for example, it may be considered that only similar still images are extracted by feature point analysis such as face recognition and presented to the user as still image data of erasure candidates. However, a similar still image is not necessarily important for the user, and is not necessarily a still image that may be deleted. For example, even if the subject has the same face, it may be still image data that is important for the user when the image is a still image with a different background or a still image with a different shooting time. Therefore, even if the feature point analysis is used, there is a problem that it is difficult to select and present still image data that is not important to the user from a large amount of still image data recorded in the recording memory. . Similarly, for moving image data with completely different shooting times, shooting targets, shooting locations, etc., it is difficult to select and present moving image data that is not important to the user.

  Furthermore, once the still image data has been erased, the same still image data cannot be restored thereafter, so the user must carefully erase the still image data, and there is a problem of poor usability. It was.

  The imaging apparatus according to the embodiment of the present invention can solve such problems. That is, the imaging apparatus according to the embodiment of the present invention selects related moving image data or still image data as deletion candidates by using related information that associates moving image data and still image data, and improves usability regarding data deletion. Is possible.

  Specifically, the imaging apparatus according to the embodiment of the present invention manages related information that associates moving image data and still image data, and selects moving image data or still image data that is a deletion candidate based on the related information. . Further, the imaging apparatus according to the present embodiment can determine whether still image data is recorded during recording or reproduction of moving image data based on the related information.

  Here, when still image data is recorded during recording or reproduction of moving image data, it is assumed that a scene memorable for the user is shot, and the moving image data is likely to be important data for the user. Therefore, the imaging apparatus according to the present embodiment determines that only moving image data in which still image data is not recorded during recording or reproduction of moving image data is moving image data that is not so important to the user, and Select as erasure candidates.

  On the other hand, as for still image data, there is a possibility that still image data recorded during recording or reproduction of moving image data is important data for the user. However, if there is moving image data associated with still image data, the still image data can be restored based on the frame image of the moving image data. Therefore, the imaging apparatus according to the present embodiment determines that only still image data recorded during recording or reproduction of moving image data can be restored based on the moving image data, and uses the still image data as an erasure candidate. Sort out.

  In addition, when erasing still image data, the imaging apparatus according to the present embodiment stores information regarding the still image data to be erased. As a result, the image capturing apparatus according to the present embodiment can restore still image data based on a frame image of moving image data related to the deleted still image data even if the still image data is deleted.

  As described above, the imaging apparatus according to the present embodiment selects related moving image data or still image data as deletion candidates by using related information that associates moving image data and still image data, and improves usability regarding data deletion. Is possible. Hereinafter, details of the imaging apparatus 100 according to the present embodiment having such characteristics will be described.

(2. Functional configuration related to image recording processing of imaging apparatus 100 according to one embodiment)
First, a functional configuration related to image recording processing of the imaging apparatus 100 according to the present embodiment will be described. FIG. 1 is an explanatory diagram illustrating an example of a functional configuration related to image recording processing of the imaging apparatus 100 according to the present embodiment.

  The imaging apparatus 100 according to the present embodiment mainly includes a functional unit related to moving image recording, a functional unit related to still image recording, a functional unit related to addition of GPS information, a functional unit related to operation input by a user, and a functional unit related to display processing. And comprising. Each of these functional units constituting the imaging apparatus 100 executes various functions by being controlled by a CPU (Central Processing Units). The functional configuration of the imaging apparatus 100 illustrated in FIG. 1 is an example for explaining the image recording processing function included in the imaging apparatus 100 according to the present embodiment, and the present invention is not limited to these. . That is, in addition to the functional configuration shown in FIG. 1, the imaging apparatus 100 includes a playback function, an erasure candidate selection function, an image editing function, and the like, which will be described later. Naturally, it is possible to further include various functions provided in a normal imaging apparatus. In the following description, details of each functional component shown in FIG. 1 will be described focusing on the image recording processing function of the imaging apparatus 100.

  As shown in FIG. 1, the imaging apparatus 100 mainly includes an imaging unit 102, an imaging data storage unit 104, a first video data signal processing unit 106, and a first video data temporary storage as functional units related to video recording. Unit 108, moving image data encoding unit 110, moving image data multiplexing unit 116, moving image data recording unit 118, and moving image data storage unit 124 are included. In addition, as the functional units related to still image data, the still image data acquisition unit 132, the still image data signal processing unit 134, the still image data encoding unit 136, the metadata embedding unit 138, and the still image data recording Part 140 and still picture data storage part 142 are included. In addition, as a function unit related to the addition of GPS information, a GPS information acquisition unit 112 and a GPS data storage unit 114 are mainly included. In addition, the function unit related to the operation input by the user mainly includes an input unit 120 and an input data storage unit 122. Further, the display unit 126 and the moving image data external output unit 128 are mainly included as functional units related to display processing.

(Functional section related to video recording)
The imaging unit 102 forms an image of a subject on the built-in imaging device, and transfers the image data stored on the imaging device to the imaging data storage unit 104. Examples of the image pickup device include, but are not limited to, a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS).

  The imaging data storage unit 104 includes a semiconductor memory and temporarily stores a plurality of imaging data transferred from the imaging unit 102.

  The first moving image data signal processing unit 106 performs various types of video signal processing such as resolution conversion and correction processing on the imaging data stored in the imaging data storage unit 104, and first moving image data temporary storage unit as moving image data Forward to 108. Note that the first moving image data signal processing unit 106 can also generate a plurality of moving image data by performing a plurality of video signal processes on one piece of imaging data in accordance with the transfer destination of the moving image data. For example, the first moving image data signal processing unit 106 generates moving image data having a resolution of 640 × 480 when the display unit 126 provided in the imaging apparatus 100 is a VGA (Video Graphics Array) panel. The first moving image data signal processing unit 106 also generates moving image data having a resolution of 1920 × 1080 when a display device 130 such as an HDTV is externally connected to the imaging device 100.

  The first moving image data temporary storage unit 108 is composed of a semiconductor memory or the like, and temporarily stores a plurality of moving image data transferred from the first moving image data signal processing unit 106. The first moving image data temporary storage unit 108 may be configured by a plurality of storage units in accordance with the transfer destination of moving image data.

  The moving image data encoding unit 110 encodes the moving image data for recording stored in the first moving image data temporary storage unit 108 into a moving image format such as an MPEG video format and transfers the encoded moving image data to the moving image data multiplexing unit 116.

  The video data multiplexing unit 116 multiplexes the image data encoded by the video data encoding unit 110 and the audio data encoded in a predetermined audio format by an audio data generation unit (not shown). . The moving image data multiplexing unit 116 can also perform multiplexing processing with GPS data including at least position information and / or date / time information collected by a GPS information acquisition unit 112 described later. The moving image data multiplexed by the moving image data multiplexing unit 116 is transferred to the moving image data recording unit 118.

  The moving image data recording unit 118 records the moving image data multiplexed by the moving image data multiplexing unit 116 in the moving image data storage unit 124. The moving image data recording unit 118 can record moving image data in the moving image data storage unit 124 when receiving a recording instruction from the user via the input unit 120 described later.

  The moving image data storage unit 124 is a non-volatile storage area for storing moving image data. The moving image data storage unit 124 can be configured by, for example, an optical disk such as a DVD or a Bluray Disc (registered trademark), a magnetic disk such as a hard disk, or a semiconductor memory. Further, the moving image data storage unit 124 is not necessarily provided in the imaging apparatus 100 as shown in FIG. The moving image data storage unit 124 may be an external recording medium inserted into a slot (not shown) of the imaging device 100, for example. Further, the moving image data storage unit 124 may be provided on an external server connected by a wired or wireless network, for example. The moving image data storage unit 124 is not limited to the above-described storage method as long as it can store a plurality of moving image data and still image data. The moving image data storage unit 124 functions as a data storage unit in the present invention.

  With the above functional unit, the imaging apparatus 100 according to the present embodiment can record moving image data. Note that the flow of moving image data recording processing will be described in the processing flow described later.

(Functions related to still image recording)
The still image data acquisition unit 132 extracts one frame as still image data from the imaging data stored in the imaging data storage unit 104 and transfers it to the still image data signal processing unit 134. When the still image data acquisition unit 132 receives a still image acquisition instruction from the user via the input unit 120 described later, the still image data acquisition unit 132 extracts the still image data from the imaging data and transfers it to the still image data signal processing unit 134. it can.

  The still image data signal processing unit 134 performs various image signal processing such as correction processing on the still image data transferred from the still image data acquisition unit 132, and then converts the still image data into the still image data encoding unit 136. Forward to.

  The still image data encoding unit 136 encodes still image data transferred from the still image data signal processing unit 134 into a still image compression format such as JPEG (Joint Photographic Experts Group). The still image data encoded by the still image data encoding unit 136 is then transferred to the metadata embedding unit 138.

  The metadata embedding unit 138 appends GPS data including at least position information and / or date / time information collected by the GPS information acquisition unit 112 described later to the still image data encoded by the still image data encoding unit 136. To do. For example, the metadata embedding unit 138 can additionally add GPS data to still image data according to EXIF (Exchangeable File Format).

  The still image data recording unit 140 records, in the still image data storage unit 142, still image data in which GPS data is additionally written by the metadata embedding unit 138. The still image data recording unit 140 can record still image data in the still image data storage unit 142 when receiving a recording instruction from the user via the input unit 120 described later.

  The still image data storage unit 142 is a non-volatile storage area for storing still image data. Similar to the moving image data storage unit 124 described above, the still image data storage unit 142 can be configured with various storage methods, and can be provided in the imaging apparatus 100 or an external recording medium. May be provided on an external server. In the example of the functional configuration shown in FIG. 1, the still image data storage unit 142 and the moving image data storage unit 124 have different configurations for convenience of explanation, but the present invention is not limited to this. In other words, the moving image data storage unit 124 and the still image data storage unit 142 are provided in the same recording medium, so that the moving image data and the still image data can be stored in the same storage medium. The still image data storage unit 142 functions as a data storage unit in the present invention.

  With the above functional unit, the imaging apparatus 100 according to the present embodiment can record still image data. The flow of the still image data recording process will be described in the process flow described later.

(Regarding the functional part regarding the addition of GPS information)
The GPS information acquisition unit 112 acquires information on the current position and date and time of the imaging apparatus 100 by using GPS (Global Positioning System), and transfers the information as GPS data to the GPS data storage unit 114 at a constant cycle. The GPS used by the GPS information acquisition unit 112 can acquire information on the current position and date / time by receiving radio waves from an artificial satellite. However, since the technology using the GPS is already widely known, details are provided. Is omitted. Further, the information included in the GPS data is not limited to specific information, and may include other information such as altitude. Further, the GPS information acquisition unit 112 may additionally write, for example, information on the direction detected by the azimuth sensor in addition to the various types of information acquired by the GPS, and transfer the information to the GPS data storage unit 114.

  The GPS data storage unit 114 is composed of a semiconductor memory or the like, and temporarily stores GPS data transferred from the GPS information acquisition unit 112. As described above, the GPS data stored in the GPS data storage unit 114 is multiplexed with the moving image data by the moving image data multiplexing unit 116 or added to the still image data by the metadata embedding unit 138.

  With the above functional unit, the imaging apparatus 100 according to the present embodiment can record GPS data in moving image data and still image data. The flow of processing for recording GPS data in moving image data and still image data will be described in the processing flow described later.

(Functional parts related to user operation input)
The input unit 120 receives an instruction input from the user, decodes the received instruction content, and transfers various instructions to the input data storage unit 122. The imaging apparatus 100 includes an operation unit that receives an operation from a user, such as a touch panel, a button, a switch, a lever, and a dial. When the user operates these operation units, the input unit 120 transfers an execution instruction for the processing to the input data storage unit 122 in order to execute a process according to the operation content.

  The input data storage unit 122 accumulates various commands transferred from the input unit 120 and transfers them to the moving image data recording unit 118, the still image data acquisition unit 132, and the still image data recording unit 140 described above. Accordingly, the moving image data recording unit 118, the still image data acquisition unit 132, and the still image data recording unit 140 can execute a process desired by the user based on the command transferred from the input data storage unit 122. Note that the various commands accumulated in the input data storage unit 122 are not limited to the moving image data recording unit 118, the still image data acquisition unit 132, and the still image data recording unit 140 described above, and may be imaged according to the operation content by the user. It is also transferred to various functional components included in the apparatus 100.

(About the functional unit related to display processing)
The display unit 126 includes, for example, an LCD (Liquid Crystal Display), an organic EL (ElectroLuminescence display) display, and the like, and is provided on the imaging device 100. In the display unit 126, among the moving image data stored in the first moving image data temporary storage unit 108, the moving image data subjected to signal processing according to the specifications of the display unit 126 by the first moving image data signal processing unit 106 Is displayed. Accordingly, the user can instruct the imaging apparatus 100 to record moving image data and still image data after confirming the video displayed on the display unit 126 and performing adjustments such as zooming and focusing.

  The moving image data external output unit 128 includes an interface such as HDMI (High Definition Multimedia Interface) and transmits moving image data to the display device 130 such as a television. The moving image data external output unit 128 performs signal processing according to the display specifications of the display device 130 by the first moving image data signal processing unit 106 among the moving image data stored in the first moving image data temporary storage unit 108. The applied moving image data is transmitted to the display device 130. Accordingly, the user confirms the video displayed on the display of the display device 130 externally connected to the imaging device 100, adjusts zooming, focusing, and the like, and then captures the recording of the moving image data and the still image data. The device 100 can be instructed.

  Note that the imaging apparatus 100 does not necessarily include the display unit 126 and the moving image data external output unit 128. In other words, the display capable of displaying the video imaged by the imaging unit 102 may be provided in the imaging device 100 itself or in an external device connected to the imaging device 100.

  With the above functional units, the imaging apparatus 100 according to the present embodiment can display an image that can be captured by the user. Note that the flow of display processing of video that can be captured by the user will be described in a processing flow described later.

  The details of the functional configuration related to the image recording processing of the imaging apparatus 100 according to the present embodiment have been described above with reference to FIG.

(3. Details of image recording processing by imaging apparatus 100)
Next, a flow of recording processing of moving image data and still image data performed by the imaging apparatus 100 having the above-described functional configuration will be described. FIG. 2 is a flowchart illustrating an example of a process flow in the recording mode in the imaging apparatus 100 according to the present embodiment. 2 is performed by the user selecting a recording mode (moving image or still image capturing mode) after the imaging apparatus 100 is powered on.

  As shown in FIG. 2, when the recording mode is selected by the user, display processing, moving image recording processing, and still image recording processing are performed in accordance with a command from the input unit 120. That is, in step 200, the imaging apparatus 100 executes display processing. Details of the display process will be described later with reference to FIG.

  In parallel with step 200, the imaging apparatus 100 confirms in step 202 whether or not there has been an instruction to record a moving image based on the command information stored in the input data storage unit 122. If it is determined that there is an instruction to record a moving image from the user, the imaging apparatus 100 executes a moving image recording process in step 204. That is, for example, when the user presses a Rec button or the like provided in the imaging apparatus 100, the imaging apparatus 100 executes the moving image recording process in step 204. Details of the moving image recording process will be described later with reference to FIG.

  Further, in parallel with step 200, the imaging apparatus 100 confirms in step 206 whether or not there has been a still image recording instruction from the user based on the command information stored in the input data storage unit 122. If it is determined that there is an instruction to record a still image from the user, the imaging apparatus 100 executes a still image recording process in step 208. That is, for example, when the user presses a shutter button or the like provided in the imaging apparatus 100, the imaging apparatus 100 executes the still image recording process in step 208. Details of the still image recording process will be described later with reference to FIG.

  Next, in step 210, the imaging apparatus 100 confirms whether or not the user has instructed to end the recording mode based on the command information stored in the input data storage unit 122. When determining that the user has instructed to end the recording mode, the imaging apparatus 100 ends the recording mode. On the other hand, when it is determined that the user has not instructed to end the recording mode, the imaging apparatus 100 executes the processes of Step 200 to Step 208 described above again.

  The processing flow in the recording mode has been described above. Note that the display process, moving image recording process, and still image recording process shown in FIG. 2 are performed in parallel. Therefore, for example, when the user presses the Rec button or the like of the imaging apparatus 100, the display process 200 in step 200 and the moving image recording process in step 204 are executed simultaneously. Further, when the user presses the shutter button of the imaging apparatus 100 during moving image recording, the display processing in step 200, the moving image recording processing in step 204, and the still image recording processing in step 208 are executed simultaneously. It will be.

  Next, the detailed flow of the display process in step 200, the moving image recording process in step 204, and the still image recording process in step 208 shown in FIG. 2 will be described with reference to the flowcharts of FIGS.

(Flow of display processing in step 200)
FIG. 3 is a flowchart showing an example of the flow of the captured image display process executed in step 200 shown in FIG. 2 in the imaging apparatus 100 according to the present embodiment.

  As shown in FIG. 3, in step 300, the imaging unit 102 forms an image of the subject and transfers the imaging data to the imaging data storage unit 104. The transferred imaging data is temporarily stored in the imaging data storage unit 104.

  Next, in step 302, the first moving image data signal processing unit 106 performs various types of video signal processing such as resolution conversion and correction processing on the imaging data temporarily stored in the imaging data storage unit 104 to obtain moving image data. As the first moving image data temporary storage unit 108. In response to this, the moving image data stored in the first moving image data temporary storage unit 108 is displayed on the display unit 126 in step 304.

  Further, in step 306, the moving image data external output unit 128 determines whether or not a display device 130 having a display is connected to the imaging device 100. When it is determined that the display device 130 is externally connected to the imaging device 100, the moving image data external output unit 128 transmits the moving image data stored in the first moving image data temporary storage unit 108 to the display device 130 for display. Let

  With the processing flow described above, images via the imaging unit 102 are continuously displayed on the display unit 126 and / or the display device 130 in the recording mode.

(Flow of moving image recording process in step 204)
Next, the flow of the moving image recording process executed in step 204 shown in FIG. 2 will be described. FIG. 4 is a flowchart showing an example of the flow of the moving image data recording process executed in step 204 shown in FIG. 2 in the imaging apparatus 100 according to the present embodiment. Step 400 and step 402 will not be described because the same processing as step 300 and step 302 described above is performed.

  As shown in FIG. 4, in step 404, the moving image data encoding unit 110 encodes the recording moving image data stored in the first moving image data temporary storage unit 108 into a moving image format such as an MPEG video format.

  In parallel with the moving image data encoding process in steps 400 to 404, the imaging apparatus 100 executes a GPS data acquisition process. Specifically, in step 406, the GPS information acquisition unit 112 acquires information on the current position and date / time of the imaging apparatus 100, and in step 408, GPS data including the position information and date / time information is sent to the GPS data storage unit 114. Forward.

  Thereafter, in step 410, the moving image data multiplexing unit 116 multiplexes the image data encoded in step 404 and the GPS data stored in the GPS data storage unit 114 in step 408. Although not shown in FIG. 4, the moving image data multiplexing unit 116 may also multiplex audio data encoded in a predetermined audio format by an audio data generation unit (not shown) or the like. Of course it is possible.

  Next, in step 412, the moving image data recording unit 118 records the moving image data multiplexed in step 410 in the moving image data storage unit 124.

  Thereafter, in step 414, the imaging apparatus 100 confirms whether or not the user has instructed to end moving image recording based on the command information stored in the input data storage unit 122. If it is determined that the user has instructed to end moving image recording, the imaging apparatus 100 ends the moving image recording process. On the other hand, when it is determined that the user has not instructed the end of moving image recording, the imaging apparatus 100 executes the processes of steps 400 to 412 described above again. That is, until the user presses the Rec button or the like provided in the imaging apparatus 100 again, the imaging apparatus 100 continues to execute the moving image recording process.

(Flow of still image recording process in step 208)
Next, the flow of the still image recording process executed in step 208 shown in FIG. 2 will be described. FIG. 5 is a flowchart showing an example of the flow of the still image data recording process executed in step 208 shown in FIG. 2 in the imaging apparatus 100 according to the present embodiment.

  As illustrated in FIG. 5, in step 500, the still image data acquisition unit 132 extracts one frame as still image data from the imaging data stored in the imaging data storage unit 104, and outputs the frame to the still image data signal processing unit 134. Forward.

  Next, in step 502, the still image data signal processing unit 134 performs various image signal processing such as correction processing on the still image data transferred from the still image data acquisition unit 132, and then executes the still image data. Are transferred to the still image data encoding unit 136.

  Thereafter, in step 504, the still image data encoding unit 136 encodes the still image data transferred from the still image data signal processing unit 134 into a still image compression format such as JPEG.

  In parallel with the still image data encoding process in steps 500 to 504, the imaging apparatus 100 executes the GPS data acquisition process in the same manner as the processes in steps 406 and 408 described above.

  Thereafter, in step 510, the metadata embedding unit 138 adds the GPS data stored in the GPS data storage unit 114 in step 508 to the still image data encoded in step 504.

  Next, in step 512, the still image data recording unit 140 records the still image data in which the GPS data is added in step 510 in the still image data storage unit 142.

  With the above processing, the imaging apparatus 100 can record still image data including GPS information when the user presses a shutter button or the like provided in the imaging apparatus 100.

(4. Functional Configuration Regarding Erase Candidate Image Sorting Process of Imaging Device 100)
Next, a functional configuration related to the erasure candidate image selection process provided in the imaging apparatus 100 described above will be described. As described above, the imaging apparatus 100 receives only moving image data or still image data that is an erasure candidate from the plurality of moving image data and still image data recorded in the moving image data storage unit 124 and the still image data storage unit 142. Can be sorted. Hereinafter, details of a functional configuration that realizes the feature of the imaging apparatus 100 according to the present embodiment will be described.

  6 and 7 are explanatory diagrams illustrating an example of a functional configuration related to the deletion candidate image selection process of the imaging apparatus 100 according to the present embodiment. For convenience of explanation, the functional configuration is shown in two drawings of FIGS. 6 and 7, but the functional configuration unit shown in FIGS. 6 and 7 is provided in the same imaging apparatus 100. The flow of signals between the functional components shown in FIGS. 6 and 7 is represented by symbols (a), (b), and (c). The same functional components as those shown in FIG. 1 are denoted by the same reference numerals, and detailed description thereof will be omitted below.

  The imaging apparatus 100 mainly includes a functional unit related to moving image reproduction, a functional unit related to still image reproduction, a functional unit related to selection of moving image and still image erasure candidate images, a functional unit related to data erasure processing, and a functional unit related to display processing. And comprising. Each of these functional units constituting the imaging apparatus 100 executes various functions by being controlled by a CPU (Central Processing Units). Hereinafter, the details of the functional components shown in FIGS. 6 and 7 will be described.

  As shown in FIGS. 6 and 7, the functional units related to video playback are mainly the video data reading unit 150, the video data separation unit 152, the video data decoding unit 154, the second video data temporary storage unit 158, and the video A list generation unit 162 and a moving image data selection unit 164 are included. In addition, as a functional unit related to still image reproduction, a still image data reading unit 166, a still image data decoding unit 168, a still image data temporary storage unit 172, a still image list generation unit 174, and a still image data selection Part 176. Further, the functional unit related to selection of moving image and still image deletion candidates mainly includes a metadata reading unit 170, a metadata processing unit 156, and an deletion candidate selection unit 157. In addition, the functional unit related to the data erasing process mainly includes a moving image data erasing unit 182 and a still image data erasing unit 184. Further, the functional unit related to display processing mainly includes a selector 160, an image data signal processing unit 178, an image data temporary storage unit 180, and an image data external output unit 181.

(Functions related to video playback)
The moving image data reading unit 150 reads predetermined moving image data from the moving image data storage unit 124 and transfers it to the moving image data separation unit 152. The moving image data reading unit 150 receives predetermined moving image data in accordance with a command from the user via the input unit 120 or a command from the moving image data selection unit 164, the metadata processing unit 156, or the deletion candidate selection unit 157 described later. Can be read from the moving image data storage unit 124. The moving image data reading unit 150 functions as a data reading unit in the present invention.

  The moving image data separation unit 152 separates the moving image data transferred from the moving image data reading unit 150 into various data. The moving image data separation unit 152 can separate, for example, metadata including audio data and GPS data multiplexed in the moving image data (hereinafter simply referred to as metadata). The moving image data separated by the moving image data separation unit 152 is transferred to a moving image data decoding unit 154 described later, the metadata is transferred to a metadata processing unit 156 described later, and other processing units (FIG. (Not shown).

  The moving image data decoding unit 154 decodes the moving image data transferred from the moving image data separation unit 152 and transfers it to the second moving image data temporary storage unit 158.

  The second moving image data temporary storage unit 158 is composed of a semiconductor memory or the like, and temporarily stores a plurality of moving image data transferred from the moving image data decoding unit 154. The moving image data stored in the second moving image data temporary storage unit 158 is displayed on the display unit 126 and the display device 130 by a function unit related to display processing to be described later. The flow of the moving image data reproduction process will be described in the process flow described later.

  The moving image list generation unit 162 extracts thumbnail images of the moving image data stored in the second moving image data temporary storage unit 158, and configures a moving image data selection screen based on the thumbnail images. For example, when the user instructs a moving image data list display mode (hereinafter also referred to as a preview mode), the moving image list generation unit 162 extracts thumbnail images and generates an image to be displayed in the moving image data preview mode. .

  The moving image data selection unit 164 transfers information related to the moving image data selected by the user in the preview mode to the moving image data reading unit 150 or a moving image data erasing unit 182 described later. In response to this, the moving image data reading unit 150 can read the moving image data selected by the user from the moving image data storage unit 124. In addition, the moving image data deleting unit 182 can delete the moving image data selected by the user from the moving image data storage unit 124. The moving image data selection unit 164 determines an instruction from the user via the input unit 120, and transfers information related to the moving image data to the moving image data reading unit 150 when the user selects reproduction of moving image data in the preview mode. . In addition, when the user selects the deletion of the moving image data in the preview mode, the moving image data selection unit 164 transfers information regarding the moving image data to the moving image data deletion unit 182 ((c) in FIGS. 6 and 7).

(Functional part related to still image playback)
The still image data reading unit 166 reads predetermined still image data from the still image data storage unit 142 and transfers it to the still image data decoding unit 168 and the metadata reading unit 170. The still image data reading unit 166 receives a predetermined command in response to a command from the user via the input unit 120 or a command from a later-described still image data selection unit 176, metadata processing unit 156, or erasure candidate selection unit 157. Still image data can be read from the still image data storage unit 142. The still image data reading unit 166 functions as a data reading unit in the present invention.

  The still image data decoding unit 168 decodes the still image data transferred from the still image data reading unit 166 and transfers it to the still image data temporary storage unit 172.

  The still image data temporary storage unit 172 is composed of a semiconductor memory or the like, and temporarily stores a plurality of still image data transferred from the still image data decoding unit 168. The still image data stored in the still image data temporary storage unit 172 is displayed on the display unit 126 and the display device 130 by a function unit related to display processing to be described later. The flow of the still image data reproduction process will be described in the process flow described later.

  The still image list generation unit 174 extracts still image data stored in the still image data temporary storage unit 172 as a thumbnail image, and configures a still image data selection screen based on the thumbnail image. For example, when the user instructs a still image data preview mode, the still image list generation unit 174 extracts a thumbnail image and generates an image to be displayed in the still image data preview mode.

  The still image data selection unit 176 transfers information related to still image data selected by the user in the preview mode to the still image data reading unit 166 or a still image data erasing unit 184 described later. In response to this, the still image data reading unit 166 can read the still image data selected by the user from the still image data storage unit 142. Further, the still image data deleting unit 184 can delete the still image data selected by the user from the still image data storage unit 142. The still image data selection unit 176 determines an instruction from the user via the input unit 120, and when the user selects reproduction of the still image data in the preview mode, the still image data reading unit Transfer to 166. Further, when the user selects erasure of still image data in the preview mode, the still image data selection unit 176 transfers information regarding the still image data to the still image data erasure unit 184 (in FIGS. 6 and 7). a)).

(Functional unit for selecting candidate images for erasing movies and still images)
The metadata reading unit 170 reads the metadata from the still image data read by the still image data reading unit 166 and transfers the metadata to the metadata processing unit 156 described later. As described above, in the still image data recorded in the still image data storage unit 142, metadata including GPS data such as position information and date / time information is recorded. Therefore, the metadata reading unit 170 can read metadata including at least position information and date / time information from the still image data read by the still image data reading unit 166 and transfer the metadata to the metadata processing unit 156.

  The metadata processing unit 156 determines whether or not the metadata separated from the moving image data by the moving image data separation unit 152 matches the metadata read by the metadata reading unit 170. As described above, the imaging apparatus 100 according to the present embodiment selects only moving image data in which still image data is not recorded during recording or reproduction of moving image data when selecting deletion candidates for moving image data. Sort as Furthermore, when selecting the still image data deletion candidates, the imaging apparatus 100 selects only still image data recorded during recording or reproduction of moving image data as deletion candidates. Here, as described above, metadata including at least position information and date / time information is recorded in the frame image and still image data of the moving image data. Therefore, if the position information and date / time information of the metadata recorded in the still image data match the position information and date / time information of the metadata recorded in the predetermined frame image of the moving image data, the still image data is Recorded during data recording or playback.

  Therefore, when the metadata processing unit 156 selects a deletion candidate for moving image data, the metadata of the still image data read by the still image data reading unit 166 is included in any frame image of the target moving image data. It is determined whether or not it matches the recorded metadata. The metadata processing unit 156 sequentially instructs the still image data reading unit 166 to read still image data. Thus, the metadata processing unit 156 determines whether the metadata of all the still image data recorded in the still image data storage unit 142 matches the metadata of any frame image of the target moving image data. Can be determined. If the metadata does not match, the metadata processing unit 156 determines that no still image data is recorded during recording or reproduction of the target moving image data, and transfers the determination result to the erasure candidate selection unit 157.

  On the other hand, when the metadata processing unit 156 selects deletion candidates for still image data, the metadata recorded in the target still image data is the frame image of the moving image data read by the moving image data reading unit 150. It is determined whether or not it matches the metadata recorded in. The metadata processing unit 156 sequentially instructs the moving image data reading unit 150 to read moving image data. Thereby, the metadata processing unit 156 determines whether or not the metadata of the target still image matches the metadata recorded in the frame images of all the moving image data recorded in the moving image data storage unit 124. Judgment can be made. If the metadata matches, the metadata processing unit 156 determines that the target still image data is recorded during recording or reproduction of the moving image data, and transfers the determination result to the erasure candidate selection unit 157. .

  The deletion candidate selection unit 157 instructs the moving image data reading unit 150 and the still image data reading unit 166 to read moving image data and still image data that are deletion candidates in accordance with the determination result transferred from the metadata processing unit 156. . As described above, the metadata processing unit transfers only information related to moving image data and still image data that are candidates for deletion to the deletion candidate selection unit 157. Therefore, based on the information transferred from the metadata processing unit 156, the deletion candidate selection unit 157 instructs the moving image data reading unit 150 and the still image data reading unit 166 to read moving image data and still image data that are deletion candidates. can do.

  Specifically, when the deletion candidate of moving image data is presented to the user in the preview mode, the deletion candidate selection unit 157 determines the moving image data based on the information regarding the moving image data transferred from the metadata processing unit 156. Reading is instructed to the moving image data reading unit 150. As a result, the above-described moving image list generation unit 162 or the like generates a preview mode screen including only deletion candidate moving image data, and displays it on the display unit 126 and / or the display device 130.

  Further, when presenting a still image data erasure candidate to the user in the preview mode, the erasure candidate selection unit 157, based on the information regarding the still image data transferred from the metadata processing unit 156, Reading is instructed to the still image data reading unit 166. As a result, the above-described still image list generation unit 174 or the like generates a preview mode screen composed of only still image data as erasure candidates and displays it on the display unit 126 and / or the display device 130. .

  With the above functional units, the imaging apparatus 100 according to the present embodiment can select deletion candidates for moving image data and still image data. Note that the metadata reading unit 170, the metadata processing unit 156, and the deletion candidate selection unit 157 described above function as an deletion candidate image selection processing unit in the present invention. Further, the flow of selection processing for deletion candidates of moving image data and still image data will be described in a processing flow described later.

(Functional part related to data erasure processing)
The moving image data deletion unit 182 deletes predetermined moving image data from the moving image data storage unit 124 in response to an instruction from the moving image data selection unit 164. As described above, when the user instructs to delete the predetermined moving image data in the preview mode or the like, the moving image data selection unit 164 transfers information related to the moving image data to the moving image data deletion unit 182 (FIGS. 6 and 7). (C)). In response to this, the moving image data deletion unit 182 can delete the target moving image data from the moving image data storage unit 124 based on the information transferred from the moving image data selection unit 164.

  The still image data deletion unit 184 deletes predetermined still image data from the still image data storage unit 142 in response to an instruction from the still image data selection unit 176. As described above, when the user instructs deletion of predetermined still image data in the preview mode or the like, the still image data selection unit 176 transfers information related to the still image data to the still image data deletion unit 184 (FIG. 6 and (a) in FIG. In response to this, the still image data deletion unit 184 can delete the target still image data from the still image data storage unit 142 based on the information transferred from the still image data selection unit 176.

  With the above function unit, the imaging apparatus 100 according to the present embodiment can erase predetermined moving image data and still image data from the moving image data storage unit 124 and the still image data storage unit 142. Note that the flow of erasure processing of moving image data and still image data will be described in the processing flow described later.

(Functional part related to display processing)
The selector 160 selects an image (moving image data or still image data) that conforms to the current mode of the imaging apparatus 100 and transfers it to an image data signal processing unit 178 described later ((b) in FIGS. 6 and 7). . That is, the selector 160 selects the moving image data stored in the second moving image data temporary storage unit 158 and transfers it to the image data signal processing unit 178 in the mode for reproducing moving image data. In the mode for displaying a list of moving image data, the preview mode image generated by the moving image list generating unit 162 is transferred to the image data signal processing unit 178. In the mode for reproducing still image data, the still image data stored in the still image data temporary storage unit 172 is selected and transferred to the image data signal processing unit 178. Further, in the mode for displaying a list of still image data, the preview mode image generated by the still image list generation unit 174 is transferred to the image data signal processing unit 178.

  The image data signal processing unit 178 performs various video signal processing such as resolution conversion and correction processing on the image data transferred from the selector 160 and transfers the image data to the image data temporary storage unit 180. Note that the image data signal processing unit 178 may generate a plurality of moving image data by performing a plurality of video signal processes in accordance with the specifications of the display unit 126 and the display device 130. For example, the image data signal processing unit 178 generates image data with a resolution of 640 × 480 when the display unit 126 included in the imaging apparatus 100 is a VGA (Video Graphics Array) panel. The image data signal processing unit 178 also generates image data with a resolution of 1920 × 1080 when a display device 130 such as an HDTV is externally connected to the imaging device 100.

  The image data temporary storage unit 180 is composed of a semiconductor memory or the like, and temporarily stores a plurality of image data transferred from the image data signal processing unit 178. The image data temporary storage unit 180 may be configured by a plurality of storage units according to the transfer destination of the image data. The image data stored in the image data temporary storage unit 180 in this way is displayed on the display unit 126. As a result, the user can view moving image data and still image data on the display unit 126, and can select predetermined data from a list of moving image data and still image data displayed on the display unit 126.

  The image data external output unit 181 includes an interface such as HDMI and transmits image data to the display device 130 such as a television. The image data external output unit 181 is an image subjected to signal processing by the image data signal processing unit 178 according to the display specifications of the display device 130 among the image data stored in the image data temporary storage unit 180. Data is transmitted to the display device 130. As a result, the user can view moving image data and still image data on the display of the display device 130 externally connected to the imaging device 100, or can select a predetermined number from a list of moving image data and still image data displayed on the display of the display device 130. You can select the data.

  With the above function unit, the imaging apparatus 100 according to the present embodiment can display an image according to a predetermined mode provided in the imaging apparatus 100. A display example of the display unit 126 or the display device 130 in the preview mode will be exemplified in the description of the processing flow described later.

  The details of the functional configuration related to the erasure candidate image selection process of the imaging apparatus 100 according to the present embodiment have been described above with reference to FIGS. 6 and 7.

(5. Details of Erase Candidate Image Sorting Process by Imaging Device 100)
Next, a flow of processing performed in the preview mode in the imaging apparatus 100 having the above-described functional configuration will be described below. Specifically, a description will be given of the flow of moving image data and still image data reproduction processing, moving image data and still image data list display processing, and moving image data and still image data deletion candidate image selection processing performed by the imaging apparatus 100.

(About the overall process flow in preview mode)
First, an overall flow of processing performed by the imaging apparatus 100 in the preview mode will be described. FIG. 8 is a flowchart showing an example of the overall flow of processing performed by the imaging apparatus 100 in the preview mode. Note that FIG. 8 shows processing executed by each of the functional component units described above in response to an instruction from the input unit 120, for example, when the user selects a preview mode.

  As illustrated in FIG. 8, in step 800, the input unit 120 determines whether the user has selected the moving image preview mode or the still image preview mode. For example, the input unit 120 can determine which preview mode the user has selected according to the operation of the touch panel, operation buttons, or the like by the user. When the input unit 120 determines that the user has selected the video preview mode, the input unit 120 transfers a command related to the video list display process to the input data storage unit 122. On the other hand, if it is determined that the user has selected the still image preview mode, the input unit 120 transfers a command related to a still image list display process to the input data storage unit 122. In the preview mode, for example, either a moving image preview mode or a still image preview mode may be automatically selected depending on an initial setting or the like.

  If the user selects the moving image preview mode, the imaging apparatus 100 executes moving image data list display processing in step 802. FIG. 20 is an explanatory diagram illustrating a display example of the display unit 126 or the display device 130 in the moving image preview mode. The user can select moving image data to be reproduced or select a data erasing mode with reference to a preview screen as shown in FIG. The details of the moving image data list display process will be described later with reference to FIG.

  Next, in step 804, the input unit 120 determines whether or not the user has selected the moving image erasing mode. For example, the user can select the moving image erasing mode on the preview screen shown in FIG. 20 via a touch panel, a remote control, an operation button, or the like. When the input unit 120 determines that the user has selected the moving image erasing mode in response to such an operation by the user, the input unit 120 transfers an instruction relating to the transition to the moving image erasing mode to the input data storage unit 122.

  In response to this, in step 806, the imaging apparatus 100 executes the erasing process of the moving image data. The details of the flow of the moving image data erasing process will be described later with reference to FIG.

  Thereafter, in step 808, the moving image erasing process in step 806 is continuously executed until it is determined that the user has instructed to end the moving image erasing mode.

  On the other hand, if it is determined in step 804 that the user has not selected the moving image deletion mode, the input unit 120 determines in step 810 whether or not the user has instructed the moving image reproduction. When the input unit 120 determines that the user has instructed to reproduce the moving image, the input unit 120 transfers an instruction relating to reproduction of the moving image data to the input data storage unit 122.

  In response to this, in step 812, the imaging apparatus 100 executes a reproduction process of the moving image data. The details of the flow of moving image data reproduction processing will be described later with reference to FIG.

  Thereafter, in step 814, the moving image reproduction process in step 812 is continuously executed until it is determined that the user has instructed to end the moving image reproduction mode.

  If it is determined in step 808 or step 814 that the user has instructed to end the moving image deletion mode or the moving image reproduction mode, the input unit 120 determines in step 816 whether the user has instructed to end the preview mode. . When it is determined that the user has instructed the end of the preview mode, the input unit 120 transfers a command related to the end of the preview mode to the input data storage unit 122. On the other hand, when the preview mode is being continued, the processing related to the preview mode of the moving image in steps 802 to 814 is continuously executed.

  Here, for example, when the user selects the still image preview mode in the moving image preview mode, the processing related to the still image preview mode in steps 818 to 830 is executed.

  Specifically, in step 818, the imaging apparatus 100 executes a still image data list display process in the same manner as the moving image data list display example illustrated in FIG. Thus, the user can select still image data to be displayed or select a data erasing mode with reference to a preview screen on which still images are displayed in a list. The details of the flow of the still image data list display process will be described later with reference to FIG.

  Next, in step 820, the input unit 120 determines whether or not the user has selected the still image deletion mode. When the input unit 120 determines that the user has selected the still image erasing mode, the input unit 120 transfers an instruction related to the transition to the still image erasing mode to the input data storage unit 122.

  In response to this, in step 822, the imaging apparatus 100 executes a still image data erasing process. Details of the flow of the still image data erasing process will be described later with reference to FIG.

  Thereafter, in step 824, the still image erasing process in step 822 is continuously executed until it is determined that the user has instructed the end of the still image erasing mode.

  On the other hand, if it is determined in step 820 that the user has not selected the still image deletion mode, the input unit 120 determines in step 826 whether or not the user has instructed display of a predetermined still image. When the input unit 120 determines that the user has instructed display of a predetermined still image, the input unit 120 transfers a command related to display of the still image data to the input data storage unit 122.

  In response to this, the imaging apparatus 100 executes a still image data display process in step 828. The details of the flow of the still image data display process will be described later with reference to FIG.

  Thereafter, in step 830, the still image display process in step 828 is continuously executed until it is determined that the user has instructed the end of the still image display mode.

  If it is determined in step 824 or step 830 that the user has instructed the end of the still image deletion mode or the still image display mode, the input unit 120 determines in step 816 whether the user has instructed the end of the preview mode. to decide. When it is determined that the user has instructed the end of the preview mode, the input unit 120 transfers a command related to the end of the preview mode to the input data storage unit 122. On the other hand, when the preview mode is continuing, the processing related to the still image preview mode in steps 818 to 830 is continuously executed.

  With the above processing flow, in the preview mode, moving image data reproduction processing, still image data display processing, moving image data and still image data erasure processing are executed. Thereby, the user can select arbitrary moving image data or still image data desired to be reproduced (displayed) or deleted in the preview mode. Hereinafter, the moving image list display process in step 802, the moving image reproduction process in step 812, the still image list display process in step 818, the still image display process in step 828, the moving image deletion process in step 806, and the still image in step 822 shown in FIG. Details of the image erasing process will be described.

(Flow of video list display process in step 802)
First, the details of the flow of the moving image data list display process executed in step 802 shown in FIG. 8 will be described. FIG. 9 is a flowchart illustrating an example of a moving image data list display process executed in step 802 illustrated in FIG. 8 in the imaging apparatus 100 according to the present embodiment.

  As shown in FIG. 9, in step 900, moving image data reading unit 150 reads predetermined moving image data recorded in moving image data storage unit 124. From the moving image data read by the moving image data reading unit 150, metadata, audio data, and the like are separated by the moving image data separation unit 152.

  Next, in step 902, the moving image data decoding unit 154 decodes a predetermined frame image constituting the moving image data as a thumbnail image, and transfers the decoded thumbnail image to the second moving image data temporary storage unit 158.

  Thereafter, in step 904, the processing in step 900 and step 902 is continuously executed until it is determined that the thumbnail images corresponding to all the moving image data recorded in the moving image data storage unit 124 have been decoded. When the number of moving image data to be displayed at a time on the display unit 126 is set in the moving image data list display, the above steps 900 and 902 are performed until it is determined that the set number of thumbnail images has been decoded. The processing by may be executed continuously.

  Thereafter, in step 906, the moving image list generating unit 162 displays list display images to be displayed on the display unit 126 and / or the display device 130 based on the plurality of thumbnail images stored in the second moving image data temporary storage unit 158. Generate.

  In step 908, the moving image data list display image generated by the moving image list generation unit 162 is displayed on the display unit 126 via the selector 160, the image data signal processing unit 178, and the image data temporary storage unit 180. . When the display device 130 is externally connected to the imaging device 100, the moving image data list display image generated by the moving image list generation unit 162 is also displayed on the display device 130 via the image data external output unit 181. Is displayed. As a result, a list of moving image data as shown in FIG. 20 is displayed on the display unit 126 and the display device 130.

(Flow of video playback process in step 812)
Next, details of the flow of moving image data reproduction processing executed in step 812 shown in FIG. 8 will be described. FIG. 10 is a flowchart illustrating an example of the flow of moving image data reproduction processing executed in step 812 illustrated in FIG. 8 in the imaging apparatus 100 according to the present embodiment.

  As shown in FIG. 10, in step 1000, the moving image data reading unit 150 reads moving image data selected by the user from a plurality of moving image data recorded in the moving image data storage unit 124. The user can select any video data desired to be reproduced from a plurality of video data displayed on the video data list display screen shown in FIG. 20 via a touch panel, operation buttons, or the like. When predetermined moving image data is selected by the user, an instruction relating to reproduction of the moving image data is transferred to the moving image data reading unit 150 via the input unit 120 and the input data storage unit 122. In response to this, the moving image data reading unit 150 can read the moving image data selected by the user from the moving image data storage unit 124.

  Next, in step 1002, the moving image data separation unit 152 separates metadata, audio data, and the like from the moving image data read by the moving image data reading unit 150.

  Next, in step 1004, the moving image data decoding unit 154 decodes the moving image data, and transfers the decoded moving image data to the second moving image data temporary storage unit 158.

  Thereafter, in step 1006, the moving image data stored in the second moving image data temporary storage unit 158 is reproduced on the display unit 126 via the selector 160, the image data signal processing unit 178, and the image data temporary storage unit 180. In addition, when the display device 130 is externally connected to the imaging device 100, the moving image data stored in the second moving image data temporary storage unit 158 is also reproduced on the display unit 126 via the image data external output unit 181. Is done. As a result, the moving image data reproduction screen as shown in FIG. 21 is displayed on the display unit 126 and the display device 130. Simultaneously with the reproduction of the moving image data, the audio data separated by the moving image data separation unit 152 is also output via an audio output unit (not shown) or the like.

(Flow of still image list display processing in step 818)
Next, details of the flow of the still image data list display process executed in step 818 shown in FIG. 8 will be described. FIG. 11 is a flowchart illustrating an example of a flow of the still image data list display process executed in step 818 illustrated in FIG. 8 in the imaging apparatus 100 according to the present embodiment.

  As shown in FIG. 11, in step 1100, the still image data reading unit 166 reads predetermined still image data recorded in the still image data storage unit 142.

  In step 1102, the still image data decoding unit 168 decodes the still image data as a thumbnail image, and transfers the decoded thumbnail image to the still image data temporary storage unit 172. Depending on the image format of the still image data, a thumbnail image may be recorded in a header or the like. In such a case, the still image data decoding unit 168 may decode only the thumbnail image recorded in the header of the still image data.

  Thereafter, in step 1104, the processing in step 1100 and step 1102 is continuously executed until it is determined that the thumbnail images corresponding to all the still image data recorded in the still image data storage unit 142 have been decoded. . If the number of still image data to be displayed at a time on the display unit 126 is set in the list display of still image data, the above steps 1100 and until the determined number of thumbnail images are determined to have been decoded. You may perform the process by step 1102 continuously.

  Thereafter, in step 1106, the still image list generation unit 174 displays list display images to be displayed on the display unit 126 and / or the display device 130 based on the plurality of thumbnail images stored in the still image data temporary storage unit 172. Generate.

  Next, in step 1108, the list display image of the still image data generated by the still image list generation unit 174 is displayed on the display unit 126 via the selector 160, the image data signal processing unit 178, and the image data temporary storage unit 180. Is done. When the display device 130 is externally connected to the imaging device 100, the still image data list display image generated by the still image list generation unit 174 is displayed on the display device 130 via the image data external output unit 181. Is also displayed. As a result, a list of still image data similar to the list of moving image data as shown in FIG. 20 is displayed on the display unit 126 and the display device 130.

(Flow of still image display processing in step 828)
Next, details of the flow of the still image data display process executed in step 828 shown in FIG. 8 will be described. FIG. 12 is a flowchart showing an example of the flow of the still image data display process executed in step 828 shown in FIG. 8 in the imaging apparatus 100 according to the present embodiment.

  As shown in FIG. 12, in step 1200, the still image data reading unit 166 reads still image data selected by the user from among a plurality of still image data recorded in the still image data storage unit 142. The user desires display via a touch panel or operation buttons from among a plurality of still image data displayed on the still image data list display screen similar to the moving image data list display screen shown in FIG. Arbitrary still image data can be selected. When predetermined still image data is selected by the user, a command related to display of the still image data is transferred to the still image data reading unit 166 via the input unit 120 and the input data storage unit 122. In response, the still image data reading unit 166 can read the still image data selected by the user from the still image data storage unit 142.

  In step 1202, the still image data decoding unit 168 decodes the still image data read in step 1200 and transfers the decoded still image data to the still image data temporary storage unit 172.

  Thereafter, in step 1204, the still image data stored in the still image data temporary storage unit 172 is displayed on the display unit 126 via the selector 160, the image data signal processing unit 178, and the image data temporary storage unit 180. When the display device 130 is externally connected to the imaging device 100, the still image data stored in the still image data temporary storage unit 172 is also transmitted to the display device 130 via the image data external output unit 181. Is displayed.

(Flow of moving image erasing process in step 806)
Next, details of the flow of the moving image data erasing process executed in step 806 shown in FIG. 8 will be described. FIG. 13 is a flowchart showing an example of the flow of the moving image data erasing process executed in step 806 shown in FIG. 8 in the imaging apparatus 100 according to the present embodiment. The process flow shown in FIG. 13 is a process performed when the user selects the moving image data erasing mode in the moving image preview mode. That is, in the example of the moving image preview mode screen shown in FIG. 20, the processing is performed when the user selects the moving image data erasing mode via the touch panel, operation buttons, or the like.

  Note that the imaging apparatus 100 according to the present embodiment has two erasing modes for moving image data erasing processing. In the first moving image erasing mode (hereinafter referred to as normal erasing mode), all moving image data recorded in the moving image data storage unit 124 are uniformly displayed on the screen as erasing candidates, and the user can select from these moving image data. Any video data can be selected and deleted. On the other hand, in the second moving image erasing mode (hereinafter referred to as special erasing mode), only the moving image data selected as erasure candidates is displayed on the screen, and the user can select any moving image data from the selected moving image data. You can select and delete.

  For example, when the user selects the moving image data erasing mode on the moving image data preview mode screen shown in FIG. 20, the normal erasing mode display screen shown in FIG. 22 is displayed on the display unit 126 and / or the display device 130. Is displayed. As shown in FIG. 22, the same moving image data list as the moving image data list shown in FIG. 20 is displayed on the screen. That is, the imaging apparatus 100 displays all moving image data recorded in the moving image data storage unit 124 on the screen as erasure candidates.

  Further, on the screen of the normal erasing mode as shown in FIG. 22, a button for switching to the special erasing mode is displayed. When the user selects switching to the special erasure mode, a special erasure mode display screen as shown in FIG. 23 is displayed on the display unit 126 and / or the display device 130. As shown in FIG. 23, a list of moving image data selected as erasure candidates is displayed on the screen.

  In the following description, an example in which the normal erasure mode and the special erasure mode are appropriately switched according to the selection by the user will be described, but it is naturally possible to set so that any erasure mode is automatically selected. Is possible. Details of the processing flow in the normal erase mode and the special erase mode will be described below.

  As shown in FIG. 13, in step 1300, the input unit 120 determines whether or not the user has selected the special erasure mode. When it is determined that the user has not selected the special erasure mode, the imaging apparatus 100 maintains the display screen in the normal erasure mode illustrated in FIG. 22 and waits for an instruction to erase moving image data from the user.

  That is, in step 1302, the input unit 120 determines whether or not the user has instructed deletion of predetermined moving image data. The user selects any video data from a plurality of video data displayed on the display screen in the normal erasure mode shown in FIG. 22 via the touch panel or operation buttons, and deletes the video data. Can be directed. When the predetermined moving image data is selected by the user, the moving image data selection unit 164 that has received an instruction via the input unit 120 transfers an instruction to delete the moving image data to the moving image data deletion unit 182.

  Thereafter, in step 1304, the moving image data deleting unit 182 deletes the moving image data from the moving image data storage unit 124. Thereby, the user can select and delete arbitrary moving image data from the plurality of moving image data recorded in the moving image data storage unit 124.

  On the other hand, if it is determined in step 1300 that the user has selected the special erasure mode, the imaging apparatus 100 is not important for the user by executing the processing from step 1306 onward, which is one of the features of the present embodiment. Only video data considered to be selected. The detailed flow of the moving image data erasure candidate selection process, which is one of the features of this embodiment, will be described below.

  First, in step 1306, the still image data reading unit 166 reads one still image data from among a plurality of still image data recorded in the still image data storage unit 142.

  In step 1308, the metadata reading unit 170 reads metadata from the still image data read in step 1306, and extracts GPS data including at least position information and date / time information from the metadata. The GPS data extracted by the metadata reading unit 170 is transferred to the metadata processing unit 156.

  Next, in step 1310, the metadata processing unit 156 reads out the moving image data in which the date and time information close to the date and time information is recorded based on the date and time information included in the GPS data transferred in step 1308. It instructs the reading unit 150.

  For example, it is assumed that the date and time information included in the still image data is “July 17, 2008 17:26”. The date and time information included in the moving image data 1, 2 and 3 recorded in the moving image data storage unit 124 is “October 15, 2007 13:21” and “July 17, 2008 16: 00 ”,“ July 17, 2008 20:00 ”. In this case, the metadata processing unit 156 instructs the moving image data reading unit 150 to read the moving image data 2 from the moving image data storage unit 124.

  In response to this, the moving image data reading unit 150 reads the moving image data 2 from the moving image data storage unit 124 and transfers it to the moving image data separation unit 152. Thereafter, the moving image data separation unit 152 separates the metadata from the moving image data, and transfers GPS data including at least date information and position information to the metadata processing unit 156.

  Next, in step 1312, the metadata processing unit 156 records the GPS data of the still image data read by the still image data reading unit 166 in any frame image of the moving image data read by the moving image data reading unit 150. Judge whether or not. The metadata processing unit 156 can make the above determination by comparing the GPS data of the still image data transferred from the metadata reading unit 170 with the GPS data transferred from the moving image data separation unit 152.

  When the GPS data of the still image data read by the still image data reading unit 166 is not recorded in any frame image of the moving image data read by the moving image data reading unit 150, the moving image data is being recorded or reproduced. This means that still image data is not recorded. In this case, the imaging apparatus 100 determines that the moving image data is likely to be moving image data that is not so important for the user, and executes the processing of step 1314.

  Specifically, in step 1314, the metadata processing unit 156 transfers information regarding the moving image data to the erasure candidate selection unit 157. In response to this, the erasure candidate selection unit 157 records and manages the information of the moving image data in the erasure candidate database.

  On the other hand, when the GPS data of the still image data read by the still image data reading unit 166 is recorded in any frame image of the moving image data read by the moving image data reading unit 150, the moving image data is being recorded or played back. This means that still image data has been recorded. Accordingly, since the moving image data is assumed to record an important scene, the imaging apparatus 100 determines that the moving image data is important moving image data for the user, and does not select it as an erasure candidate.

  Thereafter, in step 1306, another still image data is read again from the still image data storage unit 142, and moving image data erasure candidate selection processing is executed again by the same steps as described above. That is, in step 1316, until it is determined that the selection process of deletion candidates for moving image data has been performed based on all the still image data recorded in the still image data storage unit 142, the above-described steps 1306 to 1314 are performed. Processing is executed continuously.

  If it is determined in step 1316 that the selection process of deletion candidates for moving image data has been performed based on all the still image data recorded in the still image data storage unit 142, the imaging apparatus 100 determines in step 1318 that Display a list of video data deletion candidates.

  Specifically, the erasure candidate selection unit 157 transfers information related to erasure candidates for moving image data recorded in a database or the like to the moving image data reading unit 150. In response to this, the moving image data reading unit 150 reads only moving image data as an erasure candidate from the plurality of moving image data recorded in the moving image data storage unit 124 and transfers the moving image data to the moving image data separation unit 152. Thereafter, based on the moving image data stored in the second moving image data temporary storage unit 158 via the moving image data separation unit 152, the moving image data decoding unit 154, and the like, the moving image list generation unit 162 deletes the moving image data including the thumbnail images. A list display image of candidates is generated. Thereafter, a list of moving image data deletion candidates is displayed on the display unit 126 via the selector 160, the image data signal processing unit 178, and the image data temporary storage unit 180. When the display device 130 is externally connected to the imaging device 100, a list of moving image data erasure candidates is also displayed on the display device 130 via the image data external output unit 181.

  FIG. 23 is an explanatory diagram illustrating a display example of a list of deletion candidates displayed on the display unit 126 and / or the display device 130 in the moving image data special deletion mode. Referring to FIG. 23, it can be seen that only some of the moving image data displayed in the display example of FIG. 22 is displayed. That is, among the six moving image data A, B, C, D, and E displayed in the display example of FIG. 22, moving image data A, E, and F are still image data during recording or reproduction of the moving image data. Is not selected as an erasure candidate. On the other hand, the moving image data B, C, and D are determined not to be important moving image data for the user because no still image data is recorded during recording or reproduction of the moving image data. It has been selected as. As a result, the user can efficiently instruct the imaging apparatus 100 to delete the unimportant moving image data based on the display screen shown in FIG.

(Flow of still image erasing process in step 822)
Next, details of the flow of the still image data erasing process executed in step 822 shown in FIG. 8 will be described. FIG. 14 is a flowchart showing an example of the still image data erasing process executed in step 822 shown in FIG. 8 in the imaging apparatus 100 according to the present embodiment. The process flow shown in FIG. 14 is a process performed when the user selects the still image data deletion mode in the still image preview mode. That is, also in the still image data erasing mode, the user selects the erasing mode having the same contents as the normal erasing mode shown in FIG. 22 and the special erasing mode shown in FIG. Can do. Details of the processing flow in the normal erase mode and the special erase mode will be described below.

  As shown in FIG. 14, in step 1400, the input unit 120 determines whether or not the user has selected the special erase mode. If it is determined that the user has not selected the special erasure mode, the imaging apparatus 100 maintains the display screen in the normal erasure mode having the same contents as in FIG. 22 and waits for an instruction to erase still image data from the user.

  That is, in step 1402, the input unit 120 determines whether or not the user has instructed deletion of predetermined still image data. The user selects arbitrary still image data from a plurality of still image data displayed on the display screen in the normal deletion mode via the touch panel or operation buttons, and instructs to delete the still image data. be able to. When predetermined still image data is selected by the user, the still image data selection unit 176 that has received an instruction via the input unit 120 transfers an instruction to delete the still image data to the still image data deletion unit 184.

  Thereafter, in step 1404, the still image data deleting unit 184 deletes the still image data from the still image data storage unit 142. Thus, the user can select and delete any still image data from among the plurality of still image data recorded in the still image data storage unit 142.

  On the other hand, when it is determined in step 1400 that the user has selected the special erasure mode, the imaging apparatus 100 performs resting that can be restored by executing the processing from step 1406 onward, which is one of the features of the present embodiment. Select only image data. The detailed flow of the still image data erasure candidate selection process, which is one of the features of this embodiment, will be described below.

  First, in step 1406, the still image data reading unit 166 reads one still image data from among a plurality of still image data recorded in the still image data storage unit 142.

  Next, in step 1408, the metadata reading unit 170 reads the metadata from the still image data read in step 1406, and extracts GPS data including at least position information and date / time information from the metadata. The GPS data extracted by the metadata reading unit 170 is transferred to the metadata processing unit 156.

  Next, in step 1410, the metadata processing unit 156 reads the moving image data in which the date and time information close to the date and time information is recorded based on the date and time information included in the GPS data transferred in step 1408. It instructs the reading unit 150.

  For example, it is assumed that the date and time information included in the still image data is “July 17, 2008 17:26”. The date and time information included in the moving image data 1, 2 and 3 recorded in the moving image data storage unit 124 is “October 15, 2007 13:21” and “July 17, 2008 16: 00 ”,“ July 17, 2008 20:00 ”. In this case, the metadata processing unit 156 instructs the moving image data reading unit 150 to read the moving image data 2 from the moving image data storage unit 124.

  In response to this, the moving image data reading unit 150 reads the moving image data 2 from the moving image data storage unit 124 and transfers it to the moving image data separation unit 152. Thereafter, the moving image data separation unit 152 separates the metadata from the moving image data, and transfers GPS data including at least date information and position information to the metadata processing unit 156.

  Next, in step 1412, the metadata processing unit 156 records the GPS data of the still image data read by the still image data reading unit 166 in any frame image of the moving image data read by the moving image data reading unit 150. Judge whether or not. The metadata processing unit 156 can make the above determination by comparing the GPS data of the still image data transferred from the metadata reading unit 170 with the GPS data transferred from the moving image data separation unit 152.

  When the GPS data of the still image data read out by the still image data reading unit 166 is recorded in any frame image of the moving image data read out by the moving image data reading unit 150, the moving image data is being recorded or reproduced. This means that still image data has been recorded. In this case, the imaging apparatus 100 determines that the still image data can be restored again based on the moving image data even if the still image data is once deleted, and executes the processing of step 1414.

  Specifically, in step 1414, the metadata processing unit 156 transfers information related to the still image data to the erasure candidate selection unit 157. In response to this, the erasure candidate selection unit 157 records and manages the information of the still image data in an erasure candidate database or the like.

  On the other hand, when the GPS data of the still image data read out by the still image data reading unit 166 is not recorded in any frame image of the moving image data read out by the moving image data reading unit 150, the still image data is recorded while the moving image data is being recorded. This means that no image data is recorded. Therefore, the imaging apparatus 100 determines that once the still image data is erased, it cannot be restored thereafter, and does not select it as an erase candidate.

  Thereafter, in step 1406, another still image data is read again from the still image data storage unit 142, and the still image data erasure candidate selection process is executed again by the same steps as described above. That is, in step 1416, the processing from step 1406 to step 1414 is continued until it is determined that the erasure candidate selection processing has been performed on all the still image data recorded in the still image data storage unit 142. To be executed.

  If it is determined in step 1416 that the erasure candidate selection process has been performed on all the still image data recorded in the still image data storage unit 142, the imaging apparatus 100 determines that the still image data is stored in step 1418. Display a list of deletion candidates.

  Specifically, the erasure candidate selection unit 157 transfers information related to erasure candidates for still image data recorded in a database or the like to the still image data reading unit 166. In response to this, the still image data reading unit 166 reads only still image data that is an erasure candidate from the plurality of still image data recorded in the still image data storage unit 142. Thereafter, based on the still image data stored in the still image data temporary storage unit 172 via the still image data decoding unit 168 and the like, the still image list generation unit 174 generates a list display image of still image data deletion candidates. To do. Thereafter, a list of still image data erasure candidates similar to the display example shown in FIG. 23 is displayed on the display unit 126 via the selector 160, the image data signal processing unit 178, and the image data temporary storage unit 180. When the display device 130 is externally connected to the imaging device 100, a list of still image data deletion candidates is also displayed on the display device 130 via the image data external output unit 181. As a result, the user can efficiently instruct the imaging device 100 to erase still image data based on the display screen of the deletion candidate list displayed on the display unit 126 or / and the display device 130.

  The details of the selection process of the deletion candidates for moving image data and still image data by the imaging apparatus 100 according to the present embodiment have been described above. As described above, the imaging apparatus 100 can select only moving image data that is a candidate for deletion from a plurality of moving image data and present it to the user. That is, the imaging apparatus 100 can determine that moving image data in which still image data is not recorded during recording or reproduction of moving image data is not important for the user, and can select the moving image data as an erasure candidate. Further, the imaging apparatus 100 can select only the still image data that is a candidate for erasure from a plurality of still image data and present it to the user. That is, when still image data is recorded during recording or playback of moving image data, the imaging apparatus 100 can be restored again based on the moving image data even if the still image data is deleted once. And the still image data can be selected as an erasure candidate. As described above, the imaging apparatus 100 uses the related information (GPS data in this embodiment) that associates moving image data and still image data to select moving image data or still image data that is a candidate for deletion, and erases the data. It is possible to improve usability.

(6. Modification of imaging device 100)
The imaging device 100 according to the above-described embodiment can have further features in addition to the above features by changing each of the functional configuration units described above or additionally including another functional configuration unit. . Hereinafter, a modified example of the imaging apparatus 100 that has the characteristics of the imaging apparatus 100 according to the above-described embodiment and can further improve usability regarding data erasing will be described.

(6-1. Modification 1 (Additional example of still image restoration processing function))
The first modification of the imaging device 100 allows the still image data erased in the above-described embodiment to be restored based on the moving image data. That is, the imaging apparatus 100 according to the above embodiment determines that the still image data recorded during the recording or reproduction of the moving image data can be restored again based on the moving image data even after being erased. Image data is selected as a candidate for deletion. When the user erases the still image data selected in this way, the imaging apparatus 100 according to the first modification can restore the still image data based on the moving image data. Hereinafter, the details of the imaging apparatus 100 of Modification 1 having such characteristics will be described.

(Functional Configuration of Imaging Device 100 of Modification 1)
15 and 16 are explanatory diagrams illustrating an example of a functional configuration related to the still image data restoration processing of the imaging apparatus 100 according to the first modification. For convenience of explanation, the functional configuration is shown in two drawings of FIGS. 15 and 16, but the functional configuration unit shown in FIGS. 15 and 16 is provided in the same imaging apparatus 100. The flow of signals between the functional components shown in FIGS. 15 and 16 is represented by symbols (a), (b), (c), (d), (e), (f), (g), It is represented by (h). Also, the same functional components as those shown in FIGS. 1, 6 and 7 are denoted by the same reference numerals, and detailed description thereof will be omitted below.

  As illustrated in FIGS. 15 and 16, the imaging apparatus 100 according to the first modification includes a still image data restoration determination unit 250, an erase history storage unit 252, and still image data restoration in addition to the functional configuration unit in the above embodiment. And a processing unit 256. Details of the functional components shown in FIGS. 15 and 16 will be described below.

  The erasure history storage unit 252 includes a semiconductor memory and manages erasure image information related to still image data erased by the still image data erasure unit 184. For example, the deletion history storage unit 252 can record and manage the position information and date / time information of still image data deleted by the still image data deletion unit 184 in a database or the like. Of course, the erasure image information that can be managed by the erasure history storage unit 252 is not limited to the position information and the date / time information, but includes the erased still image data and the same frame image as the still image data. Any information that associates video data with each other may be used. Therefore, for example, the erasure history storage unit 252 manages, as erasure image information, information such as which frame image of which moving image data in the moving image data storage unit 124 is the same frame image as the deleted still image data. May be.

  When the still image data restoration determination unit 250 restores the still image data once deleted by the still image data deletion unit 184, the same frame image as the still image data is recorded in the moving image data storage unit 124. It is determined whether it is included in any moving image data. When it is determined that the same frame image as the still image data to be restored is included in the moving image data, the still image data restoration determining unit 250 sends the moving image data reading unit 150 to the moving image data reading unit 150 via the deletion history storage unit 252. Instruct to read the moving image data. On the other hand, when it is determined that the same frame image as the still image data to be restored is not included in the moving image data, the still image data restoration determination unit 250 relates to the still image data recorded in the deletion history storage unit 252. The information is erased ((e) in FIGS. 15 and 16). Details of the determination process by the still image data restoration determination unit 250 will be described later with reference to FIGS. 16 and 17.

  The still image data restoration processing unit 256 restores still image data once deleted. As shown in FIG. 16, the still image data restoration processing unit 256 mainly includes a still image data acquisition unit 258, a still image data signal processing unit 260, a still image data encoding unit 262, and a metadata embedding unit 264. And a still image data recording unit 266.

  The still image data acquisition unit 258 extracts a frame image of the same image as the deleted still image data from the moving image data stored in the second moving image data temporary storage unit 158 and transfers the frame image to the still image data signal processing unit 260. ((H) in FIGS. 15 and 16). The still image data acquisition unit 258 can extract still image data from moving image data and transfer it to the still image data signal processing unit 260 in accordance with an instruction from the still image data restoration processing unit 256 or the like.

  The still image data signal processing unit 260 performs various image signal processing such as correction processing on the still image data transferred from the still image data acquisition unit 258, and then converts the still image data into the still image data encoding unit 262. Forward to.

  The still image data encoding unit 262 encodes the still image data transferred from the still image data signal processing unit 260 into, for example, a still image compression format such as JPEG. The still image data encoded by the still image data encoding unit 262 is then transferred to the metadata embedding unit 264.

  The metadata embedding unit 264, for the still image data encoded by the still image data encoding unit 262, includes metadata including position information and date / time information transferred from the still image data restoration determination unit 250 (FIG. 15 and FIG. 15). 16 (d)) is added.

  The still image data recording unit 266 records the still image data in which the position information and the date / time information are added by the metadata embedding unit 264 in the still image data storage unit 142.

(Still image data restoration process)
Next, details of the flow of processing for restoring still image data once erased in the imaging apparatus 100 of Modification 1 configured as described above will be described with reference to FIGS. 17 and 18. FIG. 17 is a flowchart illustrating an example of the flow of still image data erasing processing, and FIG. 18 is a flowchart illustrating an example of the flow of restoring processing of still image data once deleted.

  As can be seen by comparing the flowcharts of FIG. 17 and FIG. 14, in the imaging apparatus 100 of the first modification, after erasing still image data, the erasure history storage unit 252 performs the still image data erasing unit 184 in step 1700. Saves erased image information related to still images erased by. As described above, as the erased image information stored in the erased history storage unit 252, position information, date / time information, and the like are assumed, but any information that can associate the still image data with the moving image data is specified. It is not limited to the information. For example, the erasure history storage unit 252 may manage, as a database, information related to frame images of moving image data associated with erased still image data. In addition, the erasure history storage unit 252 manages information about erased still image data as erased image information by recording flag information or the like in a frame image of moving image data associated with the erased still image data. May be.

  In this way, the still image data restoration process shown in FIG. 18 is executed based on the erased image information stored when the still image data is erased. Note that the still image data restoration process shown in FIG. 18 is a process executed when, for example, the user instructs the still image data restoration process by operating a touch panel, an operation button, or the like (FIGS. 15 and 15). (G) in 16). Of course, the still image data restoration process shown in FIG. 18 may be executed with another event as a trigger. For example, the imaging apparatus 100 according to the first modified example automatically executes the still image data restoration process shown in FIG. 18 when the imaging apparatus 100 is connected to a personal computer or placed on a charging cradle. Also good.

  As for the still image data restoration processing, as shown in FIG. 18, in step 1800, the imaging apparatus 100 determines whether or not there is sufficient free space in the still image data storage unit 142 to restore still image data. Determine whether. If there is not enough free space in the still image data storage unit 142, the still image data cannot be restored, and the still image restoration process is terminated.

  On the other hand, if it is determined that there is sufficient free space in the still image data storage unit 142, the CPU (not shown) instructs the input unit 120 to start a restoration process of the still image data. After that, the moving image data reading unit 150 that has received the instruction via the input data storage unit 122 acquires erased image information related to still image data to be restored from the erase history storage unit 252 in step 1802 (FIGS. 15 and 16). (F)). The moving image data reading unit 150 reads moving image data associated with the erased still image data from the moving image data storage unit 124 based on the acquired erased image information, and transfers the moving image data to the moving image data separation unit 152.

  Thereafter, the moving image data is stored in the second moving image data temporary storage unit 158 via the moving image data separation unit 152, the moving image data decoding unit 154, and the like. Further, metadata including at least position information and date / time information recorded in the moving image data read by the moving image data reading unit 150 is still image data via the moving image data separation unit 152, the metadata processing unit 156, and the like. The data is transferred to the restoration determination unit 250.

  In step 1804, the still image data restoration determination unit 250 determines whether the moving image data read by the moving image data reading unit 150 includes the same frame image as the still image data to be restored. . The still image data restoration determination unit 250 compares the metadata transferred from the metadata processing unit 156 with the erased image information saved in the erase history saving unit 252, thereby making the same as the still image data to be restored. It can be determined whether or not the frame image is included in the moving image data.

  When the same frame image as the still image data to be restored is not included in the moving image data, the still image data cannot be restored. Accordingly, the still image data restoration determination unit 250 erases the erased image information related to the still image data stored in the erase history storage unit 252 in step 1812.

  On the other hand, when it is determined in step 1804 that the same frame image as the still image data to be restored is included in the moving image data, the imaging apparatus 100 of the first modification performs the processing of step 1806 and subsequent steps for the still image data. Perform the restoration process.

  Specifically, in step 1806, the still image data acquisition unit 258 extracts a target frame image from the moving image data stored in the second moving image data temporary storage unit 158 as still image data, and performs still image data signal processing. The data is transferred to the unit 260. Thereafter, the still image data signal processing unit 260 performs various image signal processes such as correction processing on the still image data transferred from the still image data acquisition unit 258, and then encodes the still image data. The data is transferred to the unit 262. In response, the still image data encoding unit 262 encodes the still image data transferred from the still image data signal processing unit 260 into a still image compression format such as JPEG.

  Next, in step 1808, the metadata embedding unit 264 appends metadata including at least GPS data transferred from the still image data restoration determination unit 250 to the encoded still image data.

  Next, in step 1810, the still image data recording unit 266 records the still image data in which the GPS data is additionally written in step 1808 in the still image data storage unit 142.

  Thereafter, in step 1814, the restoration process in steps 1800 to 1810 is performed until it is determined that the restoration process has been performed on the still image data corresponding to all the erased image information stored in the deletion history storage unit 252. Is executed.

  With the above processing, the imaging apparatus 100 according to the first modification can restore the still image data once deleted by the user based on the moving image data associated with the still image data. As a result, even if the user deletes the still image data deletion candidate presented by the above-described processing, the user can restore the still image data afterwards, so that the user can safely delete the still image data. Can do. That is, the imaging apparatus 100 according to the first modification can further improve usability regarding data erasure.

(6-2. Modification 2 (Additional Example of Another Still Image Deletion Candidate Selection Processing Function))
Next, a modification of the still image data erasure candidate selection process will be described. In the special erasure mode, the imaging apparatus 100 according to the above-described embodiment selects still image data recorded during recording or reproduction of moving image data as an erasure candidate because it can be restored again. In addition to the special erasure mode (hereinafter also referred to as the first special erasure mode), the imaging apparatus 100 according to the modified example 2 includes a function for selecting still image data erasure candidates in the second special erasure mode. Usability related to data erasure can be further enhanced. Hereinafter, the details of the imaging apparatus 100 of Modification 2 having such characteristics will be described.

  In the second special erasure mode, the imaging apparatus 100 according to Modification 2 records metadata including similar position information and date / time information among a plurality of still image data recorded in the still image data storage unit 142. Only still image data is selected as a deletion candidate. Usually, there is a high possibility that still image data shot at a location within a predetermined range within a predetermined time is similar still image data. In addition, such still image data may be assumed when the user has taken a plurality of times as insurance, or when the user has retaken the image due to a zooming or framing error. Therefore, the imaging apparatus 100 according to the second modification is characterized in that such still image data is selected as an erasure candidate and presented to the user. The details of the flow of still image data erasure candidate selection processing in the second special erasure mode by the imaging apparatus 100 according to the second modification will be described below.

  FIG. 19 is a flowchart illustrating an example of the flow of the still image data erasing process executed in step 822 illustrated in FIG. 8 in the imaging apparatus 100 according to the second modification. In the processing flow shown in FIG. 19, the same processes as those in the processing flow shown in FIG. 14 are denoted by the same reference numerals and are omitted in the following description. In the following description, processing in steps 1802 to 1818 executed when the second special erasing mode is selected by the user will be described in detail. That is, the process of selecting an erase candidate in the second special erase mode that is executed when it is determined in step 1900 shown in FIG. 19 that the user has not selected the first special erase mode will be described below.

  As illustrated in FIG. 19, in step 1902, the imaging apparatus 100 according to the second modification sorts a plurality of still image data recorded in the still image data storage unit 142 in order of recorded date and time. Here, the imaging apparatus 100 may manage the order in which a plurality of still image data recorded in the still image data storage unit 142 is recorded, using a database or the like. In any case, the imaging apparatus 100 is in a state in which still image data can be sequentially read from the still image data storage unit 142 in the order of recorded date and time.

  Next, in step 1904, the still image data reading unit 166 reads still image data recorded at the oldest date and time among the plurality of still image data recorded in the still image data storage unit 142.

  Next, in step 1906, the metadata reading unit 170 reads metadata from the still image data read in step 1904, and acquires GPS data including at least position information and date / time information from the metadata. The GPS data acquired by the metadata reading unit 170 in this way is transferred to the metadata processing unit 156.

  Next, in step 1908, the still image data reading unit 166 is recorded next to the still image data read in step 1904 among the plurality of still image data recorded in the still image data storage unit 142. Read still image data.

  Next, in step 1910, the metadata reading unit 170 reads metadata from the still image data read in step 1908, and acquires GPS data including at least position information and date / time information from the metadata. The GPS data acquired by the metadata reading unit 170 in this way is transferred to the metadata processing unit 156.

  Thereafter, in step 1912, the metadata processing unit 156 compares the GPS data transferred in step 1906 with the GPS data transferred in step 1910, and both still image data are at a date and time within a predetermined range. Judge whether it was recorded or not. For example, when two still image data are recorded within 5 seconds and are recorded at a position within 5 m, the metadata processing unit 156 selects both still image data as erasure candidates. As a result, the user can delete only the desired still image data from the similar still image data, and increase the free space of the still image data storage unit 142.

  The range of the position information and date / time information used for determination by the metadata processing unit 156 can be arbitrarily set / changed, and is not limited to the above example. When it is determined that the GPS data recorded in the two still image data is within the predetermined range, the metadata processing unit 156 transfers information regarding the still image data to the erasure candidate selection unit 157. In response to this, in step 1914, the erasure candidate selection unit 157 records and manages the information of the still image data in the erasure candidate database or the like.

  Thereafter, in step 1908, the still image data recorded next is read out from the still image data storage unit 142, and the still image data erasure candidate selection process is executed again by the same steps as described above. That is, in step 1916, the processing in steps 1908 to 1914 is continued until it is determined that the erasure candidate selection processing has been performed on all the still image data recorded in the still image data storage unit 142. To be executed.

  If it is determined in step 1916 that the erasure candidate selection process has been performed on all the still image data recorded in the still image data storage unit 142, the imaging apparatus 100 according to the modified example 2 Displays a list of still image data deletion candidates.

  As a result of the above, the imaging apparatus 100 according to Modification 2 deletes only still image data recorded at a position within a predetermined range and date / time from among a plurality of still image data recorded in the still image data storage unit 142. Can be selected as a candidate and presented to the user. Accordingly, the user can easily delete only unnecessary still image data from, for example, still image data captured a plurality of times for insurance or still image data captured a plurality of times due to a shooting mistake or the like. That is, the imaging apparatus 100 according to the second modification can further improve usability regarding data erasure.

  In the above description, the first special erasure mode and the second special erasure mode are set as different erasure modes, and the example in which the sorting process is executed in one of the erasure modes according to the selection by the user has been described. The invention is not limited to this. For example, in the special erasure mode, the imaging apparatus 100 may further execute the sorting process in the second special erasing mode after performing the sorting process in the first special erasing mode described above. As a result, the imaging apparatus 100 can select and present only still image data that is considered to be less important to the user from among the recoverable still images, and can further improve usability regarding data erasure. .

(7. Hardware Configuration of Imaging Device 100)
Next, an example of a hardware configuration of the imaging apparatus 100 having the above-described features will be described with reference to FIG. FIG. 24 is a block diagram illustrating an example of a hardware configuration of the imaging apparatus 100 according to one embodiment of the present invention.

  The imaging apparatus 100 mainly includes a CPU 901, a ROM 903, a RAM 905, a bridge 909, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, and a connection port 923. Consists of.

  The CPU 901 functions as an arithmetic processing device and a control device, and controls all or a part of the operation in the imaging device 100 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927. The ROM 903 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 905 primarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 907 constituted by an internal bus such as a CPU bus.

  The host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

  The imaging device 914 includes an optical system, an imaging device, an A / D (Analog to Digital) converter, a signal processing unit, and the like, and images a subject to generate image data. The moving image data and still image data generated by the imaging device 914 are displayed on the display device of the output device 917 or stored in the storage device 919 or the removable recording medium 927.

  The input device 915 is operation means operated by the user such as a touch panel, buttons, switches, and levers. The input device 915 may be, for example, remote control means (so-called remote control) that uses infrared rays or other radio waves.

  The output device 917 visually or audibly notifies the user of various types of information such as a display device such as a liquid crystal display device, a plasma display device, and an EL display device, and an audio output device such as a speaker and headphones. It is composed of devices that can. Note that the output device 917 functions as a display constituting the display unit 126 described above.

  The storage device 919 is a data storage device configured as an example of a storage unit of the imaging device 100. For example, the storage device 919 includes a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, or a magneto-optical storage device. Composed. The storage device 919 stores programs executed by the CPU 901, various data, moving image data, still image data, and the like. The storage device 919 may function as the moving image data storage unit 124 and the still image data storage unit 142 described above.

  The drive 921 is a recording medium reader / writer, and is built in or externally attached to the imaging apparatus 100. The drive 921 reads information recorded on a removable recording medium 927 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 905. Further, the drive 921 can write moving image data, still image data, and the like on the mounted removable recording medium 927. Note that the removable recording medium 927 may function as the moving image data storage unit 124 and the still image data storage unit 142 described above.

  The connection port 923 is a port for directly connecting to the external connection device 929 such as a USB port, an optical audio terminal, and an HDMI port. By connecting the external connection device 929 including the display device 130 described above to the connection port 923, the imaging device 100 can transfer moving image data and still image data to the external connection device 929.

  Heretofore, an example of a hardware configuration capable of realizing the function of the imaging apparatus 100 according to one embodiment of the present invention has been shown. In addition, each said component may be comprised using the general purpose member, and may be comprised by the hardware specialized for the function of each component. Therefore, the hardware configuration to be used can be changed as appropriate according to the technical level at the time of carrying out the present embodiment.

(8. Summary)
The details of the imaging apparatus 100 according to one embodiment of the present invention have been described above. As described above, the imaging apparatus 100 records GPS data including at least position information and date / time information for frame images and still image data of moving image data as related information for associating still image data and moving image data. be able to. By using such related information, the imaging apparatus 100 can determine whether still image data is recorded during recording or reproduction of moving image data. Thereby, when selecting the deletion candidate of moving image data, the imaging apparatus 100 selects only moving image data in which still image data is not recorded during recording or reproduction of moving image data as an deletion candidate, and prompts the user. Can be presented. Further, when selecting the erasure candidate for still image data, the imaging apparatus 100 may select only the still image data recorded during recording or reproduction of moving image data as the erasure candidate and present it to the user. it can.

  As a result, the user can easily select and delete only unimportant moving image data, or can easily select and temporarily delete still image data that can be restored later. That is, the imaging device 100 according to the embodiment of the present invention can improve usability regarding data erasure.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  For example, in the above embodiment, the imaging apparatus 100 has been described as an example of the image processing apparatus. However, the present invention is not limited to such an example, and may be a mobile phone, a PDA, a portable game device, or the like. . Further, the image processing apparatus according to the present invention does not necessarily have an imaging function as long as it has a storage area capable of storing still image data and moving image data. For example, the image processing apparatus according to the present invention may be a playback apparatus such as an HDD recorder, a DVD recorder, or a Bluray Disc (registered trademark) recorder, a personal computer, or the like. That is, the image processing apparatus according to the present invention includes a storage area capable of storing data, manages related information associating still image data and moving image data, and selects data as deletion candidates based on the related information. Any other function may be additionally provided as long as it is possible.

  In the above embodiment, GPS information including position information and date / time information has been described as an example of metadata recorded in moving image data and still image data. However, the present invention is not limited to these. . In addition, as examples of metadata recorded in moving image data and still image data, for example, direction, altitude, and the like are assumed, but the information is not limited to specific information. In other words, any metadata may be recorded in the moving image data and the still image data as long as it is related information that associates the moving image data and the still image data, and the imaging apparatus 100 can select the erasure candidate based on various metadata. A sorting process can be executed.

  In the above embodiment, the imaging apparatus 100 records the metadata including the position information and the date / time information in the moving image data and the still image data as the related information that associates the moving image data and the still image data. Further, the imaging apparatus 100 selects moving image data and still image data that are candidates for erasure by comparing the metadata of moving image data recorded in this way with the metadata of still image data. . However, the image processing apparatus according to the present invention only needs to have related information that associates moving image data and still image data, and the related information is not necessarily recorded in the moving image data or the still image data. . For example, the image processing apparatus according to the present invention may manage information related to moving image data having the same frame image as still image data in a database as related information. That is, the related information that associates the still image data with the moving image data is limited to a specific recording method and recording format as long as the information indicates which frame image of which moving image data corresponds to the still image data. It is not something.

  Further, in the processing flow in the above-described embodiment, for the sake of convenience of explanation, the example of performing the deletion candidate image selection process on all the image data recorded in the data storage unit has been described, but the present invention is limited to such an example. Is not to be done. In other words, when the erasure candidate image selection process is executed every time the user selects the special erasure mode, there is a possibility that the processing time becomes long and usability is lacking. Therefore, for example, the image processing apparatus according to the present invention can manage image data once selected as deletion candidates in a database, or set flag information for the image and manage it. As a result, the image processing apparatus according to the present invention can quickly execute the erasure candidate image selection process based on the database, flag information, and the like. That is, the image processing apparatus according to the present invention can also select image data that has been subjected to the deletion candidate image selection process as an deletion candidate image without executing the same process again. Thereby, the image processing apparatus according to the present invention can shorten the time required for the erasure candidate image selection process, and can further improve the usability.

  In addition, the display screens of the display unit 126 and the display device 130 shown in FIGS. 20 to 23 are examples for explaining the above-described mobile phone, and the present invention is not limited to these. In other words, the image processing apparatus according to the present invention can arbitrarily change the display screen, the display method, and the like by initial setting or setting change by the user. For example, the number of data to be erased to be displayed on the display screen at a time and the switching method between the normal erase mode and the special erase mode are not limited to a specific number or method. In addition, the image processing apparatus can naturally execute the processing flow according to the above-described flow diagram by appropriately changing and correcting the change in the number of displays and the switching method.

  Further, in the present specification, the steps described in the flow diagram or the sequence diagram are not necessarily processed in time series in parallel with the processes performed in time series in the order described, but in parallel or It also includes processes that are executed individually. Further, it goes without saying that the order can be appropriately changed even in the steps processed in time series.

It is a block diagram showing an example of functional composition of imaging device 100 concerning one of the embodiments of the present invention. FIG. 10 is a flowchart showing an example of a process flow in a recording mode in the imaging apparatus 100 according to the embodiment. FIG. 6 is a flowchart illustrating an example of a flow of a captured image display process in the imaging apparatus 100 according to the embodiment. FIG. 6 is a flowchart showing an example of a moving image data recording process in the imaging apparatus 100 according to the embodiment. FIG. 4 is a flowchart showing an example of a flow of still image data recording processing in the imaging apparatus 100 according to the embodiment. 2 is a block diagram illustrating an example of a functional configuration of the imaging apparatus 100 according to the embodiment. FIG. 2 is a block diagram illustrating an example of a functional configuration of the imaging apparatus 100 according to the embodiment. FIG. FIG. 10 is a flowchart showing an example of the overall flow of processing in the preview mode in the imaging apparatus 100 according to the embodiment. FIG. 6 is a flowchart showing an example of a moving image data list display process in the imaging apparatus 100 according to the embodiment. FIG. 10 is a flowchart showing an example of a flow of moving image data reproduction processing in the imaging apparatus 100 according to the embodiment. FIG. 6 is a flowchart showing an example of a flow of a still image data list display process in the imaging apparatus 100 according to the embodiment. FIG. 6 is a flowchart showing an example of a flow of a still image data reproduction process in the imaging apparatus 100 according to the embodiment. 5 is a flowchart illustrating an example of a flow of moving image data erasing processing in the imaging apparatus 100 according to the embodiment. FIG. FIG. 6 is a flowchart showing an example of a flow of erasure processing of still image data in the imaging apparatus 100 according to the embodiment. It is a block diagram showing an example of functional composition of modification 1 of imaging device 100 concerning the embodiment. It is a block diagram showing an example of functional composition of modification 1 of imaging device 100 concerning the embodiment. FIG. 10 is a flowchart illustrating an example of a flow of erasure processing of still image data in Modification Example 1 of the imaging apparatus 100 according to the embodiment. FIG. 11 is a flowchart illustrating an example of a flow of a still image data restoration process in Modification Example 1 of the imaging apparatus 100 according to the embodiment. 12 is a flowchart illustrating an example of a flow of a still image data erasing process in Modification 2 of the imaging apparatus 100 according to the embodiment. FIG. 4 is an explanatory diagram illustrating an example of a display screen in a preview mode in the imaging apparatus 100 according to the embodiment. FIG. 5 is an explanatory diagram illustrating an example of a display screen in a moving image reproduction mode in the imaging apparatus 100 according to the embodiment. FIG. 5 is an explanatory diagram illustrating an example of a display screen in a moving image normal erasing mode in the imaging apparatus 100 according to the embodiment. FIG. 5 is an explanatory diagram illustrating an example of a display screen in a moving image special erasure mode in the imaging apparatus 100 according to the embodiment. FIG. It is a block which shows an example of the hardware constitutions of the imaging device 100 which concerns on one of embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 102 Imaging part 104 Imaging data storage part 106 1st moving image data signal processing part 108 1st moving image data temporary storage part 110 Movie data encoding part 112 GPS information acquisition part 114 GPS data storage part 116 Animation data multiplexing part 118 Animation Data recording unit 120 Input unit 122 Input data storage unit 124 Video data storage unit 126 Display unit 128 Video data external output unit 130 Display device 132, 258 Still image data acquisition unit 134, 260 Still image data signal processing unit 136, 262 Still image Data encoding unit 138, 264 Metadata embedding unit 140, 266 Still image data recording unit 142 Still image data storage unit 150 Movie data reading unit 152 Movie data separating unit 154 Movie data decoding unit 156 Metadata processing unit 157 Erasing Supplementary selection unit 158 Second moving image data temporary storage unit 160 Selector 162 Moving image list generation unit 164 Moving image data selection unit 166 Still image data reading unit 168 Still image data decoding unit 170 Metadata reading unit 172 Still image data temporary storage unit 174 Still image List generation unit 176 Still image data selection unit 178 Image data signal processing unit 180 Image data temporary storage unit 181 Image data external output unit 182 Movie data deletion unit 184 Still image data deletion unit 250 Still image data restoration determination unit 252 Erase history storage unit 256 Still image data restoration processing unit

Claims (10)

A data storage unit for storing a plurality of moving image data and still image data;
A data reading unit for reading predetermined moving image data and still image data from the data storage unit;
Based on the related information associating the moving image data and the still image data, only the moving image data or still image data to be erased is selected from the plurality of moving image data and the still image data sequentially read by the data reading unit. An erasure candidate image selection processing unit to perform,
An image processing apparatus comprising: The erasure candidate image selection processing unit records still image data read by the data reading unit during recording or reproduction of the moving image data read by the data reading unit based on the related information. Determine whether or not
2. The image according to claim 1, wherein only moving image data that is determined not to record any still image data read by the data reading unit during recording or reproduction of the moving image data is selected as an erasure candidate. Processing equipment. The erasure candidate image selection processing unit further includes:
The image processing apparatus according to claim 2, wherein only still image data determined to be recorded during recording or reproduction of any moving image data read by the data reading unit is selected as an erasure candidate. The erasure candidate image selection processing unit becomes an erasure candidate from a plurality of the moving image data and the still image data sequentially read by the data reading unit based on related information associating the moving image data and the still image data. A first erasure candidate image selection process for selecting only moving image data or still image data;
A second erasure candidate image selection process for selecting all moving image data or still image data recorded in the data storage unit as erasure candidates;
The image processing apparatus according to claim 3, wherein the image processing device is executed by appropriately switching according to selection by the user. When still image data recorded in the data storage unit is erased, an erase history storage unit that stores erased image information related to the still image data;
A still image data restoration processing unit that restores the erased still image data based on the erased image information;
The image processing apparatus according to claim 4, further comprising: The deletion history storage unit stores the related information of the deleted still image data as the deletion image information,
6. The still image data restoration processing unit restores the erased still image data from a frame image of moving image data associated with the erased still image data based on the related information. Image processing apparatus. The related information is recorded in the frame image data and the still image data of the moving image data recorded in the data storage unit,
The erasure candidate image selection processing unit compares the related information recorded in the frame image data of the moving image data with the related information recorded in the still image data, thereby allowing the data reading unit to The image processing apparatus according to claim 6, wherein it is determined whether still image data read by the data reading unit is recorded during recording or reproduction of the read moving image data.   The image processing apparatus according to claim 7, wherein the related information includes at least position information and / or date / time information acquired by GPS. A data reading step of reading moving image data and still image data from a data storage unit for storing a plurality of moving image data and still image data;
A related information reading step of reading related information associating the moving image data and the still image data;
An erasure that selects only moving image data or still image data as an erasure candidate from the moving image data and still image data read by the data reading step based on the related information read by the related information reading step. A candidate image selection step;
An erasure candidate image selection method including: A data read process for reading moving image data and still image data from a data storage unit for storing a plurality of moving image data and still image data;
Related information read processing for reading related information associating the moving image data and the still image data;
An erasure that selects only moving image data or still image data as an erasure candidate from the moving image data and still image data read by the data reading processing based on the related information read by the related information reading processing Candidate image selection processing,
A deletion candidate image selection program for causing a computer to execute.

Images