JP2014060497A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device that, for example, when video data of a video file is partially deleted, is capable of reducing the possibility that a large part of the video data is erroneously deleted.SOLUTION: When a specified section is equal to or greater than a predetermined proportion with respect to video data of a video file, deletion means is controlled not to delete video data in the specified section, and when the specified section is smaller than the predetermined proportion with respect to the video data of the video file, the deletion means is controlled to delete video data in the specified section.

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  Conventionally, as an image processing apparatus, an editing apparatus capable of recording, reproducing, and editing a moving image is known. As these editing apparatuses, for example, as disclosed in Patent Document 1, an apparatus capable of performing editing to delete an arbitrary scene of a moving image is known.

JP 2000-165802 A

  However, in the editing apparatus disclosed in Patent Literature 1, when editing is performed to delete an unnecessary section of a moving image, most of the moving image may be deleted by mistake.

  Accordingly, an object of the present invention is to provide an image processing apparatus capable of reducing the possibility that most of moving image data is mistakenly deleted when, for example, moving image data of a moving image file is partially deleted. And

  In order to achieve such an object, the image processing apparatus of the present invention includes a reproducing unit that reproduces a moving image file recorded on a recording medium, and an erasing unit that erases moving image data in a specified section of the moving image file. When the specified section is equal to or greater than a predetermined ratio with respect to the moving image data of the moving image file, the erasing unit is controlled so as not to delete the moving image data of the specified section. And control means for controlling the erasing means so as to erase the moving image data in the designated section when the section is smaller than a predetermined ratio with respect to the moving image data of the moving image file.

  According to the present invention, for example, when moving image data of a moving image file is partially deleted, the possibility that most of moving image data is accidentally deleted can be reduced.

It is a figure which shows the structure of the imaging device of a present Example. It is a flowchart which shows control of the imaging device of digest movie mode. It is a figure for demonstrating the state of the still image file recorded by digest movie mode, and a moving image file. It is a figure which shows the example of the chapter information of a present Example. It is a figure which shows the operation | movement flow at the time of the moving image file selection of a present Example. It is a figure which shows the operation | movement flow at the time of the moving image file selection of a present Example. It is a figure which shows the format of the moving image file of a present Example.

  Hereinafter, examples of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the following embodiments. The following embodiments do not limit the invention according to the claims, and all combinations of features described in the embodiments are not necessarily essential to the solution means of the invention.

  Note that each functional block described in the present embodiment is not necessarily separate hardware. That is, for example, the functions of some functional blocks may be executed by one piece of hardware. In addition, the function of one functional block or the functions of a plurality of functional blocks may be executed by some hardware linked operations.

  In this embodiment, an image pickup apparatus will be described as an example of the image processing apparatus.

  The imaging apparatus 100 according to the present embodiment has an editing function for deleting moving image data in a specified section of a moving image file recorded on a recording medium. In the present embodiment, the moving image file includes moving image data corresponding to a plurality of chapters, and the imaging apparatus 100 can delete the moving image data of the section corresponding to the designated chapter. In the present embodiment, the moving image data includes at least a plurality of pieces of image data constituting each frame of the moving image, and may further include audio data corresponding to a predetermined number of image data, text data indicating the title of each chapter, and the like. .

  In the editing function of the imaging apparatus 100 according to the present embodiment, when an instruction to delete image data corresponding to a specified chapter is input, if the total number of chapters in the moving image file is greater than one, the specified chapter is specified. Delete the image data corresponding to. On the other hand, when an instruction to erase the image data corresponding to the designated chapter is input, if the total number of chapters in the moving image file is one or less, the image data corresponding to the designated chapter is not erased. To do.

  In addition, when deleting the moving image data of the section specified by the user without deleting each chapter, the ratio of the moving image data of the specified section to the moving image data of the entire moving image file is equal to or greater than a predetermined threshold value. In this case, do not delete the video data. On the other hand, when deleting the moving image data of the section specified by the user, the moving image data is deleted when the ratio of the moving image data of the specified section to the moving image data of the entire moving image file is smaller than a predetermined threshold.

  Hereinafter, such an imaging apparatus will be described.

  First, the overall configuration of the imaging apparatus 100 of the present embodiment will be described with reference to FIG.

  As illustrated in FIG. 1, the imaging apparatus 100 according to the present exemplary embodiment includes a CPU 101, a RAM 102, a ROM 103, and an operation unit 104. The imaging apparatus 100 includes an imaging unit 110, an image processing unit 111, a microphone unit 120, an audio processing unit 121, and a speaker unit 122. In addition, the imaging apparatus 100 includes an encoding / decoding processing unit 130, a display unit 140, a display control unit 141, a recording / playback unit 150, a recording medium 151, and a communication unit 160.

  CPU is an abbreviation for Central Processing Unit. RAM is an abbreviation for Random Access Memory.

  In the imaging apparatus 100 according to the present exemplary embodiment, the CPU 101 develops various programs recorded in the ROM 103 using the RAM 102 as a work memory, and controls each block of the imaging apparatus 100 according to the program. The operation unit 104 includes switches for inputting various operations such as a power button, a record button, a zoom adjustment button, an autofocus button, a menu display button, a mode switch, and a determination button. Further, any type of operation element such as a cursor key, a pointing device, a touch panel, and a dial may be used. The touch panel may be any of various types of touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method. . When the user operates these keys, buttons, and touch panel, the operation unit 104 transmits an operation signal to the CPU 101, and the CPU 101 performs control corresponding to the operation signal according to the program being executed. For example, there are selection of an icon displayed on the display unit 140, start of control corresponding to the selected icon, and the like. Examples of the icon include an end button, a return button, playback, pause, stop, fast forward, rewind, slow playback, and erase.

  The imaging unit 110 converts an optical image of a subject captured by a lens into an image signal using an imaging element such as a CCD sensor or a CMOS sensor by controlling a light amount by a diaphragm, and converts the obtained analog image signal into a digital image signal. And temporarily stored in the RAM 102. The digital image signal stored in the RAM 102 is then transmitted to the image processing unit 111. The image processing unit 111 performs an image quality adjustment process for adjusting the white balance, color, brightness, and the like of the digital image signal based on a setting value set by the user or a setting value automatically determined from the characteristics of the image. The digital image signal that has been processed is stored in the RAM 102 again. In addition, a digital image signal that has undergone image quality adjustment processing or an unprocessed digital image signal can be transmitted to a display control unit 141 described later and displayed on the display unit 140 as an image being captured. At the time of reproduction, the image processing unit 111 reads the image quality of the image data included in the still image file or the moving image file read from the recording medium 151 by the recording / reproducing unit 150 and decoded by the encoding / decoding processing unit 130. Make adjustments. Then, an image quality adjusted or unprocessed digital image signal can be transmitted to a display control unit 141 described later and displayed on the display unit 140 as an image.

  At the time of recording, the encoding / decoding processing unit 130 performs image compression processing on the digital image signal processed by the image processing unit 111 and stored in the RAM 102 to generate compressed moving image data and still image data. Then, a process of temporarily storing in the RAM 102 is performed. Further, at the time of reproduction, a process is performed in which the compressed moving image data and still image data of the image file read from the recording medium 151 is decoded to extract a digital image signal and stored in the RAM 102.

  For example, when generating moving image data, each frame of the moving image data is intra-frame encoded to generate compression-encoded moving image data. Moreover, you may produce | generate the moving image data compression-coded using the difference between several flame | frames of moving image data, a motion estimation, etc. For example, Motion JPEG, MPEG, H.264. H.264 (MPEG4-Part10 AVC), H.264. It is possible to generate moving image data of various compression encoding schemes such as H.265 / HEVC. In general, intra-frame encoded frame image data is referred to as an I picture, and inter-frame encoded image data using a difference from the front frame is referred to as a P picture, and the difference from the front and rear frames is used. The inter-frame encoded image data is called a B picture. These compression methods use well-known methods and are not related to the features of the present invention, so the description is omitted. Further, when generating still image data, a general compression encoding method such as JPEG is used, but these compression encoding methods use known methods and are not related to the features of the present invention. Therefore, explanation is omitted. The still image data may be so-called RAW image data in which the digital image signal obtained by the imaging unit 110 is recorded as it is.

  The microphone unit 120 includes, for example, an omnidirectional microphone built in the housing of the imaging apparatus 100 and an AD conversion unit. In the microphone unit 120, ambient sound is collected (collected) by the microphone, and the acquired analog sound signal is converted into a digital signal by the AD converter and temporarily stored in the RAM 102. The digital audio signal stored in the RAM 102 is then transmitted to the audio processing unit 121. At the time of recording, the audio processing unit 121 performs processing such as level optimization processing and noise reduction processing on the digital audio signal stored in the RAM 102, and stores the processed digital audio signal in the RAM 102 again. Moreover, the process which compresses an audio | voice signal is performed as needed. As for the audio compression method, a general audio compression method such as AC3 or AAC is used, and the description thereof will be omitted. Further, at the time of reproduction, a process for decoding the compressed audio data included in the audio file or the moving image file read from the recording medium 151 by the recording / reproducing unit 150, a process for optimizing the audio level, and the like are performed and sequentially stored in the RAM 102. Processing is also performed. The speaker unit 122 includes a speaker and a DA converter. In the speaker unit 122, the digital audio signal stored in the RAM 102 is read out by the audio processing unit 121 and converted into an analog audio signal, and audio is output from the speaker using the analog audio signal.

  The display unit 140 includes, for example, a liquid crystal panel and a backlight, and displays an image under the control of the display control unit 141. The display unit 140 is not limited to a liquid crystal display device, and may be any device that can provide an image to a user, such as an organic EL display or an LED display. The display control unit 141 displays an image on the display unit 140 based on the digital image signal processed by the image processing unit 111 and stored in the RAM 102.

  In the recording / reproducing unit 150, when recording a moving image, the compressed moving image data generated by the encoding / decoding processing unit 130, the audio data generated by the audio processing unit 121, the shooting date, and the like stored in the RAM 102 are stored. Along with various information, it is written in the recording medium 151 as a moving image file. At the time of recording a still image, the still image data stored in the RAM 102 is recorded on the recording medium 151 as a still image file together with various information such as the shooting date. When recording a moving image file on the recording medium 151, a data stream composed of compressed moving image data and audio data is formed and sequentially recorded on the recording medium 151, and a file header or the like is added to a file such as FAT or exFAT. Record a video file on a recording medium in a form that conforms to the format. Further, at the time of reproduction, a moving image file or a still image file recorded on the recording medium 151 is read according to the aforementioned file format. The read moving image file and still image file are analyzed for headers by the CPU 101, and compressed moving image data and still image data are extracted. The extracted compressed moving image data and still image data are stored in the RAM 102 and decoded by the encoding / decoding processing unit 130.

  Further, the recording medium 151 may be a recording medium built in the imaging apparatus or a removable recording medium. For example, the recording medium includes all types of recording media such as a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, and a flash memory. When using removable recording media, the recording / reproducing unit 150 includes a mechanism for loading and unloading the removable recording media.

  The communication unit 160 transmits and receives control signals, moving image files, still image files, various data, and the like to and from an external device different from the imaging device 100, and can be connected regardless of wired connection or wireless connection. It is. Note that any communication method may be used.

  Here, each of the image processing unit 111, the audio processing unit 121, the encoding / decoding processing unit 130, the display control unit 141, and the recording / reproducing unit 150 described above is a microcomputer in which a program for executing each of the functions described above is installed. It may be. Further, the program for executing the above-described processing recorded in the ROM 103 by the CPU 101 may be loaded into the RAM 102 and executed.

  Note that the imaging apparatus 100 according to the present exemplary embodiment records a moving image file in the “QuickTime (registered trademark) format” as an example, but any format may be used.

  In this embodiment, the file management system of the recording medium 151 will be described as using a FAT file system generally used in embedded devices. Since the technology of the FAT file system itself is widely known, only the characteristic operation of this embodiment will be described. Further, the NTFS format or the exFAT format which is a FAT file format may be used.

  Next, the operation of the imaging apparatus 100 according to the present embodiment will be described.

  The imaging apparatus 100 according to the present exemplary embodiment supplies power to each block of the imaging apparatus from a power supply unit (not illustrated) in response to an instruction to turn on the power by operating the operation unit 104 by the user. .

  When power is supplied, the CPU 101 determines whether the camera mode set by the operation unit 104 is a playback mode, a “digest movie mode”, a still image recording mode, or a moving image recording mode. In the present embodiment, the still image recording mode and the moving image recording mode are not related to the characteristic configuration, and thus description thereof is omitted.

  Next, the “digest movie mode” will be described with reference to the flowchart of FIG. The flowchart in FIG. 2 is a flowchart that starts when the digest movie mode is set, and is executed by the CPU 101 controlling each unit of the imaging apparatus 100 based on a program developed in the RAM 102. It is. In the present embodiment, whether or not to add the moving image data sequentially is determined after recording the still image and before recording the moving image data on the recording medium 151. That is, the CPU 101 reads out the moving image file that was last shot in the digest movie mode from the recording / playback unit 150 and confirms the information on the date when the movie was shot. If the read moving image file is taken on the same day, it is added. If it is taken on a different day, it is not added. The moving image shot in the digest movie mode is, for example, a file name obtained by sequentially incrementing a 4-digit integer in an identifier “MDG” for indicating that the moving image was shot in the digest movie mode. By doing in this way, it can be easily identified that the moving image having the largest number including the identifier MDG recorded on the recording medium 151 was taken last. In addition, when the captured moving image data is additionally written in response to the still image shooting instruction in the digest movie mode, it is recorded as a new chapter in the moving image file. That is, each time moving image data is linked, moving image data is recorded as a new chapter.

  In the present embodiment, the description will be made assuming that the thumbnail image is generated every time a still image shooting instruction is input. In this case, a plurality of thumbnail images are associated with the added moving image file. However, in the case of additional recording, a thumbnail image may be generated only when a moving image file is newly generated without generating a thumbnail image.

  When the digest movie mode is set by the operation unit 104, the CPU 101 controls each block of the imaging apparatus 100 and causes the following operations to be executed.

  First, the imaging unit 110 transmits the obtained digital image signal to the RAM 102 and temporarily stores it. Then, the display control unit 141 reads the digital image signal stored in the RAM 102 and causes the display unit 140 to display the digital image signal. The image processing unit 111 sequentially reads out the digital image signals stored in the RAM 102, performs the above-described various image quality adjustment processes, and stores the processed digital image signals in the RAM 102 again. The image processing unit 111 repeats this process every time an image is captured by the imaging unit 110.

  The encoding / decoding processing unit 130 performs an encoding process for encoding the digital image signal processed by the image processing unit 111 as moving image data (S201). For example, the encoding process includes Motion JPEG, MPEG, H.264, and so on. There are various well-known compression encoding system processes such as H.264 (MPEG4-Part10 AVC). In the present embodiment, for example, H.264. It is assumed that the encoding process is performed so that the moving image data includes an intra-frame predictive encoded image in H.264.

  At this time, the CPU 101 applies various adjustment processes to the digital audio signal input to the microphone unit in the audio processing unit 121, and then executes the encoding process according to a preset audio encoding method. The encoded audio signal obtained is stored in the RAM 102.

  Then, the encoding / decoding processing unit 130 and the audio processing unit 121 store the encoded moving image data and audio data in the RAM 102 (S202). In the following description, although explanation of audio data is omitted, it is assumed that it is processed together with moving image data.

  In the imaging apparatus 100 according to the present embodiment, the RAM 102 always stores the moving image data for the predetermined time immediately before the predetermined time among the moving image data stored in the RAM 102 so that the moving image data for the predetermined time is stored. The moving image data picked up at the time is deleted. For this reason, the CPU 101 determines whether or not moving image data for a predetermined time or more has been stored in the RAM 102 (S203), and if it has been stored for a predetermined time or longer (Yes in S203), at a point in time that is earlier than the predetermined time. The moving image data indicating the photographed image is discarded. Since the size of the data to be deleted is defined in encoding units, the size of the data to be deleted can be determined as a frame or a reproduction time depending on the encoding method. In addition, when it is not stored for a predetermined time or longer (No in S203), the moving image data is not discarded. In the present embodiment, the predetermined time may be any time, but may be selected by the user, for example, 4 seconds, 6 seconds, 8 seconds, or the like. Then, the CPU 101 determines whether or not a still image shooting instruction is input from the operation input unit 112 (S205). If a still image shooting instruction is not input (No in S205), the process returns to S201 again. The generation processing and temporary storage of moving image data are continued.

  In the present embodiment, it is assumed that moving image data for a predetermined time immediately before is always stored in the RAM 102, but the present invention is not limited to this. That is, the size of the moving image data stored in the RAM 102 may be anything that can be quantified, and may be a predetermined amount defined by, for example, the number of frames, the number of GOPs (Group Of Pictures), the data size, and the like. . In other words, when the moving image data stored in the RAM 102 is larger than the predetermined size, the moving image data is stored in the frames of the moving image data until the size becomes less than the predetermined size. The shooting time may be deleted in order from the oldest frame.

  When a still image shooting instruction is input (Yes in S205), the CPU 101 controls the recording / playback unit 150 to check the recordable capacity of the recording medium 151, and is temporarily stored in the RAM 102. It may be determined whether or not the moving image data can be recorded. This determination is made by comparing whether the sum of the size of the moving image data temporarily stored in the RAM 102 and the expected size of the still image data to be recorded is smaller than the recordable capacity of the recording medium 151. Determined. The expected size of the still image data may be 4 MB, for example, or may be changed according to the recording size, image quality, or the like.

  If it is determined that the moving image data and the still image data cannot be recorded on the recording medium 151, only the still image shooting may be performed and the moving image data may not be recorded.

  Also, when a still image shooting instruction is input in S205, if only a short amount of moving image data such as less than 1 second or less than 2 seconds is stored in the RAM 102, the still image shooting instruction is invalidated. You may make it. You may enable it to set a user image also during this time.

  Next, when a still image shooting instruction is input (Yes in S205), the CPU 101 causes the imaging unit 110 to perform shooting for still image data (S210). At this time, the CPU 101 causes the encoding / decoding processing unit 130 to decode the image of the first frame of the moving image data stored in the RAM 102 and execute the thumbnail image generation processing (S211). In this embodiment, the thumbnail image of the moving image data to be recorded is described as being generated from the image of the first frame. However, the present invention is not limited to this, and any of the frames of the moving image data to be recorded is used. It may be generated from an image of such a frame. That is, a thumbnail image using any frame of the moving image data stored in the RAM 102 may be generated when a still image shooting instruction is given. In this way, it is possible to generate a thumbnail of the moving image data without reading the moving image file from the recording medium after the file recording of the moving image data to the recording medium is finished once, so that the processing is quick. Become. If it is determined that a still image shooting instruction has been issued, the CPU 101 performs control so that the instruction is not accepted even if a still image shooting instruction is issued.

  Next, the CPU 101 determines whether or not the thumbnail image generation processing by the encoding / decoding processing unit 130 has been completed (S212). If the processing has been completed, next, the digital image captured in S210 is determined. In order to convert the image signal into still image data, the image processing unit 111 sequentially executes development processing and the encoding / decoding processing unit 130 sequentially executes encoding processing (S220). At this time, in parallel, the CPU 101 includes the thumbnail image generated by the thumbnail generation process in the header information of the encoded moving image data temporarily stored in the RAM 102 and records it on the recording medium 151 so as to record it. 150 is controlled (S221). Here, the still image development process (S220) is a “demosaic” process for creating a full-color image by complementing color information by collecting and giving missing color information from its surrounding pixels to each pixel during shooting. In addition to this, processing such as gamma correction and white balance adjustment may be included.

  When the above-described development processing is completed, the CPU 101 stores the developed digital image data in the RAM 102 again, causes the display control unit 141 to read it, and causes the display unit 140 to display it. This is a so-called “rec review” display in which a photographed image is displayed on the display unit 140 immediately after photographing with a digital camera. Incidentally, no image is displayed on the display unit 140 and a black image is displayed until the still image development process is completed after an instruction to shoot a still image is given. Alternatively, a display for presenting a status such as “processing” to the user may be displayed.

  When the development process is completed, the CPU 101 causes the encoding / decoding processing unit 130 to execute the encoding process according to a preset encoding method for still image recording. Next, the CPU 101 determines whether or not the still image development process and the encoding process have been completed (S222). If it is determined that the still image encoding process has been completed (Yes in S222), the CPU 101 sends the generated still image data to the recording / playback unit 150 to be recorded on the recording medium 151 (S223). Then, unless the user operates the operation input unit 102 to give an instruction to exit the digest movie mode (No in S224), the CPU 101 captures and encodes a moving image in parallel with recording a still image (S201). ). At this time, the CPU 101 causes the display control unit 141 to read out the digital image signal stored in the RAM 102 and displays the through image on the display unit 140 again.

  As described above, the imaging apparatus 100 according to the present exemplary embodiment records a moving image file and a still image file in the “digest movie mode”.

  Here, in the “digest movie mode” of the present embodiment, the newly captured video data (new video data) is added to the video data of the video file (existing video file) already recorded on the recording medium 151. An example of connection (additional writing) will be described. For example, if the date when the existing video file was recorded and the date when the new video data was acquired (the camera date setting at the time of shooting may be the same), the video data should be concatenated as shown in FIG. Recorded as shown. FIG. 3 shows the shooting timing and the recording state of the moving image file and the still image file.

  Still image files P1, P2, and P3 having the same shooting date are recorded in one folder (in the same folder) of the recording medium 151, and the moving image data stored in the RAM 102 immediately before shooting each still image is stored in the same folder. It is recorded as one linked moving image file. Further, P4 and P5 having shooting dates different from those of the still image files P1 to P3 are recorded in a folder different from the folder in which the still image file P1 is recorded. At this time, the moving image data stored in the RAM 102 immediately before shooting the still image file P4 is stored in the same folder as the shooting date of the still image file P4 even if the shooting date is changed in the middle of the moving image data. It shall be controlled to be recorded. That is, it is determined whether to link the moving image data or to newly save the moving image data, based on the date information at the timing when the shooting instruction is input.

  Further, in the present embodiment, it has been described that a thumbnail image corresponding to moving image data is generated every time a still image shooting instruction is input. However, for example, moving image data M1 generated at the time of shooting P1 still image data. The thumbnails corresponding to may be generated, and the thumbnail images of the M2 and M3 moving image data to be added may not be generated. In this way, it is possible to have one thumbnail image for each moving image file.

  In this embodiment, when recording is performed in the “digest movie mode” as described above, the moving image data is linked to the moving image file each time additional recording is performed. The image capturing apparatus 100 according to the present embodiment connects moving image file moving image data as another chapter each time an additional recording is performed. When connecting the moving image data, the CPU 101 stores management information (chapter management information) of each chapter in the file header of the moving image file recorded on the recording medium 151. FIG. 4 shows an example of chapter management information. For example, information on the start frame, end frame, start time, end time, title, and shooting position of each chapter is recorded in association with each other. That is, it is sufficient that at least moving image data corresponding to each chapter can be discriminated.

  Next, the file format of the moving image file recorded on the recording medium 151 will be described. FIG. 7 is a diagram for explaining the file format of the moving image according to the present embodiment.

  In this embodiment, the moving image file is recorded in the MOV format. In the MOV format, data recorded in a file is described in a data structure called “Atom” and recorded in the file in units of atoms. Each atom has a “Size field” and a “Type field”. The “Size field” is a 4-byte field that represents the data size of the entire atom including the Size field. The “Type field” is a 4-byte type identifier field indicating the kind of atom. In each atom, the fields after the “Type field” are optional depending on the atom, and the description thereof is omitted here. Further, it is possible to include other atoms in the atom, thereby realizing a nested structure. The moving image file recorded in the MOV format stores each atom in a structure as shown in FIG.

  As shown in FIG. 4, a moving image file in the MOV format has the following atoms.

  Ftyp (file type atom) 701 representing the type of file. A moov (movie atom) 702 that stores information about audio and video, including mvhd (movie header atom) 706 and trak (track atom) 707, 708, 709, which will be described later. Mdat (movie data atom) 703 that stores actual data such as voice, video, and text.

  The moov (movie atom) 702 stores the following atoms.

  Udta (user data atom) 704 in which arbitrary data is stored. A meta (metadata atom) 705 in which metadata such as the model name of the image capturing apparatus 100, position information of the image capturing apparatus 100 received by the communication unit 152, and UTC time are stored. An mvhd (movie header atom) 706 that stores the creation date / time, modification date / time, time scale, duration, etc. of the movie. Trak (track atom) 707 for video. An audio trak (track atom) 708. A trak (track atom) 709 for text.

  Note that the chapter management information in this embodiment is stored in the moov atom.

  Further, the following atoms are stored in each trak (track atom) 707 to 709.

  A tkhd (track header atom) 710 in which the creation date and time of the track, Duration (time interval between samples in a chunk to be described later), ID, and the like are stored. In this embodiment, the video track ID is 1, the audio track ID is 2, and the text track ID is 3. Tref 711 storing reference information between tracks. In the present embodiment, since the video track refers to the text track as a chapter, the video tref 711 describes 3 as the ID of the text track, and in order to refer to it as a chapter, describes “chap” as an identifier. Has been. The same applies to the audio track. In this embodiment, tref does not have to exist in the text track.

  Further, the following atoms are also stored in each trak (track atom) 707 to 709.

  A stsc (sample chunk atom) 712 that indicates how many samples (frames in the case of video) each chunk is composed of. In this embodiment, it is assumed that all video chunks are composed of 1 chunk = 1 sample (frame). A stts (synchronous sample atom) 713 storing the number of samples and the time interval (Duration) between each sample. Stsz (sample size atom) 714 storing the data size of each sample. Stco (chunk offset) 715 storing the file offset of each chunk.

  The following atoms are stored in mdat (movie data atom) 703 in which actual data such as audio, video, and text is stored.

  Text chunks 716 and 717 storing the title of each chapter as text data. In the text chunks 716 and 717, data indicating the data size (hexadecimal number) of the text data that follows is stored in the first area. Text data is stored in the text data area in ASCII code. In this embodiment, the shooting time when a still image was shot in the “digest movie mode” is described as text data. In other words, in the “digest movie mode”, when there is an instruction to shoot a still image at 12:34:56, the moving image recorded on the recording medium corresponds to 12:34:52 to 12:34:56. It is a video to be. However, text data corresponding to 12:34:56 when a still image shooting instruction is given is written as text data of a text chunk indicating the title of the chapter of the moving image.

  In addition, the following atoms are also stored in mdat (movie data atom) 703 in which actual data such as voice, video, and text is stored.

  Audio data chunks 718, 719. Video data chunks 720, 721, 722, etc. In FIG. 7, alphabets indicate the types of pictures. That is, it indicates either an I picture that has been subjected to intraframe prediction encoding, a P picture that has been subjected to interframe prediction encoding for forward prediction, or a B picture that has been subjected to interframe prediction encoding for bidirectional prediction. In the present embodiment, I is added because it is an I picture that has been intra-frame prediction encoded. Further, the alphabetic subscript number represents the frame number from the beginning. That is, the video data chunk 720 indicates that the first frame is an I picture (intra-frame predictive coded picture).

  Here, the data storage state of the mdat atom 703 will be described.

  As described above, the mdat atom 703 stores text chunks, audio chunks, and video chunks. In the present embodiment, one audio chunk and 15 video chunks are stored as a set. This is recorded in this way so that 0.5 seconds of audio data corresponds to 15 frames of video. However, the storage method is not limited to this method. Furthermore, text chunks 716 and 717 are stored for each chapter as in this embodiment. This corresponds to one text chunk per chapter. That is, when shooting is repeated in the “digest movie mode” as in this embodiment, a text chunk is stored in the mdat atom every time shooting is performed. A text chunk corresponds to one chapter. In addition, a text chunk sample playback interval (Duration) is also stored in the text stts atom of the text trak atom.

  Movie files are recorded in this format.

  Therefore, for example, when accessing an arbitrary video frame, audio data, or chapter in mdat, information stored in stsz 714 and stco 715 of moov 702 may be used.

  Next, the playback mode will be described. The imaging apparatus 100 according to the present embodiment can delete moving image data corresponding to a chapter of a moving image file in the reproduction mode. In the present embodiment, the “digest movie mode” has been described as adding a chapter to a moving image file. However, chapters in the following description are not limited to chapters added in the “digest movie mode”, but may be chapters added by the moving image recording mode or other devices.

  The imaging apparatus 100 according to the present embodiment displays a list screen of still image files and moving image files on the display unit 140 in the reproduction mode. The list screen displays a list screen of only still image files, a list screen of only moving image files, a list screen in which still image files and moving image files are mixed, and the like. Then, the designated still image file is reproduced, and the image of the still image file is displayed on the display unit 140.

  Then, the CPU 101 reproduces the selected moving image file or still image file from the recording medium in accordance with an operation on the operation unit 104 by the user, and displays a corresponding image on the display unit 140.

  When the still image file is selected, the CPU 101 controls the recording / reproducing unit 150 to read out the image data of the still image file from the recording medium 151. Then, the encoding / decoding processing unit 130 is controlled so as to decode the reproduced image data, and the display control unit 141 is controlled so as to be displayed on the display unit 140.

  When a moving image file is selected, the CPU 101 controls the recording / reproducing unit 150 so as to read image data corresponding to the initial frame from the image data of the still image file from the recording medium 151. Then, the encoding / decoding processing unit 130 is controlled so as to decode the reproduced image data, and the display control unit 141 is controlled so as to be displayed on the display unit 140. The initial frame may be the first frame of the moving image data of the moving image file or the frame that was displayed when the previous reproduction was finished. When an instruction to start reproduction is input from the operation unit 104, the CPU 101 reads image data corresponding to the frames from the recording medium 151 in order from the initial frame and displays them on the display unit 140.

  Further, when a moving image file is selected and a desired frame image is displayed on the display unit 140, the CPU 101 controls the display control unit 141 to display an operation panel on the display unit 140. This operation panel includes an icon indicating deletion of a chapter to which the displayed frame image belongs. In response to selection of this icon, the CPU 101 displays moving image data corresponding to the chapter to which the frame image belongs. to erase. That is, a frame image or a chapter is designated by displaying a frame image belonging to the chapter to be erased.

  Next, the operation when a desired moving image file is selected in the playback mode will be described with reference to FIG. Note that the processing shown in the flowchart of FIG. 5 is processing that is executed by the CPU 101 controlling each unit of the imaging apparatus 100 based on a program developed in the RAM 102. Further, the operation by the user is an operation input by the user operating the operation unit 104.

(S501)
The CPU 101 controls the recording / playback unit 150 to read the file header of the selected moving image file from the recording medium 151, and temporarily stores the read file header in the RAM 102.

(S502)
Next, the CPU 101 causes the display unit 140 to display an image of an initial frame of the selected moving image file. For this purpose, the CPU 101 specifies the file offset and data size of the image data corresponding to the initial frame from the file header stored in the RAM 102, and controls the recording / reproducing unit 150 to read the specified image data from the recording medium 151. To do. Then, the CPU 101 controls the encoding / decoding processing unit 130 to decode the read image data, and controls the display control unit 141 to display the decoded image data on the display unit 140.

(S503)
Next, the CPU 101 controls the display control unit 141 to display an operation panel including an icon indicating an operation on the selected moving image file on the display unit 140. Icons indicating operations on the moving image file include icons indicating “play”, “file deletion”, “chapter deletion”, and the like. “Playback” is an operation for sequentially playing back frame images of a moving image file. “Delete file” is an operation for deleting a selected moving image file. “Chapter deletion” is an operation of deleting moving image data corresponding to each chapter of the moving image file. The CPU 101 executes control corresponding to each operation. In addition, the operation panel also has icons indicating operations such as “fast forward”, “rewind”, “slow playback”, etc., but these operations are not related to the characteristic configuration, so the explanation is omitted. To do. Note that a “return” icon may be displayed on the operation panel. When the “return” icon is selected, the CPU 101 controls the display control unit 141 to display the moving image file list screen again. . That is, the moving image playback process ends.

(S511)
Next, the CPU 101 determines whether the icon indicating “play” on the operation panel has been operated. If the icon indicating “play” on the operation panel is operated, the process proceeds to S512. On the other hand, when the icon indicating “play” on the operation panel is not operated, the process proceeds to S521.

(S512)
When the icon indicating “play” on the operation panel is operated (Yes in S511), the CPU 101 causes the display unit 140 to display frame images in order from the initial frame. That is, the CPU 101 controls the recording / reproducing unit 150 to sequentially read image data corresponding to each frame from the recording medium 151, and controls the encoding / decoding processing unit 130 to sequentially decode the read image data. To do. Then, the CPU 101 controls the display control unit 141 so that the decoded image data is sequentially displayed on the display unit 140. The interval between reading, decoding and display is the time per sample described in the stts atom of the trak atom. That is, if it is 30 frames per second, this control is performed at intervals of 0.033 seconds.

(S513)
Next, the CPU 101 determines whether or not a pause operation for the moving image file being played is input from the operation unit 104. If a pause operation has been performed, the process proceeds to S503 with the frame image displayed when the pause operation was performed displayed on the display unit 140. If the pause operation has not been performed, the process proceeds to S514.

(S514)
If the pause operation has not been performed during the video playback (No in S513), has the CPU 101 completed playback of the video data of the selected video file to the end or whether a playback end operation has been input from the operation unit 104? Determine. If the reproduction is finished, the moving image reproduction process is terminated, and the display control unit 141 is controlled to display the moving image file list screen again. If the reproduction has not ended, the process proceeds to S512.

(S521)
On the other hand, when the icon indicating “play” on the operation panel is not operated (No in S511), the CPU 101 determines whether the icon indicating “delete file” on the operation panel is operated. If the icon indicating “delete file” is operated, the process proceeds to S522. If the icon indicating “delete file” is not operated, the process proceeds to S531.

(S522)
When the icon indicating “delete file” on the operation panel is operated (Yes in S521), the CPU 101 controls the display control unit 141 to display a screen for inquiring whether the deletion can be executed on the display unit 140. Then, the CPU 101 determines whether execution of deletion is instructed. If deletion is instructed, the process proceeds to S523. If deletion is not instructed, the process proceeds to S503.

(S523)
When execution of deletion is instructed (Yes in S522), the CPU 101 controls the recording / playback unit 150 to delete the selected moving image file from the recording medium 151. Then, the moving image reproduction process is terminated, and the display control unit 141 is controlled to display the moving image file list screen again.

(S531)
On the other hand, when the icon indicating “file deletion” on the operation panel is not operated (No in S521), the CPU 101 determines whether the icon indicating “chapter deletion” on the operation panel is operated. When the icon indicating “Erase chapter” is operated, the process proceeds to S532. If the icon indicating “chapter deletion” is not operated, the process proceeds to S503.

(S532)
When the icon indicating “chapter deletion” is operated (Yes in S531), the CPU 101 reads the chapter management information stored in the file header of the moving image file stored in the RAM 102. As shown in FIG. 4, the chapter management information includes information such as the start frame, end frame, start time, and end time of each chapter, as well as chapter numbers and the like. The CPU 101 confirms the total number of chapters of the moving image file based on the chapter management information. Then, the CPU 101 determines whether or not the total number of chapters is greater than 1. If the total number of chapters is greater than 1, the process proceeds to S533. If the total number of chapters is 1 or less, the process proceeds to S536. To do. In this embodiment, it is determined whether or not the total number of chapters is greater than 1. However, a predetermined threshold other than 1 may be used. For example, when the total number of chapters is greater than 4, the process may proceed to S533, and when the total number of chapters is 4 or less, the process may proceed to S536.

(S533)
When the total number of chapters is larger than 1 (Yes in S532), the CPU 101 causes the display control unit 141 to display a screen for inquiring whether to erase the chapter to which the frame currently displayed on the display unit 140 belongs. Control. Then, the CPU 101 determines whether execution of erasure has been instructed. If execution of erasure is instructed, the process proceeds to S534. If deletion is not instructed, the process proceeds to S503.

(S534)
When the execution of erasure is instructed (Yes in S533), the CPU 101 executes erasure of the moving image data corresponding to the chapter to which the currently displayed frame belongs. This process is executed according to the following procedure. First, the chapter to which the currently displayed frame belongs is specified based on the currently displayed frame and the chapter management information stored in the file header of the moving image file. That is, the frame temporarily suspended by the user is the designated frame, and the chapter specified to belong to the designated frame is the designated chapter. Then, the moving image data (text chunk, audio chunk, video chunk in FIG. 7) corresponding to the designated chapter is erased from the recording medium 151. As shown in FIG. 7, the moving image data in the section corresponding to the chapter includes one text chunk corresponding to each chapter. Therefore, first, the file offset at the beginning of the text chunk is acquired from the stco atom of the trak atom for video. Then, the last frame number of the chapter to be erased is specified from the chapter management information stored in the file header of the moving image file. Then, the file offset of the video chunk storing the image data of the final frame of the chapter to be erased is acquired from the stco atom of the video trak atom, and the data size of the final frame is acquired from the stsz atom. Get file offset. As a result, the first file offset and the last file offset of the moving image data corresponding to the chapter are acquired. In this way, it is possible to obtain the start file offset and end file offset of the moving image data (text chunk, audio chunk, video chunk) of the chapter to be erased. Then, the cluster chain of the file system is updated so as to skip the data in the meantime, and the information such as the file offset to each data of the moov atom is updated according to the deleted data amount.

(S535)
Next, the CPU 101 controls the recording / reproducing unit 150 so as to read the image data corresponding to the first frame of the chapter next to the erased chapter from the recording medium 151 so as to decode the read image data. The encoding / decoding processing unit 130 is controlled. Then, the display control unit 141 is controlled to display the decoded image data on the display unit 140. When the chapter to be erased is the last chapter, the display unit 140 displays image data corresponding to the first frame of the moving image file. Then, the CPU 101 shifts the process to S503.

(S536)
On the other hand, when the total number of chapters is 1 or less in the processing of S532 (No in S532), the CPU 101 controls the display control unit 141 to display an image indicating that erasing cannot be performed on the display unit 140. That is, even if the CPU 101 receives an instruction to erase a chapter (designated chapter) to which the designated frame belongs, if the total number of chapters is 1 or less, the CPU 101 performs control so as not to erase (deletion is performed). Control to prohibit).

  As described above, when the total number of chapters of the moving image file is equal to or smaller than the predetermined threshold, the imaging apparatus 100 according to the present embodiment performs control so as not to delete the moving image data in the section corresponding to the specified chapter. When the total number of chapters of the moving image file exceeds a predetermined threshold, control is performed so as to delete the moving image data in the section corresponding to the designated chapter.

  In this way, when receiving an instruction to erase most of the video data in the video file, control is performed so that the video data in the video file is not erased. The possibility that most of the moving image data is erased can be reduced. In particular, as in this embodiment, when recording is performed in the “digest movie mode”, it is possible to prevent the additional moving image file from being erased unintentionally and being unable to be additionally written.

  In the present embodiment, a case has been described in which an instruction to delete a chapter corresponding to a frame displayed on the display unit 140 is input. However, after selecting a moving image file, a chapter list may be displayed and a chapter to be erased may be designated in accordance with an operation such as a function key.

  In addition, a plurality of chapters may be designated as deletion targets. Also in this case, deletion of moving image data may be prohibited when the total number of chapters of the moving image file is equal to or less than a predetermined threshold. Further, when a plurality of chapters can be designated as erasure targets, erasure may be prohibited when the designated number of chapters is equal to or greater than a predetermined ratio with respect to the total number of chapters of the moving image file. That is, erasure is prohibited when (total number of chapters) / (number of chapters to be erased) is larger than a predetermined threshold. For example, the predetermined threshold value may be 100% or 50%, and may be arbitrarily designated by the user. In addition, when multiple chapters can be specified as erasure targets, the playback time or number of frames of the video data in the section corresponding to the specified chapter is calculated, and a predetermined ratio to the total playback time or total number of frames of the video file If this is the case, erasure may be prohibited. That is, erasure is prohibited when (total reproduction time) / (reproduction time of chapter to be erased) is greater than a predetermined threshold. Alternatively, erasure is prohibited when (total number of frames) / (number of chapter frames to be erased) is larger than a predetermined threshold. For example, the predetermined threshold may be 100% or 50%, and may be arbitrarily designated by the user.

  In this embodiment, the deletion of the moving image data corresponding to the designated chapter has been described. However, the moving image data in the section specified by the user's operation may be deleted. In this case, the CPU 101 does not erase the moving image data when the ratio of the reproduction time of the moving image data to be deleted to the reproduction time of the moving image data of the entire moving image file is equal to or greater than a predetermined threshold instead of the number of chapters. To control. For example, when the reproduction time of the moving image data of the entire moving image file is 10 minutes and the reproduction time of the moving image data to be erased is 8 minutes, 80% is deleted. If the predetermined threshold value is 50%, it exceeds this value, so the CPU 101 does not erase the moving image data to be erased. The predetermined threshold can also be set to 100%. If the ratio is smaller than the predetermined threshold, the moving image data is deleted. Note that the moving image data to be deleted may not be deleted based on the ratio of the data amount of the moving image data to the data amount of the entire moving image file, not the reproduction time. That is, the deletion target moving image data may not be deleted in accordance with the ratio of the deletion target moving image data to the moving image file.

  In this embodiment, when the total number of chapters in the video file is less than or equal to the predetermined number, the video data is controlled not to be erased. However, after displaying a screen for inquiring whether the video data can be erased. If deletion is instructed, the deletion may be performed.

  Also, it is controlled not to delete the video data to be deleted based on the total number of chapters, or to control not to delete the video data to be deleted based on the ratio of the video data to be deleted to the video file, You may make it switch.

  In this embodiment, the image pickup apparatus has been described as an example. However, the present invention can be applied as long as the editing process for deleting a part of the moving image data of the moving image file can be executed as in the present embodiment. For example, it may be a computer, a tablet terminal, a smartphone, a mobile phone, a television, or the like. A program for causing a computer to execute the deletion process of this embodiment is also included in the concept of the present invention.

  Also in this embodiment, an image pickup apparatus will be described as an example of the image processing apparatus.

  When erasing moving image data corresponding to a specified chapter, the image pickup apparatus according to the present embodiment performs erasure if a highly relevant chapter exists, and if no highly relevant chapter exists. Prohibit erasure. In this embodiment, highly relevant chapters are chapters corresponding to moving image data shot within a predetermined time from a shooting time of moving image data of a specified chapter or within a predetermined range from a shooting position.

  The image pickup apparatus of the present embodiment performs the same operation as that of the image pickup apparatus 100 of the first embodiment except for the operation in the reproduction mode, and the block configuration is the same as FIG. Therefore, description will be made using the block configuration of FIG.

  The description of the block configuration and the description of the “digest movie mode” are the same as those in the first embodiment, and thus the description thereof is omitted.

  Next, the operation when a desired moving image file is selected in the playback mode of this embodiment will be described with reference to FIG. Note that the process shown in the flowchart of FIG. 6 is a process executed by the CPU 101 controlling each unit of the imaging apparatus 100 based on a program developed in the RAM 102. Further, the operation by the user is an operation input by the user operating the operation unit 104.

(S601)
The CPU 101 controls the recording / playback unit 150 to read the file header of the selected moving image file from the recording medium 151, and temporarily stores the read file header in the RAM 102.

(S602)
Next, the CPU 101 causes the display unit 140 to display an image of an initial frame of the selected moving image file. For this purpose, the CPU 101 specifies the file offset and data size of the image data corresponding to the initial frame from the file header stored in the RAM 102, and controls the recording / reproducing unit 150 to read the specified image data from the recording medium 151. To do. Then, the CPU 101 controls the encoding / decoding processing unit 130 to decode the read image data, and controls the display control unit 141 to display the decoded image data on the display unit 140.

(S603)
Next, the CPU 101 controls the display control unit 141 to display an operation panel including an icon indicating an operation on the selected moving image file on the display unit 140. Icons indicating operations on the moving image file include icons indicating “play”, “file deletion”, “chapter deletion”, and the like. “Playback” is an operation for sequentially playing back frame images of a moving image file. “Delete file” is an operation for deleting a selected moving image file. “Chapter deletion” is an operation of deleting moving image data corresponding to each chapter of the moving image file. The CPU 101 executes control corresponding to each operation. In addition, the operation panel also has icons indicating operations such as “fast forward”, “rewind”, “slow playback”, etc., but these operations are not related to the characteristic configuration, so the explanation is omitted. To do. Note that a “return” icon may be displayed on the operation panel. When the “return” icon is selected, the CPU 101 controls the display control unit 141 to display the moving image file list screen again. . That is, the moving image playback process ends.

(S611)
Next, the CPU 101 determines whether the icon indicating “play” on the operation panel has been operated. If the icon indicating “play” on the operation panel is operated, the process proceeds to S612. On the other hand, if the icon indicating “play” on the operation panel is not operated, the process proceeds to S621.

(S612)
When the icon indicating “play” on the operation panel is operated (Yes in S611), the CPU 101 causes the display unit 140 to display frame images in order from the initial frame. That is, the CPU 101 controls the recording / reproducing unit 150 to sequentially read image data corresponding to each frame from the recording medium 151, and controls the encoding / decoding processing unit 130 to sequentially decode the read image data. To do. Then, the CPU 101 controls the display control unit 141 so that the decoded image data is sequentially displayed on the display unit 140. The interval between reading, decoding and display is the time per sample described in the stts atom of the trak atom. That is, if it is 30 frames per second, this control is performed at intervals of 0.033 seconds.

(S613)
Next, the CPU 101 determines whether or not a pause operation for the moving image file being played is input from the operation unit 104. When the pause operation is performed, the process proceeds to S603 with the frame image displayed when the pause operation is performed displayed on the display unit 140. If the pause operation has not been performed, the process proceeds to S614.

(S614)
If the pause operation has not been performed during the playback of the video (No in S613), has the CPU 101 completed playback of the video data of the selected video file, or has the playback end operation been input from the operation unit 104? Determine. If the reproduction is finished, the moving image reproduction process is terminated, and the display control unit 141 is controlled to display the moving image file list screen again. If it is not the end of reproduction, the process proceeds to S612.

(S621)
On the other hand, when the icon indicating “play” on the operation panel is not operated (No in S611), the CPU 101 determines whether the icon indicating “delete file” on the operation panel is operated. If the icon indicating “delete file” is operated, the process proceeds to S622. If the icon indicating “delete file” is not operated, the process proceeds to S631.

(S622)
When the icon indicating “delete file” on the operation panel is operated (Yes in S621), the CPU 101 controls the display control unit 141 to display a screen for inquiring whether the deletion can be executed on the display unit 140. Then, the CPU 101 determines whether execution of deletion is instructed. If deletion is instructed, the process proceeds to S623. If deletion is not instructed, the process proceeds to S603.

(S623)
When execution of deletion is instructed (Yes in S622), the CPU 101 controls the recording / playback unit 150 to delete the selected moving image file from the recording medium 151. Then, the moving image reproduction process is terminated, and the display control unit 141 is controlled to display the moving image file list screen again.

(S631)
On the other hand, when the icon indicating “file deletion” on the operation panel has not been operated (No in S621), the CPU 101 determines whether the icon indicating “chapter deletion” on the operation panel has been operated. If the icon indicating “chapter deletion” is operated, the process proceeds to S632. If the icon indicating “chapter deletion” is not operated, the process proceeds to S603.

(S632)
When the icon indicating “chapter deletion” is operated (Yes in S631), the CPU 101 reads the chapter management information stored in the file header of the moving image file stored in the RAM 102. As shown in FIG. 4, the chapter management information includes information such as the start frame, end frame, start time, and end time of each chapter, as well as chapter numbers and the like. The CPU 101 identifies the chapter to which the currently displayed frame belongs based on the chapter management information. This identified chapter is a chapter to be erased in the present embodiment. The CPU 101 acquires the shooting time of the moving image data of the chapter to be erased from the shooting time information described in the chapter management information or the text chunk of the moving image data corresponding to the chapter.

(S633)
Next, the CPU 101 acquires the shooting time of another chapter from the shooting time information described in the chapter management information or the text chunk of the moving image data corresponding to each chapter, and the shooting time of the moving image data of the designated chapter. Compare with And it determines with the chapter corresponding to the moving image data image | photographed within the predetermined time from the imaging | photography time of the moving image data of the designated chapter being a relevant chapter. In this embodiment, for example, the predetermined time is within 1 minute. In this embodiment, if the shooting interval in the “digest movie mode” is within one minute, the shooting interval is also within one minute. For example, in FIG. 4, it can be seen from the information described in the chapter titles of chapter numbers 2 and 3 that the shooting interval is 41 seconds. Therefore, when chapter 2 is designated, it is determined that chapter 3 is a related chapter with respect to moving image data of chapter 2. In the present embodiment, an example is shown in which information generated from the shooting time is used as the chapter title.

(S634)
Next, the CPU 101 determines whether there is a chapter determined to be related to the specified chapter (a chapter whose shooting time is within a predetermined time). If there is a chapter determined to be related to the designated chapter, the CPU 101 proceeds to S635, and if there is no chapter determined to be related, the process proceeds to S638. In this embodiment, it is determined whether the chapter determined to be related is `` present '' or `` not '', but depending on whether the number of chapters determined to be related is `` more '' or `` less '' than a predetermined number, It may be determined whether the process of S635 is performed or the process of S638 is performed.

(S635)
When there is a chapter determined to be related (Yes in S634), the CPU 101 displays a screen asking whether to delete the chapter to which the frame currently displayed on the display unit 140 belongs. The controller 141 is controlled. Then, the CPU 101 determines whether execution of erasure has been instructed. If execution of erasure is instructed, the process proceeds to S636. If deletion is not instructed, the process proceeds to S603.

(S636)
When execution of erasure is instructed (Yes in S635), the CPU 101 executes erasure of moving image data corresponding to the chapter to which the currently displayed frame belongs (designated chapter). This process is executed according to the following procedure. First, the chapter to which the currently displayed frame belongs is specified based on the frame number of the currently displayed frame and the chapter information indicating the relationship between each chapter and the frame. Then, the moving image data (text chunk, audio chunk, video chunk in FIG. 7) corresponding to the specified chapter is erased from the recording medium 151. As shown in FIG. 7, moving image data corresponding to chapters includes one text chunk corresponding to each chapter. Therefore, first, the file offset of the text chunk is acquired from the stco atom of the trak atom for video. Then, the file offset of the video chunk storing the image data of the last frame of the chapter to be erased is acquired from the stco atom of the video trak atom, and the data size of the final frame is acquired from the stsz atom, and the end of the video chunk is acquired. Get file offset. As a result, the first file offset and the last file offset of the moving image data corresponding to the chapter are acquired. Then, the cluster chain of the file system is updated so as to skip the data in the meantime, and the information such as the file offset to each data of the moov atom is updated according to the deleted data amount.

(S637)
Next, the CPU 101 controls the recording / reproducing unit 150 so as to read the image data corresponding to the first frame of the next chapter of the chapter to be erased from the recording medium 151, and decodes the read image data. The encoding / decoding processing unit 130 is controlled. Then, the display control unit 141 is controlled to display the decoded image data on the display unit 140. When the chapter to be erased is the last chapter, the display unit 140 displays image data corresponding to the first frame of the moving image file. Then, the CPU 101 shifts the process to S603.

(S638)
On the other hand, when there is no chapter determined to be related in the process of S634 (No in S634), the CPU 101 controls the display control unit 141 to display an image indicating that erasure cannot be performed on the display unit 140.

  As described above, when there is no chapter corresponding to the moving image data shot within a predetermined time from the shooting time of the designated chapter, the imaging apparatus 100 according to the present embodiment deletes the moving image data corresponding to the designated chapter. Control not to. When there is a chapter corresponding to the moving image data shot within a predetermined time from the shooting time of the specified chapter, the moving image data corresponding to the specified chapter is controlled to be deleted.

  In this way, when there is a predetermined number of moving image data that may be similar to the moving image data to be deleted, the moving image data to be deleted is deleted. If there is no predetermined number of moving image data that may be similar to the moving image data to be deleted, the moving image data to be deleted is not deleted. Can be. In other words, when most of the necessary scenes are deleted, the video data in the video file is controlled not to be erased, so most of the video data is deleted by the operation intended to delete a part of the video. The possibility of being erased can be reduced. Further, in particular, when recording is performed in the “digest movie mode” as in the present embodiment, it is possible to prevent that the original video file is deleted unintentionally and cannot be additionally recorded. .

  Note that the imaging apparatus 100 according to the present embodiment does not delete the moving image data corresponding to the specified chapter when there is no chapter corresponding to the moving image data captured within a predetermined time from the shooting time of the specified chapter. To control. When there is a chapter corresponding to the moving image data shot within a predetermined time from the shooting time of the specified chapter, the moving image data corresponding to the specified chapter is controlled to be deleted. However, for example, when the number of chapters corresponding to moving image data shot within a predetermined time from the shooting time of a specified chapter is less than or equal to a predetermined number, control is performed so that the moving image data corresponding to the specified chapter is not deleted. Yes. When the number of chapters corresponding to the moving image data shot within a predetermined time from the shooting time of the specified chapter is larger than the predetermined number, the moving image data corresponding to the specified chapter may be controlled to be deleted. Further, the predetermined time can be designated as an arbitrary value and may be selected by the user. Further, the predetermined number can be designated as an arbitrary value and can be selected by the user.

  Note that the imaging apparatus 100 according to the present embodiment determines that the chapter corresponding to the moving image data shot within a predetermined time from the shooting time of the specified chapter is a chapter related to the specified chapter. When there is no chapter related to the specified chapter, control is performed so as not to delete the moving image data corresponding to the specified chapter. When there is a chapter related to the designated chapter, the moving image data corresponding to the designated chapter is controlled to be deleted. However, the chapter associated with the designated chapter may be a chapter corresponding to moving image data photographed within a predetermined range from the photographing position of the designated chapter. In addition, a chapter associated with the specified chapter is captured within a predetermined range from the shooting position of the specified chapter, and a chapter corresponding to moving image data shot within a predetermined time from the shooting time of the specified chapter. It is good.

  Further, in the second embodiment, as in the first embodiment, when the number of chapters of the selected moving image file is equal to or less than a predetermined number, control is performed so as not to delete moving image data corresponding to the chapter to be deleted. Also good. That is, based on the conditions of the second embodiment and the first embodiment, it may be controlled not to delete the moving image data corresponding to the chapter to be deleted. Further, based on the condition of the first embodiment, control is performed so as not to delete the moving image data corresponding to the chapter to be deleted, or the moving image data corresponding to the chapter to be deleted is not deleted based on the condition of the second embodiment. You may make it switch whether it controls.

  In this embodiment, the image pickup apparatus has been described as an example. However, the present invention can be applied as long as the editing process for deleting a part of the moving image data of the moving image file can be executed as in the present embodiment. For example, it may be a computer, a tablet terminal, a smartphone, a mobile phone, a television, or the like. A program for causing a computer to execute the deletion process of this embodiment is also included in the concept of the present invention.

(Other embodiments)
The above-described embodiment can also be realized in software by a computer of a system or apparatus (or CPU, MPU, etc.). Therefore, the computer program itself supplied to the computer in order to implement the above-described embodiment by the computer also realizes the present invention. That is, the computer program itself for realizing the functions of the above-described embodiments is also one aspect of the present invention.

  The computer program for realizing the above-described embodiment may be in any form as long as it can be read by a computer. For example, it can be composed of object code, a program executed by an interpreter, script data supplied to the OS, but is not limited thereto. A computer program for realizing the above-described embodiment is supplied to a computer via a storage medium or wired / wireless communication. Examples of the storage medium for supplying the program include a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, an optical / magneto-optical storage medium such as an MO, CD, and DVD, and a nonvolatile semiconductor memory.

  As a computer program supply method using wired / wireless communication, there is a method of using a server on a computer network. In this case, a data file (program file) that can be a computer program forming the present invention is stored in the server. The program file may be an executable format or a source code. Then, the program file is supplied by downloading to a client computer that has accessed the server. In this case, the program file can be divided into a plurality of segment files, and the segment files can be distributed and arranged on different servers. That is, a server apparatus that provides a client computer with a program file for realizing the above-described embodiment is also one aspect of the present invention.

  In addition, a storage medium in which the computer program for realizing the above-described embodiment is encrypted and distributed is distributed, and key information for decrypting is supplied to a user who satisfies a predetermined condition, and the user's computer Installation may be allowed. The key information can be supplied by being downloaded from a homepage via the Internet, for example. Further, the computer program for realizing the above-described embodiment may use an OS function already running on the computer. Further, a part of the computer program for realizing the above-described embodiment may be configured by firmware such as an expansion board attached to the computer, or may be executed by a CPU provided in the expansion board. Good.

Claims (15)

Playback means for playing back a moving image file recorded on a recording medium;
Erasing means for erasing the video data of a specified section of the video file;
When the specified section is equal to or greater than a predetermined ratio with respect to the moving image data of the moving image file, the erasure unit is controlled not to delete the moving image data of the specified section, and the specified section Control means for controlling the erasing means to erase the moving picture data in the designated section when the video data is smaller than a predetermined ratio with respect to the moving picture data of the moving picture file. apparatus.   Control means for controlling the erasing means so as not to erase the moving picture data of the designated section when the designated section is 100% of the moving picture data of the moving picture file. An image processing apparatus. Reproducing means for reproducing a moving image file including moving image data corresponding to a plurality of chapters recorded on a recording medium;
Erasing means for erasing the video data corresponding to the specified chapter of the video file;
When the total number of chapters of the video file is equal to or less than a predetermined number, the erasure unit is controlled not to delete the video data corresponding to the specified chapter of the video file, and the total number of chapters of the video file is predetermined. An image processing apparatus comprising: a control unit that controls the erasing unit so as to erase moving image data corresponding to a specified chapter of the moving image file when the number is larger than the number. Reproducing means for reproducing a moving image file including moving image data corresponding to a plurality of chapters recorded on a recording medium;
Erasing means for erasing the video data corresponding to the specified chapter of the video file;
When the total number of chapters of the video file is equal to or less than a predetermined number, the erasure unit is controlled not to delete the video data corresponding to the specified chapter of the video file, and the total number of chapters of the video file is predetermined. An image processing apparatus comprising: a control unit that controls the erasing unit so as to erase moving image data corresponding to a specified chapter of the moving image file when the number is larger than the number. Reproducing means for reproducing a moving image file including moving image data corresponding to a plurality of chapters recorded on a recording medium;
Erasing means for erasing the video data corresponding to the specified chapter of the video file;
When the number of chapters related to the specified chapter is equal to or less than a predetermined number, the erasure unit is controlled so as not to delete the moving image data corresponding to the specified chapter of the moving image file. Control means for controlling the erasure means so as to erase the moving image data corresponding to the specified chapter of the moving image file when the number of chapters related to the specified chapter is larger than a predetermined number. An image processing apparatus.   6. The image processing apparatus according to claim 5, wherein the chapter related to the designated chapter is a chapter of moving image data photographed within a predetermined time from the photographing time of the designated chapter.   6. The image processing apparatus according to claim 5, wherein the chapter associated with the designated chapter is a chapter of moving image data photographed within a predetermined range from the photographing position of the designated chapter. A playback step of playing back a video file recorded on the recording medium;
When the specified section of the video file is equal to or greater than a predetermined ratio with respect to the video data of the video file, control is performed so as not to delete the video data of the specified section. And a control step of controlling to delete the moving image data in the designated section when the moving image data is smaller than a predetermined ratio with respect to the moving image data of the moving image file.   And a control step for controlling the video data in the designated section not to be deleted when the designated section is 100% of the video data of the video file. 9. The image processing method according to claim 8, wherein: A reproduction step of reproducing a moving image file including moving image data corresponding to a plurality of chapters recorded on the recording medium;
When the total number of chapters of the video file is less than a predetermined number, the video data corresponding to the specified chapter of the video file is controlled not to be deleted, and the total number of chapters of the video file is larger than the predetermined number And a control step of controlling to delete moving image data corresponding to a specified chapter of the moving image file. A reproduction step of reproducing a moving image file including moving image data corresponding to a plurality of chapters recorded on the recording medium;
When the total number of chapters of the video file is less than a predetermined number, the video data corresponding to the specified chapter of the video file is controlled not to be deleted, and the total number of chapters of the video file is larger than the predetermined number And a control step of controlling to delete moving image data corresponding to a specified chapter of the moving image file. A reproduction step of reproducing a moving image file including moving image data corresponding to a plurality of chapters recorded on the recording medium;
When the number of chapters related to the specified chapter of the video file is equal to or less than a predetermined number, control is performed so as not to delete the video data corresponding to the specified chapter of the video file, and the specification of the video file And a control step for controlling to delete moving image data corresponding to a specified chapter of the moving image file when the number of chapters related to the specified chapter is greater than a predetermined number. .   13. The image processing method according to claim 12, wherein the chapter related to the designated chapter is a chapter of moving image data photographed within a predetermined time from the photographing time of the designated chapter.   13. The image processing method according to claim 12, wherein the chapter related to the designated chapter is a chapter of moving image data photographed within a predetermined range from the photographing position of the designated chapter.   A program that causes a computer to function as each unit of the image processing apparatus according to claim 1.

Images