JP2017069902A - Image processing apparatus, control method therefor and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent the occurrence of a case of giving a user an operational contradiction that a combined moving image file can be preserved during combining moving image files.SOLUTION: At the combination of a plurality of moving image files into one combined moving image file, if a moving image file is selected from among the plurality of moving image files, a control unit 101 generates work history information which identifies the selected moving image file. If there is an available capacity in a recording medium sufficient for preserving the combined moving image file, the control unit 101 performs the combination processing of the moving image files using the work history information.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an image processing apparatus, a control method therefor, and a control program, and more particularly to an image processing apparatus that combines a plurality of moving image files to generate one moving image file.

  Conventionally, there is a digital camera, a video camera, or a terminal device such as a mobile phone and a smartphone that combines a plurality of moving image files to generate one moving image file. And in case of running out of battery or unexpected shutdown when selecting video files to be combined, there is one that saves the latest selection state as a work history file on the recording medium .

  However, when the moving image file is selected again (combined selection) using the latest work history file, the free capacity of the recording medium may change depending on the user operation before performing the combined selection. Even when the recording medium has insufficient free space, the operation history file may exist on the recording medium, which may cause the user to have an operational contradiction that the selected video file can be stored on the recording medium. is there.

  On the other hand, there is an output device that records an editing history of an image and reproduces and displays the edited image without re-saving the image data that has been edited halfway (see Patent Document 1). Furthermore, there is an imaging and recording apparatus that can automatically insert an optimum BGM for a shooting scene (see Patent Document 2).

JP 2006-48826 A JP 2004-221666 A

  Although the output device described in Patent Document 1 describes that an edited image is reproduced and displayed without re-storing image data that has been edited halfway, the recording medium has insufficient free space. It is difficult to eliminate operational contradictions when

  In addition, although the imaging and recording apparatus described in Patent Document 2 describes that an optimal BGM is inserted into a shooting scene, similarly, there is an operation contradiction when the recording medium has insufficient free space. It is difficult to eliminate.

  Accordingly, it is an object of the present invention to provide an image processing apparatus, a control method thereof, and a control program that do not give an operational contradiction that a combined moving image file can be saved to a user when combining moving image files. It is in.

  To achieve the above object, an image processing apparatus according to the present invention is an image processing apparatus that combines a plurality of moving image files into one combined moving image file, and selects a moving image file to be combined from the plurality of moving image files. Whether or not there is a free space for storing the combined moving image file in the generation unit that generates the work history information for specifying the selected moving image file and the recording medium for storing the combined moving image file. And a combination processing unit for performing a combination process of moving image files using the work history information when the determination unit determines that the free space exists.

  The control method according to the present invention is a control method of an image processing apparatus that combines a plurality of moving image files into one combined moving image file, and is selected when a moving image file to be combined is selected from the plurality of moving image files. A generating step for generating work history information for specifying the moving image file; and a determining step for determining whether or not a recording medium for storing the combined moving image file has a free space for storing the combined moving image file; A combination processing step of performing a combination processing of moving image files using the work history information when it is determined in the determination step that the free space exists.

  A control program according to the present invention is a control program used in an image processing apparatus that combines a plurality of moving image files into one combined moving image file, and combines the plurality of moving image files into a computer included in the image processing apparatus. When the moving image file to be selected is selected, a generation step for generating work history information for specifying the selected moving image file, and a recording medium for storing the combined moving image file have a free space for storing the combined moving image file. A determination step for determining whether or not there exists, and a combination processing step for performing a combination processing of moving image files using the work history information when it is determined in the determination step that the free space exists. It is characterized by that.

  According to the present invention, when it is determined that there is a free space, the moving image file is combined using the work history information. As a result, there is no operational inconsistency that the combined moving image file can be saved to the user when combining the moving image files.

1 is a block diagram illustrating a configuration of an example of an imaging apparatus that is one of image processing apparatuses according to an embodiment of the present invention. It is a figure which shows an example of the format of the work history file produced | generated with the camera shown in FIG. It is a figure which shows an example of the hierarchical file structure used with the camera shown in FIG. 6 is a flowchart for explaining an example of a playback mode process performed by the camera shown in FIG. 1. It is a flowchart for demonstrating an example of the moving image mixing process shown in FIG. It is a flowchart for demonstrating the combined moving image selection process shown in FIG. 6 is a flowchart for explaining another example of the moving image mixing process shown in FIG. 4. It is a flowchart for demonstrating the work history operation | movement process shown in FIG. FIG. 8 is a diagram for explaining an example of guidance display displayed on the display unit in the video mix process shown in FIG. 5 or FIG. 7, and (a) and (b) are diagrams showing an example of a video file mix screen; () Is a diagram showing a moving image combination screen, (d) is a diagram showing a selection cancellation screen for a selected moving image, and (e) is a diagram showing a deletion screen when deleting an image recorded on a recording medium. FIG. 8 is a diagram for describing an example of a moving image selection screen and a deletion image selection screen displayed on the display unit in the moving image mixing process illustrated in FIG. 5 or FIG. (D) is a figure which shows a deletion image selection screen.

  FIG. 1 is a block diagram showing a configuration of an example of an imaging apparatus which is one of image processing apparatuses according to an embodiment of the present invention. In the following description, a digital camera (hereinafter simply referred to as a camera) will be described as an example of the imaging device. However, the imaging device may be a terminal device such as a mobile phone or a smartphone.

  The camera 100 includes a control unit 101. The control unit 101 includes, for example, a CPU (MPU), a memory (DRAM or SRAM), and a nonvolatile memory (EEPROM). Then, the control unit 101 controls the camera 100 by executing various programs recorded in the nonvolatile memory. Furthermore, the control unit 101 receives an operation signal from the operation unit 102 that receives a user operation, and controls the camera 100 according to the operation signal. In addition, the control unit 101 analyzes images obtained by image processing units 111 and 113 described later, and controls the camera 100 according to the analysis result.

  The operation unit 102 includes buttons (switches) for inputting various operations related to shooting such as a power button, a still image recording button, a moving image recording start button, a zoom adjustment button, and an autofocus button. . Further, the operation unit 102 includes a menu display button, a determination button, other cursor keys, a pointing device, a touch panel, and the like. When these keys or buttons are operated by the user, the operation unit 102 sends an operation signal corresponding to the operation to the control unit 101.

  The bus 103 is a general-purpose bus for sending various data, control signals, instruction signals, and the like to each block of the camera 100.

  The nonvolatile memory 105 is an electrically erasable and recordable memory, and stores constants and programs for the operation of the control unit 101. The imaging unit 110 controls the amount of light of an optical image (subject image) received through a lens by a diaphragm, and forms an image on an imaging element such as a CCD sensor or a CMOS sensor. The image sensor outputs an image signal (analog image signal) corresponding to the optical image. Further, the imaging unit 110 performs A / D conversion on the analog image signal and sends the digital image signal to the image processing unit 111.

  The image processing unit 111 performs image quality adjustment processing for adjusting white balance, color, brightness, and the like based on setting values set in advance for the digital image signal, and outputs image data.

  The control unit 101 sends the image data to the memory 104, a video output unit 150 and a display control unit 131 which will be described later.

  The imaging unit 110 has an “optical zoom” function and an “optical image stabilization” function. The image processing unit 111 has an “electronic zoom” function and an “electronic image stabilization” function. Each of the “optical zoom” function and the “electronic zoom” function is a function for enlarging an image in accordance with a user operation. Each of the “optical image stabilization” function and the “electronic image stabilization” function is a function for preventing image shake caused by the vibration of the camera 100. These functions are used simultaneously or alternately under the control of the control unit 101. Furthermore, each of these functions may be used alone.

  The imaging unit 110 enlarges or reduces the optical image by moving the lens along the optical axis by the “optical zoom” function according to the operation of the zoom key by the user. The image processing unit 111 enlarges an image obtained by cutting out a part of the image obtained by the imaging unit 110 by the “electronic zoom” function in accordance with the operation of the zoom key by the user.

  Under the control of the control unit 101, the imaging unit 110 moves the lens in a direction intersecting the optical axis by an “optical image stabilization” function based on an acceleration signal obtained by a vibration detection unit (not shown). , Prevent image shake. Under the control of the control unit 101, the image processing unit 111 prevents shaking of the image obtained by the imaging unit 110 by the “electronic image stabilization” function based on the acceleration signal.

  As for the “electronic image stabilization” function, image shaking can also be prevented by shifting the pixel readout position in the image sensor based on the acceleration signal. Since these functions are known, a detailed description is omitted.

  The audio input unit 120 collects sound (sound) around the camera 100 using, for example, a built-in omnidirectional microphone or an external microphone connected via an audio input terminal. Then, the audio input unit 120 performs A / D conversion on the audio signal obtained as a result of the sound collection, and sends it to the audio processing unit 121 as a digital audio signal.

  The audio processing unit 121 optimizes the level of the digital audio signal by audio processing such as optimization processing, and then sends the digital audio signal to the control unit 101. Then, the control unit 101 records the digital audio signal in the memory 104 as audio data. As a result, the memory 104 temporarily stores image data and audio data.

  The image processing unit 111 reads out the image data stored in the memory 104, performs compression encoding, and generates compressed image data. Then, the control unit 101 sends the compressed image data to the recording / reproducing unit 140.

  Similarly, the audio processing unit 121 reads out audio data stored in the memory 104, performs compression encoding, and generates compressed audio data. Then, the control unit 101 sends the compressed audio data to the recording / reproducing unit 140.

  The recording / playback unit 140 records compressed image data, compressed audio data, and other shooting-related control data (various data) on the recording medium 141. When the audio data is not compression-encoded, the control unit 101 sends the audio data and the compressed image data to the recording / reproducing unit 140. Then, the recording / reproducing unit 140 records the audio data and the compressed image data on the recording medium 141.

  The recording medium 141 may be a recording medium built in the camera 100 or a recording medium removable from the camera 100. For example, as the recording medium 141, a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, or a flash memory is used.

  The recording / reproducing unit 140 reads (that is, reproduces) compressed image data, compressed audio data (or audio data), various data, and the like recorded on the recording medium 141. Then, the control unit 101 sends the compressed image data and the compressed audio data (or audio data) to the image processing unit 111 and the audio processing unit 121.

  The image processing unit 111 temporarily stores the compressed image data in the memory 104. The image processing unit 111 decodes the compressed image data according to a predetermined procedure to obtain image data. Then, the image processing unit 111 sends the image data to the video output unit 150 and the display control unit 131.

  Similarly, the audio processing unit 121 temporarily stores the compressed audio data in the memory 104. The audio processing unit 121 decodes the compressed audio data according to a predetermined procedure to obtain audio data. Then, the voice processing unit 121 sends the voice data to the voice output unit 151. When the audio data is recorded in the recording medium 141 in a non-compressed manner, the control unit 101 sends the audio data directly to the audio output unit 151.

  The audio output unit 151 has an audio output terminal, for example. The audio output unit 151 transmits audio corresponding to audio data from an earphone or a speaker connected to the audio output terminal. Note that the audio output unit 151 may be a speaker built in the camera 100.

  The video output unit 150 includes, for example, a video output terminal. The video output unit 150 displays an image corresponding to the image data on an external display or the like connected to the video output terminal.

  Note that the audio output unit 151 and the video output unit 150 may include an integrated output terminal, for example, an HDMI (High-Definition Multimedia Interface: registered trademark) terminal.

  The display control unit 131 displays a video (image) corresponding to the image data on the display unit 130. Further, the display control unit 131 displays an operation screen (menu screen) for operating the camera 100 under the control of the control unit 101 on the display unit 130. The display unit 130 may be any device as long as it is a display device such as a liquid crystal display, an organic EL display, or electronic paper.

  The communication unit 152 is used to perform communication between the camera 100 and an external device. The communication unit 152 transmits and receives, for example, audio data, image data, compressed audio data, and compressed image data under the control of the control unit 101.

  Furthermore, the communication unit 152 transmits and receives control signals related to shooting such as shooting start and end commands and other information to and from an external device. As the communication unit 152, for example, a wireless communication module such as an infrared communication module, a Bluetooth (registered trademark) communication module, a wireless LAN communication module, a Wireless USB, and a GPS receiver is used.

  Next, the photographing operation (normal operation) of the camera 100 shown in FIG. 1 will be described.

  When the user operates a power button provided on the operation unit 102, an activation instruction is sent from the operation unit 102 to the control unit 101. In response to this activation instruction, the control unit 101 controls a power supply unit (not shown) to supply power to the camera 100.

  When the power is supplied, the control unit 101 checks whether the mode switch provided in the operation unit 102 is in the still image shooting mode, the moving image shooting mode, or the playback mode. In the still image shooting mode, the control unit 101 performs shooting when the user operates a still image recording button provided in the operation unit 102 in a shooting standby state. Then, as described above, the compressed image data is recorded on the recording medium 141. Thereafter, the control unit 101 enters a shooting standby state.

  In the moving image shooting mode, the control unit 101 starts shooting when the user operates a moving image recording start button provided in the operation unit 102 in a shooting standby state. The compressed image data and the compressed audio data (or audio data) are recorded on the recording medium 141 until the moving image recording end button provided in the operation unit 102 is operated. When the user operates the moving image recording end button, the control unit 101 ends moving image shooting and enters a shooting standby state.

  In the reproduction mode, the control unit 101 controls the recording / reproducing unit 140 to reproduce the compressed image data or the compressed audio data (or audio data) from the recording medium 141 according to the user's selection. Then, as described above, sound corresponding to the sound data is output from the sound output unit 151, and an image corresponding to the image data is displayed on the display unit 130.

  Here, the still image shooting mode performed by the camera 100 shown in FIG. 1 will be further described.

  As described above, when the still image shooting mode is set, the control unit 101 sets the camera 100 in a shooting standby state. In the shooting standby state, the image processing unit 111 sends image data to the display control unit 131. As a result, the display control unit 131 displays an image corresponding to the image data on the display unit 130. The user can prepare for shooting while checking the screen displayed on the display unit 130.

  When the user operates the still image recording button in the shooting standby state (when a shooting instruction is given), the control unit 101 controls the camera 100 to execute the following operation.

  As described above, the imaging unit 110 sends a digital image signal to the image processing unit 111. The image processing unit 111 performs image quality adjustment processing on the digital image signal to generate image data. Then, the control unit 101 sends the image data to the memory 104, the video output unit 150, and the display control unit 131. The user can check the still image obtained as a result of shooting by looking at the image displayed on the display unit 130.

  The image processing unit 111 reads out image data stored in the memory 104 and performs compression coding. Then, the control unit 101 outputs the compressed image data to the recording / reproducing unit 140. The recording / playback unit 140 records the compressed image data as a still image file on the recording medium 141 based on file system management such as UDF or FAT.

  When the compression encoding process by the image processing unit 111 is completed, the control unit 101 puts the camera 100 into a shooting standby state.

  Next, the moving image shooting mode performed by the camera shown in FIG. 1 will be further described.

  As described above, when the moving image shooting mode is set, the control unit 101 sets the camera 100 in a shooting standby state. In the shooting standby state, the image processing unit 111 sends image data to the display control unit 131. As a result, the display control unit 131 displays an image corresponding to the image data on the display unit 130. The user can prepare for shooting while checking the screen displayed on the display unit 130.

  When the user operates the moving image recording start button in the shooting standby state, the control unit 101 controls the camera 100 to execute the following operation.

  As described above, the imaging unit 110 sends a digital image signal to the image processing unit 111. The image processing unit 111 performs image quality adjustment processing on the digital image signal to generate image data. Then, the control unit 101 sends the image data to the memory 104 and the display control unit 131. The display control unit 131 displays an image (moving image) corresponding to the image data on the display unit 130.

  On the other hand, a digital audio signal is sent from the audio input unit 120 to the audio processing unit 121. As described above, the audio processing unit 121 optimizes the level of the digital audio signal and outputs audio data. Then, the control unit 101 sends the audio data obtained by the audio processing unit 121 to the memory 104.

  As described above, the image processing unit 111 and the audio processing unit 121 perform predetermined compression encoding to generate compressed image data and compressed audio data. The control unit 101 combines these compressed image data and compressed audio data to form a data stream. Then, the control unit 101 outputs the data stream to the recording / reproducing unit 140.

  The recording / playback unit 140 records the data stream on the recording medium 141 as one moving image file based on file system management such as UDF or FAT. When the audio data is not compressed and encoded, the control unit 101 synthesizes the compressed image data and the audio data to form a data stream. The above-described operation continues until an instruction to end moving image shooting is given.

  During shooting, the control unit 101 controls the imaging unit 110, the image processing unit 111, and the audio processing unit 121 in accordance with a user operation or an analysis result of image data. For example, the control unit 101 controls the imaging unit 110 to perform lens movement and aperture adjustment. The control unit 101 also controls the image processing unit 111 and the audio processing unit 121 to adjust the image data and the audio data.

  Further, when the user operates the zoom key during shooting, the control unit 101 operates the “optical zoom” function of the imaging unit 110 and the “electronic zoom” function of the image processing unit 111. During shooting, the control unit 101 operates the “optical image stabilization” function of the image capturing unit 110 and the “electronic image stabilization” function of the image processing unit 111.

  When the user operates the moving image recording end button, the control unit 101 controls the camera 100 as follows to end the shooting.

  The image processing unit 111 and the sound processing unit 121 stop outputting the image data and the sound data to the memory 104, respectively. Then, the image processing unit 111 and the audio processing unit 121 read the remaining image data and audio data stored in the memory 104 and perform predetermined compression encoding.

  The control unit 101 synthesizes these compressed image data and compressed audio data to form a data stream and outputs it to the recording / reproducing unit 140. When the audio data is not compression-encoded, the control unit 101 synthesizes the compressed image data and the audio data, forms a data stream, and outputs the data stream to the recording / reproducing unit 140.

  As described above, the recording / reproducing unit 140 records the data stream on the recording medium 141 as one moving image file. When the recording on the recording medium 141 is completed, the control unit 101 controls the camera 100 as follows in order to generate a thumbnail.

  The recording / playback unit 140 reads the compressed image data located in the first frame of the moving image file recorded on the recording medium 141 and sends the compressed image data to the image processing unit 111. The image processing unit 111 temporarily stores the compressed image data in the memory 104. Then, the image processing unit 111 decodes the compressed image data according to a predetermined procedure to obtain image data.

  Next, the image processing unit 111 performs predetermined compression encoding for thumbnails on the image data to generate compressed image data for thumbnails. Then, the control unit 101 outputs the compressed image data for thumbnails to the recording / reproducing unit 140.

  Based on file system management such as UDF or FAT, the recording / playback unit 140 combines the compressed image data for thumbnails with the original moving image file and writes the compressed video data to the recording medium 141. The recording / playback unit 140 completes the moving image file and then stops the recording operation. When the recording operation is stopped, the control unit 101 places the camera 100 in a shooting standby state.

  Note that the control unit 101 stores the copyright owner name and the creator name in the nonvolatile memory 105 in accordance with the operation of the operation unit 102 by the user. The control unit 101 changes the copyright owner name and the creator name stored in the nonvolatile memory 105 each time the operation unit 102 is operated. The copyright holder name and creator name stored in the non-volatile memory 105 are recorded as metadata in a still image file or a moving image file in accordance with the shooting process.

  By the way, as a moving image mode, there is a normal moving image mode in which normal recording is performed. Furthermore, as a moving image mode, there is a short clip moving image mode in which a short moving image is recorded by selecting a reproduction effect such as normal fast-forward, slow, or replay. In addition, there are a moving image mode, a manual moving image mode in which the shutter speed and aperture can be set, a diorama-like moving image mode in which you can enjoy the effects of a miniature model and fast-forward movement.

  It is assumed that the still image file and the moving image file recorded in the above-described still image shooting mode and moving image shooting mode are recorded in accordance with a DCF (Design rule for Camera File system).

  Next, the playback mode performed by the camera 100 shown in FIG. 1 will be further described.

  When the playback mode is set by the operation unit 102, the control unit 101 shifts the camera 100 to the playback state and performs the following operation.

  The recording / playback unit 140 reads a still image file or a moving image file recorded on the recording medium 141 under the control of the control unit 101. In the following description, it is assumed that a moving image file has been read.

  The control unit 101 sends the compressed image data and the compressed audio data to the image processing unit 111 and the audio processing unit 121, respectively. If the audio data is not compressed and encoded, the control unit 101 sends the audio data to the audio output unit 151.

  The image processing unit 111 and the audio processing unit 121 temporarily store the compressed image data and the compressed audio data in the memory 104, respectively. Then, the image processing unit 111 and the sound processing unit 121 decode the compressed image data and the compressed sound data, respectively, according to a predetermined procedure.

  The control unit 101 sends audio data obtained by decoding to the audio output unit 151 and sends image data to the video output unit 150 and the display control unit 131. The display control unit 131 displays a video (image) corresponding to the image data on the display unit 130. On the other hand, the audio output unit 151 outputs audio corresponding to the audio data from the built-in speaker or the earphone or speaker connected to the audio output unit 151.

  By the way, the user may select a desired moving image file from a plurality of moving image files recorded on the recording medium 141 and combine the selected moving image files to generate one moving image file. At this time, the control unit 101 stores the selection history of the moving image file by the user in the recording medium 141 as work history information (hereinafter also referred to as work history file). This work history file is information for specifying the selected moving image file.

  FIG. 2 is a diagram showing an example of the format of a work history file generated by the camera shown in FIG.

  In the illustrated work history file, for example, the CTG file format is used, and the work history file includes a header (header) 201 that manages file information and an ObjectInfo 202 that extracts necessary data in the moving image file. . In Header 201 and ObjectInfo 202, the data length of each information is 4 bytes. The information stored in the header 201 is mainly used for consistency check when the work history is read and used.

  In Header 201, FileSizeCheckSum (file size checksum) 203 is information for checking the reliability of the file size of the work history file. FileVersino 204 is information indicating the version of the work history file. The file version is updated when it is updated. TotalObject 205 is information indicating the number of selected moving image files. Model ID 206 is information indicating a model-specific number of the camera 100.

  In ObjectInfo 202, ObjectID1 207 is information indicating the unique ID (identification ID: unique number) of the first selected moving image file. FrameCount1 208 is information indicating the number of frames of the first selected moving image file. CreateTime1 209 is information indicating the creation time of the first selected moving image file. ObjectID1 210 is information indicating the unique ID (identification ID) of the Nth (N is an integer equal to or greater than 1) selected video file. FrameCountN 211 is information indicating the number of frames of the Nth selected moving image file. CreateTime1 212 is information indicating the creation time of the Nth selected moving image file.

  Thus, when the number of selected moving image files in the work history file increases, the number of ObjectID, FrameCount, and CreateTime increases.

  3 is a diagram showing an example of a hierarchical file structure used in the camera 100 shown in FIG.

  As described with reference to FIG. 1, still image files and moving image files are recorded in accordance with DCF. In the hierarchical file 301, the file name is SC0001. In the CONONMSC folder of the DCF image root directory (DCIM). A work history file 302 is stored as a CTG.

  FIG. 4 is a flowchart for explaining an example of a playback mode process performed by the camera shown in FIG. Note that the processing according to the illustrated flowchart is performed under the control of the control unit 101.

  When the playback mode process is started, the control unit 101 obtains the latest image data (hereinafter also referred to as image information) from the recording medium 141, and displays an image corresponding to the image data on the display unit 130 by the display control unit 131 (step S1). S401). Then, the control unit 101 determines whether or not the Menu button has been pressed in the operation unit 102. That is, the control unit 101 determines whether or not to transit to the Menu screen (step S402).

  When it is determined that the screen is to be changed to the Menu screen (YES in Step S402), the control unit 101 displays the Menu screen on the display unit 130, and determines whether or not a video file mix for combining short videos is selected on the Menu screen. (Step S403).

  Note that the moving image file mix refers to a process of combining a plurality of moving image files and storing them in the recording medium 141 as one moving image file. Here, in the moving image file mix, the short clip moving image of the short moving image is described as being combined, but the moving image file to be combined is not limited to this.

  When the moving image file mix is selected (YES in step S403), the control unit 101 performs a moving image mix process described later (step S404). Then, the control unit 101 determines whether or not to end the reproduction mode (step S405). If it is determined to end the playback mode (YES in step S405), control unit 101 ends the playback mode process. On the other hand, if it is determined not to end the playback mode (NO in step S405), control unit 101 returns to the process in step S402.

  If the moving image file mix is not selected (YES in step S403), the control unit 101 performs other menu processing according to the operation of the operation unit 102 (step S406). Then, the control unit 101 proceeds to the process of step S405. Other menu processing includes, for example, image resizing processing, trimming processing, and print settings.

  When it is determined that the screen does not transit to the Menu screen (NO in step S402), the control unit 101 performs other reproduction processing according to the operation of the operation unit 102 (step S407). Then, the control unit 101 proceeds to the process of step S405. Other reproduction processes include, for example, image deletion, image editing, and image transmission.

  FIG. 5 is a flowchart for explaining an example of the moving image mixing process shown in FIG.

  When the moving image mixing process is started, the control unit 101 determines whether or not the write protection is “ON” in the recording medium 141 (step S501). If the write protection is “OFF” (NO in step S501), the control unit 101 can create a file name of the moving image file (combined moving image file) obtained by combining in the moving image file mixing process. Is determined (step S502).

  Here, the combined moving image file name is named and stored in accordance with a file path defined by a DCF (Design rule for Camera File system). When naming according to the file path specified in the DCF standard, if the maximum file number (file number: 9999) already exists in the DCF maximum directory (directory number: 999), the control unit 101 determines the combined movie file name. It is determined that cannot be created.

  If it is possible to create a combined movie file name (YES in step S502), control unit 101 calculates the maximum file size in one short clip movie file of the short movie used in the movie file mix. Then, the control unit 101 compares the maximum file size with the free capacity of the recording medium 141, and determines whether there is free capacity according to the comparison result (step S503).

  When calculating the maximum file size of one short clip video file, the control unit 101 converts the maximum time of one short clip video file into the number of frames. Then, the control unit 101 converts the number of frames into a file size in consideration of the bit rate of the moving image, the thumbnail size, and the frame rate of the video system (NTSC / PAL).

  When comparing the maximum file size and the free capacity of the recording medium 141, it is desirable to compare the file size of one short clip moving image file and the free capacity of the recording medium after converting them to a cluster size optimum for the camera. .

  If there is free space (YES in step S503), control unit 101 determines whether or not a short clip moving image (that is, a target moving image) exists on recording medium 141 (step S504). When the short clip moving image exists (YES in step S504), the control unit 101 displays a screen (moving image file mix screen) for selecting whether to perform moving image combining described later on the display unit 130. Then, the control unit 101 determines whether moving image combination is selected (step S505).

  If it is determined that movie combination is selected, that is, if movie combination is to be performed (YES in step S505), control unit 101 determines whether a work history file exists on recording medium 141 and whether there is a work history. (Step S506). If the work history exists in the work history file (YES in step S506), the control unit 101 adds the number of frames of the object in the ObjectInfo 202 recorded in the work history file. Then, the control unit 101 calculates the file size based on the number of frames in consideration of the bit rate of the moving image, the thumbnail size, and the frame rate of the video system (NTSC / PAL) (step S507).

  Subsequently, the control unit 101 calculates the free capacity of the recording medium 141 (step S508). Note that it is desirable to convert the file size and free space obtained in steps S507 and S508 to a cluster size optimum for the camera 100.

  Next, the control unit 101 compares the file size obtained in step S507 with the free space obtained in step S508, and determines whether the combined moving image file can be stored in the recording medium 141 according to the comparison result. Determination is made (step S509). If there is a storable free space (YES in step S509), control unit 101 determines whether or not to use the work history (step S510). Here, as will be described later, the control unit 101 displays a moving image combination screen on the display unit 130 and determines whether or not the use of the work history by the user has been selected.

  If it is determined that the work history is to be used (YES in step S510), control unit 101 displays a combination selection screen described later on display unit 130 (step S511). On the other hand, when it is determined that the work history is not used (NO in step S510), control unit 101 clears the work history (step S512). Then, the control unit 101 proceeds to the process of step S511.

  After the process of step S511, the control unit 513 performs a moving image combination selection process described later (step S513), and ends the moving image mixing process.

  If there is no storable free space in step S509 (NO in step S509), the control unit 101 proceeds to the process of step S512. If no work history exists in step S506 (NO in step S506), control unit 101 proceeds to the process in step S511.

  If the write protect is “ON” (YES in step S501), control unit 101 determines whether or not playback of the combined moving image file has been selected in accordance with the operation of operation unit 102 (step S514). When playback of the combined moving image file is selected (YES in step S514), control unit 101 performs combined moving image playback processing for playing back the combined moving image file (step S515). And the control part 101 complete | finishes a moving image mixing process. On the other hand, if playback of the combined video file is not selected (NO in step S514), control unit 101 ends the video mix process.

  If it is not possible to create a combined moving image file name (NO in step S502), control unit 101 proceeds to the process in step S514. Similarly, if there is no free space in step S502 (NO in step S503), control unit 101 proceeds to the process in step S514. If there is no short clip moving image (NO in step S504), control unit 101 proceeds to the process in step S514. Further, if it is determined not to combine the moving images (NO in step S505), control unit 101 proceeds to the process in step S514.

  FIG. 6 is a flowchart for explaining the combined moving image selection process shown in FIG.

  When the combined moving image selection process is started, the control unit 101 determines whether there is a short clip moving image (selected moving image) selected for combining (step S601). If there is a selected video (YES in step S601), control unit 101 determines whether or not to cancel the selected short clip video (selected video) (step S602). Note that the user can cancel the selected moving image using the operation unit 102 as described later.

  When canceling the selected moving image (YES in step S602), the control unit 101 performs the cancellation processing of the selected moving image (step S603). And the control part 101 returns to the process of step S601.

  In the selected release process, the control unit 101 clears the work history expanded in the memory 104 and stores the SC0001. Update the CTG file. Further, when clearing the work history, the control unit 101 reduces the number of Header TotalObjects 205 shown in FIG. 2 by 1 and deletes the ObjectID, FrameCount, and rateTime stored in the ObjectInfo 202.

  If there is no selected moving image (NO in step S601), the control unit 101 determines whether or not to end the moving image file combination selection (step S604). When the moving image file combination selection is to be ended (YES in step S604), the control unit 101 ends the combined moving image selection process.

  On the other hand, when the moving image file combination selection is not terminated (NO in step S604), the control unit 101 determines whether to select a combined moving image file (step S605). When selecting a combined moving image file (YES in step S605), the control unit 101 performs a moving image file selection process as described later (step S606).

  Subsequently, according to the operation of the operation unit 102, the control unit 101 determines whether or not to combine moving image files (step S607). When the selected moving image files are to be combined (YES in step S607), the control unit 101 performs a combining process of the selected moving image files (step S608). The movie file combining process includes a preview for confirming the combined movie file, a movie file combination for combining movie files, a BGM selection for adding BGM, and a color effect applying process for adding a color filter to the combined movie file. is there. Thereafter, the control unit 101 ends the combined moving image selection process.

  If the selected moving image files are not combined (NO in step S607), control unit 101 returns to the process in step S601. If the combined moving image file is not selected (NO in step S605), the control unit 101 ends the combined moving image selection process.

  FIG. 7 is a flowchart for explaining another example of the moving image mixing process shown in FIG. In FIG. 7, the same steps as those in the flowchart shown in FIG.

  If there is no storable free space in step S509 described with reference to FIG. 5 (NO in step S509), the control unit 101 performs a work history operation process described later (step S716). Then, the control unit 101 proceeds to the process of step S511.

  FIG. 8 is a flowchart for explaining the work history operation process shown in FIG.

  When the work history operation process is started, the control unit 101 displays on the display unit 130 that the recording medium 141 has insufficient free space as guidance (step S801). Then, the control unit 101 determines whether or not to cancel the selected moving image file stored in the work history (step S802). When canceling the selected moving image file (YES in step S802), the control unit 101 sets the combined moving image file size (step S803). Note that the calculation of the moving image file size is performed as described in step S507 in FIG.

  Subsequently, the control unit 101 calculates the free capacity of the recording medium 141 (step S804). The calculation of the free space is performed as described in step S508 of FIG.

  Next, the control unit 101 determines whether or not the selected moving image files can be stored in the recording medium 141 as a result of the combination (step S805). If the free space exists, that is, if it can be stored (YES in step S805), control unit 101 ends the work history operation process. On the other hand, if there is no storable free space (NO in step S805), control unit 101 returns to the process in step S801.

  When the selected moving image file is not released (NO in step S802), the control unit 101 determines whether to selectively delete the still image file and the moving image file stored in the recording medium 141 (medium) (step S802). S806). When performing selective deletion (YES in step S806), the control unit 101 displays a list of still image files and moving image files stored in the recording medium 141 on the display unit 130 (step S807).

  Subsequently, the control unit 101 selects an image to be deleted according to a user operation (step S808). Then, the control unit 101 deletes the selected image from the recording medium 141 (step S809). Thereafter, the control unit 101 proceeds to the process of step S803. Note that if the selective deletion is not performed (NO in step S806), the control unit 101 returns to the process of step S802.

  By the way, when the deleted image is a short clip moving image that has been selected for combination, the control unit 101 reduces the number of TotalObjects 205 of the Header shown in FIG. Further, the control unit 101 deletes the ObjectID, FrameCount, and CreateTime stored in the ObjectInfo 202, and deletes the SC0001. Update the CTG file.

  Here, an example of a screen displayed on the display unit 130 in the above-described moving image mixing process will be described.

  FIG. 9 is a diagram for explaining an example of guidance display displayed on the display unit 130 in the moving image mixing process shown in FIG. 5 or 7. FIG. 9A and FIG. 9B are diagrams illustrating an example of a moving image file mix screen, and FIG. 9C is a diagram illustrating a moving image combination screen. FIG. 9D is a diagram showing a selection cancellation screen for a selected moving image, and FIG. 9E is a diagram showing a deletion screen when an image recorded on the recording medium is deleted.

  FIG. 10 is a diagram for explaining an example of a moving image selection screen and a deletion image selection screen displayed on the display unit 130 in the moving image mixing process shown in FIG. 5 or FIG. 10 (a) to 10 (c) are diagrams showing a moving image selection screen, and FIG. 10 (d) is a diagram showing a deletion image selection screen.

  In the process of step S505 described with reference to FIG. 5, the control unit 101 displays the moving image file unmixed screen 901 illustrated in FIG. In FIG. 9A, a “Combine Movie” button 902 and a “Play Combined Movie” button 912 are displayed.

  If there is no short clip moving image (target moving image) that can be combined in the process of step S504 (NO in step S504), the control unit 101 proceeds to the process of step S514 as described above. At this time, as shown in FIG. 9B, the control unit 101 grays out (selection prohibition) the “Combine Movies” button and displays it as a “Combine Movie” button 903.

  In the process of step S505, when the user depresses the “Merge movie” button 902, the control unit 101 proceeds to the process of step S506. On the other hand, when the user depresses the “play combined video” button 912, the control unit 101 proceeds to the process of step S514.

  In the process of step S510 described with reference to FIG. 5, the control unit 101 displays the moving image combination screen 904 illustrated in FIG. In FIG. 9C, guidance “Do you want to edit based on the previous contents?” Is displayed, and “Yes” button 913 and “No” button 914 are displayed.

  In the process of step S510, when the user depresses the “Yes” button 913, the control unit 101 proceeds to the process of step S511. When the work history is used, the control unit 101 expands the history work file in the memory 104. On the other hand, when the user depresses the “No” button 914, the control unit 101 proceeds to the process of step S512.

  In the process of step S801 described with reference to FIG. 8, the control unit 101 displays a selection cancellation screen 905 illustrated in FIG. In FIG. 9 (d), a guidance “Not enough card remaining. Are you sure you want to deselect the selected video?” Is displayed, and “Yes” and “No” buttons are displayed. Yes.

  When the user depresses the “Yes” button in the process of step S802, the control unit 101 proceeds to the process of step S803. On the other hand, when the user depresses the “No” button, the control unit 101 proceeds to the process of step S806.

  In the process of step S806, the control unit 101 displays a deletion screen 906 shown in FIG. In FIG. 9 (e), a guidance “Insufficient card remaining. Are you sure you want to delete the saved image?” Is displayed, and “Yes” and “No” buttons are displayed. ing.

  If the user depresses the “Yes” button in the process of step S806, the control unit 101 proceeds to the process of step S807. On the other hand, when the user depresses the “No” button, the control unit 101 returns to the process of step S802.

  In the process of step S605 illustrated in FIG. 6, the control unit 101 displays the moving image selection screen 907 illustrated in FIG. Here, videos “1” to “5” are displayed as a movie list together with the guidance “Please select a movie”.

  Now, assume that the user selects the moving image “2” and the moving image “4” as the selected moving images 916 on the moving image selection screen 907. Accordingly, the control unit 101 displays the moving image selection screen 908 shown in FIG. 10B on the display unit 130 in the process of step S606. Here, the selected moving image “2” and moving image “4” are grayed out, and the selected moving image “2” and moving image “4” are displayed as the selected moving image 915 at the bottom of the screen.

  At this time, the control unit 101 increases the number of Header TotalObjects 205 in the work history file expanded in the memory 104 by one. Further, the control unit 101 stores the ObjectID, FrameCount, and CreateTime in the ObjectInfo 202, and stores the SC0001. Update the CTG file. SC0001. When the CTG file does not exist, the control unit 101 generates the file.

  In the process of step S602 illustrated in FIG. 6, the control unit 101 displays the moving image selection screen 908 illustrated in FIG. Here, when the user cancels the selection of the moving image “2”, the control unit 101 displays a moving image selection screen 909 shown in FIG. Here, the moving image “2” is grayed out in the selected moving image 910, and the gray out of the moving image “2” is canceled in the moving image list.

  In the process of step S807 shown in FIG. 8, the control unit 101 displays a deletion image selection screen 911 shown in FIG. In FIG. 10D, a guidance “Please select an image you want to delete” is displayed, and a list of images stored in the recording medium 141 is displayed.

  In the process of step S808, when the user checks the image 917 deleted on the deletion image selection screen 911, the control unit 101 checks 917 in step S809, that is, deletes the selected image from the recording medium 141. To do.

  As described above, according to the embodiment of the present invention, when the latest work history is used and the combined movie file cannot be saved due to insufficient free space on the recording medium, the selected movie file is cleared by clearing the work history. Inform users that they cannot be merged and saved. As a result, it is possible to prevent the user from having an operation inconsistency that the combined moving image file can be saved.

  As is clear from the above description, in the example shown in FIG. 1, the control unit 101 functions as a file generation unit and a determination unit, and the control unit 101 and the image processing unit 111 function as a combination processing unit. In addition, the control unit 101 and the display control unit 131 function as a notification unit, and the control unit 101 and the recording / playback unit 140 function as a deletion unit. Note that the above work history information is held in a storage area that is not erased even when the image processing apparatus is turned off. After the image processing apparatus is turned on again, the control unit 101 generates a combined moving image file. Therefore, the work history information held in the storage area is referred to.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  Further, the function of the above embodiment may be used as a control method, and this control method may be executed by the image processing apparatus. In addition, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the image processing apparatus. The control program is recorded on a computer-readable recording medium, for example.

[Other Embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium. It can also be realized by a process in which one or more processors in the computer of the system or apparatus read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 101 Control part 102 Operation part 110 Imaging part 111 Image processing part 120 Audio | voice input part 121 Audio | voice processing part 130 Display part 131 Display control part 140 Recording / reproducing part 141 Recording medium

Claims (11)

An image processing apparatus that combines a plurality of video files into one combined video file,
Generating means for generating work history information for identifying the selected moving image file when selecting a moving image file to be combined from the plurality of moving image files;
Determining means for determining whether or not there is a free capacity for storing the combined moving image file in a recording medium for storing the combined moving image file;
When the determination unit determines that the free space exists, a combination processing unit that performs a combination process of moving image files using the work history information;
An image processing apparatus comprising:   The determination means determines a file size of the combined moving image file based on the work history information, and determines whether or not there is a free capacity for storing the combined moving image file of the file size. The image processing apparatus according to 1.   3. The work history information is clear when the combination processing unit selects a moving image file to be combined from the plurality of moving image files without using the work history information. 4. Image processing apparatus.   The image processing apparatus according to claim 1, wherein at least the unique number and the number of frames of each of the selected moving image files are recorded in the work history information.   5. The information processing apparatus according to claim 1, further comprising a notification unit that notifies that the combined moving image file cannot be stored when the determination unit determines that the free space does not exist. The image processing apparatus described.   The image processing apparatus according to claim 5, wherein the notification unit displays on the display unit as guidance that the combined moving image file cannot be stored.   The notification means selects a video file that is not used to generate the combined video file from among the video files specified by the work history information as a video file selected when generating the combined video file. The image processing apparatus according to claim 5, wherein the screen is displayed on a display unit.   The image processing according to claim 5, wherein the notification unit displays a deletion screen for selectively deleting an image file stored in the recording medium on a display unit. apparatus. The work history information is held in a storage area that is not erased even when the image processing apparatus is turned off.
The combined processing means refers to work history information held in the storage area to generate the combined moving image file after the image processing apparatus is turned on again. 9. The image processing device according to any one of 1 to 8. A method of controlling an image processing apparatus by combining a plurality of video files into a single combined video file,
A generation step of generating work history information for identifying the selected video file when selecting a video file to be combined from the plurality of video files;
A determination step of determining whether or not there is a free capacity for storing the combined moving image file in a recording medium for storing the combined moving image file;
A combination processing step of performing a combination processing of moving image files using the work history information when it is determined in the determination step that the free space exists;
A control method characterized by comprising: A control program used in an image processing apparatus that combines a plurality of moving image files into a combined moving image file,
In the computer provided in the image processing apparatus,
A generation step of generating work history information for identifying the selected video file when selecting a video file to be combined from the plurality of video files;
A determination step of determining whether or not there is a free capacity for storing the combined moving image file in a recording medium for storing the combined moving image file;
A combination processing step of performing a combination processing of moving image files using the work history information when it is determined in the determination step that the free space exists;
A control program characterized by causing