JP6478626B2 - Recording apparatus, control method therefor, and program - Google Patents

Description

  The present invention relates to a recording apparatus, a control method therefor, and a program.

  2. Description of the Related Art Conventionally, an apparatus that synthesizes and displays or records music as BGM (BackGroundMusic) with a still image or a moving image is known (see Patent Document 1).

JP 2008-124666 A

  However, in addition to generating such a BGM-combined moving image, there is a case where it is desired to edit the moving image once generated by deleting a part of the moving image. Furthermore, when editing a BGM-composed moving image, the edited moving image may be uncomfortable, for example, depending on the editing content, the BGM may become discontinuous. For this reason, it is desirable that a user can appropriately edit a moving image obtained by synthesizing BGM with a simple operation.

  An object of the present invention is to provide a recording apparatus, a control method thereof, and a program that allow a user to generate a moving image obtained by synthesizing BGM and edit it appropriately with a simple operation.

In order to solve this problem, for example, a recording apparatus of the present invention has the following configuration. That is, in accordance with an instruction for synthesizing the moving image data and the music data, the moving image acquiring unit for acquiring the moving image data, the acquiring unit for acquiring the music data, and the instruction for combining the moving image data and the music data are recorded on the recording medium . and a recording control means for control in this way, the video data of the editing target, if music data is a moving image data that have been synthesized, and until the deletion start position from the beginning of the video data to be edited, from the deletion end position The first editing process that combines the portion up to the end position of the video data to be edited cannot be executed, and the video data to be edited is deleted from the beginning of the video data to be edited to the deletion end position, or Control means for controlling the second editing process to delete from the deletion start position to the end of the moving image data to be edited .

  According to the present invention, it is possible for a user to generate a moving image obtained by synthesizing BGM and edit it appropriately by a simple operation.

It is a block diagram which shows the structure of the imaging device in embodiment of this invention. It is a figure which shows the format of a moving image file. It is a flowchart which shows the process of reproduction | regeneration mode. It is a flowchart which shows an album creation process. It is a flowchart which shows the determination process of free capacity. It is a figure which shows the selection screen of an album type, and a warning screen. It is a flowchart which shows the setting process of BGM. It is a flowchart which shows the expansion | deployment determination processing of BGM. It is a flowchart which shows a preview reproduction process. It is a flowchart which shows the preservation | save process of an album moving image. It is a flowchart which shows the conversion process from a still image to a moving image. It is a flowchart which shows the conversion process from a moving image to a moving image. It is a flowchart which shows the production process of a moving image file. It is a flowchart which shows the synthesis | combination process of BGM. It is a flowchart which shows the process in the case of synthesize | combining BGM at the time of video recording. It is a figure which shows the menu screen regarding the setting of an album. It is a figure which shows the data processed by an album creation process. It is a flowchart which shows an edit process.

  Hereinafter, embodiments of the present invention will be described. FIG. 1 is a diagram illustrating a configuration of an imaging apparatus 100 as an embodiment of the present invention. In FIG. 1, an image pickup unit 101 includes an optical system such as a lens, an image pickup device such as a CMOS, an AD conversion unit, an image processing unit, and the like, takes an image of a subject and outputs image data. The imaging unit 101 can output, for example, moving image data of one frame of 1920 pixels × vertical 1080 pixels and 30 frames per second (30 fps). As will be described later, the imaging unit 101 outputs either 30 fps moving image data or 25 fps moving image data in accordance with an instruction from the control unit 109. In addition, the imaging unit 101 outputs still image data of one screen when there is an instruction to record a still image from the control unit 109.

  At the time of recording moving image data, the image processing unit 102 converts the moving image data obtained by the imaging unit 101 to H.264. It is encoded according to a predetermined encoding method such as H.264 and the amount of information is compressed. In addition, when recording a still image, the image processing unit 102 encodes the still image data obtained by the imaging unit 101 according to an encoding method such as JPEG, and compresses the amount of information. The image processing unit 102 decodes the reproduced moving image data or still image data and expands the amount of information when reproducing the moving image or still image data. Further, as will be described later, the image processing unit 102 once decodes moving image data and still image data read from the recording medium 108 in the album mode, and performs encoding processing again.

  The audio input unit 103 includes a microphone, an amplifier, an AD converter, and the like, acquires audio around the imaging apparatus 100, and outputs audio data. During recording, the audio processing unit 104 performs processing for converting the level of audio data obtained by the audio input unit 103 to an appropriate level, noise reduction processing, and the like. Further, the audio processing unit 104 encodes the audio data obtained from the audio input unit 103 according to a predetermined encoding method at the time of recording and compresses the amount of information, and at the time of reproduction, the reproduced audio data Is decrypted and the amount of information is expanded. In addition, the audio processing unit 104 performs a process of expanding audio data included in the BGM music file stored in the nonvolatile memory 112 in the album mode, as will be described later. In the album mode, the audio processing unit 104 performs processing for synthesizing audio data recorded together with the expanded moving image data and music data for BGM.

  The display control unit 105 causes the display unit 106 to display a moving image related to the moving image data obtained by the imaging unit 101, an operation screen (menu screen) for operating the imaging device 100, and the like. The display unit 106 may be any display device such as a liquid crystal display, an organic EL display, and electronic paper.

  The recording / playback unit 107 records various data such as moving image data, audio data, or still image data on a removable recording medium 108, performs recording control for reading the recorded data, and records these data. Playback control for reading out from the medium and playing back is performed. The recording medium 108 is a large capacity random accessible recording medium such as a memory card. The recording medium 108 can be easily mounted on and removed from the imaging apparatus 100 by a mounting / discharging mechanism (not shown). In the present embodiment, various data recorded on the recording medium 108 are managed as files by the control unit 109 according to a predetermined file system such as FAT.

  The control unit 109 includes, for example, a CPU (MPU), a memory, and the like, executes a program stored in the non-volatile memory 112 to control each block of the imaging apparatus 100, and transfers data between the blocks. Or control. In addition, the control unit 109 controls each block of the imaging apparatus 100 according to an operation signal from the operation unit 110 that receives an operation from the user. The operation unit 110 includes, for example, switches for inputting various operations related to shooting such as a power button, a still image recording button, and a button for instructing start and stop of moving image recording. The operation unit 110 includes a menu display button, a determination button, other cursor keys, a pointing device, a touch panel, and the like, and transmits an operation signal to the control unit 109 when these keys and buttons are operated by the user.

  The memory 111 stores various data such as moving image data, still image data, audio data, data necessary for processing by the control unit 109, and the like. The memory 111 is a volatile memory such as an SDRAM. The nonvolatile memory 112 stores a program for the CPU in the control unit 109, operation constants, and the like. The non-volatile memory 112 stores a music file used as BGM (BackGroundMusic) in an album mode to be described later. In the present embodiment, a predetermined number, for example, three music files are stored in the nonvolatile memory 112. The music data stored in each music file is encoded by a predetermined encoding method and is stored in the nonvolatile memory 112 in a compressed state. Each music file has an information amount compressed by, for example, an AAC (Advanced Audio Coding) method, but a compression method other than this can also be used.

  The output unit 113 outputs the moving image data obtained by the imaging unit 101, the audio data obtained by the audio input unit 103, the reproduced moving image, audio data, or the like to an external display device or the like. The speaker 114 outputs sound when reproducing a moving image or previewing in the album mode. The communication unit 115 performs communication between the imaging device 100 and an external device. For example, the communication unit 115 transmits and receives data such as an audio signal, an image signal, a compressed audio signal, and a compressed image signal. The communication unit 115 is, for example, a wireless communication module such as an infrared communication module, a Bluetooth (registered trademark) communication module, a wireless LAN communication module, a Wireless USB, or a GPS receiver. In addition, the bus 116 transfers data, commands, and the like between the units of the imaging apparatus 100.

  Next, a recording operation of the imaging apparatus 100 will be described. When the user operates the operation unit 110 to output a power-on instruction, the operation unit 110 issues a start instruction to the control unit 109. Upon receiving this instruction, the control unit 109 controls a power supply unit (not shown) to supply power to each block of the imaging apparatus 100.

  When the power is supplied, the control unit 109 causes each block of the imaging device 100 to be set to a recording standby state. In the recording standby state, the control unit 109 causes the imaging unit 101 to perform moving image data shooting processing. The moving image data output from the imaging unit 101 is temporarily stored in the memory 111, the size is changed according to the size of the display unit 106 by the image processing unit 102, and is output to the display control unit 105. The display control unit 105 displays the moving image data from the image processing unit 102 on the display unit 106. In this way, the user prepares for shooting while looking at the screen displayed on the display unit 106.

  The user can change the number of pixels and the frame rate of a moving image to be recorded or the number of pixels of a still image to be recorded by operating the operation unit 110 in a recording standby state. In the recording standby state, the imaging unit 101 outputs moving image data having a predetermined frame rate, for example, 30 fps.

  When a still image recording instruction is output by the user operating the still image recording button of the operation unit 110 in the recording standby state, the control unit 109 transmits a control signal to each block of the imaging apparatus 100, and the following It controls to make it operate like this.

  The imaging unit 101 converts an optical image of a subject captured by a lens into an image signal using an imaging element, converts the image signal into a digital signal, and acquires still image data of one frame. The imaging unit 101 further performs various image quality adjustment processes (white balance, color, brightness, etc.) on the still image data, and sends them to the memory 111 and the display control unit 105. The image processing unit 102 reads and compresses still image data stored in the memory 111, and stores the compressed still image data in the memory 111. The recording / playback unit 107 reads still image data of one screen from the memory 111 and records a still image file including the still image data on the recording medium 108. The image processing unit 102 reads still image data from the memory 111 and reduces the size of the still image data to generate thumbnail image data. The recording / playback unit 107 reads out the thumbnail image data and stores it in the still image file recorded on the recording medium 108.

  The display control unit 105 reads still image data from the memory 111 and displays the still image data on the display unit 106 for a predetermined period. By viewing the still image displayed on the display unit 106, the user can confirm the captured still image. As described above, when the recording process of the still image of one screen is completed, the control unit 109 transmits a control signal to each block of the imaging apparatus 100 so as to shift to the recording standby state, and returns to the recording standby state.

  In the recording standby state, when the user operates the moving image recording button of the operation unit 110 to output a moving image recording start instruction, the control unit 109 transmits a control signal for instructing moving image recording to the imaging apparatus 100. Send to each block.

  The imaging unit 101 converts an optical image of a subject captured by a lens into an image signal using an imaging element, converts the image signal into a digital signal, and acquires moving image data. At this time, the imaging unit 101 acquires moving image data having the number of pixels and the frame rate set by the user in accordance with a control signal from the control unit 109. The imaging unit 101 further performs predetermined image quality adjustment processing on the moving image data, and sequentially stores them in the memory 111.

  On the other hand, the voice input unit 103 acquires voice data, performs level adjustment and the like, and outputs it. The control unit 109 sequentially stores the audio data obtained by the audio input unit 103 in the memory 111.

  The image processing unit 102 reads and encodes moving image data temporarily stored in the memory 111, generates compressed moving image data, and stores the compressed moving image data in the memory 111. Also, the audio processing unit 104 reads out and encodes audio data temporarily stored in the memory 111, generates compressed audio data, and stores the compressed audio data in the memory 111. The recording / playback unit 107 reads out the compressed moving image data and audio data at a predetermined timing, multiplexes them, and records them on the recording medium 108 as one moving image file. As described above, the moving image data and audio data recorded on the recording medium 108 are managed as one moving image file.

  Further, the display control unit 105 sequentially reads the moving image data from the memory 111, changes the screen size according to the display unit 106, and displays it on the display unit 106.

  During recording of the moving image file, the control unit 109 generates management information stored in the moving image file and sequentially stores it in the memory 111.

  When the user operates the operation unit 110 and the recording stop is instructed while the moving image is being recorded as described above, the control unit 109 controls each unit to stop recording the moving image. Is output. The image processing unit 102 stops encoding moving image data in response to a recording stop instruction, and the audio processing unit 104 stops encoding audio data in response to a recording stop instruction.

  Then, the recording / playback unit 107 reads the moving image data and audio data encoded before the recording stop instruction from the memory 111 and records them on the recording medium 108. After the recording of the moving image data and the audio data is stopped, the control unit 109 controls the recording / reproducing unit 107 to read out the first frame of the moving image data. Then, the control unit 109 decodes the head frame by the image processing unit 102 and further reduces the size of the frame to generate thumbnail image data. The recording / playback unit 107 stores the thumbnail image data at a predetermined position of the moving image file recorded on the recording medium 108.

  The control unit 109 further controls the recording / playback unit 107 so as to read the management information of the moving image file from the memory 111 and store it in the moving image file in response to an instruction to stop recording. The recording / playback unit 107 stores management information at a predetermined position of the moving image file recorded on the recording medium 108. When the recording of thumbnail image data and management information is completed in this way, the control unit 109 controls the recording / playback unit 107 to close the moving image file and end the recording.

  When the recording of the moving image file ends, the control unit 109 sets the imaging apparatus 100 to a recording standby state. In addition, the still image file and moving image file recorded on the recording medium 108 shall be recorded according to DCF (Design rule for Camera File system).

  Next, playback processing of a moving image file and a still image file recorded on the recording medium 108 will be described. When the user operates the operation unit 110 to instruct the playback mode, the control unit 109 controls each unit to set the playback mode.

  The control unit 109 controls the recording / playback unit 107 to read out the image data for each still image file and the thumbnail of the moving image file recorded on the recording medium 108. The read thumbnail image data is temporarily stored in the memory 111. The display control unit 105 reads the thumbnail image data from the memory 111, generates an index screen including a plurality of thumbnail images, and displays the index screen on the display unit 106. When the user operates the operation unit 110 to select any thumbnail image and instruct to play back, the control unit 109 plays back a still image file or a moving image file corresponding to the selected thumbnail image. It instructs the recording / reproducing unit 107.

  The recording / playback unit 107 reads the specified still image file or moving image file from the recording medium 108 and stores it in the memory 111. When the reproduction of the still image file is instructed, the image processing unit 102 reads out still image data from the memory 111, decodes it, and stores it in the memory 111. When the reproduction of the moving image file is instructed, the image processing unit 102 sequentially reads and decodes moving image data from the memory 111 and stores the decoded moving image data in the memory 111. When the reproduction of the moving image file is instructed, the audio processing unit 104 decodes the audio data reproduced together with the moving image data from the memory 111 and stores the decoded audio data in the memory 111.

  The display control unit 105 reads the decoded still image data or moving image data from the memory 111 and displays them on the display unit 106. In addition, the control unit 109 reads the audio data decoded from the memory 111 and outputs it from the speaker 114.

  If there is an index display instruction from the operation unit 110 during still image reproduction, the control unit 109 stops reproduction of the still image and displays the index screen on the display unit 106 again. In addition, when an instruction to stop reproduction is given from the operation unit 110 during moving image reproduction, the control unit 109 stops reproduction of the moving image and causes the display unit 106 to display the index screen again.

  Next, the format of the moving image file will be described with reference to FIG. The video file format (container format) handled in this embodiment is MP4. The moving image data is H.264. The audio data is encoded by the H.264 system and compressed by the AAC system.

In MP4, data stored in a file is described in a data structure called a box, and is recorded in the file in units of boxes. A box consists of the following fields:
Size: A 4-byte field representing the data size of the entire box including the Size field.
Type: A 4-byte type identifier representing the type of box.
Since the fields after the Type field are optional depending on the box, the description is omitted here. Further, the box can be included in the box, thereby realizing a nested structure.

  Reference numeral 201 denotes an ftyp (file type box), which represents a file type. Reference numeral 202 denotes a moov (movie box), which stores information related to audio and video including mvhd (movie header box) and trak (track box) described later. Reference numeral 203 denotes an mdat (movie data box) that stores actual data such as audio data, moving image data, and text.

  A typical box of the moov 202 will be described. Reference numeral 204 denotes a uuid (general-purpose unique identifier box) in which arbitrary identifiers and data are stored. Reference numeral 205 denotes an udta (user data box) that stores metadata such as the model name of the imaging apparatus 100, position information of the imaging apparatus 100 received by the communication unit 115, and UTC time. Reference numeral 206 denotes mvhd, which describes the creation date / time and modification date / time, time scale, duration and the like of the moving image.

  Reference numeral 207 denotes a trak (video track) for moving images, the type of encoding of the moving image data, stts (time sample box), stsc (sample chunk box), stss (synchronous sample box), and stsz (sample size box) described later. , Stco (chunk offset), etc., information related to moving image data in mdat is stored. Reference numeral 208 denotes an audio trak, which stores information related to audio data in the mdat such as the sampling frequency, the number of bits, and the number of channels. Reference numeral 209 denotes a text trak, which stores information on text data in the mdat.

  Reference numeral 210 denotes tkhd, which stores the creation date and time, duration, and ID of the track. In this embodiment, the video track ID is 1, the audio track ID is 2, and the text track ID is 3.

  Reference numeral 211 denotes an edts (edit box), which describes the playback start time of the track. For example, in the case where it is desired to shift the audio playback start later than the video playback start, it can be realized by writing a value in the audio edts. Reference numeral 212 denotes tref, which describes reference information between tracks. In the present embodiment, since the video track refers to the text track as a chapter, the video track tref is described with 3 being the ID of the text track, and to refer to it as a chapter, the identifier “chap” is described. Has been. The same applies to the audio track. There is no tref in the text track.

  Reference numeral 213 denotes stsc, which represents how many samples (frames in the case of moving images) each chunk is composed of. Reference numeral 214 denotes stts, which store the number of samples and the duration of each sample. Reference numeral 215 denotes stss, which describes a key frame number and exists only in the video trak. For example, when GOP (Group of Pictures) is 3, it is written as 1, 4, 7... When GOP is 12, 1, 13, 25. Are described as 1, 16, 31. Reference numeral 216 denotes stsz, which stores the data size of each sample. Reference numeral 217 denotes stco, which stores an offset from the beginning of each chunk file in the moving image data.

Reference numeral 218 denotes Wide, which is a 64-bit expansion box when the moving image file size is 4 GB or more. Reference numerals 219 and 220 denote text chunks stored in the mdat, and the titles of the chapters are described as text data. Reference numerals 221 and 222 denote audio chunk data stored in the mdat. Reference numerals 223 and 224 denote video chunk data stored in the mdat.
As described above, by using the information stored in the video stsz and stco, it is possible to access any video frame, audio data, and chapter in the mdat.

  Next, the album mode process will be described. The imaging apparatus 100 has a function of generating a single moving image by combining the still image file and the moving image file recorded on the recording medium 108 so as to be reproduced in a predetermined order. One moving image generated in this way is called an album in this embodiment. In the present embodiment, one album is selected from a file automatically selected by the control unit 109 from a still image file or a moving image file recorded on the recording medium 108 according to a predetermined condition, or a file selected by a user instruction. Generate.

  In the present embodiment, the music data of BGM stored in the nonvolatile memory 112 can be combined with the moving image of the album. Therefore, the still image file and the moving image file recorded on the recording medium 108 are converted into album moving image data and temporarily recorded on the recording medium 108. Thereafter, the temporarily recorded moving image data is read out, and further, a music file recorded in advance on the recording medium 108 is read out as will be described later, and is combined with the moving image data as BGM. Thereafter, the moving image data combined with the BGM is compressed and recorded on the recording medium 108 as the moving image data of the final album. Thereafter, the temporarily recorded moving image data is erased from the recording medium.

  FIG. 3 is a flowchart showing the playback mode processing including such album mode processing. The processing in FIG. 3 is executed by the control unit 109 controlling each unit. As described above, when the user operates the operation unit 110 to instruct the reproduction mode, the process of FIG. 3 is started.

  When the playback mode is instructed, the control unit 109 controls the recording / playback unit 107 to acquire information on still image files and moving image files recorded on the recording medium 108 (S301), and displays the index screen as described above. The information is displayed on the display unit 106 (S302).

  In this state, the control unit 109 determines whether switching to the album mode is instructed (S303). The user can instruct switching to the album mode by operating the operation unit 110 and displaying the menu screen on the display unit 106. If there is no instruction to switch to the album mode, other processing in the playback mode is performed (S311).

  When there is an instruction to switch to the album mode, the control unit 109 records the still image or moving image file that can be used for album generation on the recording medium 108 using the information acquired in S301. It is determined whether or not there is (S304). In the present embodiment, it is assumed that a still image file or a moving image file recorded by the imaging apparatus 100 itself in FIG. 1 is used for album generation, and a file recorded by another apparatus is not used. When a file that can be used for album generation is not recorded on the recording medium 108, a menu for selecting a target image in the album mode is displayed in gray out (S310). A menu screen 601 displayed at this time is shown in FIG. As a result, it is possible to notify the user that an image for which album generation is to be performed has not been recorded on the recording medium 108.

  When a file that can be used for album generation is recorded on the recording medium 108, the control unit 109 displays a menu screen on the display unit 106 for allowing the user to select conditions for album generation. To do. In this embodiment, an event, a date, a person, and custom are prepared as conditions. Here, when an event is selected, an album is generated from images recorded during a date period specified by the user. When a date is selected, an album is generated from images recorded on the date designated by the user. Further, when a person is selected, an image used for generating an album is selected based on information on the face of the person registered in advance in the imaging apparatus by the user. When custom is selected, the user selects an image to be used to generate an album by himself.

  The control unit 109 determines whether any type is selected (S305), and when an album type is selected, executes an album creation process (S306). The album creation process will be described with reference to FIG. Next, the control unit 109 determines whether or not to end the album mode (S307). If the album mode is not terminated, the process returns to S304. When the album mode is ended, the control unit 109 displays the index screen again on the display unit 106 (S308), and determines whether or not to end the reproduction mode (S309). When the reproduction mode is ended, the reproduction mode process is ended, and when the reproduction mode is not ended, the process returns to S303.

  Next, album creation processing will be described. FIG. 4 is a flowchart showing album creation processing. First, the control unit 109 generates a scenario according to a predetermined condition (S401). Here, the scenario refers to a file used to generate an album among still image files and moving image files recorded on the recording medium 108, a reproduction order thereof, the number of moving image frames generated from each file, and the like. Information. When an event or date is selected as the type of album, the control unit 109 selects a file from an image recorded on the specified date according to a predetermined condition. For example, the control unit 109 generates an album according to the result of analysis of each still image or moving image by the image processing unit 102 or the conditions such as the number of still images and moving images used to generate one album. Select a file to use and generate a scenario.

  Hereinafter, a part of a moving image generated from one still image file or a moving image file in an album is referred to as a chapter. The control unit 109 also describes information such as image effects such as fade processing between chapters in the album in the scenario. Moreover, you may comprise so that a user can set the frame rate of the album produced | generated. In this case, the control unit 109 also describes album frame rate information in the scenario. In this embodiment, the album frame rate is set to 30 fps regardless of the frame rate of the recorded moving image. The control unit 109 stores the generated scenario information in the memory 111.

  Next, the control unit 109 determines whether or not the recording medium 108 is set in a write-protected state (S402). For example, when the recording medium 108 is a memory card, it is possible to determine whether or not the writing is prohibited by detecting the state of the member for setting the writing prohibition. If the recording medium 108 is not in a write-protected state, the control unit 109 determines whether it is possible to create a file name to be added to the generated movie file of the album (S403).

  In this embodiment, the generated moving image file of the album is recorded on the recording medium 108. The control unit 109 determines whether or not a file name according to a predetermined rule can be added to the moving image file of the album. As described above, in this embodiment, a moving image file and a still image file are managed according to the DCF. In DCF, an upper limit (up to 999) of the number of directories that can be stored in the DCF directory and an upper limit (up to 9999) of the files that can be stored in one directory are defined. Here, it is determined that the file name cannot be created when the upper limit file (directory number 999) contains the upper limit file (file number included in the file name is 9999).

  If the file name of the movie file of the album can be created, the control unit 109 performs free space determination processing (S404). The free space determination process will be described with reference to FIG. Then, the control unit 109 determines whether or not the recording medium 108 has a free space necessary for storing the album (S405).

  When the recording medium 108 is write-protected (S402), when a file name cannot be created (S403), and when it is determined that the free space is insufficient (S405), the control unit 109 confirms preview reproduction. The screen is displayed on the display unit 106 (S406). For example, when the recording medium is set in a write-inhibited state in S402, a confirmation screen 602 in FIG. 6B is displayed on the display unit 106. If it is determined in S403 that a file name cannot be created, a confirmation screen 603 in FIG. 6C is displayed on the display unit 106. If it is determined in S405 that the free space is insufficient, a confirmation screen 604 in FIG. 6D is displayed on the display unit 106.

  After displaying the confirmation screen, the control unit 109 determines whether preview reproduction has been instructed (S407). When preview playback is instructed, the control unit 109 performs preview playback processing according to the scenario generated in S401 (S408). The preview reproduction process will be described later with reference to FIG.

  When canceling preview playback is selected and when preview playback ends, the control unit 109 displays both the album video creation item and the BGM setting item displayed in gray on the album setting menu screen. (S409). Then, the control unit 109 displays an album setting menu screen on the display unit 106 (S410). Here, as shown in FIG. 16B, the album moving image creation item 1607 and the BGM setting item 1608 are both grayed out and set so that the user cannot select them.

  In this state, the control unit 109 determines whether or not the end of the album mode is instructed by the user (S411). When the end of the album mode is instructed, the album creating process ends. If there is no instruction to end the album mode, the process returns to S407.

  On the other hand, when it is determined in S405 that there is free space, the control unit 109 performs a preview reproduction process according to the scenario generated in S401 (S412). Here, when it is determined that there is free space, the preview reproduction process is executed without confirming whether the user performs preview reproduction. Note that when the BGM setting process described in and after S413 is not performed for the scenario, the preview reproduction is performed for still images and moving images.

  After the preview reproduction process is completed, the control unit 109 performs a process for confirming the configuration of the BGM file (S413). In this embodiment, the music data for BGM stored in the non-volatile memory 112 has a function of synthesizing with the movie of the album. Therefore, the music data for BGM stored in the nonvolatile memory 112 in a compressed state is expanded and stored in the recording medium 108 in advance. This process is called a music file (BGM file) development process. Then, when generating the album moving image, the music file developed on the recording medium 108 is combined with the album moving image.

  In the present embodiment, the music data stored in the nonvolatile memory 112 is decompressed, added with a predetermined file name, and stored in the recording medium 108. Therefore, here, first, whether or not a directory (folder) having the same name as the file name added when the music data stored in the nonvolatile memory 112 is expanded on the recording medium 108 exists in the recording medium 108. Determine. If a directory having the same name as the music file does not exist in the recording medium 108, it is determined that the music file structure is normal.

  In addition, the control unit 109 records a file having the same name as the file name added when the music file is expanded on the recording medium 108 and the same extension as the expanded music file on the recording medium 108. If so, the file size is detected. And it is discriminate | determined whether the file size of the detected music file is below a predetermined file size. When the size of the detected music file is equal to or smaller than the predetermined file size, it is determined that the music file configuration is normal. In the present embodiment, the music data stored in the nonvolatile memory 112 is expanded and expanded on the recording medium 108 so that the size of the music file expanded on the recording medium 108 becomes a predetermined file size.

  Next, the control unit 109 determines whether or not the structure of the music file recorded on the recording medium 108 is normal (S414). If the file structure is normal, the control unit 109 sets all items to be displayed on the album setting menu screen to be normally displayed (S415). If the file configuration is not normal, the control unit 109 determines that BGM setting is not possible. Then, the control unit 109 sets the BGM setting items to be grayed out among the items displayed on the album setting menu screen, and sets predetermined warning information to be displayed (S416).

  Next, the control unit 109 displays a menu screen for album setting on the display unit 106 (S417). If it is set in S415 that all setting items are normally displayed, the menu screen 1601 in FIG. 16A is displayed. The menu screen 1601 includes four items 1602-1605. A menu screen 1601 shows a case where any setting item is valid. In the menu screen 1601, an item 1602 is an item for instructing preview reproduction, and an item 1603 is an item for instructing creation of an album moving image. An item 1604 is an item for instructing a setting related to BGM to be combined with the moving image of the album, and an item 1605 is an item for instructing a change in the color effect added to the moving image of the album.

  On the other hand, if the BGM setting item is grayed out and set to display predetermined warning information in S416, the menu screen 1609 in FIG. 16C is displayed. On the menu screen 1609, the BGM setting item 1610 is grayed out so that the user cannot select it. Further, predetermined warning information 1611 is displayed in the BGM setting item. The warning information 1611 can inform the user that the configuration of the music file developed on the recording medium 108 is not normal. In this state, the process of recording the BGM music file on the recording medium 108 is not performed. Further, neither the process of recording the moving image file of the album on the recording medium 108 nor the process of combining the BGM music data with the moving image of the album and recording it.

  Next, the control unit 109 determines whether it is possible to set so that BGM is combined with the album and recorded (S418). If the BGM setting is not possible, the control unit 109 determines whether or not the user has instructed to save the album (S419). When there is an instruction to save the album, the control unit 109 controls each unit to generate a moving image of the album according to the scenario and record it on the recording medium 108 (S420). The album storage process will be described later with reference to FIGS.

  If the setting of BGM is possible in S418, the control unit 109 determines whether or not an item for BGM setting has been selected on the menu screen (S421). When the BGM setting item is selected, the control unit 109 performs a BGM setting process (S423). The BGM setting process will be described later with reference to FIG.

  If the BGM setting item is not selected in S421, and if the album storage instruction item is not selected in S419, the control unit 109 determines whether preview reproduction is instructed (S422). If preview playback is instructed, the process returns to S412 to perform preview playback processing. If preview playback is not instructed, the process returns to S418.

  Next, the free capacity determination process in S404 will be described. FIG. 5 is a flowchart showing the free space determination process. First, the control unit 109 selects the first file in the playback order based on the scenario generated in S401 (S501). The control unit 109 obtains the number of chapter chapters of the album generated from this file, and obtains the amount of chapter data generated from this file based on the number of frames (S502).

  Here, when converting a still image into a moving image of an album, a still image of one screen is converted into a predetermined number of frames, for example, a moving image of 60 frames. When the album frame rate is 30 fps, a still image on one screen is converted into a moving image for 2 seconds. Also, when converting a moving image to an album, the number of frames can be obtained by converting the playback time of the original moving image to the frame rate (30 fps) of the album. Further, the data amount of each chapter is obtained from the obtained number of frames and the data rate (bit rate) of the moving image of the generated album.

  Next, the control unit 109 converts the obtained chapter data amount into the number of clusters which is a writing unit of the recording medium 108 (S503). For example, in a memory card, data is written based on a predetermined writing unit called a cluster. Next, the control unit 109 updates these by adding the newly acquired chapter frame number and cluster number to the total frame number and cluster number (S504).

  Then, the control unit 109 determines whether there is a remaining file specified in the scenario (S505). If there is a remaining file, the process returns to S502 and continues the processing (S506). Further, when the processing is completed for all the files described in the scenario, the control unit 109 obtains the size of the header (moov) of the moving image file of the generated album. Then, the header size is converted into the number of clusters and added to the total number of clusters (S507). Here, the control unit 109 obtains the header size of the moving image file of the album based on the total number of frames acquired in S504. That is, the total number of frames acquired in S504 is the number of frames of the moving image included in the generated moving image file of the album. Further, as described with reference to FIG. 2, the size of the header (moov) is a size corresponding to the number of frames of moving image data. Therefore, the control unit 109 calculates the header size based on the total number of frames.

  Next, the control unit 109 adds the number of clusters of moving image data temporarily generated to the total number of clusters when BGM is multiplexed on the moving images of the album (S508). The number of clusters to be added here is the total number of clusters of all chapters obtained in S504.

  Next, the control unit 109 decompresses the compressed music data for BGM stored in the non-volatile memory 112, converts the size necessary for recording on the recording medium 108 into the number of clusters, and calculates the total cluster. Add to the number (S509). Here, the required number of clusters is obtained as a predetermined size for one music file.

  Next, the control unit 109 detects the number of free clusters (number of unrecorded clusters) in the recording medium 108 (S510), and determines whether or not the number of free clusters is larger than the total number of clusters obtained in S509. It discriminate | determines (S511). If the number of free clusters is larger than the total number of clusters, the control unit 109 determines that there is free space (S512). If the number of free clusters is not larger than the total number of clusters, the control unit 109 determines that the free capacity is insufficient (S513).

  Thus, according to the processing of FIG. 5, the data amount of the moving image data of the album generated from the still image file and the moving image file specified in the scenario is calculated. Further, when the BGM is combined with the album, the data amount of the temporarily generated moving image data and the data amount necessary for recording the BGM music file are obtained. Then, based on the total data amount, it is determined whether or not the recording medium 108 has enough free space to generate the album.

  Next, the BGM setting process in S423 will be described. FIG. 7 is a flowchart showing BGM setting processing. First, the control unit 109 performs BGM expansion determination processing for detecting a music file that has been expanded on the recording medium 108 (S701). The BGM deployment determination process will be described with reference to FIG. Next, the control unit 109 determines whether or not a predetermined number of BGM music files have been developed on the recording medium 108 (S702). When all the music files corresponding to the predetermined number of BGM music data stored in the nonvolatile memory 112 have been recorded on the recording medium 108, the control unit 109 displays a BGM setting screen on the display unit 106 (S703). ). FIG. 16D shows a BGM setting screen 1612. Then, the control unit 109 performs setting processing using this setting screen (S704).

  The user uses the setting screen 1612 to set whether or not to synthesize BGM, and when recording BGM, whether to synthesize with voice, record only BGM, or which music to use as BGM. be able to. In addition, the setting screen 1612 can be used to instruct trial listening to BGM music. When the audition is instructed, the control unit 109 reads out the selected music file among the music files stored in the nonvolatile memory 112, decodes it by the audio processing unit 104, and outputs it from the speaker 114.

  In S702, when a predetermined number of BGM music files have not been developed on the recording medium 108, the control unit 109 displays a confirmation screen for inquiring the user whether or not to develop the music file on the recording medium 108. The information is displayed on the unit 106 (S706). Then, the control unit 109 determines whether or not the user has instructed expansion of the music file (S706). When it is instructed not to perform the music file development process, the control unit 109 displays the album setting menu screen on the display unit 106 and ends the process (S714).

  If an instruction to expand the music file is given, the control unit 109 reads the unexpanded music data from the nonvolatile memory 112, decompresses it by the audio processing unit 104, and stores it in the memory 111 (S707). Next, the control unit 109 generates header information of a file for recording the decompressed music data and stores it in the memory 111 (S708). The recording / reproducing unit 107 records the decompressed music data and the header on the recording medium 108 as a music file (S709). In this embodiment, the decompressed music data is recorded in the PCM format without being compressed.

  Next, the control unit 109 determines whether or not a predetermined number of music files have been developed on the recording medium 108 (S710). If the music file has been developed, the control unit 109 proceeds to S703 and displays a BGM setting screen. Displayed on the unit 106. On the other hand, when the predetermined number of music files have not been developed, the control unit 109 determines whether or not cancellation of the BGM setting process has been instructed (S711). If there is no cancel instruction, the process returns to S707 to continue decompression processing of undeveloped music data and recording of a music file.

  If there is a cancel instruction, the control unit 109 stops the decompression process of the music file currently being processed and the recording process to the recording medium 108 (S712), and deletes the music file being recorded from the recording medium 108. (S713). Then, an album setting menu screen is displayed on the display unit 106, and the process is terminated (S714).

  Next, the BGM expansion determination process in S701 will be described. This process is a process of detecting the number of BGM music files developed in a state that can be combined with the moving image of the album on the recording medium 108 and undeveloped music files. FIG. 8 is a flowchart showing the BGM development determination process.

  First, the control unit 109 acquires information about a music file for BGM recorded on the recording medium 108 (S801). Here, the file name and header information of the music file are acquired. As described above, in the present embodiment, when music data stored in the nonvolatile memory 112 is expanded and recorded on the recording medium 108, a predetermined file name is added and recorded. Also, the format of the music file to be recorded is a predetermined format. For example, in the present embodiment, the music file developed on the recording medium 108 is in the WAV format, and its extension is. Let it be wav.

  Further, the control unit 109 selects one of the music data compressed for BGM stored in the nonvolatile memory 112. Then, based on the information acquired in S801, it is determined whether or not the music file corresponding to the compressed music data is expanded on the recording medium 108 (S802). That is, it is determined whether or not a music file having a file name corresponding to the selected BGM music data is recorded on the recording medium 108. If the corresponding music file is not recorded on the recording medium 108, the control unit 109 stores this music data as an unexpanded file (S806).

  When a music file corresponding to the music data stored in the nonvolatile memory 112 is recorded on the recording medium 108, the control unit 109 determines whether the recorded file can be used for synthesizing the album. Is discriminated (S803). The header includes information necessary for reproducing music data, such as the sampling frequency of music data or the number of channels. The control unit 109 determines whether the sampling frequency of music data, the number of channels, or the like is a value that can be processed by the imaging apparatus 100. When it is determined that the image capturing apparatus 100 cannot process music data, it is determined that the image capturing apparatus 100 cannot be used to compose the album. If the recorded file is not usable for combining with the album, the control unit 109 stores that the music data is an undeveloped BGM file (S806). If the recorded music file can be used to synthesize the album, the control unit 109 stores that the music data is a developed BGM file (S804).

  Next, the control unit 109 determines whether or not an expanded determination process has been performed for all music data stored in the nonvolatile memory 112 (S805). When the developed determination process is completed for all music data, the process ends. In addition, when the expanded determination processing has not been completed for all music data, the control unit 109 selects the next music data from the music data stored in the nonvolatile memory 112, and returns to S702 (S807). .

  As described above, according to the processing of FIGS. 7 and 8, when all the music files for BGM have been developed on the recording medium 108, the setting screen is displayed in accordance with the setting instruction of BGM. Further, even if not all BGM music files have been developed on the recording medium 108, an undeveloped music file is automatically developed on the recording medium 108 in accordance with the BGM setting instruction.

  In addition, when all music files corresponding to a predetermined number of music data stored in the non-volatile memory 112 are not recorded on the recording medium 108, the BGM setting screen is not displayed, and the user instructs to synthesize BGM. Can not do it. For this reason, the process of synthesizing BGM with the moving image of the album is not performed.

  As described above, in the imaging apparatus 100, the music data for BGM is stored in the nonvolatile memory 112 in a compressed state, and is decompressed and then recorded on the recording medium 108 as a music file. Therefore, the storage capacity of the non-volatile memory 112 required for storing BGM music data can be reduced. Further, since the recording medium 108 is configured to be detachable, when the recording medium 108 to which the music file is not developed is loaded, the music file is recorded on the recording medium 108 again. Therefore, even when the recording medium 108 is replaced, BGM can be combined with the moving image of the album. In the present embodiment, prior to the process of synthesizing the BGM with the moving image of the album, the music data is decompressed and recorded on the recording medium 108 as a music file. In this way, in the process of synthesizing BGM with the moving picture of the album, the processing load is reduced, for example, the process of reading out and decompressing music data from the nonvolatile memory 112 and the process of synthesizing the music data are not performed simultaneously. can do.

  Next, the preview reproduction process in S408 and S412 will be described. FIG. 9 is a flowchart showing the preview reproduction process. First, the control unit 109 determines whether or not it is set to synthesize BGM (S901). When the BGM composition is set, the control unit 109 reproduces the music file selected as BGM from the recording medium 108 by the recording / reproducing unit 107 (S902). Then, the audio processing unit 104 processes the reproduced music file and sequentially stores it in the memory 111.

  Next, the control unit 109 selects the first file in the playback order from the files specified by the scenario (S903), and determines whether the file is a still image file or a moving image file (S904). . In the case of a still image file, the control unit 109 reproduces the still image file selected from the recording medium 108. Then, the reproduced still image data is decoded by the image processing unit 102, converted into YUV format image data, and stored in the memory 111 (S905). Next, the control unit 109 determines whether or not it is set to synthesize BGM (S906). If it is set to synthesize BGM, audio data included in the reproduced music file is output from the speaker 114. (S907).

  Further, the control unit 109 reads the decoded still image data of one screen from the memory 111, and performs predetermined processing by the image processing unit 102 (S908). Here, processing for changing the number of pixels of still image data in accordance with the number of pixels of the display unit 106, processing for combining various information such as recording date and time into a still image, processing for various image effects, and the like are performed. . Then, the control unit 109 displays a still image for one frame on the display unit 106 (S909), and determines whether or not a still image having the number of frames set per chapter of the still image file has been displayed (S909). S910). If no still image of the set number of frames is displayed, the process returns to S906. When the set number of still images have been displayed, the control unit 109 determines whether or not the reproduction of all the files specified in the scenario has been completed (S911).

  When the reproduction of all the files is completed, the control unit 109 determines whether or not the setting for synthesizing the BGM is made. When the setting for reproducing the BGM is made, the reproduction of the music file from the recording medium 108 is stopped. (S914). In the present embodiment, the reproduction time of the audio data stored in each BGM music file is set to several seconds to several tens of seconds. Therefore, one music file is repeatedly reproduced from the recording medium 108 during preview reproduction and during BGM synthesis processing described later. Alternatively, one music file may be read from the recording medium 108 and stored in the memory 111, and repeatedly read from the memory 111 and output.

  If the reproduction of all the files specified in the scenario is not completed in S911, the control unit 109 selects the next file in the scenario reproduction order, and the process proceeds to S904.

  In S904, when the selected file is a moving image file, the control unit 109 reproduces the selected moving image file from the recording medium 108. Then, the reproduced moving image data is decoded by the image processing unit 102, converted into YUV format image data, and stored in the memory 111 (S915). Further, the control unit 109 determines whether or not sound is recorded along with the moving image in the reproduced moving image file (S916). If audio data is included, the reproduced audio data is decoded by the audio processing unit 104 and sequentially stored in the memory 111 (S917). If no audio data is included, the control unit 109 controls the audio processing unit 104 to output silent audio data (S918).

  Next, the control unit 109 determines whether it is set to synthesize BGM (S919). If the BGM synthesis setting is used, the audio processing unit 104 synthesizes the audio data included in the reproduced music file and the audio data reproduced together with the moving image data or silent audio data, and outputs from the speaker 114. (S920).

  At this time, the composition ratio between the music data of BGM and the reproduced audio data is described in the scenario. That is, in the BGM setting process of S704, when BGM + audio is set, the BGM music data and the reproduced audio data are synthesized so that the audio levels are 50%, respectively. Further, if it is set to output only BGM, the music data level of BGM becomes 100% and synthesis is performed so that reproduced audio data is not output. If it is not set to synthesize BGM, audio data reproduced together with the moving image or silent audio data is output from the speaker 114 (S921).

  In addition, the control unit 109 reads one screen of the decoded moving image data from the memory 111, and performs predetermined processing by the image processing unit 102 (S922). Here, as in the case of a still image, processing for changing the number of data pixels to match the number of pixels in the display unit 106, processing for combining various information such as recording date and time into a still image, or various images Process effects, etc. In the case of moving image data, if the frame rate of the moving image of the album is different from the frame rate of the moving image data, a frame rate conversion process is also performed.

  Then, the control unit 109 displays one frame of moving image on the display unit 106 (S923), and determines whether or not a moving image having the number of display frames set per chapter is displayed (S924). For video files, all the video data contained in one file is displayed. If the moving image data of the set number of frames is not displayed, the process returns to S915. When the display of all the frames of the moving image data is completed, the reproduction of the moving image file is stopped (S925), and the process proceeds to S911.

  Next, the album storage process in S420 will be described. FIG. 10 is a flowchart showing album storage processing. In the album saving process, each still image file and moving image file specified in the scenario is converted into one chapter moving image of the scenario, and each chapter is recorded on the recording medium 108 as one moving image file. These moving image files are combined into one file. When BGM is not synthesized, the combined file is recorded as a movie file of the album. When synthesizing BGM, the combined file is read from the recording medium 108 as temporarily converted moving image data, and music data for BGM that has been developed on the recording medium 108 is read. The read moving image data and audio data are decoded, synthesized with BGM music data, then compressed again and recorded on the recording medium 108.

  In FIG. 10, the control unit 109 selects a file in the playback order from the files specified by the scenario (S1001), and determines whether the file is a still image file or a moving image file (S1002). ). If the file is a still image file, the control unit 109 performs conversion processing from a still image to a moving image (S1003). In the case of a moving image file, conversion processing from a moving image to a moving image is performed (S1004).

  When the process for one file is completed, the control unit 109 determines whether or not the conversion process to the moving image has been completed for all the files specified in the scenario (S1005). Then, the next file is selected and the process returns to S1002 (S1006).

  When the processing for all the files specified in the scenario is completed, the control unit 109 performs processing for generating one moving image file from the converted moving images of each chapter (S1007). As will be described later, in the moving image file generation processing in the present embodiment, the file name when generating one moving image file is changed depending on whether or not the setting for synthesizing BGM is made. For example, in the case of setting to synthesize BGM, the generated moving image file is a temporary file for synthesizing BGM. Therefore, for example, a predetermined temporary file name is added and the extension is tmp. The temporary file name may be a fixed file name, for example, or may be dynamically added like the file generation time. If the setting is not to synthesize BGM, a file name and extension according to the DCF rules are added. Next, the control unit 109 determines again whether or not it is set to synthesize BGM according to the scenario (S1008). If it is set to synthesize BGM, BGM synthesis processing is performed (S1009). . In the BGM synthesis process, the control unit 109 adds a file name and extension in accordance with the DCF rules, and generates a new album movie file in the DCF directory on the recording medium 108. If it is not set to synthesize BGM, the control unit 109 moves the moving image file to the DCF directory and records it on the recording medium 108 as an album moving image file (S1010).

  Next, conversion processing from a still image to a moving image will be described. FIG. 11 is a flowchart showing a conversion process from a still image to a moving image. First, the control unit 109 creates a file for recording the converted moving image data on the recording medium 108 (S1101). In the present embodiment, one chapter of moving image data generated from one still image file or moving image file is recorded on the recording medium 108 as one file. Therefore, here, a file for recording the converted moving image data is opened on the recording medium 108. Here, the converted moving image file is created in a directory different from the DCF directory. Moreover, although the format of the video file of each chapter is the MP4 format, it may be a format other than this.

  Next, the control unit 109 reads the selected still image file from the recording medium 108 by the recording / playback unit 107. Then, the read still image data is decoded by the image processing unit 102, converted into YUV format image data, and stored in the memory 111 (S1102). The decoded still image data of one screen is read from the memory 111, and predetermined processing is performed by the image processing unit 102 (S1103). Here, processing for converting the number of pixels of the image data to a predetermined number of pixels, here 1280 pixels by 720 pixels, processing for combining various types of information such as the number of chapters from the beginning, etc. The image effects are processed.

  Then, still image data for one frame is encoded by the image processing unit 102 (S1104), and silent audio data is encoded by the audio processing unit 104 and stored in the memory 111 (S1105). Next, the recording / reproducing unit 107 reads the encoded image data and audio data from the memory 111 and records them on the recording medium 108 (S1107). Note that the recording / reproducing unit 107 does not record each time one frame of image data is encoded, but in accordance with the fact that a predetermined amount of encoded image data and audio data are stored in the memory 111. The encoded image data and audio data may be recorded on the recording medium 108.

  Next, the control unit 109 determines whether or not the image data having the number of frames set per chapter of the still image file is encoded and recorded (S1107). If image data of the set number of frames has not been recorded, the process returns to S1103. When the set number of still images have been recorded, the control unit 109 stops recording the image data, generates management information (moov) of the moving image file, and the recording / playback unit 107 causes the recording medium 108 to be recorded. (S1108). Then, the control unit 109 closes the chapter moving image file and ends the process (S1109).

  Next, the moving image file conversion process will be described. FIG. 12 is a flowchart showing a moving image file conversion process. First, the control unit 109 creates a file for recording the converted moving image data on the recording medium 108 (S1201). Next, the control unit 109 reads the selected moving image file from the recording medium 108 by the recording / playback unit 107. Then, the read moving image data is decoded by the image processing unit 102, converted into YUV format image data, and stored in the memory 111 (S1202). Further, the control unit 109 determines whether or not audio data is included in the read moving image file (S1203). If the audio data is included, the control unit 109 decodes the audio file and stores the data in the memory 111. (S1204). If no audio data is included, the audio processing unit 104 outputs silent audio data (S1205).

  Then, the control unit 109 reads the decoded one-screen moving image data from the memory 111, and performs predetermined processing by the image processing unit 102 (S1206). Here, processing for converting the number of pixels of the image data to a predetermined number of pixels, here 1280 pixels by 720 pixels, processing for combining various types of information such as the number of chapters from the beginning, etc. The image effects are processed.

  Then, the moving image data for one frame is encoded by the image processing unit 102 (S1207), and the audio data is encoded by the audio processing unit 104 and stored in the memory 111 (S1208). At this time, by setting the data rate of the audio data to be encoded to be higher than the data rate of the music data for BGM, the sound quality in the moving image of the album can be improved. Next, the recording / reproducing unit 107 reads the encoded moving image data and audio data from the memory 111 and records them in the recording medium 108 (S1209). Note that the recording / reproducing unit 107 does not record each time one frame of image data is encoded, but in accordance with the fact that a predetermined amount of encoded image data and audio data are stored in the memory 111. The encoded image data and audio data may be recorded on the recording medium 108.

  Next, the control unit 109 determines whether or not the image data having the number of frames set per chapter of the moving image file is encoded and recorded (S1210). If image data having the set number of frames has not been recorded, the process returns to S1202. When the set number of still images have been recorded, the control unit 109 stops recording the image data, generates management information (moov) of the moving image file, and the recording / playback unit 107 causes the recording medium 108 to be recorded. (S1211). Then, the control unit 109 closes the chapter moving image file and ends the process (S1212).

  As described above, the still image file and the moving image file specified by the scenario are each converted into one chapter moving image in the album, and are recorded on the recording medium 108 as the moving image file.

  Next, the moving image file creation process in S1007 will be described. The moving image file creation process is a process of generating one moving image file by combining the moving image files of the chapters recorded on the recording medium 108 by the processes of FIGS. 11 and 12. FIG. 13 is a flowchart showing a moving image file creation process.

  First, the control unit 109 determines whether it is set to synthesize BGM according to the scenario (S1301). If the setting is to synthesize BGM, the control unit 109 sets, for example, a predetermined temporary file name and a file name with an extension of tmp (S1302). If the setting is not to synthesize BGM, the file name and extension according to the DCF rules are set (S1303).

  Next, the control unit 109 detects, from the moving image file recorded on the recording medium 108, the moving image file of the chapter corresponding to the file whose reproduction order is designated at the top by the scenario generated in S401. Then, in order to combine the moving image file of the next chapter to be reproduced with the moving image file of the first chapter, the management information of the moving image file of the first chapter is changed based on the moving image file of the next chapter (S1304). ).

  Then, the moving image data and audio data of the next chapter are added to the top file (S1305). Here, the moving image data and the audio data are added by changing the FAT chain in the FAT file system, but the recording positions of the moving image data and the audio data may be moved. Next, the control unit 109 determines whether there is a remaining chapter specified in the scenario (S1306). If there is a remaining chapter, the control unit 109 returns to S1304 to add a moving image file of the next chapter. . As described above, when the combination of the moving image files of all the chapters is completed, the processing is ended.

  In this way, the moving images corresponding to the files specified in the scenario are combined into one moving image. As described above, in this embodiment, a predetermined file name is added as the file name of the combined file. Further, the combined moving image file is stored in a directory different from the DCF directory.

  If the BGM is not synthesized with the combined moving image file, the combined moving image file is moved to the DCF directory and recorded as an album moving image file in the process of S1010.

  On the other hand, if BGM composition is set, the combined moving image file is read from the recording medium 108 and decoded by the processing of S1009, and the BGM music data is synthesized, and then encoded again to be the album moving image file. Record as. Therefore, in this case, the combined moving image file recorded by the processing of FIG. 13 is managed as a temporary moving image file for BGM synthesis. Next, such BGM synthesis processing will be described. FIG. 14 is a flowchart showing BGM synthesis processing.

  The control unit 109 reads the music file selected as BGM from the recording medium 108 by the recording / playback unit 107 (S1401). Then, the audio processing unit 104 sequentially stores the read music files in the memory 111. Next, the recording / reproducing unit 107 reads the combined moving image file from the recording medium 108. The read moving image data is decoded by the image processing unit 102 and stored in the memory 111, and the read audio data is decoded by the audio processing unit 104 and stored in the memory 111 (S1402).

  Next, the control unit 109 controls the audio processing unit 104 to synthesize the audio data included in the read music file and the audio data decoded and stored in the memory 111 and store the synthesized data in the memory 111. (S1403). At this time, the synthesis ratio between the music data of BGM and the audio data included in the moving image file is described in the scenario. That is, in the BGM setting process in S704, when BGM + audio is set, the BGM music data and the audio data included in the moving image file are combined so that the audio levels are 50%. Further, when it is set to output only BGM, the music data level of BGM becomes 100%, and the audio data included in the moving image file is not included.

  As described above, the BGM synthesis process repeatedly reads one music file from the recording medium 108. Alternatively, one music file is read from the recording medium 108 and stored in the memory 111, and is repeatedly read from the memory 111 and output.

  Next, the control unit 109 determines whether or not the number of frames from the beginning of the read moving image data has reached the number of frames for starting audio fade-out (S1404). When the number of frames for starting fade-out has been reached, the control unit 109 controls the audio processing unit 104 to gradually lower the level of audio data synthesized with BGM (S1405).

  Then, the moving image data stored in the memory 111 is encoded by the image processing unit 102 and stored in the memory 111. Also, the voice data synthesized with the BGM is read from the memory 111 by the voice processing unit 104, encoded, and stored in the memory 111 (S1406). Next, the control unit 109 controls the recording / playback unit 107 to read the encoded moving image data and audio data from the memory 111 and record them as one moving image file on the recording medium 108 (S1407). The moving image file recorded here is a moving image file of the album. Therefore, here, the moving image file is stored in the DCF folder, and further, the file name of the moving image file is added based on the file name of the file already stored in the DCF folder.

  The recording / reproducing unit 107 records the encoded image data and audio data on the recording medium 108 in response to the predetermined amount of encoded image data and audio data being stored in the memory 111. . Also, chapter information or the like is not added to the moving image data encoded here. That is, tref 212, trak (text) 209, text chunks 219, 220, etc. are not recorded.

  Next, the control unit 109 determines whether or not moving image data having the set number of frames has been processed (S1408), and returns to S1402 if the processing is not completed. Here, the total number of frames of the moving image data stored in the moving image files combined by the processing of FIG. 13 is the set number of frames.

  When the processing of the moving image data of the set number of frames is completed, the control unit 109 stops reading of the combined moving image file and BGM music file by the recording / reproducing unit 107 (S1409). Then, the control unit 109 generates management information (moov) of the moving image file of the album combined with the BGM, and records it on the recording medium 108 (S1410). When the recording of the album moving image file is completed, the control unit 109 deletes the combined moving image file recorded by the processing of FIG. 13 from the recording medium 108 (S1411).

  As described above, in the album mode, as shown in FIG. 17A, the still image file 1701 and the moving image file 1702 specified by the scenario are converted into one chapter of moving image data 1703 and 1704, respectively. The converted moving image data is recorded on the recording medium 108 as a moving image file. Further, the moving image files of each chapter are combined to generate a combined moving image file 1705. When the BGM is not synthesized, the saving destination directory of the combined moving image file 1705 is changed and recorded as an album moving image file 1706.

  If the setting is to synthesize BGM, the moving image data and audio data of the combined moving image file 1705 are respectively decoded as shown in FIG. On the other hand, the BGM music file 1710 developed on the recording medium 108 is read out and synthesized with the audio data. The decoded moving image data 1707 and the synthesized audio data 1708 are encoded again and recorded on the recording medium 108 as the moving image file 1709 of the album. Also, the combined moving image file 1705 is deleted from the recording medium.

  Thus, if the album moving image file 1706 and the moving image file 1709 are generated in order, for example, when creating an album moving image file, processing for converting the number of pixels, processing of various image effects, etc., and audio data for BGM Even when decoding, encoding, or synthesizing processing cannot be performed simultaneously due to processing load or the like, an album file can be generated with a simple operation. Further, the moving image file 1709 is recorded in a storage location different from the storage location of the moving image file 1706, and is automatically deleted after the moving image file 1706 is recorded, thereby preventing the user's usability and the free space of the recording medium from decreasing. be able to.

  Next, a process of synthesizing and recording audio data and BGM when recording a moving image will be described. FIG. 15 is a flowchart showing a process when BGM is synthesized and recorded. When the user operates the operation unit 110 in the recording standby state to instruct a recording mode for BGM synthesis, the processing in FIG. 15 is performed.

  First, the control unit 109 performs processing for confirming the configuration of the BGM file (S1501). This process is the same as the process of S413. Next, the control unit 109 determines whether or not the configuration of the music file recorded on the recording medium is normal (S1502). If the file configuration is normal, the control unit 109 performs BGM expansion determination processing shown in FIG. 8 (S1503). If the file structure is not normal, the control unit 109 determines that BGM recording is not possible, displays warning information indicating that BGM cannot be recorded on the display unit 106 for a predetermined period, and ends the process (S1521). .

  After completing the processing in S1503, the control unit 109 determines whether or not a predetermined number of BGM music files have been developed on the recording medium 108 (S1504). In the case where the development has been completed, the control unit 109 displays the BGM setting screen shown in FIG. 16D on the display unit 106 (S1505), and the BGM setting process by the user is performed (S1506) and set. The BGM music file is reproduced from the recording medium 108 and stored in the memory 111 (S1507).

  If it is determined in S1504 that the predetermined number of BGM files have not been expanded, the control unit 109 determines whether the recording medium 108 has a capacity necessary for expanding the BGM music file. (S1518). If the capacity is insufficient, the control unit 109 determines that BGM recording is not possible, displays warning information indicating that BGM cannot be recorded on the display unit 106 for a predetermined period, and ends the process (S1521).

  If there is free space, the control unit 109 reads an unexpanded music file among the BGM music files stored in the nonvolatile memory 112 and decompresses it by the audio processing unit 104 (S1519). Then, the control unit 109 records the decompressed music data on the recording medium 108 as a BGM music file by the recording / playback unit 107 (S1520), and displays the BGM setting screen on the display unit 106 (S1505). .

  After the reproduction of the BGM music file in S1507 is completed, the control unit 109 sets the imaging apparatus 100 to a recording standby state (S1508). If a BGM setting instruction is issued again in the recording standby state (S1509), the process returns to S1505, and a BGM setting screen is displayed on the display unit 106. The control unit 109 detects an instruction to start recording in the recording standby state (S1510), starts capturing moving image data by the imaging unit 101, and the image processing unit 102 encodes the moving image data from the imaging unit 101. And stored in the memory 111 (S1511). At the same time, audio data is acquired by the audio input unit 103 (S1512), and the acquired audio data and the BGM music data read from the recording medium 108 and stored in the memory 111 are stored by the audio processing unit 104. Synthesized. The composition ratio at this time follows the ratio described in the scenario. The voice processing unit 104 encodes the synthesized voice data and stores it in the memory 111 (S1513).

  Next, the control unit 109 reads the encoded moving image data and audio data from the memory 111 and records them as a moving image file on the recording medium 108 (S1514). In this way, moving image data and synthesized voice data of voice data and BGM are recorded. The control unit 109 determines whether or not there is an instruction to stop recording (S1515), and when there is no instruction to stop recording, recording is continued. Also. If there is an instruction to stop recording, the control unit 109 stops recording moving image data and audio data on the recording medium 108 (S1516). Further, the control unit 109 stops reading the music file from the recording medium 108 (S1517).

  In the present embodiment, the reproduction time of the audio data stored in each BGM music file is set to several seconds to several tens of seconds. For this reason, during recording of a moving image, one music file is repeatedly read or reproduced from the recording medium 108. Alternatively, one music file may be read from the recording medium 108 and stored in the memory 111, and repeatedly read from the memory 111 and output.

  Next, a moving image editing process will be described. In the playback mode, the user can edit the moving image by operating the operation unit 110 to select one of the moving image files recorded on the recording medium 108 and instructing the start of editing. In the present embodiment, an editing process for deleting a part of the designated moving image is performed. Here, three types of editing, that is, before-cut, after-cut, and hollow out of a moving image will be described.

  The pre-cut editing is a process of deleting from the beginning of the moving image to the editing position designated by the user. Post-cut editing is a process of deleting from the editing position designated by the user to the end of the moving image. The hollow edit is a process of deleting from the deletion start position specified by the user to the deletion end position, and combining the moving images before and after that to form one moving image. That is, according to the hollow edit process, the moving image from the beginning to the deletion start position and the deletion end position to the moving image end position are combined and recorded as one moving image. Also, pre-cut and post-cut edits are possible. In this case, the processing is to delete from the beginning of the moving image to the editing start position (In point) specified by the user and from the editing end position (Out point) specified by the user to the end of the moving image.

  Further, in the present embodiment, an addition indicating that the BGM is synthesized with the movie of the album synthesized with the BGM in the album mode and the movie recorded with the BGM synthesized at the time of shooting by the processing of FIG. Add information and record. For example, the control unit 109 adds the additional information indicating that BGM is synthesized to the header of the moving image file in FIG. Further, when the BGM is synthesized with the moving image of the album, the chapter information described in FIG. 2 is not recorded. Therefore, based on this chapter information, it may be determined whether or not the BGM is synthesized. .

  FIG. 18 is a flowchart showing the editing process. When the user operates the operation unit 110 to select one of the moving image files recorded on the recording medium 108 and instruct to start editing, the processing in FIG. 18 is started. The processing in FIG. 18 is executed by the control unit 109 controlling each unit.

  First, the control unit 109 determines whether or not BGM is combined with the moving image file to be edited based on the header information of the moving image file designated as the editing target (S1801). When the BGM is a synthesized moving image, the control unit 109 prohibits the editing with no outline (S1802). If the BGM is a moving image that has not been combined, the control unit 109 permits hollow editing (S1803).

  Then, the control unit 109 controls the display control unit 105 to display an editing screen on the display unit 106 (S1804). If hollow editing is permitted, the editing position for the front-cut editing (editing start position), the editing position for the post-cut editing (editing end position), and the hollow-cut editing start position (deletion start position) ) And an icon for designating the end position (deletion end position) are displayed on the editing screen. On the other hand, when outline editing is prohibited, icons for specifying the edit position for front-cut edit and edit position for post-cut edit are displayed on the edit screen, and the edit start position and end position are specified. The icon for specifying is not displayed. Therefore, with respect to a moving image in which BGM is synthesized, editing with no outline is prohibited. The user can designate the editing position by operating the operation unit 110 while viewing the editing screen.

  Next, the control unit 109 determines whether or not an editing position has been designated (S1805), and if the editing position has been designated, stores the designated editing position in the memory 111 (S1806). Further, the user can operate the operation unit 110 to instruct to save the edited moving image. The control unit 109 determines whether saving of the edited moving image has been instructed (S1807). When the storage is instructed, the control unit 109 controls the recording / playback unit 107 to edit the moving image data based on the designated editing position (S1808), and stores the edited moving image data in the recording medium 108. (S1809). If there is no save instruction in S1807, the control unit 109 determines whether an instruction to end the editing process has been given (S1810). If the end of the editing process is instructed, the process ends. If not, the process returns to S1804 to continue the process.

  When the BGM-combined moving image is edited while being omitted, it is conceivable that the BGM is reproduced discontinuously at the joint portion between the head portion and the rear end portion of the moving image. In the present embodiment, hollow editing is prohibited for a moving image synthesized with BGM. For this reason, it is possible to prevent the BGM from being reproduced discontinuously due to the hollow editing.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 101 ... Imaging part, 102 ... Image processing part, 103 ... Audio | voice input part, 104 ... Audio | voice processing part, 107 ... Recording / reproducing part, 108 ... Recording medium, 109 ... Control part, 111 ... Memory, 112 ... Non-volatile memory, 110 ... Operation part

Claims (10)

A video acquisition means for acquiring video data ;
An acquisition means for acquiring music data;
In accordance with an instruction for combining the video data and the music data, and recording control means for control so as to record said music data and the video data to the combining to a recording medium,
Video data of the editing target, if music data is a moving image data that have been synthesized, and until the deletion start position from the beginning of the moving image data of the editing target, the end position of the moving image data of the editing target from the deletion end position The first editing process that combines the above-mentioned parts is not allowed to be executed, and the editing target moving image data is deleted from the beginning of the editing target moving image data to the deletion end position, or the editing starts from the deletion start position. Control means for performing control so that the second editing processing for deleting up to the end of the target moving image data is executable ;
Recording apparatus characterized by having a. Wherein, the moving image data of the edited, if the music data is a moving image data that has not been synthesized, claim 1, wherein the controller controls so as to enable execution of the first editing process The recording device described in 1. The recording control means, when combining and recording moving image data and the music data, adds information indicating that the music data has been combined to the moving image data to be combined and recorded. The recording apparatus according to claim 1 or 2. The recording apparatus according to claim 3, wherein the recording control unit adds information indicating that the music data is combined to a header of the moving image data to be combined and recorded. The control means determines whether or not the music data is synthesized according to information included in the moving image data to be edited, and performs control so that the first editing process cannot be executed. The recording apparatus according to claim 1 or 2. The control means performs control so that the first editing process cannot be executed when information indicating that the music data is synthesized is added to the moving image data to be edited. Item 5. The recording apparatus according to Item 3 or Item 4. Display control means for controlling the display of the editing position for the video data to be edited;
Wherein, the moving image data of the edited, if the music data is a moving image data that have been synthesized, controlling the display control means so as not to display an edit position of the first editing process The recording apparatus according to claim 1 . It said display control means controls the display of information corresponding to the respective front Symbol deletion start position and the deletion end position,
Said control means, wherein the video data of the edited, the music data for controlling the display control means so that when a moving image data that has been synthesized, not display the deletion start position and the deletion end position The recording apparatus according to claim 7 . A video acquisition process in which the video acquisition means acquires video data;
An acquisition means for acquiring music data; and
Recording control means, in accordance with an instruction for combining the said the moving image data music data, a recording control step of controlling to record on a recording medium by combining with the music data and the video data,
Control means, the moving image data of the editing target, if the music data is a moving image data that have been synthesized, and until the deletion start position from the beginning of the moving image data of the edited, from the deletion end position of the editing target The first editing process for combining the portion up to the end position of the video data is not executable, and the video data to be edited is deleted from the beginning of the video data to be edited to the deletion end position, or is deleted A control step for controlling to enable execution of the second editing process for deleting from the start position to the end of the video data to be edited ;
Control method for a recording apparatus characterized in that it comprises a. The program for functioning a computer as each means of the recording device of any one of Claim 1 to 8 .

Images