JP4189555B2 - Moving picture editing apparatus and program thereof - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a moving image editing apparatus and a program thereof, and more particularly to a moving image editing apparatus that executes an editing operation on a plurality of moving image data.
[0002]
[Prior art]
Conventionally, there is a digital camera as a typical moving image photographing apparatus. Such shooting with a digital camera is different from shooting with a conventional silver salt camera, and digital image processing can be performed on image data shot during or after shooting.
In addition to performance improvements due to increased processing speed and storage capacity, it has become possible to shoot not only still images but also moving images.
When there are two captured moving image files (hereinafter referred to as moving image file 1 and moving image file 2), the user may want to create one moving image file by combining moving image file 1 and moving image file 2. In such a case, the moving image file 1 and the moving image file 2 are simply combined manually or the moving image editing is performed manually to provide a scene change effect between the moving image file 1 and the moving image file 2. We are joining.
[0003]
Further, the following patent publication discloses an image processing system that automatically edits a moving image. This image processing system generates management information for associating information for specifying the location of moving image data in which a subject is recorded with the time at which the subject is recorded, and edits the management information based on the management information, This makes it possible to autonomously generate new video data with consistency for the subject.
[0004]
[Patent Literature]
Japanese Patent Laid-Open No. 10-215434 (see paragraph “0023” and paragraph “0028”)
[0005]
[Problems to be solved by the invention]
However, the conventional digital camera has the following problems because one moving image file is generated when moving image shooting is finished.
(1) If the user mistakenly ends the movie shooting, even if the movie shooting is started immediately, it is recorded as a separate file. I had to edit at.
(2) When a moving image is shot with a digital camera, the shooting stops in about 30 seconds. Therefore, even when a series of related moving images are shot, a plurality of moving images There was a drawback of being recorded as a file.
(3) Even if the editing work is performed, if there are a plurality of moving image files, it takes time and effort, so the editing work is difficult.
Moreover, such a problem could not be solved even by the technique disclosed in the above-mentioned patent document.
[0006]
Therefore, the present invention has been made in view of such conventional problems, and provides a moving image editing apparatus capable of automatically editing a plurality of related moving image data as one moving image data, and a program thereof. The purpose is to do.
[0007]
[Means for Solving the Problems]
  In order to achieve the above object, a moving image editing apparatus according to the first aspect of the present invention comprises: first moving image data acquisition means for acquiring first moving image data;
  Second moving image data acquisition means for acquiring second moving image data;
  The first moving image dataLast frame data ofAnd the second video dataEach frame data in order from the start frameA comparison means for comparing;
  Based on the comparison result of the data by the comparison means, the first moving image dataLast part ofAnd the second video dataIs overlapping with the start ofDetermination means for determining whether or not,
  By the determination meansDuplicateA combination means for combining the first moving image data and the second moving image data and editing it into one moving image data;
  It is provided with.
[0008]
  Further, for example, as described in claim 2, the first moving image data acquisition unit and the second moving image data acquisition unit acquire moving image data from a recording medium capable of recording moving image data. Also good.
  For example, as described in claim 3, the moving image editing apparatus includes:
  A moving image editing apparatus capable of shooting a shooting object,
  The first moving image data acquisition means includesRecordableThe moving image data may be acquired from the recording medium, and the second moving image data acquisition unit may acquire the captured moving image data.
[0009]
  MaClaim4As described above, the determination means includes
  When it is determined that the video data is within a predetermined range based on the comparison result by the comparison means,DuplicateMay be determined.
  Claims5As described in the above, the predetermined range may be arbitrarily set by the user.
  Claims6As described above, the combining means is determined by the determining means.The last frame data of the first moving image data and the start frame data of the second moving image data overlap.If it is determined that the start frame data of the second moving image data is combined after the final frame data of the first moving image data, the moving image data may be edited into one moving image data.
[0010]
  MaClaim7The coupling means is as described in
  By the determination meansDuplicateIn the case where it is determined that the second moving image data is duplicated, the overlapping portion of the second moving image data is deleted, and after the final frame data of the first moving image data, the remaining second moving image data is combined to 1 One moving image data may be used.
[0011]
  Also, for example, the claim8As described above, when the comparison is performed by the comparison means, the position, shape, or size of the object displayed in the frame data to be compared may be compared.
  Claims9As described in the above, when combining by the combining means, the combined moving image data is recorded on the recording medium, and the acquired moving image data to be combined is deleted from the recording medium. Good.
[0012]
  Claim10The program according to the described invention isOn the computer,
  Get first video dataFirst video data acquisition functionWhen,
  Get second video dataSecond video data acquisition functionWhen,
  The first moving image dataLast frame data ofAnd the second video dataEach frame data in order from the start frameCompareComparison functionWhen,
  ComparisonfunctionThe first moving image data based on the data comparison result byLast part ofAnd the second video dataIs overlapping with the start ofWhether or notJudgment functionWhen,
  The determination functionByDuplicateIs determined, the first moving image data and the second moving image data are combined and edited into one moving image data.Combined functionWhen,
  Themake it happenIt is characterized by that.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings as an example applied to a digital camera.
[0014]
(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of the digital camera 1. The digital camera 1 constitutes a moving image editing apparatus, and has a CCD 2 and a DSP / CPU 3. The DSP / CPU 3 is a one-chip microcomputer that has various digital signal processing functions including image data compression / decompression and audio data processing, and controls each part of the digital camera 1. In particular, a moving image file recorded on the memory card 13, that is, moving image data, is acquired via the interface 12 and the data bus 9 and stored in the DRAM 10. This function corresponds to moving image data acquisition means. The moving image data acquisition means acquires first moving image data (hereinafter referred to as moving image data 1) and second moving image data (hereinafter referred to as moving image data 2) from the memory card 13. Note that the moving image data 1 and the moving image data 2 are arbitrarily acquired. At this time, an identification symbol is attached to the acquired moving image data so that it can be understood that the acquired moving image data 1 and moving image data 2 are acquired.
[0015]
Further, the DSP / CPU 3 compares the acquired moving image data. At this time, the final frame data of the moving image data 1 and the start frame data of the moving image data 2 may be compared, and the position, shape, and size of the object of the frame data may be compared. This function corresponds to a comparison means.
Then, the DSP / CPU 3 determines whether or not the contents of the two frame data match based on the comparison result, and determines that the moving image data 1 and the moving image data 2 are combined in the case of the approximate match. To do. This function corresponds to determination means.
[0016]
Further, when the DSP / CPU 3 determines to combine, the moving image data 1 and the moving image data 2 stored in the DRAM 10 are combined. At this time, the moving image data 2 is combined after the moving image data 1, and this function corresponds to a combining means. The combined moving image data is recorded on the memory card 13 through the data bus 9 and the interface 12 as one moving image file. At this time, the DSP / CPU 3 deletes the moving image data 1 and the moving image data 2 recorded in the memory card 13.
[0017]
A TG (Timing Generator) 4 that drives the CCD 2 is connected to the DSP / CPU 3, and a unit circuit 5 that receives an analog imaging signal corresponding to the optical image of the subject output from the CCD 2 is connected to the TG 4. Has been. The unit circuit 5 is a CDS (Correlated Double Sampling) circuit that samples and holds an image pickup signal output from the CCD 2 by sampling a correlated double signal, a gain adjustment amplifier (AGC) that amplifies the image pickup signal, and digitally outputs the image pickup signal after amplification. It is composed of an A / D converter (AD) for converting it into a signal, and the output signal of the CCD 2 is sent to the DSP / CPU 3 through the unit circuit 5 as a digital signal.
[0018]
The DSP / CPU 3 is connected to a display device 6, a key input unit 7, and an audio processing unit 8, and to a DRAM 10, a built-in flash memory 11, and a card interface 12 through an address / data bus 9. A detachable memory card 13 attached to a throttle (not shown) of the main body of the digital camera 1 is connected to the card interface 12.
[0019]
The display device 6 includes a color LCD and its driving circuit, and displays the subject image captured by the CCD 2 as a through image when in the shooting standby state, and reads out from the memory card 13 as a storage memory when reproducing the recorded image. The expanded recorded image is displayed. The key input unit 7 includes a plurality of operation keys such as a shutter button, a recording start / end button used for moving image shooting, a power key, and a MENU key, and outputs a key input signal corresponding to a key operation by the user to the DSP / CPU 3. To do.
[0020]
The sound processing unit 8 includes a built-in microphone, an amplifier, an A / D converter, a built-in speaker, a D / A converter, and the like. When shooting a still image or a moving image with sound, the sound input to the built-in microphone is converted into a digital signal. The data is converted and sent to the DSP / CPU 3. The audio data sent to the DSP / CPU 3 is sequentially accumulated in the DRAM 10 and finally stored in the memory card 13 together with the image data generated by the DSP / CPU 3. The audio processing unit 8 reproduces audio based on audio data attached to each video and outputs the audio from the built-in speaker when reproducing a still image or moving image with audio. In addition, various notification sounds are reported by a built-in speaker as necessary.
[0021]
The DRAM 10 is used as a buffer memory for temporarily storing digitized subject image data and the like as a working memory of the DSP / CPU 3 after being imaged by the CCD 2, and a moving image file recorded on the memory card 13 is stored in the card. The data is stored via the I / F 12 and the address / data bus 9, and processing necessary for editing is performed.
[0022]
In the built-in flash memory 11, a control program necessary for control of each unit by the DSP / CPU 3, that is, a moving image file is acquired from the memory card 13, an editing operation and a moving image file are compared, and it is determined whether or not to combine them. In addition, a program necessary for various controls including a program for coupling, and data necessary for each control are stored, and the DSP / CPU 3 operates according to the program.
[0023]
That is, the DSP / CPU 3, the address / data bus 9, the card I / F 12, the memory card 13, the DRAM 10, and the built-in flash memory 11 constitute a first moving image data acquiring unit and a second moving image data acquiring unit, and the DSP / CPU 3 The address / data bus 9, the DRAM 10, and the built-in flash memory 11 constitute comparison means, determination means, and coupling means.
[0024]
Next, the operation of the digital camera 1 having the above configuration will be described. FIG. 2 is a flowchart showing the processing procedure of the DSP / CPU 3 when the user sets the moving image shooting mode.
When the user operates the key input unit 7 to set the moving image shooting mode, it is possible to photograph the scenery and scenery that the user wants to shoot with a digital camera and record the photographed video on a memory card or the like.
[0025]
When the moving image shooting mode is set, the DSP / CPU 3 starts shooting by the CCD 2 and displays a through image of the subject on the display device 6 (step S1). The through image is an object imaged by the CCD 2 is stored in the DRAM 10, the stored image is displayed on the display screen, and the object imaged by the CCD 2 is changed to update the image stored in the DRAM 10. The video displayed on the display screen also changes. In the through display state, the video stored in the DRAM 10 is displayed as it is, but since the video data is not recorded in the memory card 13, the video data is not saved.
Next, when it is determined that the user has pressed the shutter button while the through image is displayed (step S2), a moving image (moving image frame) is captured at a predetermined frame rate (fixed period of 1/30 seconds). The stored moving image shooting process is started (step S3). Until the shutter button is pressed, the process stays in step S2 and the through display continues.
[0026]
When the shutter button is pressed (step S4) or when 30 seconds have elapsed since the start of the moving image shooting process (step S5), the moving image shooting process is stopped (step S6). ) A moving image file is generated using the moving image data developed above and stored in the memory card 13 (step S7). Then, it returns to step S1.
By repeating this operation, moving image files are sequentially recorded on the memory card 13, and the plurality of moving image files are recorded on the memory card 13. The moving image files recorded on the memory card 13 are moving image data 1 and moving image data 2 to be edited later.
If the shutter button is not pressed in step S4 and 30 seconds have not elapsed since the start of the moving image shooting process (NO in step S5), the process returns to step S4, and the moving image shooting process is performed until the shutter button is pressed or 30 seconds have elapsed. Will continue.
[0027]
Next, editing of a moving image file stored in the memory card 13 will be described. When editing a video file, when a single continuous video is recorded in multiple video files, the video files are automatically combined into a single video file. To do.
When the user operates the key input unit 7 to set the moving image editing mode, the moving image data recorded on the memory card 13 is sent by the DSP / CPU 3 via the card I / F 12 and the address / data bus 9. And stored in the DRAM 10. Here, the moving image data stored in the DRAM 10 is selected by the DSP / CPU 3. Here, for convenience, only two moving image data are selected.
[0028]
FIG. 3 shows moving image data stored in the DRAM 10, and reference numerals 20 and 40 in FIGS. 3A and 3B denote start frames of the moving image data, and reference numerals 30 and 50 denote final frames. The moving image data includes a start frame and a final frame, and a plurality of frames between them. The direction of the arrow t represents the passage of time.
[0029]
FIG. 3A shows moving image data 1 stored in the DRAM 10, and FIG. 3B shows moving image data 2.
Also, 60 in FIG. 3A shows an image of the last frame data (hereinafter referred to as frame data) of the moving image data 1, and 70 in FIG. 3B shows the start frame data of the moving image data 2. An image is shown.
In the final frame data of the moving image data 1 and the start frame data of the moving image 2, an image including the mountain 100, the house 110, and the boundary line 120 between the mountain and the ground is shown.
Note that the moving image data 2 may be selected from moving image data having a shooting time closest to the moving image data 1 and moving image data shot after the shooting time of the moving image data 1.
[0030]
Next, moving image editing will be described based on the flowchart of FIG.
When the moving image editing mode is set, moving image data 1 is acquired from the memory card 13 in step S11. An identification symbol or the like is attached to the moving image data acquired at this time so that the moving image data 1 is acquired. Next, the final frame data of the moving image data 1 acquired in step S12 is acquired.
Next, the moving image data 2 is acquired at step S13. At this time, an identification symbol or the like is added to the acquired moving image data so that it can be understood that the acquired moving image data 2 is acquired as the moving image data 2 for the currently acquired moving image data 1. The start frame of the moving image data 2 acquired in step S14 is acquired. Therefore, based on this identification symbol, it is determined whether or not the video data 1 and the video data 2 have been acquired.
[0031]
The final frame data of the moving image data 1 acquired in step S15 and the start frame data of the moving image data 2 are compared. If it is determined in step 16 that they do not match, it is determined that they are not combined, and the process proceeds to step 18. If it is determined in step S16 that they match, it is determined that they are combined.
For example, the moving image data shown in FIGS. 3A and 3B are determined to be combined because the final frame data 30 of the moving image data 1 and the start frame data 50 of the moving image data 2 match.
[0032]
If it is determined in step S16 that the images are combined, the process proceeds to step 17 where the moving image data 2 is combined after the moving image data 1. FIG. 5 shows the combined moving image data, where 80 is the last frame 30 of the moving image data 1 and 90 is the starting frame 50 of the moving image data 2.
The combined moving image data is recorded as a new moving image file on the memory card 13 via the address / data bus 9 and the card I / F 12.
Since the identification symbol is used, when moving image data is acquired and compared, the same moving image data is not acquired and compared again. Even when moving image data is generated, the same moving image data is not generated again.
In addition, when the generated moving image file is stored in the memory card 13, the moving image data (moving image file) acquired as the moving image data 1 and the moving image data 2 may be deleted from the memory card 13.
That is, even if the moving image data 1 and the moving image data 2 are acquired and the new moving image data A is generated, the same moving image data is acquired again as the moving image data 1 and the moving image data 2 and the same moving image data A is generated. Because there is no, there is no generation of the same moving image data.
[0033]
If it is determined in step S16 that they are not combined, the process proceeds to step S18, and it is determined whether or not there is moving image data in the memory card 13 that is not acquired as moving image data 2 for the moving image data 1 that is currently acquired. If it is determined that there is, the process returns to step S13, and the moving image data not acquired as the moving image data 2 for the currently acquired moving image data 1 is newly acquired from the memory card 13. If it is determined that there is not, the process proceeds to step S19.
Here, the moving image data already acquired as the moving image data 2 with respect to the currently acquired moving image data 1 is not acquired again, but the moving image data is newly acquired as the moving image data 1 as described below. The moving image data recorded on the memory card 13 is all moving image data that is not acquired as the moving image data 2. That is, whether or not the video data 2 is acquired is determined based on the video data 1.
[0034]
If a moving image file is generated in step S17 or if it is determined in step S18 that there is no moving image file, the process proceeds to step S19 to determine whether there is moving image data not acquired as moving image data 1 in the memory card 13. If it is determined that there is, the process returns to step S11, new moving image data is acquired from the memory card 13, and the same operation is repeated. If it is determined that there is no video editing mode, the video editing mode is terminated. The determination as to whether or not the moving image data 1 and moving image data 2 have been acquired is made based on the identification symbol attached to the moving image data, so that the same moving image file is acquired again and several pieces of the same moving image data are obtained. Is not generated.
When new moving image data is generated in step S17, the generated moving image data is also included in moving image data not specified as moving image data 1 and moving image data 2. Therefore, new moving image data is added in step S17. Is generated, the moving image editing mode is not terminated. Thereby, when three or more moving image data also have continuity and relevance, they can be automatically edited into one moving image data.
[0035]
Next, how to compare in step S15 and determine in step 16 will be described with reference to FIGS.
FIG. 6 is a diagram showing a subroutine of the comparison unit in step S15 and the determination unit in step S16 in FIG.
7A, 7B, and 7C show images of frame data of a moving image file.
The image of the frame data in FIG. 7 includes a mountain 100, a house 110, and a boundary line 120 between the mountain and the earth. FIGS. 7A, 7B, and 7C are all the same objects. , The location where the photo was taken is different.
[0036]
In step S101 of FIG. 6, the objects of the final frame data of the moving image data 1 and the start frame data of the moving image data 2 are specified. The thing which specified the target object becomes FIG.7 (d), (e), (f). In step S102, the position, shape, and size of the object are acquired. In this case, the position, shape, and size of each mountain and house are specified.
Next, in step S103, the positions, shapes, and sizes of the objects of the final frame data of the moving image data 1 and the starting frame data of the moving image data 2 are respectively compared.
[0037]
Next, when it is determined that the object positions match as a result of comparing the positions of the objects in step S104, the process proceeds to step S105, and when it is determined that the object shapes match in step S105. Proceeds to step S106, and if it is determined that they match as a result of comparing the sizes of the objects in step S106, the process proceeds to step S107, where it is determined to be combined. Then, the process proceeds to step S17 in FIG. If it is determined in step S104 to step S106 that the position, shape, and size of the object do not match, the process proceeds to step 18 in FIG.
[0038]
7A is an image of the last frame data of the moving image data 1, and FIG. 7B is an image of the starting frame data of the moving image data 2, the last frame data of the moving image data 1 and the start of the moving image data 2 are assumed. In the frame data, the positions, shapes, and sizes of the mountains are the same, and the shapes and sizes of the houses are also the same. However, since the positions of the houses are different, it is not determined to be combined.
Note that the coincidence of the position, shape, and size of the object may not be completely the same. This matching range may be set in advance or may be arbitrarily set by the user. Further, weighting may be performed by changing the range of coincidence of the position, shape, and size of the object. For example, when the range of coincidence related to the position of the object is widened or the determination related to the position of the object is not performed, it is determined that FIG. 7A and FIG. Become. Further, if the shapes match, they may be matched, or may be determined based on criteria other than the criteria for determining position, shape, and size, such as color.
[0039]
As described above, when the moving image editing mode is set, the moving image data recorded on the memory card 13 is acquired as the moving image data 1 and the moving image data 2 and stored in the DRAM. Next, when the moving image data 1 and the moving image data 2 are stored in the DRAM 10, the final frame of the moving image data 1 and the start frame of the moving image data 2 are acquired, and the two frame data are compared. If it is determined as a result of the comparison that the two frame data are the same, it is determined that the moving image data 1 and the moving image data 2 are combined.
Next, the moving image data 1 and the moving image data 2 stored in the DRAM 10 are combined. At this time, as a combining method, moving image data 2 is combined after moving image data 1.
Next, the combined moving image data is recorded on the memory card 13 via the address / data bus 9 and the card I / F 12.
As a result, continuous and related moving images are automatically edited as one moving image file.
[0040]
As described above, in the first embodiment, even if continuous and related videos are separately recorded in a plurality of moving image files, the continuous and related moving image files are automatically generated. Since it is edited into one moving image file, the labor and time involved in the editing work can be greatly reduced.
Also, once video recording is finished, it is recorded as one video file, and even if video recording is started immediately, video data is recorded as another video file, but there is continuity and relevance If the video files are the same, even if the user ends the video recording by mistake, if the video recording is started immediately, it is automatically edited into one video file.
Furthermore, even if the user deliberately ends the movie shooting or starts a new movie shooting, if the finished moving image and the started moving image have continuity and relevance, they are automatically edited. For example, if the object to be photographed is a moving image of scenery, scenery, plants, etc., it will be edited as a single moving image, so if you shoot regularly, the scenery will change, the growth of plants will be one, etc. It can be edited as one video file.
[0041]
When shooting a movie with a digital camera, the moving image shooting automatically ends as soon as about 30 seconds elapse. It can be edited as one video file.
In addition, by editing video files on a computer, etc., you can easily and automatically edit multiple video data with a large data capacity. Also, video files shot at the same place with multiple digital cameras at the same time, If there is continuity and relevance, it can be edited as one video file.
[0042]
In the first embodiment, the digital camera is used to perform automatic editing. However, the present invention is not limited to the digital camera, and the memory card 13 in which the moving image file is recorded is read into a personal computer or the like. Needless to say, it can be automatically edited on a personal computer.
Further, not only the memory card 13 but also a moving image file acquired from the Internet may be automatically edited by downloading it to a personal computer or the like.
[0043]
(Second Embodiment)
Next, a second embodiment of the present invention will be described. In the video editing of the second embodiment, the video data recorded on the memory card 13 and the video data currently being shot, that is, the video that has already been recorded and the video that has been shot are related to continuity. If it is determined that there is a characteristic, simultaneously with the end of the movie shooting, the recorded movie data and the movie data that has just been shot are combined and recorded in the memory card 13 as one movie data. is there.
Therefore, in the second embodiment, since the editing work is performed during shooting, the moving image editing mode is not necessary.
The second embodiment also uses a digital camera having the same configuration as that shown in FIG.
The DSP / CPU 3 stores the digitized subject image data in the DRAM 10 after being imaged by the CCD 2, and this function corresponds to the photographed moving image data acquisition means.
Since other functions are the same as those of the first embodiment, description thereof is omitted.
[0044]
The moving image editing according to the second embodiment will be described with reference to the flowcharts of FIGS.
When the user operates the key input unit 7 to set the moving image shooting mode, shooting by the CCD is started in step S21 and a through display of the subject is displayed on the display device 6. If it is determined in step S22 that the user has pressed the shutter button in the through display state, the process proceeds to step S23, and a moving image (moving image frame) is captured and stored at a predetermined frame rate (fixed period of 1/30 seconds). The moving image shooting process is started. If it is determined in step S22 that the shutter button has not been pressed, the process stays in step S22 until the shutter button is pressed, and the through display continues.
[0045]
In step S24, start frame data when the moving image shooting process is started is acquired. Next, moving image data is acquired from the memory card 13 in step S25. At this time, an identification symbol or the like is attached to the acquired moving image data so that the acquired moving image data can be recognized. Next, the final frame data of the moving image data acquired in step 26 is acquired. Therefore, based on this identification symbol, it can be determined whether or not the acquired moving image data.
Note that when a new moving image shooting is started, this identification symbol is deleted.
[0046]
In step S27, the start frame data when shooting is started and the final frame data of the moving image data acquired from the memory card 13 are compared. In step S28, it is determined whether or not these two data match. The range of coincidence may be set in advance or may be arbitrarily set by the user. If it is determined that they match, it is determined to be combined, and the process proceeds to step S29. If it is determined that they do not match, it is determined not to be combined, and the process proceeds to step S33.
[0047]
In step S28, it is determined that the images are combined, and in step S29, it is determined whether or not the shutter button is pressed. If it is determined that the shutter button is pressed, the process proceeds to step S31. Proceed to In step S30, it is determined whether 30 seconds have elapsed since the start of the moving image shooting process. If it has elapsed, the process proceeds to step S31. If it is determined that it has not elapsed, the process returns to step S29.
[0048]
That is, a moving image is shot until the shutter button is pressed or 30 seconds after the moving image shooting process is started, and the shutter button is pressed or the moving image shooting process is started. When 30 seconds have elapsed, the process proceeds to step S31, and the moving image shooting process is stopped.
[0049]
When the moving image shooting process is stopped in step S31, the process proceeds to step S32, and the moving image data including the final frame data acquired from the memory card 13 stored in the DRAM 10 and determined to be the same in step S28. And the video data expanded in the buffer memory. At this time, the moving image data expanded in the buffer memory is combined after the moving image data acquired from the memory card 13. Next, one moving image file is generated using the combined moving image data, and is recorded in the memory card 13.
At this time, the moving image data acquired from the memory card 13 may be deleted from the memory card 13.
[0050]
If it is determined in step S28 that they do not match, the process proceeds to step S33, and in step S33, it is determined whether there is moving image data not acquired in the memory card 13, and if it is determined that there is Returns to step S25, acquires new moving image data from the memory card 13, and repeats the same operation.
If it is determined in step S33 that there is not, the process proceeds to step S34 to determine whether the shutter button has been pressed. If it is determined that the button has been pressed, the process proceeds to step S36. If it is determined that the button has not been pressed, the process proceeds to step S35.
[0051]
In step S35, it is determined whether 30 seconds have elapsed since the start of the moving image shooting process. If it is determined that 30 seconds have elapsed, the process proceeds to step S36, and if it is determined that 30 seconds have not elapsed. Returns to step S34.
That is, a moving image is shot until the shutter button is pressed or until 30 seconds elapses after the moving image shooting process is started, and the shutter button is pressed or the moving image shooting process is started. When 30 seconds have elapsed, the process proceeds to step S36, and the moving image shooting process is stopped.
[0052]
In step S36, the moving image shooting process is stopped, and in step S37, a moving image file is generated using the moving image data developed in the buffer memory and recorded in the memory card 13.
That is, it is determined that there is no series of continuously related moving image data in the memory card 13, and without performing moving image editing between the captured moving image data and the moving image data stored in the memory card 13, The captured moving image is stored in the memory card 13.
[0053]
The comparison in step S27 and the determination of whether or not to combine in step S28 are performed by specifying each object of the frame data and determining the position, shape, and size of the object as described in the first embodiment. Are compared to determine whether they match. In this case, the criterion for determining whether or not they match may be set in advance, or can be arbitrarily set by the user. For example, if the position, shape, and size match, it can be determined to match, or only the shape or another requirement such as color can be determined to match.
[0054]
As described above, when the moving image photographing process is started, the moving image data recorded in the memory card 13 is acquired and stored in the DRAM 10. Next, the start frame data of the moving image data being shot and the final frame data of the moving image data acquired from the memory card 13 are acquired, and the two frame data are compared. As a result of the comparison, if it is determined that the two frame data match, it is determined to be combined. If it is determined that they do not match, it is determined that they are not combined, new moving image data is acquired from the memory card 13, and the above-described comparison and determination are performed.
When it is determined to be combined and the moving image shooting is finished, the acquired moving image data and the moving image data after the shooting are combined. At this time, as a combining method, moving image data that has been shot is combined after the acquired moving image data.
[0055]
The combined moving image data is recorded on the memory card 13 via the address / data bus 9 and the card I / F 12.
At this time, the moving image data acquired from the memory card 13 may be deleted.
If it is determined that the moving image data being shot and all the moving image data recorded on the memory card 13 do not match, and if it is determined not to be combined, the moving image data is shot without performing the combining operation. The moving image data is recorded on the memory card 13 alone. That is, the editing operation is not performed, and the moving image shooting operation is normally performed.
As a result, continuous and related moving images can be automatically edited during shooting.
[0056]
As described above, in the second embodiment, the editing work is performed during shooting, so that the video being shot has relevance and continuity with the video already recorded on the memory card 13. Can automatically combine the video recorded at the end of shooting with the video that has been shot and record it as one moving image file.
In addition, since the editing work is performed during shooting, it is possible to eliminate the labor and time associated with the editing work.
In addition, once movie shooting is finished, it will be recorded as one movie file, but if you start movie shooting immediately, editing work will be performed during shooting, so the recorded movie file data and shooting will be Combined moving image data can be recorded as one moving image file.
[0057]
In video shooting with a digital camera, moving image shooting automatically ends as soon as about 30 seconds elapse, but even in this case, if you start shooting immediately, editing work will be performed during shooting, so continuity, Relevant images can be recorded as a single video file.
Even if the user intentionally ends moving image shooting and a certain amount of time elapses, even if the moving image shooting is started, the recorded moving image and the moving image being recorded are If there is, the video editing work will be done during shooting. For example, if the object to be shot is a moving image such as landscape, landscape, plant, etc. Can be recorded as one video file.
[0058]
(Third embodiment)
Next, a third embodiment of the present invention will be described. The moving image editing of the third embodiment is to combine moving image data having overlapping portions, that is, moving image data having overlapping images, among a plurality of moving image data recorded on the memory card 13. is there.
At the time of this combination, the overlapping part of either one of the moving image data is deleted and combined.
The third embodiment also uses a digital camera having the same configuration as that shown in FIG.
When the user operates the key input unit 7 to set the moving image editing mode, the DSP / CPU 3 transfers the moving image data recorded on the memory card 13 to the DRAM 10 via the card I / F 12 and the address / data bus 9. To remember. Here, for convenience, only two moving image data are selected.
[0059]
FIG. 10 shows two moving image data stored in the DRAM 10, 200 and 400 in FIGS. 10A and 10B represent start frames of the moving image data, and 300 and 500 represent the final moving image data. Represents a frame. The moving image data includes a start frame and a final frame, and a plurality of frames between them. The direction of the arrow t represents the passage of time.
FIG. 10A shows moving image data 1 stored in the DRAM 10 and FIG. 10B shows moving image data 2.
[0060]
The moving image editing according to the third embodiment will be described with reference to the flowcharts of FIGS.
When the moving image editing mode is set, moving image data 1 is obtained from the memory card 13 in units of files in step S51. At this time, an identification symbol or the like is attached to the acquired moving image data 1 so that the acquired moving image data 1 is acquired.
Next, the process proceeds to step S52, and the final frame data of the moving image data 1 is acquired. In step S53, the moving image data 2 is acquired from the memory card 13 in units of files. At this time, an identification symbol or the like is added to the acquired moving image data so that it can be understood that the acquired moving image data is acquired as moving image data 2 for moving image data 1.
Next, start frame data of the moving image data 2 is acquired in step S54. Then, the process proceeds to step S55. Therefore, based on this identification symbol, it is determined whether or not the video data 1 and the video data 2 have been acquired.
[0061]
In step S55, the acquired two frame data are compared, and in step S56, it is determined whether the two frame data match based on the comparison result. As described in the first embodiment, this comparison and determination method may be determined based on the position, shape, and size of the object. Moreover, you may make it judge with a color other method.
[0062]
If it is determined in step S56 that they do not match, the process proceeds to step S57, and it is determined whether or not the last frame data of the moving image data 2 is included in the two compared frame data.
If it is determined in step S57 that the frame data is not included, the process proceeds to step S58, where the frame data immediately after the compared frame data of the moving image data 2 is acquired, and the process returns to step S55. That is, the frame data of the moving image data 2 is acquired until it is determined that they match, and the final frame data of the moving image data 2 is sequentially compared.
If it is determined in step S57 that the two compared frame data include the final frame data of the moving image data 2, it is determined that there is no overlapping portion between the moving image data 1 and the moving image data 2; Proceeding to S 64, new moving image data is acquired from the memory card 13 as moving image data 2 for the currently acquired moving image data 1.
[0063]
As a result of the sequential comparison, if it is determined in step S56 that they match, the process proceeds to step S59. Assume that the data of the final frame 300 of the moving image data 1 and the frame 700 of the moving image data 2 shown in FIG. In step S59, it is determined whether there is start frame data of moving image data 2 in the two compared frame data. If it is determined that there is, the process proceeds to step S63. If it is determined that there is no start frame data, step S60 is determined. Proceed to
Since the frame 700 portion of the moving image data 2 in FIG. 10 is not a start frame, it is determined in step S59 that it is not included, and the process proceeds to step S60.
[0064]
In step S60, the data of the frame immediately before the frame compared with the moving image data 1 (frame data) and the frame data immediately before the frame compared with the moving image data 2 are respectively acquired. Compare two frame data. Next, the process proceeds to step S62, and it is determined whether or not the two frame data match based on the comparison result. If it is determined that they do not match, the process proceeds to step S64. If it is determined that they match, the process returns to step S59 and the same operation is repeated.
[0065]
As a result of repeating this operation, if it is determined that the frame data of the moving image data 1 and the frame data of the moving image data 2 match each other up to the start frame of the moving image data 2, there is overlapped data. And the process proceeds to step S63.
That is, as shown in FIG. 10, the last frame data 300 of the moving image data 1 and the frame data 700 of the moving image data 2 match, and then the frame data immediately before the frame 300 of the moving image data 1 and the moving image data 2 This is a state in which the frame data immediately before the frame 700 coincides and the frame data 600 of the moving image data 1 and the start frame data 400 of the moving image data 2 coincide as a result of comparison in this order. This is frame data determined to have the hatched portions shown in FIG.
[0066]
If it is determined that they do not match, it is determined that there is no overlapping portion between the moving image data 1 and the moving image data 2, it is determined that they are not combined, and the process proceeds to step S 64, where the currently acquired moving image data As the moving image data 2 for 1, new moving image data is acquired from the memory card 13.
When it is determined that the frame data of the moving image data 1 and the frame data of the moving image data 2 match each other up to the start frame data of the moving image data 2, that is, the start frame data of the moving image data 2 is included in step S59. If it is determined that the moving image data 1 and the moving image data 2 are duplicated, it is determined that they are combined. Next, the process proceeds to step S63.
[0067]
In the above description, the case where there is duplicate data has been described. However, there is a case where it is determined that the data is combined even if there is no duplicate data.
More specifically, as a result of comparing the final frame data of the moving image data 1 acquired in step S52 with the start frame data of the moving image data 2 acquired in step S54 (step S55), if the data match (step S56) Since the matched frame data naturally includes the start frame data of the moving image data 2, it is determined to be combined (step S59).
That is, the invention of the third embodiment includes the invention of the first embodiment, and even if there is no duplicate data, continuity and related moving image data are determined to be combined. .
[0068]
In step S63, the moving image data 1 and the moving image data 2 are combined to generate a new moving image file. At this time, the combining method deletes the overlapping portion of the moving image data 2 and combines the deleted moving image data 2 after the moving image data 1. That is, it is as shown in FIG. In FIG. 13, 800 is a portion that was the start frame 200 of the moving image data 1, 900 is a portion that was the frame 600 of the moving image data 1, and a frame having substantially the same data as the start frame 400 of the moving image data 2. It is. Reference numeral 1000 denotes a portion that was the last frame 300 of the moving image data 1 and a frame having substantially the same data as the frame 700 of the moving image data 2. Reference numeral 1100 denotes a portion that was the last frame 500 of the moving image data 2.
Further, the hatched portion in FIG. 13 indicates data determined that the moving image data 1 and the moving image data 2 are overlapped.
In this embodiment, the overlapping portion of the moving image data 2 is deleted and combined. However, the overlapping portion of the moving image data 1 may be deleted and the moving image data 1 and the moving image data 2 may be combined.
[0069]
The newly generated moving image file is recorded on the memory card 13 via the address / data bus 9 and the card I / F 12.
Since the identification symbol is used, when moving image data is acquired and compared, the same moving image data is not acquired and compared again. Even when moving image data is generated, the same moving image data is not generated again.
In addition, when the generated moving image file is stored in the memory card 13, the moving image data (moving image file) acquired as the moving image data 1 and the moving image data 2 may be deleted from the memory card 13.
That is, even if the moving image data 1 and the moving image data 2 are acquired and the new moving image data A is generated, the same moving image data is acquired again as the moving image data 1 and the moving image data 2 and the same moving image data A is generated. Because there is no, there is no generation of the same moving image data.
When this operation is completed, the process proceeds to step S65.
[0070]
If it is determined in step S62 that they do not match or if it is determined in step S57 that the final frame data is included, it is determined that there is no overlapping data in the moving image data 1 and the moving image data 2. Then, the process proceeds to step S64. Then, it is determined whether or not there is moving image data not acquired as moving image data 2 with respect to the moving image data 1 currently acquired in the memory card 13. Dynamic video data 2 is acquired. If it is determined in step S64 that there is no moving image data not acquired as moving image data 2, the process proceeds to step S65.
Here, the moving image data already acquired as the moving image data 2 with respect to the currently acquired moving image data 1 is not acquired again, but the moving image data is newly acquired as the moving image data 1 as described below. The moving image data recorded on the memory card 13 is all moving image data that is not acquired as the moving image data 2. That is, whether or not the video data 2 is acquired is determined based on the video data 1.
[0071]
In step S65, it is determined whether there is moving image data not acquired as moving image data 1 in the memory card 13. If it is determined that there is, the flow returns to step S51, and new moving image data 1 is stored. get. If it is determined in step S65 that there is no moving image data not acquired as moving image data 1, the moving image editing mode is terminated.
Note that the determination as to whether or not the video data 1 and video data 2 have been acquired is made based on the identification symbol or the like attached to the video data. Therefore, the same video file is acquired again, and several identical video data are obtained. Never generated.
When new moving image data is generated in step S63, the generated moving image data is also included in moving image data not specified as moving image data 1 and moving image data 2. Therefore, new moving image data is added in step S63. Is generated, the moving image editing mode is not terminated. Thereby, when three or more moving image data also have continuity and relevance, they can be automatically edited into one moving image data.
[0072]
Thus, when the moving image editing mode is set, moving image data recorded on the memory card 13 is acquired as moving image data 1 and moving image data 2 and stored in the DRAM 10. Next, when the moving image data 1 and the moving image data 2 are stored in the DRAM 10, the final frame of the moving image data 1 and the start frame of the moving image data 2 are acquired, and the two frame data are compared. If it is determined that they do not match, the next frame data of the moving image data 2 is acquired and compared with the final frame data of the moving image data 1. The comparison of the final frame data of the moving image data 1 and the frame data of the moving image data 2 is continued until it is determined that they match.
[0073]
If it is determined that the final frame data of the moving image data 2 does not match, it is determined that there is no overlapping portion between the moving image data 1 and the moving image data 2, and new moving image data is transferred from the memory card 13 to the moving image data 2. The data 2 is acquired and the above-described operation is repeated.
If it is determined that they match, the last frame data of the moving image data 1 and the frame data of the moving image data 2 that are determined to match are used as the reference to obtain the previous frame data from the moving image data 1 and the moving image data 2, respectively. A comparison is made to determine whether or not they match. If it is determined that they match, the previous frame data is obtained and compared from the moving image data 1 and the moving image data 2 to determine whether they match. This comparison determination continues until the start frame data of the moving image data 2. However, if it is determined that they do not match even once, it is determined that there is no overlapping portion between the moving image data 1 and the moving image data 2, and new moving image data is acquired as the moving image data 2 from the memory card 13, and the above operation is performed. repeat.
[0074]
As a result of the comparison and determination, each frame data from the frame data of the moving image data 2 determined to match the final frame data of the moving image data 1 to the start frame data of the moving image data 2, and each frame data of the moving image data 1 Is determined to match, the video data 1 and the video data 2 are determined to be duplicated, and the video data 1 and the video data 2 are combined. At this time, the overlapping portion of the moving image data 2 is deleted, and the moving image data 1 and the remaining deleted moving image data 2 are combined.
Based on the combined moving image data, a new moving image file is generated and recorded in the memory card 13.
Note that the overlapping portion of the moving image data 1 may be deleted and the moving image data 1 and the moving image data 2 may be combined.
At this time, the moving image data 1 and the moving image data 2 may be deleted from the memory card 13.
As a result, the moving image data including the overlapping moving image data are combined, so that moving images having continuity and relevance are edited as one moving image file.
Even if the moving image data 1 and the moving image data 2 do not have overlapping data, if the final frame data of the moving image data 1 and the start frame data of the moving image data 2 match, they are combined. The related moving images are edited as one moving image file.
[0075]
As described above, in the third embodiment, moving image data including duplicate data is automatically edited, so that moving image data having continuity and relevance can be generated as one moving image file. it can.
In addition, since it automatically determines whether there is duplicated data, it is possible to greatly reduce the labor and time involved in editing work.
Furthermore, a plurality of moving image files photographed at the same place with a plurality of digital cameras or the like are likely to have duplicate data, and in such a case, they can be automatically edited.
In addition, by editing a moving image file with a personal computer or the like, it is possible to easily and automatically edit a plurality of moving image data having a large data capacity.
Even if there is no duplicate video data, video files with continuity and relevance can be automatically edited, so a variety of editing is possible.
[0076]
In the third embodiment, automatic editing is performed using a digital camera. However, the present invention is not limited to a digital camera, and a memory card 13 on which a moving image file is recorded is read into a personal computer or the like. Needless to say, it can be automatically edited on a personal computer.
Further, not only the memory card 13 but also a moving image file acquired from the Internet may be automatically edited by downloading it to a personal computer or the like.
[0077]
The present invention is not limited to the above-described embodiments, and the following modified embodiments are possible.
(A) The moving image editing apparatus of the present invention may be applied to an apparatus that captures video with a personal computer and automatically edits the moving image on the personal computer by attaching a CCD camera to the personal computer or the like.
(B) The moving image editing apparatus of the present invention may be applied to a device that automatically edits a moving image using a mobile phone, a watch, or other equipment having a photographing function.
[0078]
【The invention's effect】
According to the first aspect of the present invention, even if a plurality of video data is recorded with continuous and related videos separately, the continuous and related video data is automatically converted into one video data. Therefore, the time and labor involved in the editing work can be greatly reduced.
Also, once video recording is finished, it is recorded as one video data, and even if video recording is started immediately, video data is recorded as another video data, but there is continuity and relevance If the video data is the same, even if the user ends the video recording by mistake, if the video recording starts immediately, the video data is automatically edited into one video data.
Furthermore, even if the user deliberately ends the movie shooting or starts a new movie shooting, if the finished moving image and the started moving image have continuity and relevance, they are automatically edited. For example, if the object to be photographed is a moving image of scenery, scenery, plants, etc., it will be edited as a single moving image, so if you shoot regularly, the scenery will change, the growth of plants will be one, etc. It can be edited as one video data.
In addition, when 30 seconds have elapsed since the start of movie shooting, movie shooting ends automatically. In this case, if shooting starts immediately, the movie data is automatically edited into one movie data. .
[0079]
  According to the invention described in claim 2, since the moving image data recorded on the recording medium is automatically edited, any mobile phone, personal computer can be used as long as the recording medium can be read without being limited to a digital camera. It can be automatically edited using a device such as.
  In addition, by editing the video data on a personal computer,capacityA large number of large video data can be easily and automatically edited.
  According to the invention described in claim 3, since the editing work is performed during shooting, if the video being shot has relevance and continuity with the video recorded on the recording medium, The video recorded at the end of shooting and the video being shot can be combined to generate one moving image data.
  In addition, since the editing work is performed during shooting, it is possible to eliminate the labor and time associated with the editing work.
  In video shooting with a digital camera, moving image shooting automatically ends as soon as about 30 seconds elapse, but even in this case, if you start shooting immediately, editing work will be performed during shooting, so continuity, Relevant images can be recorded as one moving image data.
[0080]
  Claim 4According to the invention, if the frame data are within a predetermined range,DuplicateTherefore, it is possible to reliably edit a continuous video as one moving image data.
  Claim5According to the described invention, since the user can arbitrarily set the predetermined range, editing suitable for the application can be performed.
  Claim6According to the described invention, editing is performed so that the start frame of the moving image data 2 comes after the final frame of the moving image data 1, so that it is possible to generate naturally continuous moving image data.
[0081]
  Claim7According to the described invention, video data including duplicate data is automatically edited, so that video data having continuity and relevance can be generated as one video data.The TheIn addition, multiple video data shot at the same location with multiple digital cameras, etc. are likely to have duplicate data, and even in such cases, it can be automatically edited.wear.
[0082]
  Claim8According to the described invention, since the position, shape, and size of the object are compared, comparison of frame data can be performed more reliably, and a continuous and smooth video can be automatically edited.
  Claim9According to the described invention, the moving image data 1 and moving image data 2 which are the basis of editing are deleted and the edited moving image data is generated. Therefore, it is not necessary to record the overlapping moving image data on the recording medium, and the same editing work is performed. You do n’t have to.
[0083]
  Claim10According to the described invention, the present invention can be implemented by an existing image editing apparatus such as a digital camera by using a program.
[Brief description of the drawings]
FIG. 1 is a block diagram of a digital camera according to an embodiment of the present invention.
FIG. 2 is a flowchart showing an operation in a moving image shooting mode.
FIG. 3 is a diagram illustrating a configuration of moving image data.
FIG. 4 is a flowchart showing an operation in a moving image editing mode.
FIG. 5 is a diagram illustrating a configuration after editing moving image data.
FIG. 6 is a flowchart showing a subroutine for comparison and determination in a moving image editing mode.
FIG. 7 is a diagram illustrating a frame image of moving image data.
FIG. 8 is a flowchart showing an operation in a moving image shooting mode.
FIG. 9 is a flowchart showing an operation in a moving image shooting mode.
FIG. 10 is a diagram illustrating a configuration of moving image data.
FIG. 11 is a flowchart showing an operation in a moving image editing mode.
FIG. 12 is a flowchart showing an operation in a moving image editing mode.
FIG. 13 is a diagram illustrating a configuration after editing moving image data.
[Explanation of symbols]
1 Digital camera
2 CCD
3 DSP / CPU
4 TG
5 Unit circuit
6 Display device
7 Key input part
8 Voice processing part
9 Data bus
10 DRAM
11 Built-in flash memory
12 interfaces
13 Memory card

Claims (10)

First moving image data acquisition means for acquiring first moving image data;
Second moving image data acquisition means for acquiring second moving image data;
Comparison means for sequentially comparing the last frame data of the first moving image data and each frame data of the second moving image data from a start frame ;
Based on the comparison result of the data by the comparison means, determining means for determining said first end portion and the second starting portion and is not Luke duplicate the video data of the moving image data,
A combining unit that combines the first moving image data and the second moving image data and edits the moving image data into a single moving image data when it is determined by the determining unit that there is an overlap ;
A moving image editing apparatus comprising: The first moving image data acquisition unit and the second moving image data acquisition unit are:
The moving image editing apparatus according to claim 1, wherein the moving image data is acquired from a recording medium capable of recording the moving image data. The moving image editing apparatus includes:
A moving image editing apparatus capable of shooting a shooting object,
The first moving image data acquisition means acquires moving image data from a recordable recording medium,
The moving image editing apparatus according to claim 1, wherein the second moving image data acquisition unit acquires captured moving image data. The determination means includes
The moving image according to any one of claims 1 to 3 , wherein when the moving image data is determined to be within a predetermined range based on a comparison result by the comparing means, it is determined that the moving image data overlap each other. Editing device. Within the predetermined range,
5. The moving image editing apparatus according to claim 4 , wherein the moving image editing apparatus can be arbitrarily set by a user. The coupling means includes
If it is determined by the determining means that the last frame data of the first moving image data and the start frame data of the second moving image data overlap , after the last frame data of the first moving image data , the moving picture editing apparatus according to any one of claims 1 to 5, characterized in that editing one of the moving image data to the start frame data combined with the second video data. The coupling means includes
If it is determined by the determination means that the second moving image data is duplicated, the overlapping portion of the second moving image data is deleted, and the second remaining deleted second frame data after the last frame data of the first moving image data. moving picture editing apparatus according to any one of claims 1 to 5 by combining the video data, characterized in that a single moving image data. When comparing by the comparison means,
Position of the comparison object being displayed on the frame data, shape, or comparing the magnitude moving picture editing apparatus according to any one of claims 1 to 7, characterized in. When joining by the joining means,
Video data that is coupled to one recorded on the recording medium, the moving picture editing apparatus according to any one of claims 1 to 8, characterized in that to remove the moving image data obtained as the binding of the target from the recording medium . On the computer,
A first moving image data acquisition function for acquiring first moving image data ;
A second moving image data acquisition function for acquiring second moving image data ;
A comparison function for sequentially comparing the last frame data of the first moving image data and each frame data of the second moving image data from a start frame ;
Based on the comparison result of the data by the comparing function, a determination function whether the first final portion and the second starting portion and is not Luke duplicate the video data of the moving image data,
A combination function for combining the first moving image data and the second moving image data to edit into one moving image data when it is determined by the determination function that they are duplicated ;
A program to realize

Images