JP6532354B2 - Imaging device, control method therefor, and program - Google Patents

Description

  The present invention relates to an imaging device, a control method thereof, and a program.

  In recent years, a video sharing site for sharing photographed videos on the Internet has developed, and a user's need for photographing creative and interesting videos is increasing. One way to make the video interesting is to add slow motion or fast forward effects to the video.

  If you add slow motion or fast forward effects to a video, the playback time of the video will change. Patent Document 1 is known as a technique for suppressing a change in reproduction time. According to Patent Document 1, the recording time of the moving image is set so that the reproduction time becomes constant even when the slow motion or the fast-forwarding effect is added to the moving image.

  There is also known an image recording / reproducing apparatus for recording music data to be reproduced as BGM at the time of reproduction of moving image data as well as the moving image data (see Patent Document 2). The image recording and reproducing apparatus of Patent Document 2 matches the reproduction time of the moving picture and the music by matching the photographing time of the moving picture with the reproduction time of the music data.

JP, 2010-251907, A JP, 2010-245735, A

  Consider the case of adding slow motion or fast-forwarding effect to a moving image and further adding audio (for example, BGM). In this case, even if the moving image shooting time matches the audio playback time according to the technique of Patent Document 2, the moving image playback time changes according to the contents of the effect added to the video, so the moving image and audio playback time Differently, the user may feel uncomfortable.

  The present invention has been made in view of such a situation, and a technique for suppressing the difference between the video playback time and the audio playback time even if the video shooting time and the playback time do not match. Intended to be provided.

  In order to solve the above-mentioned problems, according to the present invention, recording time per unit photographing time is recorded based on the state of the subject of the moving picture photographing means, acquisition means for acquiring the reproduction time of sound, and the moving picture photographing means. A determination unit that determines a recording frame rate corresponding to the number of frames; and a recording unit that records a moving image captured by the moving image capturing unit over the determined shooting time at the determined recording frame rate. Recording means for associating the audio with the moving image to be recorded and recording the audio, and the determination means is configured such that a difference between reproduction times of the moving image and the audio recorded by the recording means falls within a predetermined range Thus, the present invention provides an imaging device characterized in that the photographing time and the recording frame rate are determined.

  Other features of the present invention will become more apparent from the description in the accompanying drawings and the following detailed description of the invention.

  According to the present invention, it is possible to suppress the difference between the moving image playback time and the audio playback time even if the moving image shooting time and the playback time do not match.

FIG. 2 is an external view of the imaging device 100. FIG. 2 is a functional block diagram of the imaging device 100. 6 is a flowchart showing a moving image shooting process performed by the imaging device 100 according to the first embodiment. The figure which shows BGM determination table based on 1st Embodiment. The figure which shows an effect determination table. FIG. 8 is a diagram showing a shooting and recording process when the movement level is “3” (when the movement of the subject is large). FIG. 7 is a diagram showing a shooting and recording process when the movement level is “1” (when the movement of the subject is small). 10 is a flowchart showing a moving image shooting process performed by the imaging device 100 according to the second embodiment. The figure which shows BGM determination table based on 2nd Embodiment. The figure which shows the possible combination of the reproduction time of each chapter of a connection moving image. The figure which shows the possible combination of the reproduction time of each chapter of a connection moving image.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The technical scope of the present invention is determined by the scope of the claims, and is not limited by the following individual embodiments. Moreover, not all combinations of features described in the embodiments are essential to the present invention.

First Embodiment
FIG. 1 is an external view of an imaging device 100 according to the first embodiment. In FIG. 1, the display unit 28 displays an image and various information. The shutter button 61 is an operation unit for giving a shooting instruction. The mode switching switch 60 is an operation unit for switching various modes. The connector 112 connects the connection cable 111 and the imaging device 100. The operation unit 70 is an operation member such as various switches, buttons, and a touch panel that receive various operations from the user. The controller wheel 73 is a rotatable operation member included in the operation unit 70. The power switch 72 is an operation unit for switching power on and power off. The recording medium 200 is a recording medium such as a memory card or a hard disk. The recording medium slot 201 is a slot for storing the recording medium 200. The recording medium 200 stored in the recording medium slot 201 can communicate with the imaging device 100.

  FIG. 2 is a functional block diagram of the imaging device 100. In FIG. 2, the shutter 101 is a shutter having an aperture function. The photographing lens 103 is a lens group including a zoom lens and a focus lens. The imaging unit 22 is an imaging device configured of a CCD, a CMOS device, or the like that converts an optical image into an electrical signal. The imaging unit 22 also has an A / D conversion processing function. The AF evaluation value detection unit 23 calculates an AF (Auto Focus) evaluation value from contrast information or the like obtained from the digital image signal, and outputs the obtained AF evaluation value from the imaging unit 22 to the system control unit 50. The barrier 102 covers the imaging system including the imaging lens 103, the shutter 101, and the imaging unit 22, thereby preventing the imaging system from being dirty or damaged. The flashlight 90 can compensate for the illuminance at the time of shooting in a low illuminance scene or at the time of shooting in a backlit scene by emitting light at the time of shooting.

  The image processing unit 24 performs resize processing such as predetermined pixel interpolation and reduction, and color conversion processing on the image data output from the imaging unit 22 or the image data from the memory control unit 15. Further, in the image processing unit 24, predetermined arithmetic processing is performed using captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation result. As a result, TTL (through-the-lens) AE (automatic exposure) processing and EF (flash automatic light emission) processing are performed. Further, in the image processing unit 24, an AF (Auto Focus) process is performed, but at this time, an output of the AF evaluation value detecting unit 23 provided in the imaging unit 22 may be used. The image processing unit 24 further performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (Auto White Balance) processing based on the acquired arithmetic result.

  Output data of the imaging unit 22 is directly written to the memory 32 via the image processing unit 24 and the memory control unit 15 or via the memory control unit 15. The memory 32 stores image data acquired and A / D converted by the imaging unit 22 and image data to be displayed on the display unit 28. The memory 32 has a sufficient storage capacity to store a predetermined number of still images and moving images and sounds for a predetermined time. The memory 32 also serves as a memory (video memory) for image display.

  The D / A converter 13 converts the image display data stored in the memory 32 into an analog signal and supplies the analog signal to the display unit 28. Thus, the display image data written in the memory 32 is displayed by the display unit 28 via the D / A converter 13. The display unit 28 performs display according to the analog signal from the D / A converter 13 on a display device such as an LCD. The display unit 28 is an electronic view finder by performing analog conversion of the digital signal once A / D converted in the imaging unit 22 and stored in the memory 32 in the D / A converter 13 and sequentially transferring to the display unit 28 for display. Function as a through image display.

  The nonvolatile memory 56 is an electrically erasable and recordable memory, and for example, a flash memory or the like is used. In the non-volatile memory 56, constants, programs and the like for operation of the system control unit 50 are stored. The program referred to here is a program for executing various flowcharts to be described later in this embodiment.

  The system control unit 50 controls the entire imaging device 100. The system control unit 50 implements each process of the present embodiment described later by executing the program stored in the non-volatile memory 56 described above. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 13, the display unit 28, and the like. The system memory 52 is a RAM. In the system memory 52, constants and variables for the operation of the system control unit 50, programs read out from the non-volatile memory 56, and the like are expanded. The system timer 53 is a clock unit that measures the time used for various controls and the time of the built-in clock.

  The mode switching switch 60, the first shutter switch 62, the second shutter switch 64, and the operation unit 70 are operation members for inputting various operation instructions to the system control unit 50. The mode switching switch 60 switches the operation mode of the system control unit 50 to any one of a still image shooting mode, a moving image shooting mode, a reproduction mode, and the like. As modes included in the still image shooting mode, there are an auto shooting mode, an auto scene determination mode, a manual mode, various scene modes as shooting settings for each shooting scene, a program AE mode, a custom mode and the like. The mode switching switch 60 directly switches to any of these modes included in the still image shooting mode. Alternatively, once the mode is switched to the still image shooting mode by the mode switching switch 60, another operation member may be used to switch to any of these modes included in the still image shooting mode. Similarly, a plurality of moving image shooting modes may be included. During the operation of the shutter button 61 provided in the imaging device 100, the first shutter switch 62 is turned on by a so-called half depression (shooting preparation instruction), and generates a first shutter switch signal SW1. The system control unit 50 starts operations such as AF (auto focus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, EF (flash automatic light emission) processing, etc. by the first shutter switch signal SW1. Do. The second shutter switch 64 is turned on by completion of the operation of the shutter button 61, that is, full-press (shooting instruction), and generates a second shutter switch signal SW2. The system control unit 50 starts a series of photographing processing operations from reading of the signal from the imaging unit 22 to writing of image data on the recording medium 200 by the second shutter switch signal SW2.

  Each operation member of the operation unit 70 is appropriately assigned a function for each scene by selecting and operating various function icons displayed on the display unit 28, and functions as various function buttons. The function buttons include, for example, an end button, a back button, an image feed button, a jump button, a narrowing button, and an attribute change button. For example, when the menu button is pressed, various settable menu screens are displayed on the display unit 28. The user can intuitively perform various settings using the menu screen displayed on the display unit 28 and the four-direction button, the SET button, and the like in the upper, lower, left, and right directions.

  The controller wheel 73 shown in FIG. 1 is a rotatable operation member included in the operation unit 70, and is used together with the direction button to designate a selection item. When the controller wheel 73 is operated to rotate, an electrical pulse signal is generated according to the amount of operation, and the system control unit 50 controls each part of the imaging device 100 based on this pulse signal. Based on this pulse signal, it is possible to determine the angle at which the controller wheel 73 is operated to rotate, how many rotations, and the like. The controller wheel 73 may be any operation member as long as it can detect a rotation operation. For example, the controller wheel 73 may be a dial operation member that rotates to generate a pulse signal according to a user's rotation operation. Alternatively, the operation member may be a touch sensor, and the controller wheel 73 itself may not rotate, and may detect a user's finger rotation operation on the controller wheel 73 (so-called touch wheel).

  The power supply control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like, and detects the presence or absence of a battery, the type of battery, and the battery remaining amount. Further, the power control unit 80 controls the DC-DC converter based on the detection result and an instruction of the system control unit 50, and supplies necessary voltages to the respective units including the recording medium 200 for a necessary period.

  The power supply unit 40 is made of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, a Li battery or the like, an AC adapter or the like. The recording medium I / F 18 is an interface with the recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording a photographed image, and is formed of a semiconductor memory, a magnetic disk, or the like.

  In the present embodiment, the imaging apparatus 100 adds a special effect such as a slow reproduction effect or a fast forward reproduction effect to moving image data by controlling a recording frame rate corresponding to the number of recording frames per unit shooting time. Can. The control of the recording frame rate can be performed, for example, by controlling one or both of a frame rate at the time of moving image shooting (shooting frame rate) and a recording ratio of frames at the time of moving image recording. In the following description, the imaging apparatus 100 controls the recording frame rate by controlling both the imaging frame rate and the recording ratio.

  Further, in the present embodiment, the imaging apparatus 100 records, in association with the moving image data to be recorded, audio data to be reproduced together with the moving image data. In the following description, the content of audio data is music, and this music plays a role as BGM at the time of video reproduction. However, the content of the audio data is not limited to music, and may be narration, for example. Further, in the following description, a shooting mode for generating moving image data to which special effects and sound data are added is referred to as “sound-added effect moving image shooting mode”.

  FIG. 3 is a flowchart showing a moving image shooting process performed by the imaging device 100. The process of each step of the flowchart is realized by the system control unit 50 executing the program stored in the non-volatile memory 56 unless otherwise specified. When the operation mode of the imaging device 100 transitions to the above-described sound-effect moving image shooting mode described above, the processing of this flowchart starts.

  In S301, the imaging apparatus 100 detects the state of the subject every N seconds. For example, the imaging apparatus 100 can obtain the amount of change in the position of the center of gravity of the main subject area between frames from the signal data output from the imaging unit 22, and can detect the change in the state of the subject from the amount of change. In order to detect the main subject, an algorithm is generally known which determines whether or not the main subject is present in the screen from the area distribution of luminance and color in the screen and edge information. The purpose of detecting the state of the subject in S301 is to add special effects such as slow reproduction effect and fast forward reproduction effect to the moving image data as described above. Further, in the present embodiment, the imaging apparatus 100 is also used to determine the BGM to be added to moving image data as the detection result of the state of the subject. Details of the method of determining the special effect and the method of determining the BGM will be described later.

  In step S302, the imaging apparatus 100 determines whether a user has issued a shooting start instruction. The process of S301 is repeated until the imaging start instruction is issued. When the imaging start instruction is issued (that is, when the system control unit 50 receives the imaging start instruction), the process proceeds to S303. In S303, the imaging device 100 acquires the detection result of the state of the subject in S301.

  In step S304, the imaging apparatus 100 determines the BGM to be added to the moving image data based on the detection result of the state of the subject, and acquires the reproduction time of the BGM. In the present embodiment, it is assumed that the movement level of the subject is used as the detection result of the state of the subject, and the movement of the subject is larger as the numerical value of the movement level is larger. Further, in the present embodiment, the BGM determination process (voice determination process) in S304 is performed according to the BGM determination table shown in FIG. The BGM determination table is a table for selecting BGM according to the movement level of the subject. Here, as an example, the case where the movement level is “1” (the movement is small) will be described. In this case, the imaging device 100 selects the BGM of the BGM number "B101" according to the BGM determination table. Further, as can be understood from FIG. 4, the BGM reproduction time corresponding to the BGM number “B101” is 3 seconds. As described above, when the imaging device 100 determines the BGM, the imaging device 100 can acquire the reproduction time of the BGM.

  In step S305, the imaging apparatus 100 determines the shooting frame rate, the recording ratio, and the shooting time so that the playback time of the moving image matches the playback time of the BGM based on the detection result of the subject state.

  Here, the relationship between the playback time of a moving image and the playback time of BGM will be considered. If the playback time of the video does not match the playback time of the BGM added to the video, the BGM playback may end before the video playback ends, or the video playback may end before the BGM playback ends. Or As a result, the quality as moving image data to which BGM is added is low. Therefore, it is necessary to match the playback time of the moving image and the playback time of the BGM.

  Strictly speaking, even if the playback times of the moving image and the BGM do not match completely, if the difference between the playback times is reduced, it is possible to suppress the deterioration of the quality due to the difference of the playback times. In the following, in order to simplify the description, the imaging device 100 is assumed to match the playback time of the moving image and the BGM, but the present embodiment is not limited to this, and the difference between the playback time of the moving image and the BGM is predetermined. It also includes configurations that fall within the scope.

  Based on the above, the effect determination process in S305 will be described in more detail. In the present embodiment, the effect determination process in S305 is performed according to the effect determination table shown in FIG. The effect determination table is a table for determining the slow reproduction effect and the fast forward reproduction effect as described above according to the state of the subject. Further, in the present embodiment, as in S304, it is assumed that the motion level of the subject is used as the result of detection of the state of the subject, and the motion of the subject is greater as the numerical value of the motion level is larger.

  FIG. 6 is a diagram showing a photographing and recording process when the movement level is “3” (when the movement of the subject is large). FIG. 6 shows that the number of output frames of the imaging unit 22 is 90 fps × 3 seconds = 270, the frame rate is 30 fps for reproduction, and 90 frames of the head and the end are thinned to 1⁄3. In this case, a moving image to which the effect of normal reproduction (1 second) → slow reproduction (3 seconds) → normal reproduction (1 second) is added is generated. In this case, the imaging apparatus 100 determines the imaging frame rate to 90 fps and the imaging time to 3 seconds in accordance with the effect determination table of FIG. 5. Also, in the imaging device 100, the first one second recording ratio is 1/3, the next one second recording ratio is one, and the last one second recording ratio is one third of the three second shooting time. Determine the recording rate so that Thus, the recording ratio need not be constant over the entire imaging time, but may vary during the imaging time. As a result, a moving image to which the effect shown in FIG. 6 is added is generated. In other words, determining the shooting frame rate and the recording ratio in S305 corresponds to determining the special effect to be added to the moving image. In addition, when the shooting frame rate, recording ratio, and shooting time are determined, the playback time is also determined.

  FIG. 7 is a diagram showing a photographing and recording process when the movement level is “1” (the movement of the subject is small). FIG. 7 shows that the number of output frames of the imaging unit 22 is 30 fps × 6 seconds = 180, the frame rate is 30 fps for reproduction, and all frames are thinned to 1⁄2. In this case, a moving image to which an effect of double speed reproduction (3 seconds) is added is generated. As in the case of FIG. 6, the imaging apparatus 100 determines the shooting frame rate, the recording ratio, and the shooting time according to the effect determination table of FIG.

  In addition, the special effect added to a moving image is not limited to what is shown in FIG.6 and FIG.7. For example, when the movement of the subject is small (when the degree of movement is less than the first threshold), the imaging apparatus 100 sets the shooting frame rate and the recording so that at least a part of the moving image to be recorded Determine the proportions. As another example, when the movement of the subject is large (when the degree of movement is equal to or higher than the second threshold), the imaging device 100 may capture a shooting frame so that at least part of the moving image to be recorded is played back slowly. Determine rate and rate of recording.

  In the present embodiment, the BGM determination table (FIG. 4) and the effect determination table (FIG. 5) are configured such that the reproduction times of the corresponding BGM and moving image coincide with each other for each motion level. Therefore, the imaging apparatus 100 can match the playback time of the moving image and the BGM by determining the shooting frame rate, the recording ratio, and the shooting time according to the effect determination table of FIG. 5 in S305. For example, as described above in S304, when the motion level is “1” (the motion is small), the imaging apparatus 100 selects BGM having a playback time of 3 seconds according to the BGM determination table of FIG. Then, in step S305, the imaging apparatus 100 determines the shooting frame rate to 90 fps, the recording ratio (full shooting period) to 1⁄2, and the shooting time to 6 seconds according to the effect determination table of FIG. As a result, the playback time of the moving image is 3 seconds, which matches the playback time of the BGM.

  In the example of FIGS. 4 and 5, for simplification, the playback time of BGM corresponding to one motion level is only one, and the playback time of moving images corresponding to one motion level is only one. It is assumed to be one. However, the BGM determination table and the effect determination table may be configured such that a plurality of playback times correspond to one motion level. For example, in the BGM determination table, it is assumed that three BGMs having reproduction times of 3 seconds, 5 seconds, and 7 seconds are associated with the motion level “1”. In addition, in the effect determination table, combinations of 3 sets of “shooting frame rate, recording ratio, and shooting time” corresponding to three playback times of 3 seconds, 5 seconds, and 7 seconds correspond to the motion level “1”. It shall be attached. In this case, in S304, the imaging apparatus 100 selects the BGM corresponding to the playback time of any of 3 seconds, 5 seconds, and 7 seconds based on some condition in addition to the motion level "1". Here, it is assumed that BGM having a playback time of 5 seconds is selected. Then, in S305, the imaging apparatus 100 selects a combination of “photographing frame rate, recording ratio, and photographing time” corresponding to the motion level “1” that corresponds to a reproduction time of 5 seconds.

  In the above description, the imaging apparatus 100 determines the BGM based on the detection result of the state of the subject. However, the present embodiment is not limited to this, and the BGM may be determined based on any criteria. The use of the BGM determination table and the effect determination table as shown in FIGS. 4 and 5 is only one specific method for matching the playback time of moving pictures and BGM. Whatever the determination criterion of BGM, the imaging device 100 determines the photographing frame rate, the recording ratio, and the photographing time in S305 so that the reproduction time of the moving image matches the reproduction time of the BGM.

  It returns to the flowchart of FIG. Following the BGM determination process and the effect determination process in S304 and S305, the imaging apparatus 100 starts moving image shooting in S306. Specifically, the imaging device 100 captures a moving image at the shooting frame rate determined in S305 over the shooting time determined in S305. Further, when recording the captured moving image, the imaging apparatus 100 records a frame in accordance with the recording ratio determined in S305. In other words, the imaging apparatus 100 records the moving image captured over the determined imaging time at the recording frame rate corresponding to the determined imaging frame rate and recording rate. When the determined shooting time has elapsed, moving image shooting is automatically ended in S307.

  In S308, the imaging device 100 saves the captured moving image as a moving image file. At this time, the imaging device 100 records the BGM determined in S304 in association with the moving image. Specifically, for example, the imaging device 100 stores audio data corresponding to the BGM determined in S304 in a specific area of the moving image file.

  In step S309, the imaging apparatus 100 determines whether the operation mode has transitioned to another mode. If the operation mode has not transitioned to another mode, the process returns to S301. When the operation mode transitions to another mode, the processing of this flowchart ends.

  As described above, according to the first embodiment, in the moving image and the BGM, the image capturing apparatus 100 matches the moving image and the BGM (or the difference in the reproducing time falls within a predetermined range). Determine the shooting time and recording frame rate. This makes it possible to suppress the difference between the moving image playback time and the audio playback time even if the moving image shooting time and playback time do not match.

Second Embodiment
In the first embodiment, the configuration for adding BGM to one moving image has been described. On the other hand, in the second embodiment, a configuration in which C (C is an integer of 2 or more) moving images are connected to generate one connected moving image, and BGM is added to the connected moving image will be described. Each moving image that constitutes a connected moving image is also referred to as a "chapter".

  In the second embodiment, the basic configuration of the imaging apparatus 100 is the same as that of the first embodiment (see FIGS. 1 and 2). The differences from the first embodiment will be mainly described below.

  FIG. 8 is a flowchart showing a moving image shooting process performed by the imaging device 100 according to the second embodiment. In FIG. 8, steps in which the same or similar processing as that in FIG. 3 is performed are assigned the same reference numerals as in FIG. 3. The process of each step of the flowchart is realized by the system control unit 50 executing the program stored in the non-volatile memory 56 unless otherwise specified. When the operation mode of the imaging device 100 transitions to the sound-effect moving image shooting mode, the processing of this flowchart is started. In the second embodiment, the imaging device 100 generates a connected moving image in the sound-added effect moving image shooting mode. In the following description, it is assumed that C = 4 (that is, the imaging apparatus 100 generates a connected moving image composed of 4 chapters).

  In S801, the imaging device 100 initializes a variable i indicating the current chapter number to 0. In S802, the imaging device 100 adds 1 to i. In step S803, the imaging apparatus 100 determines whether i = 1 (whether or not the chapter to be photographed at present is the first chapter). If i = 1, the imaging device 100 proceeds with the process to S804, and if i 場合 1, the imaging device 100 proceeds with the process to S805.

  In step S804, the imaging apparatus 100 determines the BGM to be added to the connected moving image based on the detection result of the state of the subject, and acquires the reproduction time of the BGM. In the present embodiment, it is assumed that the movement level of the subject is used as the detection result of the state of the subject, and the movement of the subject is larger as the numerical value of the movement level is larger. Further, in the present embodiment, the BGM determination process in S804 is performed according to the BGM determination table shown in FIG. The reproduction time of BGM included in the BGM determination table of FIG. 9 is longer than the reproduction time of BGM included in the BGM determination table of FIG. 4. This is because the reproduction time of the BGM addition target in the second embodiment (that is, a connected moving image composed of 4 chapters) is generally longer than the BGM addition target moving image in the first embodiment. It is. In the following description, it is assumed that the BGM of the BGM number "B401" having a reproduction time of 16 seconds is selected.

  In step S805, the imaging apparatus 100 substitutes the reproduction time Ta of the BGM acquired in step S804 for a variable Tr indicating the remaining reproduction time of the BGM.

  In step S806, the imaging apparatus 100 selects a shooting record setting from the effect determination table based on the detection result of the state of the subject. The photographing and recording setting includes information corresponding to a photographing time and a recording frame rate corresponding to the number of recording frames per unit photographing time. In the following description, as in the description of the first embodiment, the imaging apparatus 100 controls the recording frame rate by controlling both the imaging frame rate and the recording ratio. Further, in the following description, as in the description of the first embodiment, the effect determination table shown in FIG. 5 is used. That is, in the second embodiment, the combination of the shooting frame rate, the recording ratio, and the shooting time in the effect determination table shown in FIG. 5 corresponds to the shooting condition setting.

  In the selection process in S806, the minimum value of the difference between (Tr−Tc) and the total playback time of (C−i) moving images that can be realized based on the playback time included in the effect determination table is in a predetermined range It takes place under the condition that it fits inside. Here, Tc indicates the playback time of the current (i-th) chapter (that is, the playback time corresponding to the shooting condition setting to be selected from now).

  The meaning of the condition of the above selection process will be described with reference to FIGS. 5 and 10. When the playback time of BGM is 16 seconds, in order to match the playback time of BGM with the playback time of the connected moving image, the combination of the playback time of each chapter is three of A, B, and C shown in FIG. Limited to the combination. Here, it is assumed that the current chapter number i = 3, the playback time of the first chapter is 3 seconds, and the playback time of the second chapter is 4 seconds. In this case, as can be understood from FIG. 10, only the combination B can be used, and only 4 seconds or 5 seconds can be selected as the reproduction time of the third chapter. Applying this state to the above conditions, “the total playback time of (C−i) moving images that can be realized based on the playback time included in the effect determination table” is 3 seconds, 4 seconds, and 5 seconds. is there. And since Tr = 16 seconds (reproduction time of BGM) -3 seconds (reproduction time of the first chapter) -4 seconds (reproduction time of the second chapter) = 9 seconds, Tc = 3 seconds, 4 seconds In the case of 5 seconds, (Tr-Tc) becomes 9-3 = 6 seconds, 9-4 = 5 seconds, and 9-5 = 4 seconds, respectively. Of the "6 seconds, 5 seconds, 4 seconds", the minimum value of the difference with "the total playback time of the (realizable (Ci) moving images) (3 seconds, 4 seconds, and 5 seconds)" is set to 0 Only "5 seconds, 4 seconds" can be done. Therefore, 5 seconds or 4 seconds can be selected as the reproduction time Tc of the current chapter, and 3 seconds can not be selected. Here, it is assumed that the movement level of the subject is "1". In this case, if the above conditions do not exist, the photographing condition setting is selected according to the effect determination table of FIG. 5, and the reproduction time of the third chapter is 3 seconds. However, since the above conditions actually exist, the shooting condition setting corresponding to the playback time of 3 seconds is not selected, and instead, the shooting condition setting corresponding to the playback time of 4 seconds or 5 seconds is selected . This makes it possible to match the BGM playback time with the linked moving image playback time.

  As in the first embodiment, the second embodiment also includes a configuration in which the difference between the BGM playback time and the linked moving image playback time falls within a predetermined range. In this case, the “minimum value of the difference between (Tr−Tc) and the total playback time of (C−i) moving images that can be realized based on the playback time included in the effect determination table” under the above conditions is It does not have to be 0 and may fall within a predetermined range.

  Also, the BGM determination table of FIG. 9 is configured such that the imaging device 100 can satisfy the above conditions (that is, so as to be able to create at least one combination of reproduction times as shown in FIG. 10). Ru. In the example of FIG. 9, although there are three types of BGM reproduction time patterns, the reproduction time patterns can be increased by repeatedly reproducing the same BGM or combining with other BGMs.

  Referring back to FIG. 8, in step S <b> 807, the imaging device 100 substitutes (Tr−Tc) for Tr. As a result, the remaining reproduction time Tr of BGM is updated based on the reproduction time (that is, the reproduction time of the current chapter) corresponding to the shooting record setting selected in S806.

  In S808, the imaging apparatus 100 saves the captured moving image as a moving image file. In the case of i 撮 像 2, the imaging device 100 links the moving image newly captured this time to the moving image captured earlier. Therefore, finally, a connected moving image in which C moving images are connected is generated. When i = 1, a moving image file is newly generated.

  In S809, the imaging apparatus 100 determines whether i = C (that is, whether or not recording of all the chapters constituting the connected moving image is completed). If i = C, the imaging apparatus 100 ends the processing (thus, in S301 to S809, i is a natural number less than or equal to C). If i ≠ C, the imaging device 100 returns the process to S301.

  As described above, according to the second embodiment, even when BGM is added to a connected moving image, the difference between the playback time of the connected moving image and the playback time of BGM (audio) is suppressed. Is possible.

<Modification>
In the above description, the imaging apparatus 100 determines the reproduction time of BGM before the start of imaging of the first chapter, but can also determine after capturing a plurality of chapters. For example, in a shooting mode in which four chapters are connected to generate one combined moving image, it is assumed that shooting of a first chapter and a second chapter is performed as follows based on the motion detection result of the subject and the effect determination table.

1st chapter shooting frame rate: 90 fps
Recording ratio: 1/3 (1 second) → 1 (1 second) → 1/3 (1 second)
Shooting time: 3 seconds Playback time: 5 seconds 2 chapters shooting frame rate: 30 fps
Recording rate: 1 (4 seconds)
Shooting time: 4 seconds Reproduction time: 4 seconds In this case, since the total moving image reproduction time up to the second chapter is 9 seconds, the combination of the reproduction time of the third chapter and the fourth chapter is as shown in FIG. There is a pattern (W, X, Y, Z). Subsequently, the imaging apparatus 100 detects the movement of the subject before the start of photographing of the third chapter. Here, if the motion level is “1” (corresponding to a playback time of 3 seconds), selectable patterns are
X: 5 seconds-4 seconds-3 seconds-5 seconds in total 17 seconds Z: 5 seconds-4 seconds-3 seconds-4 seconds In total, it is determined to be either 16 seconds. Thereafter, the imaging apparatus 100 selects the more effective one of the playback time of 4 seconds or 5 seconds based on the result of the motion detection of the fourth chapter subject. Thereby, the reproduction time for four chapters and the effect of the moving image are determined.

  As described above, in the mode in which the imaging apparatus 100 generates a single combined moving image by connecting a plurality of chapters, even after shooting one or more chapters, the reproduction time of BGM added to the combined moving image and the reproduction of the combined moving image You can match the time.

Other Embodiments
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

  22: imaging unit, 24: image processing unit, 32: memory, 50: system control unit, 52: system memory, 56: non-volatile memory, 100: imaging device, 200: recording medium

Claims (13)

Video shooting means,
Acquisition means for acquiring the reproduction time of the audio;
A determination unit configured to determine a shooting time and a recording frame rate corresponding to the number of recording frames per unit shooting time based on the state of the subject of the moving image shooting unit;
Recording means for recording a moving image photographed by the moving image photographing means at the determined recording frame rate over the determined photographing time, and recording means for correlating the voice with the recorded moving image When,
Equipped with
The image pickup apparatus, wherein the determination means determines the photographing time and the recording frame rate such that a difference between reproduction times of the moving image and the sound recorded by the recording means falls within a predetermined range. The imaging apparatus according to claim 1, wherein the determination unit determines the photographing time and the recording frame rate such that reproduction times of the moving image and the sound recorded by the recording unit coincide with each other. . The image pickup apparatus according to claim 1, wherein the acquisition unit further includes an audio determination unit configured to determine the audio to be recorded by the recording unit based on a state of the subject. When the degree of movement of the subject is less than a first threshold, the determination means determines the recording frame rate such that at least a part of the moving image recorded by the recording means is fast-forwarded during reproduction. The imaging device according to any one of claims 1 to 3, characterized in that: When the degree of movement of the subject is equal to or higher than a second threshold, the determination unit determines the recording frame rate such that at least a part of the moving image recorded by the recording unit is slow-replayed during reproduction. The imaging device according to any one of claims 1 to 4, characterized in that: The determination unit controls at least one of a shooting frame rate of the moving image shooting unit and a recording ratio of the frame of the recording unit in order to cause the recording unit to perform recording at the determined recording frame rate. The imaging device according to any one of claims 1 to 5, wherein: The imaging apparatus according to claim 6, wherein the determination unit determines the recording ratio so that the recording ratio changes in the determined photographing time. Video shooting means,
Acquisition means for acquiring the reproduction time of the audio;
It is a selection means for selecting one of a plurality of shooting record settings based on the condition of the subject of the moving image shooting means, and the shooting record setting corresponds to the shooting time and the number of recording frames per unit shooting time. Selection means including information corresponding to the recording frame rate
Recording means for recording a moving image photographed by the moving image photographing means over a photographing time corresponding to the selected photographing and recording setting at a recording frame rate corresponding to the selected photographing and recording setting;
A control unit that controls the selection unit and the recording unit to record C (C is an integer of 2 or more) moving images;
Equipped with
When the selection means selects a shooting record setting for a moving image to be recorded at the i-th (i is a natural number less than or equal to C), the total reproduction time of the moving image to be recorded from the first to the i-th The minimum value of the difference between the value subtracted from the playback time and the total playback time of (C−i) moving images that can be realized based on the playback time corresponding to the plurality of shooting record settings falls within a predetermined range As such, select the shooting record setting of the i-th moving image,
An imaging apparatus, wherein the recording unit records the C moving images as one combined moving image in association with the sound. 9. The image pickup apparatus according to claim 8, wherein the selection unit selects the shooting and recording setting of the i-th moving image such that the minimum value is zero. The photographing and recording setting includes at least one of a photographing frame rate of the moving picture photographing means and a recording ratio of a frame of the recording means as information corresponding to the recording frame rate,
The selection means for causing the recording means to perform recording at a recording frame rate corresponding to the selected photographing and recording setting according to the selected photographing and recording setting; 10. The imaging apparatus according to claim 8, wherein at least one of the recording rates of the frames of the recording means is controlled. It is a control method of an imaging device provided with a moving image photographing means,
An acquisition process for acquiring a playback time of voice;
A determination step of determining a shooting time and a recording frame rate corresponding to the number of recording frames per unit shooting time based on the state of the subject of the moving image shooting means;
A recording step of recording a moving image photographed by the moving image photographing means at the determined recording frame rate over the determined photographing time, the recording step of correlating the voice with the recorded moving image; When,
Equipped with
The control method, wherein the photographing time and the recording frame rate are determined in the determination step such that a difference between reproduction times of the moving image and the sound recorded in the recording step falls within a predetermined range. It is a control method of an imaging device provided with a moving image photographing means,
An acquisition process for acquiring a playback time of voice;
It is a selection step of selecting one of a plurality of shooting record settings based on the condition of the subject of the moving image shooting means, and the shooting record setting corresponds to the shooting time and the number of recording frames per unit shooting time. A selection step including information corresponding to a recording frame rate
Recording a moving image shot by the moving image shooting means over a shooting time corresponding to the selected shooting record setting at a recording frame rate corresponding to the selected shooting record setting;
A control step of controlling the selection step and the recording step so as to record C (C is an integer of 2 or more) moving images;
Equipped with
In the selection step, when selecting a shooting record setting for a moving image to be recorded at the i-th (i is a natural number less than or equal to C), the total reproduction time of the moving image to be recorded from the first The minimum value of the difference between the value subtracted from the playback time and the total playback time of (C−i) moving images that can be realized based on the playback time corresponding to the plurality of shooting record settings falls within a predetermined range As such, select the shooting record setting of the i-th moving image,
In the recording step, the C moving images are recorded as one combined moving image in association with the sound.   The program for functioning a computer as each means except the moving image imaging | photography means of the imaging device of any one of Claims 1-10.

Images