JP2016058793A - Imaging apparatus, control method therefor, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology capable of controlling a reproduction speed of a recorded moving image on the basis of a condition that is not considered conventionally.SOLUTION: An imaging apparatus includes: imaging means for capturing a moving image; recording means for recording the moving image; determination means for determining the reproduction speed of the moving image on the basis of at least either a motion of a subject in the moving image or a type of a main subject included in the subject; and control means for controlling the imaging means and the recording means so as to record the moving image to be reproduced at the reproduction speed that is determined by the determination means.SELECTED DRAWING: Figure 13

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a program.

  In recent years, video sharing sites for sharing captured videos on the Internet have been developed, and the needs of users who want to capture creative and interesting videos are increasing. However, it is not easy for a general user who is not familiar with moving image shooting to shoot a creative and interesting moving image. For such users, complicated editing operations such as adding special effects to moving images and combining moving images are also problems in generating interesting moving images.

  In order to facilitate the generation of an interesting video, a function that enables a user to shoot a video with a special effect by a simple operation has been proposed with a focus on smartphone applications. For example, a function of adding a special color / gradation conversion filter effect to a moving image, a function of photographing a predetermined short-second moving image a plurality of times, and automatically combining them are proposed.

  In addition, a technique for changing the moving image reproduction speed by adjusting and recording the number of moving image frames according to the acceleration of the camera device at the time of moving image shooting has been proposed (see Patent Document 1).

JP 2006-262135 A

  However, the technique of Patent Document 1 only considers the acceleration of the camera device, and does not consider the movement of the subject or the type of the main subject included in the subject.

  The present invention has been made in view of such a situation, and an object thereof is to provide a technique capable of controlling the playback speed of a recorded moving image based on conditions that have not been considered in the past. To do.

  In order to solve the above problems, the present invention provides at least one of a photographing unit that captures a moving image, a recording unit that records the moving image, a movement of a subject of the moving image, and a type of a main subject included in the subject. And a control means for controlling the photographing means and the recording means so as to record a moving picture to be played back at the playback speed determined by the determining means. An imaging device comprising: is provided.

  Other features of the present invention will become more apparent from the accompanying drawings and the following description of the preferred embodiments.

  According to the present invention, it is possible to control the playback speed of a recorded moving image based on conditions that have not been considered in the past.

1 is a block diagram illustrating a configuration of an imaging apparatus 100 according to a first embodiment. FIG. 3 is a conceptual diagram of a combined moving image file including a plurality of chapters generated by the imaging apparatus 100. The figure which shows the example of a template synthetic | combination effect. The figure which shows the example of a variable frame rate effect. The figure which shows the classification of various special effects. 4 is a flowchart showing moving image shooting processing by the imaging apparatus 100. 7 is a flowchart showing details of a special effect process A group determination process in S603 of FIG. The flowchart which shows the detail of the selection algorithm of the special effect process A group in S702 of FIG. The conceptual diagram of the update of the evaluation value in the selection algorithm of special effect process A group. FIG. 7 is a flowchart showing details of variable frame rate effect determination processing for special effect processing group B in S604 of FIG. 6. FIG. The conceptual diagram of the method of detecting a motion of a to-be-photographed object. The conceptual diagram of a motion determination area. The conceptual diagram of the method of determining the weight pattern of a variable frame rate effect. The figure which shows the example of the weight pattern of a variable frame rate effect. 11 is a flowchart showing details of processing in S1007 of FIG. The figure which shows another example of a variable frame rate effect determination process. The figure which shows another example of the variable frame rate effect determination process. The figure which illustrates the joint animation file to which various special effects were added.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. The technical scope of the present invention is determined by the claims, and is not limited by the following individual embodiments. In addition, not all combinations of features described in the embodiments are essential to the present invention.

[First Embodiment]
FIG. 1 is a block diagram illustrating a configuration of the imaging apparatus 100 according to the first embodiment. In FIG. 1, reference numeral 101 denotes an optical system including a plurality of lens groups and a diaphragm mechanism, and specifically includes a distance measuring lens (FocusLens), a zoom lens (ZoomLens), and a diaphragm mechanism.

  Reference numeral 102 denotes an image sensor made up of a CCD, a CMOS, or the like, and includes an A / D converter that converts an analog signal into a digital signal. The surface of the image sensor 102 is covered with an RGB color filter such as a Bayer array, for example, so that color imaging can be performed. When the subject image is formed on the image sensor 102, image data (image signal) is generated and stored in the memory 103.

  Reference numeral 103 denotes a memory, which can hold an image signal generated by the image sensor 102, data necessary for overall processing of the imaging apparatus 100, and the like. Reference numeral 104 denotes an image processing circuit, which performs predetermined pixel interpolation processing, color conversion processing, and the like on the image signal held in the memory 103. The image processing circuit 104 performs predetermined calculation processing using the captured image data, determines shooting conditions based on the obtained calculation results, and notifies the system control unit 105 of the shooting conditions. The image processing circuit 104 has various functions such as image analysis, filter processing, noise reduction processing, and composition processing, and includes a special effect processing determination unit that selects a special effect optimum for the shooting scene according to an algorithm described later. .

  Reference numeral 105 denotes a system control unit that controls the entire imaging apparatus 100. The system control unit 105 controls the shutter speed, the aperture mechanism, the focus lens, and the zoom lens in order to perform shooting under the shooting conditions determined by the image processing circuit 104. For this purpose, the system control unit 105 instructs the exposure amount control unit 106, the focus lens control unit 107, and the focal length control unit 108.

  An exposure amount control unit 106 adjusts the aperture mechanism of the optical system 101, the exposure time of the image sensor 102, and the photographing sensitivity, and performs appropriate exposure amount control. A focus lens control unit 107 controls the focus lens of the optical system 101. A focal length control unit 108 controls the zoom lens of the optical system 101, and changes the focal length according to instructions from the system control unit 105.

  Reference numeral 109 denotes a compression circuit, which converts a moving image to H.264. It is compressed according to a compression algorithm typified by H.264 / AVC, and converted into an MPEG or MOV file. The converted moving image is recorded on the recording medium 110.

  Reference numeral 111 denotes a display unit that displays a captured image generated by the image processing circuit 104 on the LCD of the imaging apparatus 100, an external monitor, or the like. Reference numeral 112 denotes an operation member that receives user input, and includes buttons, a touch panel, and the like. The system control unit 105 determines or changes the operation of the imaging apparatus 100 in accordance with a user operation received through the operation member 112.

  Next, an overview of the moving image shooting process performed by the imaging apparatus 100 will be described with reference to FIGS. The imaging apparatus 100 performs moving image shooting a plurality of times, and generates moving image data by combining moving image data obtained by the respective shootings. In FIG. 2, “chapter” indicates moving image data obtained by one shooting, and “combined moving image file” indicates one moving image data obtained by combining a plurality of chapters.

The imaging apparatus 100 adds various types of special effects as listed below, for example, to each moving image (each chapter).
(1) Color / tone conversion filter effect (2) Template composition effect (3) Variable frame rate effect (4) Afterimage effect

  “(1) Color / gradation conversion filter effect” is a special effect that adds an atmosphere suitable for a subject or a shooting scene to a moving image by changing the color and contrast of the moving image by the image processing circuit 104. In other words, “(1) color / gradation conversion filter effect” corresponds to application control of a filter that converts at least one of color and gradation. For example, the image processing circuit 104 can generate a monochrome moving image with high contrast from the captured color moving image.

  “(2) Template synthesis effect” is a special effect obtained by a process of synthesizing predetermined template data (hereinafter simply referred to as “template”) to each frame of a moving image by the image processing circuit 104. In other words, “(2) Template synthesis effect” corresponds to template synthesis control. For example, depending on the image processing circuit 104, a decorative frame can be combined with the frame as shown on the left side of FIG. 3, or a peripheral dimming effect can be added as shown on the right side of FIG.

  The “(3) variable frame rate effect” is a special effect that emphasizes the movement of the subject by making the whole or part of the moving image slow motion or fast-forward playback. In other words, “(3) variable frame rate effect” corresponds to control of the playback speed of a moving image. As a method for realizing this effect, by recording a moving image at a frame rate Frec (= N × Fplay) which is N times the playback frame rate Fplay, it is possible to achieve slow playback of (1 / N) times. On the other hand, N times fast-forward playback is possible by thinning out the frames of a moving image shot at the same frame rate Frec (= Fplay) as Fplay to 1 / N. As described above, the playback speed can be controlled by controlling the shooting frame rate and the recording frame rate. Further, using such a mechanism, for example, as shown in FIG. 4B, it is possible to generate a moving image whose playback speed changes as “normal → slow → normal”. Specifically, when the playback frame rate Fplay = 30 [fps], the imaging apparatus 100 records a part of data captured for several seconds at Frec = 90 [fps] by thinning out to 1/3. As a result, it is possible to perform the slow reproduction of 1/3 times the section where thinning is not performed. In this way, a playback pattern in which at least a part of a moving image is played back slowly is called a “slow playback pattern”. In addition, as shown in FIG. 4C, it is possible to generate a moving image whose playback speed changes as “normal → fast forward → normal”. Specifically, when the playback frame rate Fplay = 30 [fps], the imaging apparatus 100 records a part of data captured for several seconds at Frec = 30 [fps] by thinning out to 1/3. Thereby, it is possible to reproduce the fast-forwarded reproduction of the section where the thinning is performed three times. A playback pattern in which at least a part of a moving image is played back in this way is called a “fast forward playback pattern”. As shown in FIG. 4A, when Fplay = Frec and thinning is not performed, the entire moving image is normally reproduced. In this way, a reproduction pattern in which the entire moving image is reproduced at a normal speed is referred to as a normal reproduction pattern.

  “(4) Afterimage effect” is a special effect that adds an afterimage to a moving subject using a recursive filter. In other words, “(4) Afterimage effect” corresponds to afterimage addition control for a moving subject.

  The imaging apparatus 100 determines the content of the special effect based on the shooting scene for each type of special effect. For example, the imaging apparatus 100 selects “decorative frame composition”, “peripheral dimming”, or “no composition” based on the shooting scene for a special effect of the type “(2) template composition effect”. Details of the determination algorithm will be described later.

  By the way, there are some special effects that can improve the overall quality of the combined video if the special effects are unified (shared) between chapters. Depending on the shooting scene for each chapter (for each video) There are also types that are expected to improve the fun of moving images with special effects. In the present embodiment, the special effect of the former type is referred to as “special effect processing A group”, and the special effect of the latter type is referred to as “special effect processing B group”. As shown in FIG. 5, in this embodiment, “(1) color / tone conversion filter effect” and “(2) template composition effect” are “special effect processing A group”, and “(3) Assume that “variable frame rate effect” and “(4) afterimage effect” are “special effect processing B group”. As can be understood from FIG. 5, a plurality of special effects such as “decorative frame composition” and “peripheral dimming” are included in a specific type of special effect (special effect group) such as “(2) template composition effect”. Includes special effects.

  The classification of “special effect processing A group” and “special effect processing B group” is not limited to that shown in FIG. Also, the types of special effects and the special effects that can be selected for each type of special effect are not limited to those shown in FIG. In the present embodiment, at least one type of special effect (first special effect group) classified into “special effect processing A group” and at least one type of special effect (first special effect processing B group) ( A second special effect group).

  Next, with reference to FIG. 6, the details of the moving image shooting process by the imaging apparatus 100 will be described. It should be noted that the processing of each step in the flowchart of each drawing of the present embodiment is performed by the system control unit 105 controlling each component of the imaging apparatus 100 according to a control program unless otherwise specified.

  In step S601, the imaging apparatus 100 analyzes a shooting scene. Specifically, the imaging apparatus 100 analyzes the brightness of the shooting target scene, whether the subject is a person, whether the subject is moving, and the like. This analysis is performed based on information from various sensors such as an acceleration sensor (not shown) and a gyro sensor (not shown), image data generated by the image sensor 102, and the like. Analysis based on the image data can be performed using the image processing circuit 104.

  In step S602, the imaging apparatus 100 determines whether a shooting instruction has been given by the user. The imaging apparatus 100 repeats the scene analysis in S601 until a shooting instruction is given. When a shooting instruction is given, the process proceeds to S603.

  In S603, the imaging apparatus 100 determines a special effect to be added to the captured moving image with respect to the special effect process A group (see FIG. 5) based on the scene analysis result in S601. Details of this determination process will be described later.

  In step S604, the imaging apparatus 100 determines a special effect to be added to the captured moving image with respect to the special effect processing group B (see FIG. 5) based on the scene analysis result in step S601. Details of this determination process will be described later.

  By the processing of S603 and S604, a special effect to be added to the chapter to be photographed is determined immediately before the chapter photographing is started.

  In step S605, the imaging apparatus 100 performs moving image capturing control and acquires one frame of the moving image. Here, the imaging apparatus 100 performs drive frequency / exposure amount control of the imaging system according to the content of the variable frame rate effect determined in S604. For example, when a slow playback effect is added to a moving image, the imaging device 100 controls the imaging device 102 so as to perform imaging at a frequency higher than the playback frame rate. In addition, when a fast-forward playback effect is added to a moving image, the imaging device 100 controls the imaging device 102 so as to perform imaging at the same frequency as the playback frame rate. In addition, the imaging apparatus 100 correctly sets an exposure amount including an aperture, a shutter speed, and sensitivity via the exposure amount control unit 106.

  In step S606, the imaging apparatus 100 adds the special effect of the special effect process A group determined in step S603 to the frame acquired in step S605. In step S607, the imaging apparatus 100 adds the special effect of the special effect process B group determined in step S604 to the frame acquired in step S605. For example, the imaging apparatus 100 controls the shooting frame rate and the recording frame rate (decimation) so that a moving image that is played back at a playback speed corresponding to the variable frame rate effect determined in S604 is recorded. A variable frame rate is added to.

  Note that the order of adding special effects is not limited to that shown in FIG. For example, the special effect of the special effect process B group may be added first, and then the special effect of the special effect process A group may be added. Or, add a part of special effects of special effect processing A group first, then add special effects of special effect processing group B, and finally add the rest of special effects of special effect processing group A Also good.

  In S608, the imaging apparatus 100 compresses the frame to which the special effect is added and records it as a frame of the combined moving image file (see FIG. 2). Note that the imaging apparatus 100 can combine chapters at an arbitrary timing. For example, the imaging apparatus 100 can generate a separate moving image file for each chapter, and after a predetermined number of moving image files are generated, these moving image files can be combined to generate a combined moving image file. Alternatively, the imaging apparatus 100 may generate a combined moving image file by adding a new chapter frame to the immediately preceding chapter. When performing thinning recording as shown in FIGS. 4B and 4C, if the current frame is a frame to be thinned, the imaging apparatus 100 discards the frame without recording it. .

  In step S609, the imaging apparatus 100 determines whether a user has instructed to end shooting. Until the shooting end instruction is given, the imaging apparatus 100 repeats the processing from S605 to S608 to continue shooting the current chapter. Alternatively, the imaging apparatus 100 repeats the processing from S605 to S608 until a predetermined time has elapsed since the start of video recording, and determines that the video imaging is to be terminated when the predetermined time has elapsed.

  When a shooting end instruction is performed, the process returns from S609 to S601, and the imaging apparatus 100 performs scene analysis until the next shooting instruction is performed. When the next shooting instruction is given, the imaging apparatus 100 performs the processing of S603 and subsequent steps, thereby shooting the next chapter. However, with regard to the special effect processing A group determination processing in S603, when shooting the second and subsequent chapters, the same special effects as the first (first) chapter are determined.

  Although not shown, the imaging apparatus 100 may capture the first chapter of another combined moving image file after capturing a predetermined number of chapters. For example, it is assumed that the imaging apparatus 100 is configured to generate a combined moving image file including four chapters. In this case, when the imaging of the fourth chapter by the imaging apparatus 100 is completed, the process returns from S609 to S601, and when an imaging instruction is given, in S603, the imaging apparatus 100 causes the first chapter of the next combined video file to be captured. Therefore, the special effect of the special effect process A group is determined.

  Next, the details of the special effect process A group determination process in S603 of FIG. 6 will be described with reference to FIGS. First, in S701 of FIG. 7, the imaging apparatus 100 determines whether or not the current shooting target chapter is the first (first) chapter in the combined moving image file. In the case of the first chapter, in step S702, the imaging apparatus 100 executes a selection algorithm for the special effect process A group. If it is not the first chapter, in S703, the imaging apparatus 100 selects the same special effect as that previously selected for the first chapter in S702.

  With the processing in FIG. 7, for special effect processing A group, it is possible to unify the special effects added to each chapter in the combined moving image file and to generate a moving image with higher quality and a sense of unity. However, although not shown, the imaging apparatus 100 selects a filter with priority given to the user's intention (user instruction) when receiving an instruction to change the filter effect from the user, even for the second and subsequent chapters. be able to. That is, in this case, the imaging apparatus 100 adds the special effect selected by the user instruction to the chapter corresponding to the user instruction instead of the special effect selected in S702 for the first chapter.

  FIG. 8 is a flowchart showing details of the special effect processing A group selection algorithm in S702 of FIG. Here, “(1) color / gradation conversion filter effect” which is an example of a special effect belonging to the special effect processing group A will be described. However, other types of special effects (for example, “(2) template composition” A similar algorithm can be used for “effect”).

In the present embodiment, the imaging apparatus 100 is capable of selecting M types of color / gradation conversion filters. First, in S801, the imaging apparatus 100 uniformly sets the evaluation value x [m] of the M filters to the initial value P according to the following equation (1).
x [m] = P (m = 0, 1, 2,..., M−1) (1)

  In S802, the imaging apparatus 100 updates the evaluation value according to the scene analysis result (for example, subject information or color distribution information of the captured image) in S601 of FIG. For example, when the subject includes a person, the imaging apparatus 100 shoots an evaluation value calculation process such as “increase the evaluation value of a filter that is compatible with a person and decrease the evaluation value of a filter that is not compatible with a person”. Execute multiple times depending on the scene analysis result. As a result, as shown in FIG. 6, the final evaluation value x [m] varies depending on the shooting scene.

  Thereafter, in S803, the imaging apparatus 100 selects a filter having the highest evaluation value. Alternatively, the imaging apparatus 100 can select a filter effect that is compatible with the shooting scene by a method such as randomly selecting one filter from filters having an evaluation value higher than a predetermined threshold. is there.

  Next, details of the special effect process B group determination process in S604 of FIG. 6 will be described with reference to FIGS. Here, “(3) variable frame rate effect” which is an example of a special effect belonging to the special effect processing group B will be described, but other types of special effects (for example, “(4) afterimage effect”) will be described. A similar algorithm can be used.

  First, in S1001, the imaging apparatus 100 acquires motion information of the imaging apparatus 100 based on the scene analysis result in S601 of FIG. It is predicted that the amount of movement of the imaging apparatus 100 itself is larger when the user is tracking and shooting a moving subject than when the user is shooting a subject such as a flower or landscape. Therefore, the imaging apparatus 100 detects the presence or absence of movement of the imaging apparatus 100 based on the output of a speed sensor, an acceleration sensor, or the like provided in the imaging apparatus 100. As a method of determining the presence or absence of the movement of the imaging apparatus 100, the output values of the speed sensor and the like are averaged for a predetermined time, and when the average value exceeds a predetermined threshold Th_G, “with movement”, A method of “no movement” can be considered.

  In S1002, the imaging apparatus 100 detects the subject type (the type of main subject included in the subject) based on the scene analysis result in S601 of FIG. In general, it is possible to detect a face in the screen by a method such as pattern matching. When a face is found, the subject type is defined as “person”. Also, a main subject detection algorithm for determining whether or not a main subject exists in the screen from the luminance and color area distribution and edge information in the screen is generally known. Therefore, when a face is not detected and a subject is detected by the main subject detection algorithm, the subject type is defined as “main subject other than person is present”. If no subject is detected by any of the above methods, it is defined as “no main subject”.

In step S1003, the imaging apparatus 100 acquires subject motion information according to the subject type detected in step S1002. As a method of detecting the movement of the subject, when the subject type is “person”, for example, as shown in FIG. 11A, the face position between a frame at a certain time F (t) and a frame at F (t + α) There is a method of detecting that “subject movement is present” when the amount of change in the amount exceeds the threshold Th_F. When the subject type is “there is a main subject other than a person”, as shown in FIG. 11B, the center of gravity position of the main subject region between the frame at time F (t) and the frame at F (t + α) is shown. There is a method of detecting “subject motion present” when the amount of change exceeds a threshold Th_M. Further, when the subject type is “no main subject”, as shown in FIG. 11C, the sum S of the luminance difference values between frames is calculated according to the following equation (2) for a predetermined area in the screen. There is a method of calculating and “detecting subject movement” when the sum S exceeds a threshold Th_Sad.
S = Σ (Y1 (x, y) −Y0 (x, y)) (2)
Y1: Brightness of frame 1 Y0: Brightness of frame 0

  Next, in S1004, the imaging apparatus 100 determines a motion detection area based on the motion information acquired in S1001 and S1003. The motion detection area can be divided into four areas shown in FIG. 12 according to the presence / absence of the movement of the imaging apparatus 100 and the presence / absence of the movement of the subject.

  In step S1005, the imaging apparatus 100 determines a variable frame rate effect weight pattern according to the area determination result in step S1004 and the subject type detected in step S1002. Here, the weight pattern represents the occurrence ratio of the normal / slow / fast-forward effect described with reference to FIG. As shown in FIG. 13, any one of the four patterns shown in FIG. 14 is selected as the weight pattern according to the area and the subject type. Each pattern has a probability of selecting “normal” (first probability), a probability of selecting “slow” (second probability), and a probability of selecting “fast forward” (third probability). Is defined. For example, for the “normal priority” pattern, the probability of selecting “normal” (first probability) is set to be the highest so that “normal” is preferentially selected. For the “normally fixed” pattern, the probability of selecting “normal” (first probability) is set to “100%” so that “normal” is fixedly selected.

  In the example of FIG. 13, the imaging apparatus 100 determines the weight pattern based on all of the movement of the imaging apparatus 100, the movement of the subject, and the main subject. The weight pattern may be determined based only on the part. For example, the imaging apparatus 100 is configured to select “slow priority” (when the subject moves) or “normal priority” (when there is no subject movement) depending on whether or not the subject moves. Also good.

  In step S1006, the imaging apparatus 100 corrects the weight pattern determined in step S1005 based on the chapter number of the current shooting target, the type of variable frame rate effect selected in the past, the focal length of the imaging apparatus 100, and the like. The following are four examples of weight correction methods when “slow priority” is selected in S1005.

(I) If the chapter to be photographed is chapter 1, increase the “normal” ratio slightly and decrease the other ratios.
(Before correction) Normal: Slow: Fast forward = 20:60:20
(After correction) Normal: Slow: Fast forward = 30:40:30
→ Do not add special effects as much as possible to the first chapter of the combined video file.

(Ii) If the current chapter to be photographed is the final chapter N, the ratio of “slow” and “fast forward” is slightly increased and the other ratios are decreased.
(Before correction) Normal: Slow: Fast forward = 20:60:20
(After correction) Normal: Slow: Fast forward = 10:65:25
→ Add special effects as much as possible to the last (end) chapter of the combined video file.

(Iii) If the chapter to be photographed is other than chapter 1 and the effect selected in chapter 1 is “slow”, the ratio of “slow” is increased and the other ratios are decreased.
(Before correction) Normal: Slow: Fast forward = 20:60:20
(After correction) Normal: Slow: Fast forward = 10:80:10
→ Increase the probability that similar special effects will be selected in the combined video file.

(Iv) When the focal length of the imaging apparatus 100 is greater than or equal to a preset focal length f_Th (greater than or equal to a threshold value), the influence of camera shake on the moving image increases. Raise.
(Before correction) Normal: Slow: Fast forward = 20:60:20
(After correction) Normal: Slow: Fast forward = 30: 70: 0
The correction of the weight pattern described above is a device aimed at increasing the satisfaction of the viewer when the moving image is viewed as the whole combined moving image file in which a plurality of chapters are connected. The weight pattern correction methods are not limited to the four types described here, and various weight pattern correction methods may be considered according to the designer's idea. More generally speaking, the imaging apparatus 100 adds a special effect to be added to a predetermined chapter for the variable frame rate effect to the shooting parameter of this chapter, the position of this chapter in the combined moving image file, and the first chapter. Decide in consideration of special effects. Note that the imaging apparatus 100 need not consider all of these elements, and may consider only some of them.

  Finally, in S1007, the imaging apparatus 100 determines the content of the final variable frame rate effect. Specifically, in S1501 of FIG. 15, the imaging apparatus 100 generates a normal random number R of [1,100] and determines whether R <Td. Td is the probability of occurrence of “normal”. If R <Td, in step S1502, the imaging apparatus 100 selects “normal” as the variable frame rate effect. If R ≧ Td, in step S1503, the imaging apparatus 100 determines whether R <Td + Ts. Ts is the occurrence probability of “slow”. When R <Td + Ts, in step S1504, the imaging apparatus 100 selects “slow” as the variable frame rate effect. If R ≧ Td + Ts, in step S1505, the imaging apparatus 100 selects “fast forward” as the variable frame rate effect.

  6 and 10, the content of the variable frame rate effect is determined immediately before the start of shooting. However, the imaging apparatus 100 may determine the content of the variable frame rate effect at another timing. For example, as illustrated in FIG. 16, when the imaging apparatus 100 analyzes motion information at regular intervals during shooting and detects that there is a motion of a subject, the imaging device 100 then increases the imaging rate for a certain period of time to generate a moving image. A variable frame rate effect “slow” can be added. Alternatively, as illustrated in FIG. 17, the imaging apparatus 100 captures a moving image at the highest frame rate, analyzes subject movement in the moving image after capturing, and then applies a variable frame rate effect with predetermined content to the moving image. Can be added.

  Through the processing described above, a combined moving image file to which various special effects according to the shooting scene are added is generated. An example of the combined moving image file generated in this way is shown in FIG. The combined moving image file of FIG. 18 includes four chapters, and four types of special effects are added to each chapter. For “(1) color / gradation conversion filter effect” and “(2) template synthesis effect” which are special effects of the type belonging to the special effect processing group A, a special effect common to each chapter is added. In addition, with regard to “(3) variable frame rate effect” and “(4) afterimage effect” which are special effects of the type belonging to the special effect processing group B, special effects corresponding to the shooting scene are added for each chapter. Yes. As can be understood from the fact that the afterimage effect of chapter 1 is “none”, the special effect processing group B does not necessarily add the special effect to all chapters. In other words, for the special effect process B group, the imaging apparatus 100 adds a special effect determined for each chapter to each of one or more chapters of the plurality of chapters constituting the combined moving image file. As a result, it is possible to generate an “interesting” moving image that is adaptive to the shooting scene, while maintaining unity as a whole combined moving image file.

  As described above, according to the first embodiment, the imaging apparatus 100 adds a common special effect to each chapter for the special effect processing A group, and for each chapter for the special effect processing B group. Add special effects to be determined. As described above, the imaging apparatus 100 is configured to control whether or not to share a special effect added to a plurality of moving images according to the type of the special effect. Further, the imaging apparatus 100 adds a variable frame rate effect to the moving image (that is, controls the playback speed of the recorded moving image) based on conditions that have not been considered in the past, such as the movement of the subject and the type of the main subject. To be configured).

[Other Embodiments]
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

  DESCRIPTION OF SYMBOLS 100 ... Imaging device 101 ... Optical system 102 ... Imaging device 103 ... Memory 104 ... Image processing circuit 105 ... System control part 106 ... Exposure amount control part 107 ... Focus lens control part 108 ... Focal length control 109, compression circuit, 110, recording medium, 111, display unit, 112, operation member

Claims (16)

Shooting means for shooting videos,
Recording means for recording the moving image;
Determining means for determining a playback speed of the moving image based on at least one of a motion of a subject of the moving image and a type of a main subject included in the subject;
Control means for controlling the photographing means and the recording means so that a moving image reproduced at the reproduction speed determined by the determining means is recorded;
An imaging apparatus comprising: The said determination means determines the said reproduction speed based on the motion of the said imaging device in addition to at least one of the motion of the said subject and the kind of the said main subject. Imaging device. The imaging apparatus according to claim 2, wherein the determination unit determines the reproduction speed based on the movement of the subject, the type of the main subject, and the movement of the imaging apparatus. The determination means includes a normal playback pattern in which the entire moving image is played back at a normal speed, a slow playback pattern in which at least a portion of the moving image is played back slowly, and a fast-forward playback in which at least a portion of the moving image is played back in a fast-forward manner. The imaging apparatus according to claim 3, wherein the reproduction speed is determined so that the moving image is reproduced with any one of the reproduction patterns. The determining means includes
Preferentially selecting the slow playback pattern when there is a movement of the imaging device, there is a movement of the subject, and the main subject is a person;
Preferentially selecting the slow playback pattern when there is a movement of the imaging device, there is a movement of the subject, and the main subject is other than a person;
Preferentially selecting the normal reproduction pattern when there is a movement of the imaging device, a movement of the subject, and a main subject is not included in the subject;
Preferentially selecting the slow reproduction pattern when there is a movement of the imaging device, no movement of the subject, and the main subject is a person;
Preferentially selecting the slow playback pattern when there is a movement of the imaging device, there is no movement of the subject, and the main subject is other than a person;
The normal reproduction pattern is fixedly selected when there is a movement of the imaging device, no movement of the subject, and no main subject is included in the subject;
Preferentially selecting the slow playback pattern when there is no movement of the imaging device, there is movement of the subject, and the main subject is a person;
The fast-forward playback pattern preferentially selects priority when there is no movement of the imaging device, there is movement of the subject, and the main subject is other than a person;
Preferentially selecting the fast-forward playback pattern when there is no movement of the imaging device, there is movement of the subject, and the main subject is not included in the subject,
When the imaging device does not move, the subject does not move, and the main subject is a person, the slow reproduction pattern is preferentially selected.
Preferentially selecting the normal playback pattern when there is no movement of the imaging device, no movement of the subject, and the main subject is other than a person; and
Preferentially selecting the normal reproduction pattern when there is no movement of the imaging device, no movement of the subject, and no main subject is included in the subject;
The imaging apparatus according to claim 4, wherein at least one of the above is executed. The determining means determines a first probability, a second probability, and a third probability based on the movement of the subject, the type of the main subject, and the movement of the imaging device, and the first probability 6. The imaging apparatus according to claim 4, wherein the normal reproduction pattern is selected, the slow reproduction pattern is selected with the second probability, and the fast-forward reproduction pattern is selected with the third probability. . The imaging apparatus according to claim 6, wherein the determining unit determines the first probability, the second probability, and the third probability based further on a shooting parameter of the moving image. The imaging apparatus according to claim 7, wherein the determination unit reduces the third probability when a focal length of the moving image is greater than or equal to a threshold value. The control means controls the photographing means and the recording means so that a plurality of moving images are photographed and the plurality of moving images are recorded as one combined moving image,
The determining means further includes, based on at least one of a position of the predetermined moving image in the combined moving image and a reproduction pattern of a first moving image in the combined moving image, for the predetermined moving image constituting the combined moving image. The imaging apparatus according to any one of claims 6 to 8, wherein a probability of 1, the second probability, and the third probability are determined. The determining means increases the probability corresponding to the reproduction pattern of the first moving image in the combined moving image out of the first probability, the second probability, and the third probability for the predetermined moving image. The imaging apparatus according to claim 9, wherein the imaging apparatus is characterized. The imaging apparatus according to claim 9, wherein the determination unit increases the first probability for the predetermined moving image when the predetermined moving image is a head moving image in the combined moving image. The determining means raises at least one of the second probability and the third probability for the predetermined moving image when the predetermined moving image is the last moving image in the combined moving image. The imaging device according to any one of claims 9 to 11. The control means controls the photographing means and the recording means so that a plurality of moving images are photographed and the plurality of moving images are recorded as one combined moving image,
The determining means is configured to determine, based on at least one of a position of the predetermined moving image in the combined moving image and a playback speed of the first moving image in the combined moving image, for the predetermined moving image constituting the combined moving image. The imaging apparatus according to claim 1, wherein a reproduction speed of the moving image is determined. When the predetermined moving image is the last moving image in the combined moving image, the determining means performs slow playback of the reproduction speed of the predetermined moving image, compared to the case where the predetermined moving image is the first moving image in the combined moving image, Alternatively, the probability of fast-forward playback is increased. The imaging apparatus according to claim 13. A method for controlling an imaging apparatus,
An imaging process in which the imaging means of the imaging device captures a moving image;
A recording step in which the recording unit of the imaging apparatus records the moving image;
A determining step in which the determining unit of the imaging apparatus determines the playback speed of the moving image based on at least one of a motion of a subject of the moving image and a type of a main subject included in the subject;
A control step for controlling the photographing step and the recording step so that the moving image reproduced at the reproduction speed determined by the determining step is recorded by the control means of the imaging device;
A control method comprising:   The program for functioning a computer as each means of the imaging device of any one of Claims 1 thru | or 14.

Images