JP2011010276A - Image reproducing apparatus and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically reproduce an important scene slow.SOLUTION: When reproducing a moving image, a viewer designates a plurality of objects of interest on the moving image utilizing a touch panel function or the like. An image reproducing apparatus sets the designated objects of interest as a tracking target and tracks positions of the tracking targets on the moving image. During reproduction of the moving image, a distance between tracking targets is sequentially calculated as an evaluation distance and a video section with a relatively small evaluation distance is reproduced slow. Furthermore, a distance between the position of a tracking target designated by a user and a fixed position on the moving image can be also defined as an evaluation distance.

Description

  The present invention relates to an image reproducing device for reproducing an image and an imaging device such as a digital camera.

  Slow playback is often desired when viewing important scenes such as scenes where soccer players hold the ball or track competition goal scenes when playing a moving image recording a soccer game or track competition. Also, not only soccer games and track competitions, slow playback is often desired when viewing important scenes in various moving images. However, in moving image reproduction, it is troublesome for the user himself to set the optimum reproduction speed for each important scene.

  A method is also conceivable in which the difference between frames is used to determine whether or not an object moves on the image, and the video section with the object movement is automatically played back in slow motion. However, with this method, an excessively slow playback section is set in response to all moving objects, so that it is difficult to view the video.

  Patent Documents 1 and 2 listed below disclose methods for detecting a slow playback section using interframe differences. However, the methods of these documents detect the slow playback section on the playback device side from the video data in which the slow playback section has already been inserted (for example, video data by broadcast in which the slow playback section has already been inserted by the program producer). And the extraction method, and does not contribute to the solution of the above-described problems.

JP 2007-336088 A JP 2006-33125 A

  Therefore, an object of the present invention is to provide an image reproduction apparatus that contributes to the optimization of the reproduction speed for important scenes. It is another object of the present invention to provide an imaging apparatus that contributes to an appropriate recording frame rate for an important scene.

  The image reproduction device according to the present invention is an image reproduction device that reproduces a moving image at an evaluation distance that is a distance between a plurality of specific objects on the moving image or a fixed position on the moving image and a target object. Accordingly, a playback speed control unit for controlling the playback speed of the moving image is provided.

  If a plurality of objects (including persons) focused on by the user (viewer) are set as the plurality of specific objects, for example, when the soccer players as the specific objects approach each other, the playback speed is reduced. It becomes possible. In addition, if an object (including a person) focused on by the user is set as the attention object, for example, when a soccer player as the attention object approaches a goal placed at a fixed position, the playback speed is reduced. It becomes possible to do. As described above, according to the above-described image reproduction apparatus, it is expected that the scene reproduction speed important for the user is optimized.

  Specifically, for example, the playback speed control unit tracks the position of each specific object on the moving image based on the image data of the moving image, and thereby, between the plurality of specific objects as the evaluation distance. Or by tracking the position of the target object on the moving image based on the image data of the moving image, the distance between the fixed position and the target object as the evaluation distance is calculated. To derive.

  More specifically, for example, the playback speed control unit changes the playback speed in three or more stages during playback of the moving image according to the evaluation distance.

  Another image reproduction apparatus according to the present invention is an image reproduction apparatus that reproduces a moving image, and controls the reproduction speed of the moving image according to at least one of a direction and an inclination of a human face on the moving image. A playback speed control unit is provided.

  According to this image reproduction device, for example, it is possible to reduce the reproduction speed when the face faces the front. The video section in which the face is facing the front is estimated to be an important video section for the user. Therefore, according to this image reproduction apparatus, it is expected that the reproduction speed of a scene important for the user is optimized.

  Still another image playback device according to the present invention is a playback speed control for controlling a playback speed of the moving image in accordance with a magnitude of an acoustic signal associated with the moving image in an image playback device for playing back a moving image. It has the part.

  According to this image reproduction device, for example, it is possible to reduce the reproduction speed when the size of the acoustic signal is large. A section with a large acoustic signal is estimated to be a video section in which the scene is lively, and such a section is likely to be an important video section for the user. Therefore, according to this image reproduction apparatus, it is expected that the reproduction speed of a scene important for the user is optimized.

  An imaging device provided with any of the above-described image reproducing devices may be formed. The imaging apparatus acquires the moving image to be reproduced by the image reproduction apparatus by photographing.

  The imaging apparatus according to the present invention is a distance between a plurality of specific objects on the moving image or a distance between a fixed position on the moving image and a target object in the imaging apparatus that captures and records a moving image. A frame rate control unit that controls the frame rate of a moving image to be recorded according to the evaluation distance is provided.

  If a plurality of objects (including persons) focused on by the user (photographer) are set as the plurality of specific objects, for example, the recording frame rate is increased when soccer players as specific objects approach each other. It is possible to make it. Further, if an object (including a person) focused on by the user is set as the noted object, for example, the recording frame rate is set when a soccer player as the noted object approaches a goal placed at a fixed position. It can be increased. If a video section with an increased recording frame rate that is estimated to be a video section important for the user is normally played back, the video section is played back in slow motion. As described above, according to the above-described imaging apparatus, it is expected that the recording frame rate of a scene important for the user is optimized.

  Specifically, for example, the playback speed control unit tracks the position of each specific object on the moving image based on the image data of the moving image, and thereby, between the plurality of specific objects as the evaluation distance. Or by tracking the position of the target object on the moving image based on the image data of the moving image, the distance between the fixed position and the target object as the evaluation distance is calculated. To derive.

  More specifically, for example, the frame rate control unit changes the frame rate of the recorded moving image in three or more steps according to the evaluation distance.

  According to another aspect of the present invention, there is provided an imaging apparatus that captures and records a moving image, and records a moving image according to at least one of a direction and an inclination of a human face on the moving image. A frame rate control unit for controlling the frame rate is provided.

  According to this imaging apparatus, for example, it is possible to increase the recording frame rate when the face faces the front. The video section in which the face is facing the front is estimated to be an important video section for the user. If a video section with an increased recording frame rate that is estimated to be a video section important for the user is normally played back, the video section is played back in slow motion. As described above, according to the above-described imaging apparatus, it is expected that the recording frame rate of a scene important for the user is optimized.

  According to another aspect of the present invention, there is provided an imaging apparatus that captures and records a moving image, and records a moving image according to a magnitude of an acoustic signal collected at the time of capturing the moving image. A frame rate control unit for controlling the frame rate of the image is provided.

  According to this imaging apparatus, for example, the recording frame rate can be increased when the magnitude of the acoustic signal is large. A section with a large acoustic signal is estimated to be a video section in which the scene is lively, and such a section is likely to be an important video section for the user. If a video section with an increased recording frame rate that is estimated to be a video section important for the user is normally played back, the video section is played back in slow motion. As described above, according to the above-described imaging apparatus, it is expected that the recording frame rate of a scene important for the user is optimized.

  For example, in any of the above-described imaging apparatuses, the recorded moving image may be output to the display unit at a constant frame rate.

  Thereby, for example, a video section with an increased recording frame rate, which is estimated as a video section important for the user, is played back in slow motion.

  According to the present invention, it is possible to provide an image reproducing device that contributes to optimization of the reproduction speed for an important scene and an imaging device that contributes to optimization of a recording frame rate for an important scene.

  The significance or effect of the present invention will become more apparent from the following description of embodiments. However, the following embodiment is merely one embodiment of the present invention, and the meaning of the term of the present invention or each constituent element is not limited to that described in the following embodiment. .

1 is an overall block diagram of an imaging apparatus according to a first embodiment of the present invention. FIG. 4 is a partial block diagram of the image pickup apparatus according to the first embodiment of the present invention and particularly related to the operation in the automatic slow motion playback mode. It is a figure which shows the input frame image sequence which forms an input moving image. FIG. 6 is a diagram illustrating one input frame image and two tracking targets on the input frame image according to the first embodiment of the present invention. It is a figure which concerns on 1st Embodiment of this invention and shows the 1st relationship between evaluation distance and a reproduction speed adjustment rate. It is a figure which shows the input frame image (a) in the state where the distance between two tracking object is small, and the input frame image (b) in the state where the distance between two tracking objects is large. It is a figure which concerns on 1st Embodiment of this invention and shows the 2nd relationship between evaluation distance and a reproduction speed adjustment rate. It is a figure which concerns on 1st Embodiment of this invention and shows the relationship between an input frame image sequence and an output frame image sequence. It is a figure which concerns on 1st Embodiment of this invention and shows the relationship between an input frame image sequence and an output frame image sequence. 6 is an operation flowchart of the imaging apparatus in the automatic slow motion playback mode according to the first embodiment of the present invention. It is a figure which concerns on 2nd Embodiment of this invention and shows the tracking target and fixed position on one input frame image and this input frame image. FIG. 10 is a partial block diagram of an imaging apparatus according to a fourth embodiment of the present invention and particularly related to an operation in an automatic slow motion recording mode. It is a figure which concerns on 4th Embodiment of this invention and shows the relationship between evaluation distance and imaging | photography rate (frame rate at the time of imaging | photography). 14 is an operation flowchart of the imaging apparatus in the automatic slow motion recording mode according to the fourth embodiment of the present invention. FIG. 20 is a partial block diagram of an imaging apparatus according to a sixth embodiment of the present invention and particularly related to the operation in the automatic slow motion playback mode. FIG. 8A is a diagram showing a front face, FIGS. B and d showing a front face, and c and e showing a profile according to a sixth embodiment of the present invention. It is a figure for demonstrating the inclination angle of a face concerning 6th Embodiment of this invention. FIG. 20 is a diagram illustrating a manner in which a region of interest is scanned on an input frame image according to the sixth embodiment of the present invention. It is a figure which concerns on 6th Embodiment of this invention and shows 45 types of reference | standard face images. It is a figure which concerns on 6th Embodiment of this invention and shows the example of a relationship between an evaluation angle and a reproduction speed adjustment rate. 24 is an operation flowchart of the imaging apparatus in the automatic slow motion playback mode according to the sixth embodiment of the present invention. FIG. 16 is a partial block diagram of an imaging apparatus related particularly to an operation in an automatic slow motion recording mode according to a seventh embodiment of the present invention. It is a figure which concerns on 7th Embodiment of this invention and shows the relationship between an evaluation angle and imaging | photography rate (frame rate at the time of imaging | photography). 29 is an operation flowchart of the imaging apparatus in the automatic slow motion recording mode according to the seventh embodiment of the present invention. FIG. 29 is a partial block diagram of an imaging apparatus according to an eighth embodiment of the present invention, and particularly related to the operation in the automatic slow motion playback mode. It is a figure which shows a mode that the whole imaging | photography area of an input moving image is divided | segmented into a some unit area concerning 8th Embodiment of this invention. It is a figure which concerns on 8th Embodiment of this invention and shows the example of a relationship between evaluation volume and a reproduction speed adjustment rate. 29 is an operation flowchart of the imaging apparatus in the automatic slow motion playback mode according to the eighth embodiment of the present invention. FIG. 29 is a partial block diagram of an imaging apparatus according to the ninth embodiment of the present invention, and particularly related to the operation in the automatic slow motion recording mode. It is a figure which concerns on 9th Embodiment of this invention and shows the relationship between evaluation sound volume and imaging | photography rate (frame rate at the time of imaging | photography). 29 is an operation flowchart of the imaging apparatus in the automatic slow motion recording mode according to the ninth embodiment of the present invention. FIG. 25 is a partial block diagram of an imaging apparatus according to the tenth embodiment of the present invention and particularly related to the operation in the automatic slow motion recording mode. It is a figure which shows the outline | summary of 1st-10th embodiment which concerns on this invention.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings. In each of the drawings to be referred to, the same part is denoted by the same reference numeral, and redundant description regarding the same part is omitted in principle. FIG. 33 is a diagram showing an outline of the first to tenth embodiments shown below.

<< First Embodiment >>
A first embodiment of the present invention will be described. FIG. 1 is an overall block diagram of an imaging apparatus 1 according to the first embodiment of the present invention. The imaging device 1 has each part referred by the codes | symbols 11-28. The imaging device 1 is a digital video camera, and can capture a moving image and a still image, and also can simultaneously capture a still image during moving image capturing. Each part in the imaging apparatus 1 exchanges signals (data) between the parts via the bus 24 or 25. The display unit 27 and / or the speaker 28 may be provided in an external device (not shown) of the imaging device 1.

  The imaging unit 11 includes an imaging system (image sensor) 33, an optical system (not shown), a diaphragm, and a driver. The image sensor 33 is formed by arranging a plurality of light receiving pixels in the horizontal and vertical directions. The image sensor 33 is a solid-state image sensor composed of a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like. Each light receiving pixel of the image sensor 33 photoelectrically converts an optical image of an object incident through an optical system and a diaphragm, and outputs an electric signal obtained by the photoelectric conversion to an AFE 12 (Analog Front End). Each lens constituting the optical system forms an optical image of the subject on the image sensor 33.

  The AFE 12 amplifies the analog signal output from the image sensor 33 (each light receiving pixel), converts the amplified analog signal into a digital signal, and outputs the digital signal to the video signal processing unit 13. The amplification degree of signal amplification in the AFE 12 is controlled by a CPU (Central Processing Unit) 23. The video signal processing unit 13 performs necessary image processing on the image represented by the output signal of the AFE 12, and generates a video signal for the image after the image processing. The microphone 14 converts the ambient sound of the imaging device 1 into an analog audio signal, and the audio signal processing unit 15 converts the analog audio signal into a digital audio signal.

  The compression processing unit 16 compresses the video signal from the video signal processing unit 13 and the audio signal from the audio signal processing unit 15 using a predetermined compression method. The internal memory 17 is composed of a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores various data. The external memory 18 as a recording medium is a non-volatile memory such as a semiconductor memory or a magnetic disk, and records the video signal and the audio signal compressed by the compression processing unit 16 in a state of being associated with each other.

  The decompression processing unit 19 decompresses the compressed video signal and audio signal read from the external memory 18. The video signal expanded by the expansion processing unit 19 or the video signal from the video signal processing unit 13 is sent to the display unit 27 such as a liquid crystal display via the display processing unit 20 and displayed as an image. Further, the audio signal that has been expanded by the expansion processing unit 19 is sent to the speaker 28 via the audio output circuit 21 and output as sound.

  The TG (timing generator) 22 generates a timing control signal for controlling the timing of each operation in the entire imaging apparatus 1, and gives the generated timing control signal to each unit in the imaging apparatus 1. The timing control signal includes a vertical synchronization signal Vsync and a horizontal synchronization signal Hsync. The CPU 23 comprehensively controls the operation of each part in the imaging apparatus 1. The operation unit 26 includes a recording button 26a for instructing start / end of moving image shooting and recording, a shutter button 26b for instructing shooting and recording of a still image, an operation key 26c, and the like. Accept the operation. The operation content for the operation unit 26 is transmitted to the CPU 23.

  The operation mode of the imaging apparatus 1 includes a shooting mode in which an image (still image or moving image) can be shot and recorded, and an image (still image or moving image) recorded in the external memory 18 is reproduced and displayed on the display unit 27. Playback mode to be included. Transition between the modes is performed according to the operation on the operation key 26c. The imaging device 1 when operating in the playback mode functions as an image playback device.

  In the shooting mode, a subject is periodically shot at a predetermined frame period, and shot images of the subject are sequentially acquired. A digital video signal representing an image is also called image data. One image is represented by image data for one frame period. One image represented by image data for one frame period is also called a frame image.

  Since the compression and expansion of image data is not related to the essence of the present invention, the following description ignores the existence of compression and expansion of image data (ie, recording compressed image data, for example). Simply expressed as recording image data). In this specification, image data of a certain image may be simply referred to as an image.

  The imaging apparatus 1 has a function of automatically changing a playback speed that can be called a playback rate (hereinafter referred to as a playback speed variable function) in accordance with the distance between subjects on the moving image when playing back a moving image in the playback mode. Have. The user can freely set whether to enable or disable the playback speed variable function. The variable playback speed function works only when the variable playback speed function is enabled. The playback mode in a state where the playback speed variable function is enabled is particularly called an automatic slow playback mode.

  FIG. 2 shows a partial block diagram of the image pickup apparatus 1 particularly related to the operation in the automatic slow motion playback mode. The tracking processing unit 51 and the speed adjustment unit 52 in FIG. 2 are provided in the imaging apparatus 1. For example, the tracking processing unit 51 and the speed adjustment unit 52 can be provided in the video signal processing unit 13 or the display processing unit 20 of FIG.

  Image data of the input moving image is supplied to the tracking processing unit 51 and the speed adjustment unit 52. In the first embodiment, image data of an input moving image is image data of a moving image recorded in the external memory 18, and the image data is obtained by a shooting operation of the imaging device 1 in a shooting mode. However, the image data of the input moving image may be provided from a device other than the imaging device 1.

  The input moving image is composed of a frame image sequence. An image sequence represented by a frame image sequence refers to a collection of still images arranged in time series. Therefore, the frame image sequence is composed of a plurality of frame images arranged in time series. Each frame image is a still image, and each frame image forming an input moving image is also called an input frame image.

As shown in FIG. 3, FI ₁ , FI ₂ , FI ₃ ,..., FI _n −1, FI _n ,. n is an integer of 2 or more. The input frame image FI _{i + 1} is a frame image taken next to the input frame image FI _i (i is an arbitrary natural number). Now, it is assumed that the frame rate of the input moving image is 60 fps (frame per second) over the entire input moving image. In this case, the time difference between the input frame image FI _i and the input frame image FI _{i + 1} , that is, the shooting time difference between the input frame images FI _i and FI _{i + 1 is 1} for an arbitrary natural number i. / 60 seconds. In the present specification, for simplicity of description, a name corresponding to a symbol may be omitted or abbreviated by referring to the symbol (symbol). For example, the input frame image FI _n and the image FI _n indicate the same thing.

  The tracking processing unit 51 performs a tracking process for tracking the target object on the input moving image on the input moving image based on the image data of the input moving image. When the input moving image is acquired by photographing of the imaging device 1, the target object is the target subject of the imaging device 1 at the time of capturing the input moving image. The target object to be tracked by the tracking process is hereinafter referred to as a tracking target.

  The user can specify a tracking target. For example, the display unit 27 is provided with a so-called touch panel function. Then, when the input moving image is displayed on the display screen of the display unit 27, the user touches the display area on the display screen where the target object is displayed, so that the target object is tracked. Set as a target. Alternatively, for example, the user can designate a tracking target by a predetermined operation on the operation unit 26. Further alternatively, the imaging apparatus 1 may automatically set a tracking target using face recognition processing. That is, after extracting a face area, which is an area including a person's face, from the input frame image based on the image data of the input frame image, the face included in the face area is matched with a previously registered person's face by face recognition processing. If the match is confirmed, a person having a face included in the face area may be set as a tracking target.

  After setting the tracking target, in the tracking process, the position and size of the tracking target in each input frame image are sequentially detected based on the image data of the input frame image sequence. Actually, an image area in which image data representing the tracking target exists is set as a tracking target area in each input frame image, and the center position (or centroid position) and size of the tracking target area are the position and size of the tracking target. Is detected. The tracking processing unit 51 outputs tracking result information including information indicating the position and size of the tracking target in each input frame image.

  The tracking process between the first and second frame images can be executed as follows. Here, the first frame image refers to a frame image in which the position and size of the tracking target have already been detected, and the second frame image refers to a frame from which the position and size of the tracking target are to be detected. Refers to the image. The second frame image is a frame image that is usually taken after the first frame image.

  For example, the tracking processing unit 51 can perform the tracking process based on the image characteristics of the tracking target. The image feature includes luminance information and color information. More specifically, for example, a tracking frame that is estimated to have the same size as the size of the tracking target area is set in the second frame image, and the image in the tracking frame in the second frame image is set. The similarity between the image feature and the image feature of the image in the tracking target area in the first frame image was executed while sequentially changing the position of the tracking frame in the search area, and the maximum similarity was obtained. It is determined that the center position of the tracking target area in the second frame image exists at the center position of the tracking frame. The search area for the second frame image is set with reference to the position of the tracking target in the first frame image. For example, the search area is a rectangular area centered on the position of the tracking target in the first frame image, and the size (image size) of the search area is smaller than the size of the entire image area of the frame image.

  As a method for detecting the position and size of the tracking target on the frame image, any other method different from the method described above (for example, the method described in Japanese Patent Application Laid-Open No. 2004-94680, or Japanese Patent Application Laid-Open No. 2009-38777). It is also possible to adopt the method described in the publication.

  The speed adjustment unit 52, which can also be referred to as a playback speed control unit or a playback speed adjustment unit, generates an output video from an input video based on tracking result information in the automatic slow playback mode. Each frame image forming the output moving image is also referred to as an output frame image. When the playback speed variable function is enabled, that is, in the automatic slow playback mode, the output moving image is played back and displayed on the display screen of the display unit 27. When the playback speed variable function is disabled, the input moving image is played back and displayed on the display screen of the display unit 27 at the playback speed of 60 fps as it is.

  The speed adjustment unit 52 adjusts the playback speed of the input moving image based on the tracking result information. The moving image obtained after this adjustment is the output moving image. A method for determining the playback speed based on the tracking result information will be described. In the first embodiment, it is assumed that a plurality of tracking targets are set. In this case, the tracking processing unit 51 performs a tracking process on each tracking target, and includes information indicating the position and size of each tracking target in the tracking result information.

  An image 200 shown in FIG. 4 represents one input frame image. There are a plurality of persons in the input frame image 200 (in other words, the image data of the input frame image 200 includes image data representing a plurality of persons). The input moving image including the input frame image 200 is an image of a soccer game, and the object denoted by reference numeral 203 is a goal installed on the soccer field. Now, it is assumed that the user designates two persons among the plurality of persons as the tracking targets 201 and 202 using the touch panel function or the like. In a soccer game, when the user wants to appreciate in detail how the two persons are holding the ball, the user may designate the two persons as tracking targets.

  In FIG. 4, points 211 and 212 respectively indicate the position of the tracking target 201 detected by the tracking processing unit 51 (that is, the center position or the gravity center position of the tracking target area where the image data of the tracking target 201 exists) and the tracking target. A position 202 (that is, a center position or a gravity center position of the tracking target area where the image data of the tracking target 201 exists) is shown.

  The speed adjustment unit 52 derives the distance between the positions 211 and 212 on the input frame image as the evaluation distance for each input frame image, and dynamically changes the reproduction speed of the input moving image based on the evaluation distance.

FIG. 5 shows an example of the relationship between the reproduction speed adjustment rate k _R that defines the adjustment amount of the reproduction speed and the evaluation distance. The evaluation distance is represented by the symbol DIS. A look-up table or a mathematical expression representing such a relationship can be given to the speed adjustment unit 52 in advance. The reference playback speed REF _SP of the input moving image matches the frame rate of 60 fps of the input moving image. The playback speed adjustment rate k _R represents a playback speed adjustment rate based on the reference playback speed REF _SP . The playback speed of the input moving image is REF _SP × k _R. Accordingly, as the value of k _R is small, the playback speed is reduced, as the value of k _R is large, the playback speed increases.

In a section where the playback speed adjustment rate k _R is 1, the playback speed of the input moving image is the same as the reference playback speed REF _SP . That is, if when the input frame image FI _n-1 ~FI _{n +} 1 playback speed adjustment factor k _R for intervals consisting of 1, the input frame image _{FI n-1 ~FI n + 1} , ((3 × 1 / 60) ÷ k _R ) = ((3 × 1/60) ÷ 1) = 1/20 [seconds] and is displayed on the display screen of the display unit 27 as a part of the output moving image.

When the playback speed adjustment rate k _R for the section composed of the input frame images FI _{n−1 to} FI _{n + 1} is a constant value k _RO , the input frame images FI _{n−1 to} FI _{n + 1} are ((3 × 1 / 60) ÷ k _RO ) [seconds] and displayed on the display screen of the display unit 27 as a part of the output moving image. Therefore, for example, if the playback speed adjustment rate k _R for the section composed of the input frame images FI _{n-1 to} FI _{n + 1} is 1/2, the input frame images FI _{n-1 to} FI _{n + 1} are (( 3 × 1/60) ÷ k _R ) = ((3 × 1/60) ÷ 1/2) = 1/10 [seconds] on the display screen of the display unit 27 as a part of the output moving image. Is displayed.

As shown in FIG. 5, basically, the larger the evaluation distance DIS, the larger the reproduction speed adjustment rate k _R is set. Accordingly, in a section in which an input frame image sequence having a relatively small evaluation distance DIS including the input frame image 200a of FIG. 6A is reproduced, a relatively small value is set as the reproduction speed adjustment rate k _R and input. The playback speed of moving images is relatively slow. Conversely, in a section in which an input frame image sequence having a relatively large evaluation distance DIS including the input frame image 200b of FIG. 6B is reproduced, a relatively large value is set for the reproduction speed adjustment rate k _R. The playback speed of the input moving image becomes relatively fast.

In the example shown in FIG. 5, when the inequality “DIS <TH ₁ ” is satisfied, “k _R = 1/8” is set, and when the inequality “TH ₁ ≦ DIS <TH ₃ ” is satisfied, the evaluation distance DIS is determined from the reference distance TH _1. As the reference distance TH ₃ increases, the reproduction speed adjustment rate k _R increases linearly from 1/8 to 1, and when the inequality “TH ₃ ≦ DIS <TH ₄ ” is satisfied, “k _R = 1”. When the inequality “TH ₄ ≦ DIS <TH ₅ ” is established, the playback speed adjustment rate k _R is linear from 1 to 2 as the evaluation distance DIS increases from the reference distance TH ₄ to the reference distance TH _5. When the inequality “TH ₅ ≦ DIS” is satisfied, “k _R = 2” is set.

In the example shown in FIG. 5, when the inequality “TH ₁ ≦ DIS <TH ₃ ” or “TH ₄ ≦ DIS <TH ₅ ” is satisfied, the reproduction speed adjustment rate k _R is continuously applied to the change in the evaluation distance DIS. However, as shown in FIG. 7, when the inequality “TH ₁ ≦ DIS <TH ₃ ” or “TH ₄ ≦ DIS <TH ₅ ” is satisfied, k _R is changed stepwise. Also good. When the relationship between DIS and k _R shown in FIG. 7 is used, for example, when the inequality “DIS <TH ₁ ” is established, “k _R = 1/8” and the inequality “TH ₁ ≦ DIS <TH ₂ −Δ” is satisfied. It is at the time of establishment and "k _R = 1/4", during the establishment of inequality _{"TH 2 -Δ ≦ DIS <TH 2} + Δ " is the "k _R = 1/2", the inequality "TH ₂ + Δ ≦ DIS When <TH ₄ ”is satisfied,“ k _R = 1 ”is set, and when the inequality“ TH ₄ ≦ DIS ”is satisfied,“ k _R = 2 ”is set (where Δ> 0).

TH ₁ to TH ₅ is a reference distance that satisfies the inequality _{"0 <TH 1 <TH 2 <} TH 3 <TH 4 <TH 5 ", they are based on a diagonal line length of the input frame image is a rectangular image Is preset. When the length of the diagonal line is 100, TH ₅ ≦ 100, and for example, TH ₁ = 10, TH ₂ = 25, TH ₃ = 30, and TH ₄ = 80.

The relationship between the input moving image and the output moving image will be described with a specific example. Assume that the tracking targets 201 and 202 are set before the input frame image FI _n-1 is displayed on the display screen of the display unit 27. The tracking processing unit 51 creates tracking result information for each input frame image after the input frame image FI _n−1 , and based on the tracking result information, the speed adjustment unit 52 selects the input frame image FI _{n−. The} evaluation distance DIS is derived for each input frame image after ₁ .

Then, and inequality "TH ₃ ≦ DIS <TH _4" is established for the evaluation distance DIS determined for the input frame image FI _n ~FI _{n + 2,} as shown in FIG. 8, the input frame image FI _n ~ Assume that 1 is set to the playback speed adjustment rate k _R for FI _{n + 2} . In this case, the speed adjustment unit 52 outputs the three input frame image FI _n ~FI _{n + 2} based on the three output frame image FO _n ~FO _{n + 2.} The output frame images FO _{n to} FO _{n + 2} are obtained by multiplying ((3 × 1/60) ÷ k _R ) = ((3 × 1/60) ÷ 1) = 1/20 [second]. Is displayed on the display screen of the display unit 27 as a part of. The output frame images FO _{n to} FO _{n + 2} are the same images as the input frame images FI _{n to} FI _{n + 2} , respectively.

Further, it is assumed that the evaluation distance DIS obtained for the input frame images FI _{n + 3 to} FI _{n + 5} is the same as or substantially the same as the reference distance TH ₂ . Then, as shown in FIG. 8, the speed adjustment unit 52 sets 1/2 the reproduction speed adjustment rate k _R for the input frame images FI _{n + 3 to} FI _{n + 5} and sets the three input frame images FI _{n +. 3} outputs the ~FI _{n +} based on ₆ six output frame image FO _{n +} 3 ~FO _n + ₅ and _{FO n + 3 '~FO n +} 5'. The output frame images FO _{n + 3 to} FO _{n + 5} are the same images as the input frame images FI _{n + 3 to} FI _{n + 5} , respectively. The output frame image FO _{n + 3} ′ is inserted between the output frame images FO _{n + 3} and FO _{n + 4} , and the output frame image FO _{n + 4} ′ is inserted between the output frame images FO _{n + 4} and FO _{n + 5.} Is done. The output frame image FO _{n + 5} ′ is inserted between the output frame image FO _{n + 5} and the output frame image FO _{n + 6} that is the same image as the input frame image FI _{n + 6} .

The same image as the input frame image FI n _{+ 3} output frame image FO n _{+ 3} 'also to be able to generate as output by interpolation from an input frame image FI n _{+ 3} and FI n _{+ 4} frame images FO n _{+ 3' May} be generated (the same applies to the output frame images FO _{n + 4} ′ and FO _{n + 5} ′).

The output frame image sequence output from the speed adjustment unit 52 is displayed on the display unit 27 as an output moving image at a constant frame rate of 60 fps. That is, nine output frame images FO _n , FO _{n + 1} , FO _{n + 2} , FO _{n + 3} , FO _{n + 3} ′, FO _{n + 4} , FO _{n + 4} ′, FO _{n + 5} and FO _{n +5} ′ is displayed on the display screen of the display unit 27 as a part of the output moving image over (9 × 1/60) [seconds]. As a result, the input frame image sequences FI _{n + 3 to} FI _{n + 5} in which ½ is set to k _R are played back slowly at a playback speed that is 1/2 the reference playback speed REF _SP .

When the moving image is reproduced, an audio signal associated with the moving image (an audio signal associated with the moving image video signal) is also reproduced by the speaker 28. When the input frame images FI _{n to} FI _{n + 2} for which k _R = 1 is set, the associated audio signal is also played at a normal speed, but the input for which k _R = 1/2 is set. At the time of reproduction of the frame images FI _{n + 3 to} FI _{n + 5} , the audio signal associated therewith is also reproduced at a half speed of the normal speed. That is, the audio signal associated with the image FI _{n + 3} is extended and reproduced until the display of the images FO _{n + 3} and FO _{n + 3} ′ is completed (associated with the images FI _{n + 4} and FI _{n + 5)} . The same applies to the audio signal). Alternatively, the audio signal associated with the image FI n _{+ 3} to play at normal speed at the time of displaying the image FO n _{+ 3,} at the time of display of the image FO n _{+ 3} ', the same audio signal (i.e., image FI _The audio signal associated with _{n + 3} ) may be reproduced again at a normal speed (the same applies to the audio signals associated with the images FI _{n + 4} and FI _{n + 5} ).

The slow playback operation in the case where k _R = 1/2 is set for the input frame image sequences FI _{n + 3 to} FI _{n + 5} has been described. The same applies to the slow playback operation in the case of k _R ≠ 1/2. It is. For example, if k _R = 1/4 with respect to the input frame image sequence FI _{n +} 3 ~FI _n + ₅ is set, between the image FO _{n + 3} and FO _{n + 4,} the image FO _{n + 4} and FO _Three images FO _{n + 3} ′, FO _{n + 4} ′, and FO _{n + 5} ′ are inserted between _{n + 5 and} between images FO _{n + 5} and FO _{n + 6} , _respectively . In other words, between the images FI _{n + 3} and FI _{n + 4,} between the images FI _{n + 4} and FI _{n + 5,} between the images FI _{n + 5} and FI _{n + 6} , respectively, the images FO _{n + 3} ′, Three FO _{n + 4} ′ and FO _{n + 5} ′ are inserted. As a result, the input frame image sequences FI _{n + 3 to} FI _{n + 5} in which ¼ is set to k _R are played back slowly at a playback speed that is 1/4 times the reference playback speed REF _SP .

Further, the evaluation distance DIS obtained for the input frame images FI _{n + 6 to} FI _{n + 11} is sufficiently large, and the reproduction speed adjustment for the input frame images FI _{n + 6 to} FI _{n + 11} is performed as shown in FIG. Consider a case where 2 is set for the rate k _R. In this case, the speed adjustment unit 52 thins out a part of the _six input frame images FI _{n + 6 to} FI _{n + 11} to thereby reduce the three output frame images FO _{n + 6} , FO _{n + 8} and FO _{n +.} Generate ₁₀ The output frame images FO _{n + 6} , FO _{n + 8} and FO _{n + 10} are the same images as the input frame images FI _{n + 6} , FI _{n + 8} and FI _{n + 10} , respectively. The three output frame images FO _{n + 6} , FO _{n + 8,} and FO _{n + 10} are (3 × 1/60) [seconds] on the display screen of the display unit 27 as a part of the output moving image. Is displayed. That is, the input frame image sequence FI n _{+ 6} ~FI n _{+ 11} 2 is set to k _R will be fast-forward reproduced at twice the playback speed of the reference playback speed REF _SP.

  According to this embodiment, when a plurality of tracking targets focused by the user (viewer) are approaching (for example, when a plurality of persons of interest are holding the ball in a soccer game), slow playback is automatically performed. Made. That is, slow playback that matches the user's wish is automatically performed. In the method of determining the presence / absence of movement of an object on an image using a difference between frames, etc., and automatically reproducing a video section with movement of the object in slow motion, Although the reaction causes slow regeneration, the method of this embodiment avoids such undesirable slow regeneration.

In addition, it is estimated that the video section where the evaluation distance DIS is large is not a video section for an important scene. Considering this, in the above-described example, fast-forward reproduction is performed when the evaluation distance DIS is correspondingly large. Thereby, the time required for viewing a moving image can be shortened. Also, if the playback speed during slow playback is always the same, the video during slow playback tends to be monotonous, but in this embodiment, the playback speed during slow playback is changed in two or more stages (reference playback speed). When considering including REF _SP , the playback speed is changed in three or more stages). For this reason, realistic slow playback is possible.

It is possible to prevent fast-forward playback as described above from being performed. That is, for example, when the inequality “TH ₃ ≦ DIS” is satisfied, k _R may always be set to 1 regardless of the evaluation distance DIS.

Also, at least one of the tracking targets 201 and 202 (see FIG. 4) is not included in the input frame image (when the tracking target is out of frame), or the tracking process fails. When the position of the tracking target becomes undetectable, the evaluation distance DIS cannot be calculated. If calculation of the evaluation distance DIS becomes impossible during playback of the input moving image, the playback speed of the input moving image may be set to the reference playback speed REF _SP thereafter. However, after that, if the evaluation distance DIS can be calculated again, the adjustment of the reproduction speed based on the evaluation distance DIS can be resumed.

Next, with reference to FIG. 10, the operation flow of the imaging apparatus 1 in the automatic slow motion playback mode will be described. FIG. 10 is a flowchart showing the flow of this operation. When playback of a moving image as an input moving image is instructed in the automatic slow motion playback mode, input frame images forming the input moving image are read from the external memory 18 in order from the earliest in time series (step S11). Until the tracking target is set, the input moving image is reproduced at the reference reproduction speed REF _SP (steps S12 and S13). When the tracking target is set by user designation or the like (Y in step S13), the current input frame image is read from the external memory 18 in steps S14 to S16 (step S14), and the current input is input. An evaluation distance DIS based on the tracking result information is calculated for the frame image (step S15), and the current input frame image is reproduced at a reproduction speed based on the evaluation distance DIS (step S16). The processes in steps S14 to S16 are repeatedly executed until the reproduction of the input moving image is completed (step S17).

<< Second Embodiment >>
A second embodiment of the present invention will be described. The second embodiment is an embodiment obtained by modifying a part of the first embodiment. For matters not specifically described in the second embodiment, the matters described in the first embodiment are the same as those in the second embodiment as long as there is no contradiction. Also applies to form.

  In the first embodiment, the distance between the plurality of tracking targets is derived as the evaluation distance DIS. However, in the second embodiment, the distance between the position of the tracking target and the fixed position is derived as the evaluation distance DIS.

  An image 200 shown in FIG. 11 is the same input frame image as that shown in FIG. There are a plurality of persons in the input frame image 200. It is assumed that the user designates one person among the plurality of persons as the tracking target 201 using the touch panel function or the like. Furthermore, it is assumed that the user designates one point in the input frame image 200 using the touch panel function or the like. In FIG. 11, a point designated by reference numeral 213 is a designated point, and a position of the designated point on the input frame image 200 is referred to as a fixed position 213. In the example shown in FIG. 11, the fixed position 213 is a position where a soccer goal is displayed. In a soccer game, when a user wants to appreciate in detail the situation when the user's attention person (tracking target 201) approaches the goal, the user may specify the attention person and the goal using a touch panel function or the like. .

  The speed adjustment unit 52 derives the distance between the positions 211 and 213 on the input frame image as the evaluation distance DIS for each input frame image, and dynamically changes the reproduction speed of the input moving image based on the evaluation distance DIS. If the input frame image is different, the position 211 can be changed, but the fixed position 213 is not changed. The method of dynamically changing the reproduction speed of the input moving image based on the evaluation distance DIS is the same as that described in the first embodiment, and an output moving image is generated from the input moving image based on the evaluation distance DIS. The operation is the same as that described in the first embodiment. Furthermore, the flow of operation of the imaging apparatus 1 in the automatic slow motion playback mode described with reference to FIG. 10 is the same as that described in the first embodiment. However, in the second embodiment, after the reproduction of the input moving image is started, the tracking target and the fixed position are set by the user's designation or the like, and then the processes of steps S14 to S16 are executed.

  According to this embodiment, the same effect as that of the first embodiment can be obtained.

<< Third Embodiment >>
A third embodiment of the present invention will be described. The above-described processes based on the recorded data in the external memory 18 can be realized by an electronic device (for example, an image reproduction device; not shown) different from the imaging device (the imaging device is also a kind of electronic device). .

  For example, the imaging apparatus 1 captures a moving image and stores the image data of the moving image in the external memory 18. 2 is provided with the tracking processing unit 51 and the speed adjustment unit 52 shown in FIG. 2 and the display unit and the speaker equivalent to the display unit 27 and the speaker 28 shown in FIG. What is necessary is just to give the image data of the moving image to the tracking processing unit 51 and the speed adjustment unit 52 in the electronic device as image data of the input moving image. In the electronic device, the display unit reproduces and displays the output moving image from the speed adjustment unit 52 at a constant frame rate of 60 fps. Thereby, the input moving image whose reproduction speed is adjusted is reproduced on the display unit of the electronic device, and the audio signal associated with the input moving image is also reproduced by the speaker of the electronic device.

<< Fourth Embodiment >>
A fourth embodiment of the present invention will be described. The matters described in the first or second embodiment apply to the fourth embodiment as long as there is no contradiction. In the fourth embodiment, a characteristic operation of the imaging apparatus 1 in the shooting mode will be described.

  The imaging device 1 has a function of automatically changing the frame rate of a recorded moving image in accordance with the distance between subjects on the moving image when recording a moving image in the shooting mode (hereinafter referred to as a recording rate variable function). Have The user can freely set whether to enable or disable the recording rate variable function. The variable recording rate function works only when the variable recording rate function is enabled. The shooting mode in a state where the recording rate variable function is enabled is particularly called an automatic slow recording mode. The following description in the fourth embodiment is an operation description of the imaging apparatus 1 in the automatic slow motion recording mode unless otherwise specified.

  FIG. 12 is a partial block diagram of the imaging apparatus 1 that is particularly involved in the operation in the automatic slow motion recording mode. The tracking processing unit 51 and the shooting rate adjustment unit (frame rate control unit) 72 in FIG. 12 are provided in the imaging apparatus 1. The tracking processing unit 51 in FIG. 12 is the same as that in FIG. The shooting rate adjustment unit 72 is realized by, for example, the CPU 23 and / or the TG 22 of FIG.

  The image data of each frame image obtained by photographing by the imaging unit 11 is sequentially sent to the tracking processing unit 51 as image data of the input frame image. Unlike the first to third embodiments, the image data of the input frame image in the present embodiment and the fifth embodiment described later refers to the image data of the frame image output from the AFE 12 in the automatic slow motion recording mode. The frame rate of the input frame image sequence in the first to third embodiments is fixed at 60 fps, but in this embodiment, the frame rate of the input frame image sequence is changed as appropriate (details will be described later).

  The tracking processing unit 51 performs the tracking process described in the first embodiment on the given input frame image sequence. That is, the tracking target on the input frame image sequence is tracked on the input frame image sequence based on the image data of the given input frame image sequence, and the position and size of the tracking target in each input frame image are sequentially detected. Then, tracking result information including information indicating the position and size of the tracking target in each input frame image is output.

  The tracking target setting method is as described in the first embodiment. In the shooting mode, an input frame image sequence sequentially obtained by shooting is displayed on the display unit 27 as a moving image. The user can set the target object as a tracking target by touching the display area where the target object, which should be called the target subject, is displayed with a finger using the touch panel function.

  The image sensor 33 in the imaging device 1 can seamlessly change the frame rate in photographing (hereinafter referred to as the photographing rate). The shooting rate adjustment unit 72 in FIG. 12 dynamically changes the shooting rate based on the tracking result information in the automatic slow motion recording mode. The change of the imaging rate is realized by changing the drive mode of the image sensor 33 and the period of the drive pulse given from the TG 22 to the image sensor 33. It is assumed that the shooting rate is always 60 fps when the recording rate variable function is disabled.

  When the input frame image 200 shown in FIG. 4 is displayed, it is assumed that the user designates two tracking targets using the touch panel function or the like, and the two tracking targets are the tracking targets 201 and 202. A method of changing the shooting rate by the shooting rate adjustment unit 72 will be described.

  The shooting rate adjustment unit 72 derives the distance between the positions 211 and 212 on the input frame image as the evaluation distance DIS for each input frame image, and dynamically changes the shooting rate based on the evaluation distance DIS.

  FIG. 13 shows an example of the relationship between the shooting rate and the evaluation distance DIS. A look-up table or a mathematical expression representing such a relationship can be given in advance to the shooting rate adjustment unit 72. As shown in FIG. 13, basically, the larger the evaluation distance DIS, the smaller the shooting rate.

In the example shown in FIG. 13, the shooting rate is 300 fps when the inequality “DIS <TH ₁ ” is satisfied, and the evaluation distance DIS is changed from the reference distance TH ₁ to the reference distance TH when the inequality “TH ₁ ≦ DIS <TH ₃ ” is satisfied. _The shooting rate is linearly decreased from 300 fps to 60 fps as it increases toward ₃ , and when the inequality “TH ₃ ≦ DIS <TH ₄ ” is satisfied, the shooting rate is set to 60 fps, and the inequality “TH ₄ ≦ DIS < When “TH ₅ ” is satisfied, the shooting rate is linearly decreased from 60 fps to 15 fps as the evaluation distance DIS increases from the reference distance TH ₄ toward the reference distance TH ₅ , and the inequality “TH ₅ ≦ DIS” is satisfied. Sometimes the shooting rate is 15 fps. Further, when the evaluation distance DIS is the same or substantially the same as the reference distance TH _2, the image pickup rate is set to 120 fps.

If the shooting rate can be continuously changed, the shooting rate can be adjusted as described above, but usually the shooting rate is often changed only in steps. Accordingly, as the relationship of FIG. 5 is transformed into the relationship of FIG. 7, the shooting rate is continuously changed when the inequality “TH ₁ ≦ DIS <TH ₃ ” or “TH ₄ ≦ DIS <TH ₅ ” is satisfied. You may make it change in steps instead of making it.

A more specific operation example will be described. It is assumed that the tracking targets 201 and 202 have been set before the input frame image F _n is captured. For example, if the inequality “TH ₃ ≦ DIS <TH ₄ ” holds for the evaluation distance DIS obtained for the input frame images FI _{n to} FI _{n + 2} , the input frame images FI _{n to} FI _{n + The} shooting rate for the ₂ shooting sections is 60 fps. If the evaluation distance DIS obtained for the input frame images FI _{n to} FI _{n + 2} is the same as or substantially the same as the reference distance TH ₂ , the input frame image FI is used. _{If the} shooting rate for the shooting section of _{n to} FI _{n + 2} is 120 fps, and the evaluation distance DIS obtained for the input frame images FI _{n to} FI _{n + 2} is the same as or substantially the same as the reference distance TH ₁ field input frame captured rate for image FI _n ~FI _{n + 2} of the photographing section is a 300 fps, the input frame image FI _n ~FI _{n + 2} rating found for the distance DIS is the reference distance If the same or was substantially the same as the H ₅ input frame captured rate for image FI _n ~FI _n + ₂ of the photographing section is a 15fps.

The change of the shooting rate is executed as quickly as possible. That is, for example, the inequality “TH ₃ ≦ DIS <TH ₄ ” holds for the evaluation distance DIS obtained for the input frame images FI _{n to} FI _{n + 2} , and the input frame images FI _{n + 3 to} FI If the evaluation distance DIS determined for _{n + 6} is the same or substantially the same as the reference distance TH _2, the image pickup rate is changed instantaneously if possible, the input frame image FI _{n + 3} ~FI n _The shooting rate for the shooting section of ₊₆ is 120 fps. However, depending on the processing time of the tracking process, the shooting interval between the images FI _{n + 3} and FI _{n + 4} and the shooting interval between the images FI _{n + 4} and FI _{n + 5} are longer than 1/120 seconds. Sometimes.

  The image data of the input frame image sequence obtained as described above is recorded in the external memory 18 as image data of the input moving image. In the playback mode, the imaging apparatus 1 uses the display unit 27 to play back the input moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the input moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproducing device; not shown) different from the imaging device 1, and the input moving image is set to a constant frame rate of 60 fps on the electronic device. Can also be played.

  A portion recorded with a high photographing rate due to the small evaluation distance DIS is reproduced in slow speed because the number of recording frames per unit time is large. Conversely, a portion recorded at a low photographing rate due to the large evaluation distance DIS is reproduced by fast-forwarding because the number of recording frames per unit time is small. As a result, the same effect as the first embodiment can be obtained. In addition, when the evaluation distance DIS is small, since actual shooting is performed at a high shooting rate (for example, 120 fps) and image recording is performed, it is possible to perform high-quality slow playback compared to the first to third embodiments. . On the other hand, the amount of recorded data increases, and a thinning process is required when a portion shot at a high shooting rate (for example, 120 fps) is normally reproduced.

Note that when the evaluation distance DIS is large, the photographing rate may not be reduced. That is, for example, when the inequality “TH ₃ ≦ DIS” is satisfied, the shooting rate may always be set to 60 fps, no matter how large the evaluation distance DIS is. If the evaluation distance DIS cannot be calculated during shooting and recording of the input moving image, the shooting rate of the input moving image may be set to 60 fps thereafter. However, if the evaluation distance DIS can be calculated again thereafter, the adjustment of the photographing rate based on the evaluation distance DIS can be resumed.

  Further, in this embodiment, the distance between the tracking target position and the fixed position may be derived as the evaluation distance DIS so that the first embodiment can be transformed into the second embodiment. That is, for example, when the input frame image 200 that forms the input moving image is displayed during the shooting of the input moving image (see FIG. 11), the user uses the touch panel function or the like to set the tracking target 201 and the fixed position 203. Can be specified. In this case, the imaging rate adjustment unit 72 derives the distance between the positions 211 and 213 on the input frame image as the evaluation distance DIS for each input frame image obtained after the input frame image 200, and after the input frame image 200 The imaging rate of the input frame image sequence obtained is dynamically changed based on the evaluation distance DIS. If the input frame image is different, the position 211 can be changed, but the fixed position 213 is not changed. The method of dynamically changing the shooting rate based on the evaluation distance DIS is the same as that described above.

  With reference to FIG. 14, the flow of operation of the imaging apparatus 1 in the automatic slow motion recording mode will be described. FIG. 14 is a flowchart showing the flow of this operation. In the automatic slow motion recording mode, first, shooting of an input moving image is started at a shooting rate of 60 fps (step S21) until a plurality of tracking targets are set or until a tracking target and a fixed position are set. The shooting rate is maintained at 60 fps (step S22). Image data of the input frame image is sequentially recorded in the external memory 18 from the time when the first recording button 26 a is pressed. When a plurality of tracking targets or a tracking target and a fixed position are set by user designation or the like (Y in step S22), the evaluation distance DIS is calculated from the latest input frame image in steps S23 and S24. A shooting rate is set according to the latest evaluation distance DIS, and image data of the latest input frame image is sequentially recorded in the external memory 18. The processes in steps S23 and S24 are repeatedly executed until the shooting of the input moving image is completed (for example, until the second recording button 26a is pressed) (step S25).

<< Fifth Embodiment >>
A fifth embodiment of the present invention will be described. The fifth embodiment is an embodiment obtained by modifying a part of the fourth embodiment. Regarding matters not specifically described in the fifth embodiment, the matters described in the fourth embodiment are the same as those in the fifth embodiment as long as there is no contradiction. Also applies to form. The matters described in the first to third embodiments are also applied to the fifth embodiment as long as there is no contradiction.

  In the fifth embodiment, in the automatic slow motion recording mode, the image rate of the input moving image is acquired with the shooting rate fixed at 60 fps, and the image data of the input moving image is acquired as the tracking processing unit 51 and the speed adjusting unit 52 in FIG. Thus, the image data of the output moving image obtained from the speed adjustment unit 52 is recorded in the external memory 18. A method for generating an output moving image from an input moving image is as described in the first or second embodiment. In the playback mode, the imaging apparatus 1 uses the display unit 27 to play back the output moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the output moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproduction device; not shown) different from the imaging device 1, and the output moving image is set to a constant frame rate of 60 fps on the electronic device. To play.

  Also in the fifth embodiment, as in the fourth embodiment, the number of frame images to be recorded per unit time is adjusted according to the evaluation distance DIS. That is, the frame rate of the moving image to be recorded is adjusted according to the evaluation distance DIS by the speed adjusting unit 52 in FIG. 2 which should be called a recording frame rate control unit or a frame rate control unit. For this reason, the same effect as that of the fourth embodiment can be obtained by the fifth embodiment.

<< Sixth Embodiment >>
A sixth embodiment of the present invention will be described. In the first and second embodiments, the playback speed variable function for dynamically controlling the playback speed of the input moving image based on the evaluation distance DIS has been described. As described in the first embodiment, the playback mode in a state where the playback speed variable function is enabled is particularly called an automatic slow playback mode. In the sixth embodiment, another method for realizing the reproduction speed variable function by the imaging apparatus 1 of FIG. 1 will be described. The matters described in the above embodiments are also applied to the sixth embodiment as long as there is no contradiction.

  FIG. 15 is a partial block diagram of the imaging apparatus 1 particularly related to the operation in the automatic slow motion playback mode according to the sixth embodiment. The face detection unit 101 and the speed adjustment unit 52a in FIG. 15 can be provided in, for example, the video signal processing unit 13 or the display processing unit 20 in FIG.

Image data of the input moving image is given to the face detection unit 101 and the speed adjustment unit 52a. In the sixth embodiment, image data of an input moving image is image data of a moving image recorded in the external memory 18, and the image data is obtained by a shooting operation of the imaging device 1 in a shooting mode. However, the image data of the input moving image may be provided from a device other than the imaging device 1. In the sixth embodiment and other embodiments described later, as in the first embodiment, FI ₁ , FI ₂ , FI ₃ ,..., FI _n are used as symbols representing input frame images forming the input moving image. −1, FI _n ,... Are introduced (see FIG. 3). In the sixth embodiment, as in the first embodiment, it is assumed that the frame rate of the input moving image is 60 fps (frame per second) over the entire input moving image. The following description in the sixth embodiment is an operation description of the imaging apparatus 1 in the automatic slow motion playback mode unless otherwise specified.

  The face detection unit 101 executes face detection processing on the input frame image based on the input frame image, and generates face detection information representing the result of the face detection processing. The face detection unit 101 can perform face detection processing for each input frame image. In the face detection process, a human face is detected from the input frame image based on the image data of the input frame image, and a face region including the detected face is extracted. Various methods are known as a method for detecting a face included in an image, and the face detection unit 101 can employ any method. For example, a face on the input frame image can be detected by extracting an image portion having a high similarity with a reference face image registered in advance as a face area from the input frame image.

  The face detection unit 101 also detects the orientation of the face in the input frame image in the face detection process. That is, for example, the face detection unit 101 determines whether the face detected from the input frame image is a front face (face seen from the front) as shown in FIG. d) whether it is an oblique face (face seen from an oblique direction) or a side face (face seen from the side) as shown in FIGS. 16 (c) and 16 (e), It is possible to detect in a plurality of stages. Various methods have been proposed for detecting the orientation of the face, and the face detection unit 101 can employ any method. For example, as in the technique described in Japanese Patent Laid-Open No. 10-307923, face parts such as eyes, nose and mouth are found in order from the input frame image to detect the position of the face on the input frame image. The face orientation may be detected based on the projection data of the face part. Alternatively, for example, a method described in JP 2006-72770 A may be used.

  An angle representing the orientation of the face is represented by the symbol θ, and the angle is called a direction angle. The front face orientation angle θ is 0 °, and the side face orientation angle θ is 90 ° or (−90 °). The direction angle θ of the oblique face satisfies “0 ° <θ <90 °” or “−90 ° <θ <0 °”. When a face directly facing the imaging apparatus 1 appears on the input frame image, the face orientation angle θ is 0 °. Starting from the state where the face is directly facing the imaging device 1, when the face gradually rotates in either the left or right direction with the neck as a rotation axis, the orientation of the face in the process of rotation The absolute value of the angle θ gradually increases toward 90 °. Now, when the face on the input frame image is facing the right direction on the input frame image (see FIGS. 16B and 16C), it is assumed that the face orientation angle θ is negative and the face on the input frame image When the face at is oriented to the left on the input frame image (see FIGS. 16D and 16E), the face orientation angle θ is assumed to be positive.

  Furthermore, the face detection unit 101 also detects the tilt of the face in the input frame image in the face detection process. The face inclination in this case means the inclination of the face 313 with respect to the vertical direction of the input frame image 310 as shown in FIG. 17, for example, the center of the mouth of the face 313 with respect to the straight line 311 parallel to the vertical direction of the input frame image 310. And the inclination of the straight line 312 connecting the eyebrows. For example, by rotating the input frame image and evaluating the similarity with respect to the rotated image, a tilted face can be detected and the tilt of the face can be detected.

  An angle representing the tilt of the face is represented by the symbol φ, and the angle is called a tilt angle. In the input frame image 310 of FIG. 17, the inclination angle φ is an angle formed by the straight line 311 and the straight line 312. As shown in FIG. 17, when the straight line 311 is rotated by less than 90 degrees in the counterclockwise direction on the input frame image 310 and the straight line 312 is a straight line 312, the inclination angle φ is negative. However, if the straight line 311 obtained by rotating the straight line 311 clockwise by less than 90 degrees on the input frame image 310 is the straight line 312, the inclination angle φ is assumed to be positive.

An example of face detection processing that can be executed by the face detection unit 101 will be described with reference to FIGS. For convenience, detection of the face orientation angle θ is called orientation detection, and detection of the face tilt angle φ is called tilt detection. In FIG. 18, reference numeral 320 represents an arbitrary input frame image. A plurality of faces shown in FIG. 19 represent a plurality of reference face images RF [θ _O , φ _O ] registered in advance in the face detection unit 101. theta _O is the reference face images RF [θ _{O, φ O]} represents the orientation angle of, phi _O represents the inclination angle of the reference face image _{RF [θ O, φ O]} . Reference face images RF [θ _O , φ _O ] when the orientation angle θ is −90 °, −60 °, −30 °, −15 °, 0 °, 15 °, 30 °, 60 °, and 90 ° are obtained. The reference face images RF [θ _O , φ _O ] are set respectively when the tilt angles φ are −30 °, −15 °, 0 °, 15 °, and 30 °. Yes. Accordingly, the total number of types of the reference face image RF [θ _O , φ _O ] is 45 (= 9 × 5). In FIG. 19, for simplification of illustration, symbols (RF [90 °, −30 °], RF [−90 °, −30 °], RF [90 °, 30 °], RF [−90 °, 30 °] and RF [90 °, 0 °]).

The face detection unit 101 sets a region of interest 321 having a predetermined image size in the input frame image 320. First, attention is paid to the reference face image RF [90 °, 0 °], which is one of 45 types of reference face images RF [θ _O , φ _O ], and the image in the region of interest 321 and the reference face image RF [ 90 [deg.], 0 [deg.]], It is detected whether or not the region of interest 321 includes a face whose orientation angle [theta] is 90 [deg.] And whose inclination angle [phi] is 0 [deg.]. The similarity determination is performed by extracting a feature amount effective for identifying whether the face is a face. The feature amount is a horizontal edge, a vertical edge, a right diagonal edge, a left diagonal edge, or the like.

  In the input frame image 320, the region of interest 321 is shifted pixel by pixel in the horizontal direction or the vertical direction. Then, the image of the region of interest 321 after the shift is compared with the reference face image RF [90 °, 0 °], the similarity between both images is determined again, and the same detection is performed. In this way, the attention area 321 is updated and set while being shifted pixel by pixel from the upper left to the lower right of the input frame image 320, for example. The arrows in FIG. 18 indicate the process in which the region of interest 321 is shifted. In addition, the input frame image 320 is reduced at a certain rate, and the orientation detection and the inclination detection are performed on the reduced image as described above. By repeating such processing, a face having an arbitrary size and a direction angle θ of 90 ° and an inclination angle φ of 0 ° can be detected from the input frame image 320.

The processing performed while paying attention to the reference face image RF [90 °, 0 °] is similarly performed on the reference face image RF [60 °, 0 °]. Thereby, a face having an arbitrary size and an orientation angle θ of 60 ° and an inclination angle φ of 0 ° can be detected from the input frame image 320. Further, the processing performed while paying attention to the reference face images RF [90 °, 0 °] and RF [60 °, 0 °] is applied to the remaining 43 types of reference face images RF [θ _O , φ _O ]. The same applies to the case. Then, finally, faces having various orientation angles θ and inclination angles φ can be detected from the input frame image 320.

  In the example shown in FIG. 19, the face orientation angle θ is detected in 9 steps and the face inclination angle φ is detected in 5 steps, but the face orientation angle θ is detected in a number of steps different from 9 steps. Alternatively, the face inclination angle φ may be detected with a number of steps different from five. Based on the similarity between the reference face image RF [90 °, 0 °] and the image in the region of interest 321, and the similarity between the reference face image RF [60 °, 0 °] and the image in the region of interest 321; The face orientation angle θ in the region of interest 321 may be detected with high resolution within a range satisfying “60 ° <θ <90 °” (for example, the similarity of the former and the similarity of the latter are the same). In the case of the degree, it may be detected that θ is 75 °). The same applies to the detection of the orientation angle θ based on the similarity of other reference face images (for example, RF [60 °, 0 °] and RF [30 °, 0 °]), and also in the detection of the inclination angle φ. It is the same.

  The face detection information generated by the face detection unit 101 includes information indicating the orientation angle θ and the inclination angle φ in addition to information indicating the presence or absence of a face (see FIG. 15). For example, when a face having an orientation angle θ of 90 ° and an inclination angle φ of 0 ° is detected from the input frame image 320 in FIG. 18, the detected face orientation angle θ and inclination angle φ are Information indicating 90 ° and 0 ° respectively is included in the face detection information. The face detection information may further include information representing the position and size of the face on the input frame image. The face detection information is given to the speed adjustment unit 52a (see FIG. 15).

The speed adjustment unit 52a generates an output moving image by adjusting the playback speed of the input moving image based on the face detection information. In the speed adjustment unit 52 (see FIGS. 2 and 5) in the first embodiment, the playback speed of the input moving image is adjusted using the playback speed adjustment rate k _R determined based on the evaluation distance DIS. The adjustment unit 52a adjusts the playback speed of the input moving image using the playback speed adjustment rate k _R determined based on the face detection information.

The speed adjustment unit 52a determines the reproduction speed adjustment rate k _R based on the evaluation angle ANG based on the orientation angle θ and / or the inclination angle φ. The evaluation angle ANG is an angle | θ | that is an absolute value of the orientation angle θ or an angle | φ | that is an absolute value of the tilt angle φ. Alternatively, an angle based on the orientation angle θ and the inclination angle φ may be substituted for the evaluation angle ANG. That is, for example, ANG = k ₁ · | θ | + k ₂ · | φ |. k ₁ and k ₂ are predetermined weighting factors having positive values. When the evaluation angle ANG is the angle | θ |, it is possible to omit the face inclination detection from the face detection processing. When the evaluation angle ANG is the angle | φ | The direction detection can be omitted.

FIG. 20 shows a relationship example between the reproduction speed adjustment rate k _R and the evaluation angle ANG. A look-up table or a mathematical expression representing such a relationship can be given in advance to the speed adjustment unit 52a. As described above, the playback speed adjustment rate k _R represents the playback speed adjustment rate based on the reference playback speed REF _SP that matches the frame rate 60 fps of the input video, and the playback speed of the input video is REF _SP. Xk _R. Thus, as the playback speed is reduced the value of k _R is small, the reproduction speed as the value of k _R is large is increased.

In the example shown in FIG. 20, “k _R = 1/8” is established when the inequality “0 ° ≦ ANG <TH _A1 ” is satisfied, and the evaluation angle ANG is the reference angle when the inequality “TH _A1 ≦ ANG <TH _A2 ” is satisfied. As the playback speed adjustment rate k _R increases from TH _A1 toward the reference angle TH _A2 , the playback speed adjustment rate k _R increases linearly from 1/8 to 1, and when the inequality “TH _A2 ≦ ANG <TH _A3 ” is satisfied, “k _R = 1 ”, and when the inequality“ TH _A3 ≦ ANG <TH _A4 ”is satisfied, the reproduction speed adjustment rate k _R increases from 1 to 2 as the evaluation angle ANG increases from the reference angle TH _A3 toward the reference angle TH _A4. When the inequality “TH _A4 ≦ ANG” is satisfied, “k _R = 2” is set.

In the example shown in FIG. 20, when the inequality “TH _A1 ≦ ANG <TH _A2 ” or “TH _A3 ≦ ANG <TH _A4 ” is satisfied, the reproduction speed adjustment rate k _R is continuously applied to the change in the evaluation angle ANG. However, the inequality “TH _A1 ≦ ANG <TH _A2 ” or “TH _A3 ≦ ANG <TH so that the relationship between DIS and k _R shown in FIG. 5 can be changed to that of FIG. 7. _When “ _A4 ” is established, k _R may be changed stepwise.

TH _{A1 to} TH _A4 are reference angles that satisfy the inequality “0 ° <TH _A1 <TH _A2 <TH _A3 <TH _A4 ≦ 90 °”, and can be set in advance. However, TH _A1 = TH _A2 can be set, TH _A2 = TH _A3 can be set, or TH _A3 = TH _A4 can be set. When ANG = | θ |, for example, 15 °, 30 °, 45 °, and 90 ° are substituted for TH _A1 , TH _A2 , TH _A3, and TH _A4 , respectively. When ANG = | φ |, for example, 5 °, 10 °, 20 °, and 30 ° are substituted for TH _A1 , TH _A2 , TH _A3, and TH _A4 , respectively.

Except for the difference in the method of determining the playback speed adjustment rate k _R, the method of generating the output moving image by the speed adjustment unit 52a is the same as that by the speed adjustment unit 52 (see FIGS. 8 and 9). The output moving image output from the speed adjustment unit 52a is displayed on the display unit 27 at a constant frame rate of 60 fps. The method of reproducing the audio signal associated with the input moving image is the same as that described in the first embodiment.

  On a moving image in which a human face is photographed, a video section in which the human face is facing front or almost in front, or a video section in which the inclination of the human face is 0 ° or near 0 ° is shown to the user (viewing It is hoped that it will be played back over a relatively long time. Considering this, in the present embodiment, when the face of the person on the input moving image is front or substantially facing the front, or when the inclination of the face of the person on the input moving image is 0 ° or around 0 °. In some cases, the playback speed is automatically reduced. As a result, slow playback that matches the user's (viewer's) desire is performed.

Also, it is presumed that a video section in which a human face is facing sideways or a video section in which the inclination of a human face is relatively large is not a video section for an important scene. Considering this, in the above example, fast-forward reproduction is performed when the evaluation angle ANG is correspondingly large. Thereby, the time required for viewing a moving image can be shortened. Also, if the playback speed during slow playback is always the same, the video during slow playback may tend to be monotonous. Taking this into consideration, it is preferable to change the playback speed during slow playback in two or more stages based on the evaluation angle ANG (in consideration of the reference playback speed REF _SP , it is better to change the playback speed in three or more stages). . As a result, realistic slow playback is possible.

It is possible to prevent fast-forward playback as described above from being performed. That is, for example, when the inequality “TH _A2 ≦ ANG” is satisfied, k _R may always be 1 regardless of how large the evaluation angle ANG is. In a section where the evaluation angle ANG cannot be obtained, such as a section where no face is detected from the input frame image, the playback speed of the input moving image is set to the reference playback speed REF _SP .

  Next, with reference to FIG. 21, an operation flow of the imaging apparatus 1 in the automatic slow motion playback mode of the sixth embodiment will be described. FIG. 21 is a flowchart showing the flow of this operation. When playback of a moving image as an input moving image is instructed in the automatic slow motion playback mode, input frame images forming the input moving image are read from the external memory 18 in order from the earliest in time series, and evaluated one after another. The angle ANG is derived to adjust the playback speed. That is, the current input frame image is read from the external memory 18 (step S31), and the evaluation angle ANG based on the face detection information is calculated for the current input frame image (step S32). The current input frame image is reproduced at a reproduction speed based on ANG (step S33). The processes in steps S31 to S33 are repeatedly executed until the reproduction of the input moving image is completed (step S34).

  Note that each of the above-described processes based on the recorded data in the external memory 18 can be realized by an electronic device (for example, an image reproduction device; not shown) different from the imaging device (the imaging device is also a kind of electronic device). is there). For example, the imaging apparatus 1 captures a moving image and stores the image data of the moving image in the external memory 18. Then, the electronic device is provided with the face detection unit 101 and the speed adjustment unit 52a of FIG. 15 and a display unit and a speaker equivalent to the display unit 27 and the speaker 28 of FIG. What is necessary is just to give the image data of the moving image to the face detection part 101 and the speed adjustment part 52a in an electronic device as image data of an input moving image. In the electronic device, the display unit reproduces and displays the output moving image from the speed adjustment unit 52a at a constant frame rate of 60 fps. Thereby, the input moving image whose reproduction speed is adjusted is reproduced on the display unit of the electronic device, and the audio signal associated with the input moving image is also reproduced by the speaker of the electronic device.

<< Seventh Embodiment >>
A seventh embodiment of the present invention will be described. In the above-described fourth embodiment, the recording rate variable function that dynamically controls the frame rate of a moving image to be recorded based on the evaluation distance DIS has been described. As described in the fourth embodiment, the shooting mode in a state where the recording rate variable function is enabled is particularly called an automatic slow recording mode. In the seventh embodiment, another method for realizing the recording rate variable function by the imaging apparatus 1 of FIG. 1 will be described. The matters described in the above embodiments are also applied to the seventh embodiment as long as there is no contradiction.

  FIG. 22 is a partial block diagram of the imaging apparatus 1 particularly related to the operation in the automatic slow motion recording mode according to the seventh embodiment. The face detection unit 101 in FIG. 22 is the same as that in FIG. The shooting rate adjustment unit 72a is realized by, for example, the CPU 23 and / or the TG 22 of FIG. The image data of the input frame image in the seventh embodiment refers to the image data of the frame image output from the AFE 12 in the automatic slow motion recording mode, as in the fourth and fifth embodiments described above. The following description in the seventh embodiment is an operation description of the imaging apparatus 1 in the automatic slow motion recording mode unless otherwise specified.

  In the automatic slow motion recording mode, sequentially obtained image data of input frame images is given to the face detection unit 101. The face detection unit 101 executes face detection processing on the input frame image based on the image data of the input frame image, and generates face detection information representing the result of the face detection processing. The contents of the face detection process and the face detection information are the same as those described in the sixth embodiment.

  The shooting rate adjustment unit 72a dynamically changes the shooting rate based on the face detection information in the automatic slow motion recording mode. More specifically, the evaluation angle ANG is calculated from the face detection information, and the shooting rate is dynamically changed according to the evaluation angle ANG. The evaluation angle ANG can be calculated for each input frame image. The calculation method of the evaluation angle ANG is the same as that described in the sixth embodiment.

  FIG. 23 shows an example of the relationship between the shooting rate and the evaluation angle ANG. A lookup table or a mathematical expression representing such a relationship can be given in advance to the photographing rate adjustment unit 72a. As shown in FIG. 23, basically, the larger the evaluation angle ANG, the lower the shooting rate.

In the example shown in FIG. 23, the imaging rate is 300 fps when the inequality “ANG <TH _A1 ” is satisfied, and the evaluation angle ANG is changed from the reference angle TH _A1 to the reference angle TH _A1 when the inequality “TH _A1 ≦ ANG <TH _A2 ” is satisfied. _The shooting rate is linearly decreased from 300 fps to 60 fps as it increases toward _A2 , and when the inequality “TH _A2 ≦ ANG <TH _A3 ” is satisfied, the shooting rate is set to 60 fps, and the inequality “TH _A3 ≦ ANG < When TH _A4 is established, the shooting rate is linearly decreased from 60 fps to 15 fps as the evaluation angle ANG increases from the reference angle TH _A3 toward the reference angle TH _A4 , and the inequality “TH _A4 ≦ ANG” is established. Sometimes the shooting rate is 15 fps.

If the shooting rate can be continuously changed, the shooting rate can be adjusted as described above, but usually the shooting rate is often changed only in steps. Therefore, as the relationship of FIG. 5 is transformed into the relationship of FIG. 7, the shooting rate is continuously changed when the inequality “TH _A1 ≦ ANG <TH _A2 ” or “TH _A3 ≦ ANG <TH _A4 ” is satisfied. You may make it change in steps instead of making it.

In the fourth embodiment described above, the shooting rate is set based on the evaluation distance DIS as the state quantity, whereas in the sixth embodiment, the shooting rate is set based on the evaluation angle ANG as another state quantity. The function of the shooting rate adjustment unit 72a is the same as that of the shooting rate adjustment unit 72 (see FIG. 12) according to the fourth embodiment, except that the state quantity from which the shooting rate is set is different. Thus, for example, the image pickup rate to the input frame image FI _n ~FI _{n + 2} of the imaging section, the evaluation angle ANG determined for the input frame image FI _n ~FI _{n + 2} established inequality "ANG <TH _A1" If the inequality “TH _A2 ≦ ANG <TH _A3 ” is satisfied, then 60 fps is assumed. If the inequality “TH _A4 ≦ ANG” is satisfied, 15 fps. As described in the fourth embodiment, the photographing rate is changed as quickly as possible.

  The image data of the input moving image obtained as described above is recorded in the external memory 18. In the playback mode, the imaging apparatus 1 uses the display unit 27 to play back the input moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the input moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproducing device; not shown) different from the imaging device 1, and the input moving image is set to a constant frame rate of 60 fps on the electronic device. Can also be played. At the time of reproducing the input moving image, the input audio signal recorded in the external memory 18 is also reproduced by the speaker 28.

  A portion recorded at a high photographing rate due to the small evaluation angle ANG is reproduced in slow speed because the number of recording frames per unit time is large. Conversely, a portion recorded at a low photographing rate due to the large evaluation angle ANG is reproduced by fast-forwarding because the number of recording frames per unit time is small. As a result, the same effect as in the sixth embodiment can be obtained. Further, when the evaluation angle ANG is small, since actual shooting is performed at a high shooting rate (for example, 300 fps) and image recording is performed, it is possible to perform slow reproduction with higher image quality than in the sixth embodiment. On the other hand, the amount of recording data increases, and thinning processing is required when a portion shot at a high shooting rate (for example, 300 fps) is normally reproduced.

Note that when the evaluation angle ANG is large, the photographing rate may not be reduced. That is, for example, when the inequality “TH _A2 ≦ ANG” is satisfied, the shooting rate may always be set to 60 fps, no matter how large the evaluation angle ANG is. If the evaluation angle ANG cannot be calculated during shooting and recording of the input moving image, then the shooting rate of the input moving image may be set to 60 fps. However, if the evaluation angle ANG can be calculated again thereafter, the adjustment of the imaging rate based on the evaluation angle ANG can be resumed.

  With reference to FIG. 24, the flow of the operation of the imaging apparatus 1 in the automatic slow motion recording mode of the seventh embodiment will be described. FIG. 24 is a flowchart showing the flow of this operation. In the automatic slow recording mode, the image data of the input frame image is sequentially recorded in the external memory 18 from the time when the first recording button 26a is pressed. At this time, the evaluation angle ANG is calculated from the latest input frame image, the shooting rate is set according to the latest evaluation angle ANG (step S41), and the image data of the latest input frame image is sequentially stored in the external memory 18. Recording is performed (step S42). The processes in steps S41 and S42 are repeatedly executed until the shooting of the input moving image is completed (for example, until the second recording button 26a is pressed) (step S43).

In addition, the above-mentioned method in 7th Embodiment can also be deform | transformed as follows so that 4th Embodiment can be deform | transformed into 5th Embodiment.
That is, in the automatic slow motion recording mode, the image rate of the input moving image is acquired with the shooting rate fixed at 60 fps, and the image data of the input moving image is given to the face detection unit 101 and the speed adjustment unit 52a in FIG. The image data of the output moving image obtained from the speed adjusting unit 52a is recorded in the external memory 18. The method for generating the output moving image from the input moving image is as described in the sixth embodiment. In the playback mode, the imaging apparatus 1 uses the display unit 27 to play back the output moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the output moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproduction device; not shown) different from the imaging device 1, and the output moving image is set to a constant frame rate of 60 fps on the electronic device. To play. This also adjusts the number of recorded frame images per unit time according to the evaluation angle ANG. That is, the frame rate of the moving image to be recorded is adjusted according to the evaluation angle ANG by the speed adjusting unit 52a in FIG. 15 which should be called a recording frame rate control unit or a frame rate control unit, and the shooting rate adjusting unit 72a in FIG. The same effect as that obtained when the shooting rate is adjusted using is obtained.

<< Eighth Embodiment >>
An eighth embodiment of the present invention will be described. In the eighth embodiment, another method for realizing the reproduction speed variable function by the imaging apparatus 1 of FIG. 1 will be described. The matters described in the above embodiments are applied to the eighth embodiment as long as there is no contradiction.

  FIG. 25 is a partial block diagram of the imaging apparatus 1 particularly related to the operation in the automatic slow motion playback mode according to the eighth embodiment. 25 can be provided in, for example, the audio signal processing unit 15 in FIG. 1, and the speed adjustment unit 52b in FIG. 25 is provided in, for example, the video signal processing unit 13 or the display processing unit 20 in FIG. Can be provided.

  Image data of the input moving image is given to the speed adjustment unit 52b. In the eighth embodiment, the image data of the input moving image is image data of the moving image recorded in the external memory 18, and the image data is obtained by the shooting operation of the imaging device 1 in the shooting mode. However, the image data of the input moving image may be provided from a device other than the imaging device 1. In the eighth embodiment, similarly to the first embodiment, the frame rate of the input moving image is assumed to be 60 fps (frame per second) over the entire input moving image. The following description in the eighth embodiment is an operation description of the imaging apparatus 1 in the automatic slow motion playback mode unless otherwise specified.

  An audio signal associated with the image data of the input moving image is given to the volume detection unit 111 as an input audio signal. The input audio signal is an audio signal of sound collected by the microphone 14 in FIG. 1 during the shooting period of the input moving image, and is recorded in the external memory 18 together with the image data of the input moving image in the shooting mode. In the eighth embodiment, as shown in FIG. 26, the entire shooting section of the input moving image is divided into a plurality of unit sections P [1], P [2], P [3],. The time length of each unit section is L times the frame period (in this embodiment, 1/60 seconds). Here, L is a natural number. In this specification, the term audio signal can also be read as an acoustic signal.

  For each unit section, the volume detection unit 111 detects the magnitude of the input voice signal in the unit section based on the input voice signal in the unit section, and outputs an evaluation volume that is information indicating the detected magnitude. . The evaluation sound volume is represented by symbol SV, and the evaluation sound volume SV for the unit section P [i] is particularly represented by symbol SV [i] (i is an integer). The magnitude of the input audio signal may be the signal level of the input audio signal or the power of the input audio signal. If the signal level or power of the input audio signal increases, the volume and evaluation volume SV of the input audio signal increase, and if the signal level or power of the input audio signal decreases, the volume and evaluation volume SV of the input audio signal decrease. To do. It is assumed that the lower limit value of the evaluation sound volume SV [i] is zero. That is, when the signal level or power of the input audio signal in the unit interval P [i] is zero, the evaluation sound volume SV [i] is zero.

  The magnitude of the input voice signal detected by the volume detector 111 is the average magnitude of the input voice signal in the unit section. Therefore, for example, the sound volume detection unit 111 calculates an average value of the signal level or power of the input audio signal in the unit interval P [1] based on the input audio signal in the unit interval P [1], and calculates the average value. The evaluation sound volume SV [1] for the unit section P [1] is output. The same applies to other unit sections.

The speed adjustment unit 52b generates an output moving image by adjusting the reproduction speed of the input moving image based on the evaluation sound volume SV. In the first embodiment or the sixth embodiment (see FIG. 5 or FIG. 20), the playback speed of the input moving image is adjusted using the playback speed adjustment rate k _R determined based on the evaluation distance DIS or the evaluation angle ANG. However, the speed adjusting unit 52b adjusts the playback speed of the input moving image using the playback speed adjustment rate k _R determined based on the evaluation sound volume SV.

FIG. 27 shows an example of the relationship between the playback speed adjustment rate k _R and the evaluation volume SV. A lookup table or a mathematical expression representing such a relationship can be given to the speed adjustment unit 52b in advance.

In the example shown in FIG. 27, when the inequality “0 ≦ SV <TH _B1 ” is satisfied, “k _R = 2” is set, and when the inequality “TH _B1 ≦ SV <TH _B2 ” is satisfied, the evaluation volume SV is changed from the reference volume TH _B1. As the sound volume increases toward the reference volume TH _B2 , the playback speed adjustment rate k _R decreases linearly from 2 to 1, and when the inequality “TH _B2 ≦ SV <TH _B3 ” is satisfied, “k _R = 1”. When the inequality “TH _B3 ≦ SV <TH _B4 ” is established, the playback speed adjustment rate k _R is linear from 1 to 1/8 as the evaluation volume SV increases from the reference volume TH _B3 toward the reference volume TH _B4. When the inequality “TH _B4 ≦ SV” is satisfied, “k _R = 1/8” is set.

In the example shown in FIG. 27, when the inequality “TH _B1 ≦ SV <TH _B2 ” or “TH _B3 ≦ SV <TH _B4 ” is satisfied, the playback speed adjustment rate k _R is continuously applied to the change in the evaluation sound volume SV. However, the inequality “TH _B1 ≦ SV <TH _B2 ” or “TH _B3 ≦ SV <TH so that the relationship between DIS and k _R shown in FIG. 5 can be changed to that of FIG. 7. _When “ _B4 ” is established, k _R may be changed stepwise.

TH _B1 to TH _B4 is a reference volume that satisfies the inequality _{"0 <TH B1 <TH B2 <} TH B3 <TH B4 ", it is possible to set them in advance. However, TH _B1 = TH _B2 can be set, TH _B2 = TH _B3 can be set, or TH _B3 = TH _B4 can be set.

Except for the difference in the method for determining the playback speed adjustment rate k _R, the method for generating the output moving image by the speed adjustment unit 52b is the same as that by the speed adjustment unit 52 (see FIGS. 8 and 9). However, in the eighth embodiment, the playback speed of the input frame image belonging to the unit section P [i] is controlled based on the evaluation sound volume SV [i] based on the input sound signal of the unit section P [i]. That is, the playback speed adjustment rate k _R for the unit interval P [i] is determined based on the evaluation volume SV [i], and the unit interval P [i] is determined based on the playback speed adjustment rate k _R for the unit interval P [i]. An output frame image belonging to the unit section P [i] is generated from the input frame image belonging to.

Therefore, for example, when the number of input frame images belonging to each unit section (that is, the value of L) is 4,
When the inequality “0 ≦ SV [i] <TH _B1 ” is satisfied, two output frame images belonging to the unit interval P [i] are generated from the four input frame images belonging to the unit interval P [i].
When the inequality “TH _B2 ≦ SV [i] <TH _B3 ” is satisfied, four input frame images themselves belonging to the unit section P [i] are generated as four output frame images belonging to the unit section P [i]. ,
When the inequality “TH _B4 ≦ SV [i]” is satisfied, 32 output frame images belonging to the unit interval P [i] are generated from the four input frame images belonging to the unit interval P [i].

  The output moving image output from the speed adjustment unit 52b is displayed on the display unit 27 at a constant frame rate of 60 fps. The method of reproducing the audio signal associated with the input moving image is the same as that described in the first embodiment.

  For example, when playing back a moving image in which a state of a soccer game is captured, a video section in which the size of the audio signal is large is considered to correspond to a section in which a scene on the game is swelled. Therefore, such a video section is highly likely to be an attention section for the user (viewer), and is desired to be played back over a relatively long time. Considering this, in the present embodiment, when it is estimated that the size of the audio signal is large and the scene is exciting, the reproduction speed is automatically reduced. As a result, slow playback that matches the user's (viewer's) desire is performed.

Also, it is presumed that the video section in which the size of the audio signal is relatively small is not a video section for an important scene. Considering this, in the above-described example, fast-forward playback is performed when the evaluation sound volume SV is correspondingly small. Thereby, the time required for viewing a moving image can be shortened. Also, if the playback speed during slow playback is always the same, the video during slow playback may tend to be monotonous. Considering this, it is preferable to change the playback speed at the time of slow playback based on the evaluation sound volume SV in two or more stages (in consideration of the reference playback speed REF _SP , the playback speed may be changed in three or more stages). . As a result, realistic slow playback is possible.

It is possible to prevent fast-forward playback as described above from being performed. That is, for example, when the inequality “SV <TH _B3 ” is established, k _R may always be set to 1 regardless of how small the evaluation sound volume SV is.

  Next, with reference to FIG. 28, the flow of operations of the imaging apparatus 1 in the automatic slow motion playback mode of the eighth embodiment will be described. FIG. 28 is a flowchart showing the flow of this operation. When playback of a moving image as an input moving image is instructed in the automatic slow motion playback mode, the input frame image and the input audio signal forming the input moving image are read from the external memory 18 in order from the earliest in time series. Then, the evaluation sound volume SV is derived one after another and the reproduction speed is adjusted.

  Specifically, after 1 is assigned to the variable i in step S50, the input frame image and the input audio signal of the unit section P [i] are read from the external memory 18 in step S51, and in the subsequent step S52, the unit section Evaluation sound volume SV [i] is calculated from the input sound signal of P [i]. In the subsequent step S53, the input frame image of the unit section P [i] is reproduced at the reproduction speed based on the evaluation sound volume SV [i]. The processing of steps S51 to S53 is repeatedly executed until the reproduction of the input moving image is completed (step S54), and 1 is added to the variable i each time the processing of steps S51 to S53 is performed once (step S55). .

  Note that each of the above-described processes based on the recorded data in the external memory 18 can be realized by an electronic device (for example, an image reproduction device; not shown) different from the imaging device (the imaging device is also a kind of electronic device). is there). For example, the imaging apparatus 1 captures a moving image and stores the image data of the moving image and an audio signal to be associated therewith in the external memory 18. 25 is provided with the sound volume detection unit 111 and the speed adjustment unit 52b shown in FIG. 25 and the display unit and speaker equivalent to the display unit 27 and the speaker 28 shown in FIG. The moving image image data and the audio signal associated therewith may be given to the speed adjustment unit 52b and the sound volume detection unit 111 in the electronic device as the image data and input audio signal of the input moving image. In the electronic device, the display unit reproduces and displays the output moving image from the speed adjustment unit 52b at a constant frame rate of 60 fps. Thereby, the input moving image whose reproduction speed is adjusted is reproduced on the display unit of the electronic device, and the audio signal associated with the input moving image is also reproduced by the speaker of the electronic device.

<< Ninth Embodiment >>
A ninth embodiment of the present invention will be described. In the ninth embodiment, still another method of realizing the recording rate variable function by the imaging apparatus 1 of FIG. 1 will be described. The matters described in the above embodiments are also applied to the ninth embodiment as long as there is no contradiction.

  FIG. 29 is a partial block diagram of the imaging apparatus 1 particularly related to the operation in the automatic slow motion recording mode according to the ninth embodiment. The volume detector 111 in FIG. 29 is the same as that in FIG. The shooting rate adjustment unit 72b is realized by, for example, the CPU 23 and / or the TG 22 of FIG. The image data of the input frame image in the ninth embodiment refers to the image data of the frame image output from the AFE 12 in the automatic slow motion recording mode, as in the fourth and fifth embodiments described above. The following description in the ninth embodiment is an operation description of the imaging apparatus 1 in the automatic slow motion recording mode unless otherwise specified.

  The input audio signal in the ninth embodiment refers to an audio signal of sound collected by the microphone 14 in FIG. 1 in a section in which an input moving image is captured. The input audio signal and the image data of the input moving image are recorded in the external memory 18 in association with each other. As in the eighth embodiment, as shown in FIG. 26, the entire shooting section of the input moving image is divided into a plurality of unit sections P [1], P [2], P [3],. To do.

  The sound volume detection unit 111 calculates the evaluation sound volume SV for the unit section for each unit section, and outputs the obtained evaluation sound volume SV to the shooting rate adjustment unit 72b. The significance of the evaluation volume SV and the calculation method of the evaluation volume SV are as described in the eighth embodiment.

  The shooting rate adjustment unit 72b dynamically changes the shooting rate based on the evaluation sound volume SV in the automatic slow motion recording mode. FIG. 30 shows an example of the relationship between the shooting rate and the evaluation sound volume SV. A look-up table or a mathematical expression representing such a relationship can be given in advance to the photographing rate adjustment unit 72b. As shown in FIG. 30, basically, the larger the evaluation volume SV, the larger the shooting rate.

In the example shown in FIG. 30, when the inequality “SV <TH _B1 ” is satisfied, the shooting rate is 15 fps, and when the inequality “TH _B1 ≦ SV <TH _B2 ” is satisfied, the evaluation sound volume SV is changed from the reference sound volume TH _B1 to the reference sound volume TH. _The shooting rate is increased linearly from 15 fps to 60 fps as it increases toward _B2 , and when the inequality “TH _B2 ≦ SV <TH _B3 ” is satisfied, the shooting rate is set to 60 fps, and the inequality “TH _B3 ≦ SV < When TH _B4 is established, the shooting rate is linearly increased from 60 fps to 300 fps as the evaluation volume SV increases from the reference volume TH _B3 toward the reference volume TH _B4 , and the inequality “TH _B4 ≦ SV” is established. Sometimes the shooting rate is 300 fps.

If the shooting rate can be continuously changed, the shooting rate can be adjusted as described above, but usually the shooting rate is often changed only in steps. Therefore, as the relationship of FIG. 5 is transformed into the relationship of FIG. 7, the shooting rate is continuously changed when the inequality “TH _B1 ≦ SV <TH _B2 ” or “TH _B3 ≦ SV <TH _B4 ” is satisfied. You may make it change in steps instead of making it.

  In the fourth or seventh embodiment, the shooting rate is set based on the evaluation distance DIS or the evaluation angle ANG as the state quantity, whereas in the ninth embodiment, the shooting rate is set based on the evaluation sound volume SV as another state quantity. Is set. Except for the fact that the state quantity from which the shooting rate is set is different, the function of the shooting rate adjustment unit 72b is the same as that of the shooting rate adjustment unit 72 or 72a (see FIG. 12 or FIG. 22) according to the fourth or seventh embodiment. It is the same.

However, in the ninth embodiment, since it is necessary to adjust the shooting rate in real time from the input audio signal obtained when shooting the input moving image, the detection result of the volume detection unit 111 in the unit interval P [i] (that is, the evaluation volume) It is difficult to reflect SV [i]) in the shooting rate of the unit interval P [i]. Therefore, the shooting rate adjustment unit 72b adjusts the shooting rate of the unit section after the unit section P [i] based on the evaluation sound volume SV [i]. Specifically, for example, the shooting rate of the unit section [i + 1] is adjusted based on the evaluation sound volume SV [i]. In this case, for example, if the inequality “SV [i] <TH _B1 ” is satisfied, the shooting rate for the unit interval P [i + 1] is 15 fps, and the inequality “TH _B2 ≦ SV [i] <TH _B3. "Is established, 60 fps is assumed, and if the inequality" TH _B4 ≤SV [i] "is established, 300 fps is assumed.

  The image data of the input moving image obtained as described above is recorded in the external memory 18 together with the input audio signal. In the playback mode, the imaging apparatus 1 uses the display unit 27 to play back the input moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the input moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproducing device; not shown) different from the imaging device 1, and the input moving image is set to a constant frame rate of 60 fps on the electronic device. Can also be played.

  A portion recorded at a high shooting rate due to a large evaluation volume SV is played back in slow speed because of the large number of recording frames per unit time. On the contrary, the portion recorded at a low photographing rate due to the small evaluation sound volume SV is reproduced by fast-forwarding because the number of recording frames per unit time is small. As a result, the same effect as in the eighth embodiment can be obtained. In addition, when the evaluation sound volume SV is high, since actual shooting is performed at a high shooting rate (for example, 300 fps) and image recording is performed, it is possible to perform slow reproduction with higher image quality than in the eighth embodiment. On the other hand, the amount of recording data increases, and thinning processing is required when a portion shot at a high shooting rate (for example, 300 fps) is normally reproduced.

Note that when the evaluation sound volume SV is small, the photographing rate may not be reduced. That is, for example, when the inequality “SV <TH _B3 ” is established, the shooting rate may always be set to 60 fps, no matter how small the evaluation sound volume SV is.

  With reference to FIG. 31, the flow of the operation of the imaging apparatus 1 in the automatic slow motion recording mode of the ninth embodiment will be described. FIG. 31 is a flowchart showing the flow of this operation. In the automatic slow motion recording mode, when an instruction to capture the input moving image is issued by the first pressing operation of the recording button 26a, 1 is assigned to the variable i and the capturing and recording of the input moving image is started (step S1). S60 and S61). As described above, the input audio signal in the shooting period of the input moving image is also recorded in the external memory 18 in association with the image data of the input frame image. In step S62, the evaluation sound volume SV [i] is calculated from the input audio signal in the unit interval P [i]. In subsequent step S63, the shooting rate of the unit interval P [i + 1] is determined according to the evaluation sound volume SV [i]. Is set. Until the recording of the input moving image is completed (for example, until the second recording button 26a is pressed), the recording of the image data of the sequentially obtained input frame images is continued, and the processes of steps S62 and S63 are performed. Repeatedly executed (step S64). Each time the processes of steps S62 and S63 are performed once, 1 is added to the variable i (step S65). Further, the shooting rate in the unit section P [1] is fixed to 60 fps. Alternatively, the evaluation volume SV [0] is calculated from the audio signal of the unit section P [0], which is the section immediately before the unit section P [1], and the unit section P [1] is calculated based on the evaluation volume SV [0]. The shooting rate may be set.

In addition, the above-mentioned method in 8th Embodiment can also be deform | transformed as follows so that 4th Embodiment can be deform | transformed into 5th Embodiment.
That is, in the automatic slow motion recording mode, the image rate of the input moving image is acquired with the shooting rate fixed at 60 fps, and the image data of the input moving image and the input audio signal to be associated with the image data are input to the speed adjustment unit 52b in FIG. The image data of the output moving image obtained from the sound volume detection unit 111 and thus obtained from the speed adjustment unit 52 b is recorded in the external memory 18. A method for generating an output moving image from an input moving image is as described in the eighth embodiment. In the playback mode, the imaging apparatus 1 uses the display unit 27 to play back the output moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the output moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproduction device; not shown) different from the imaging device 1, and the output moving image is set to a constant frame rate of 60 fps on the electronic device. To play. This also adjusts the number of recorded frame images per unit time according to the evaluation volume SV. That is, the frame rate of the moving image to be recorded is adjusted according to the evaluation sound volume SV by the speed adjustment unit 52b of FIG. 25, which is also called a recording frame rate control unit or a frame rate control unit, and the shooting rate adjustment unit 72b of FIG. The same effect as that obtained when the shooting rate is adjusted using is obtained.

<< Tenth Embodiment >>
A tenth embodiment of the present invention will be described. In the tenth embodiment, another method for realizing the recording rate variable function by the imaging apparatus 1 of FIG. 1 will be described. The matters described in the above embodiments are applied to the tenth embodiment as long as there is no contradiction.

  FIG. 32 is a partial block diagram of the imaging apparatus 1 particularly related to the operation in the automatic slow motion recording mode according to the tenth embodiment. The recording rate adjustment unit (recording frame rate control unit) 82 is realized by, for example, the CPU 23 in FIG. The following description in the tenth embodiment is an operation description of the imaging apparatus 1 in the automatic slow motion recording mode unless otherwise specified.

  In the automatic slow motion recording mode of the tenth embodiment, image data of an input moving image is acquired after the shooting rate is fixed at 300 fps. On the other hand, the evaluation distance DIS, the evaluation angle ANG, or the evaluation sound volume SV is derived according to the method described in any of the above-described embodiments, and is supplied to the recording rate adjustment unit 82. The evaluation distance DIS, the evaluation angle ANG or the evaluation sound volume SV given to the recording rate adjustment unit 82 is called an evaluation state quantity. Note that a combination of two or three of the evaluation distance DIS, the evaluation angle ANG, and the evaluation sound volume SV may be an evaluation state quantity.

  The recording rate adjustment unit 82 generates a recording moving image from the input moving image based on the evaluation state quantity. The generated image data of the recording moving image is recorded in the external memory 18 together with the input audio signal.

When the evaluation state quantity is the evaluation distance DIS, the recording moving image is a moving image equivalent to the input moving image to be obtained in the fourth embodiment (see FIGS. 12 and 13), and
When the evaluation state quantity is the evaluation angle ANG, the recording moving image is a moving image equivalent to the input moving image to be obtained in the seventh embodiment (see FIGS. 22 and 23), and
When the evaluation state quantity is the evaluation sound volume SV, the recording moving image is a moving image equivalent to the input moving image to be obtained in the ninth embodiment (see FIGS. 29 and 30).
If necessary, a recording moving image is generated by thinning out a part of the input frame image sequence.

  For the sake of specific description, an operation when the evaluation state quantity is the evaluation sound volume SV will be described. Further, it is assumed that the number of input frame images belonging to each unit section (that is, the value of L) is 20 (that is, the time length of each unit section is 20 × 1/300 = 1/15 [seconds]). Assuming a certain case), the j-th input frame image in the unit interval P [i] is represented by FI [i, j] (i and j are integers). In this case, the moving image for recording in the unit interval P [i] is formed from all or part of the input frame images FI [i, 1] to FI [i, 20], and basically the evaluation sound volume SV [i]. Is larger, the number of input frame images forming the recording moving image in the unit interval P [i] is increased.

Specifically, for example (see FIG. 30),
The input frame image forming the recording moving image of the unit interval P [i] is
When the inequality “SV [i] <TH _B1 ” is satisfied, only FI [i, 1] is assumed.
When the inequality “TH _B1 ≦ SV [i] <TH _B2 ” is satisfied, only FI [i, 1] and FI [i, 11] are assumed.
When the inequality “TH _B2 ≦ SV <TH _B3 ” is established, only FI [i, 1], FI [i, 6], FI [i, 11], and FI [i, 16] are set.
When the inequality “TH _B3 ≦ SV <TH _B4 ” is satisfied, FI [i, 1], FI [i, 3], FI [i, 5], FI [i, 7], FI [i, 9], Only FI [i, 11], FI [i, 13], FI [i, 15], FI [i, 17] and FI [i, 19]
When the inequality “TH _B4 ≦ SV” is satisfied, all of FI [i, 1] to FI [i, 20] are set.

  In the playback mode, the imaging device 1 uses the display unit 27 to play back the recording moving image read from the external memory 18 at a constant frame rate of 60 fps. Alternatively, the recording moving image recorded in the external memory 18 is given to an electronic device (for example, an image reproducing device; not shown) different from the imaging device 1, and the recording moving image is provided on the electronic device at a constant frame rate. It can also be played back at 60 fps. Thereby, it is possible to obtain the same effect as that of the fourth, seventh, or ninth embodiment for controlling the photographing rate according to the evaluation state quantity.

<< Deformation, etc. >>
The specific numerical values shown in the above description are merely examples, and as a matter of course, they can be changed to various numerical values.

  The imaging apparatus 1 in FIG. 1 can be configured by hardware or a combination of hardware and software. When the imaging apparatus 1 is configured using software, a block diagram of a part realized by software represents a functional block diagram of the part. A function realized using software may be described as a program, and the function may be realized by executing the program on a program execution device (for example, a computer).

DESCRIPTION OF SYMBOLS 1 Imaging device 11 Imaging part 27 Display part 33 Imaging element 51 Tracking process part 52, 52a, 52b Speed adjustment part (reproduction speed adjustment part)
72, 72a, 72b Shooting rate adjustment unit 82 Recording rate adjustment unit 101 Face detection unit 111 Volume detection unit

Claims (10)

In an image playback device for playing back moving images,
A playback speed control unit that controls the playback speed of the moving image according to a distance between a plurality of specific objects on the moving image or an evaluation distance that is a distance between a fixed position on the moving image and a target object; An image reproducing apparatus characterized by that. The playback speed control unit
Deriving the distance between the plurality of specific objects as the evaluation distance by tracking the position of each specific object on the moving image based on the image data of the moving image, or
The distance between the fixed position and the target object as the evaluation distance is derived by tracking the position of the target object on the video based on the image data of the video. Item 2. The image playback device according to Item 1. In an image playback device for playing back moving images,
An image reproduction apparatus comprising: a reproduction speed control unit that controls a reproduction speed of the moving image according to at least one of a direction and an inclination of a human face on the moving image. In an image playback device for playing back moving images,
An image reproduction apparatus comprising: a reproduction speed control unit that controls a reproduction speed of the moving image according to a magnitude of an acoustic signal associated with the moving image. The image reproduction apparatus according to any one of claims 1 to 4, comprising:
An imaging apparatus, wherein the moving image to be reproduced by the image reproduction apparatus is acquired by photographing. In an imaging device that captures and records moving images,
A frame rate control unit that controls a frame rate of a moving image to be recorded according to a distance between a plurality of specific objects on the moving image or an evaluation distance that is a distance between a fixed position on the moving image and a target object. An image pickup apparatus comprising: The playback speed control unit
Deriving the distance between the plurality of specific objects as the evaluation distance by tracking the position of each specific object on the moving image based on the image data of the moving image, or
The distance between the fixed position and the target object as the evaluation distance is derived by tracking the position of the target object on the video based on the image data of the video. Item 7. The imaging device according to Item 6. In an imaging device that captures and records moving images,
An image pickup apparatus comprising: a frame rate control unit that controls a frame rate of a moving image to be recorded according to at least one of a direction and an inclination of a human face on the moving image. In an imaging device that captures and records moving images,
An image pickup apparatus comprising: a frame rate control unit that controls a frame rate of a moving image to be recorded in accordance with a magnitude of an acoustic signal picked up when the moving image is captured. The imaging apparatus according to claim 6, wherein the recorded moving image is output to a display unit at a constant frame rate.