JP2012191544A - Reproduction apparatus, imaging apparatus, and moving image reproduction program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To freely move a subject moving in a moving image, at an arbitrary speed desired by a user.SOLUTION: A reproduction apparatus is provided with: a reproduction control part 111 which controls reproduction of a moving image; a display part 19 which displays the reproduced moving image; a touch panel 14 which is superposed on the display part 19; and an operation detection part 113 which detects touch operation on a touch panel 14. If the reproduction control part 111 determines that the touch operation detected by the operation detection part 113 is movement operation along the movement of a subject moving in the moving image, the reproduction control part 111 controls the reproduction of the moving image so that the subject moves in connection with the movement operation.

Description

  The present invention relates to a moving image reproduction technique.

  2. Description of the Related Art Conventionally, a technique is known that provides an image that makes it easier to see a subject of interest by extracting and enlarging the subject of interest from a moving image and displaying the enlarged still images side by side (see Patent Document 1).

  On the other hand, since it takes time to view all moving images, there are many voices of users who want to efficiently appreciate halfway or only a part thereof. Conventionally, when only a part of a scene in a moving image is to be reproduced, the scene is cued by fast-forwarding or rewinding reproduction. In addition, there is known a reproducing apparatus capable of automatically cuing the position where the index mark is added. However, even in such a reproducing apparatus, it is necessary to manually input the index mark to the position in advance.

  Regarding video cue playback technology, if multiple thumbnail images corresponding to the playback time position of the video are displayed and a gesture operation is performed on the thumbnail image that you want to cue, the scene corresponding to the thumbnail image A technique for starting playback of a moving image is known (see Patent Document 2).

  Further, a technique for detecting the approach of a hand to the touch panel and controlling displayed information is also known (see Patent Document 3).

JP 2004-178368 A JP 2009-43225 A JP 2008-250654 A

  In the reproduction of a moving image, a desired image can be displayed by performing fast forward reproduction or slow reproduction at a predetermined speed by operating a fast forward button or a slow reproduction button. However, in the conventional technique, it is not possible to freely move a subject moving in a moving image at an arbitrary speed desired by the user.

  An object of the present invention is to provide a technique capable of freely moving a subject moving in a moving image at an arbitrary speed desired by a user.

  A playback apparatus according to an aspect of the present invention includes a playback control unit that controls playback of a moving image, a display unit that displays a played back video, a touch panel unit that is arranged to overlap the display unit, and the touch panel An operation detection unit that detects a touch operation on the unit, and the reproduction control unit determines that the touch operation detected by the operation detection unit is a movement operation along a movement of a subject moving in a moving image Then, the reproduction of the moving image is controlled so that the subject moves in conjunction with the moving operation.

  A moving image playback program according to another aspect of the present invention includes a step of detecting a touch operation on a touch panel arranged to overlap a display unit that displays a moving image, and a subject of the detected touch operation moving in the moving image. Determining whether or not the movement operation is along the movement; and determining that the touch operation is a movement operation along the movement of the subject so that the subject moves in conjunction with the movement operation. And a step of controlling reproduction of the moving image.

  According to the present invention, a user can freely move a subject moving in a moving image at an arbitrary speed by performing a moving operation along the movement of the subject by a touch operation on the touch panel unit.

It is a block diagram which shows the structure of the digital camera in 1st Embodiment. It is a figure for demonstrating an example of the moving image to reproduce | regenerate. It is a figure for demonstrating an example of the moving image reproduction display at the time of direct operation mode setting. It is a figure for demonstrating normal reproduction | regeneration, slow reproduction | regeneration, and fast forward reproduction | regeneration. It is a figure for demonstrating the reverse reproduction | regeneration according to the sliding operation of a finger | toe. It is a figure for demonstrating the moving image reproduction method when it is a position away from the position where a specific subject exists on a screen, and the position near the movement locus | trajectory of a specific subject is touched. It is a figure for demonstrating an example of the designation | designated method when a user designates a specific subject. It is a figure for demonstrating the method to pinpoint a specific subject when a picking angle of view changes. It is a flowchart performed by the digital camera in 1st Embodiment. It is a figure which shows the detailed structure of the control part of the digital camera in 2nd Embodiment. It is a figure for demonstrating the moving image reproduction | regeneration control in 2nd Embodiment. It is a flowchart performed by the digital camera in 2nd Embodiment.

-First embodiment-
FIG. 1 is a block diagram illustrating a configuration of a digital camera 1 according to the first embodiment. The digital camera 1 functions as a photographing device that captures still images / moving images and also functions as a playback device that reproduces still images / moving images.

  The digital camera 1 includes a control unit 11, a program / data storage unit 12, an operation unit 13, a touch panel 14, an imaging unit 15, an SDRAM 16, an image processing unit 17, a display driver unit 18, and a display unit 19. A compression / decompression unit 20, a reproduction unit 21, a recording unit 22, an image storage unit 23, and a bus 25.

  The control unit (CPU) 11 operates according to a control program stored in the program / data storage unit 12 and performs overall control of the camera. In the control unit 11, a reproduction control unit 111, a locus generation unit 112, an operation detection unit 113, and a specific image search unit 114 are provided. Since the reproduction control unit 111, the trajectory generation unit 112, the operation detection unit 113, and the specific image search unit 114 are a part of processing executed by the control program, they will be described as functional units included in the control unit 11.

  The reproduction control unit 111 performs reproduction control (reproduction speed control) when the reproduction unit 21 described later reproduces an image.

  The trajectory generation unit 112 identifies a moving subject in the moving image, sets this as a specific subject, detects the shape and color of the specific subject, and tracks the specific subject in the moving image. When the specific subject is specified by the user, the subject specified by the user is set as the specific subject. When a specific subject is not specified by the user and a plurality of moving subjects are detected, the largest subject is specified as the specific subject. However, the subject with the largest movement may be specified as the specific subject instead of the subject with a large size.

  In addition, the trajectory generation unit 112 creates the movement trajectory of the specific subject by sequentially storing the position of the specific subject on the image according to the reproduction of the moving image. The created movement trajectory data is stored in the image storage unit 23.

  The operation detection unit 113 detects the operation of the operation unit 13 and the operation of the touch panel 14 by the user. In particular, the operation detection unit 113 detects a corresponding position on the image displayed on the display unit 19 based on the operation position of the touch panel 14.

  When the user performs a touch operation on the touch panel 14, the specific image search unit 114 displays an image in which a specific subject exists within a predetermined range centered on a specified position (touch position) on the image. A search is made from a plurality of images constituting the moving image being displayed in FIG. When searching for an image, when the movement locus of the specific subject is generated by the locus generation unit 112, the position of the specific subject on the image is specified, so information on the movement locus is used. When the movement locus of the specific subject has not been generated by the locus generation unit 112, a search is performed from a series of images constituting the moving image by image recognition processing. At this time, the search may be performed every predetermined frame (for example, 10 frames) or every predetermined time (for example, 0.5 seconds) without searching from all the images constituting the moving image.

  Depending on the content of the moving image, the specific subject may pass through a designated position on the image a plurality of times. In this case, a plurality of images are detected. In such a case, the specific image search unit 114 preferentially detects an image with the earliest shooting time. In some cases, an image with a slow shooting time may be preferentially detected.

  The control unit 11 is connected with a program / data storage unit 12, an operation unit 13, a touch panel 14, and a bus 25. As described above, the program / data storage unit 12 stores a program executed by the control unit 11 and also stores various data.

  The operation unit 13 includes various operation members for the user to give instructions to the camera. The various operation members include, for example, a power button, a release button, an OK button, a cross button, a playback button, a tele wide button, and the like. The operation states of various operation members included in the operation unit 13 are detected by the operation detection unit 113 of the control unit 11.

  The touch panel 14 is disposed so as to overlap the front surface of the display unit 19 or is configured integrally with the display unit 19. When the user touches the screen of the display unit 19, the operation detection unit 113 detects the touch position and the touch direction.

  In addition to the control unit 11, the imaging unit 15, SDRAM 16, image processing unit 17, display driver unit 18, compression / decompression unit 20, reproduction unit 21, and recording unit 22 are connected to the bus 25.

  The imaging unit 15 includes a photographing lens for forming a subject image, an imaging element for converting the subject image into image data, a processing circuit thereof, a diaphragm and a shutter interposed in the optical path of the photographing lens, and the like. including. Image data of still images and continuous images generated by the imaging unit 15 is output to the bus 25.

  The SDRAM 16 is an electrically rewritable volatile temporary storage memory, and is used for temporary storage of still image and continuous image data output from the imaging unit 15.

  The image processing unit 17 performs digital amplification (digital gain adjustment processing) of digital image data, white balance, color correction, gamma (γ) correction, contrast correction, live view display image generation, moving image generation, index image (reduction) Various image processing such as (image) generation is performed.

  The compression / decompression unit 20 is a circuit for compressing still image or continuous image data temporarily stored in the SDRAM 16 by a compression method such as JPEG or TIFF, and decompressing the data for display. Note that image compression is not limited to JPEG, TIFF, and MPEG, and other compression methods can be applied.

  The display driver unit 18 is connected to the display unit 19 and causes the display unit 19 to display an image. The display unit 19 is a display such as a liquid crystal monitor or an organic EL arranged on the back surface of the camera body.

  The reproduction unit 21 reproduces an image based on an instruction from the reproduction control unit 111. In particular, the playback unit 21 reads the image data searched by the specific image search unit 114 of the control unit 11 from among a plurality of images constituting the moving image being displayed on the display unit 19. The read image data is decompressed by the compression / decompression unit 20 and an image is reproduced and displayed on the display unit 19 based on the decompressed image data.

  The recording unit 22 causes the image storage unit 23 to record the image data compressed by the compression / decompression unit 20. The image storage unit 23 is connected to the playback unit 21 and is a recording medium for image data that can be built in or loaded into the camera body.

  In the digital camera 1 according to the first embodiment, a direct operation mode can be set in addition to the normal moving image reproduction mode as a reproduction mode during moving image reproduction.

  The direct operation mode will be described. FIG. 2 is a diagram for explaining an example of a moving image to be reproduced. 2A and 2B are images at the start and end of shooting among a plurality of still images constituting a moving image to be played back, and time t = 0 (second) and t = 30 (second), respectively. The image at the time of is represented. FIG. 2C shows an image showing the position of the moving subject at intervals of 3 seconds for the following explanation.

  2A to 2C, the specific subject is a person 28 running on the road 26. That is, on the image, the road 26, the house 27, and the person 28 are shown, but the person 28 that is a moving subject is specified as the specific subject. As shown in FIG. 2C, the positions of the specific subjects at intervals of 3 seconds from time t = 0 (seconds) to t = 30 (seconds) are p1, p2, p3, p4, p5, and p6, respectively. , P7, p8, p9, p10, and p11.

  FIG. 3 is a diagram for explaining an example of a moving image playback display when the direct operation mode is set. When the digital camera 1 is set to the direct operation mode and a specific subject is specified, an arrow icon 31 indicating that the specific subject is a specific subject as shown in FIG. Is displayed. In addition, when the movement locus of the specific subject is created by the locus generation unit 112, the movement locus is superimposed on the image. In FIG. 3A, the movement locus 32 is indicated by a dotted line.

  Note that the movement trajectory of the specific subject is created by the trajectory generation unit 112 when the moving image is reproduced once from the beginning to the end, and is displayed on the display unit 19 at the next reproduction of the moving image. However, if the movement locus has not been created, the movement locus of the specific subject is created during the reproduction of the moving image, and the movement locus being created is displayed on the display unit 19 at any time during the reproduction of the moving image. May be.

  The user can control the moving speed of the specific subject, that is, the moving image playback speed, to any speed by touching the touch panel 14. This control is performed by the user touching the vicinity of the specific subject on the screen. The vicinity of the specific subject is within a predetermined range centered on the position where the specific subject exists. FIG. 3B is a diagram showing a state in which the vicinity of the specific subject existing at the position p5 in FIG.

  The user can move the specific subject by performing a sliding operation to move the finger to another point along the moving direction of the specific subject while touching the finger on the touch panel 14. The moving direction of the specific subject is a direction in which the specific subject moves during normal playback of a moving image. FIG. 3C is a diagram illustrating a state in which a sliding operation is performed in which the finger is moved along the moving direction of the specific subject while the finger is touched on the touch panel 14. The finger 34 represents the start position of the sliding operation, the finger 36 represents the end position of the sliding operation, and the finger 35 represents the position during the sliding operation.

  The specific image search unit 114 searches for an image in which a specific subject exists within a predetermined range centered on a position touched with a finger, from a series of images constituting a moving image. When there are a plurality of images in which the specific subject exists within a predetermined range centered on the position touched with the finger, an image in which the specific subject exists at a position closest to the position touched with the finger is searched. Then, the searched image is displayed on the display unit 19. By repeatedly performing this process during the period in which the finger sliding operation is performed, it is possible to perform moving image reproduction such that the specific subject moves at the same speed as the finger sliding operation speed. That is, if a sliding operation that moves the finger slowly is performed, slow reproduction in which the specific subject moves slowly is performed, and if a sliding operation that moves the finger fast is performed, fast-forward reproduction in which the specific subject moves fast is performed.

  FIG. 3C shows a state in which the specific subject is moving in accordance with the sliding operation of the finger by displaying a plurality of specific subjects. A dotted line 37 shown in FIG. 3C is a line indicating the moving direction of the specific subject and is not displayed in an actual moving image. Note that when the movement of the finger is stopped while being touched in the middle of FIG. 3B or FIG. 3C, the moving image is temporarily stopped at that position.

  FIG. 3D is a diagram illustrating a state where the user finishes the finger sliding operation and releases the finger 38 from the touch panel 14. When the user's finger is released from the touch panel 14, the video playback at the normal playback speed is resumed. In the example shown in FIG. 3D, moving image reproduction at a normal reproduction speed is resumed from an image having a reproduction time of 27 seconds.

  FIG. 3C shows a moving image reproduction display example when a sliding operation for slowly moving a finger is performed. As described above, when a sliding operation for slowly moving a finger is performed, slow reproduction in which a specific subject slowly moves according to the sliding operation speed is performed. On the other hand, FIG. 3E is a diagram illustrating an example of a moving image reproduction display when a sliding operation for moving a finger quickly is performed. When a sliding operation that moves a finger quickly is performed, fast-forward reproduction in which the specific subject moves fast is performed according to the sliding operation speed.

  FIG. 4 is a diagram for explaining normal reproduction, slow reproduction, and fast forward reproduction. 4A shows the time change of the specific subject during normal playback, FIG. 4B shows the time change of the specific subject during slow playback, and FIG. 4C shows the time change of the specific subject during fast-forward playback. Respectively.

  During normal reproduction, it takes 12 seconds for the specific subject to move from the position p5 to the position p9 (FIG. 4A). On the other hand, when the user performs an operation of sliding the finger from the position p5 to the position p9 over 24 seconds, the specific subject moves from the position p5 to the position p9 in accordance with the speed of the sliding operation. Slow playback that moves over a second is performed (FIG. 4B).

  When the user performs an operation of sliding the finger from the position p5 to the position p9 in 6 seconds, the specific subject moves from the position p5 to the position p9 in 6 seconds according to the speed of the sliding operation. Fast forward playback is performed (FIG. 4C).

  In FIG. 3 and FIG. 4, the method of controlling the moving image reproduction speed by performing the sliding operation of moving the finger along the moving direction of the specific subject has been described. In the present embodiment, reverse reproduction is performed in which a moving image is reproduced in the reverse direction by performing a sliding operation of moving a finger along a direction opposite to the moving direction of the specific subject.

  FIG. 5 is a diagram for explaining reverse reproduction according to a finger sliding operation. FIG. 5A shows an image with a playback time of 24 seconds. In FIG. 5A, the movement trajectory 50 is displayed by a dotted line. The user touches the vicinity of the specific subject on the screen, and performs a sliding operation of moving the finger to another point along the direction opposite to the moving direction of the specific subject while keeping the touched state.

  FIG. 5B is a diagram illustrating a state in which a sliding operation is performed in which the finger is moved along a direction opposite to the moving direction of the specific subject while the finger is touched on the touch panel 14. The finger 51 represents the start position of the sliding operation, the finger 53 represents the end position of the sliding operation, and the finger 52 represents the position during the sliding operation.

  FIG. 5C is a diagram illustrating a state in which the user finishes the finger sliding operation and releases the finger 55 from the touch panel 14. When the user's finger is released from the touch panel 14, the video playback at the normal playback speed is resumed. In the example shown in FIG. 5C, the moving image reproduction at the normal reproduction speed is resumed from the image having the reproduction time of 15 seconds.

  The specific image search unit 114 searches for an image in which a specific subject exists within a predetermined range centered on a position touched with a finger, from a series of images constituting a moving image. When there are a plurality of images in which the specific subject exists within a predetermined range centered on the position touched with the finger, an image in which the specific subject exists at a position closest to the position touched with the finger is searched. Then, the searched image is displayed on the display unit 19. By repeating this process while the finger is sliding, the specific subject moves in the opposite direction to the moving direction at the same speed as the sliding operation in the direction opposite to the moving direction of the specific subject. Movie playback (reverse playback) that moves in the direction can be performed.

  FIG. 5B shows a state where the specific subject is moving in accordance with the sliding operation of the finger by displaying a plurality of specific subjects. A dotted line 54 shown in FIG. 5B is a line indicating the moving direction of the specific subject during reverse playback, and is not displayed in an actual moving image.

  In the description using FIGS. 3 to 5 described above, the operation method for performing the sliding operation by touching the vicinity of the specific subject on the screen has been described. Next, an operation method in which a sliding operation is performed by touching a position near the movement locus of the specific subject that is away from the position where the specific subject exists on the screen will be described with reference to FIG. .

  FIG. 6A shows an image with a playback time of 0 seconds. The specific subject indicated by the arrow icon 60 exists at the position p1. In this state, the user touches a desired position in the vicinity of the movement locus 61 of the specific subject that is away from the position p1. The vicinity of the movement locus 61 is a position within a predetermined range from the movement locus 61.

  The specific image search unit 114 searches for an image in which a specific subject exists within a predetermined range centered on a position touched with a finger, from a series of images constituting a moving image. When there are a plurality of images in which the specific subject exists within a predetermined range centered on the position touched with the finger, an image in which the specific subject exists at a position closest to the position touched with the finger is searched. Then, the searched image is displayed on the display unit 19.

  6B shows a position of the display unit 19 when the user touches a position near the movement locus 61 of the specific subject with the finger 62 at a position away from the position p1 shown in FIG. It is a figure which shows the example of a display. An image in which the specific subject is present at the position p5 closest to the position touched with the finger 62 is retrieved and displayed on the display unit 19.

  Thereafter, when a sliding operation is performed in which the finger 62 is touched on the touch panel 14 and the finger is moved along the moving direction of the specific subject, moving image reproduction in which the specific subject moves according to the sliding operation is performed (FIG. 6). (C)). The moving image reproduction display corresponding to the sliding operation is the same as the moving image reproduction display described with reference to FIG. FIG. 6C shows a state where the specific subject moves from the position p5 to the position p9 by performing a sliding operation from the finger 62 to the finger 63. A dotted line 64 shown in FIG. 6C indicates the moving direction of the specific subject. Note that when the movement of the finger is stopped in the touched state, the moving image is temporarily stopped at that position.

  As described with reference to FIG. 5, when a sliding operation is performed by moving a finger in a direction opposite to the moving direction of the specific subject, the moving image playback (reverse operation) is performed such that the specific subject moves in the direction opposite to the moving direction. Playback).

  In addition, when the user releases the finger in the state shown in FIG. 6B, the reproduction of the moving image is started from the image shown in FIG.

  The specific subject can be designated by the user. FIG. 7 is a diagram for explaining an example of a designation method when a user designates a specific subject. The user touches the touch panel with a finger, and performs an operation of surrounding the subject to be designated as the main subject among the three subjects with the finger. A dotted line 71 shown in FIG. 7 indicates that an operation of surrounding with a finger has been performed. The trajectory generation unit 112 of the control unit 11 specifies a specific subject based on the detection result of the operation detection unit 113.

  However, the method for the user to specify the specific subject is not limited to the method shown in FIG. For example, a subject directly touched with a finger may be specified as a specific subject.

  Here, in the above description, it is assumed that the shooting angle of view at the time of moving image shooting hardly changes. However, the specific subject can be specified even if the shooting angle of view changes.

  FIG. 8 is a diagram for explaining a method of specifying a specific subject when the shooting angle of view changes. FIG. 8A shows an image at a playback time of 0 second, that is, at the start of moving image shooting. FIG. 8B is an image with a playback time of 15 seconds, and FIG. 8C is an image with a playback time of 30 seconds. As shown in FIG. 8A, FIG. 8B, and FIG. 8C, as the shooting time advances, the zoom-in is performed to enlarge the specific subject.

  Even when the shooting angle of view changes, the specific subject can be specified by a known method based on the shape and color of the subject on the image. In the example illustrated in FIG. 8, for example, the specific subject 81 is specified based on the shape and color of the road 82 and the shape and color of the specific subject 81. The background also changes from the start to the end of shooting due to the change in the shooting angle of view, but the interrelationship of the background is determined from the shape and color of the background. For example, by determining that the roads 82 (A) and (C) in FIG. 8 are the same road, the mutual relationship (A) → (B) → (C) is determined. In this way, even when the vicinity of the lower right corner is designated in the image of FIG. 8A, the designated position is a position corresponding to a position near the center in the image of FIG. 8C. decide.

  In the above description, the position (designated position) designated by the user is “position in the image currently displayed on the display unit”, but the designated position is “physical position on the display unit”. It is good. In other words, if the shooting angle of view is almost constant, there is no difference between the “position on the image currently displayed on the display” and the “physical position on the display”. Of course, they change when they change.

  That is, when the lower right corner of the display unit screen is designated, in the examples so far, the “lower right corner position of the image at the designated time point” is set as the designated position, and the specific image search unit 114 specifies “specified. The image in which the specific subject exists at the “lower right corner position of the image at the time” is searched.

  On the other hand, when the designated position is “physical position on the display unit”, the specific image search unit 114 searches for an image in which the specific subject exists in the lower right corner position of the screen of the display unit. To do. Which method should be adopted as the designated position may be selected in advance.

  FIG. 9 is a flowchart performed by the digital camera 1 according to the first embodiment. When the digital camera 1 is set to a reproduction mode for reproducing a moving image, the control unit 11 reads out moving image data to be reproduced from the image storage unit 23 and starts a moving image reproduction process.

  In step S11, it is determined whether or not the digital camera 1 is set to the direct operation mode. If it is determined that the digital camera 1 is not set to the direct operation mode, the process proceeds to step S12, normal moving image reproduction is performed, and the process returns to step S11. On the other hand, if it is determined that the digital camera 1 is set to the direct operation mode, the process proceeds to step S13.

  In step S13, the locus generation unit 112 identifies a moving subject in the moving image, and sets this subject as the specific subject. As described with reference to FIG. 7, when a specific subject is designated by the user, the designated subject is set as the specific subject. Further, when the movement trajectory data of the specific subject is stored in the image storage unit 23, the subject is set as the specific subject.

  In step S <b> 14, it is determined whether or not the movement trajectory data of the specific subject is stored in the image storage unit 23. If it is determined that the movement track data of the specific subject is stored in the image storage unit 23, the process proceeds to step S15. In step S15, the moving trajectory data of the specific subject is read from the image storage unit 23 together with the moving image data to be reproduced, and the moving image is reproduced and displayed together with the moving trajectory of the specific subject.

  On the other hand, if it is determined in step S14 that the movement trajectory data of the specific subject is not stored in the image storage unit 23, the process proceeds to step S16. In step S16, the trajectory generation unit 112 creates a movement trajectory of the specific subject according to the reproduction of the moving image.

  In step S17, the moving image data to be reproduced is read from the image storage unit 23, and the read moving image is reproduced and displayed together with the movement locus created by the locus generating unit 112.

  In step S <b> 18, the operation detection unit 113 determines whether a touch operation on the touch panel 14 has been performed. If it determines with the touch operation of the touch panel 14 not being performed, it will return to step S11, and if it determines with the touch operation having been performed, it will progress to step S19.

  In step S <b> 19, the specific image search unit 114 determines whether or not a specific subject exists in the vicinity of the position touched by the user in the image currently displayed on the display unit 19. The vicinity of the touched position is within a predetermined range centered on the touched position. The predetermined range is a circle whose radius is, for example, about 5% to 10% of the horizontal width of the screen. If it is determined that the specific subject exists in the vicinity of the touched position, the process proceeds to step S20.

  In step S20, the operation detection unit 113 determines whether or not the touch position of the touch panel 14 has moved. If it is determined that the touch position has not moved, the process stands by in step S20. If it is determined that the touch position has moved, the process proceeds to step S21.

  In step S21, the operation detection unit 113 detects the position to which the touch position is moved.

  In step S22, the specific image search unit 114 searches for an image in which the specific subject exists in the vicinity of the movement position detected in step S21, from a series of images constituting the moving image being reproduced. The vicinity of the moving position is within a predetermined range centered on the moving position.

  In step S23, the image searched in step S22 is displayed on the display unit 19.

  In step S <b> 24, the operation detection unit 113 determines whether the touch operation on the touch panel 14 has ended. If it is determined that the touch operation has not ended, the process returns to step S20. If it is determined that the touch operation has ended, the process proceeds to step S25. If the movement is stopped while being touched after the start of the touch operation, the moving image is temporarily stopped at that position.

  On the other hand, if it is determined in step S19 that the specific subject does not exist in the vicinity of the touched position when the touch is made, the process proceeds to step S27. In step S27, it is determined whether or not the touch position of the touch panel 14 is in the vicinity of the movement locus of the specific subject. The vicinity of the movement locus is within a predetermined range from the movement locus. The predetermined range is a range having a constant width centered on the movement trajectory, and the constant width is, for example, a value of about 5% to 10% of the horizontal width of the screen. If it is determined that the touch position is near the movement locus of the specific subject, the process proceeds to step S28.

  In step S <b> 28, the specific image search unit 114 searches for an image in which the specific subject exists near the touch position of the touch panel 14 from a series of images constituting the moving image being reproduced.

  In step S29, the image searched in step S28 is displayed on the display unit 19.

  On the other hand, if it is determined in step S27 that the touch position is not near the movement locus of the specific subject, the process proceeds to step S30. In step S30, the touch operation on the touch panel 14 by the user is invalidated, and the process proceeds to step S25.

  In step S25, it is determined whether or not an operation for ending reproduction of the moving image has been performed. For example, when the user performs a power-off operation or a photographing operation, it is determined that a reproduction end operation has been performed, and the process of the flowchart ends. On the other hand, when it is determined that the operation for ending the reproduction of the moving image is not performed, the process returns to step S14.

  As described above, according to the digital camera of the first embodiment, when the touch operation by the user is a movement operation along the movement of the moving subject in the moving image, the subject moves in conjunction with the moving operation. Control playback of moving images. Thereby, the user can freely move the moving object in the moving image at an arbitrary desired speed. In addition, since the moving speed of the subject can be controlled by a touch operation on the touch panel 14 instead of an operation by a fast-forward button or a slow playback button, the moving speed of the subject can be controlled by an intuitive operation. Furthermore, since the moving speed of the subject is controlled by a touch operation on the touch panel 14, the moving subject can be easily stopped at an arbitrary position.

  Further, when the moving operation is in the direction opposite to the moving direction of the subject at the time of moving image reproduction, the backward reproduction of the moving image is controlled so that the subject moves in conjunction with the moving operation. Thereby, the subject in the moving image can be freely moved in the reverse direction at any desired speed.

  In particular, since it is determined whether or not the touch operation is a movement operation based on a touch operation within a predetermined range from the movement trajectory of the moving subject in the moving image, the user closely matches the movement trajectory of the subject. There is no need to perform a touch operation, which is very convenient.

  Further, when the touch position of the touch operation is not the position of the subject displayed on the display unit 19 and is within a predetermined range from the movement locus of the subject, the subject is located near the touch position of the touch operation. Control to play video from existing images. Thereby, it is possible to reproduce a moving image from an image existing at a position where the subject desires.

  Furthermore, since the movement trajectory of the moving subject in the moving image is created and the created moving trajectory is superimposed on the moving image and displayed on the display unit 19, the user can easily perform a moving operation along the movement of the subject. be able to.

  In particular, from among a plurality of images constituting a moving image, an image in which a moving subject exists in the moving image near the touch position of the touch operation is searched, and reproduction of the moving image is controlled using the searched image. Therefore, it is possible to accurately control the playback of a moving image linked with the touch operation.

  In the above description, the trajectory generation unit 112 has been described as creating a movement trajectory of a specific subject during video reproduction, but the present invention is not limited to this. For example, at the time of shooting a moving image, a specific subject may be determined, a movement locus may be created, and recorded together with moving image data.

  Further, the operation input member is not limited to the touch panel. Since it is only necessary to be able to trace the movement locus, for example, a touch pad or a mouse can be used.

-Second Embodiment-
FIG. 10 is a diagram illustrating a detailed configuration of the control unit 11A of the digital camera according to the second embodiment. The configuration other than the control unit 11A is the same as that of the digital camera in the first embodiment.

  The control unit 11A includes a reproduction control unit 111, a trajectory generation unit 112, an operation detection unit 113, a specific image search unit 114, and a speed setting unit 115.

  In addition to the functions described in the first embodiment, the trajectory generation unit 112 obtains the moving speed V0 of the specific subject at the time of moving image reproduction when creating the moving trajectory of the specific subject. The moving speed V0 is not the actual moving speed of the specific subject but the moving speed on the image.

  The operation detection unit 113 detects the touch operation of the touch panel 14 by the user, and detects the speed Vf of the user's finger moving on the touch panel based on the touch operation.

  The speed setting unit 115 calculates a speed ratio Vf / V0 based on the finger moving speed Vf detected by the operation detecting unit 113 and the moving speed V0 of the specific subject obtained by the trajectory generating unit 112. The calculated speed ratio Vf / V0 is set as the moving image reproduction speed magnification.

  The playback control unit 111 controls the playback (playback speed) of the moving image according to the playback speed magnification set by the speed setting unit 115. For example, when the reproduction speed magnification is 2, the moving image is reproduced at the double speed. A known method can be used as a specific method for reproducing a moving image at an arbitrary reproduction speed magnification. For example, in the case of a moving image recorded at 60 frames / second, when reproducing a moving image at double speed, every other frame image of 60 frames / second, which is a basic frame, is thinned out to obtain a moving image of 30 frames / second. As a result, the double speed can be realized. As another method, double speed can be realized by increasing the number of frames to be displayed per second and creating and playing a moving image of 120 frames / second.

  FIG. 11 is a diagram for describing moving image reproduction control according to the second embodiment. FIG. 11A shows an image showing the position of the moving subject at intervals of 3 seconds (corresponding to the positions p5, p6, p7, p8, and p9 in FIG. 2C). The moving speed of the finger detected by the operation detection unit 113 is assumed to be Vf. It is assumed that the finger is moved at a constant speed Vf.

  FIG. 11B is a diagram showing the relationship between the moving speed V0 of the subject on the screen and the moving speed Vf of the finger. The moving speed V0 of the subject indicates the moving speed on the screen during normal playback of a moving image. That is, even if the subject actually moves at a constant speed, if the subject is far away, the speed on the screen becomes slow. FIG. 11C is a diagram illustrating the moving speed of the subject on the screen, which is changed according to the finger operation by the user.

As described above, the playback control unit 111 sets the ratio Vf / V0 between the moving speed Vf of the finger detected by the operation detecting unit 113 and the moving speed V0 of the specific subject on the moving image to the moving image playback speed magnification. Set. In the moving image reproduced at the reproduction speed magnification Vf / V0, the moving speed V0 ′ of the subject on the screen becomes equal to the moving speed Vf of the finger as will be described in the following equation (1).
V0 ′ = V0 × (Vf / V0) = Vf (1)

  As shown in FIG. 11C, in actual control, a slight time delay T1 occurs in the change in the image reproduction speed with respect to the finger sliding operation. That is, the moving speed of the subject is changed from V0 to Vf after time T1 from the start of the finger sliding operation, and the moving speed of the subject is changed from Vf to V0 after time T1 from the end of the finger sliding operation. Is done. In the above, for the sake of simplicity, the finger movement speed Vf is constant. However, when the finger movement speed Vf changes, the image reproduction speed V0 ′ is also continuously adjusted in accordance with the change. To change.

  FIG. 12 is a flowchart performed by the digital camera 1 in the second embodiment. Steps for performing the same processing as the processing in the flowchart shown in FIG. 9 are denoted by the same reference numerals, and detailed description thereof is omitted. The flowchart shown in FIG. 12 is different from the flowchart shown in FIG. 9 in that the processing from step S41 to step S43 is provided instead of the processing from step S21 to step S23.

  If the determination in step S20 is affirmative, the process proceeds to step S41. In step S41, the operation detection unit 113 detects the moving speed Vf of the finger moving on the touch panel 14.

  In step S42, the speed setting unit 115 calculates the speed ratio Vf / V0 based on the finger moving speed Vf detected by the operation detecting unit 113 and the moving speed V0 of the specific subject on the moving image.

  In step S43, the reproduction control unit 111 controls the reproduction (reproduction speed) of the moving image according to the reproduction speed magnification Vf / V0 set by the speed setting unit 115. As in the first embodiment, after the touch operation starts moving, if the movement is stopped while being touched, the moving image is temporarily stopped at that position.

  As described above, also in the digital camera according to the second embodiment, the user can freely move a subject moving in a moving image at a desired arbitrary speed.

  In particular, according to the digital camera in the second embodiment, the moving speed of the touch operation is detected, and the moving image playback speed is set so that the moving speed of the subject in the moving image corresponds to the moving speed of the touch operation. Then, playback of the moving image is controlled at the set playback speed. Thereby, the reproduction control of the moving image interlocked with the touch operation can be performed with high accuracy.

  In addition, for the reproduction control of the moving image, the method according to the second embodiment for controlling the reproduction speed according to the detected sliding speed of the finger, and the first method for continuously searching and displaying the image according to the touch position. The accuracy and speed may be further improved by using the method according to the embodiment together. That is, when the finger moving speed is fast or the moving amount is large, the method according to the second embodiment is used. Conversely, when the finger moving speed or the moving amount is small, the method according to the first embodiment is used. Use the method.

  In the description of the first and second embodiments described above, hardware processing is assumed as processing performed by the digital camera. However, the present invention is not limited to such a configuration. For example, it may be configured to perform software processing on a computer. In this case, the computer includes a main storage device such as a CPU and a RAM, and a computer-readable storage medium storing a program for realizing all or part of the above processing. Here, this program is called a moving image reproduction program. Then, the CPU reads out the moving image reproduction program stored in the storage medium and executes information processing / calculation processing, thereby realizing processing similar to that of the digital camera described above.

  Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, and the like. Further, the moving image reproduction program may be distributed to a computer via a communication line, and the computer that has received the distribution may execute the moving image reproduction program.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment.

  In the embodiment described above, the camera equipped with the playback device has been described as a digital camera. However, as long as the camera or playback device has a video playback function, a video camera or movie camera may be used, and a mobile phone or portable information terminal may be used. (PDA: Personal Digital Assist), a game machine, a photo stand, or the like may be used.

DESCRIPTION OF SYMBOLS 11 ... Control part 14 ... Touch panel 19 ... Display part 111 ... Reproduction control part 112 ... Trajectory generation part 113 ... Operation detection part 114 ... Specific image search part 115 ... Speed setting part

Claims (9)

A playback control unit for controlling playback of moving images;
A display unit for displaying a moving image to be reproduced;
A touch panel unit disposed so as to overlap the display unit;
An operation detection unit for detecting a touch operation on the touch panel unit;
With
If the reproduction control unit determines that the touch operation detected by the operation detection unit is a movement operation along the movement of the moving subject in the moving image, the subject moves so as to move in conjunction with the moving operation. To control the playback of the moving image,
A reproducing apparatus characterized by that. When the playback control unit determines that the moving operation is in the direction opposite to the moving direction of the subject during moving image playback, the moving image is played back in the reverse direction so that the subject moves in conjunction with the moving operation. To control the
The reproducing apparatus according to claim 1. The reproduction control unit determines that the touch operation is the moving operation when the touch position of the touch operation is in the vicinity of a moving locus of a subject moving in the moving image.
The reproducing apparatus according to claim 1 or 2, wherein When the touch position of the touch operation is in the vicinity of the movement locus of the subject and the subject is not touched in the touch position of the touch operation in the image at the time when the touch operation is performed, Control to play a video from an image in which the subject is present near the touch position of the operation,
The playback apparatus according to claim 3. A trajectory generator for creating a trajectory of a subject moving in the moving image;
The reproduction control unit superimposes the movement trajectory created by the trajectory generation unit on a moving image and causes the display unit to display the movement trajectory.
The reproduction apparatus according to claim 1, wherein the reproduction apparatus is a reproduction apparatus. A specific image search unit for searching an image in which a moving subject exists in the moving image in the vicinity of the touch position of the touch operation detected by the operation detection unit from a plurality of images constituting the moving image; ,
The reproduction control unit controls reproduction of a moving image using the image searched by the specific image search unit;
The playback apparatus according to claim 1, wherein the playback apparatus is configured as described above. The operation detection unit detects a moving speed of the detected touch operation,
The playback device
A speed setting unit that sets a playback speed of the moving image so that the moving speed of the subject in the moving image corresponds to the moving speed of the touch operation;
The reproduction control unit controls reproduction of the moving image at a reproduction speed set by the speed setting unit;
The reproducing apparatus according to any one of claims 1 to 6, wherein the reproducing apparatus is characterized in that An imaging unit that generates moving image data by imaging;
A playback device according to any one of claims 1 to 7,
An imaging apparatus comprising: Detecting a touch operation on a touch panel arranged to overlap a display unit that displays a moving image;
Determining whether the detected touch operation is a movement operation along with movement of a subject moving in a moving image;
Controlling the reproduction of the moving image so that the subject moves in conjunction with the moving operation when it is determined that the touch operation is a moving operation along the movement of the subject;
A video playback program that causes a computer to execute.