JP5534858B2 - Display control device and control method of display control device - Google Patents

Description

The present invention relates to a display control device, a control method for a display control device , a program, and a recording medium, and more particularly to a technique suitable for use in operating a touch panel or the like.

  Generally, in a personal computer, when copying an object such as a file displayed on a screen, a target object is instructed using a mouse, and copy and paste operations are performed. It is also possible to perform copy and paste operations using both input using a keyboard and operations using a mouse.

  Some recent digital video cameras are equipped with an editing function for cutting out a part of a moving image recorded on a recording medium into a new moving image or cutting out one frame of a moving image into a still image. When a certain range is cut out from one moving image, it is necessary to instruct the moving image to have two editing points, an IN point that is a starting point for editing the moving image and an OUT point that is an ending point for editing the moving image. In addition, when a still image is cut out from a moving image, it is necessary to specify a cutting point for a desired scene of the moving image.

  However, when editing is performed with a digital video camera that fits in such a hand, a series of button operations is troublesome. Therefore, a method has been proposed in which a digital video camera is equipped with a touch panel and is operated using the movement of a finger on the touch panel so that the user can easily perform the operation. For example, Patent Document 1 discloses a technique related to finger movement on a touch panel and a response of the system. According to the technique described in Patent Document 1, the operation of the system can be changed according to the distance between the fingers on the touch panel.

JP 2001-228971 A

  However, Patent Document 1 describes the operation of the system when the touch panel is touched with a plurality of fingers, but is not a technique specifically assuming a moving image copy operation or a still image clipping. For this reason, there is a problem in that it is not possible to perform a moving image copy operation or a still image cut-out on the touch panel, and operability is insufficient.

  The present invention has been made in view of the above-described problems, and an object thereof is to make it possible to easily perform an operation of copying a moving image or cutting out a still image on a touch panel.

The display control device of the present invention includes a display control unit that controls to display a display object representing content data on a display unit, a detection unit that detects a touch position on the display unit, and a single unit displayed on the display unit. A determination unit that determines whether or not two touch positions are detected by the detection unit in one display object, and a determination that two touch positions are detected in a single display object by the determination unit when, in the case where the touch position while touching moves in the first direction, the distance of the first direction between the two points touch position after the movement exceeds a predetermined distance, the display There line control for recording the duplicate to a recording medium the content data object represents, when the touch position while touching is moved in the second direction, after movement A number of frame images corresponding to the distance between the touch positions are extracted from the content data represented by the display object, and the extracted frame images are displayed between the two touch positions after the movement. And a control means.

  ADVANTAGE OF THE INVENTION According to this invention, operation which copies all or a part of a moving image by an operation on a touch panel, or cuts out as a still image can be performed easily.

It is a block diagram which shows the structural example of the digital camera which concerns on embodiment. It is a perspective view which shows the external appearance structural example of the digital camera which concerns on embodiment. It is a figure which shows the example of a display of the moving image object in embodiment. It is a figure which shows the relationship between the frame image selected and a moving image. It is a flowchart which shows an example of the process sequence which detects a finger | toe. It is a flowchart which shows an example of the process sequence regarding operation with two fingers. It is a flowchart which shows an example of the process sequence regarding operation with three fingers. It is a figure which shows an example of the procedure which copies a moving image object. It is a figure which shows an example of the procedure which copies the designated range in a moving image content. It is a figure which shows an example of a display when copying cannot be performed. It is a figure which shows the example of a display which increases the moving image object of a timeline. It is a figure which shows the other example of a display which increases the moving image object of a timeline. It is a figure which shows the example of a display which reduces the moving image object of a timeline. It is a figure showing an example of a method of combining a plurality of animation objects. It is a figure which shows an example of the display effect at the time of combining a moving image object. It is a figure which shows the example of a display when a moving image object cannot be combined.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration example of a digital camera 101 according to the present embodiment.
In FIG. 1, a digital camera 101 can shoot and reproduce moving images and still images. The touch panel unit 102 includes a display unit 103 such as an LED and an operation unit 104 that converts a user's touch operation into an input signal. The display unit 103 displays a moving image shot by the digital camera 101 or displays an instruction button for the user. Also, information regarding the digital camera 101, the remaining capacity of the recording medium 120, and the like are displayed. The operation unit 104 receives a user instruction from a button or the like displayed on the display unit 103.

  The video input unit 105 captures a subject and inputs a video signal when shooting with the digital camera 101. The frame image extraction unit 106 generates a frame image at a time position designated by a user or the like from a moving image recorded on the recording medium 120. The synthesizing unit 107 functions as a display control unit, and synthesizes character information displayed on the display unit 103 of the touch panel unit 102, an image, a frame image generated by the frame image extracting unit 106, and the like, and displays them on the display unit 103. is there. The decoding unit 108 decodes moving image data and still image data recorded on the recording medium 120. The encoding unit 109 encodes the video signal input from the video input unit 105 when recording a moving image.

  The graphic unit 110 generates an image for displaying various information of the digital camera 101 on the display unit 103. For example, an image in which information such as a clock, a remaining battery capacity, a remaining recording medium capacity, and the number of recorded moving images is graphically generated is generated. The recording medium access unit 111 is an interface for recording moving image data on the recording medium 120 when recording a moving image, and reproducing moving image data from the recording medium 120 when reproducing the moving image. The database unit 112 holds information related to moving image data recorded on the recording medium 120.

  The touch state detection unit 113 detects how many fingers of the user are touching the touch panel unit 102, where they are touching, and the like. The overall control unit 114 is connected to each block of the digital camera basic unit 115 and appropriately controls according to operations during recording and reproduction. Note that the processing of the flowchart described below is performed by developing a program recorded in the ROM 122 on the RAM 123 and executing it by the CPU 121 to control each unit of the digital camera 101. The recording medium 120 is a detachable recording medium.

FIG. 2 is a perspective view showing an external configuration example of the digital camera 101 according to the present embodiment. 2A and 2B show the appearance of one digital camera viewed from different angles.
In FIG. 2, the housing 201 of the digital camera 101 is provided with an insertion port 202 for the recording medium 120, and the recording medium 120 is inserted through the insertion port 202. The power button 203 is a button for turning on or off the main power of the digital camera 101. The lens 204 is a lens barrel portion of the digital camera 101. The touch panel 205 serves as both a display unit and an operation unit, and all operations such as recording / playback instructions and editing instructions are performed on the touch panel 205.

FIG. 3 is a diagram illustrating a display example of a moving image object as a display object in the present embodiment. Here, the moving image object is a set of frame images displayed in one index.
In FIG. 3, on the display screen 310 of the touch panel 205, a moving image object or a still image object is displayed in an index. In the display example of FIG. 3, the index is arranged in a display space having a wide left and right, a part is cut out and displayed on the display screen 310, an old object is displayed on the left, and a new object is displayed on the right. doing.

  The entire bar 311 represents the entire display space as a bar. The area bar 312 is a bar that represents an area that is actually displayed on the display screen 310 in the display space. An index 313 represents, for example, an index of a moving image object, and a plurality of frame images can be displayed as the moving image object. The frame image is displayed so as to be surrounded by a black frame. Further, the time position from the beginning of the moving image object is added and displayed at the lower right of each frame image.

  The example of the moving image index shown in FIG. 3 is an object of about 15 seconds, and the moving image object index 313 is composed of a frame image of 0 second and a frame image of 15 second. The still image object 314 is displayed without a black frame in order to distinguish it from the frame image. The user can determine whether the object is a still image object or a moving image object based on the presence or absence of the black frame. In the present embodiment, since the timeline display of the moving image object will be described in detail, the display method of the still image is omitted. A display 315 represents an overview of the shooting time of the currently displayed index, and a bar 316 represents the start of the date.

Next, a frame image extraction method will be described with reference to FIG. FIG. 4 is a diagram illustrating a relationship between a selected frame image and a moving image.
The example shown in FIG. 4A is a moving image having a playback time of 60 seconds. In this case, when an operation of a finger on the touch panel 205 indicates that the frame index is represented using three frame images, 0, 30, 60 so that the time interval is the same from the 60-second moving image. Extract the second frame image.

  Also, the example shown in FIG. 4B is a moving image with a playback time of 240 seconds. When using three frame images, the frame images at 0, 120, and 240 seconds are extracted as in the example shown in FIG. As described above, when the playback time of the moving image is different, the position of the frame image to be extracted is determined by equally dividing the entire moving image according to the number of displayed frame images.

  Further, the example shown in FIG. 4C is a moving image having a reproduction time of 2 seconds. Also in this case, frame images at 0, 1, and 2 seconds are extracted. The 0th second is the starting point of the moving image, and the first second is a point one second after the starting point of the moving image. The second second is a point two seconds after the starting point of the moving image, and becomes the final image of the moving image. In the present embodiment, the interval between frame images is set to a minimum of one second, and a maximum of three frame images can be displayed.

  Next, the relationship between the finger movement on the touch panel 205 and the system sequence will be described with reference to the flowcharts of FIGS. 5 to 7 is realized by the CPU 121 developing the program recorded in the ROM 122 on the RAM 123 and executing the program.

FIG. 5 is a flowchart illustrating an example of a processing procedure for detecting a finger in the present embodiment.
First, finger detection processing is started in step S501 in FIG. In step S502, the touch state detection unit 113 determines whether or not a first finger touch is detected. In the present embodiment, a touch on one point on the touch panel 205 is referred to as a first finger touch. If any contact (touch) is simultaneously detected at one place (one point) on the touch panel 205 regardless of whether or not it is actually a finger, the determination result in step S502 is set to Yes.

  As a result of the determination in step S502, if the first finger touch is not detected, the process proceeds to step S503. In step S503, the overall control unit 114 determines whether to end a series of finger detection operations. Here, a case where a series of finger detection operations is terminated includes a case where the power of the digital camera 101 is turned off, or a case where an instruction is given to shift to another mode such as a shooting mode. As a result of this determination, if the series of finger detection operations is to be terminated, the process proceeds to step S512, and the process is terminated as it is. On the other hand, if the result of determination in step S503 is to continue processing, processing returns to step S502.

  On the other hand, if the first finger touch is detected as a result of the determination in step S502, the process proceeds to step S503. In step S504, processing related to one finger is performed under the control of the overall control unit 114. Here, the process related to one finger is an operation such as selecting an object indicated by the finger on the screen. Next, in step S505, the touch state detection unit 113 determines whether the touch of the second finger is detected while the touch of the first finger is continued. This case is also referred to as the second finger touch, but when any contact (touch) is detected at two locations (two points) on the touch panel 205 at the same time, regardless of whether or not it is actually a finger. The determination result in step S505 is set to Yes.

  As a result of the determination in step S505, if the second finger is not detected, the process proceeds to step S506. In step S <b> 506, the touch state detection unit 113 determines whether all fingers have been removed from the touch panel 205. As a result of the determination, if all the fingers are separated from the touch panel 205, the process proceeds to step S503. If there is a finger that is not separated from the touch panel 205, the process returns to step S504.

  On the other hand, if the second finger is detected as a result of the determination in step S505, the process proceeds to step S507. In step S507, processing related to an operation with two fingers is performed. The process related to the operation with the two fingers will be described later with reference to FIG. Next, in step S508, the touch state detection unit 113 determines whether the third finger has been detected while the first and second fingers are continuously touched. This case is also referred to as the third finger touch, but when any contact (touch) is detected at three points (three points) on the touch panel 205 at the same time, regardless of whether or not it is actually a finger. The determination result in step S508 is Yes.

  As a result of the determination in step S508, if the third finger is not detected, the process proceeds to step S509. In step S509, the touch state detection unit 113 identifies the number of detected fingers and determines whether the number is reduced from two to one. As a result of this determination, if the number is reduced to one, the process proceeds to step S506, and if the number of fingers is not decreased, the process returns to step S507.

  On the other hand, as a result of the determination in step S508, if the third finger is detected, the process proceeds to step S510. In step S510, a process related to three fingers is performed. The process related to these three fingers will be described later with reference to FIG. Next, in step S511, the touch state detection unit 113 identifies the number of detected fingers, and determines whether or not the number is decreased from three to two. As a result of this determination, if the number is reduced to two, the process proceeds to step S509, and if the number of fingers is not decreased, the process returns to step S510. As described above, in the present embodiment, the operation is performed while changing the process according to the number of detected fingers.

FIG. 6 is a flowchart showing an example of a detailed processing procedure regarding the operation with two fingers in step S507 of FIG.
First, in step S601, the touch state detection unit 113 functions as a first determination unit, and determines whether the detected two-finger touches are touching the same moving image object. To do. In this process, when the moving image object is composed of a plurality of frame images, it is determined whether or not two fingers are touching any of these frame images. If the same moving image object is touched as a result of the determination, the process proceeds to step S602. If the same moving image object is not touched, the process proceeds to step S611.

  In step S602, the touch state detection unit 113 determines whether or not the touch position has been moved without releasing the detected touch of the two fingers. As a result of the determination, if the touch position has been moved, the process proceeds to step S603. If the touch position has not been moved, the process is terminated, the process of FIG. 6 is terminated, and the process proceeds to step S508 of FIG.

  In step S603, it is determined whether or not the touch positions of the two fingers are separated in the vertical direction by the movement determined in step S602. Here, the horizontal direction of the touch panel 205 is the left-right direction on the display screen (the direction in which frame images are arranged on the timeline of the moving image object), and the vertical direction is the up-down direction on the display screen (the direction in which frame images on the timeline are arranged). In a direction perpendicular to In this process, based on detection by the touch state detection unit 113, the CPU 121 of the overall control unit 114 determines that the vertical direction is the y axis and the horizontal direction is the x axis. That is, in step S603, it is determined whether or not the touch position of the two fingers has moved away in the y direction due to the movement, and if the touch position is separated by a predetermined threshold (this threshold is referred to as threshold A) in the y direction, It is determined that the position has moved away in the y direction due to the movement. If the result of this determination is that there is a separation in the y direction, the process proceeds to step S604, and if there is no separation in the y direction, the process proceeds to step S607.

  In step S604, under the control of the overall control unit 114, the synthesizing unit 107 increases the single moving image object that has been touched with two fingers to two, and moves to a position that follows the touch position of the two fingers. Are displayed on the touch panel 205. Here, when the distance between the touch positions of two fingers is short to some extent, two moving image objects are superimposed and displayed. A display example at this time is shown in FIG. 8, and details of FIG. 8 will be described later.

  Next, in step S605, the overall control unit 114 functions as a second determination unit based on the detection by the touch state detection unit 113, and the vertical positions of the two positions after being touched by two fingers are moved. It is determined whether or not the distance is equal to or greater than a threshold value B (a predetermined value or greater). As a result of the determination, if the threshold value B is equal to or greater than the threshold value B, the process proceeds to step S606, and if it is less than the threshold value B, the process ends, and the process proceeds to step S508 in FIG.

  In step S606, the actual moving image data indicated by the moving image object touched with two fingers is copied. That is, the recording medium access unit 111 duplicates and records the moving image data indicated by the moving image object touched in step S601 on the recording medium 120. At this time, the moving image data to be copied is the entire range of the moving image before copying. In this way, by simply touching the same moving image object with two fingers and spreading the two touched fingers vertically, the moving image data indicated by the moving image object touched by the user can be easily copied. Can do. Then, when the process of step S606 ends, the process ends, and the process proceeds to step S508 in FIG.

  On the other hand, in step S607, based on the detection by the touch state detection unit 113, the overall control unit 114 expands the touch position of the two fingers in the horizontal direction (x direction) before the movement by the movement determined in step S602. It is determined whether or not. At this time, it is determined that the touch position has spread in the x direction due to the movement when the distance is a predetermined threshold (this threshold is referred to as threshold C) in the x direction. If the result of this determination is that it has spread in the horizontal direction, processing proceeds to step S608, and if it has not spread in the horizontal direction, processing proceeds to step S609.

  In step S608, the number of frame images to be displayed on the timeline is determined according to the lateral distance between the two fingers under the control of the overall control unit 114. Then, the frame image extraction unit 106 extracts the determined number of frame images from the moving image data indicated by the moving image object that is touched, and the combining unit 107 displays them on the touch panel 205 in the x direction. At this time, when two or more frame images are displayed on the timeline of the moving image object and the frame images touched by two fingers are different, a frame image between the two touched frame images is displayed. It shall be displayed. In addition, when only one frame image is displayed on the timeline of the moving image object, a frame image between the first frame and the last frame of the moving image data indicated by the moving image object is extracted. That is, the user can touch the same moving image object with two fingers and spread the two touched fingers to the left and right to display the timeline display of the desired range of the moving image desired by the user in more detail. You can switch to something. A display example at this time is shown in FIG. 11, and details of FIG. 11 will be described later. Then, when the process of step S608 ends, the process ends, and the process proceeds to step S508 of FIG.

  On the other hand, in step S609, based on the detection by the touch state detection unit 113, the overall control unit 114 narrows the touch position of the two fingers in the horizontal direction (x direction) from before the movement by the movement determined in step S602. It is determined whether or not. If the result of this determination is that it has narrowed in the horizontal direction, processing proceeds to step S610, and if it has not narrowed in the horizontal direction, processing is terminated, and processing proceeds to step S508 in FIG.

  In step S610, the number of frame images to be displayed on the timeline is reduced according to the lateral distance between the two fingers under the control of the overall control unit 114, and the moving image touched by the combining unit 107 Narrow the horizontal display area of the object. More specifically, the number of frame images to be displayed on the timeline is determined according to the lateral distance between two fingers, and the moving image object touched indicates the determined number of frame images. Extract from video data and display side by side in the x direction. At this time, since the distance in the horizontal direction between the two fingers is narrowed, the number of frame images extracted as a result is reduced compared to before the number of frame images is narrowed.

  Here, before the distance between two touching fingers is reduced, three or more frame images are displayed on the timeline of the touching moving image object, and the frame image touched with two fingers. May be different. In this case, it is assumed that only the frame image between the two touched frame images decreases as the distance between the two fingers in the lateral direction is reduced. This makes it easier to display the timeline of the desired range of the desired video by simply touching the same video object with two fingers and narrowing the two touched fingers to the left and right. The display area can be narrowed by switching to a new one. A display example at this time is shown in FIG. Details of FIG. 13 will be described later. When the process in step S610 is completed, the process ends, and the process proceeds to step S508 in FIG.

  On the other hand, in step S611, the touch state detection unit 113 determines whether the two detected fingers are touching different moving image objects. As a result of the determination, if a different moving image object is touched, the process proceeds to step S612. If a different moving image object is not touched, the process ends, and the process proceeds to step S508 in FIG.

  In step S612, the touch state detection unit 113 determines whether or not the touch position has been moved without releasing the detected touch of the two fingers. As a result of the determination, if the touch position has been moved, the process proceeds to step S613. If the touch position has not been moved, the process ends, and the process proceeds to S508 in FIG.

  In step S613, under the control of the overall control unit 114, the composition unit 107 moves the display position of the touched moving image object following the movement of the finger touch position. That is, it accepts a drag of a moving image object.

  Next, in step S614, based on the detection by the touch state detection unit 113, the overall control unit 114 determines whether or not the distance between the touch positions of the two fingers is equal to or less than the threshold value D due to the movement of the finger. To do. As a result of this determination, if the threshold value D is less than or equal to the threshold value D, the process proceeds to step S615.

  In step S615, moving image data indicated by two different moving image objects touched with two fingers is combined under the control of the overall control unit 114. At this time, on the touch panel 205, based on the display position of the two moving image objects, the other moving image object is combined with the other moving image object and displayed as one timeline by the combining unit 107. To do. Actually, one combined that can be played back continuously so that the first frame of the moving image of the other moving image object follows the last frame of the moving image indicated by the moving image object positioned to the left of the other in the x direction. Create new video data. Then, the moving image data newly generated by the recording medium access unit 111 is recorded on the recording medium 120. As a result, a desired moving image can be easily combined in a desired order simply by performing an operation of simultaneously touching and moving the moving image objects to be combined with each other from among the displayed moving image objects. Also, display examples at this time are shown in FIGS. Details of FIGS. 14 to 16 will be described later. When the process of step S615 is completed as described above, the process ends, and the process proceeds to step S508 of FIG.

  By the above control, touching and operating the moving image object displayed on the touch panel 205 makes it possible to intuitively and easily perform operations such as confirmation, copying, and combining of moving image contents using the timeline. Can do.

Next, processing related to three fingers will be described with reference to FIG. FIG. 7 is a flowchart showing an example of a detailed processing procedure regarding the operation with three fingers in step S510 of FIG.
First, in step S701, processing related to an operation with three fingers is started. In step S702, the touch state detection unit 113 functions as a first determination unit, and determines whether or not the moving image objects designated by the three fingers indicate the same thing. As a result of the determination, if the same moving image object is designated, the process proceeds to step S703, and if the same moving image object is not designated, the process proceeds to step S716. In step S715, processing is performed when the moving image objects are not the same. As for the processing in this case, nothing may be performed assuming that the moving image object cannot be specified. In the present embodiment, a case where the same moving image object is specified and operated will be described, and a detailed description thereof will be omitted.

  In step S703, the touch state detection unit 113 determines whether or not the touch position has moved by monitoring the touch position (contact position) of the finger. As a result of this determination, if the touch position has moved, the process proceeds to step S704. If not, the process ends, and the process proceeds to step S511 in FIG.

  In step S704, the touch state detection unit 113 functions as a second determination unit, counts the number of moved fingers, and determines whether all three fingers have moved. As a result of the determination, if all three have moved, the process proceeds to step S714, and if there are two or less fingers, the process proceeds to step S705. In step S714, processing is performed when all three points have moved. As for the processing in this case, nothing may be performed on the assumption that it is not possible to specify how to instruct the object. In addition, in this embodiment, since three operations are not mentioned, detailed description is omitted.

  In step S705, the touch state detection unit 113 determines whether only one finger has moved as a result of the count. If only one finger is moved as a result of this determination, the process proceeds to step S709, and if two fingers are moved, the process proceeds to step S706.

  In step S706, based on the detection by the touch state detection unit 113, the overall control unit 114 determines whether the movement amount of the two fingers has exceeded the threshold value E. As a result of the determination, if the threshold value E is exceeded, the process proceeds to step S708, and if it is equal to or less than the threshold value E, the process proceeds to step S707. In step S707, under the control of the overall control unit 114, the synthesizing unit 107 separates and displays a portion corresponding to the range of the frame image designated by the two fingers. And it progresses to step S716, a process is complete | finished, and progresses to step S511 of FIG. On the other hand, in step S708, under the control of the overall control unit 114, a moving image portion corresponding to the range of the frame image designated by the two fingers is copied. And it progresses to step S716, a process is complete | finished, and progresses to step S511 of FIG.

  In step S709, based on the detection by the touch state detection unit 113, the overall control unit 114 determines whether or not the movement amount of one finger exceeds the threshold value F. As a result of the determination, if the threshold value F is exceeded, the process proceeds to step S711, and if it is equal to or less than the threshold value F, the process proceeds to step S710. In step S710, under the control of the overall control unit 114, a moving image portion corresponding to the frame image of the object designated by one point is copied. At this time, a preview display for cutting out a still image may be performed. And it progresses to step S716, a process is complete | finished, and progresses to step S511 of FIG.

  On the other hand, in step S711, it is determined by the control of the overall control unit 114 whether or not the current mode is the still image clipping mode. If the result of this determination is that it is in the still image cut-out mode, processing proceeds to step S712, and if it is in any other mode, processing proceeds to step S713. In step S712, under the control of the overall control unit 114, the frame image designated by one finger is cut out to a still image. And it progresses to step S716, a process is complete | finished, and progresses to step S511 of FIG. On the other hand, in step S713, a moving image portion corresponding to the frame image designated by one finger is copied under the control of the overall control unit 114. And it progresses to step S716, a process is complete | finished, and progresses to step S511 of FIG.

(Example of copy)
Next, an actual copying method will be described. FIG. 8 is a diagram illustrating an example of a procedure in which one moving image object is selected as a copy target from the objects displayed in the index of FIG. 3 and copying is performed in step S606 of FIG.
FIG. 8A shows an operation in which the moving image content 803 expressed by one thumbnail is touched with two fingers, that is, the thumb 801 and the index finger 802, and the interval between the two fingers is further expanded. As a result, a thumbnail 804 of the copied moving image object is displayed. Note that if the finger is released at this time, the moving image data is not copied, and the thumbnail 805 is separated when the finger is released in a state where the distance between the thumb 801 and the index finger 802 exceeds the above-described threshold value B. Is copied.

  The same applies to an index expressed by a plurality of thumbnails as shown in FIG. When a moving image object 806 made up of two thumbnails is picked up and spread by a finger, an overlapping moving image object 807 is generated, and further, a completely separated moving image object 808 is generated. At this time, the moving image data is copied.

Next, a description will be given of a case where a range is specified for copying of moving image data. FIG. 9 is a diagram showing an example of a procedure for copying a specified range from the moving image content using three fingers.
FIG. 9A shows an example in which a part of a moving image object composed of a plurality of thumbnails is selected and cut out as a still image or a part of a moving image is copied in steps S710, S712, and S713 in FIG. Show. As shown in FIG. 9A, the moving image object 904 is designated by three fingers, that is, the left thumb 901, the right index finger 902, and the right middle finger 903.

  In this state, when only the right hand middle finger 903 moves to the upper part of the screen of the touch panel 205, the thumbnail 905 touched by the right hand middle finger 903 is displayed so as to be separated from the moving image object. When the middle finger 903 of the right hand is further slid upward, the thumbnail 906 is completely separated from the moving image object. At this time, the moving image section corresponding to the thumbnail designated by the middle right finger 903 is copied. Note that the thumbnail 906 may be cut out from the moving image data as a still image by this operation.

  FIG. 9B shows a state where the moving object is pressed with the left thumb and the two fingers of the right hand are moved in steps S707 and S708 of FIG. In this state, the segment is instructed by instructing the thumbnail of the moving image object with the index finger and the middle finger of the right hand. When the index finger and the middle finger are moved in parallel so as to slide to the upper part of the touch panel 205, the thumbnail 907 in the designated section of the moving image object moves with the finger and is completely separated from the moving image object. When the finger is further slid, the moving image data in the designated section area 908 is copied.

(Example when copy is not possible)
Next, processing when a moving image object that cannot be copied is selected will be described with reference to FIG. FIG. 10 is a diagram illustrating an example of a state in which a moving image object that cannot be copied is selected to be copied.
As described above, in the case of an object that can be copied, the operation ends when the thumbnail of the moving image object is displayed. However, in the case of an object that cannot be copied, as shown in FIG. 10, when the index finger 1001 is released from the touch panel 205, the thumbnail 1002 returns to its original state. By returning to the original state while showing it to the user as if it was copied in this way, it is possible to explicitly notify the user that copying cannot be performed. At this time, a message indicating that copying cannot be performed may be displayed to warn. Similarly, when a part of a moving image is copied from a moving image object or a still image is cut out as shown in FIG. 9, the original state is restored while showing the user as if the copy or still image was cut out. . Then, a message may be displayed to warn that copying cannot be performed.

(Example of timeline operation)
Next, the operation for displaying the timeline of the moving image object will be described with reference to FIG. In the following description, the moving image object index 313 displayed on the display screen 310 of the touch panel 205 shown in FIG. 3 will be described as an example.

  FIG. 11A shows an example of a method for selecting a moving image object for displaying a timeline. By touching the moving object 1101 with two fingers, the right thumb 1102 and the right index finger 1103, the display of the timeline can be started.

  FIG. 11B shows an example of a method for displaying a timeline in step S608 of FIG. As shown in FIG. 11A, when the two touched fingers are pulled apart and the finger is slid on the touch panel 205, the number of frame images corresponding to the distance between the fingers is calculated. Then, a timeline 1104 composed of indexes is displayed on the touch panel 205. In the example shown in FIG. 11B, three frame images are displayed from the interval between the fingers.

  FIG. 11C shows an example in which the timeline of a specific section is further displayed in detail. In the state shown in FIG. 11B, if you want to see the timeline between the 18th and 36th seconds in detail, release the thumb 1102 of the right hand from the touch panel 205 and touch the frame image at the 18th second. . In this state, when the fingers are spread apart in the direction in which they are touched on the touch panel 205, the timeline is such that the frame images between the 18th and 36th seconds are equally spaced as shown in FIG. 11 (c). 1105 is displayed.

  FIG. 12 shows a display example when a moving image object is selected with two fingers and spread too much. A timeline 1201 shown in FIG. 12A is a state in which all the frame images from the 30th to 33rd seconds of the moving image object are displayed, and the frame image is not displayed even if the finger is further spread. . In the following, two examples are shown as cases where the finger is further spread beyond this state.

  In the first case, as shown in FIG. 12B, the frame image is not attached to the finger touched with the timeline 1202 as it is, and the frame image cannot be newly generated. Not added. In this way, the user can know that the timeline display of the moving image object has reached the end.

  The second case is a case where a frame image follows the location of the touched finger as shown in FIG. In this case, a new frame image cannot be generated, but a timeline 1203 in which the interval between frame images between fingers is widened is displayed. In this case, when the finger leaves the touch panel 205, the normal display for continuously displaying normal frame images returns. In this way, the user can know the display limit by telling the user that no more frame images can be displayed.

  FIG. 13 shows an example of a method for determining a frame image when the index of the moving image object is represented by one frame image in step S610 of FIG. When a moving image object is operated with a finger and the fingers are brought closer to each other, the moving image object index becomes one frame image. Two examples are shown as methods for determining one frame image at this time.

  In the first method, as shown in FIG. 13A, when the index of a moving image object is represented by one frame image, the first frame image is used as a moving image object 1301. In the second method, as shown in FIG. 13B, when the index of the moving image object is represented by one frame image, the frame image 1302 that the user has determined in advance as the representative image is defined as the moving image object 1303. It is a method to do. In this case, when reproducing moving image data or displaying an index, a user may register a desired frame image as a frame image representing a moving image object. In addition, an image from which a most characteristic face is extracted in a digital camera or the like may be used as a frame image.

  In this way, when the frame image of the moving image becomes one, the frame image specified by the user or the top frame image of the moving image object is displayed, so that the desired moving image can be selected from various moving images and still image indexes. Can make it easier to find.

(Example of join operation)
FIG. 14 shows an example of a method for combining a plurality of moving image objects into one index in step S615 of FIG.
In FIG. 14, a moving image object 1401 on the left is a moving image object that becomes the first half of the moving image after combining. On the other hand, the moving image object 1402 on the right side is a moving image object that becomes the latter half of the moving image after combining. The moving image objects respectively designated by the left hand index finger 1403 and the right hand index finger 1404 are moved closer to each other. When the distance 1405 between the moving image objects falls below a certain threshold, the moving image objects are combined into one index 1406. Note that in step S614 in FIG. 6, threshold values are used with reference to two touch positions, but the threshold values shown in FIG. 14 are threshold values determined at the first touch position. At this time, the two moving image data may be actually combined, or the moving image data itself may be combined only on the playlist.

  Further, as shown in FIG. 15, a display effect may be applied when indexes are combined. As shown in FIG. 15, when two moving image objects designated by a finger are brought close to each other and a distance 1501 between the two moving image objects falls below a certain threshold value, a preview image 1502 when the two moving images are combined is displayed. Furthermore, the display size of the preview image 1502 changes according to the distance 1501 between the two moving image objects.

  Also, a preview image 1503 that is larger immediately before the two moving image objects are combined is displayed, and when the two moving image objects are combined, the moving image object that is 1 second before and after the combining point is repeatedly displayed on the preview image 1503. As a result, the user can grasp the combined image while viewing the preview image. Further, when two moving image objects are further brought closer to each other and the moving image objects are combined, an image in which the moving image object has one index 1504 is displayed. At this time, the display of the preview image 1503 is stopped.

  FIG. 16 shows an example of a display method when the moving image objects cannot be combined when the moving image objects are combined. In the example shown in FIG. 16, there are moving image objects 1601 and 1602 to be combined, and these two moving image objects are instructed to approach each other with a finger. When the overlapping width 1603 of two moving image objects exceeds a certain threshold value, the two moving image objects are usually combined. However, when it is determined that the two moving image objects cannot be combined due to the attribute of the moving image object, the two moving image objects are displayed at a distance 1604 so that they repel each other when the finger is removed from the moving image object. The An example of such display is when attributes such as a moving image encoding method are different. For example, one moving image data is compressed by MPEG1 and the other moving image data is compressed by MPEG2. By displaying the two moving image objects so as to be repelled in this way, it is possible to inform the user that the two moving image objects cannot be combined. In addition, a message that it cannot be combined may be displayed to warn.

  As described above, according to the present embodiment, the timeline display of a moving image can be freely handled by the operation of a finger on the touch panel, and the user can see in detail the location of the moving image to be viewed more focused. Furthermore, even when it is desired to view the contents of a moving image sparsely, it can be displayed sparsely by the timeline display. Such a timeline display allows the user to freely operate the moving image.

  Note that the control of the overall control unit 114 may be performed by a single piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing. Although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms without departing from the gist of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and it is also possible to combine each embodiment suitably. Further, in the above-described embodiment, the case where the present invention is applied to a digital camera has been described as an example, but this is not limited to this example. That is, the present invention can be applied to a personal computer, a PDA, a mobile phone terminal, a portable image viewer, a display for selecting and confirming a print image provided in a printer, a digital photo frame, and the like. In other words, any display control device that can be controlled to display a timeline of a moving image on a display device that is a touch panel is applicable. The present invention is not limited to moving images, and can also be applied to data copying using display objects representing other data (content data such as still images, document files, and music files).

(Other embodiments)
The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and a computer-readable recording medium recording the program constitute the present invention.

102 touch panel unit, 103 display unit, 107 composition unit, 111 recording medium access unit, 113 touch state detection unit, 114 overall control unit

Claims (23)

Display control means for controlling the display object representing the content data to be displayed on the display unit;
Detecting means for detecting a touch position on the display unit;
Determination means for determining whether or not two detection positions are detected by the detection means in the single display object displayed on the display unit;
When it is determined by the determination means that two touch positions have been detected on a single display object, the touch positions move in the first direction while being touched, and the two touch positions after movement if the distance of the first direction between exceeds a predetermined distance, have row control for recording on a recording medium by replicating the content data to which the display object is represented, said touch position while touching When moving in the second direction, the number of frame images corresponding to the distance between the two touch positions after the movement is extracted from the content data represented by the display object, and the two touch positions after the movement And a control means for controlling the extracted frame image to be displayed between the display control device and the display control device. The display control means changes the display position of the display object displayed at the touch position detected by the detection means, following the movement of the touch position,
When two places of the display unit are touched and different display objects are touched at the respective touch positions, the distance between the two touch positions becomes a predetermined value or less due to the movement of at least one of the touch positions. The control unit is configured to generate single content data in which the content data represented by the different display objects is combined in an order based on the display position of the display object changed following the movement of the touch position. The display control apparatus according to claim 1 , wherein control is performed. Display control means for controlling the display object representing the content data to be displayed on the display unit;
Detecting means for detecting a touch position on the display unit;
Determination means for determining whether or not two detection positions are detected by the detection means in the single display object displayed on the display unit;
When it is determined by the determination means that two touch positions are detected on the single display object, the touch position moves while touching, and a distance between the two touch positions after the movement is a predetermined distance. if it becomes more than, have a control means for performing control to record on a recording medium by replicating the content data to which the display object is represented,
The display control means changes the display position of the display object displayed at the touch position detected by the detection means, following the movement of the touch position,
When two places of the display unit are touched and different display objects are touched at the respective touch positions, the distance between the two touch positions becomes a predetermined value or less due to the movement of at least one of the touch positions. The control unit is configured to generate single content data in which the content data represented by the different display objects is combined in an order based on the display position of the display object changed following the movement of the touch position. A display control device that performs control. Wherein when the content data display object represents is one that can not be replicated, the display control device according to any one of claims 1 to 3, further comprising a warning means for performing warning. The content data display control device according to any one of claims 1-4, characterized in that the moving image. The content data display control device according to any one of claim 1 to 5, characterized in that voice data. The display control device, the display control device according to any one of claim 1 to 6, characterized in that an imaging apparatus including the imaging means. The display control device, the display control device according to any one of claim 1 to 7, characterized in that a mobile telephone terminal. Display control means for controlling to display the timeline of the content data on the display unit;
Detecting means for detecting a touch position on the display unit;
A determination unit that determines whether or not three detection positions are detected by the detection unit in the single timeline displayed on the display unit;
When it is determined by the determination means that three touch positions are detected in the single timeline , two touch positions of the three positions move while being touched, and the moved touch positions And the touch position before the movement is a predetermined distance or more, and is a partial range of the entire content data range represented by the timeline, and the two moved positions on the timeline . A display control apparatus comprising: control means for performing control for copying and recording content data in a range specified by a touch position on a recording medium. The display control apparatus according to claim 9 , further comprising a warning unit that issues a warning when the content data represented by the timeline cannot be copied. The display control apparatus according to claim 9 , wherein the content data is a moving image. The display control apparatus according to claim 9, wherein the content data is audio data. The display control apparatus according to claim 9 , wherein the display control apparatus is an imaging apparatus including an imaging unit. The display control apparatus according to claim 9 , wherein the display control apparatus is a mobile phone terminal. When it is determined by the determination means that three touch positions are detected in the single timeline , the control means
When one or two of the three touch positions move while touching, and the distance in the first direction between the moved touch position and the touch position before the movement is equal to or greater than a predetermined distance And performing control for copying the content data represented by the timeline and recording it on a recording medium,
Content that the timeline represents the number of frame images according to the distance between the touch positions after the movement when one or two of the three touch positions move in the second direction while being touched The display control apparatus according to claim 9 , wherein the display control apparatus controls the display so that the extracted frame image is displayed between the touch positions after the movement and extracted from the data. When one touch position of the three touch positions moves, the control means is a partial range of the entire moving image data range represented by the timeline, and the display control device according to claim 11, wherein the controller controls so as to replicate the video thus designated partial to the touch position location as moving image data. If the touch position of one portion in the touch position of the three positions is moved, the control means of the moving image data to which the time line represents, thus designated the touch position of the one point on the time line 12. The display control apparatus according to claim 11 , wherein control is performed so that the image of the frame at the selected position is copied as still image data. The display control device according to claim 11, 16 or 17, wherein the display control means controls the timeline to display a plurality of frame images extracted from a moving image in time series. A display control step for controlling the display object representing the content data to be displayed on the display unit;
A detection step of detecting a touch position on the display unit;
A determination step of determining whether or not two detection positions are detected by the detection step in the single display object displayed on the display unit;
When it is determined in the determination step that two touch positions are detected on the single display object, the touch positions move in the first direction while being touched, and the two touch positions after the movement if the distance of the first direction between exceeds a predetermined distance, have row control for recording on a recording medium by replicating the content data to which the display object is represented, said touch position while touching When moving in the second direction, the number of frame images corresponding to the distance between the two touch positions after the movement is extracted from the content data represented by the display object, and the two touch positions after the movement And a control step of controlling the extracted frame image to be displayed between the control method and the display control device. A display control step for controlling the display object representing the content data to be displayed on the display unit;
A detection step of detecting a touch position on the display unit;
A determination step of determining whether or not two detection positions are detected by the detection step in the single display object displayed on the display unit;
When it is determined in the determination step that two touch positions are detected on the single display object, the touch position moves while touching, and a predetermined distance is set between the two touch positions after the movement. if it becomes more than, have a control step of performing control for recording on a recording medium by replicating the content data to which the display object is represented,
The display control step changes the display position of the display object displayed at the touch position detected by the detection step, following the movement of the touch position,
When two places of the display unit are touched and different display objects are touched at the respective touch positions, the distance between the two touch positions becomes a predetermined value or less due to the movement of at least one of the touch positions. The control step generates single content data in which the content data represented by the different display objects is combined in an order based on the display position of the display object changed following the movement of the touch position. A control method for a display control device, characterized by performing control. A display control step for controlling the timeline of the content data to be displayed on the display unit;
A detection step of detecting a touch position on the display unit;
A determination step of determining whether or not three touch positions are detected by the detection step in the single timeline displayed on the display unit;
When it is determined by the determination step that three touch positions are detected in the single timeline , the two touch positions of the three positions move while being touched, and the moved touch positions And the touch position before the movement is a predetermined distance or more, and is a partial range of the entire content data range represented by the timeline, and the two moved positions on the timeline . And a control step for performing control for duplicating the content data in the range specified by the touch position and recording the content data on a recording medium. Program for causing a computer to function as each unit of the display control device according to any one of claims 1 to 18. A computer-readable recording medium having recorded thereon a program for causing the computer to function as each unit of the display control device according to any one of claims 1 to 18 .

Images