JP5486721B2 - Display control device, display control device control method, program, and storage medium - Google Patents

Description

  The present invention relates to a display control device for inputting a gesture operation to a touch panel and a control method for the display control device.

  In recent years, digital devices having a touch panel in a display unit and capable of intuitive operation have appeared. In these devices, it is possible not only to execute a function with a button icon placed on the touch panel display, but also to call the function with gesture recognition. However, it is necessary for anyone to know how to use these gesture recognitions in advance so that they can be operated easily. Or even if it is known, it is difficult to know whether or not the gesture has been recognized until the operation is completed, and the operation is difficult.

  In order to improve the operability of the user interface using gesture recognition, a method of displaying guidance for gesture recognition has been proposed. As such a conventional guidance display method, there is a method of detecting that there is no input for a certain period of time and displaying a guide for executing an application (see Patent Document 1).

Japanese Patent Laid-Open No. 06-289984

  However, in the guidance display method described in Patent Document 1, it is necessary for a user who wants to operate while looking at the guide to wait for a certain period of time and cannot perform the operation immediately. In addition, for a user who desires to view an image taken on a small display such as a digital camera, there is a problem that it is difficult to see the image itself when a guide for editing operations that have no other relation is continuously displayed.

  The present invention has been made in view of the above problems, and provides a display control device that eliminates the complication of display by guide display and enables guide display so that a user can easily perform a gesture operation. It is intended.

In order to achieve the above object, a display control apparatus according to one aspect of the present invention has the following configuration. That is,
An input means for detecting a touch input on the display screen of the touch panel type display means;
Display processing means for displaying an image on the display screen of the display means and displaying information about the image together with the image;
When the touch input locus detected by the input means when displaying the image on the display means is a locus that can be part of a gesture operation, the information displayed on the display means is not displayed. Display control means for controlling to display guidance on a gesture operation candidate that is a gesture operation that can be determined by continuing the touch input among a plurality of gesture operations, and displaying on the display screen of the display means Have.

  According to the present invention, it is possible to eliminate the complicated display by the guide display and to perform the guide display so that the user can easily perform the gesture operation.

The block diagram of the digital camera by an Example. The figure which shows gesture operation | movement and application assignment. The flowchart of a gesture recognition process. The flowchart of a guidance display. The flowchart of gesture confirmation. The flowchart of gesture function activation. (A) is a figure of the display in which only an image is displayed, (b) is a guidance display figure at the time of gesture recognition. (A) is a guidance display figure at the time of gesture confirmation, (b) is a figure after gesture activation.

Preferred embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 shows a configuration example of a digital camera 100 as an example of a display control apparatus in which the present invention can be implemented. The CPU 101 is an arithmetic processing unit that controls the operation of the content management apparatus, receives instructions from the user via the input unit 105 and the like, executes various programs described later, and controls display on the display 104. The imaging unit 102 captures an image. The memory 103 is used as a work area for the CPU 101. The display 104 is a display unit for displaying the graphic user interface according to the present embodiment, and images and display items to be described later are displayed on the display unit. The input unit 105 is an input unit for receiving an instruction from a user, and in this embodiment, is an input device including a touch panel 113 provided on the display screen of the display 104. That is, the input unit 105 detects a touch input on the display screen of the display 104 and provides the information to the CPU 101. By using the input unit 105, the user can execute the content management program. Note that the touch panel 113 is not limited to such a contact type, and may be, for example, an optical type (configuration in which infrared rays are irradiated from the side of the display screen). That is, a touch panel type display unit may be formed.

  The recording medium drive 106 is a device that reads data stored in an external recording medium 108 such as a CD-ROM, DVD-ROM, or flash memory, and writes data to the external recording medium 108. Assume that the external recording medium 108 stores an image captured by the imaging unit 102 and a program executed by the CPU 101. The I / F 107 is connected to the network 110 via the communication line 109. The sensor 112 is a vibration detection unit including an acceleration sensor and the like, and detects the posture and vibration of the digital camera 100. The CPU 101 can execute various functions such as switching and rotation of the image displayed on the display 104 based on the vibration detected by the sensor 112. The CPU 101 can also execute a program on the network 110 via the I / F 107, and the present invention can also be applied to a program on the network 110.

  As described above, the input unit 105 includes the touch panel 113, detects a contact position with the touch panel 113, and notifies the detected position to the CPU 101 through the internal bus 111. Based on the notified contact position, the CPU 101 touches the touch panel 113 with a finger or a pen (hereinafter referred to as touchdown), releases it (hereinafter referred to as touchup or release of touch input), or moves while touching (hereinafter referred to as touchdown). An operation such as “drag” is detected. Note that the CPU 101 determines that a stroke has been drawn when a touch-up is performed on the touch panel 113 by dragging a predetermined distance or more from the touch-down. When the shape of the stroke corresponds to any of the gestures registered in advance, the CPU 101 executes a function associated with the corresponding gesture.

  Preconditions in this embodiment will be described. FIG. 2 shows gesture patterns indicating user operation instructions that can be recognized by the digital camera 100. In this example, four stroke input movement trajectories in the first direction (Y direction in this example) and subsequent touch input movement trajectories in the second direction (X direction in this example) are included in one stroke. A stroke pattern is used. More precisely, after the movement component in the first direction of the touch position on the display screen becomes a predetermined distance or more, the second direction perpendicular to the first direction on the display screen at the touch position. Is a stroke pattern in which the moving component is equal to or greater than a predetermined distance (first condition). A movement locus is a locus drawn by dragging a touch input. These patterns are named gesture 1, gesture 2, gesture 3, and gesture 4. Note that the X component and the Y component of the touch input are touch input components in the X direction and the Y direction in the coordinate system 700 illustrated in FIG. Functions assigned in advance to these gestures are function F1, function F2, function F3, and function F4. Here, the function assigned to function F1 is image erasure, image protection is performed in F2, image rotation is performed in F3, In F4, a slide show of images is set. For example, when gesture 1 is recognized and confirmed, an application called image deletion can be called.

  FIG. 3 is a flowchart for explaining the flow from the no-input state to the guidance display process. The no-input state is a state in which no image is input from the input unit 105 while an image stored in the external recording medium 108 is displayed on the display 104 as shown in FIG. It is. Note that the processing shown in the flowcharts of FIGS. 3, 4, 5, and 6 to be described later is realized by the CPU 101 executing a program stored in the external recording medium.

  In step S <b> 301, the CPU 101 monitors an input event from the input unit 105. Examples of the input event include a touch input (touch up, touch down, drag) to the touch panel 113 and an operation event from an input device other than the touch panel 113. If an input event occurs, the process proceeds to S302. In S302, the CPU 101 determines whether or not the input event detected in S301 is a touchdown event. If it is determined that the event is a touchdown event, in S303, the CPU 101 stores the coordinates as P (Xo, Yo) in the memory 103 as a touch start point, monitors the event again, and waits until the next event is received. (S301). On the other hand, if it is determined in S302 that the event is not a touchdown event, the process proceeds to S304.

  In S304, the CPU 101 determines whether the event is a touch-up event. If it is determined that the event is a touch-up event, the process advances to step S305, and the CPU 101 clears the touch start point P from the memory 103, monitors the event, and waits until the next event is received (S301). On the other hand, if it is determined in S304 that the event is not a touch-up event, the process proceeds to S306.

  In S306, the CPU 101 determines whether or not the input event is a drag event. If it is determined that the event is a drag event, the process advances to step S307, and the CPU 101 stores the point touched at that time as the current point and the coordinates thereof as C (X, Y) in the memory 103. Then, the process proceeds to S308. On the other hand, if it is determined in S306 that the event is not a drag event, the process proceeds to S315.

  In S <b> 308, the CPU 101 calculates the amount of movement from the starting point coordinate P to the current point coordinate C, that is, the distance, and holds the distance in the X component as Sx and the distance in the Y component as Sy in the memory 103. In steps S309 to S311, it is determined whether or not the touch input locus detected by the input unit 105 is a part of the gesture operation (a part of the gesture pattern shown in FIG. 2). First, in S309, the CPU 101 determines whether or not the X component distance Sx exceeds the threshold value B1. If the distance Sx of the X component exceeds the threshold B1, that is, if the amount of movement of the touch input in the X direction exceeds the threshold B1, the process proceeds to S316 and does not exceed the gesture recognition candidate (gesture operation candidate). The process proceeds to S310. Here, the distance of the X component exceeds the threshold value B1 means that the touch input is recognized as not a stroke in the Y direction because the touch input has moved too much in the X direction, and does not apply to the gesture pattern that the digital camera 100 can recognize. means. Therefore, it deviates from a gesture recognition candidate (gesture operation candidate).

  In S310, the CPU 101 determines whether or not the distance Sy of the Y component has fallen below the threshold value A1 (<0). If it has fallen below, the process proceeds to S312; otherwise, the process proceeds to S311. Here, the Y component distance Sy is less than the threshold value A1 means that the amount of movement of the Y component stroke in the negative direction (upward on the touch panel) exceeds the distance | A1 |. On the other hand, in S311, the CPU 101 determines whether or not the distance Sy of the Y component has exceeded the threshold value A2 (> 0). If exceeded, the process proceeds to S313, and if not exceeded, the process proceeds to S301. Here, the Y component distance Sy exceeds the threshold value A2 means that the amount of movement of the Y component stroke in the positive direction (downward on the touch panel) exceeds the distance | A2 |. In S310 and S311, A1 <0 and A2> 0 are set, but positive and negative values may be reversed. Also, the distance between the upper and lower thresholds may be constant as | A1 | = | A2 |, or may not be constant according to positive and negative as | A1 | ≠ | A2 |.

  As described above, if the amount of movement of the touch input exceeds | A1 | in the Y-axis / negative direction or exceeds | A2 | in the Y-axis / positive direction according to the determinations in S310 and S311, the touch The input is determined as a gesture recognition candidate (gesture operation candidate). That is, when the movement amount from the start of the touch input exceeds a predetermined amount in the first direction, it is determined that the movement locus of the touch input is a part of the gesture operation. In step S <b> 312, the CPU 101 holds information in the memory 103 that the Y component distance Sy is less than the threshold value A <b> 1. Then, the process proceeds to S314. In step S <b> 313, the CPU 101 holds information in the memory 103 that the Y component distance Sy exceeds the threshold value A <b> 2. Then, the process proceeds to S314. In S314, the CPU 101 hides character information other than the guidance described later. Then, the process proceeds to the guidance display process shown in FIG. Note that the character information other than the guidance includes information such as the shooting date and time 702 of the image 701 displayed superimposed on the image 701 and the shooting setting value 703 when the image 701 is shot as shown in FIG. Point to.

  On the other hand, in S315, the CPU 101 determines whether or not the detected event is an input event such as a physical button other than the touch panel. If it is determined that the input event is other than a touch panel, the process proceeds to S316. If it is determined that the input event is a touch panel, the process proceeds to S301. In S316, the CPU 101 deletes the gesture recognition information calculated in S307 and S308, and ends this process. That is, even when an operation is being performed on the touch panel, if there is an operation other than the touch panel, such as an operation on a physical button, the gesture recognition process is terminated with priority on that operation. Even if touch-up is detected after S308, the function based on the gesture is not activated.

  FIG. 4 is a flowchart of the guidance display process, which is a process following S314 in FIG. In the guidance display process, for a touch input determined to be a part of the gesture operation (that is, a gesture recognition candidate), a gesture operation that can be determined by continuing the touch input is selected as a candidate, and guidance display is performed. . First, in S401, the CPU 101 determines whether or not the distance of the Y component is less than the threshold value A1. For this determination, the information held in S312 or S313 is used. If it is determined that the value has fallen, the process proceeds to S402. At this time, the gesture operation candidates are gesture 1 and gesture 2 in FIG. On the other hand, if it is determined that the distance has not fallen below, the distance of the Y component has exceeded the threshold value A2, and the process proceeds to S408. At this point, the gesture operation candidates are gesture 3 and gesture 4 in FIG.

  At the time of starting the processes of S402 to S407, the gestures 1 and 2 in FIG. 2 are selected as gesture candidates that can be specified by continuing the touch input. Accordingly, guidance display regarding these selected gesture candidates may be performed on the display 104. However, in this embodiment, in order to further improve the operability, guidance display of gestures to which functions that are not executable at that time are assigned is prohibited, and guidance display is only performed for gestures to which executable functions are assigned. To do. First, in S402, the CPU 101 determines whether or not the function F1 is valid and the function F2 is valid. That is, it means that it is determined whether the image can be erased and the image can be protected with respect to the image currently displayed on the display 104. If both the function F1 and the function F2 are valid, the process proceeds to S403 to display a plurality of executable functions, and if not, the process proceeds to S404.

  In S403, the gesture 1 and gesture 2 guidance is displayed. The guidance here means that function names and figures are displayed as shown in FIG. A function name 711 represents the function name of the gesture 1 and is displayed superimposed on the image 701. A graphic 712 represents a direction to be stroked to activate the function of the gesture 1 and is displayed superimposed on the image 701. The function name 711 and the graphic 712 indicate that the user can recognize the operation of the gesture 1 and delete the image 701 by moving the finger in the left direction (the direction represented by the graphic 712) without releasing the finger from the touch panel. Similarly, the function name 713 and the graphic 714 are related to the gesture 2 and indicate that the operation of the gesture 2 can be recognized and the image 701 can be protected by moving the finger to the right. The function name 711 and the graphic 712, and the function name 713 and the graphic 714 are displayed at positions where the touch position should be moved in order to activate the function of each gesture. For example, gesture 1 is determined with a stroke that moves A1 (<0) in the Y direction, that is, a predetermined distance upward on the screen, then D1 (<0) in the X direction, that is, a predetermined amount of leftward movement on the screen. The Therefore, in order to execute the function assigned to the gesture 1, the touch position moves to the upper left. In order to encourage this movement, the function name 711 and the graphic 712 that are the guidance of the gesture 1 are displayed in the upper left area of the display screen of the display 104 (the X coordinate is on the left side of the screen center and the Y coordinate is on the upper side of the screen center). Is displayed. For the same reason, the function name 713 and the graphic 714 that are the guidance of the gesture 2 are displayed in the upper right area of the display screen of the display 104 (the X coordinate is on the right side of the screen center and the Y coordinate is on the upper side of the screen center). The

  In addition, since the determination in S401 means that the stroke in the Y direction has advanced in the negative direction (upward), the gesture pattern that can be recognized thereafter is limited to gesture 1 or gesture 2. In this case, as shown in FIG. 7B, only the guidance relating to the gesture 1 and the gesture 2 is displayed, so that it is not necessary to display a gesture pattern that cannot be recognized after drawing an X component stroke. Therefore, the display area for displaying the remaining pattern guides can be used effectively.

  In S404, the CPU 101 determines whether or not the function F1 is valid and the function F2 is invalid. In other words, this means that it is possible to determine whether or not the image currently displayed on the display 104 can be erased but cannot be protected. If only F1 is valid, the process proceeds to S405, and if not, the process proceeds to S406. In S <b> 405, the CPU 101 displays only the guidance related to gesture 1 on the display 104 and does not display the guidance related to gesture 2. In S406, the CPU 101 determines whether or not the function F1 is invalid and the function F2 is valid. If only F2 is valid, the process proceeds to S407, and if not, the process proceeds to gesture recognition processing. In S407, the CPU 101 displays only the guidance related to the gesture 2 on the display 104, and does not display the guidance related to the gesture 1.

  On the other hand, when proceeding to S408, it means that the stroke in the Y direction has proceeded in the positive direction (downward). That is, the subsequent gesture pattern is limited to gesture 3 or gesture 4. Therefore, the subsequent processes of S408, S410, and S412 are the same as S402, S404, and S406 described above except that the function F1 is the function F3 and the function F2 is the function F4. For the same reason as gestures 1 and 2 described above, the function name and figure that are the guidance of gesture 3 are displayed in the lower left area of the display screen of the display 104 (the x coordinate is on the left side of the screen center and the Y coordinate is on the screen center). Displayed in the lower area). In addition, the function name and the figure that are the guidance of the gesture 4 are displayed in the lower right area of the display screen of the display 104 (the X coordinate is on the right side of the screen center and the Y coordinate is on the lower side of the screen center).

  As described above, during the gesture recognition, the guidance indicating the function name that can be executed by the gesture that can be specified by continuing the touch input is displayed. Thus, the user can identify what function can be activated by continuing the gesture operation currently being performed. That is, it is possible to confirm whether the gesture operation intended by the user has been performed so far. In addition, a guidance indicating a function name that can be executed with a gesture that can be determined by continuing touch input is displayed together with a guidance that indicates a direction to be stroked to activate the function. This makes it easier for the user to visually understand what kind of operation can be made to recognize the gesture thereafter, and as a result, the gesture operation becomes easy.

  In the description of S405, it is described that the guidance is not displayed when the function F2 is invalid. However, the guidance may not be displayed by changing the display form or the like. In this case, for example, when both the functions F1 and F2 are not effective, it is possible to notify the user to that effect. That is, the user can know that there is no gesture operation corresponding to a function that can be executed although there are gesture operation candidates. Further, although the guidance is described as function names and figures, for example, an arrow indicating movement of the X component may be included as guidance. Moreover, although the guidance display showed the example which is still, you may make it guide | invade operation by using animation expression for the guide of operation which draws a stroke.

  Further, by hiding information related to operations other than gesture operation candidates in S314, it is possible to hide information that is not related to gesture recognition and display only the information to be transmitted. Therefore, it is easy for the user to operate, and there is an effect that the limited display area can be used effectively by the gesture recognition guide.

  Although only the gesture operation has been described in the present embodiment, the operation that can be performed on the touch panel is not only the gesture operation. For example, after the touchdown, the next image can be displayed when dragged in the positive direction of the X component, and the previous image can be displayed when dragged in the negative direction. In other words, it is desirable that a plurality of operations can be performed on one screen. However, in this case, there is a possibility that the guidance of the gesture is displayed in the guidance display processing of FIG. 4 because the user intends to perform the next image display operation and drags it to the Y component by mistake. Such a guidance display is annoying guidance for a user who wants to send an image. Therefore, in the present embodiment, as described in S310 and S311, the guidance recognition is not displayed before the distance of the Y component reaches the threshold, and the gesture recognition and the image feed processing are distinguished. Therefore, there is an effect that comfortable image browsing can be performed without worrying about unrelated guide display during image browsing.

  Next, a case where the displayed guidance is changed when the gesture is confirmed during the gesture recognition will be described. FIG. 5 is a flowchart when the Y component distance Sy is less than the threshold value A1 in the gesture recognition process following FIG. In this case, the gesture candidate is gesture 1 or gesture 2.

  S501 and S502 are the same as S301 and S302 described above. If it is determined in S502 that the event is a touchdown event, the process proceeds to S501. If it is determined that the event is not a touchdown event, the process proceeds to S503. S503 is the same as S304 described above. If it is determined that the event is a touch-up event, the process proceeds to S516. If it is determined that the event is not a touch-up event, the process proceeds to S504. S504 is the same as S306 described above. If it is determined that the event is a drag event, the process proceeds to S505. If it is determined that the event is not a drag event, the process proceeds to S515.

  S505 and S506 are the same as S307 and S308 described above. When S506 ends, the process proceeds to S507. In S507, if the values of Sx and Sy calculated in S506 are larger than the maximum values Sx_max and Sy_max in the same stroke, S101 substitutes Sx and Sy for Sx_max and Sy_max, and updates the maximum values. . Similarly, when the values of Sx and Sy are smaller than the minimum values Sx_min and Sy_min within the same stroke, Sx and Sy are substituted for Sx_min and Sy_min, and the minimum value is updated. Then, the process proceeds to S508.

  In step S508, the CPU 101 determines whether or not the CPU 101 has moved in the reverse direction with respect to the Y direction. If it is determined that it has moved, the process proceeds to S517 to clear the gesture recognition information, and if it is determined that it has not moved, the process proceeds to S509. The determination in S508 will be described in detail. For example, when the stroke is in the negative direction with respect to the Y component, the value of Sy_min is a negative value, and Sy is also a negative value. Here, the difference between the Sy_min value and the Sy value is calculated. If there is a difference, it means that the current point C has moved in the opposite direction with respect to the stroke of the Y component. Conversely, if the stroke is in the positive direction with respect to the Y component, the difference between the Sy_max value and the Sy value is calculated. In this way, it is possible to determine whether the stroke moves according to the gesture pattern.

  Further, a margin may be given to the difference between the value of Sy_min and the value of Sy. That is, when the difference between the Sy_min value and the Sy value exceeds a predetermined amount, it is determined that the movement has been reversed. For example, when the predetermined amount is B2 and Sy-Sy_min> B2, it is determined that the movement has been reversed. This makes it possible to prevent erroneous detection when the coordinates input to the touch panel device detect minute movements even if the user intends to touch one point like a finger.

  In step S509, the CPU 101 determines whether or not the CPU 101 has moved in the opposite direction with respect to the X direction. If it is determined that it has moved, the process proceeds to S517 to clear the gesture recognition information, and if it is determined that it has not moved, the process proceeds to S510. Here, the details of S509 will be described by taking as an example the case where the gesture 2 is confirmed. Since the stroke is being drawn in the positive direction of the X component in the operation in the middle of recognition of the gesture 2, the value of Sx_max is a positive value, and Sx is also a positive value. Here, the difference between the value of Sx_max and the value of Sx is calculated. If there is a difference, it means that the current point C has moved in the opposite direction with respect to the positive stroke of the X component. If it is determined that it has moved in the reverse direction, the process proceeds to S516 and the gesture information is cleared. Similarly to the description in S508 described above, for example, the predetermined amount may be set to B3, and Sx_max−Sx> B3 may be set to prevent the process from proceeding to S516 when an erroneous operation is performed. The same applies to the case where the gesture 1 is confirmed. In this case, since Sx_min and Sx are negative values, calculating the difference between the value of Sx_min and the value of Sx indicates that the current point C has moved in the opposite direction to the negative stroke of the X component. judge.

  As described above, when the operation name that can be executed by continuing the touch input is displayed in the middle of the gesture operation and the operation determined as YES in any of S503, S508, S509, and S515, the gesture operation is performed. It is possible to prevent the function from being activated. Therefore, when the user sees the function name displayed in the middle of the gesture operation and finds that the intended function cannot be activated by the current gesture operation, the user cancels the gesture operation and The function can be disabled. In this way, it is possible to prevent an unintended function from being activated by a gesture operation.

  In S510, it is determined whether or not the distance Sx in the negative direction of the X component has fallen below a threshold value. If it is determined that it has fallen below, the process proceeds to S511. If it is determined that it has not fallen below, the process proceeds to S513. This determination is a determination as to whether or not the distance of the X component satisfies the distance necessary for recognizing the gesture 1. In S511, it is determined whether or not the function F1 can be activated. If it is determined that it can be activated, the process proceeds to S512, and if it is determined that it cannot be activated, the process proceeds to S517.

  On the other hand, in S513, it is determined whether or not the distance Sx in the positive direction of the X component exceeds the threshold value. If it is determined that it has exceeded, the process proceeds to S514, and if it is determined that it has not exceeded, the process proceeds to S501. This determination is a determination as to whether or not the distance of the X component satisfies the distance necessary for recognizing the gesture 2. In S514, it is determined whether or not the function F2 can be activated. If it is determined that it can be activated, the process proceeds to S512, and if it is determined that it cannot be activated, the process proceeds to S517.

  In S512, the CPU 101 changes the gesture guidance display to the confirmation mode display as shown in FIG. 8A, and confirms the gesture. When the gesture is confirmed, a function that can be executed by the gesture operation with the current touch input is confirmed. Information on the confirmed gesture is held in the memory 103. In this example, a state where the operation of the gesture 2 is confirmed is shown. In FIG. 8A, the function name 711 and the graphics 712 and 714 of the gesture 1 are erased and a display 801 indicating the determination of the gesture 2 is displayed compared to FIG. 7B. By displaying in this way, the user can recognize that the gesture 2 has been recognized by the apparatus with the stroke up to the present, and can identify that the function assigned to the gesture 2 is activated by releasing the finger here. Obviously, the display indicating the confirmed state is not limited to this. For example, the final state may be indicated by deleting only a figure (for example, the figure 714) indicating the moving direction of the touch input while holding the display of the function name 713. In addition, without deleting the function name 713 and the figure 714, the display form such as the color and shape of the function name 713 and the figure 714 may be changed to indicate the confirmed state, or the function name 713 and the figure 714 may be displayed. You may make it show a definite state by attaching | subjecting a frame or a mark.

  S515 is the same as S315 described above. If it is determined that the input event is other than a touch panel, the process proceeds to S516. If it is determined that the input event is a touch panel, the process proceeds to S501. In S516, the CPU 101 deletes the touch start point information stored in S305 and advances the process to S517. S517 is the same as S316 described above. In S518, the CPU 101 hides the guidance displayed in the process (guidance display process) in the flowchart of FIG. 4, returns to the display state shown in FIG. 7A, and ends the process. Even if touch-up is detected after S518, the function based on the gesture is not activated.

  In FIG. 5, an example of gesture confirmation when the function F1 or F2 is confirmed has been described. However, the same process is performed for the gesture confirmation when the function F3 or F4 is confirmed with the positive and negative signs in the Y direction reversed. The description is omitted.

  FIG. 6 is a flowchart in the case of activating the function assigned to the gesture after the gesture is confirmed, and is a process following S512 in FIG. S601 and S602 are the same as S301 and S302 described above. If it is determined in S602 that the event is a touchdown event, the process proceeds to S601. If it is determined that the event is not a touchdown event, the process proceeds to S603. S603 is the same as S304 described above. If it is determined that the event is a touch-up event, the process proceeds to S613. If it is determined that the event is not a touch-up event, the process proceeds to S604. S604 is the same as S306 described above. If it is determined that the event is a drag event, the process proceeds to S605. If it is determined that the event is not a drag event, the process proceeds to S612.

  S605 to S607 are the same as S505 to S507 described above. In step S <b> 608, the CPU 101 determines whether the Y component of the touch input is reversed, that is, whether the gesture 101 has moved 180 degrees opposite (third direction) to the Y direction (first direction) of the determined gesture stroke. Determine. If it is determined that the Y component has moved in the reverse direction, the process proceeds to S609. If it is determined that the Y component has not moved, the process proceeds to S610. In step S <b> 609, the CPU 101 moves in the opposite direction (fourth direction) by 180 degrees with respect to the X direction (second direction) of the determined gesture stroke, that is, the X component of the touch input is reversed. Determine whether or not. If it is determined that the X component has moved in the opposite direction, the process proceeds to S610. If it is determined that the X component has not moved, the process returns to S601. Note that the determination method in S608 and S609 is as described in S508 and S509.

In S610, the gesture recognition information acquired so far is deleted. In other words, the gesture information confirmed in S512 is deleted from the memory 103 to cancel the gesture confirmation. S611 is the same as S518 described above. Even if a touch-up is detected after S611, the function based on the gesture is not activated. S612 is the same as S315 described above. If it is determined that the input event is other than a touch panel, the process proceeds to S610. If it is determined that the input event is a touch panel, the process proceeds to S601. S613 is the same as S518 described above. After S613, the CPU 101 activates (executes) the assigned function (S614), and displays that the function has been executed (802) as shown in FIG. 8B (S615).
In this way, even after the gesture is confirmed in S512, until the user touches up, the function assigned to the confirmed gesture is executed by performing an operation determined as YES in S608, S609, and S612. You can avoid it. Determining YES in S608, S609, and S612 corresponds to the second condition. That is, the user can confirm whether or not the intended function is activated by confirming the function assigned to the confirmed gesture by looking at the display of the confirmation mode in S512. If it is found that an unintended function is activated, it is possible to cancel the gesture operation and not execute the function displayed in the confirmation mode.

  As described above, by changing the guidance displayed when the gesture is confirmed and displaying only the function to be activated, the user can recognize that the stroke corresponding to the gesture pattern has been drawn. In addition, from such a display, the user can easily grasp which function is activated.

  In the above embodiment, the case where the display control apparatus of the present invention is applied to a digital camera has been described, but the present invention is not limited to this. It is obvious that the present invention can be applied to any information processing apparatus capable of touch input such as a personal digital assistant (PDA).

  Moreover, in the said embodiment, although the simple stroke by the combination of up and down, right and left was shown as a gesture pattern, it is not restricted to this. For example, a combination of vertical and oblique movement trajectories may be used, or a curved movement trajectory may be used. Furthermore, in the above-described embodiment, the gesture pattern formed by two types of movement trajectories in the vertical direction and the left-right direction is shown. However, the gesture pattern formed by three or more types of movement trajectories such as upward direction → right direction → diagonal upper right direction. A pattern can also be used. In addition, if the touch panel can detect a plurality of touch positions at the same time, a gesture operation using a multi-point touch is also possible. For example, while the user is touching down one point and performing a touch operation, it is possible to perform an operation on a button icon, a display item display position change (drag) operation, or the like. When the user touches down one point and the second touch is performed while the touch is in the touch-on state, a gesture operation can be performed according to the change (trajectory) of the touch position of the two points. To do. Examples of the gesture operation corresponding to the change (trajectory) of the two touch positions include, for example, an operation for enlarging the displayed image according to an increase in the distance between the two points and a decrease in the distance between the two points. There is an operation to reduce the displayed image accordingly. In this case, since it can be considered that the user intends to perform the gesture operation when the second point touchdown occurs, the guidance of the gesture operation using two or more touches according to the second point touchdown. Is displayed.

Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.
Note that the above-described control may be performed by a single piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing.
Each of the above-described embodiments is merely an embodiment of the present invention, and the embodiments can be combined as appropriate.
(Other embodiments)
The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (12)

An input means for detecting a touch input on the display screen of the touch panel type display means;
Display processing means for displaying an image on the display screen of the display means and displaying information about the image together with the image;
When the touch input locus detected by the input means when displaying the image on the display means is a locus that can be part of a gesture operation, the information displayed on the display means is not displayed. Display control means for controlling to display guidance on a gesture operation candidate that is a gesture operation that can be determined by continuing the touch input among a plurality of gesture operations, and displaying on the display screen of the display means And a display control device.   The execution means for executing a function corresponding to the matched gesture operation candidate when the locus of the touch input detected by the input means matches the gesture operation candidate. Display controller.   The display control apparatus according to claim 1, wherein the display processing unit displays the information superimposed on the image.   4. The display processing unit according to claim 1, wherein the display processing unit displays a captured image captured by an imaging device as the image, and displays shooting information when the captured image is captured as the information. The display control apparatus according to item 1. The trajectory that can be part of the gesture operation is that the amount of movement from the start of the touch input exceeds a predetermined amount in the first direction,
Wherein the display control unit, the display control device according to any one of claims 1 to 4, characterized in that for displaying the guidance gesture operation that begins from the trajectory to the first direction as the gesture operation candidate . After the touch input trajectory detected by the input means becomes a trajectory that can be a part of the gesture operation, the movement amount of the touch input in a second direction different from the first direction is a predetermined amount. A gesture operation having a touch input movement trajectory in the second direction is subsequently determined as an instructed gesture operation. The display control apparatus according to claim 5 . The display control apparatus according to any one of claims 1 to 6 , wherein in displaying the guidance related to the gesture operation candidates, a stroke locus corresponding to the gesture operation of each gesture operation candidate is displayed as an animation. .   The display control apparatus according to claim 2, wherein the function is a function of performing processing on the image.   The display control apparatus according to claim 2, wherein the function is a function of performing at least one of deletion of the image, protection of the image, rotation of the image, and reproduction of the image in a slide show. An input process for detecting a touch input on a display screen of a touch panel type display means;
A display processing step of displaying an image on the display screen of the display means and displaying information about the image together with the image;
When the touch input trajectory detected in the input step when displaying the image on the display means is a trajectory that can be part of a gesture operation, the information displayed on the display means is not displayed. A display control step for controlling to display guidance on a gesture operation candidate, which is a gesture operation that can be determined by continuing the touch input among a plurality of gesture operations, on the display screen of the display unit A control method for a display control device, comprising: A program that causes a computer to function as each unit of the display control device according to any one of claims 1 to 9 . A storage medium storing a program that causes a computer to function as each unit of the display control device according to any one of claims 1 to 9 .

Images