JP2018041376A - Display control device, method for controlling the same, and program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To cause a user to feel that the user's operation is received, and notify the user of the fact that a scroll range reaches its end as well.SOLUTION: A CPU 101 displays a display object on a display 105, when detecting a scroll instruction operation, scrolls the display object, and if the instruction operation is not ended even when scrolling the display object to its end, displays a display item imitating ripples superimposed on the display object and controls the display item to move in the direction of scroll according to the instruction operation.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a display control device, a control method thereof, a program, and a storage medium, and more particularly to a so-called graphical user interface (GUI) using a touch panel.

  In general, recent digital devices are equipped with a GUI for displaying various functions and the like so that a user can operate them. Such a digital device includes a touch panel that detects a user's touch operation on the display unit. When the user performs a touch operation on an icon, an image, a document, or the like (hereinafter referred to as a display target or “graphics or the like”) displayed on the display unit, processing corresponding to the touch operation is performed.

  By the way, there are graphics that are continuous with graphics displayed on the display unit, but are not displayed (hidden) on the display unit. In such a case, graphics and the like are scrolled in accordance with a touch move operation by the user, and the graphics and the like continuously hidden in the direction opposite to the scroll direction are sequentially displayed.

  Here, when the end of graphics reaches the end of the displayable range as a result of scrolling, there is no longer any graphics that are continuously hidden in the opposite direction of scrolling. As a result, graphics and the like cannot be scrolled even if there is a touch move operation by the user.

  On the other hand, when the user's operation is not accepted, the graphics and the like are not scrolled similarly. Therefore, when the graphics or the like does not scroll, it is clear to the user whether the end of the graphics or the like has reached the end of the displayable range or the operation is not accepted. Not. For this reason, operational stress occurs due to the absence of an appropriate response to the operation for the user, and usability is reduced.

  For such a problem, there is a method of controlling display items to be scrolled with a display effect corresponding to a scroll instruction (see Patent Document 1). Here, for example, when the user performs a touch move operation on the display unit from top to bottom, the display item scrolls downward on the Y axis. At this time, the display item is displayed tilted with the X axis as the center so that the scroll direction is in front.

  Furthermore, there is a method of displaying a display object such as a horizontal line at a different arrangement density in accordance with the image feed direction (scroll direction) when simultaneously displaying a plurality of images (scrolling) (see Patent Document 2).

JP2015-35092A JP 2007-43247 A

  In the above-mentioned Patent Documents 1 and 2, when the end of graphics or the like reaches the end of the displayable range, even if the scrolling of graphics or the like stops, the operation by the user is accepted to some extent. Can be revealed. That is, the user can know that the operation by the user is accepted by a display effect such as tilting the display item or a display object such as a horizontal line.

  However, when graphics that have been scrolled up to now stop immediately, the change is abrupt compared to the state so far, so there is a problem that the response to the user is not appropriate and usability is still lowered. .

  Accordingly, an object of the present invention is to provide a display control device, a control method thereof, a program, and a storage medium that can notify the user that an operation has been received and can notify the end of the scroll range. Is to provide.

  In order to achieve the above object, a display control apparatus according to the present invention detects a scroll instruction operation by a display unit that displays a display target, an operation detection unit that detects a user operation on the display unit, and the operation detection unit. The display target is scrolled in response to the display, and if the instruction operation is not finished even after scrolling to the end of the display target, a display item imitating a ripple is superimposed on the display target and displayed. And display control means for controlling the display item so as to move in the direction of scrolling by the instruction operation.

  According to the present invention, it is possible to notify the user that the operation has been accepted and to notify that the end of the scroll range has been reached.

It is a block diagram which shows the structure about the electronic device provided with an example of the display control apparatus by the 1st Embodiment of this invention. It is a figure for demonstrating an example of the transition of the screen displayed on the display shown in FIG. 3 is a flowchart for explaining a display control process performed by the PC shown in FIG. 1 (No. 1). 7 is a flowchart for explaining a display control process performed by the PC shown in FIG. 1 (part 2). It is a figure for demonstrating an example of the transition of the screen displayed on a display in PC concerning the 2nd Embodiment of this invention. It is a flowchart for demonstrating the display control process performed by PC concerning the 2nd Embodiment of this invention (the 1). It is a flowchart for demonstrating the display control process performed by PC concerning the 2nd Embodiment of this invention (the 2).

  Hereinafter, an example of a display control apparatus according to an embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing the configuration of an electronic apparatus provided with an example of a display control apparatus according to the first embodiment of the present invention. The illustrated electronic device 100 can be configured using, for example, a personal computer (hereinafter referred to as a PC).

  The PC 100 includes a CPU 101, a memory 102, a nonvolatile memory 103, an image processing unit 104, a display 105, an operation unit 106, a recording medium I / F 107, an external I / F 109, and a communication I / F 110. These blocks are connected to each other by an internal bus 150 and can transmit and receive data to and from each other via the internal bus 150.

  The memory 102 is, for example, a RAM. For example, the CPU 101 controls the PC 100 using the memory 102 as a work memory in accordance with a program stored in the nonvolatile memory 103. The non-volatile memory 103 stores image data, audio data, other data, various programs that operate on the CPU 101, and the like. The nonvolatile memory 103 is composed of, for example, a hard disk (HD) and a ROM.

  The image processing unit 104 performs predetermined image processing on the image data recorded in the nonvolatile memory 103 or the external storage medium 108 under the control of the CPU 101. Furthermore, the image processing unit 104 performs predetermined image processing on a video signal obtained via the external I / F 109 or image data obtained via the communication I / F 110. Examples of the image processing performed by the image processing unit 104 include A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), and noise reduction processing. And color conversion processing.

  The image processing unit 104 may be configured with a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 may perform image processing instead of the image processing unit 104.

  The display 105 displays an image and a GUI screen constituting a GUI (Graphical User Interface) under the control of the CPU 101. The CPU 101 generates a display control signal according to the program, further generates a video signal to be displayed on the display 105, and outputs the video signal to the display 105.

  The display 105 displays a video (image) based on the video signal. Note that the PC 100 itself does not include the display 105, and an external monitor (such as a television) may be used as the display 105.

  The operation unit 106 includes a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel, a button, a dial, a joystick, a touch sensor, and a touch pad. The operation unit 106 is used as an input device when receiving a user operation.

  The touch panel is arranged so as to overlap the display 105. The touch panel outputs coordinate information corresponding to the position (touch position) where the user touches, and functions as a touch detection unit. When the operation unit 106 includes a touch panel, the CPU 101 can detect the following operations and states on the touch panel.

  The CPU 101 detects that a finger or pen that has not touched the touch panel newly touched the touch panel, that is, that touch has been started (hereinafter referred to as touch-down).

  The CPU 101 detects that the touch panel is touched with a finger or a pen (hereinafter referred to as touch-on).

  The CPU 101 detects a state where the touch panel is moved while being touched with a finger or a pen (hereinafter referred to as touch-move, touch movement operation).

  The CPU 101 detects that the finger or pen that has been touching the touch panel has been released, that is, the touch operation has been completed (hereinafter referred to as touch-up).

  The CPU 101 detects a state where nothing is touched on the touch panel (hereinafter referred to as touch-off).

  At the same time that the touchdown is detected, the CPU 101 also detects that the touch is on. After the touchdown, unless the touchup is detected, the CPU 101 normally continues to detect the touch-on state.

  When a touch move is detected, a touch-on is detected. Even if the touch-on is detected, if the touch position has not moved, the CPU 101 does not detect the touch move. When it is detected that all the fingers or pens that have been touched have touched up, the CPU 101 detects touch-off.

  These operations and states, and the position coordinates where the finger or pen touches the touch panel are sent to the CPU 101 via the internal bus 150. The CPU 101 detects what operation is performed on the touch panel based on the position coordinates. For the touch move, the CPU 101 detects the moving direction of the finger or pen moving on the touch panel for each vertical component and horizontal component on the touch panel based on the change of the position coordinates.

  Further, it is assumed that a stroke is drawn when touch-up is performed through a certain touch move from touch-down on the touch panel. The operation of drawing a stroke quickly is called flicking. A flick is an operation in which a finger is quickly moved by a certain distance while touching the touch panel and then released. In other words, flicking is an operation that quickly traces the touch panel with your finger. When it is detected that a touch distance is moved at a predetermined speed or more for a predetermined distance or more and further a touch-up is detected, the CPU 101 determines that a flick has been performed. Further, when it is detected that the touch move is performed at a predetermined distance or more at a speed lower than the predetermined speed, the CPU 101 determines that the drag has been performed.

  As a touch panel, for example, any type of touch panel among various types of touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method is used. It may be used.

  An external storage medium 108 such as a memory card, CD, or DVD can be attached to the recording medium I / F 107. The recording medium I / F 107 reads data from the external storage medium 108 under the control of the CPU 101 and writes data to the external storage medium 108. The external I / F 109 is an interface that is connected to an external device by a wired cable or wirelessly and inputs and outputs video signals and audio signals. The communication I / F 110 is an interface for communicating with an external device or a network (NET) 111 such as the Internet and transmitting / receiving various data such as files and commands.

  FIG. 2 is a diagram for explaining an example of the transition of the screen displayed on the display shown in FIG. FIG. 2A is a diagram illustrating a state in which a touchdown operation is performed, and FIG. 2B is a diagram illustrating a state in which a touch move operation is performed. FIG. 2C is a diagram illustrating a state where the scroll end is reached, and FIGS. 2D and 2E are diagrams illustrating a state where the touch move operation continues after reaching the scroll end. It is. Further, FIG. 2 (f) is a diagram showing a state in which the touch move operation is completed, and FIG. 2 (g) is a diagram showing a state in which the touch move operation is completed and the original thumbnail image is returned to the position. is there.

  Here, the CPU 101 displays an index of a plurality of thumbnail images on the display 105. The CPU 101 scrolls a plurality of thumbnail images from top to bottom or from bottom to top in response to a touch move operation from the top to the bottom or from the bottom to the top by the user. When the CPU 101 reaches the scroll end, it stops scrolling the plurality of thumbnail images. Then, the CPU 101 displays “ripple” in the vicinity of the touch point by the user. Here, the “ripple” means, for example, a pattern such as a single or multiple waves that advance so that an arc spreads in the traveling direction (scroll direction). Further, the CPU 101 moves the ripple in the direction of the touch move operation (that is, from the top to the bottom or from the bottom to the top).

  Each thumbnail image is sequentially arranged from the left end of the line to the right end in a predetermined order based on the file name, image number, shooting date order, etc., and then from the left end to the right end of the line located below the line. The

  In FIG. 2A, thumbnail images 201 to 204 are displayed on the display 105. In the state shown in FIG. 2A, the thumbnail images 201 to 204 have not reached the end of the scroll. Assume that the user performs a touchdown operation on the screen in this state.

  FIG. 2B shows a state where the user has performed a touch move operation (instruction operation) from the bottom to the top in the drawing. In response to the touch move operation, the CPU 101 scrolls the thumbnail images from bottom to top.

  FIG. 2C shows a state when the end of the scroll is reached while the touch move operation continues from the bottom to the top. When the end of scrolling is reached, the CPU 101 stops scrolling thumbnail images.

  FIGS. 2D and 2E show a state in which the user continues the touch move operation from the bottom to the top after reaching the end of the scroll. When the touch move operation continues after reaching the end of the scroll, the CPU 101 draws and displays, for example, a concentric ripple 205 (display item) in the vicinity of the touch point by the user (see FIG. 2D). ). The ripple 205 is a pattern including an arc that is convex in the scroll direction. When the touch move operation is further continued, the CPU 101 moves the ripple 205 from the bottom to the top faster than the moving speed of the touch point by the user (see FIG. 2E).

  In this way, when the ripple 205 is moved, the user is told that “When the paper on which the image is drawn is rubbed and slid, the edge of the paper is pressed and the paper (image) does not slide. It reminds me that “washes (ripples) occur at points rubbed by fingers”. Thus, the user recognizes that the touch move operation is accepted while clearly recognizing that the scroll movement of the thumbnail image has stopped, that is, reaching the end of the scroll.

  As shown in FIG. 2F, when the touch move operation is completed, the CPU 101 displays the ripple 205 at a position farther in the scroll direction than the touch point by the user. Thereafter, as shown in FIG. 2G, the CPU 101 stops the display of the ripples 205 (that is, does not display it).

  3A and 3B are flowcharts for explaining display control processing performed by the PC shown in FIG. Note that the processing according to the flowchart shown in the drawing is performed by the CPU 101 expanding and executing a program recorded in the nonvolatile memory 103 in the work memory area of the memory 102.

  When the display control process is started, the CPU 101 displays thumbnail images as indexes on the display 105 (step S301). Then, the CPU 101 determines whether or not a touch move operation has been performed by the user (step S302). When the touch move operation is performed (YES in step S302), CPU 101 determines the direction of the touch move operation (step S303).

  If the direction of the touch move operation is from the top to the bottom on the screen (the forward direction in step S303), the CPU 101 determines whether or not the thumbnail image is the thumbnail image located at the top end. That is, the CPU 101 determines whether or not the uppermost end of the scroll has been reached (step S304).

  When reaching the uppermost end (YES in step S304), the CPU 101 obtains a touch move operation speed (touch move speed) V0 (step S305). Subsequently, the CPU 101 acquires a point of touch (touch position coordinates) P0 by the user (step S306).

  Next, the CPU 101 determines whether or not a ripple has already been displayed on the screen (step S307). If the ripple is not yet displayed (NO in step S307), the CPU 101 displays the ripple on the thumbnail image with transparency “0” below the touch point P0 (step S308). Then, the CPU 101 returns to the process of step S302.

  If the ripple has already been displayed (YES in step S307), the CPU 101 moves the ripple from top to bottom at a speed faster than the movement speed V0 (step S309). Subsequently, the CPU 101 changes the transparency according to the distance between the ripple position and the touch point P0 (step S310). Then, the CPU 101 returns to the process of step S302.

  If it has not reached the uppermost end (NO in step S304), the CPU 101 scrolls the thumbnail image from top to bottom (forward direction) (step S311). Then, the CPU 101 returns to the process of step S302.

  When the direction of the touch move operation is from the bottom to the top on the screen (the reverse direction in step S303), the CPU 101 determines whether or not the thumbnail image is a thumbnail image located at the lowest end. That is, the CPU 101 determines whether or not the lowest scroll end has been reached (step S312).

  When the lowest end is reached (YES in step S312), CPU 101 obtains touch move speed V0 (step S313). Subsequently, the CPU 101 acquires a touch point P0 by the user (step S314). Then, the CPU 101 determines whether or not a ripple is already displayed on the screen (step S315).

  If the ripple has not yet been displayed (NO in step S315), the CPU 101 displays the ripple superimposed on the thumbnail image with transparency “100” (transparent state) above the touch point P0 (step S316). . Then, the CPU 101 returns to the process of step S302.

  If the ripple is already displayed (YES in step S315), the CPU 101 moves the ripple from the bottom to the top at a speed higher than the movement speed V0 (step S317). Subsequently, the CPU 101 changes the transparency according to the distance between the ripple position and the touch point P0 (step S318). Specifically, as the ripple position and the touch point P0 move away from each other, the transparency is lowered, and when the upward touch movement is continued, the ripple appears gradually and becomes deeper. Then, the CPU 101 returns to the process of step S302.

  If the lowest end has not been reached (NO in step S312), the CPU 101 scrolls the thumbnail image from the bottom to the top (reverse direction) (step S319). Then, the CPU 101 returns to the process of step S302.

  If the touch move operation is not performed (NO in step S302), CPU 101 determines whether or not a ripple is displayed on the screen (step S320). When the ripple is displayed (YES in step S320), the CPU 101 generates the ripple in the same direction as the ripple has moved so far and at the same speed as the ripple has been moved so far. Move (step S321). Further, the CPU 101 changes the transparency so that the transparency of the ripple decreases as the distance between the last touch point P0 and the ripple increases (step S322). Then, the CPU 101 returns to the process of step S320.

  If the ripple is not displayed (NO in step S320), CPU 101 determines whether or not a predetermined end condition such as a preset standby time has elapsed (step S323). The case where the ripple is not displayed is, for example, a case where the ripple exceeds the display area of the display 105 due to the movement of the ripple, and the ripple is no longer displayed. When the end condition is satisfied (YES in step S323), CPU 101 ends the display control process. On the other hand, if the end condition is not satisfied (NO in step S312), CPU 101 returns to the process of step S302.

  Here, an example has been described in which thumbnail images are indexed in 2 rows × 2 columns and scrolled up and down as shown in FIG. On the other hand, the display control process may be performed in the same manner when index display is performed with the number of rows and the number of columns other than 2 rows × 2 columns. The display control process may be performed in the same manner when scrolling in the left-right direction.

  As mentioned above, when the ripples are displayed and moved, the user says, “When the paper on which the image is drawn is rubbed and slid, the edge of the paper is pressed and the paper (image) does not slide. It can be recalled that a wrinkle / ripple is generated at a point being rubbed with a finger. Thus, the user can recognize that the end of the scroll has been reached and can recognize that the touch move operation has been normally received.

  Such ripples become deeper as the movement from the point where the ripples occur. Then, the farther away from the touch point (the greater the amount of touch movement after reaching the edge), the less the ripple transparency (transmittance), the user recognizes that the ripple is generated by the touch move operation. Become. Furthermore, it is possible to recognize that the wrinkle caused by pulling the paper matches the feeling that the larger the pulling force is, the larger the wrinkle is, and that the wrinkle has reached the end intuitively.

  When the edge is reached, a ripple with a transmittance of 0% is displayed, and as the amount of touch movement in the same direction from when the edge is reached to when the edge is reached, the ripple transparency (transmittance) increases. You may make it do. By doing in this way, the impression like a ripple when a finger touches the water surface can be given. That is, a ripple is generated by touching the water surface with a finger, and the ripple itself spreads greatly as it moves away, but an impression can be given that the amplitude is reduced and the ripple disappears.

  Instead of changing the transparency, the width of the ripples may be increased as the distance from the touch point increases, or the outline thereof may be unclear.

  Thus, in the first embodiment of the present invention, when a predetermined user operation such as a touch move operation is detected, the thumbnail image is scrolled. When reaching the end of the thumbnail image, a ripple is displayed near the touch point, and the ripple is moved in the same direction as the scroll direction. Thus, it is possible to notify the user that the touch move operation has been accepted and to notify that the end of the scroll has been reached.

[Second Embodiment]
Next, an example of a PC including a display control device according to the second embodiment of the present invention will be described. The configuration of the PC according to the second embodiment is the same as that of the PC shown in FIG.

  In the first embodiment described above, a plurality of thumbnail images are displayed as an index on the display 105, and the thumbnail images are scrolled forward or backward according to the touch move operation. When reaching the end of the scroll, the scrolling of the thumbnail image is stopped, a ripple is displayed near the touch point, and the thumbnail image is moved in the same direction as the user operation direction (scroll direction). On the other hand, in the second embodiment, when the end of scrolling is reached, scrolling of the thumbnail image is stopped and “distortion” is formed in the thumbnail image in the vicinity of the touch point. That is, an image obtained by distorting the original thumbnail image in the scroll direction (distorted image) is superimposed and displayed on the original thumbnail image.

  As in the first embodiment, each thumbnail image is positioned from the left end to the right end of a row in a predetermined order based on the file name, image number, shooting date / time order, and the like, and subsequently below the row. Arranged sequentially from the left end to the right end of the line.

  FIG. 4 is a diagram for explaining an example of transition of screens displayed on the display in the PC according to the second embodiment of the present invention. FIG. 4A is a diagram illustrating a state in which a touchdown operation is performed, and FIG. 4B is a diagram illustrating a state in which a touch move operation is performed. FIG. 4C is a diagram illustrating a state where the scroll end is reached, and FIGS. 4D and 4E are diagrams illustrating a state where the touch move operation is continued after reaching the scroll end. It is. Further, FIG. 4 (f) is a diagram showing a state in which the touch move operation is completed, and FIG. 4 (g) is a diagram showing a state in which the touch move operation is completed and the original thumbnail image is returned to the position. is there.

  In FIG. 4A, thumbnail images 401 to 404 are displayed on the display 105. In the state shown in FIG. 4A, the thumbnail images 401 to 404 do not reach the end of the scroll. Assume that the user performs a touchdown operation on the screen in this state.

  FIG. 4B shows a state where the user has performed a touch move operation from the bottom to the top in the drawing. In response to the touch move operation, the CPU 101 scrolls the thumbnail images from bottom to top.

  FIG. 4C shows a state when the end of the scroll is reached while the touch move operation is continuing from the bottom to the top. When the end of scrolling is reached, the CPU 101 stops scrolling thumbnail images.

  4D and 4E show a state in which the user continues the touch move operation from the bottom to the top after reaching the end of the scroll. When the touch move operation continues after reaching the end of the scroll, the CPU 101 superimposes and displays a distortion image 405 distorted in the direction of the touch move operation in the vicinity of the touch point by the user (see FIG. 4D). ). When the touch move operation is further continued, the CPU 101 increases the degree of distortion of the distortion image 405 as the touch point moves (see FIG. 4E).

  In this manner, although the movement of the thumbnail image is stopped, the distorted image is superimposed and displayed according to the user's touch move operation, and the degree of the distortion is increased with the movement of the touch point. As a result, when the user rubs and slides something like a cloth with some degree of elasticity on which an image is drawn, if the end is pressed and cannot slide, the point rubbed with the finger is distorted. Reminds me of how this happens. Then, the user can clearly recognize that the scroll movement of the thumbnail image has stopped, that is, the end of the scroll has been reached, while the touch move operation is accepted.

  As shown in FIG. 4F, when the touch move operation is completed, the CPU 101 gradually decreases the degree of distortion in the distorted image. Finally, as shown in FIG. 4G, the CPU 101 stops displaying the distorted image (that is, does not display it).

  5A and 5B are flowcharts for explaining display control processing performed by the PC according to the second embodiment of the present invention.

  Note that the processing according to the flowchart shown in the drawing is performed by the CPU 101 expanding and executing a program recorded in the nonvolatile memory 103 in the work memory area of the memory 102. In the illustrated flowchart, the same steps as those in the flowcharts shown in FIGS. 3A and 3B are denoted by the same reference numerals, and description thereof is omitted.

  In step S304, if the uppermost end of the scroll has been reached (YES in step S304), CPU 101 determines whether or not a distorted image has already been displayed (step S501). If the distorted image is not yet displayed (NO in step S501), the CPU 101 proceeds to the process of step S306, and acquires the touch point (touch position coordinates) P0 by the user.

  Subsequently, the CPU 101 acquires a predetermined range area (that is, a part of the image: the image G0) in the thumbnail image located in the vicinity of the touch point P0 (step S502). Then, the CPU 101 superimposes and displays the image G0 on the touch point P0 as a distorted image (distorted portion) (step S503). Thereafter, the CPU 101 returns to the process of step S302.

  If a distorted image has already been displayed (YES in step S501), CPU 101 obtains touch point P by the user (step S504). Then, the CPU 101 generates an image G (distortion image) in which the degree of distortion is changed in the forward direction (that is, downward) based on the distance between the touch point P0 and the touch point P (step S505). Subsequently, the CPU 101 superimposes the distortion image on the touch point P0 (step S506). Thereafter, the CPU 101 returns to the process of step S302.

  In step S312, when the bottom end of the scroll has been reached (YES in step S312), CPU 101 determines whether a distorted image has already been displayed (step S506). If the distorted image is not yet displayed (NO in step S506), CPU 101 obtains touch point P0 by the user (step S507).

  Subsequently, the CPU 101 acquires a predetermined range area (image G0) in the thumbnail image located in the vicinity of the touch point P0 (step S508). Then, the CPU 101 superimposes and displays the image G0 on the touch point P0 as a distorted image (step S509). Thereafter, the CPU 101 returns to the process of step S302.

  If the ripple has not been displayed yet (NO in step S315), the CPU 101 displays the ripple superimposed on the thumbnail image with transparency “0” above the touch point P0 (step S316). Then, the CPU 101 returns to the process of step S302.

  If a distorted image has already been displayed (YES in step S506), CPU 101 obtains touch point P by the user (step S510). Then, the CPU 101 generates an image G (distortion image) in which the degree of distortion is changed in the reverse direction (that is, upward) based on the distance between the touch point P0 and the touch point P (step S511). Subsequently, the CPU 101 superimposes the distortion image on the touch point P0 (step S512). Thereafter, the CPU 101 returns to the process of step S302.

  If the touch move operation is not performed in step S302 (NO in step S302), the CPU 101 determines whether the degree of distortion of the thumbnail image is “0” (step S513). If the degree of distortion is “0” (YES in step S513), CPU 101 proceeds to the process in step S323. On the other hand, if the degree of distortion is not “0” (NO in step S513), the CPU 101 generates an image (distorted image) with the degree of distortion reduced and superimposes it on the touch point P0 (step S514). Then, the CPU 101 returns to the process of step S513.

  In the second embodiment as well, the display control process may be performed in the same way even when the index display is performed with the number of rows and the number of columns other than 2 rows × 2 columns. The display control process may be performed in the same manner when scrolling in the left-right direction.

  As described above, when the end of the scroll is reached, the distortion image is displayed and the degree of distortion of the distortion image is increased as the distance from the touch point is increased. As a result, when the user rubs something like a cloth with a certain degree of elasticity on which an image is drawn by rubbing with a finger and the end is pressed and does not slide, the point being rubbed with the finger Can be recalled. As a result, the user can recognize that the end of the scroll has been reached, and can recognize that the touch move operation has been normally received.

  The above-described distortion increases as the finger is further slid after the end of the cloth is pressed, for example. Therefore, if the distortion is increased as the touch point is moved away from the touch point by the user when the end of the scroll is reached, the effect of recognizing that the distortion is generated by the touch move operation can be further enhanced.

  As described above, in the second embodiment of the present invention, when a predetermined user operation such as a touch move operation is detected, the thumbnail image is scrolled. When the end of the thumbnail image is reached, a distorted image is displayed and the degree of distortion is increased in accordance with the movement of the touch point. Thus, it is possible to notify the user that the touch move operation has been accepted and to notify that the end of the scroll has been reached.

  In the above-described embodiment, the CPU 101 functions as an operation detection unit (touch detection unit) that detects a user operation on the display 105. The above-described various controls described as being performed by the CPU 101 may be performed by a single piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. . Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and it is also possible to combine each embodiment suitably.

  In the above-described embodiment, the case where the present invention is applied to a PC has been described as an example. However, the present invention is not limited to this example and can be applied to any device having a display. That is, the present invention is applied to a PDA, a mobile phone terminal, a portable image viewer, a printer device including a display, a digital photo frame, a game machine, an electronic book reader, a tablet terminal, a smartphone, a home appliance or an in-vehicle device including a display. Is possible.

[Other Embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100 PC
101 CPU
102 Memory 103 Nonvolatile Memory 104 Image Processing Unit 105 Display 106 Operation Unit 107 Storage Medium I / F
109 External I / F
110 Communication I / F

Claims (18)

A display unit for displaying a display target;
An operation detection unit for detecting a user operation on the display unit;
The display object is scrolled in response to detection of a scroll instruction operation by the operation detection unit, and when the instruction operation is not finished even after scrolling to the end of the display object, a ripple is imitated Display control means for displaying a display item superimposed on the display object, and controlling the display item to move in a scroll direction by the instruction operation;
A display control device comprising: The operation detection unit is a touch detection unit that detects a touch operation on the display unit,
The scroll instruction operation is a touch movement operation that moves while touching the display unit,
When the instruction operation is not completed even after scrolling to the end of the display target, the same direction as the scroll direction from the state where the end is not reached to the state where the end is reached is indicated. The display control device according to claim 1, wherein the movement of the touch movement operation is continued in the direction to be performed.   The display control apparatus according to claim 1, wherein the display item has a pattern including an arc that protrudes in a scroll direction by the instruction operation.   The display control apparatus according to claim 3, wherein the display item is a plurality of concentric patterns of the arcs.   When a plurality of display objects are displayed on the display unit, the display control unit displays the display item superimposed on the display object displayed at a point on the screen where the instruction operation is performed. The display control apparatus of any one of Claims 1 thru | or 4.   The display control apparatus according to claim 1, wherein when the instruction operation is not detected by the operation detection unit, the display control unit hides the display item.   The said display control means moves the said display item in the same direction according to the movement of the point of the screen with the said instruction | indication operation, The one of Claim 1 thru | or 6 characterized by the above-mentioned. Display control device.   The display control apparatus according to claim 7, wherein the display control unit moves the display item at a speed larger than a moving speed of a point on the screen where the instruction operation is performed.   The display control apparatus according to claim 8, wherein the display control unit increases the transparency of the display item as the point on the screen where the instruction operation is performed is separated from the display item. A display unit for displaying a display target;
An operation detection unit for detecting a user operation on the display unit;
In the case where the display object is scrolled in response to detection of the scroll instruction operation by the operation detection unit, and the instruction operation is not completed even after scrolling to the end of the display object, the instruction operation Display control means for controlling to deform and display at least a part of the display object so as to be distorted in the scroll direction according to the point of the screen indicated by
A display control device comprising: The operation detection unit is a touch detection unit that detects a touch operation on the display unit,
The scroll instruction operation is a touch movement operation that moves while touching the display unit,
When the instruction operation is not completed even after scrolling to the end of the display target, the same direction as the scroll direction from the state where the end is not reached to the state where the end is reached is indicated. The display control apparatus according to claim 10, wherein the touch movement operation continues to move in a direction to be performed.   When a plurality of display objects are displayed on the display unit, the display control unit displays the display object displayed at a point on the screen where the instruction operation is performed with the deformation. The display control apparatus according to claim 10 or 11.   The display control apparatus according to claim 10, wherein the display control unit stops the deformation when the instruction operation is no longer detected by the operation detection unit.   The display control according to any one of claims 10 to 13, wherein the display control means changes a degree of distortion in the deformation in accordance with a change in a point on the screen where the instruction operation is performed. apparatus. A control method of a display control device for displaying a display target on a display unit,
A detection step of detecting a user operation on the display unit;
A first control step of scrolling the display object when a scroll instruction operation is detected in the detection step;
If the instruction operation is not finished even after scrolling to the end of the display object, a display item imitating ripples is displayed superimposed on the display object, and the display item is scrolled by the instruction operation. A second control step for controlling to move in the direction of
A control method characterized by comprising: A control method of a display control device for displaying a display target on a display unit,
A detection step of detecting a user operation on the display unit;
A first control step of scrolling the display object when a scroll instruction operation is detected in the detection step;
If the pointing operation is not completed even after scrolling to the end of the display target, at least a part of the display target is distorted in the scroll direction according to the point of the screen specified by the pointing operation. A second control step for controlling so as to display the distortion part deformed
A control method characterized by comprising:   The program for functioning a computer as each means of the display control apparatus as described in any one of Claims 1 thru | or 14.   A computer-readable storage medium storing a program for causing a computer to function as each unit of the display control device according to any one of claims 1 to 14.