JP6251948B2 - Display device, image forming apparatus, and display control program - Google Patents

Description

  The present invention relates to a display device, an image forming apparatus, and a display control program, and more particularly to a display device having a touch panel, an image forming apparatus equipped with the display device, and a display control program.

  It is possible to operate a mobile terminal such as a mobile phone or an image forming apparatus such as an MFP (Multi-Functional Peripheral) with a gesture called flick or pan, which moves or slides a finger on the mounted touch panel. It is becoming possible. Such an operation is intuitive and operability can be improved.

JP 2011-14078 A

  However, if the display screen is scrolled by gesture operations such as flicking and panning, the end of the display screen does not appear even if the touch panel display reaches the top or end of the display screen, so the user reaches the end. There is a problem that it is difficult to notice that. If the edge of the display screen does not appear on the display, the user sees that the display screen does not scroll even though the user scrolls several times after being displayed on the touch panel to the edge of the display screen. For the first time, you will notice that the display has reached the edge of the display screen. At this time, the user may perform a scroll operation a plurality of times in consideration of the possibility of an operation error. Therefore, the operation efficiency is lowered.

  On the other hand, for example, a scroll bar is also displayed on the display screen. However, when performing a gesture operation, the user's line of sight is on the target display screen and the scroll bar is confirmed. In many cases, the problem that it is difficult to notice that the display has reached the edge of the display screen cannot be solved.

  In addition, for example, in Japanese Patent Application Laid-Open No. 2011-14078 (Patent Document 1), when the display reaches the end of the display screen, the display is once displayed up to the margin area outside the end and then returned to the display end. The technique which performs is disclosed.

  However, when this technique is used, a blank area outside the edge of the display screen is displayed, so that there is a problem that the display area of the display screen is reduced and the display content is reduced. For example, when there are five display items on the display screen, the display range for two items is used for displaying the blank area, so that the number of display items is reduced from five to three.

  The present invention has been made in view of such problems, and can easily recognize that the display on the touch panel has reached the end of the display screen without reducing the display range of the display screen. An object of the present invention is to provide an image forming apparatus and a display control program.

In order to achieve the above object, according to one aspect of the present invention, the display device is a display device having a touch panel, the storage means for storing a display screen generated based on electronic information, and the touch panel The detection means for detecting that the scroll operation for the display on the touch panel has been performed and the display range displayed on the touch panel of the display screen are displayed even if the display range is moved in the scroll direction indicated by the scroll operation. Scroll processing means for moving the display range in the scroll direction to display on the touch panel when it does not reach the end of the screen, and the display range reaches the first end of the display screen by moving in the scroll direction when, to deform the first display image showing the contents of the display screen at the time of reaching the scroll direction Tatchipane And a transformation processing means for displaying on. Deformation processing means of the first display image, the scroll direction, the far side is compressed to a first end of the display screen than the position of accepting the scroll operation, to expand the side closer.
Preferably, the deformation processing means compresses the first display image on the side far from the first end with respect to the deformation boundary, with a straight line orthogonal to the scroll direction including the position where the scroll operation is received as a deformation boundary, The first display image on the near side is enlarged.
Preferably, the deformation processing unit compresses the first display image to be deformed from the position where the scroll operation is received to the second end of the display screen farther from the first end, and accepts the scroll operation. Enlarge from the position to the first end.

  Preferably, the display device further includes calculation means for calculating the deformation amount from the speed of the scroll operation.

Preferably, the deformation processing means has a first end portion in the image after deformation of the first display image when an operation in the scroll direction is further performed after the display range reaches the first end portion of the display screen. A margin area is displayed adjacent to the side.

  Preferably, the deformation processing means fixes the display position of the end of the display screen to the display position before the deformation, divides the display range into two areas in the scroll direction, and enlarges the area on the front side in the scroll direction. Then, the area on the rear side in the scroll direction is compressed.

Preferably, the deformation processing unit deforms the first display image other than characters in the display range.
Preferably, the maximum value of the compression ratio is a ratio at which characters included in the display screen have a predetermined minimum size.

  Preferably, the deformation processing means compresses the side farther from the end of the display screen than the position where the scroll operation is received in the scroll direction of the display on the touch panel, and enlarges the near side.

  More preferably, the deformation processing means greatly deforms the deformation amount as the position closer to the position where the scroll operation is received.

Preferably, the deformation processing unit deforms the knob of the scroll bar displayed on the touch panel together with the display range of the display screen according to the deformation of the first display image.
According to another aspect of the present invention, a display device having a touch panel has a storage unit for storing a display screen generated based on electronic information, and a touch operation on the touch panel is performed on the touch panel. When the display means displayed on the touch panel of the display screen does not reach the end of the display screen even if it is moved in the scroll direction indicated by the scroll operation Scroll processing means for moving the image in the scroll direction to display on the touch panel, and when the display range reaches the first end of the display screen by moving in the scroll direction, the contents of the display screen at the time of arrival are displayed. a first display image is deformed in the scroll direction and a deformation processing means for displaying on the touch panel shown The deformation processing means uses a straight line orthogonal to the scroll direction including the position where the scroll operation is received as a deformation boundary , compresses the first display image far from the first end with respect to the deformation boundary, and The first display image closer to the part is enlarged .
Preferably, the deformation processing unit compresses the image farther from the first end with respect to the deformation boundary and displays a blank area adjacent to the first end.
Preferably, when the display range reaches the first end of the display screen by moving the deformation processing means in the scroll direction, the second of the display screen far from the first end at the time of arrival is displayed. The first display image of the display screen in a range between the first end and the first end is deformed in the scroll direction and displayed on the touch panel.
Preferably, the deformation processing means has a first display image in a range between the second end of the display screen far from the first end at the time of arrival and the first end of the display screen. Is deformed in the scroll direction and displayed on the touch panel.
Preferably, the position where the scroll operation is received is a start position of the scroll operation.
Preferably, the scroll operation is a flick operation, and the position where the scroll operation is received is a start position of the flick operation.

According to another aspect of the present invention, an image forming apparatus includes the above-described display device.
According to still another aspect of the present invention, the display control program is a program for causing a computer to execute processing for controlling display on a touch panel of a display screen generated based on electronic information. The step of detecting that the scroll operation has been performed on the display and the display range displayed on the touch panel of the display screen reaches the end of the display screen when moved in the scroll direction indicated by the scroll operation. Determining whether or not to move the display range, and moving the display range in the scroll direction when the display range does not reach the end of the display screen. When the display range reaches the edge of the display screen by moving it, The display range is fixed to the range between the display position at the end far from the display screen edge when the end of the display screen is reached and the end of the display screen, and the image in that range is scrolled. And causing the computer to execute a step of deforming and displaying on the touch panel.

  According to the present invention, the user can easily be aware that the display on the touch panel has reached the end of the display screen without reducing the display range of the display screen.

1 is a diagram illustrating a specific example of a configuration of an image forming system according to an embodiment. 1 is a schematic diagram illustrating a schematic hardware configuration of an image forming apparatus included in an image forming system. 3 is a flowchart showing the flow of overall processing in the image forming apparatus. It is a figure showing the example of a display of the screen based on electronic information. It is a figure showing the example of a display of the screen based on electronic information. It is a figure showing the example of a display of the screen based on electronic information. It is a figure showing the example of a display of the screen based on electronic information. It is a figure showing the scroll gesture. It is a figure showing the specific example of the relationship of the scroll speed with respect to gesture operation speed. It is a figure showing the specific example of the change of the display according to a scroll gesture. It is a figure showing the specific example of the change of the display according to a scroll gesture. It is a figure showing the specific example of transition of the scroll speed in one scroll operation. It is a figure showing the specific example of the relationship of the deformation amount with respect to scroll speed. It is a figure showing the specific example of transition of the change of the deformation amount in one deformation operation. 3 is a block diagram illustrating a specific example of a functional configuration of the image forming apparatus. FIG. It is a flowchart showing the flow of a process of the operation panel of step S7 of FIG. It is a flowchart showing the flow of the deformation | transformation process in FIG.16 S115. It is a figure showing the specific example of the change of the display according to a scroll gesture in the 1st modification. It is a figure showing the specific example of the change of the display according to a scroll gesture in the 3rd modification. It is a figure for demonstrating the relationship between a display screen and a display range before and after the display range on a touch panel reaches | attains the edge part of a display screen.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

  In the following example, it is assumed that a control device for controlling a touch panel included in the display device is included in the image forming device, but the control device is a separate device connected to the image forming device, It may control a display on an operation panel which is a touch panel of the image forming apparatus. That is, the display on the touch panel may be controlled by being included in a device different from the touch panel included in the display device and a control device for controlling the display, and communicating with each other.

  Further, an apparatus including a display device having a touch panel is not limited to an image forming apparatus, and may be included in any apparatus.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of the image forming system according to the present embodiment. Referring to FIG. 1, in the image forming system, a plurality of image forming apparatuses 1-1A,... 1-1N and a plurality of information processing apparatuses 3-1A,. 4-1 is connected to a plurality of image forming apparatuses 1-2A, ... 1-2N and a plurality of information processing apparatuses 3-2A, ... 3-2M via a network 4-2. The second system is connected via the external network 5.

  The image forming apparatus 1-1A,... 1-1N, 1-2A,... 1-2N is represented by the image forming apparatus 1, the information processing apparatuses 3-1A,... 3-1M, 3-2A,. The information processing device 3 will be referred to as a representative.

  The network 4 may be any one of a network using a dedicated line such as a LAN (Local Area Network), a network using a general line such as the Internet, and a network using wireless communication. Also, the external network 5 may be any of a network using a dedicated line such as a LAN, a network using a general line such as the Internet, a network by wireless communication, and the like. Further, the image system may be connected to another system via the external network 5.

  In the present embodiment, it is assumed that the image forming apparatus 1 is a so-called MFP (Multi Function Peripherals) having a function as a digital composite bag having a scanner, a copy, and a printer function. However, the image forming apparatus 1 is not limited to an MFP as long as the apparatus has a touch panel as an operation unit and a display unit, and may be another device such as a scanner or a copy.

  The image forming apparatus 1 is an apparatus that forms on a sheet a copy image of a document image obtained by scanning and an image generated from print data transmitted from the information processing apparatus 3. Here, the print data is a drawing instruction in a page description language obtained by converting a drawing instruction issued by the operating system or application program of the information processing apparatus 3 into a page description language that can be processed by the image forming apparatus 1 by a printer driver, or This is document data described in a file format such as PDF (Portable Document Format), TIFF (Tagged Image File Format), JPEG (Joint Photographic Experts Group), XPS (XML Paper Specification).

  The original image obtained by scanning may be subjected to various settings (file format, layout setting, resolution setting, etc.) in the image forming apparatus and transmitted to the information processing apparatus 3 or the like via the network 4.

  The information processing apparatus 3 may be a general personal computer or the like. The information processing apparatus 3 generates print data according to a user instruction and transmits the generated print data to the image forming apparatus 1.

<Device configuration>
FIG. 2 is a schematic diagram illustrating a schematic hardware configuration of the image forming apparatus 1.

  Referring to FIG. 2, the image forming apparatus 1 includes a control unit 100. The control unit 100 includes a CPU (Central Processing Unit) 101 for controlling the entire apparatus, and a ROM (Read Only) for storing a control program. Memory) 102, an S-RAM (Static Random Access Memory) 103 serving as a working storage area, a battery-backed NV-RAM (nonvolatile memory) 104 for storing various settings relating to image formation, and a clock An IC (Integrated Circuit) 105 is included.

  The control unit 100 includes an image reading device 120 via a bus, a key switch group including a display unit, which is a touch panel, a numeric key, a print key, a logout key, and the like, each having a key and a display unit for performing various inputs. And an operation panel 130 having an operation control unit, and a network for transmitting and receiving various types of information to and from external devices such as the information processing device 3 connected via the networks 4-1, 4-2 and 5 An I / F (interface) 160, a printer controller 150 for generating a copy image from print data received by the network I / F 160, and an image output device 140 for forming the copy image on paper are connected. Yes.

  A fixed storage device 110 is connected to the control unit 100 via a bus. The fixed storage device 110 corresponds to, for example, a hard disk device.

<Overview of operation>
FIG. 3 is a flowchart showing the overall processing flow in the image forming apparatus 1. The processing shown in the flowchart of FIG. 3 is realized by the CPU 101 included in the control unit 100 reading out a program stored in the ROM 102, developing it on the S-RAM 103, and executing it. The process shown in FIG. 3 is started by turning on the power.

  Referring to FIG. 3, when processing is started, CPU 101 first performs initialization processing such as memory clearing and standard mode setting (step S1).

  When the initialization process is completed, the CPU 101 needs to control display on the display unit, which is a touch panel, by the user on the key switch group on the operation panel 130 of the image forming apparatus 1 and the operation on the display unit, which is a touch panel. It is confirmed whether any processing request (copy processing, various setting processing, display operation, etc.) has been made (step S3). If not requested (NO in step S3), the CPU 101 proceeds to step S5.

  When the above processing request is made by the user (YES in step S3), the CPU 101 performs display processing on the display unit which is a touch panel of the operation panel 130 (step S7). The touch panel processing will be described in detail later.

  If the above processing is not requested by the user (NO in step S3), the CPU 101 requests some processing (document print processing) from an external device such as the information processing device 3 via the networks 4-1 and 4-2. , Various setting processes, etc.) are confirmed (step S5). If not requested (NO in step S5), the CPU 101 returns to step S3 and repeatedly executes the above-described processing.

  When any processing request is made from an external device (YES in step S5), the CPU 101 executes the requested processing (step S9). Here, the other processing corresponds to processing of a print job transmitted from the information processing apparatus 3, processing for changing various settings stored in the NV-RAM 104, and the like. When all the processes requested from the external device are completed, the PU 101 returns to step S3 and repeatedly executes the above-described processes.

  The image forming apparatus 1 displays a screen based on electronic information in accordance with a user instruction as display processing on the display unit that is a touch panel of the operation panel 130.

4 to 7 are diagrams showing display examples of screens based on electronic information.
Here, the electronic information refers to data for generating a display screen from a document, a list of items, images, and the like. The document information display screen may be composed of only text as shown in FIG. 4, or may include images, displays, graphs, etc. in addition to text as shown in FIG. It may be. Alternatively, the item list information display screen may be a list screen in a list format as shown in FIG. 6, and keys corresponding to items are arranged as shown in FIG. It may be what was done.

  The image forming apparatus 1 generates a display screen from the electronic information, specifies a range corresponding to the size of the operation panel 130 in the display screen as a display range, and displays the display screen in the range on the operation panel 130. .

  When the image forming apparatus 1 receives a scroll gesture that is a gesture operation for moving the display range in step S3 in a state where a part of the display screen is displayed on the operation panel 130, the process is performed on the operation panel 130 in step S7. In accordance with the operation, a process for changing a range to be displayed on the operation panel 130 in the display screen, that is, a scroll operation is performed.

FIG. 8 is a diagram showing a scroll gesture.
Referring to FIG. 8, the scroll gesture is a gesture operation called a flick or the like, and touches one point (start point) on operation panel 130 as a touch panel with a finger or the like, and maintains the touch state with distance L, This is a gesture operation for releasing the touch state by sliding the finger or the like away from the operation panel 130 at one different point (end point).

  The image forming apparatus 1 obtains the gesture operation speed v (v = L / T) by dividing the movement distance L by the operation time T that is the time from the touch until the finger or the like is released. Then, the image forming apparatus 1 scrolls the display range at a scroll speed V that is defined in advance with respect to the gesture operation speed v.

  FIG. 9 is a diagram illustrating a specific example of the relationship between the scroll speed and the gesture operation speed. For example, as shown in FIG. 9, the scroll speed V may be defined as being proportional to the gesture operation speed v (V = k × v).

  10 and 11 are diagrams showing specific examples of display changes according to the scroll gesture. As specific examples, FIG. 10 and FIG. 11 show specific examples of display changes when a list of items is displayed. At this time, preferably, a scroll bar indicating the position of the current display range on the display screen is also displayed together with the display of the list of items. Thereby, the position of the display range can be known visually.

  Further, in the examples of FIGS. 10 and 11, an example in which a flick is made upward as a scroll gesture is shown. At this time, the display range on the display screen moves downward, that is, the display on the operation panel 130 is scrolled downward.

  Referring to FIG. 10, when flick J1 is made upward when the list of items is displayed (FIG. 10A), image forming apparatus 1 performs a gesture operation from distance L and time T of flick J1. The speed v is calculated, and further, the scroll speed V is calculated using the gesture operation speed v. In the example of FIG. 9, the scroll speed is calculated by multiplying the gesture operation speed v by a coefficient stored in advance (V = k × v).

  At this time, when the image forming apparatus 1 scrolls the display range by a predetermined distance defined as the movement distance in one scroll operation, whether or not the display range reaches the end of the display screen generated from the electronic information. To check. Examples of the predetermined distance include one line when the display screen is text, one item when the display screen is a list of items, and 10 pixl when the display screen is an image.

  For example, when a gesture operation for scrolling downward is received, the image forming apparatus 1 checks whether or not the lower end of the display screen is reached when scrolling the display range downward by the predetermined distance, When a gesture operation for scrolling is accepted, it is similarly confirmed whether or not the upper end of the display screen is reached. If the image does not reach the end, the image forming apparatus 1 scrolls the display according to the gesture operation.

  In the example of FIG. 10A, since the display range is considerably above the display screen, the image forming apparatus 1 determines that it does not reach the lower end of the display screen even when scrolling downward. Therefore, it scrolls downward by a predetermined distance at the calculated scrolling speed (FIG. 10B). When a flick J2 is made upward on the screen of FIG. 10B, scrolling in the downward direction is performed in the same manner.

  At this time, preferably, the image forming apparatus 1 changes the scroll speed during the scroll operation which is a process of the operation panel 130 once. Specifically, the image forming apparatus 1 accelerates the scroll speed from the start of scrolling until reaching the maximum scroll speed, and after reaching the maximum scroll speed, gradually decelerates until the scroll speed becomes zero (stops). To do.

  FIG. 12 is a diagram illustrating a specific example of transition of scroll speed in one scroll operation. As shown in FIG. 12, the image forming apparatus 1 accelerates from the start of the scroll operation to the maximum scroll speed, with the scroll speed calculated from the gesture operation speed v using the relationship of FIG. Thereafter, the scroll speed is reduced until it becomes zero.

  As a result of repeated scrolling in the downward direction, when the display range reaches the lower end of the screen, or when a further downward flick is received in a state where the display range is at the lower end of the screen, the image forming apparatus 1 in FIG. Thus, the lower end of the display screen is once displayed as a display range.

  Thereafter, the image forming apparatus 1 raises the lower end of the display screen along the scroll speed, and increases a blank area representing an area outside the display screen upward from the lower end of the display as the lower end rises. To go. At this time, the image forming apparatus 1 fixes the display range on the display screen as the display range when the lower end of the display screen shown in FIG. 11A becomes the lower end of the display, and the display position at the upper end of the display range. Is fixed to the upper end of the display, and the display screen display is compressed (reduced) in the scroll direction (up and down direction) as the lower end of the display screen rises (FIG. 11B). In the examples of FIGS. 11B and 11C, the display position of the upper end of the display range is fixed to the upper end of the display, and the display of five items is maintained as a list of items.

  After the start of the deformation, the image forming apparatus 1 increases the amount of deformation in the scroll direction (vertical direction) of the display screen display within a predetermined time until the maximum amount of deformation (compression ratio) specified in advance is reached. After that (FIG. 11C), it is gradually decreased and changed to the screen of FIG. 11A with the deformation amount 0 through the state of FIG. 11B.

  Accordingly, the image forming apparatus 1 gradually increases the blank area until the display screen reaches the maximum deformation amount (compression rate), and then gradually decreases until the blank area becomes zero.

  At this time, preferably, the CPU 101 does not deform the object such as characters and symbols in the display range without applying the deformation amount. Thereby, even if the display is deformed by being compressed and enlarged, the readability of the user can be ensured. Note that this modification method may also be performed in a modification described later.

  The amount of deformation (compression rate) is calculated from the scroll speed. Since the scroll speed V is calculated from the gesture operation speed v, it can be said that the deformation amount is also calculated from the gesture operation speed v. That is, the deformation amount M can be expressed as a function of the gesture operation speed v (M = f (v)).

  FIG. 13 is a diagram illustrating a specific example of the relationship of the deformation amount with respect to the scroll speed. For example, as shown in FIG. 13, the deformation amount M may be defined as being proportional to the scroll speed V (straight line A: M = a × V). In this case, the image forming apparatus 1 further calculates the deformation amount from the scroll speed calculated from the gesture operation speed.

  Note that the image forming apparatus 1 may set a minimum character size in advance, and the maximum value of the deformation amount may be a compression rate that becomes the character size (polygonal line B). Thereby, even if the display is deformed by being compressed and enlarged, the readability of the user can be ensured. Note that this modification method may also be performed in a modification described later.

  The change of the deformation amount in one deformation operation changes with time. That is, the deformation rate change rate y can be expressed as a function of the elapsed time t from the start of deformation (y = G (t)).

  FIG. 14 is a diagram illustrating a specific example of the transition of the change in the deformation amount in one deformation operation. As shown in FIG. 14, the image forming apparatus 1 compresses the image by increasing the deformation amount from the start of deformation to the maximum deformation amount, with the deformation amount calculated from the scroll speed using the relationship of FIG. Thereafter, the deformation amount is reduced and enlarged until the deformation amount is 0, that is, until the original state is obtained.

  When the image forming apparatus 1 deforms the display, the image data in the display range when the lower end of the display screen is displayed as the lower end of the display is displayed in the scroll direction at the change rate y as shown in FIG. The change is continued at a predetermined time interval so that the deformation amount becomes 0 through the maximum deformation amount M from the deformation amount 0. Then, at each deformation, the upper end of the display range is fixed to the upper end of the table, and the operation panel 130 sequentially displays the display range. Further, a blank area is displayed in the display area below the display screen.

  Thus, when the display range reaches the lower end of the display screen by a downward flick, the display is changed from FIG. 11 (A) → FIG. 11 (B) → FIG. 11 (C) → FIG. 11 (B) → FIG. And change.

  At this time, preferably, the image forming apparatus 1 is a mark that expresses the position of the current display range on the display screen, the ratio of the display range to the entire display screen, and the like of the scroll bar displayed together with the list of items. As shown in FIGS. 11B and 11C, the knob is deformed in correspondence with the deformation amount. Thereby, the user can know how it is deforming visually.

  In the example using FIGS. 10 to 11 described above, an example in which flicking is performed in the vertical direction and scrolling in the vertical direction is shown, but the same applies to the horizontal direction.

  FIG. 20 is a diagram for explaining the relationship between the display screen and the display range before and after the display range on the touch panel reaches the end of the display screen. FIG. Before reaching the part, FIG. 20B shows after reaching the end.

  As shown in these figures, the “display screen” represents an image of the entire display data generated based on the electronic information, and the “display range” represents the display data on the display data. Represents the range displayed on the touch panel. In the example of FIG. 20, a rectangle having sides A and B as the upper and lower ends in the scroll direction represents a display screen that is an image of the entire display data generated from the electronic information. And the rectangle which makes edge | side b each an upper end and a lower end represents the display range in a touchscreen.

  Before reaching the end of FIG. 20A, the display range on the touch panel sandwiched between side a and side b is at any end in the image of the entire display data sandwiched between side A and side B. Has not reached.

  When a downward scroll is instructed from the state of FIG. 20A, the display range on the touch panel moves downward in the display screen, and as shown in FIG. Reaches a position where side b, which is the lower end of, coincides with side B, the lower end of the display screen. This state represents a state where the display range on the touch panel has reached the lower end of the display screen. In a state where the upper end has been reached, the side a that is the upper end of the display range coincides with the side A that is the upper end of the display screen.

  In the image forming apparatus 1, when the display range reaches the end of the display screen, as shown in FIG. 11A → FIG. 11B → FIG. 11C → FIG. 11B → FIG. The displayed image is deformed. At this time, in the example of FIG. 20B in which the scroll has reached the lower end of the display screen, the side a which is the upper end of the display range coincides with the side B which is the lower end of the display screen, as illustrated. It is fixed at the position of the side a in the state. The side b, which is the lower end of the display range, is also fixed in a state where it matches the side B, which is the lower end of the display screen. Therefore, the display range on the display screen, which is the entire image, is fixed as shown in FIG.

  On the other hand, the display content in the display area of the touch panel changes as shown in FIG. 20B with the deformation of the image displayed on the touch panel. The “display area” here corresponds to the physical concept of the touch panel. That is, the display content in the display area increases so that the lower side b of the display range gradually moves to the lower end side, and returns to the original state. A portion where the display content in the display area exceeds the display screen becomes a blank area.

  Although not shown in the drawing, when the display range reaches the upper end of the display screen as a result of scrolling, this example is reversed.

<Functional configuration>
FIG. 15 is a block diagram illustrating a specific example of a functional configuration of the image forming apparatus 1 for performing the above-described operation. Each function in FIG. 15 is a function mainly formed on the CPU 101 when the CPU 101 reads out the display control program stored in the ROM 102, develops it on the S-RAM 103, and executes it. However, at least a part may be realized by a hardware configuration such as an electric circuit.

  Referring to FIG. 15, a storage device such as fixed storage device 110 is provided with a display screen storage unit 301 which is a storage area for storing a display screen based on electronic information.

  Further, referring to FIG. 15, CPU 101 confirms that input unit 201 for accepting an instruction input by touching operation panel 130 as a touch panel, and that the gesture operation on operation panel 130 is a scroll gesture such as a flick. A detection unit 202 for detecting, a scroll direction based on a scroll gesture, a display range specifying unit 203 for specifying a display range after scrolling in the display screen, and a display for storing the display range A range storage unit 204, a determination unit 205 for determining whether or not the display range has reached the end of the display screen, and a gesture operation speed v (v = L / T) is calculated from a gesture operation that is a scroll gesture. Operation speed calculation unit 206 and gesture operation speed v A scroll speed calculation unit 207 for calculating a crawl speed, a scroll processing unit 208 for executing scroll processing as processing of the operation panel 130, and a deformation amount calculation unit 209 for calculating the deformation amount M from the scroll speed. When the deformation amount M is the maximum deformation amount, the change rate calculation unit 210 for calculating the deformation rate change rate y in a predetermined time, and when the display range after scrolling reaches the end of the display screen, A deformation processing unit 211 for performing a deformation process for deforming the display while changing the deformation amount at the change rate y with the amount M as the maximum deformation amount.

<Operation flow>
FIG. 16 is a flowchart showing the flow of display processing on the display unit which is the touch panel of operation panel 130 in step S7. The operation shown in the flowchart of FIG. 16 is realized by the CPU 101 reading out the display control program stored in the ROM 102, executing it on the S-RAM 103, executing it, and exhibiting the functions of FIG.

  Referring to FIG. 16, when the gesture operation representing the processing request from the user is a scroll gesture (YES in step S <b> 101), CPU 101 is the time from when the moving distance L is touched until the finger or the like is released. By dividing by the operation time T, the gesture operation speed v (v = L / T) is calculated (step S103). If it is not a scroll gesture, other processing is performed in response to the processing request (step S105).

  The CPU 101 further calculates a scroll speed from the gesture operation speed calculated in step S103 using a relational expression as shown in FIG. 9 stored in advance, and sets the scroll speed to the maximum scroll speed (step S107). ).

  Next, the CPU 101 determines whether or not the end of the display screen is reached when the current display is scrolled by a predetermined scroll amount (step S109). Here, the CPU 101 previously stores one line when the display screen is text, one item when the display screen is a list of items, 10 pixl when the display screen is an image, and the like as one scroll amount. In accordance with the display screen, it is determined whether or not the display range reaches the end of the display screen when the scroll amount is scrolled.

  If the display range does not reach the end of the display screen as a result of scrolling (NO in step S109), the CPU 101 performs scroll processing (step S111). The scroll process here is a normal scroll process. As an example, when scrolling is started, the scrolling speed is changed with a transition as shown in FIG. 12 until the scrolling speed becomes 0 through the maximum scrolling speed set in step S107 within a predetermined time. The display is updated by moving the display range by the specified scroll amount.

  On the other hand, when it is determined that the display range reaches the end of the display screen as a result of scrolling (YES in step S109), the CPU 101 determines the scroll speed calculated in step S107 (or the gesture calculated in step S103). The amount of deformation is calculated from (speed), and the amount of deformation is set to the maximum amount of deformation (step S113). Then, a deformation process is performed using the deformation amount (step S115).

FIG. 17 is a flowchart showing the flow of the deformation process in step S115.
Referring to FIG. 17, CPU 101 sets a display range in which the end of the display screen reached as a result of the scrolling is the end of display (step S201), and sets the deformation rate to 0 at the start of the deformation process (step S203). ). Then, the CPU 101 applies the deformation rate (= 0) to deform the image in the display range (step S205). The CPU 101 fixes the display position of the deformed image at the end opposite to the end of the display screen and displays it on the operation panel 130 (step S209).

  Further, the CPU 101 displays a blank area as the edge of the display screen moves in the scroll direction by the above deformation (step S210).

  Since the deformation rate is 0 at the start of the deformation process, the edge of the display screen as shown in FIG. 11A is displayed on the operation panel 130 at this stage.

  Thereafter, the CPU 101 increases the deformation rate as time elapses as shown in FIG. 14 (step S211), and until the deformation rate reaches the maximum deformation rate set in step S113 (NO in step S213), the steps S205 to S205 are performed. S211 is repeated.

  As a result, the display is compressed in the scroll direction from the start of the deformation process until the maximum deformation rate is reached, as shown in FIG. 11A → FIG. 11B → FIG. Along with this, the display area of the blank area is enlarged.

  When the maximum deformation rate is reached (YES in step S213), the CPU 101 decreases the deformation rate over time as shown in FIG. 14 until the deformation rate returns to 0 (NO in step S223) (step S215). And CPU101 repeats the process similar to said step S205-S211 (step S217-S221).

  Thereby, after reaching the maximum deformation rate, the compressed display is expanded in the scroll direction until the deformation rate returns to 0 as shown in FIG. 11C → FIG. 11B → FIG. 11A. Along with this, the display area of the blank area is reduced.

  When the deformation rate reaches 0 (YES in step S223), the CPU 101 ends the series of processes.

<Effect of Embodiment>
By performing the above-described operation in the image forming apparatus 1, when the list display of items is scrolled by a gesture operation such as flicking, the end is displayed when reaching the end (upper end, lower end) of the display screen. As it is, the display is once compressed in the scroll direction to display the blank area, and the display is deformed so as to be restored.

  For this reason, the user must intuitively know that the end of the display screen has been reached without misunderstanding that the display screen still continues in the scroll direction or that it is not a display defect. Can do.

  Further, at this time, the display range when the end portion of the display screen is displayed is fixed and the display range is compressed, so that the amount of information that can be seen is not reduced.

<Modification 1>
In the above example, when the part beyond the end of the display screen is scrolled, the display is compressed without changing the display range, and a blank area representing the part is displayed.

As another example, the blank area may not be displayed.
FIG. 18 is a diagram showing a specific example of the display change according to the scroll gesture in the first modified example. As a specific example, the change in display when the lower end of the item list screen is displayed. A specific example is shown.

  FIG. 18A shows a display example of the operation panel 130 when the display range reaches the lower end of the display screen as a result of scrolling. In this state, when further upward flicking is performed and downward scrolling is instructed, the image forming apparatus 1 uses a straight line defined in advance with respect to the display area of the operation panel 130 as a deformation boundary. Then, the rear side (upper side in the example of FIG. 18) in the scroll direction from the boundary is specified as the first area, and the front side (lower side in the example of FIG. 18) in the scroll direction is specified as the second area. Then, the image forming apparatus 1 compresses the image in the first area while fixing the display range on the display screen. Accordingly, the image forming apparatus 1 deforms (enlarges) the image in the second area so that the size of both areas is the size of the display area of the operation panel 130. As a result, the deformation boundary moves from the first region (FIG. 18B).

  Also in this example, similarly to the above-described example, the image forming apparatus 1 deforms (compresses) the image in the first region until the deformation amount (compression rate) of the first region reaches the maximum deformation amount (FIG. 18C )) When the maximum deformation amount is reached, the deformation amount is decreased so as to return to the original amount.

  Even in this way, the user can intuitively understand that the end of the display screen has been reached without misunderstanding that the display screen still continues in the scroll direction or that it is not a display defect. Can grasp.

<Modification 2>
In addition, the said deformation | transformation boundary in a 1st modification may be set according to the position of gesture operation. That is, the image forming apparatus 1 may set a straight line perpendicular to the scroll direction including the start position of the flick operation that instructs scrolling as the deformation boundary.

  In this case, the image forming apparatus 1 may increase the amount of deformation in the first region and the second region closer to the flick operation start position.

  In this way, the user can intuitively understand that the end of the display screen has been reached.

<Modification 3>
The first modification example or the second modification example can also be applied to the modification method described in FIG.

  FIG. 19 is a diagram showing a specific example of a display change according to the scroll gesture in the third modified example, and is a diagram showing a modified example of FIG. 11A and FIG. 11B.

  Referring to FIG. 19, in the state where the display range reaches the lower end of the display screen as a result of scrolling (FIG. 19A), when an upward flick is performed and a downward scroll is instructed, image formation is performed. The apparatus 1 sets a straight line orthogonal to the scroll direction including the start position of the flick operation as a deformation boundary, and the rear side (upper side in the example of FIG. 19) in the scroll direction from the boundary is the first region, and the front in the scroll direction. The side (the lower side in the example of FIG. 19) is specified as the second region.

  The image forming apparatus 1 compresses the display size of the display range by fixing the display position of the upper end of the display range to the upper end of the display, and increases the margin area upward from the lower end of the display. Furthermore, the image forming apparatus 1 compresses the first area in the display size according to the change in the deformation amount, and expands the second area in accordance with the compression (FIG. 19B).

  In this way, the user can intuitively understand that the end of the display screen has been reached.

  Further, it is possible to provide a program for causing the CPU 101 of the image forming apparatus 1 to execute the above-described processing so as to function as a control device for controlling display on the touch panel. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program according to the present invention is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1, 1-1A, ... 1-1N, 1-2A, ... 1-2N Image forming apparatus, 3, 3-1A, ... 3-1M, 3-2A, ... 3-2M Information processing apparatus, 4 network, 5 External network, 100 control unit, 102 ROM, 103 S-RAM, 104 NV-RAM, 105 clock IC, 110 fixed storage device, 120 image reading device, 130 operation panel, 140 image output device, 150 printer controller, 160 network I / F, 201 input unit, 202 detection unit, 203 display range specifying unit, 204 display range storage unit, 205 determination unit, 206 operation speed calculation unit, 207 scroll speed calculation unit, 208 scroll processing unit, 209 deformation amount calculation unit, 210 change rate calculation unit, 211 deformation processing unit, 301 display screen storage unit.

Claims (33)

A display device having a touch panel,
Storage means for storing a display screen generated based on electronic information;
Detection means for detecting that a scroll operation on the display of the touch panel has been performed on the touch panel;
When the display range displayed on the touch panel of the display screen does not reach the end of the display screen even if the display range is moved in the scroll direction indicated by the scroll operation, the display range is changed to the scroll direction. Scroll processing means for moving the display to display on the touch panel;
When the display range reaches the first end of the display screen by moving in the scroll direction, the first display image showing the content of the display screen at the time of arrival is deformed in the scroll direction. Deformation processing means for displaying on the touch panel,
Said deformation processing means of the first display image, the scrolling direction, compressing the far side to the first end of the display screen than the position of accepting the scroll operation, to expand the side closer , Display device. The deformation processing means sets a straight line perpendicular to the scroll direction including the position where the scroll operation is received as a deformation boundary, and displays the first display image on the side farther from the first end with respect to the deformation boundary. The display device according to claim 1, wherein the display device compresses and enlarges the first display image on a near side. The deformation processing means compresses the first display image to be deformed from the position where the scroll operation is received to the second end of the display screen farther from the first end, and the scroll. The display device according to claim 1, wherein an area from a position where an operation is received to the first end is enlarged. The deformation processing means is configured to display the first display image in the deformed image when the display range further reaches the first end of the display screen and the scroll direction is further operated . The display device according to claim 1, wherein a blank area is displayed adjacent to one end side.   The deformation processing means fixes the display position of the end of the display screen to the display position before the deformation, divides the display range into two regions in the scroll direction, and The display device according to claim 1, wherein an area is enlarged and an area on the rear side in the scroll direction is compressed.   The display device according to claim 1, wherein the maximum compression ratio is a ratio at which characters included in the display screen have a predetermined minimum size. A display device having a touch panel,
Storage means for storing a display screen generated based on electronic information;
Detection means for detecting that a scroll operation on the display of the touch panel has been performed on the touch panel;
When the display range displayed on the touch panel of the display screen does not reach the end of the display screen even if the display range is moved in the scroll direction indicated by the scroll operation, the display range is changed to the scroll direction. Scroll processing means for moving the display to display on the touch panel;
When the display range reaches the first end of the display screen by moving in the scroll direction, the first display image showing the content of the display screen at the time of arrival is deformed in the scroll direction. Deformation processing means for displaying on the touch panel,
The deformation processing means compresses the first display image on the side farther from the first end with respect to the deformation boundary, with a straight line orthogonal to the scroll direction including the position where the scroll operation is received as a deformation boundary. A display device for enlarging the first display image on the side close to the first end. When the display range reaches the first end of the display screen and the operation is further performed in the scroll direction, the deformation processing unit performs the first change on the deformation boundary of the first display image . together to compress the far side image of the first end portion, to display a blank area adjacent to the first end side in the image after deformation of the first display image, the display according to claim 7 apparatus. The display device according to claim 1, wherein the deformation processing unit deforms the first display image other than characters in the display range.   The display device according to claim 1, further comprising calculation means for calculating a deformation amount from the speed of the scroll operation.   The display device according to any one of claims 1 to 10, wherein the deformation processing unit deforms the deformation amount as the position closer to the position at which the scroll operation is received. The said deformation | transformation process means deform | transforms the knob of the scroll bar displayed on the said touch panel with the said display range of the said display screen according to a deformation | transformation of a said 1st display image. Display device. When the display range reaches the first end of the display screen by moving in the scroll direction, the deformation processing means is configured to display the display on the side farther from the first end at the time of arrival. The first display image of a display screen in a range between a second end of the screen and the first end is deformed in the scroll direction and displayed on the touch panel. The display apparatus in any one. The deformation processing means may be configured such that the first end of the range between the second end of the display screen far from the first end at the time of arrival and the first end of the display screen . The display device according to claim 1, wherein the display image is deformed in the scroll direction and displayed on the touch panel.   The display device according to claim 1, wherein the position at which the scroll operation is received is a start position of the scroll operation.   The display device according to claim 1, wherein the scroll operation is a flick operation, and a position where the scroll operation is received is a start position of the flick operation.   An image forming apparatus comprising the display device according to claim 1. A program for causing a computer to execute processing for controlling display of a display screen generated based on electronic information on a touch panel,
Detecting that a scroll operation on the display of the touch panel has been performed on the touch panel;
Determining whether or not a display range displayed on the touch panel of the display screen reaches an end of the display screen when moved in a scroll direction instructed by the scroll operation;
Moving the display range in the scroll direction to display on the touch panel when the display range does not reach the end of the display screen even when the display range is moved in the scroll direction;
When the display range reaches the first end of the display screen by moving in the scroll direction, the first display image showing the content of the display screen at the time of arrival is deformed in the scroll direction. Causing the computer to execute the step of displaying on the touch panel,
Step to be displayed on the touch panel by the deformation of the first display image, the in the scroll direction, compressing the far side to the first end of the display screen than the position of accepting the scroll operation Display control program, including enlarging the near side. In the step of deforming and displaying on the touch panel, a straight line perpendicular to the scroll direction including the position at which the scroll operation is received is defined as a deformation boundary, and the distance from the first end to the first boundary is greater than the deformation boundary. The display control program according to claim 18, further comprising compressing a first display image and enlarging the first display image on a near side. The step of deforming and displaying on the touch panel includes, in the first display image to be deformed, from the position at which the scroll operation is received to the second end of the display screen on the side farther from the first end. The display control program according to claim 18, further comprising: compressing and expanding the position from the position at which the scroll operation is received to the first end. The step of deforming and displaying on the touch panel includes deforming the first display image when an operation in the scroll direction is further performed after the display range reaches the first end of the display screen. The display control program according to claim 18, further comprising displaying a blank area adjacent to the first end side in a later image .   The step of deforming and displaying on the touch panel fixes the display position of the end of the display screen to the display position before the deformation, divides the display range into two regions in the scroll direction, and The display control program according to any one of claims 18 to 21, further comprising enlarging a region on the front side in the scroll direction and compressing a region on the rear side in the scroll direction.   The display control program according to any one of claims 18 to 22, wherein the maximum value of the compression ratio is a ratio at which characters included in the display screen have a predetermined minimum size. A program for causing a computer to execute processing for controlling display of a display screen generated based on electronic information on a touch panel,
Detecting that a scroll operation on the display of the touch panel has been performed on the touch panel;
Determining whether or not a display range displayed on the touch panel of the display screen reaches an end of the display screen when moved in a scroll direction instructed by the scroll operation;
Moving the display range in the scroll direction to display on the touch panel when the display range does not reach the end of the display screen even when the display range is moved in the scroll direction;
When the display range reaches the first end of the display screen by moving in the scroll direction, the first display image showing the content of the display screen at the time of arrival is deformed in the scroll direction. Causing the computer to execute the step of displaying on the touch panel,
In the step of deforming and displaying on the touch panel, a straight line orthogonal to the scroll direction including the position at which the scroll operation is received is defined as a deformation boundary, and the first of the first end portion far from the deformation boundary is the first boundary . A display control program for compressing one display image and enlarging the first display image closer to the first end. The step of deforming and displaying on the touch panel includes the step of: when the operation in the scroll direction is further performed after the display range reaches the first end of the display screen, among the first display images. together to compress the far side images of the relative deformation boundary first end, that display the blank area adjacent to the first end side in the image after deformation of the first display image The display control program according to claim 24, further comprising: The display according to any one of claims 18 to 22, 24, and 25, wherein the step of deforming and displaying on the touch panel further includes deforming the first display image other than characters in the display range. Control program.   The display control program according to any one of claims 18 to 26, further comprising a step of calculating a deformation amount from a speed of the scroll operation.   The display control program according to any one of claims 18 to 27, wherein the step of deforming and displaying on the touch panel further includes deforming a deformation amount to be larger as the position closer to the scroll operation is received. The step of deforming and displaying on the touch panel further includes deforming a knob of a scroll bar displayed on the touch panel together with the display range of the display screen according to the deformation of the first display image. The display control program according to any one of claims 18 to 28. The step of deforming and displaying on the touch panel includes the first end portion at the time of arrival when the display range reaches the first end portion of the display screen by moving in the scroll direction. The first display image of the display screen in a range between the second end of the display screen on the far side and the first end is deformed in the scroll direction and displayed on the touch panel. The display control program according to any one of claims 18 to 29, further comprising: The step of deforming and displaying on the touch panel is performed between the second end portion of the display screen far from the first end portion at the time of arrival and the first end portion of the display screen. The display control program according to any one of claims 18 to 29, further comprising: deforming the first display image in a range of 1 in the scroll direction to display the first display image on the touch panel.   The display control program according to any one of claims 18 to 31, wherein the position at which the scroll operation is received is a start position of the scroll operation.   The display control program according to any one of claims 18 to 31, wherein the scroll operation is a flick operation, and a position where the scroll operation is received is a start position of the flick operation.

Images