JP2016095576A - Screen processing device, control method thereof, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to input operation to a screen processing device quickly, and enable the screen processing device to execute an appropriate process that corresponds to operation on a touch panel.SOLUTION: A user starts operation by touching a point P01 on a screen IMG01. The content detected by an MFP upon start of operation is a "press" at the point P01 regardless of whether the operation intended by the user is a swipe operation or a touch operation. Upon detecting the "press" at the point P01, the MFP executes control to be performed when a touch operation at the point P01 occurs, i.e., it displays a screen IMG02. Then, when the operation terminates without the swipe operation being detected, the MFP fixes the display of the touch panel to the screen IMG02, and waits for next operation. Meanwhile, when a swipe operation is detected subsequent to the press, the MFP switches the display of the touch panel from the screen IMG02 to a screen IMG03.SELECTED DRAWING: Figure 6

Description

  The present disclosure relates to a screen processing device, a control method thereof, and a program, and more particularly to a screen processing device including a touch panel, a control method thereof, and a program executed in such a screen processing device.

  In recent years, some screen processing apparatuses such as an MFP (Multi-Functional Peripheral) include a touch panel. The input mode of the operation instruction in such a screen processing device includes gesture operations such as a flick operation (an operation for quickly moving a finger on the touch screen) on the touch panel, in addition to a touch operation on a button displayed on the touch panel. There is a case.

  Various techniques have been proposed for devices that accept input on a touch panel. For example, Japanese Patent Laying-Open No. 2009-151691 (Patent Document 1) discloses an information processing apparatus that accepts a command according to a pressing operation and a command according to a gesture operation. The information processing device calculates the amount of movement of the touch operation based on the touch point where the touch operation is performed on the touch panel of the display unit and the untouch point where the touch operation is performed (the touched finger or the like releases the touch panel). calculate. Then, the information processing apparatus determines whether the touch operation is a pressing operation or a gesture operation according to the calculated movement amount.

  Japanese Patent Laying-Open No. 2014-067195 (Patent Document 2) discloses an information processing apparatus that receives an instruction to scroll a touch panel. The information processing apparatus detects a user operation on the touch panel. When the information processing apparatus detects that the user's operation has been started outside the scroll area and then detects that the user's operation has been continued in the scroll area, the information processing apparatus performs scrolling on the scroll area. A process similar to that when it is determined that the instruction is made, that is, a process of scrolling the screen displayed in the scroll area is executed.

  Japanese Patent Laying-Open No. 2013-250761 (Patent Document 3) discloses an information processing apparatus that cancels pressing of a button on a touch panel. The information processing apparatus displays a plurality of contents in a predetermined display area, and performs scroll display according to an instruction for scroll display. Then, when the pressing of a button displayed outside the display area is detected, the information processing apparatus executes a process corresponding to the pressed button if the button is not being scrolled and is being scrolled. If so, the process corresponding to the pressed button is not executed.

JP 2009-151691 A JP 2014-067195 A JP 2013-250761 A

  In the screen processing device that accepts the touch operation and the gesture operation as described above, the control for the touch operation is executed without waiting for the completion of the gesture operation by determining the start of the gesture operation as the touch operation. There was a problem of being done.

  That is, for example, when the touch operation is performed on the first screen displayed on the touch panel, the screen processing apparatus switches the display on the touch panel to the second screen and the gesture operation is performed. Suppose that the touch panel display is switched to the third screen. In such a background, the user starts a gesture operation to display the third screen by performing a gesture operation on the first screen displayed on the touch panel. At this time, the screen processing device recognizes the start of the gesture operation as a touch operation, so that the display of the touch panel is switched from the first screen to the second screen without waiting for the completion of the gesture operation. obtain. When such a situation occurs, the user is required to perform an operation of returning the display on the touch panel from the second screen to the first screen in order to display the third screen on the touch panel.

  In order to avoid such a situation, for example, in the screen processing apparatus, it may be set as a condition for recognizing the touch operation that a touch at the same position is continued for a predetermined time or more. However, when such a condition is set, the user is required to always continue the touch operation for the predetermined time in order to make the screen processing apparatus recognize the touch operation. As a result, a new problem arises that the user is required to wait for an operation in the screen processing apparatus. In particular, when the user performs further operations after the touch operation, the new problem can be a problem.

  The present disclosure has been conceived in view of such circumstances, and the purpose of the present disclosure is to allow a user to quickly input an operation to the screen processing device, and for the screen processing device to perform appropriate processing according to the operation on the touch panel. Is to be able to do it.

  According to an aspect of the present disclosure, the touch panel, the pressing operation detection unit for detecting the pressing operation on the touch panel displaying the first screen, the first touch panel according to the detection of the pressing operation on the touch panel, A first display control means for displaying a second screen to be displayed when a pressing operation is performed on the screen, a gesture operation detecting means for detecting a gesture operation on the touch panel, and a gesture When the operation detecting unit detects a gesture operation following the pressing operation detected by the pressing operation detecting unit, the second screen on the touch panel is displayed when the gesture operation is performed on the first screen. There is provided a screen processing device comprising second display control means for changing to a third screen.

  Preferably, the gesture operation includes at least one of a flick operation, a drag operation, a swipe operation, a pinch operation, and a rotation operation.

  Preferably, the first display control means displays the second screen together with the first screen until the second display control means changes the second screen to the third screen.

  Preferably, the first display control means displays the first screen in a manner that is less visible than the second screen.

  Preferably, the second display control unit changes the second screen on the touch panel to the third screen in response to detecting a part of the gesture operation, and the remaining gesture operation cannot be detected. Changes the third screen on the touch panel to the first screen.

  Preferably, the gesture operation detection means continues detecting the gesture operation until the pressing operation on the touch panel is released.

  Preferably, the gesture operation detecting unit performs a pinch operation as a gesture operation when the pressing operation detecting unit detects a pressing operation on the touch panel and further detects a pressing operation at a point different from the pressing operation on the touch panel. Is detected.

  According to another aspect of the present disclosure, there is provided a control method for a screen processing apparatus including a touch panel, the step of detecting a pressing operation on the touch panel displaying the first screen, and the detection of the pressing operation on the touch panel. A step of displaying on the touch panel a second screen to be displayed when a pressing operation is performed on the first screen, a step of detecting a gesture operation on the touch panel, and a gesture operation detecting means comprising: When the gesture operation is detected following the pressing operation detected by the detection means, the second screen on the touch panel is changed to the third screen to be displayed when the gesture operation is performed on the first screen. A method for controlling the screen processing apparatus is provided.

  According to still another aspect of the present disclosure, the program is executed by a computer of a screen processing device including a touch panel, and the program detects a pressing operation on the touch panel displaying the first screen on the computer. In response to detection of a pressing operation on the touch panel, a step of displaying a second screen to be displayed when the pressing operation is performed on the first screen on the touch panel, and a gesture operation on the touch panel are detected. When a gesture operation is performed on the first screen on the second screen on the touch panel when the step and the gesture operation detection unit detect a gesture operation following the pressing operation detected by the pressing operation detection unit. Changing to the third screen to be displayed in To line, the program is provided.

6 is a diagram for describing an overview of processing in an MFP according to the present disclosure. FIG. 6 is a diagram for describing an overview of processing in an MFP according to the present disclosure. FIG. 6 is a diagram for describing an overview of processing in an MFP according to the present disclosure. FIG. 6 is a diagram for describing an overview of processing in an MFP according to the present disclosure. FIG. 6 is a diagram for describing an overview of processing in an MFP according to the present disclosure. FIG. 6 is a diagram for describing an overview of processing in an MFP according to the present disclosure. FIG. 2 is a diagram illustrating an appearance of an MFP according to the present disclosure. FIG. 2 is a diagram illustrating an example of a hardware configuration of an MFP. FIG. FIG. 2 is a diagram illustrating an appearance of an operation panel of the MFP. It is a figure which shows an example of transition screen information. It is a figure which shows an example of state management information. It is a figure which shows the other example of state management information. It is a figure which shows an example of the aspect on which two screens are accumulated and displayed. It is a flowchart of a press detection process. It is a flowchart of a subroutine of temporary screen transition processing. It is a flowchart of a gesture detection process. It is a flowchart of a subroutine of previous screen transition processing. It is a flowchart of a release detection process. It is a figure for demonstrating the change of the display content in the touchscreen about drag operation. It is a figure for demonstrating the change of the display content in the touchscreen about rotation operation. It is a figure for demonstrating the change of the display content in the touchscreen about pinch operation.

  Hereinafter, an MFP as an embodiment of a screen processing apparatus will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

[Outline of processing in MFP]
1 to 6 are diagrams for describing an overview of processing in the MFP according to the present disclosure.

  First, with reference to FIGS. 1 to 5, changes in the screen displayed on the MFP when a touch operation and a swipe operation on the touch panel are performed will be described as premise of processing in the MFP.

  FIG. 1 shows a screen IMG01 which is an example of a screen displayed on the touch panel of the MFP. On the screen IMG01, twelve software buttons arranged in a form of three in the vertical direction and four in the horizontal direction are displayed. The four software buttons arranged at the top of these include a copy button, a fax / scan button, a box button, and a web browser button.

  FIG. 2 shows a state in which a touch operation is performed on screen IMG01. In FIG. 2, the hand of the user who performs the touch operation is shown as a hand H, and the position where the touch operation is performed on the screen IMG01 is conceptually shown as a point P01.

  Point P01 is located on the fax / scan button. As a result, the screen displayed on the touch panel is switched to a screen IMG02 for setting conditions for faxing and scanning as shown in FIG. Screen IMG02 in FIG. 3 includes numeric keys for inputting a fax (facsimile) transmission destination.

  On the other hand, FIG. 4 shows a state where the swipe operation is performed on the screen IMG01. In FIG. 4, the user's hand performing the swipe operation is shown as a hand H, the start position of the swipe operation on the screen IMG01 is conceptually shown as a point P01, and the direction in which the hand H has moved in the swipe operation is indicated by an arrow A01. It is conceptually shown as:

  FIG. 5 shows a screen IMG03 that is newly displayed on the touch panel by a swipe operation on the screen IMG01. Screen IMG03 includes ten software buttons including a screen / page aggregation button and a document image quality button.

  As described above with reference to FIGS. 1 to 5, on the touch panel of the MFP, the screen displayed by the touch operation is different from the screen displayed by the swipe operation. FIG. 6 shows three screens (IMG01, IMG02, and IMG03) to show changes in display on the touch panel of the MFP according to the present disclosure. With reference to FIG. 6, a change in display corresponding to a user operation in the MFP will be described.

  First, as shown at the top at the top of FIG. 6, a screen IMG01 is displayed on the touch panel. In this state, the user starts the operation by touching the point P01. The content detected by the MFP when the user starts the operation is “press” at the point P01 regardless of whether the operation intended by the user is a swipe operation or a touch operation. Based on this, when detecting “press” at the point P01, the MFP of the present disclosure executes control when a touch operation at the point P01 occurs. That is, the MFP displays a screen IMG02 as shown in the middle of FIG.

  After that, if the operation is completed without detecting the swipe operation, the MFP fixes the display on the touch panel on the screen IMG02 and waits for the next operation.

  On the other hand, when a swipe operation is detected following the press, the MFP switches the display on the touch panel from the screen IMG02 to the screen IMG03 (the bottom of FIG. 6).

  With the control described with reference to FIG. 6, when a touch operation is detected on the touch panel, the screen on the touch panel is quickly changed for the touch operation (screen IMG02). If a swipe operation is further detected, the display on the touch panel that has been temporarily changed for the touch operation is further changed for the swipe operation (screen IMG03).

  Note that the swipe operation on the screen IMG01 is continued even after the screen IMG02 is displayed. However, in the MFP of the present disclosure, the operation on the touch panel is handled as an operation performed on the screen IMG01 until it is determined that the operation on the screen IMG01 is not a swipe operation but a touch operation.

[MFP configuration]
FIG. 7 is a diagram illustrating an appearance of the MFP according to the present disclosure. FIG. 8 is a diagram illustrating an example of the hardware configuration of the MFP.

  Referring to FIGS. 7 and 8, MFP 100 includes a CPU (Central Processing Unit) 10 that is an arithmetic device for comprehensively controlling MFP 100 and a ROM (Read that stores programs executed by CPU 10, etc. Only Memory) 11, RAM (Random Access Memory) 12 for functioning as a work area when the program is executed by the CPU 10, and a document placed on a document table (not shown) is optically read to obtain screen data. A scanner 13 for printing, a printer 14 for printing screen data on printing paper, an operation panel 15 including a touch panel for displaying information and receiving operation inputs to the MFP 100, screen data, and the like. Access to storage media 16 and USB (Universal Serial Bus) memory and other recording media From includes a media controller 17 for controlling the communication to the storage medium for read or write a file, a network controller 18 for controlling communication over the network, an input unit 10A.

  The operation panel 15 includes a touch panel (a touch panel 150 described later) and an operation key group. The touch panel is configured by overlaying a display device such as a liquid crystal display device and a position indicating device such as an optical touch sensor or a capacitive touch sensor, displaying an operation screen and specifying the indicated position on the operation screen. To do.

  An operation position indicating an instruction position (touched position) on the touch panel or a pressed key is input to the CPU 10. The CPU 10 specifies the operation content from the pressed key or the displayed operation screen and the indicated position, and executes processing based on the operation content.

  Input unit 10 </ b> A is configured by a member for inputting information, such as a power button, provided on MFP 100 main body separately from operation panel 15. Note that a part or all of the operation content input via the input unit 10A and a part or all of the operation content input via the operation panel 15 may be common.

  The program executed by the CPU 10 may be stored in a storage medium set in the media controller 17. Storage media include CD-ROM (Compact Disc-Read Only Memory), DVD-ROM (Digital Versatile Disk-Read Only Memory), USB (Universal Serial Bus) memory, memory card, FD (Flexible Disk), hard disk, magnetic Tape, cassette tape, MO (Magnetic Optical Disc), MD (Mini Disc), IC (Integrated Circuit) card (excluding memory cards), optical card, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), etc. And a medium for storing the program in a nonvolatile manner.

  The program according to the present disclosure is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

[Operation panel configuration]
FIG. 9 is a diagram illustrating an appearance of the operation panel 15 of the MFP 100. As shown in FIG. 9, the operation panel 15 includes hardware buttons such as a power button and a touch panel 150. Touch panel 150 displays various screens such as screen IMG01.

[Transition screen information]
In MFP 100, for each screen displayed on touch panel 150, the type of operation on the screen and the transition destination screen are associated with each other as transition screen information. FIG. 10 is a diagram showing transition screen information for a screen specified by “screen A”.

  As shown in FIG. 10, the transition screen information includes the operation contents (“touch on button X”, “touch on button Y”, “swipe”, etc.) when the operation is executed. Information (“screen X”, “screen Y”, “screen B”, etc.) specifying the screen to be displayed on the touch panel 150 is associated. The transition screen information is stored in the memory 16, for example. Information for displaying each screen (image information of parts of each screen, etc.) is also stored in the memory 16.

  According to FIG. 10, for example, CPU 10 of MFP 100 displays screen X when button X (an example of a button displayed in screen A) is touched while screen A is displayed. indicate. More specifically, when the user touches the button X on the screen A, the CPU 10 acquires information for displaying the screen X, and displays the screen X on the touch panel 150 using the acquired information.

[Status management information]
Information for managing the display state of touch panel 150 (state management information) is stored in memory 16 of MFP 100. FIG. 11 is a diagram illustrating an example of state management information.

  As shown in FIG. 11, the state management information includes a main display screen and a transition display screen. The main display screen is a screen mainly displayed on the touch panel 150. The transition display screen is a screen that is displayed, for example, superimposed on the main display screen when the display state of the touch panel 150 is in the transition state. In FIG. 11, “Screen A” is registered as the main display screen, and nothing is registered as the transition display screen. Accordingly, FIG. 11 shows that only the screen A is displayed on the touch panel 150.

  FIG. 12 is a diagram illustrating another example of the state management information. In FIG. 12, “screen W” is registered as the main display screen, and “screen A” is registered as the transition display screen. Accordingly, FIG. 12 shows that the screen W is displayed on the touch panel 150 and the screen A is displayed so as to be superimposed on the screen W.

  FIG. 13 is a diagram illustrating an example of an aspect in which two screens are displayed in an overlapping manner. A screen IMG10 shown in FIG. 13 corresponds to the screen IMG02 in FIG. 3 overlaid on the screen IMG01 in FIG. In MFP 100, for example, when the display on touch panel 150 transitions from screen IMG01 to screen IMG02, the transition source screen (screen IMG02) temporarily changes to the transition destination screen (screen IMG02) as shown as screen IMG10. May be displayed on the screen. In the screen IMG10, the screen IMG01 is displayed in a translucent state, for example.

[Process flow]
Next, a processing flow for controlling display on touch panel 150 of MFP 100 will be described. FIG. 14 is a flowchart of the press detection process. The CPU 10 executes a press detection process in order to detect a press on the touch panel 150. Hereinafter, the contents of the process will be described.

(Press detection process)
In step S <b> 10, the CPU 10 detects a press on the touch panel 150. Thereby, control is advanced to step S20.

  In step S20, the CPU 10 determines whether the process executed by the press detected in step S10 is to start a screen transition process. That is, it is determined whether or not the screen displayed on the touch panel 150 may be changed by the press detected in step S10. For example, if the press detected in step S10 is a press for an operation button that does not require a screen transition, or a press for an area where no operation button is displayed, it is determined that the screen transition process is not started. Is done. On the other hand, when the press detected in step S10 is a press for the area where the operation button is displayed, it is determined that the screen transition process is started.

  In step S20, if the CPU 10 determines that the press detected in step S10 starts the screen transition process, the control proceeds to step S40. If the CPU 10 determines that the press detected in step S10 does not start the screen transition process, the control proceeds to step S30.

  In step S30, the CPU 10 executes a process corresponding to the press and ends the process of FIG.

  In step S40, CPU 10 determines whether or not a gesture operation is possible on the current screen (the screen currently displayed on touch panel 150).

  In the present disclosure, “gesture operation” is distinguished from a touch operation. That is, when the user's operation on the touch panel 150 is completed only by pressing a certain point, it is determined that the operation is a “touch operation”. Further, when the position to be pressed moves during the user's operation on the touch panel 150, the operation is determined to be a “gesture operation”. The “gesture operation” of the present disclosure includes, for example, at least one of “flick”, “drag”, “swipe”, “pinch”, and “rotation”.

  In step S40, for example, when the display content corresponding to the gesture operation such as swipe is registered in the transition screen information of the currently displayed screen, it is determined that the gesture operation is possible. When CPU 10 determines that a gesture operation is possible on the current screen (YES in step S40), control proceeds to step S60. On the other hand, when CPU 10 determines that the gesture operation is not possible on the current screen (NO in step S40), control proceeds to step S50.

  In step S50, the CPU 10 executes a process of changing the display screen on the touch panel 150 according to the press detected in step S10 (screen transition process), and then ends the process of FIG.

  In step S60, the CPU 10 holds the gesture operation on the current screen and advances the control to step S70. That is, the CPU 10 registers information specifying that the transition screen information of the currently displayed screen is the transition screen information to be processed in the RAM 12 or the like.

  In step S70, the CPU 10 determines whether or not there is a gesture operation on the next screen. The next screen is a screen displayed when it is assumed that the press detected in step S10 is a touch operation. For example, according to FIG. 10, if the press detected in step S10 is a press for the display area of the button X, the next screen is “screen X”. “There is a gesture operation” means that display content corresponding to a gesture operation such as swipe is registered in the transition screen information.

  In step S70, when CPU 10 determines that there is a gesture operation on the next screen (YES in step S70), control proceeds to step S80. On the other hand, when CPU 10 determines that there is no gesture operation on the next screen (NO in step S70), control proceeds to step S90.

  In step S80, the CPU 10 invalidates the gesture on the next screen. In step S60, the gesture on the current screen is held. Through step S60 and step S80, the transition screen information of the currently displayed screen is used for screen transition on the touch panel 150. Then, the control proceeds to step S90.

  In step S90, the CPU 10 executes a temporary screen transition process for temporarily changing the display on the touch panel 150. Then, the process of FIG. 14 is terminated. FIG. 15 is a flowchart of a subroutine for temporary screen transition processing. The provisional screen transition process will be described with reference to FIG.

  Referring to FIG. 15, in the temporary screen transition process, in step S <b> 910, CPU 10 holds the state of the displayed screen (button display color, etc.) in RAM 12 or the like. Then, control proceeds to step S920.

  In step S920, CPU 10 holds a gesture that is valid on the currently displayed screen. For example, the transition screen information of the currently displayed screen is set as the transition screen information to be processed. Then, control proceeds to step S930.

  In step S930, CPU 10 performs setting for transitioning the display of touch panel 150 to the transition destination screen. The transition destination screen is a screen displayed when the press detected in step S10 is a touch operation. The setting in step S930 is, for example, change of state management information. That is, the transition destination screen is registered as the main display screen. At this time, the screen that has been displayed so far may be registered as a transition display screen, or none of the screens may be displayed on the transition display screen. Then, control proceeds to step S940.

  In step S940, the CPU 10 acquires information (such as part image information) necessary for display according to the setting in step S930. Then, control proceeds to step S950.

  In step S950, CPU 10 changes the display on touch panel 150 using the information acquired in step S940. Control is then returned to FIG.

  In the present disclosure, the state in which the display of the touch panel 150 is changed by the control in step S950 is referred to as “provisional screen transition in progress”. In “provisional screen transition”, the screen displayed by the control in step S950 is confirmed in step SB40 in FIG. 18 described later, or the display on the touch panel 150 is displayed in the previous step SA540 in FIG. It ends by returning to the screen.

  The control in step S950 corresponds to, for example, changing the display on touch panel 150 from screen IMG01 to screen IMG02 in FIG. Then, control proceeds to step S940. Alternatively, two screens may be superimposed and displayed as shown in FIG. 13 under the control of step S950.

  The screen IMG02 of FIG. 6 is displayed when only the output display screen is registered in the state management information and the transition display screen is not registered. Screen IMG10 in FIG. 13 is displayed when screens are registered in both the output display screen and the transition display screen in the state management information. The screen clearly displayed on screen IMG10 (screen IMG02) corresponds to the main display screen of the state management information. Further, the screen (screen IMG01) that is superimposed on screen IMG10 (displayed in a manner that is less visible than screen IMG02 in screen IMG10) corresponds to the state management information transition display screen.

  In the process of FIG. 14, when the control proceeds from step S20 to step S40, the CPU 10 executes a gesture detection process and a release detection process in parallel with the process of FIG. The gesture detection process is a process for detecting whether or not a gesture operation is executed following the press detected in step S10. The release detection process is a process for detecting that the touch on the touch panel 150 is released after the press detected in step S10 (for example, the user's finger has left the touch panel 150).

(Gesture detection processing)
FIG. 16 is a flowchart of the gesture detection process.

  Referring to FIG. 16, when a gesture operation is detected in step SA10, CPU 10 advances the control to step SA20. For example, in the memory 16, conditions for detecting a gesture operation (such as a movement mode of the press position) are registered. When the press detected on the touch panel 150 satisfies the condition, the CPU 10 detects that a gesture operation has been performed.

  In step SA20, the CPU 10 determines whether or not “temporary screen transition is in progress”. If the CPU 10 determines that the temporary screen transition is in progress (YES in step SA20), the control proceeds to step SA40. On the other hand, when CPU 10 determines that the temporary screen transition is not in progress (NO in step SA20), the control proceeds to step SA30.

  In step SA30, the CPU 10 executes a process corresponding to the gesture operation in the screen transition screen information displayed on the touch panel 150 when the gesture operation is detected in step SA10, and ends the process of FIG. Let

  On the other hand, in step SA40, the CPU 10 clears the contents of the held gesture operation (such as the press trajectory started in step S10), and advances the control to step SA50.

  In step SA50, the CPU 10 returns the display on the touch panel 150 from the “progressive screen transition” state in step S950 to the original screen (the screen that was displayed when the press was detected in step S10). Execute screen transition processing. The content of the previous screen transition process will be described later with reference to FIG. And control is advanced to step S60.

  In step S60, the CPU 10 executes processing when the gesture operation detected in step SA10 is performed on the previous screen (the screen displayed when the press is detected in step S10). The process of 16 is terminated. Thereby, the touch panel 150 has a screen to be displayed when the gesture operation detected in step SA10 is performed on the previous screen (the screen that was displayed when the press was detected in step S10). Is displayed. This control corresponds to the screen IMG03 being displayed via the screen IMG02 when the swipe operation is performed on the screen IMG01 of FIG.

FIG. 17 is a flowchart of the subroutine of the previous screen transition process.
As shown in FIG. 17, in the previous screen transition process, in step SA510, the CPU 10 changes the screen state management information based on the information held in step S910 (FIG. 15). That is, the screen displayed when the press is detected in step S10 is registered as the main display screen in the state management information, and the information held in step S910 is registered in the RAM 12 or the like as the setting for the display of the screen. . Control then proceeds to step SA520.

  In step SA520, CPU 10 clears the state for screen display held in “transition of temporary screen”. Control then proceeds to step SA530.

  In step SA530, CPU 10 acquires information (for example, button image information, etc.) necessary for UI display of the transition destination screen (state). Control then proceeds to step SA540.

  In step SA540, CPU 10 updates the display of the screen on touch panel 150 using the information acquired in step SA530. Then, the process returns to FIG. By the control in step SA540, the display on the touch panel 150 is returned from the display during transition to the temporary screen to the screen displayed when the press is detected in step S10.

(Release detection processing)
FIG. 18 is a flowchart of the release detection process.

  In the release detection process, as shown in FIG. 18, in step SB10, when CPU 10 detects release (end of press on touch panel 150), control proceeds to step SB20.

  In step SB20, the CPU 10 determines whether a temporary screen transition is in progress. If CPU 10 determines that a temporary screen transition is in progress (YES in step SB20), control proceeds to step SB30. On the other hand, when CPU 10 determines that the temporary screen transition is not in progress (NO in step SB20), the process of FIG.

  In step SB30, the CPU 10 clears the gesture operation held so far. Control then proceeds to step SB40.

  In step SB40, the CPU 10 determines the temporary screen transition. That is, the temporary screen transition is canceled, and the display of the screen displayed as the main display screen during the temporary screen transition is confirmed. Thereby, for example, the registration of the screen registered as the transition display screen in the state management information is canceled.

  In MFP 100 of the present disclosure described above, transition of a screen corresponding to a touch operation is realized by detecting a press on touch panel 150. Thereafter, when a gesture operation is detected, a screen corresponding to the gesture operation on the screen before the transition is displayed on touch panel 150.

  In MFP 100, the gesture operation is continuously detected until the press on touch panel 150 is released after the press is detected in step S10. When a gesture operation is detected, control proceeds from step SA10 to step SA20.

  In the process shown in FIG. 16, the control proceeds to step SA20 in response to the completion of the gesture operation detected in step SA10. In step SA10, even in the middle of the gesture operation, the control may be advanced to step SA20 on the condition that the feature of the gesture operation distinguished from the touch operation is detected. Thereby, in MFP 100, when a part of the gesture operation is detected, a screen corresponding to the gesture operation is displayed. In this case, when the rest of the gesture operation is not detected (for example, within a predetermined time after a part of the gesture operation is detected), the display on touch panel 150 displays the original screen (press is detected in step S10). May be returned to the screen displayed at the time.

  Moreover, in the above description, swipe operation was mainly demonstrated with reference to FIG. 6 as an example of gesture operation. Below, the display regarding another kind of gesture operation is demonstrated.

[Drag operation]
FIG. 19 is a diagram for explaining a change in display content on the touch panel 150 for a drag operation. FIG. 19 shows a screen IMG21, a screen IMG22, and a screen IMG23.

  With reference to screen IMG21, when a press is detected at point P21 while screen IMG21 is displayed on touch panel 150, screen IMG22 is displayed on touch panel 150. Screen IMG22 corresponds to a screen overlaid on the screen to be displayed when screen IMG21 is touched at point P21.

  When the drag operation is executed as indicated by the arrow A22 after the point P21 is pressed in a state where the screen IMG22 is displayed, the display on the touch panel 150 is switched to the screen IMG23. The screen IMG23 is a screen displayed when a drag operation is performed on the screen IMG21 from the point P21 along the arrow A22.

[Rotation operation]
FIG. 20 is a diagram for explaining a change in display content on the touch panel 150 for the rotation operation. FIG. 20 shows a screen IMG31, a screen IMG32, and a screen IMG33. In FIG. 20, the user's hands are indicated by a hand H1 and a hand H2.

  With reference to screen IMG31, when press is detected at point P31 while screen IMG31 is displayed on touch panel 150, screen IMG32 is displayed on touch panel 150. The screen IMG32 corresponds to a screen overlaid on the screen to be displayed when the screen IMG31 is touched at the point P31.

  When the screen IMG32 is displayed, the press of the point P31 is followed by the press of the point P32, and when the target point of the press of the point P32 moves as indicated by the arrow A32, the display on the touch panel 150 is displayed. The screen is switched to the screen IMG33. The screen IMG33 is a screen displayed when the screen IMG31 is pressed at points P31 and P32 and the pressing position of the point P32 is moved along the arrow A32. More specifically, the screen IMG33 is a screen that displays the image displayed on the screen IMG31 (for example, the cover image of the brochure) by rotating it 90 degrees to the right.

[Pinch operation]
FIG. 21 is a diagram for explaining a change in display content on the touch panel 150 for a pinch operation. FIG. 21 shows a screen IMG41, a screen IMG42, and a screen IMG43. Further, in FIG. 21, both hands of the user are indicated by a hand H1 and a hand H2.

  With reference to screen IMG 41, when a press is detected at point P 41 while screen IMG 41 is displayed on touch panel 150, screen IMG 42 is displayed on touch panel 150. The screen IMG42 corresponds to a screen overlaid on the screen to be displayed when the screen IMG41 is touched at the point P41.

  While the screen IMG42 is displayed, the press of the point P41 is followed by the press of the point P42, and the point to be pressed at the point P41 and the point to be pressed at the point P42 are indicated by arrows A41 and A42. As shown, when moving away from each other, the display on the touch panel 150 is switched to the screen IMG43.

  The screen IMG43 is a screen displayed when the screen IMG41 is pressed at points P41 and P42 and further moved so that the two points are separated from each other. More specifically, the screen IMG43 is a screen for enlarging and displaying an image (for example, a cover image of a brochure) displayed on the screen IMG41.

  FIG. 21 shows display control corresponding to a so-called pinch-out operation. In the present disclosure, display control corresponding to a so-called pinch-in operation may also be executed. That is, the screen IMG 42 is displayed at the start of press detection, and when a pinch-in operation is detected, the display of the touch panel 150 is switched to the screen displayed when the pinch-in operation is performed on the original screen.

  Note that the display control by the pinch operation described with reference to FIG. 21 is performed on the screen IMG43 before the two points move away from each other according to the arrows A41 and A42, that is, at the time when the two point presses are detected. May be changed to be displayed. In this case, if the two points are moved away from each other according to the arrows A41 and A42 after the two points of press are detected, the display of the screen IMG43 is confirmed. On the other hand, after two presses are detected, when the press of at least one of the two points is canceled before the two points move away from each other according to arrows A41 and A42, the pinch operation is executed to the end. If not, the display on touch panel 150 is returned to, for example, screen IMG41.

  Each embodiment disclosed this time must be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims. In addition, the invention described in the embodiment and each modification is intended to be carried out independently or in combination as much as possible.

  10 CPU, 10A input unit, 13 scanner, 14 printer, 15 operation panel, 16 memory, 17 media controller, 18 network controller, 100 MFP, 150 touch panel.

Claims (9)

A touch panel;
A pressing operation detection means for detecting a pressing operation on the touch panel displaying the first screen;
First display control for displaying a second screen to be displayed when the pressing operation is performed on the first screen on the touch panel in response to detection of the pressing operation on the touch panel. Means,
Gesture operation detecting means for detecting a gesture operation on the touch panel;
When the gesture operation detection unit detects a gesture operation following the pressing operation detected by the pressing operation detection unit, the gesture operation detection unit displays the second screen on the touch panel with respect to the first screen. A screen processing apparatus comprising: a second display control unit for changing to a third screen that should be displayed when   The screen processing apparatus according to claim 1, wherein the gesture operation includes at least one of a flick operation, a drag operation, a swipe operation, a pinch operation, and a rotation operation.   The first display control means displays the second screen together with the first screen until the second screen is changed to the third screen by the second display control means. Item 3. A screen processing device according to item 1 or item 2.   The screen processing apparatus according to claim 3, wherein the first display control unit displays the first screen in a manner that is less visible than the second screen. The second display control means includes
In response to detecting a part of the gesture operation, the second screen on the touch panel is changed to the third screen,
The screen processing device according to claim 1, wherein when the remaining gesture operation cannot be detected, the third screen on the touch panel is changed to the first screen. .   The screen processing apparatus according to claim 1, wherein the gesture operation detection unit continues detecting the gesture operation until the pressing operation on the touch panel is released.   The gesture operation detecting unit is configured to perform a pinch operation as the gesture operation when the pressing operation detecting unit detects a pressing operation on the touch panel and further detects a pressing operation at a point different from the pressing operation on the touch panel. The screen processing apparatus according to claim 1, wherein the screen processing apparatus detects that is executed. A control method for a screen processing apparatus including a touch panel,
Detecting a pressing operation on the touch panel displaying the first screen;
Displaying a second screen to be displayed when the pressing operation is performed on the first screen on the touch panel in response to detection of the pressing operation on the touch panel;
Detecting a gesture operation on the touch panel;
When the gesture operation detection unit detects a gesture operation following the pressing operation detected by the pressing operation detection unit, the gesture operation detection unit displays the second screen on the touch panel with respect to the first screen. And a step of changing to a third screen to be displayed when the operation is performed. A program executed by a computer of a screen processing device including a touch panel,
The program is stored in the computer.
Detecting a pressing operation on the touch panel displaying the first screen;
Displaying a second screen to be displayed when the pressing operation is performed on the first screen on the touch panel in response to detection of the pressing operation on the touch panel;
Detecting a gesture operation on the touch panel;
When the gesture operation detection unit detects a gesture operation following the pressing operation detected by the pressing operation detection unit, the gesture operation detection unit displays the second screen on the touch panel with respect to the first screen. A program for executing a step of changing to a third screen to be displayed when