JP6528388B2 - Screen processing apparatus, control method therefor, and program - Google Patents

Description

  The present disclosure relates to a screen processing device, a control method thereof, and a program, and more particularly, to a screen processing device provided with a touch panel, a control method thereof, and a program executed in such a screen processing device.

  In recent years, there have been screen processing apparatuses such as MFPs (Multi-Functional Peripheral) provided with a touch panel. The input mode of the operation instruction in such a screen processing apparatus includes a gesture operation such as a flick operation (an operation of rapidly moving a finger on the touch screen) on the touch panel in addition to the touch operation on the button displayed on the touch panel There is a case.

  Various techniques have been proposed for devices that receive input on a touch panel. For example, Japanese Patent Laid-Open No. 2009-151691 (Patent Document 1) discloses an information processing apparatus that receives a command according to a pressing operation and a command according to a gesture operation. The information processing apparatus moves the amount of movement of the touch operation based on the touch point touched on the touch panel of the display unit and the untouched point on which the untouched operation (operation in which the touched finger or the like releases the touch panel). calculate. Then, the information processing apparatus determines whether the touch operation is a pressing operation or a gesture operation according to the calculated movement amount.

  Moreover, Unexamined-Japanese-Patent No. 2014-067195 (patent document 2) discloses the information processing apparatus which receives the instruction | indication of the scroll with respect to a touch panel. The information processing apparatus detects a user's operation on the touch panel. Then, after the information processing apparatus detects the start point of the user's operation outside the scroll area, when it is detected that the user's operation is continued in the scroll area, the scroll to the scroll area is performed. A process similar to that when it is determined that an instruction has been made, that is, a process of scrolling the screen displayed in the scroll area is performed.

  Moreover, Unexamined-Japanese-Patent No. 2013-250761 (patent document 3) is disclosing the information processing apparatus which cancels pressing-down of the button in a touch panel. The information processing apparatus displays a plurality of contents in a predetermined display area, and performs scroll display in accordance with an instruction for scroll display. Then, when it is detected that the button displayed outside the display area is not being scrolled, the information processing apparatus executes a process corresponding to the pressed button, and the scroll is being displayed. If it is, the process corresponding to the pressed button is not executed.

JP, 2009-151691, A Unexamined-Japanese-Patent No. 2014-067195 Unexamined-Japanese-Patent No. 2013-250761

  In the screen processing apparatus that receives the touch operation and the gesture operation as described above, the control for the touch operation is executed without waiting for the completion of the gesture operation by determining the start of the gesture operation as the touch operation. Had the problem of being

  That is, for example, when the touch processing is performed on the first screen displayed on the touch panel, the screen processing apparatus switches the display on the touch panel to the second screen, and the gesture operation is performed. To switch the display of the touch panel to the third screen. In such a background, the user performs a gesture operation on the first screen displayed on the touch panel to start the gesture operation in an attempt to display the third screen. At this time, the screen processing apparatus recognizes the start of the gesture operation as a touch operation, thereby causing a situation where the display on the touch panel is switched from the first screen to the second screen without waiting for the completion of the gesture operation. obtain. When such a situation occurs, the user is required to return the display on the touch panel from the second screen to the first screen in order to display the third screen on the touch panel.

  In order to avoid such a situation, for example, in the screen processing apparatus, it may be considered that the touch at the same position is continued for a predetermined time or more as a condition for recognizing the touch operation. However, when such conditions are set, the user is always required to continue the touch operation for the predetermined time to cause the screen processing apparatus to recognize the touch operation. This causes a new problem that the user is required to wait for operation in the screen processing apparatus. In particular, when the user further performs an operation after the touch operation, the new problem may be a problem.

  The present disclosure has been conceived in view of such circumstances, and the purpose thereof is that the user can quickly input an operation to the screen processing apparatus, and the screen processing apparatus executes appropriate processing according to the operation on the touch panel It is to be able to do it.

According to an aspect of the present disclosure, a touch panel, a pressing operation detection unit for detecting a pressing operation on a touch panel displaying a first screen, and a touch panel in response to detection of a pressing operation on the touch panel. To detect a gesture operation on the touch panel, and a first display control unit for transitioning from the first screen and displaying the second screen to be displayed when the pressing operation is performed on the screen of And the gesture operation detection unit detects a gesture operation following the pressing operation detected by the pressing operation detection unit, when transitioning from the first screen to the second screen. A second table for displaying a third screen to be displayed when a gesture operation is performed on the first screen on the touch panel. And control means, first display control means, the second display control means to the second screen is changed to the third screen, displaying a second screen with the first screen, the screen A processing device is provided.
According to another aspect of the present disclosure, a touch panel, in response to detection of a pressing operation on a touch panel displaying a first screen, a pressing operation detecting unit for detecting a pressing operation on the touch screen, A first display control means for transitioning from the first screen to the second screen to be displayed when the pressing operation is performed on the screen of 1 and the gesture operation on the touch panel are detected Gesture operation detection means and, when transitioning from the first screen to the second screen, the gesture operation detection means detects a gesture operation following the pressing operation detected by the pressing operation detection means , And a second table for displaying a third screen to be displayed when a gesture operation is performed on the first screen on the touch panel. The second display control means changes the second screen on the touch panel to the third screen in response to detection of a part of the gesture operation, and the remaining of the gesture operation can not be detected. In this case, a screen processing apparatus is provided that changes the third screen of the touch panel to the first screen.

Preferably, if there is a fourth screen to be displayed when a gesture operation is performed on the second screen, the second display control means performs the fourth operation even when the gesture operation is performed. Disable changes to the screen.
Preferably, the gesture operation includes at least one of a flick operation, a drag operation, a swipe operation, a pinch operation, and a rotation operation.

  Preferably, the first display control means displays the first screen in a manner less visible than the second screen.

  Preferably, the gesture operation detection means continues the detection of the gesture operation until the pressing operation on the touch panel is released.

  Preferably, in the gesture operation detecting means, after the pressing operation detecting means detects a pressing operation on the touch panel, when the pressing operation is further detected on the touch panel at a point different from the pressing operation, a pinch operation is performed as the gesture operation To detect

According to another aspect of the present disclosure, there is provided a control method of a screen processing apparatus including a touch panel, the method comprising: detecting a pressing operation on a touch panel displaying a first screen; and detecting a pressing operation on the touch panel. A step of transitioning from the first screen a second screen to be displayed when the first screen is pressed on the touch panel, and a step of detecting a gesture operation on the touch panel; When a gesture operation is detected following the pressing operation when transitioning from the first screen to the second screen, the touch panel is displayed when the gesture operation is performed on the first screen Rubeki saw including a step of displaying a third screen, displaying a second screen to transition from the first screen, the second screen Until changed to 3 of the screen, the second screen comprises displaying together with the first screen, the control method for image processing apparatus is provided.
According to another aspect of the present disclosure, there is provided a control method of a screen processing apparatus including a touch panel, the method comprising: detecting a pressing operation on a touch panel displaying a first screen; and detecting a pressing operation on the touch panel. A step of transitioning from the first screen a second screen to be displayed when the first screen is pressed on the touch panel, and a step of detecting a gesture operation on the touch panel; When a gesture operation is detected following the pressing operation when transitioning from the first screen to the second screen, the touch panel is displayed when the gesture operation is performed on the first screen Displaying the third screen to be displayed, and the step of displaying the third screen detecting a part of the gesture operation Accordingly, changing the second screen on the touch panel to the third screen, and changing the third screen on the touch panel to the first screen if the rest of the gesture operation can not be detected. A control method of a screen processing apparatus is provided, including:

According to still another aspect of the present disclosure, there is provided a program executed by a computer of a screen processing device including a touch panel, the program detecting on a computer a pressing operation on a touch panel displaying a first screen. And displaying on the touch panel a second screen to be displayed when the pressing operation is performed on the first screen in response to the detection of the pressing operation on the touch panel from the first screen. A step of detecting a gesture operation on the touch panel, and a transition from the first screen to the second screen, when the gesture operation is detected following the press operation, the touch panel is displayed on the first screen And displaying a third screen to be displayed when a gesture operation is performed. It is, the step of displaying the second screen to transition from the first screen comprises a second screen until changed to the third screen, displaying a second screen with the first screen , The program is provided.
According to still another aspect of the present disclosure, there is provided a program executed by a computer of a screen processing device including a touch panel, the program detecting on a computer a pressing operation on a touch panel displaying a first screen. And displaying on the touch panel a second screen to be displayed when the pressing operation is performed on the first screen in response to the detection of the pressing operation on the touch panel from the first screen. A step of detecting a gesture operation on the touch panel, and a transition from the first screen to the second screen, when the gesture operation is detected following the press operation, the touch panel is displayed on the first screen And displaying a third screen to be displayed when a gesture operation is performed. In the step of displaying the third screen, changing the second screen on the touch panel to the third screen in response to detection of a part of the gesture operation, and detection of the rest of the gesture operation In the case where the third screen in the touch panel is changed to the first screen, a program is provided.
According to still another aspect of the present disclosure, a touch panel, a pressing operation detection unit for detecting a pressing operation on a touch panel displaying a first screen, and a touch panel in response to detection of a pressing operation on the touch panel First display control means for displaying a second screen to be displayed when a pressing operation is performed on the first screen, and gesture operation detection means for detecting a gesture operation on the touch panel When the gesture operation detection means detects a gesture operation following the press operation detected by the press operation detection means, the second screen on the touch panel is displayed when the gesture operation is performed on the first screen A second display control means for changing to a third screen to be displayed, the second display control means When the second screen on the touch panel is changed to the third screen in response to detection of a part of the gesture operation, and the rest of the gesture operation can not be detected, the third screen on the touch panel is A screen processing apparatus is provided that changes to the screen of.

FIG. 10 is a diagram for describing an overview of processing in the MFP according to the present disclosure. FIG. 10 is a diagram for describing an overview of processing in the MFP according to the present disclosure. FIG. 10 is a diagram for describing an overview of processing in the MFP according to the present disclosure. FIG. 10 is a diagram for describing an overview of processing in the MFP according to the present disclosure. FIG. 10 is a diagram for describing an overview of processing in the MFP according to the present disclosure. FIG. 10 is a diagram for describing an overview of processing in the MFP according to the present disclosure. FIG. 1 is a diagram showing an appearance of an MFP according to the present disclosure. FIG. 2 is a diagram illustrating an example of a hardware configuration of an MFP. FIG. 2 is a view showing an appearance of an operation panel of the MFP. It is a figure which shows an example of transition screen information. It is a figure which shows an example of state management information. It is a figure which shows the other example of status management information. It is a figure which shows an example of the aspect by which two screens are superimposed and displayed. It is a flowchart of a press detection process. It is a flowchart of a subroutine of temporary screen transition processing. It is a flowchart of a gesture detection process. It is a flowchart of the subroutine of front screen transition processing. It is a flowchart of a release detection process. It is a figure for demonstrating the change of the display content in the touch panel about a drag operation. It is a figure for demonstrating change of the display content in the touch panel about rotation operation. It is a figure for demonstrating change of the display content in the touch panel about pinch operation.

  An MFP, which is an embodiment of the screen processing apparatus, will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

[Overview of processing in MFP]
1 to 6 are diagrams for describing an overview of processing in an MFP according to the present disclosure.

  First, with reference to FIGS. 1 to 5 among them, as a premise of processing in the MFP, changes in the screen displayed in the MFP when each of the touch operation and the swipe operation on the touch panel is performed will be described.

  FIG. 1 shows a screen IMG01 which is an example of a screen displayed on the touch panel of the MFP. On the screen IMG01, twelve software buttons arranged three in the vertical direction and four in the horizontal direction are displayed. The four software buttons arranged at the top of these include a copy button, a fax / scan button, a box button, and a web browser button.

  FIG. 2 shows a state in which the touch operation has been performed on the screen IMG01. In FIG. 2, the hand of the user who performs the touch operation is illustrated as a hand H, and the position where the touch operation is performed on the screen IMG01 is conceptually illustrated as a point P01.

  Point P01 is located on the fax / scan button. Thereby, the screen displayed on the touch panel is switched to a screen IMG02 for setting conditions for fax and scan as shown in FIG. The screen IMG02 of FIG. 3 includes numeric keys for inputting a destination of fax (facsimile).

  On the other hand, FIG. 4 shows a state in which the swipe operation has been performed on the screen IMG01. In FIG. 4, the hand of the user who performs the swipe operation is shown as a hand H, the start position of the swipe operation on the screen IMG01 is conceptually shown as a point P01, and the direction in which the hand H moves in the swipe operation is an arrow A01. It is shown conceptually as

  FIG. 5 shows a screen IMG03 newly displayed on the touch panel by the swipe operation on the screen IMG01. Screen IMG03 includes ten software buttons including a screen / page aggregation button and an original quality button.

  As described above with reference to FIGS. 1 to 5, in the touch panel of the MFP, the screen displayed by the touch operation and the screen displayed by the swipe operation are different. And in FIG. 6, three screens (IMG01, IMG02, IMG03) are shown in order to show the change of the display on the touch panel of the MFP according to the present disclosure. A change in display corresponding to the user's operation in the MFP will be described with reference to FIG.

  First, as shown at the top of FIG. 6, a screen IMG01 is displayed on the touch panel. In this state, the user starts the operation by touching the point P01. The content detected by the MFP when the user starts the operation is “press” at point P01, regardless of whether the operation intended by the user is a swipe operation or a touch operation. Based on this, when detecting the “press” at the point P01, the MFP of the present disclosure executes control when a touch operation occurs at the point P01. That is, the MFP displays a screen IMG02 as shown in the middle of FIG.

  Thereafter, when the operation is ended without detecting the swipe operation, the MFP fixes the display of the touch panel on the screen IMG02 and waits for the next operation.

  On the other hand, when a swipe operation is detected following the press, the MFP switches the display on the touch panel from screen IMG02 to screen IMG03 (the bottom of FIG. 6).

  According to the control described with reference to FIG. 6, when a touch operation is detected on the touch panel, the screen on the touch panel is promptly changed for the touch operation (screen IMG02). Then, if a swipe operation is further detected, the display on the touch panel temporarily changed for the touch operation is further changed for the swipe operation (screen IMG03).

  The swipe operation on the screen IMG01 is continued even after the screen IMG02 is displayed. However, in the MFP of the present disclosure, the operation on the touch panel is treated as the operation performed on the screen IMG01 until it is determined that the operation on the screen IMG01 is not the swipe operation but the touch operation.

[MFP configuration]
FIG. 7 is a view showing an appearance of the MFP according to the present disclosure. FIG. 8 is a diagram showing an example of the hardware configuration of the MFP.

  Referring to FIGS. 7 and 8, MFP 100 includes a central processing unit (CPU) 10 which is an arithmetic device for overall control of MFP 100, and a ROM (Read (Read) for storing programs executed by CPU 10 and the like. Only memory (RAM) 11 and RAM (Random Access Memory) 12 to function as a work area when executing a program with CPU 10, and an original document placed on a document table (not shown) are optically read to obtain screen data A scanner 13 for printing, a printer 14 for printing screen data on printing paper, an operation panel 15 including a touch panel for displaying information and accepting an operation input to the MFP 100, screen data, etc. A memory 16 for saving and a recording medium such as a USB (Universal Serial Bus) memory are accessed to From includes a media controller 17 for controlling the communication to the storage medium for read or write a file, a network controller 18 for controlling communication over the network, an input unit 10A.

  Operation panel 15 includes a touch panel (touch panel 150 described later) and an operation key group. The touch panel is configured by superimposing a display device such as a liquid crystal display device and a position pointing device such as an optical touch sensor or an electrostatic capacitance touch sensor, displays an operation screen, and specifies an indicated position on the operation screen. Do.

  An operation signal indicating a designated position (touched position) on the touch panel or a pressed key is input to the CPU 10. The CPU 10 identifies an operation content from the pressed key or the displayed operation screen and the indicated position, and executes the processing based thereon.

  The input unit 10A is configured by a member for inputting information, such as a power button, provided on the main body of the MFP 100 separately from the operation panel 15. Note that part or all of the operation content input via the input unit 10A and part or all of the operation content input via the operation panel 15 may be common.

  The program executed by the CPU 10 may be stored in a storage medium set in the media controller 17. As a storage medium, a CD-ROM (Compact Disc-Read Only Memory), a DVD-ROM (Digital Versatile Disk-Read Only Memory), a USB (Universal Serial Bus) memory, a memory card, a FD (Flexible Disk), a hard disk, a magnetic disk Tape, cassette tape, MO (Magnetic Optical Disc), MD (Mini Disc), IC (Integrated Circuit) card (except memory card), optical card, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), etc. And a medium which stores the program in a non-volatile manner.

  Note that the program according to the present disclosure is to call a required module among program modules provided as part of an operating system (OS) of a computer in a predetermined arrangement at a predetermined timing to execute processing. It is also good. In that case, the program itself does not include the above module, and the processing is executed in cooperation with the OS. A program not including such a module may also be included in the program according to the present invention.

  Also, the program according to the present invention may be provided incorporated in part of another program. Also in this case, the program itself does not include a module included in the other program, and the process is executed in cooperation with the other program. Programs incorporated into such other programs may also be included in the program according to the present invention.

  The provided program product is installed and executed in a program storage unit such as a hard disk. The program product includes the program itself and a recording medium in which the program is recorded.

[Configuration of control panel]
FIG. 9 is a view showing the appearance of the operation panel 15 of the MFP 100. As shown in FIG. As shown in FIG. 9, the operation panel 15 includes hardware buttons such as a power button and a touch panel 150. The touch panel 150 displays various screens such as the screen IMG01.

[Transition screen information]
In MFP 100, for each screen displayed on touch panel 150, the type of operation on the screen and the screen of the transition destination are mutually associated as transition screen information. FIG. 10 is a diagram showing transition screen information on the screen specified by the “screen A”.

  As shown in FIG. 10, in the transition screen information, when the operation is performed on each of the contents of the operation (“touch to button X”, “touch to button Y”, “swipe”, etc.) Information (“screen X”, “screen Y”, “screen B”, etc.) for specifying a screen to be displayed on the touch panel 150 is associated. Transition screen information is stored, for example, in the memory 16. Further, information for displaying each screen (image information of parts of each screen, etc.) is also stored in the memory 16.

  According to FIG. 10, for example, when screen A is displayed, CPU 10 of MFP 100 displays screen X when button X (an example of a button displayed in screen A) is touched. indicate. More specifically, when the user touches the button X of the screen A, the CPU 10 acquires information for displaying the screen X, and displays the screen X on the touch panel 150 using the acquired information.

Status management information
Information (status management information) for managing the display status of touch panel 150 is stored in memory 16 of MFP 100. FIG. 11 is a diagram showing an example of the state management information.

  As shown in FIG. 11, the state management information includes a main display screen and a transition display screen. The main display screen is a screen mainly displayed on the touch panel 150. The transition display screen is a screen displayed, for example, superimposed on the main display screen when the display state of the touch panel 150 is in the transition state. In FIG. 11, “Screen A” is registered as the main display screen, and nothing is registered as the transition display screen. Thus, FIG. 11 shows that only the screen A is displayed on the touch panel 150.

  FIG. 12 is a diagram illustrating another example of the state management information. In FIG. 12, “screen W” is registered as the main display screen, and “screen A” is registered as the transition display screen. Thus, FIG. 12 shows that the screen W is displayed on the touch panel 150 and the screen A is displayed so as to be superimposed on the screen W.

  FIG. 13 is a diagram showing an example of an aspect in which two screens are superimposed and displayed. The screen IMG10 shown in FIG. 13 corresponds to the screen IMG02 of FIG. 3 overlapped with the screen IMG01 of FIG. In MFP 100, for example, when the display on touch panel 150 transits from screen IMG01 to screen IMG02, the screen of the transition source (screen IMG01) is temporarily displayed as screen IMG10 as screen IMG10. May be displayed on the screen. In screen IMG10, screen IMG01 is displayed, for example, in a semitransparent state.

[Flow of processing]
Next, the flow of processing for controlling display on touch panel 150 of MFP 100 will be described. FIG. 14 is a flowchart of the press detection process. The CPU 10 executes a press detection process to detect a press on the touch panel 150. The contents of the process will be described below.

(Press detection processing)
In step S10, the CPU 10 detects a press on the touch panel 150. Thus, control proceeds to step S20.

  In step S20, the CPU 10 determines whether the process performed by the press detected in step S10 is to start the screen transition process. That is, it is determined whether there is a possibility that the screen displayed on the touch panel 150 may be changed by the press detected in step S10. For example, if the press detected in step S10 is a press for an operation button that does not require screen transition or a press for an area where no operation button is displayed, it is determined that the screen transition process is not started. Be done. On the other hand, if the press detected in step S10 is a press on the area where the operation button is displayed, it is determined that the screen transition process is to be started.

  In step S20, when the CPU 10 determines that the press detected in step S10 is to start the screen transition process, the control proceeds to step S40. If the CPU 10 determines that the press detected in step S10 does not start the screen transition process, the control proceeds to step S30.

  In step S30, the CPU 10 executes a process corresponding to the press to end the process of FIG.

  In step S40, the CPU 10 determines whether or not a gesture operation is possible on the current screen (the screen currently displayed on the touch panel 150).

  In the present disclosure, “gesture operation” is distinguished from touch operation. That is, when the operation on the touch panel 150 by the user is completed only by the press for a certain point, it is determined that the operation is the “touch operation”. When the position to be pressed moves while the user operates the touch panel 150, it is determined that the operation is a "gesture operation". Note that the “gesture operation” of the present disclosure includes, for example, at least one of “flick”, “drag”, “swipe”, “pinch”, and “rotation”.

  Then, in step S40, for example, when the display content corresponding to the gesture operation such as swipe is registered in the transition screen information of the screen currently displayed, it is determined that the gesture operation is possible. When CPU 10 determines that the gesture operation is possible on the current screen (YES in step S40), the control proceeds to step S60. On the other hand, when CPU 10 determines that the gesture operation is not possible on the current screen (NO in step S40), the control proceeds to step S50.

  In step S50, the CPU 10 executes the process (screen transition process) of causing the display screen on the touch panel 150 to transition according to the press detected in step S10, and then ends the process of FIG.

  In step S60, the CPU 10 holds the gesture operation on the current screen, and advances the control to step S70. That is, the CPU 10 registers, in the RAM 12 or the like, information specifying that transition screen information of the currently displayed screen is transition screen information to be processed.

  In step S70, the CPU 10 determines whether there is a gesture operation on the next screen. The next screen is a screen displayed when it is assumed that the press detected in step S10 is a touch operation. For example, according to FIG. 10, if the press detected in step S10 is a press for the display area of button X, the next screen is “screen X”. Further, "having a gesture operation" means that, for example, display content corresponding to a gesture operation such as swipe is registered in the transition screen information.

  Then, in step S70, when CPU 10 determines that there is a gesture operation on the next screen (YES in step S70), control proceeds to step S80. On the other hand, when CPU 10 determines that there is no gesture operation on the next screen (NO in step S70), the control proceeds to step S90.

  In step S80, the CPU 10 invalidates the gesture on the next screen. In step S60, the gesture of the current screen is held. The transition screen information of the currently displayed screen is used for screen transition on the touch panel 150 by steps S60 and S80. Then, control proceeds to step S90.

  In step S90, the CPU 10 executes temporary screen transition processing for temporarily changing the display on the touch panel 150. Then, the process of FIG. 14 is ended. FIG. 15 is a flowchart of a subroutine of provisional screen transition processing. Temporary screen transition processing will be described with reference to FIG.

  Referring to FIG. 15, in the temporary screen transition process, in step S 910, CPU 10 holds the state of the displayed screen (display color of button, etc.) in RAM 12 or the like. Then, control proceeds to step S920.

  In step S920, the CPU 10 holds a valid gesture on the currently displayed screen. For example, transition screen information of the currently displayed screen is set as transition screen information to be processed. Then, control proceeds to step S930.

  In step S930, the CPU 10 performs setting for causing the display of the touch panel 150 to transition on the transition destination screen. The screen of the transition destination is a screen displayed when the press detected in step S10 is a touch operation. The setting in step S 930 is, for example, change of state management information. That is, the screen of the transition destination is registered as the main display screen. At this time, the screen that has been displayed may be registered as the transition display screen, or any screen may not be displayed on the transition display screen. Then, control proceeds to step S940.

  In step S940, the CPU 10 acquires information (image information of parts, etc.) necessary for display according to the setting in step S930. Then, control proceeds to step S950.

  In step S950, CPU 10 changes the display on touch panel 150 using the information acquired in step S940. Then, control is returned to FIG.

  In the present disclosure, the state in which the display of the touch panel 150 is changed by the control of step S950 is referred to as "provisional screen transition". For “provisional screen transition”, the screen displayed under the control of step S950 is determined in step SB40 of FIG. 18 described later, or the display of touch panel 150 is preceded in step SA540 of FIG. Exit by returning to the screen.

  The control in step S950 corresponds to, for example, changing the display on touch panel 150 from screen IMG01 to screen IMG02 in FIG. Then, control proceeds to step S940. Alternatively, two screens may be superimposed and displayed as shown in FIG. 13 under the control of step S950.

  The screen IMG02 in FIG. 6 is displayed when only the output display screen is registered in the state management information and the transition display screen is not registered. The screen IMG10 in FIG. 13 is displayed when screens are registered in both the output display screen and the transition display screen in the state management information. The screen (screen IMG02) of the person clearly displayed in the screen IMG10 corresponds to the main display screen of the state management information. Further, a screen (screen IMG01) in a superimposed manner on the screen IMG10 (displayed in a mode less visible than the screen IMG02 in the screen IMG10) corresponds to the transition display screen of the state management information.

  Now, in the process of FIG. 14, when the control proceeds from step S20 to step S40, the CPU 10 executes the gesture detection process and the release detection process in parallel with the process of FIG. The gesture detection process is a process for detecting whether a gesture operation is performed following the press detected in step S10. The release detection process is a process for detecting that the touch on the touch panel 150 has been released (for example, the user's finger has left the touch panel 150) after the press detected in step S10.

(Gesture detection process)
FIG. 16 is a flowchart of the gesture detection process.

  Referring to FIG. 16, when the gesture operation is detected in step SA10, CPU 10 advances the control to step SA20. For example, in the memory 16, conditions (a movement mode of the press position, etc.) for detecting a gesture operation are registered. When the press detected by the touch panel 150 satisfies the condition, the CPU 10 detects that a gesture operation has been performed.

  At step SA20, the CPU 10 determines whether "temporary screen transition is in progress". When CPU 10 determines that temporary screen transition is in progress (YES in step SA20), control proceeds to step SA40. On the other hand, when CPU 10 determines that temporary screen transition is not in progress (NO in step SA20), control proceeds to step SA30.

  In step SA30, CPU 10 executes processing corresponding to the gesture operation in transition screen information of the screen displayed on touch panel 150 when gesture operation is detected in step SA10, and ends the processing of FIG. Let

  On the other hand, in step SA40, CPU 10 clears the content of the held gesture operation (such as the trajectory of the press whose detection has been started in step S10), and advances the control to step SA50.

  In step SA50, the CPU 10 returns the display on the touch panel 150 back to the original screen (the screen displayed when the press was detected in step S10) from the state of "temporary screen transition" in step S950. Execute screen transition processing. The contents of the previous screen transition process will be described later with reference to FIG. Then, control proceeds to step S60.

  In step S60, the CPU 10 executes processing when the gesture operation detected in step SA10 is performed on the previous screen (the screen displayed when the press was detected in step S10), End the process of 16. Thus, the touch panel 150 displays a screen that should be displayed when the gesture operation detected in step SA10 is performed on the previous screen (the screen displayed when the press was detected in step S10). Is displayed. This control corresponds to the display of the screen IMG03 via the screen IMG02 when the swipe operation is performed on the screen IMG01 of FIG.

FIG. 17 is a flowchart of a subroutine of front screen transition processing.
As shown in FIG. 17, in the previous screen transition processing, in step SA510, the CPU 10 changes the state management information of the screen based on the information held in step S910 (FIG. 15). That is, the screen displayed when the press is detected in step S10 is registered as the main display screen in the state management information, and the information held in step S910 is registered in the RAM 12 or the like as a setting for the display of the screen. . Then, control proceeds to step SA520.

  At step SA520, the CPU clears the state for screen display held in the "provisional screen transition" state. Then, control proceeds to step SA530.

  In step SA530, the CPU 10 acquires information (for example, image information of a button, etc.) necessary for displaying the transition destination screen (state) UI. Then, control proceeds to step SA540.

  At step SA540, CPU 10 updates the display of the screen on touch panel 150 using the information acquired at step SA530. Then, the process is returned to FIG. By the control of step SA540, the display on the touch panel 150 is returned from the display during temporary screen transition to the screen displayed when the press is detected in step S10.

(Release detection process)
FIG. 18 is a flowchart of the release detection process.

  In the release detection process, as shown in FIG. 18, when the CPU 10 detects release (end of the press on the touch panel 150) in step SB10, the control proceeds to step SB20.

  At step SB20, the CPU 10 determines whether or not temporary screen transition is in progress. When CPU 10 determines that temporary screen transition is in progress (YES in step SB20), control proceeds to step SB30. On the other hand, when determining that the temporary screen transition is not in progress (NO in step SB20), CPU 10 ends the process of FIG. 18 as it is.

  At step SB30, the CPU clears the gesture operation held so far. Then, control proceeds to step SB40.

  At step SB40, the CPU 10 decides temporary screen transition. That is, the temporary screen transition is canceled, and the display of the screen displayed as the main display screen during the temporary screen transition is decided. Thereby, for example, registration of the screen registered as the transition display screen in the state management information is cancelled.

  In the MFP 100 of the present disclosure described above, when a press is detected on the touch panel 150, transition of a screen corresponding to a touch operation is realized. Thereafter, when a gesture operation is detected, a screen corresponding to the gesture operation on the screen before transition is displayed on the touch panel 150.

  In MFP 100, the detection of the gesture operation is continued until the press on touch panel 150 is released after the press is detected in step S10. Then, when a gesture operation is detected, control proceeds from step SA10 to step SA20.

  In the process shown in FIG. 16, in response to the detection of the completion of the gesture operation in step SA10, control proceeds to step SA20. Note that in step SA10, control may be advanced to step SA20 on the condition that the feature of the gesture operation distinguished from the touch operation is detected even during the gesture operation. As a result, in MFP 100, a screen corresponding to the gesture operation is displayed by detecting a part of the gesture operation. In this case, when the rest of the gesture operation is not detected (for example, within a predetermined time after a part of the gesture operation is detected), the display on the touch panel 150 is the original screen (the press is detected in step S10 May be returned to the screen displayed at that time).

  Also, in the above description, the swipe operation has been described mainly with reference to FIG. 6 as an example of the gesture operation. Below, the display regarding other types of gesture operation is demonstrated.

[Drag operation]
FIG. 19 is a diagram for describing the change of the display content on the touch panel 150 for the drag operation. FIG. 19 shows a screen IMG21, a screen IMG22, and a screen IMG23.

  Referring to screen IMG21, when the press is detected at point P21 when screen IMG21 is displayed on touch panel 150, screen IMG22 is displayed on touch panel 150. The screen IMG22 corresponds to a screen superimposed on the screen to be displayed when the touch operation is performed on the point P21.

  With the screen IMG22 displayed, following the pressing of the point P21, when the drag operation is performed as shown by the arrow A22, the display on the touch panel 150 is switched to the screen IMG23. The screen IMG23 is a screen displayed when a drag operation is performed on the screen IMG21 from the point P21 along the arrow A22.

[Rotation operation]
FIG. 20 is a diagram for describing the change of the display content on the touch panel 150 for the rotation operation. In FIG. 20, a screen IMG31, a screen IMG32, and a screen IMG33 are shown. Also, in FIG. 20, both hands of the user are shown by the hand H1 and the hand H2.

  Referring to screen IMG31, when the press is detected at point P31 when screen IMG31 is displayed on touch panel 150, screen IMG32 is displayed on touch panel 150. The screen IMG32 corresponds to a screen superimposed on the screen to be displayed when the touch operation is performed on the point P31.

  With the screen IMG32 displayed, following the press at point P31, there is a press at point P32, and when the target point of the press at point P32 moves as shown by arrow A32, the display on touch panel 150 , Can be switched to the screen IMG33. The screen IMG33 is a screen displayed when the screen IMG31 is pressed by the point P31 and the point P32 and the press position of the point P32 moves along the arrow A32. More specifically, screen IMG33 is a screen displayed by rotating the image displayed on screen IMG31 (for example, the image of the front cover of a brochure) by 90 degrees to the right.

[Pinch operation]
FIG. 21 is a diagram for describing the change of the display content on the touch panel 150 for the pinch operation. FIG. 21 shows a screen IMG41, a screen IMG42, and a screen IMG43. Also, in FIG. 21, both hands of the user are shown by the hand H1 and the hand H2.

  Referring to screen IMG41, when the press is detected at point P41 when screen IMG41 is displayed on touch panel 150, screen IMG42 is displayed on touch panel 150. The screen IMG42 corresponds to a screen superimposed on the screen to be displayed when the touch operation is performed on the point P41.

  With the screen IMG42 displayed, following the press at point P41, there is a further press at point P42, and further, the target point of the press at point P41 and the target point of the press at point P42 are indicated by arrows A41 and A42. When moving away from each other, the display on the touch panel 150 is switched to the screen IMG43.

  The screen IMG43 is a screen displayed when the point P41 and the point P42 are pressed with respect to the screen IMG41 and the two points move further apart from each other. More specifically, the screen IMG43 is a screen on which an image displayed on the screen IMG41 (for example, an image of a cover of a brochure) is enlarged and displayed.

  Note that FIG. 21 shows display control corresponding to a so-called pinch out operation. In the present disclosure, display control corresponding to so-called pinch-in operation may also be performed. That is, when the detection of the press is started, the screen IMG42 is displayed, and when the pinch-in operation is detected, the display of the touch panel 150 is switched to the screen displayed when the pinch-in operation is performed on the original screen.

  Note that the display control by the pinch operation described with reference to FIG. 21 is screen IMG43 before two points move away from each other according to arrows A41 and A42, that is, when two points of press are detected. May be changed to be displayed. In this case, after two presses are detected, if the two points move away from each other according to the arrows A41 and A42, the display on the screen IMG43 is confirmed. On the other hand, after two presses are detected, the pinch operation is performed to the end, for example, when at least one press of the two points is canceled before the two points move away from each other according to the arrows A41 and A42. If not, the display on touch panel 150 is returned, for example, to screen IMG41.

  It should be understood that the embodiments disclosed herein are illustrative and non-restrictive in every respect. The scope of the present invention is indicated not by the above description but by the claims, and is intended to include all modifications within the meaning and scope equivalent to the claims. In addition, the invention described in the embodiment and each modification is intended to be implemented as much as possible, alone or in combination.

  10 CPU, 10A input unit, 13 scanners, 14 printers, 15 operation panels, 16 memories, 17 media controllers, 18 network controllers, 100 MFPs, 150 touch panels.

Claims (12)

Touch panel,
A pressing operation detection unit for detecting a pressing operation on the touch panel displaying a first screen;
The second screen to be displayed when the pressing operation is performed on the first screen is changed from the first screen and displayed on the touch panel in response to the detection of the pressing operation on the touch panel First display control means for setting
Gesture operation detection means for detecting a gesture operation on the touch panel;
When the gesture operation detection unit detects a gesture operation following the pressing operation detected by the pressing operation detection unit when transitioning from the first screen to the second screen, the touch panel A second display control unit for displaying a third screen to be displayed when the gesture operation is performed on the first screen ;
The first display control means is a screen for displaying the second screen together with the first screen until the second screen is changed to the third screen by the second display control means. Processing unit. Touch panel,
A pressing operation detection unit for detecting a pressing operation on the touch panel displaying a first screen;
The second screen to be displayed when the pressing operation is performed on the first screen is changed from the first screen and displayed on the touch panel in response to the detection of the pressing operation on the touch panel First display control means for setting
Gesture operation detection means for detecting a gesture operation on the touch panel;
When the gesture operation detection unit detects a gesture operation following the pressing operation detected by the pressing operation detection unit when transitioning from the first screen to the second screen, the touch panel A second display control unit for displaying a third screen to be displayed when the gesture operation is performed on the first screen;
The second display control means
The second screen on the touch panel is changed to the third screen in response to detection of a part of the gesture operation;
When the remaining of the gesture operation can not be detected, it changes the third screen in the touch panel to the first screen, the screen processing unit. If there is a fourth screen to be displayed when the gesture operation is performed on the second screen, the second display control unit may perform the second operation even when the gesture operation is performed. The screen processing apparatus according to claim 1, wherein the change to the screen of 4 is invalidated. The screen processing apparatus according to any one of claims 1 to 3, wherein the gesture operation includes at least one of a flick operation, a drag operation, a swipe operation, a pinch operation, and a rotation operation. The screen processing apparatus according to any one of claims 1 to 4 , wherein the first display control means displays the first screen in a mode in which the first screen is less visible than the second screen. The screen processing apparatus according to any one of claims 1 to 5 , wherein the gesture operation detection unit continues the detection of the gesture operation until the pressing operation on the touch panel is released. The gesture operation detecting means detects the pressing operation on the touch panel after the pressing operation detecting means detects the pressing operation on the touch panel, and further detects the pressing operation at a point different from the pressing operation, the pinch operation as the gesture operation The screen processing apparatus according to any one of claims 1 to 6 , wherein it is detected that is executed. A control method of a screen processing apparatus provided with a touch panel, comprising:
Detecting a pressing operation on the touch panel displaying a first screen;
The second screen to be displayed when the pressing operation is performed on the first screen is changed from the first screen and displayed on the touch panel in response to the detection of the pressing operation on the touch panel Step to
Detecting a gesture operation on the touch panel;
When a gesture operation is detected following the pressing operation when transitioning from the first screen to the second screen, the gesture operation is performed on the first screen on the touch panel and displaying a third screen to be displayed when considered including,
The step of transitioning and displaying the second screen from the first screen displays the second screen together with the first screen until the second screen is changed to the third screen. And controlling the screen processing apparatus. A control method of a screen processing apparatus provided with a touch panel, comprising:
Detecting a pressing operation on the touch panel displaying a first screen;
The second screen to be displayed when the pressing operation is performed on the first screen is changed from the first screen and displayed on the touch panel in response to the detection of the pressing operation on the touch panel Step to
Detecting a gesture operation on the touch panel;
When a gesture operation is detected following the pressing operation when transitioning from the first screen to the second screen, the gesture operation is performed on the first screen on the touch panel Displaying a third screen to be displayed when done.
In the step of displaying the third screen,
Changing the second screen on the touch panel to the third screen in response to detection of a part of the gesture operation;
And controlling the third screen on the touch panel to be the first screen when the rest of the gesture operation can not be detected. A program executed by a computer of a screen processing apparatus provided with a touch panel, comprising:
The program is stored in the computer
Detecting a pressing operation on the touch panel displaying a first screen;
The second screen to be displayed when the pressing operation is performed on the first screen is changed from the first screen and displayed on the touch panel in response to the detection of the pressing operation on the touch panel Step to
Detecting a gesture operation on the touch panel;
When a gesture operation is detected following the pressing operation when transitioning from the first screen to the second screen, the gesture operation is performed on the first screen on the touch panel Displaying the third screen to be displayed when done , and
The step of transitioning and displaying the second screen from the first screen displays the second screen together with the first screen until the second screen is changed to the third screen. Program that involves . A program executed by a computer of a screen processing apparatus provided with a touch panel, comprising:
The program is stored in the computer
Detecting a pressing operation on the touch panel displaying a first screen;
The second screen to be displayed when the pressing operation is performed on the first screen is changed from the first screen and displayed on the touch panel in response to the detection of the pressing operation on the touch panel Step to
Detecting a gesture operation on the touch panel;
When a gesture operation is detected following the pressing operation when transitioning from the first screen to the second screen, the gesture operation is performed on the first screen on the touch panel Displaying the third screen to be displayed when done, and
In the step of displaying the third screen,
Changing the second screen on the touch panel to the third screen in response to detection of a part of the gesture operation;
Changing the third screen on the touch panel to the first screen when the rest of the gesture operation can not be detected. Touch panel,
A pressing operation detection unit for detecting a pressing operation on the touch panel displaying a first screen;
A first display control for displaying a second screen to be displayed when the pressing operation is performed on the first screen on the touch panel in response to detection of a pressing operation on the touch panel Means,
Gesture operation detection means for detecting a gesture operation on the touch panel;
When the gesture operation detecting unit detects a gesture operation following the pressing operation detected by the pressing operation detecting unit, the gesture operation is performed on the second screen on the touch panel and the first screen. A second display control means for changing to a third screen to be displayed when the
The second display control means
The second screen on the touch panel is changed to the third screen in response to detection of a part of the gesture operation;
The screen processing apparatus, wherein the third screen on the touch panel is changed to the first screen when the rest of the gesture operation can not be detected.