JP6024319B2 - Control device, image forming apparatus, control program, and program - Google Patents

Description

  The present invention relates to a control apparatus, an image forming apparatus, and a control program, and more particularly to a control apparatus that controls an apparatus having a touch panel, an image forming apparatus equipped with the control apparatus, and a control program.

  It is possible to operate a mobile terminal such as a mobile phone or an image forming apparatus such as an MFP (Multi-Functional Peripheral) with a gesture called flick or pan, which moves or slides a finger on the mounted touch panel. It is becoming possible. Such gesture operation is intuitive and can improve operability.

  In order to detect a gesture operation, the touch panel control device needs to recognize the movement of the touch position by paying, sliding, or rotating a finger or the like.

  In relation to such an operation, for example, Japanese Patent Application Laid-Open No. 2011-134212 (hereinafter, Patent Document 1) intends the user's intention by discriminating between an operation that does not move the touch position and an operation that moves the touch position with high accuracy. A technique of an input device that can determine an input operation with high accuracy is disclosed.

  Japanese Patent Laying-Open No. 2011-118629 (hereinafter referred to as Patent Document 2) discloses a contact operation determination device that can determine a contact operation with respect to an end of a region where contact is detected with high accuracy.

JP 2011-134212 A JP 2011-118629 A

  By the way, depending on the operating environment such as humidity and the state of the operation article (user's finger, pointing device, etc.), the finger may not move smoothly on the touch panel when a finger is used for the operation. In such a case, for example, it may be an operation of paying after repeating the movement of leaving after touching the touch panel.

  In such a case, even if the techniques of Patent Documents 1 and 2 are used, even if the user intends to perform a flick operation to scroll through the list of items, for example, a combination of a tap operation and a flick operation May be detected, the item detected as the target of the tap operation may be selected or the item may be moved against the user's intention. For example, if the above operation is performed to select a document to be printed with respect to the display of the document list, a document not intended by the user is selected, and the user executes printing without noticing that. Misprinting may occur.

  In other words, depending on the operating environment and the situation of the operation article, there is a problem that the operation content is not properly detected and an unintended operation may be performed.

  SUMMARY An advantage of some aspects of the invention is that it provides a control device, an image forming apparatus, and a control program that can detect an operation on a touch panel with high accuracy.

In order to achieve the above object, according to one aspect of the present invention, the control device is a control device that controls a device having a touch panel, and includes a detection means for detecting an operation on the touch panel, and a touch panel according to the operation. Display processing means for controlling display related to items displayed on the display, and determination means for determining the possibility of erroneous operation of the tap operation detected by the detection means. The determination means may be that the first operation may be erroneously operated when the second operation is detected within a predetermined time after the first operation, which is a tap operation on the touch panel, is detected by the detection means. judge. Display processing means, and corresponds to the item which is the first operation for which it is determined that there is the possibility of erroneous operation in the determination unit, if row marking display as defined previously. The control device receives an operation for invalidating or validating the first operation in the marking display.

Preferably, the display processing means, a first steering the marking display that corresponds to the item that is the subject of the first operation it is determined that there is a possibility of erroneous operation, it is determined that there is no possibility of erroneous operation it is displayed in a display mode different from the marking display that corresponds to the item that is created in the target.

Good Mashiku is a display mode different comprise different display colors, different shapes, and different sizes of the at least one.

Preferably, when an operation for validating the first operation is accepted for the marking display, the display processing unit performs the marking display defined in advance for the first operation that has been determined not to be erroneous. Change to marking display corresponding to the target item.

Preferably, the display processing means scrolls the display on the touch panel in accordance with the flick operation detected by the detection means, and sets the item that is the target of the tap operation detected by the detection means as the display of the selected state.

Preferably, when an operation for invalidating the first operation is accepted for the marking display, the display processing unit cancels the display of the selection state of the item that is the target of the first operation.

If good Mashiku has accepted an operation to disable the first operation on the marking indication corresponding to the first operation item that is the subject of which it has been determined that there is no possibility of erroneous operation in the determination unit, The display processing means does not cancel the display of the selection state of the item that is the target of the first operation.

Preferably, the second operation is a flick operation or a tap operation.
Preferably, the display processing unit is on a coordinate corresponding to an item that is a target of the first operation that is determined by the determination unit to be erroneous in the map display that covers the entire list of items displayed on the touch panel. Marking is displayed.

Preferably, the map display is a scroll bar.
Preferably, the operation of disabling or enabling the first operation is a gesture operation for marking display.

Preferably, the display processing unit scrolls the display on the touch panel so as to display the display of the item that is the target of the first operation corresponding to the marking display when the detection unit detects a predetermined operation for the marking display. .

According to another aspect of the present invention, an image forming apparatus includes the above-described control device.
Preferably, the image forming apparatus further includes a control unit configured to perform control so as not to accept a job start instruction when there is an item that is a target of a first operation that is determined to be erroneous. .

According to yet another aspect of the present invention, the control program is a control program for executing a control of the apparatus having a touch panel on a computer, the steps of: detecting an operation against the touch panel, is detected in the step of detecting And causing the computer to execute a step of determining a possibility of erroneous operation of the tap operation. The step of determining may be an erroneous operation of the first operation when the second operation is detected within a predetermined time after the first operation, which is a tap operation on the touch panel, is detected. Including determining that there is. The step of controlling the display includes performing a pre-defined marking display corresponding to the item that is the target of the first operation that is determined to be erroneous in the determining step. In the marking display, the control program causes the computer to further execute a step of accepting an operation of invalidating or validating the first operation.
Preferably, in the step of controlling the display, the marking operation corresponding to the item that is the target of the first operation that is determined to have a possibility of an erroneous operation is the first operation that has been determined to have no possibility of an erroneous operation. Display in a display mode different from the marking display corresponding to the item that is the target of the.
Preferably, the different display modes include at least one of different display colors, different shapes, and different sizes.
Preferably, when an operation for enabling the first operation with respect to the marking display is received in the receiving step, the step of controlling the display determines that the pre-defined marking display is not likely to be erroneously operated. Changing to the marking display corresponding to the item that is the target of the first operation.
Preferably, in the step of controlling the display, the display on the touch panel is scrolled according to the flick operation detected in the detecting step, and the item that is the target of the tap operation detected in the detecting step is displayed in the selected state. Including.
Preferably, when an operation of invalidating the first operation with respect to the marking display is accepted in the accepting step, the step of controlling the display cancels the display of the selection state of the item that is the target of the first operation Including doing.
Preferably, the accepting step accepts an operation to invalidate the first operation for the marking display corresponding to the item that is the target of the first operation that is determined not to be erroneous in the determining step. In this case, the step of controlling the display includes not releasing the display of the selection state of the item that is the target of the first operation.
Preferably, the second operation is a flick operation or a tap operation.
Preferably, the step of controlling the display corresponds to the item that is the target of the first operation that is determined to be erroneous in the determining step of the map display that covers the entire list of items displayed on the touch panel. Including marking on the coordinates.
Preferably, the map display is a scroll bar.
Preferably, the operation of disabling or enabling the first operation is a gesture operation for marking display.
Preferably, in the step of controlling the display, when a predetermined operation for the marking display is detected in the detecting step, the display of the touch panel is displayed so as to display the display of the item that is the target of the first operation corresponding to the marking display. Including scrolling.
According to still another aspect of the present invention, a program for causing a computer of an image forming apparatus to execute causes the computer of the image forming apparatus to execute the control program.
Preferably, the program to be executed by the computer of the image forming apparatus is controlled so as not to accept a job start instruction when there is an item that is a target of the first operation that is determined to be erroneous. This step is further executed by the computer of the image forming apparatus.

  According to the present invention, even if the operation on the touch panel corresponds to a tap operation unintended by the user depending on the operating environment such as humidity or the state of an operation object such as a finger, a malfunction that is not intended by the user can be prevented. it can.

1 is a diagram illustrating a specific example of a configuration of an image forming system according to an embodiment. 1 is a schematic diagram illustrating a schematic hardware configuration of an image forming apparatus included in an image forming system. 3 is a flowchart showing the flow of overall processing in the image forming apparatus. It is a flowchart showing the detailed content of the process of the operation panel in step S7 of FIG. It is a figure showing the specific example of the screen which displayed electronic information. It is a figure showing the specific example of the screen which displayed electronic information. It is a figure showing the contact state to the touch panel by gesture operation when a finger | toe moves on the touch panel smoothly. It is a figure showing the contact state to the touch panel by gesture operation when a finger | toe does not move smoothly on a touch panel. It is a figure showing the specific example of the display when gesture operation was made. It is a figure showing the specific example of the display when gesture operation was made. It is a figure showing gesture operation as flick operation. It is a figure showing the specific example of the relationship of the maximum scroll speed with respect to gesture operation speed. It is a figure showing the specific example of transition of the scroll speed in one scroll operation. 3 is a block diagram illustrating a specific example of a functional configuration of the image forming apparatus. FIG. 5 is a flowchart showing the flow of gesture detection processing in step S27 of FIG. 4 in the image forming apparatus 1. 5 is a flowchart showing the flow of gesture detection processing in step S27 of FIG. 4 in the image forming apparatus 1.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

  In the following example, the control device is assumed to be included in the image forming apparatus. However, the control device is a separate device connected to the image forming apparatus and controls the operation panel that is the touch panel of the image forming apparatus. You may do.

  Further, the control target of the control apparatus is not limited to the image forming apparatus, and may be any apparatus having a touch panel. That is, the control device may be included in any device having a touch panel.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of the image forming system according to the present embodiment. Referring to FIG. 1, in the image forming system, a plurality of image forming apparatuses 1-1A,... 1-1N and a plurality of information processing apparatuses 3-1A,. -1, a plurality of image forming apparatuses 1-2A, ... 1-2N and a plurality of information processing apparatuses 3-2A, ... 3-2M connected via a network 4-2. 2 systems are connected via an external network 5.

  The image forming apparatus 1-1A,... 1-1N, 1-2A,... 1-2N is represented by the image forming apparatus 1, the information processing apparatuses 3-1A,... 3-1M, 3-2A,. The information processing device 3 will be referred to as a representative.

  The networks 4-1 and 4-2 may be any of a network using a dedicated line such as a LAN (Local Area Network), a network using a general line such as the Internet, a network using wireless communication, and the like. Also, the external network 5 may be any of a network using a dedicated line such as a LAN, a network using a general line such as the Internet, a network by wireless communication, and the like. Further, the image system may be connected to another system via the external network 5.

  In the present embodiment, it is assumed that the image forming apparatus 1 is a so-called MFP (Multi Function Peripherals) having a function as a digital composite bag having a scanner, a copy, and a printer function. However, the image forming apparatus 1 is not limited to an MFP as long as the apparatus has a touch panel as an operation unit and a display unit, and may be another device such as a scanner or a copy.

  The image forming apparatus 1 is an apparatus that forms on a sheet a copy image of a document image obtained by scanning and an image generated from print data transmitted from the information processing apparatus 3. Here, the print data is a drawing instruction in a page description language obtained by converting a drawing instruction issued by the operating system or application program of the information processing apparatus 3 into a page description language that can be processed by the image forming apparatus 1 by a printer driver, or This is document data described in a file format such as PDF (Portable Document Format), TIFF (Tagged Image File Format), JPEG (Joint Photographic Experts Group), XPS (XML Paper Specification).

  The original image obtained by scanning may be subjected to various settings (file format, layout setting, resolution setting, etc.) in the image forming apparatus and transmitted to the information processing apparatus 3 or the like via the network 4.

  The information processing apparatus 3 may be a general personal computer or the like. The information processing apparatus 3 generates print data according to a user instruction and transmits the generated print data to the image forming apparatus 1.

<Device configuration>
FIG. 2 is a schematic diagram illustrating a schematic hardware configuration of the image forming apparatus 1.

  Referring to FIG. 2, the image forming apparatus 1 includes a control unit 100. The control unit 100 includes a CPU (Central Processing Unit) 101 for controlling the entire apparatus, and a ROM (Read Only) for storing a control program. Memory) 102, an S-RAM (Static Random Access Memory) 103 serving as a working storage area, a battery-backed NV-RAM (nonvolatile memory) 104 for storing various settings relating to image formation, and a clock An IC (Integrated Circuit) 105 is included.

  The control unit 100 is connected to an image reading device 120 via a bus, an operation panel 130 that is a touch panel provided with keys and a display unit for performing various inputs, and networks 4-1, 4-2, and 5. A network I / F (interface) 160 for transmitting and receiving various types of information to and from an external device such as the information processing device 3 connected in this manner, and a copy image is generated from print data received by the network I / F 160 A printer controller 150 for connecting to the printer and an image output device 140 for forming a copy image on paper are connected.

  A fixed storage device 110 is connected to the control unit 100 via a bus. The fixed storage device 110 corresponds to, for example, a hard disk device.

<Overview of operation>
FIG. 3 is a flowchart showing the overall processing flow in the image forming apparatus 1. The processing shown in the flowchart of FIG. 3 is realized by the CPU 101 included in the control unit 100 reading out a program stored in the ROM 102, developing it on the S-RAM 103, and executing it. The process shown in FIG. 3 is started by turning on the power.

  Referring to FIG. 3, when processing is started, CPU 101 first performs initialization processing such as memory clearing and standard mode setting (step S1).

  When the initialization process ends, the CPU 101 performs some processing request (copy process, various setting processes, display operation, etc.) from the user by operating the key switches on the operation panel 130 of the image forming apparatus 1 and the display unit. ) Is confirmed (step S3). If not requested (NO in step S3), the CPU 101 proceeds to step S5.

  If any processing request is made by the user (YES in step S3), CPU 101 performs processing on operation panel 130 (step S7). The processing of the operation panel 130 will be described in detail later.

  If no processing is requested by the user (NO in step S3), the CPU 101 requests any processing (document print processing, various kinds of processing) from an external device such as the information processing device 3 via the networks 4-1 and 4-2. It is confirmed whether or not setting processing has been performed (step S5). If not requested (NO in step S5), the CPU 101 proceeds to step S11.

  When any processing request is made from an external device (YES in step S5), the CPU 101 executes the requested processing (step S9). Here, the other processing corresponds to processing of a print job transmitted from the information processing apparatus 3, processing for changing various settings stored in the NV-RAM 104, and the like. When all the processes requested from the external device are completed, the PU 101 returns to step S3 and repeatedly executes the above-described processes.

  If a processing request has not been received from an external device (NO in step S5), the CPU 101 checks whether or not a predetermined time has elapsed for a timer activated in a gesture detection process described later (step S11). ). If the timer has not passed the predetermined time (NO in step S11), the CPU 101 returns to step S3 and repeatedly executes the above-described processing.

  If the predetermined time has elapsed (YES in step S11), the CPU 101 stops the timer (step S13). Then, the CPU 101 returns to step S3 and repeatedly executes the above-described processing.

  FIG. 4 is a flowchart showing the detailed contents of the operation panel processing in step S7.

  Referring to FIG. 4, CPU 101 confirms whether or not the process requested by the user is display of electronic information (step S21). If that is the case (YES in step S21), the CPU 101 displays the specified electronic information in a predetermined amount (part) on the display unit of the operation panel 130 (step S23). When a part of the electronic information is displayed, the CPU 101 ends the operation panel processing and returns to the processing in FIG.

  5 and 6 are diagrams showing specific examples of screens displaying electronic information. The electronic information here refers to information for displaying a list of items. The list of items may be in the form of a list as shown in FIG. 5, or may be arranged with keys corresponding to the items as shown in FIG.

  If the process requested by the user is not a display request for electronic information (NO in step S21), the CPU 101 confirms whether a gesture operation has been performed on the displayed electronic information (step S25).

  If a gesture operation has been performed (YES in step S25), CPU 101 performs a gesture detection process (step S27). The gesture detection process will be described later. When the CPU 101 completes the gesture detection process, the CPU 101 ends the process of the operation panel and returns to the process of FIG.

  If a gesture operation has not been performed (NO in step S25), CPU 101 confirms whether or not the process requested by the user is a request for deselecting a selected item (step S29). Here, as an example, the CPU 101, when the gesture operation detected in the gesture detection process in step S27 is an operation of paying the mark for the mark indicating the selection state displayed on the scroll bar, It can be determined that a selection cancellation request has been made.

  If the process requested by the user is a selection cancellation request (YES in step S29), the CPU 101 confirms whether or not the item requested for selection cancellation can be canceled (step S31). Here, as will be described later, the CPU 101 determines that the selection can be canceled if the mark to be paid is the mark displayed by the second display method, and the mark is displayed by the first display method. If it is a mark, it is determined that the selection cannot be canceled.

  If the selection can be canceled (YES in step S31), the CPU 101 cancels the selection of the item to be paid (step S33). At this time, the CPU 101 erases a later-described mark on the scroll bar. As a result, if there is no mark by the second display method, the CPU 101 turns on the start key so that it can be accepted, and conversely, if even one mark by the second display method exists, the CPU 101 In order to prevent the job from starting, the start key is lit in red so that the start key cannot be pressed. Thereafter, the CPU 101 ends the operation panel processing and returns to the processing in FIG.

  If selection cannot be canceled (NO in step S31), CPU 101 displays an error message indicating that selection cannot be canceled on the display unit of operation panel 130 (step S35). For this display, a general pop-up message box can be used. Thereafter, the CPU 101 ends the operation panel processing and returns to the processing in FIG.

  If the process requested by the user is not deselection (NO in step S29), the CPU 101 confirms whether it is a marking display change request (step S37). Here, as an example, the CPU 101 performs a long tap (long-press tap operation) on the marking display displayed by the second display method on the scroll bar when the gesture operation detected in the gesture detection process in step S27 is performed. If it is, the marking display change request can be determined. The user can change the marking to the first display method when the item corresponding to the marking displayed by the second display method is confirmed and it is confirmed that it is not an erroneous selection.

  When the process requested by the user is a marking change (YES in step S37), the CPU 101 changes the marking display that has been tapped long from the display by the second display method to the display by the first display method (step S37). S39). As a result, when there is no more marking by the second display method, the CPU 101 turns on the start key to make it possible to accept, and conversely, if there is even one marking by the second display method, In order to prevent the job from starting, the start key is lit in red so that the start key cannot be pressed. Thereafter, the CPU 101 ends the operation panel processing and returns to the processing in FIG.

  If the processing requested by the user is not a marking change (NO in step S37), the CPU 101 confirms whether or not it is a jump request to the selected item (step S41). Here, as an example, if the gesture operation detected in the gesture detection process in step S27 is to double-tap the mark display indicating the selection state displayed on the scroll bar, the mark It can be determined that the jump request to the item corresponding to.

  If the process requested by the user is a jump to the selected item (YES in step S41), the CPU 101 scrolls the display of electronic information to a position where the item corresponding to the double-tapped mark is displayed ( Step S43). Thereafter, the CPU 101 ends the operation panel processing and returns to the processing in FIG.

  If the process requested by the user is not a jump to the selected item (NO in step S41), the CPU 101 executes another requested process (step S45). Other requested processing includes, for example, copy processing, scanned image transmission processing, various setting changes of the image forming apparatus, and the like. Thereafter, the CPU 101 ends the operation panel processing and returns to the processing in FIG.

Here, the gesture detection process in step S27 will be described in detail.
FIG. 7 and FIG. 8 are diagrams showing a touch state on the touch panel when a gesture operation for moving a position is performed while maintaining a touch state such as an operation of paying with a finger. The relationship between the passage of time and the touch state in the case of smooth movement and the case of not moving is shown. In the latter case, it may be detected that a tap operation has been performed.

  Specifically, referring to FIG. 7, when the finger moves smoothly, the touch state continues from the start of touch (down) to the end of touch (up). On the other hand, referring to FIG. 8, when the finger does not move smoothly due to the operating environment such as humidity or the state of the finger of the person who operates the touch, the touch state becomes discontinuous at the start of the gesture operation. It is an operation to pay continuously. In this case, a gesture operation in which the touch state is discontinuous is detected as a tap operation performed against the user's intention.

  On the other hand, when the user intentionally performs a tap operation, the next tap or wigg is detected after the previous tap is detected, even if the user taps a different position or wiggles continuously. It takes more than a certain amount of time to be done.

  Therefore, when the CPU 101 detects the next operation after the elapse of the predetermined time or more after detecting the tap, the CPU 101 determines that the tap is a tap operation intended by the user, and the predetermined time elapses. If the next operation is detected before, the tap is determined to be an erroneous operation (or an erroneous detection from an operation intended by the user). When a plurality of taps are detected within the predetermined time, the CPU 101 can determine that all these taps are erroneous operations. In addition, as said predetermined time, about 200 ms is mentioned, for example. The CPU 101 stores the time as a threshold value in advance and uses it for determining whether or not the tap operation is performed.

Then, the CPU 101 reflects the determination result on the display.
FIG. 9 is a diagram illustrating a specific example of display when a gesture operation is performed. The example of FIG. 9 shows an example in which a selection state is displayed when a gesture operation is performed while a list of electronic information is being displayed.

  Referring to FIG. 9, a list of electronic information is provided with a scroll bar at the left end of the list. In the list of electronic information, the CPU 101 indicates that the tapped item is in a selected state by displaying the tapped item differently from the other items. In the example of FIG. 9, the background of the entire tapped item is colored in a color different from the background of the other items (for example, yellow), indicating that it is in a selected state.

  Furthermore, the CPU 101 displays a mark at a position corresponding to the item selected by the tap operation by a display method corresponding to the determination result (marking display). As an example of the position corresponding to the selected item, the CPU 101 may display a mark at a position near the selected item on the scroll bar.

  The example of FIG. 9 shows an example in which the selection item determined to be an erroneous operation is displayed with a double line, and the selection item that is not so is marked with a thick horizontal line, but as another example, the selection item determined to be an erroneous operation is red A horizontal line and selection items other than that are displayed as a blue horizontal line. As another example of the display mode, the CPU 101 may display marks having different shapes as shown in FIG. 10A, or may display marks having the same shape and different sizes.

  In this example, a mark is displayed on the scroll bar, but the scroll bar is an example of a map that covers the entire list of items. The CPU 101 may display a map that covers the entire item list, and display a mark on coordinates corresponding to the position of the selected item on the map.

  In the following explanation, the display method of the mark for the selection item when there is no erroneous operation (or the user's intended operation is properly detected) is referred to as “first display method”, and the erroneous operation (or the user's intention) The display method of the mark for the selection item determined to be erroneous detection from the operated operation is also referred to as “second display method”.

  When the flick operation is detected without detecting the tap operation, or when the flick operation is detected after the predetermined time has elapsed since the tap operation detected first, the CPU 101 displays the operation panel 130. Scrolls the electronic information displayed on the display unit.

  At this time, preferably, the CPU 101 sets the maximum scroll speed based on the operation of the gesture speed, accelerates the scroll speed from the start of scrolling until reaching the maximum scroll speed, and reaches the maximum scroll speed. Slowly decelerate until the scroll speed becomes zero (stops).

FIG. 11 is a diagram illustrating a gesture operation as a flick operation.
Referring to FIG. 11, the flick operation is performed by touching one point (start point) on operation panel 130, which is a touch panel, with a finger or the like and sliding it by a distance L while maintaining the touch state. In this gesture operation, the finger or the like is released from the operation panel 130 to release the touch state.

  The CPU 101 obtains the gesture operation speed v (v = L / T) by dividing the movement distance L by the operation time T, which is the time from the touch until the finger or the like is released. Then, the CPU 101 calculates and sets the maximum scroll speed V using the gesture operation speed v.

  FIG. 12 is a diagram illustrating a specific example of the relationship between the maximum scroll speed and the gesture operation speed. For example, as shown in FIG. 12, the maximum scroll speed V may be specified as being proportional to the gesture operation speed v (V = k × v). The CPU 101 stores the relational expression in FIG. 12 in advance, and calculates and sets the maximum scroll speed V from the gesture operation speed v obtained from the flick operation.

  FIG. 13 is a diagram showing a specific example of the transition of the scroll speed in one scroll operation. As shown in FIG. 13, the image forming apparatus 1 accelerates from the start of the scroll operation to the maximum scroll speed, with the scroll speed calculated from the gesture operation speed v using the relationship of FIG. Thereafter, the scroll speed is reduced until it becomes zero.

<Functional configuration>
FIG. 14 is a block diagram illustrating a specific example of a functional configuration of the image forming apparatus 1 for performing the above operation. Each function shown in FIG. 14 is a function mainly formed on the CPU 101 when the CPU 101 reads out the display control program stored in the ROM 102, develops it on the S-RAM 103, and executes it. However, at least a part may be realized by a hardware configuration such as an electric circuit.

  Referring to FIG. 14, CPU 101 has input unit 201 for accepting an instruction input by touching operation panel 130 as a touch panel, and whether the gesture operation on operation panel 130 is a flick operation or a tap operation. , And a timer unit 203 for measuring the time according to an instruction from the detection unit 202, based on the content of the gesture operation and the elapsed time. A determination unit 204 for determining whether or not the operation is erroneous (or erroneous detection from an operation intended by the user), and an object corresponding to the operation is displayed in the first display method or the above according to the determination result. Display processing unit 205 for processing to display in the second display method, and gesture operation for instructing scrolling Accordingly, the operation speed calculation unit 206 for calculating the gesture operation speed v (v = L / T), the maximum scroll speed calculation unit 207 for calculating the maximum scroll speed V from the gesture operation speed v, and the operation panel 130 And a scroll processing unit 208 for executing scroll processing.

  The detection unit 202 detects that a tap operation has been performed, and causes the time measurement unit 203 to start measuring time when the time measurement unit 203 has not performed time measurement.

  In addition, the detection unit 202 detects that a tap operation has been performed or a flick operation has been performed, and if the time measurement unit 203 is measuring time, the time measurement by the time measurement unit 203 is terminated. The time counted at this time is an elapsed time from the previous tap operation. Therefore, the determination unit 204 compares the time measured by the time measuring unit 203 with the above-described predetermined time stored in advance as a threshold value, and when the elapsed time is within the predetermined time, Is determined as an erroneous operation (or erroneous detection from an operation intended by the user). Otherwise, the determination unit 204 determines that the previous tap operation is an appropriate detection of the tap operation intended by the user. When a plurality of tap operations are detected within the predetermined time, the determination unit 204 may determine that all these tap operations are erroneous operations.

  When the detection unit 202 detects that a flick operation has been performed, the determination unit 204 determines that a scroll instruction has been issued, and the operation speed calculation unit 206, the maximum scroll speed calculation unit 207, and the scroll process. A scroll process is instructed to the unit 208.

<Operation flow>
15 and 16 are flowcharts showing the flow of the gesture detection process in step S27 in the image forming apparatus 1. The processing shown in the flowcharts of FIGS. 15 and 16 is performed by causing the CPU 101 to read out the display control program stored in the ROM 102, develop it on the S-RAM 103, and execute it, thereby exercising the functions shown in FIG. Realized.

  Referring to FIG. 15, when CPU 101 detects a gesture operation from the user, CPU 101 confirms whether or not the gesture operation is a tap operation on the displayed electronic information (step S101). When the gesture operation is a tap operation (YES in step S101), the CPU 101 next confirms whether or not the time is being measured by a timer (step S103). The CPU 101 uses a timer to measure the time from when the tap operation is detected until the next gesture operation is detected, and whether the tap operation is an erroneous operation (or an erroneous detection from an operation intended by the user) based on the time. Determine. The time is measured from when the tap operation is detected until the next gesture operation is detected or until a predetermined time elapses.

  When the time is being measured by the timer (YES in step S103), the CPU 101 first stops the timer (step S105), and then checks whether or not the measured time is within a predetermined time (step S107). As described above, this predetermined time is, for example, about 200 ms, and the CPU 101 stores it in advance.

  If the measured time is within the predetermined time (YES in step S107), the CPU 101 determines that the previous tap operation (detected immediately before) is an erroneous operation, and the item detected as the operation target by the previous tap operation. The display mode of the marking display is changed so that the marking display indicating the selected state on the scroll bar is displayed by the second display method described above (step S109). At this time, the CPU 101 turns on a start key (not shown) provided on the operation panel 130 so that it cannot be pressed. Thereafter, the CPU 101 proceeds to the process of step S111.

  Depending on the operating environment, such as humidity, and the state of the person's finger, the finger touches the touch panel as shown in FIG. It may be an operation of paying after repeating the operation of moving away several times. In this case, since the CPU 101 detects the next tap operation or flick operation at short time intervals after detecting the tap operation, the CPU 101 detects the next gesture operation within the predetermined time from the previous tap operation. The CPU 101 can determine that the previous tap operation is due to the finger having once left the touch panel without moving smoothly on the touch panel, and thus can be determined as an erroneous detection (erroneous operation).

  On the other hand, if the measured time has passed the predetermined time (NO in step S107), the CPU 101 proceeds to the process in step S111. In this case, the previous tap operation (detected immediately before) is not caused by an erroneous operation, but is determined to have been tapped by the user, and the scroll bar of the item detected as the operation target by the previous tap operation The display mode of the marking display indicating the above selected state is not changed.

  If the user intentionally taps, even if the user taps another place or flicks continuously, it takes a predetermined time or more after the tap until the next tap or frig is performed. Therefore, if the CPU 101 detects the next tap operation or flick operation after a predetermined time has elapsed after detection of the tap operation, the CPU 101 is effective as if the subsequent tap operation was intentionally performed by the user. Detection can be determined.

  If the timer is not timed when a tap operation is detected (NO in step S103), the CPU 101 starts the time measurement by the timer (step S111), and then sets the item detected as the operation target by the tap operation. Marking display indicating that the item is in the selected state is performed at the corresponding position on the scroll bar by the first display method (step S113).

  As described above, the CPU 101 first displays the item detected as the operation target by the tap operation by the first display method, and when the next tap operation or the wigg operation is detected within a predetermined time, the previous tap is displayed. Is determined to be an erroneous operation and the display is switched to the second display method. Otherwise, it is determined that there is no erroneous operation, and the display is left with the first display method.

  Next, referring to FIG. 16, when the gesture operation is not a tap operation, the CPU 101 confirms whether or not it is a flick operation (step S <b> 201). If the gesture operation is a flick operation (YES in step S201), the CPU 101 next confirms whether or not the time is being measured by a timer (step S203).

  When the time is being measured by the timer (YES in step S203), the CPU 101 performs the same process as in steps S107 and S109. That is, the CPU 101 first stops the timer (step S205), and then checks whether or not the measured time is within a predetermined time (step S207). If the counted time is within the predetermined time (YES in step S207), the CPU 101 determines that the previous tap operation (detected immediately before) is an erroneous operation, and the item detected as the operation target by the previous tap operation is determined. The display mode of the marking display is changed so that the marking display indicating the selection state on the scroll bar is displayed by the second display method described above (step S209). At this time, the CPU 101 turns on a start key (not shown) provided on the operation panel 130 so that it cannot be pressed. Thereafter, the CPU 101 proceeds to the process of step S211.

  On the other hand, if the measured time has passed the predetermined time (NO in step S207), the CPU 101 proceeds to the process in step S211. In this case, the previous tap operation (detected immediately before) is not caused by an erroneous operation, but is determined to have been tapped by the user, and the scroll bar of the item detected as the operation target by the previous tap operation The display mode of the marking display indicating the above selected state is not changed.

  If the timer is not timed when a flick operation is detected (NO in step S203), the tap operation has not been detected before that, or the predetermined time has already elapsed since the tap operation was detected before that. It means that it has passed. In this case, the CPU 101 performs the processing after step S211 to scroll the display based on the electronic information.

  That is, first, the CPU 101 sets the maximum scroll speed according to the gesture operation speed (step S211). Next, it is confirmed whether or not the current display range has reached the front end or the end of the electronic information (step S213). That is, when the detected gesture operation is an operation of scrolling electronic information downward (an operation of paying upward with a finger or the like to display information below the information being displayed), the CPU 101 Whether the display range of has reached the end of the electronic information, the current display if it was an operation of scrolling upward (paying downward to display information above the displayed information) Check if the range has reached the tip of the electronic information.

  If the electronic information has not reached the front end or the end (NO in step S213), the CPU 101 moves the display range of the electronic information in the scroll direction to make a new display range, and displays the range on the operation panel 130. (Step S215). Here, for example, if the electronic information is a document, the CPU 101 stores one line for the information item list, one item for the information item list, and 10 pixels for the image as a predetermined movement amount, and corresponds to the type of electronic information. Move the moving amount and display range.

  Next, the CPU 101 updates the scroll speed (step S217). As shown in FIG. 13, the CPU 101 gradually accelerates the scroll speed from the start of scrolling until it reaches the maximum scroll speed set in step S211, and after reaching the maximum scroll speed, the CPU 101 gradually increases. Decelerate and stop (scroll speed = 0). Therefore, the CPU 101 updates the scroll speed as time elapses based on the transition of the scroll speed defined as shown in FIG. As an example, the CPU 101 updates the scroll speed so that the display moves at predetermined time intervals. This predetermined time interval corresponds to about 50 ms, for example.

  The CPU 101 checks whether or not the scroll speed has become 0, that is, whether or not the scrolling has stopped (step S219). If the scrolling has not stopped (NO in step S219), the CPU 101 returns to the process of step S213 to step S213 and repeats the above-described process. If scrolling has stopped (YES in step S219), CPU 101 ends the scroll process and ends the gesture detection process.

  Further, as a result of executing the scroll process, if the leading or trailing end of the display of electronic information has been reached (YES in step S213), the CPU 101 ends the scroll process and ends the gesture detection process.

  In the above example, the case where the display of the electronic information is scrolled up and down has been described. However, the same scrolling process is performed even when scrolling left and right and when scrolling two-dimensionally up and down and left and right. It is possible to apply.

  When the detected gesture operation is an operation for paying the mark indicating the selection state displayed on the scroll bar, the CPU 101 determines that the selection cancellation request has been made as described above. In this case, the CPU 101 performs the processes of steps S31 to S35. That is, when the target of the gesture operation is a mark displayed by the second display method, the CPU 101 cancels the selection state of the item represented by the mark (step S33). In this case, the CPU 101 may delete the mark display displayed by the second display method. If the target of the gesture operation is a mark displayed by the first display method, the CPU 101 does not cancel the selected state but displays an error (step S35).

  In addition, when the detected gesture operation is a long tap (a long press tap operation) for the marking displayed by the second display method on the scroll bar, the CPU 101 requests to change the marking display as described above. Judge. In this case, the CPU 101 performs the process of step S39. That is, the CPU 101 changes the display method of the mark from the second display method to the first display method. At this time, the CPU 101 may determine the selection state of the item corresponding to the mark.

  Further, when the detected gesture operation is to double-tap the mark display indicating the selection state displayed on the scroll bar, as described above, the CPU 101 requests a jump to the item corresponding to the mark. Judge. In this case, the CPU 101 performs the process of step S43. That is, the CPU 101 automatically scrolls the display of the electronic information to the position where the item corresponding to the double-tapped mark is displayed, and displays the item in the selected state corresponding to the mark displayed as the operation target. Jump to display.

<Effect of Embodiment>
When the above processing is performed in the image forming apparatus 1 according to the present embodiment, when an item is selected by performing a gesture operation on the touch panel on which display based on electronic information is performed, the user performs an erroneous operation. You can easily notice that there is an item that may be selected. Therefore, malfunction can be prevented.

  In addition, when there is an item that may be erroneously operated, the user can easily operate the mark representing the item by scrolling the display of the electronic information and not displaying the approximate item. The item can be deselected.

  Further, in the image forming apparatus 1, it is possible to prevent the user from erroneously deselecting items that are not likely to be erroneously operated.

  Further, when there is an item that may be erroneously operated, the user can easily display the item without performing an operation for scrolling the display of the electronic information.

<Others>
Furthermore, a program for causing the CPU 101 of the image forming apparatus 1 to execute the above-described processing can be provided. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program according to the present invention is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1, 1-1A, ... 1-1N, 1-2A, ... 1-2N Image forming apparatus, 3, 3-1A, ... 3-1M, 3-2A, ... 3-2M Information processing apparatus, 4-1, 4-2 network, 5 external network, 100 control unit, 101 CPU, 102 ROM, 103 S-RAM, 104 NV-RAM, 105 clock IC, 110 fixed storage device, 120 image reading device, 130 operation panel, 140 image output Apparatus, 150 printer controller, 160 network I / F, 201 input unit, 202 detection unit, 203 timing unit, 204 determination unit, 205 display processing unit, 206 operation speed calculation unit, 207 maximum scroll speed calculation unit, 208 scroll processing unit .

Claims (28)

A control device for controlling a device having a touch panel,
Detecting means for detecting an operation on the touch panel;
Display processing means for controlling display related to items displayed on the touch panel according to the operation;
Determination means for determining the possibility of erroneous operation of the tap operation detected by the detection means,
The determination means may erroneously operate the first operation when a second operation is detected within a predetermined time after the first operation, which is a tap operation on the touch panel, is detected by the detection means. It is determined that
Said display processing means, prior SL and correspond to the item which is the is determined that there is a possibility of erroneous operation first operation target in the determination unit, rows that have a marking display as defined previously,
A control device that accepts an operation to invalidate or validate the first operation in the marking display . Pre Symbol display processing unit, it is determined that there is a possibility of erroneous operation of the first operation marking display that corresponds to the item that is the subject, it is determined that there is no possibility of erroneous operation of the first it is displayed in a display mode different from the marking display that corresponds to the item that is operation of the subject, the control apparatus according to claim 1. The control device according to claim 2 , wherein the different display modes include at least one of a different display color, a different shape, and a different size. When receiving an operation to enable the first operation on the marking display, wherein the display processing means, the marking display as defined previously, wherein there is no possibility of erroneous operation and the determined first The control device according to claim 2 , wherein the control device changes to a marking display corresponding to an item that is an object of the operation. The display processing means scrolls the display of the touch panel according to the flick operation detected by the detection means, and sets the item that is the target of the tap operation detected by the detection means as a display of a selection state. The control apparatus in any one of Claims 1-4. The display processing unit cancels the display of the selection state of an item that is a target of the first operation when an operation for invalidating the first operation is received with respect to the marking display. 5. The control device according to 5 . When accepting an operation by pairs marking the display corresponding to the item which is the is determined that there is no possibility of erroneous operation first operation target to disable the first operation before Symbol judging means, The control device according to claim 5 , wherein the display processing unit does not cancel the display of the selection state of the item that is the target of the first operation. The control device according to claim 1, wherein the second operation is a flick operation or a tap operation. The display processing means is a coordinate display corresponding to an item that is a target of the first operation that is determined by the determination means to be erroneous in the map display that covers the entire list of items displayed on the touch panel. to performs the marking display control device according to any one of claims 1-8. The control device according to claim 9 , wherein the map display is a scroll bar. The first disable the operation of the or Enable operation is gesture operation for the marking display control device according to any one of claims 1 to 10. When the detection unit detects a predetermined operation for the marking display, the display processing unit displays the display of the item that is the target of the first operation corresponding to the marking display. the scroll control device according to any one of claims 1 to 11. A control device according to any one of claims 1 to 12, the image forming apparatus. The control unit according to claim 13 , further comprising: a control unit configured to perform control so as not to accept a job start instruction when there is an item that is a target of the first operation that is determined to have the possibility of the erroneous operation. Image forming apparatus. A control program for causing a computer to execute control of a device having a touch panel,
A step of detecting an operation against the touch panel,
Controlling the display of items displayed on the touch panel in response to the operation;
Causing the computer to execute a step of determining a possibility of an erroneous operation of the tap operation detected in the detecting step,
In the determining step, when a first operation, which is a tap operation on the touch panel, is detected by the detecting step, and the second operation is detected within a predetermined time, the first operation is erroneously operated. Including determining that there is a possibility of
The step of controlling the display includes performing a pre-defined marking display corresponding to the item that is the target of the first operation that is determined to be erroneous in the determining step,
A control program for causing the computer to further execute a step of accepting an operation for invalidating or validating the first operation in the marking display . In the step of controlling the display, the marking operation corresponding to the item that is the target of the first operation that is determined to have a possibility of an erroneous operation is displayed on the first operation that is determined to have no possibility of an erroneous operation. The control program according to claim 15, comprising: displaying in a display mode different from the marking display corresponding to the item that is the target of the item. The control program according to claim 16, wherein the different display modes include at least one of a different display color, a different shape, and a different size. The step of controlling the display when the operation for enabling the first operation is accepted for the marking display by the accepting step, the marking display defined in advance is not likely to be erroneously operated. The control program according to claim 16, comprising changing to a marking display corresponding to an item that is a target of the first operation determined to be. The step of controlling the display includes scrolling the display of the touch panel according to the flick operation detected in the detecting step, and selecting an item that is a target of the tap operation detected in the detecting step in a selected state. The control program according to any one of claims 15 to 18, comprising displaying. The step of controlling the display when the operation of invalidating the first operation with respect to the marking display is accepted by the accepting step is the step of controlling the display of the item that is the target of the first operation. The control program according to claim 19, including releasing the display. The accepting step accepts an operation to invalidate the first operation with respect to a marking display corresponding to the item that is the target of the first operation that has been judged as having no possibility of erroneous operation in the judging step. 21. The control program according to claim 19 or 20, wherein the step of controlling the display includes not canceling the display of the selected state of the item that is the target of the first operation. The control program according to any one of claims 15 to 21, wherein the second operation is a flick operation or a tap operation. The step of controlling the display corresponds to an item that is a target of the first operation that is determined to be erroneous in the determination step of the map display that covers the entire list of items displayed on the touch panel. The control program according to any one of claims 15 to 22, comprising displaying the marking on the coordinates. The control program according to claim 23, wherein the map display is a scroll bar. The control program according to any one of claims 15 to 24, wherein the operation for disabling or enabling the first operation is a gesture operation for the marking display. In the step of controlling the display, when a predetermined operation on the marking display is detected in the detecting step, the display of the item that is the target of the first operation corresponding to the marking display is displayed. The control program according to any one of claims 15 to 25, comprising scrolling the display on the touch panel. A program for causing a computer of an image forming apparatus to execute,
A program for causing a computer of the image forming apparatus to execute the control program according to any one of claims 15 to 26. Causing the computer of the image forming apparatus to further execute a step of controlling not to accept a job start instruction when there is an item that is a target of the first operation that is determined to have the possibility of the erroneous operation; The program according to claim 27.

Images