JP6512056B2 - Image forming apparatus, method and program - Google Patents

Description

  The present invention relates to an image forming apparatus, method, and program, and more particularly, to an image forming apparatus, method, and program for processing information of operation contents on a touch panel.

  Current image processing apparatuses (for example, copiers, printers, MFPs (Multi-Function Peripherals), etc., which are multifunction machines thereof) are equipped with a touch panel in order to receive user's operations. The touch panel of the MFP can display the scanned document on the touch panel, and enables the selection and movement of the document using flick and drag & drop technology.

  However, when you want to move a document using drag operation as a task on the touch panel or edit a document using the stamp function, if the pressure on the fingertip temporarily decreases, the user does not intend Documents and stamps are left behind, and there is a problem that a drag operation is started for other documents and stamps.

  In order to solve such a subject, the method by patent document 1 (Unexamined-Japanese-Patent No. 2007-80110) is proposed, for example. In Patent Document 1, when the drag operation is performed, the movement speed is calculated with respect to the movement distance and movement time of the drag operation, and when the set speed threshold is exceeded, even if the end of the drag operation is declared We propose a method to keep the drag state for a fixed time.

Japanese Patent Application Publication No. 2007-80110

In patent document 1, since it sets with the uniform threshold value, there exist the following subjects.
The first issue is as follows. If the threshold value is uniformly set high for the screen type being displayed, as in the box screen, the document dragged to the unintended box does not fall, so storage in the box can be prevented.

  However, as a disadvantage, the operability of the drag operation is complicated. Specifically, since the document list screen is displayed in the same screen, failure of the drag operation can be recognized at a glance. Therefore, although it is possible to repeat the drag operation again even if it fails, the high threshold allows the drag state to be maintained even if the document is dropped to the intended location, resulting in poor operability.

  On the other hand, if the operability of the drag operation by the user is prioritized by uniformly setting the threshold value low, the user can easily move the document to the intended place even when moving the document as in the document list screen. It can be dropped.

  However, the disadvantage is that it is less likely to prevent accidental manipulation of the drug. Specifically, in the case where a document is stored like a box screen, there is a high possibility that the document will be stored in a box not intended by the user due to an erroneous operation. In addition, because the threshold is low, the drag state can not be held for a certain period of time, and it is not possible to know in which box the document is stored.

  The second issue is as follows. If the threshold value is uniformly set to a high value for the preview image information being displayed, the drag operation is accidentally ended in the sentence in the preview, and the drag operation is held even if the sentence and the icon (stamp) overlap Erroneous operation can be prevented.

  In this case, the disadvantage is that even if you try to drop the icon in the intended place (preview margin), the drag operation continues to be held due to the high threshold, the icon can not be dropped easily, and the operability of the user is impaired Probability is high.

  On the other hand, by setting the threshold uniformly and low, the user can perform a drag operation and drop the icon at the intended location (preview margin), and the original drag operation operability is maintained.

  As a disadvantage of this case, it is difficult to prevent erroneous operations such as dropping an icon by mistake in a sentence and putting on a sentence and an icon because the threshold is low.

  The third issue is as follows. If you set the threshold value high uniformly for the drag direction, in the direction in which the drag operation is difficult for the user, that is, in the direction in which the finger is pressed, the operation with the pressure on the fingertip being difficult to apply constant pressure becomes difficult. There is a high possibility of causing an erroneous operation such as a document falling, but the high threshold does not cause the document to fall and can prevent an erroneous operation of dragging.

  As a disadvantage in this case, if the direction in which the user drags the user, that is, the direction in which the finger is traced, the pressure on the fingertip is likely to be constant and the possibility of an erroneous operation such as falling documents is low. Even if you try to drop the document to the place where it was, the drag operation will continue to be held, and there is a high possibility that the operability of the user will be impaired.

  On the other hand, by setting the threshold uniformly and low, the operability of the original drag operation of moving the document and dropping the document to the intended location is maintained in the direction in which the user can easily perform the drag operation.

  As a disadvantage in this case, when the drag operation is difficult for the user, the drag operation is to push the document, so the finger slips, and the document falls to an unintended place. It is less likely to prevent drug mishandling.

  The fourth issue is as follows. If the threshold value is uniformly set high for the speed at which the drag operation is performed, it is possible to prevent an erroneous drag operation when the speed of the finger during the drag operation is fast. Specifically, the moving document can not keep up with speed, and the pressure on the fingertip can not be fixed, and the document may be dropped to an unintended place, but the threshold is increased. Since the document retains the drag operation without falling, it is possible to prevent an erroneous drag operation.

  As a disadvantage in this case, if the speed of the finger during drag operation is slow, it is easy to apply a certain force to the fingertip, so the possibility of an erroneous operation such as falling of the document is low, but the place intended by the high threshold If you try to drop the document, the drag operation will continue to be held, and there is a high possibility that the operability of the user will be lost.

  On the other hand, by uniformly setting the threshold value low, when the speed of the finger during the drag operation is slow, the operability of the original drag operation of moving the document and dropping the document at the intended location is maintained.

  As a disadvantage in this case, if the speed of the finger during the drag operation is fast, the moving document can not keep up with the speed and the pressure on the fingertip can not be applied a certain force, and it may fall to an unintended place It is higher and less likely to prevent drug mishandling.

  The fifth issue is as follows. If the threshold value is uniformly set high for the distance of the drag operation, it is possible to prevent an erroneous operation of the drag. Specifically, when the document is moved to a distance far from the start point of the drag operation, it becomes difficult to keep applying a constant force to the pressure of the fingertip as the movement distance increases, and the document falls to an unintended place Although the possibility is high, the threshold is raised, so the document does not drop and holds the drag operation. This makes it possible to prevent an erroneous operation of the drag.

  As a disadvantage in this case, the operability of the user is likely to be impaired. Specifically, when the document is moved to a distance close to the start point of the drag operation, the movement distance is short, which reduces the possibility of an erroneous operation such as the document falling. However, even if the document is to be dropped to the intended place because the threshold value is high, the drag operation continues to be held, and the operability of the user is likely to be impaired.

  On the other hand, if the document is moved to a distance close to the start point of the drag operation by setting the threshold uniformly low, the movement distance is short, so the possibility of erroneous operation such as the document falling is low, The operability of the original drag operation such as dropping the document is maintained.

  As a disadvantage in this case, when moving the document to a distance far from the start point of the drag operation, it becomes difficult to keep applying a certain force to the pressure of the fingertip as the moving distance becomes longer, and it falls to an unintended place The possibility is high, and the possibility of preventing accidental manipulation of the drug is low.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image forming apparatus, method, and program that improve the operability of a user's drag operation.

  According to an aspect of the present invention, an image forming apparatus controls a screen capable of displaying an image including a plurality of component images, an operation accepting unit for accepting an operation by an instruction member on a component image displayed on the screen, and an image forming apparatus And a control unit for

  The control unit displays a speed detection unit that detects the moving speed of the pointing member on the screen, and a threshold speed for determining the moving speed of the pointing member when the drag operation is received by the operation receiving unit. It includes a threshold value determination unit that determines based on the content of the image, and an end detection unit that detects the end of the operation based on the operation content received by the operation reception unit.

  The control unit compares the threshold speed with the movement speed detected when the end of the drag operation is detected when the drag operation is received by the operation reception unit, and the threshold speed is faster than the movement speed. Continues to accept the drag operation, and controls the operation accepting unit to end the acceptance of the drag operation when the threshold speed is equal to or less than the movement speed.

Preferably, the content of the image includes the type of the image.
Preferably, the image type includes a box group image having a plurality of box images representing a storage area for storing a document as a plurality of component images.

  Preferably, the type of image includes a document list image having a list of a plurality of document images representing a document as a plurality of component images.

  Preferably, the type of image includes an image having a main image as a plurality of component images and a sub image superimposed on the main image, and the main image includes a margin portion and a non-margin portion, and the threshold is determined The unit further determines, when the operation accepted by the operation receiving unit is a drag operation, a threshold speed for determining the moving speed of the pointing member to be different speeds for the margin and the non-margin. A threshold determination unit is provided, and when the operation reception unit receives a drag operation, when the end of the drag operation is detected in the margin, the threshold speed determined for the margin, and The movement speed at which the end of the operation is detected is compared, and when the end of the operation is detected in the non-margin portion, the threshold speed determined for the non-margin portion and the end of the operation are detected Movement speed of time Based on the result of each comparison, if the threshold speed is faster than the movement speed, the acceptance of the drag operation is continued, and if the threshold speed is less than the movement speed, the acceptance of the drag operation is ended. Control the operation reception unit.

  Preferably, the threshold value determining unit determines a threshold speed for determining the moving speed of the indication member to a predetermined speed or a speed higher than the predetermined speed based on the content of the displayed image. Do.

  An image forming apparatus according to another aspect of the present invention includes a screen capable of displaying an image including a plurality of component images, an operation receiving unit for receiving an operation by an instruction member on a component image displayed on the screen, and an image forming apparatus. And a control unit for controlling.

  The control unit detects a moving speed of the pointing member on the screen, and a threshold speed for determining the moving speed of the pointing member when the drag operation is received by the operation receiving unit. When a drag operation is received by the operation receiving unit, the threshold setting unit includes a threshold setting unit that determines based on the content, and an end detection unit that detects the end of the operation based on the operation content received by the operation receiving unit. The movement speed detected when the end of the drag operation is detected is compared, and when the threshold speed is faster than the movement speed, the acceptance of the drag operation is continued and the threshold speed is less than the movement speed At this time, the control unit controls the operation reception unit to end the acceptance of the drag operation.

  Preferably, the content of the drag operation includes the movement direction of the indication member detected during the drag operation.

  Preferably, the content of the drag operation includes the moving speed detected during the drag operation.

  Preferably, the control unit is a start detection unit that detects the start of the operation based on the operation content received by the operation reception unit, and a distance detection unit that detects the movement distance of the instruction member from the start to the end of the operation. The content of the drag operation includes the movement distance of the drag operation.

  Preferably, the threshold determination unit determines a threshold speed for determining the moving speed of the indication member to a predetermined speed or a speed higher than the predetermined speed based on the content of the drag operation.

  According to one aspect of the present invention, there is provided a method implemented in an image forming apparatus. The image forming apparatus includes a screen capable of displaying an image including a plurality of component images, and an operation receiving unit for receiving an operation by the instruction member on the component image displayed on the screen.

  The method comprises the steps of: detecting the moving speed of the pointing member on the screen; and, if the accepted operation is a drag operation, a threshold speed for determining the moving speed of the pointing member based on the contents of the displayed image. Determining the end of the operation based on the content of the accepted operation, the threshold speed, and the moving speed at which the end of the operation is detected when the accepted operation is a drag operation. Based on the comparison step and the comparison result, if the threshold speed is faster than the movement speed, the acceptance of the drag operation is continued, and when the threshold speed is less than the movement speed, the acceptance of the drag operation is ended. Controlling the operation receiving unit.

  According to still another aspect of the present invention, there is provided a method implemented in an image forming apparatus. The image forming apparatus includes a screen capable of displaying an image including a plurality of component images, and an operation receiving unit for receiving an operation by the instruction member on the component image displayed on the screen.

  The method comprises the steps of: detecting the moving speed of the pointing member on the screen; and determining the threshold speed for determining the moving speed of the pointing member based on the content of the dragging operation when the accepted operation is a dragging operation Comparing the threshold speed with the moving speed at which the end of the operation is detected when the received operation is a drag operation and the step of detecting the end of the operation based on the content of the received operation; Based on the result of the step and the comparison, when the threshold speed is faster than the movement speed, the acceptance of the drag operation is continued, and when the threshold speed is less than the movement speed, the acceptance of the drag operation is ended. Controlling the unit.

  According to still another aspect of the present invention, there is provided a program for causing a computer of an image forming apparatus to execute the method described above.

  According to the present invention, the operability of the user's drag operation is improved.

FIG. 2 schematically shows a hardware configuration of the image forming apparatus 100 according to the first embodiment. FIG. 1 is a view schematically showing the appearance of an image forming apparatus 100. FIG. FIG. 2 is a view schematically showing a configuration of functions of the image forming apparatus according to Embodiment 1; 5 is a process flowchart according to the first embodiment. FIG. 10 is a diagram for describing a drag operation when a box group image is displayed on the screen of the operation panel 20. FIG. 10 is a diagram for describing a drag operation when a document list image is displayed on the screen of the operation panel 20. FIG. 10 is a diagram for describing a drag operation when a preview image is displayed on the screen of operation panel 20. It is a figure for demonstrating the direction of the drag operation in case the box group image is displayed on the screen. It is a figure for demonstrating the direction of the drag operation in case the box group image is displayed on the screen. It is a figure for demonstrating the speed of drag operation in case the box group image is displayed on the screen. It is a figure for demonstrating the speed of drag operation in case the box group image is displayed on the screen. It is a figure for demonstrating the distance of the drag operation in case the box group image is displayed on the screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same.

[Technical thought]
The technical ideas disclosed are as follows. The image forming apparatus variably determines a threshold speed for determining the speed of the drag operation on the image based on the contents of the displayed image or the contents of the drag operation. The image forming apparatus compares the threshold speed with the movement speed detected when the end of the drag operation is detected when the drag operation is received by the operation receiving unit, and the threshold speed is faster than the movement speed. At the same time, reception of the drag operation is continued, and when the threshold speed is equal to or less than the movement speed, the operation reception unit is controlled to end reception of the drag operation.

  Thereby, the image forming apparatus can dynamically change the threshold speed for determining continuation or end of the drag operation acceptance according to the content of the display image or the content of the user's operation, and the content of the display image or the user It becomes possible to accept the drag operation according to the operation content of. As a result, the operability of the user in the drag operation can be improved.

  In each embodiment, the image displayed on the screen includes one or more "part images". The part image includes an icon, a thumbnail image, a stamp image to be superimposed on the document image, and the like. The user performs various operations such as a touch operation and a drag operation on the component image displayed on the screen using the “instruction member”. In each embodiment, “drag operation” refers to the case where the user changes the contact position with the screen (touch panel) while the user selects the part image by the touch operation on the screen (touch panel), and the part image is displayed in the screen. Operation to move at The pointing member includes a finger or a dedicated pen.

First Embodiment
FIG. 1 is a diagram schematically showing the hardware configuration of the image forming apparatus 100 according to the first embodiment. The image forming apparatus may be an apparatus having at least one or more image processing functions, and may be, for example, other apparatuses such as the above-described MFP, printer, facsimile transmitter / receiver, and copier. FIG. 2 is a view schematically showing the appearance of the image forming apparatus 100. As shown in FIG. Referring to FIG. 1, an image forming apparatus 100 includes a central processing unit (CPU) 10 corresponding to a control unit for controlling the entire apparatus, a timer 11, a storage unit for storing programs and data, and input of information. It includes an output unit, a network I / F (abbreviation of interface) 17 for communicating via a LAN (Local Area Network), and various processing units.

  The storage unit includes a ROM (Read Only Memory) 12 for storing a program and data executed by the CPU 10, a RAM (Random Access Memory) 13 for functioning as a work area when the CPU 10 executes the program, and an image. It includes an HDD (Hard Disc Driver) 14 for storing data and the like.

  The input / output unit includes an operation unit I / F (abbreviation of interface) for connecting the operation panel 20 including the display 21 such as liquid crystal. The operation panel 20 displays an image by controlling the display 21 based on the image data from the operation unit I / F 16. The operation unit I / F 16 also acquires the content of the user's operation on the image forming apparatus 100 based on the output from the operation panel 20.

  The various processing units include a scanner 18 and a printer 19. The various processing units are controlled by a device I / F (abbreviated interface) 15. Document data and image data read by the scanner 18 are stored in the storage unit.

<Functional configuration>
FIG. 3 is a view schematically showing a configuration of functions of the image forming apparatus according to the first embodiment. The CPU 10 is a control unit for controlling the image forming apparatus 100, and the coordinate acquisition unit 31 for acquiring the coordinates of the touch position on the display 21 based on the output from the operation unit I / F 16 11, when the drag operation is received through the time acquisition unit 32 acquired using 11, the operation processing unit, and the operation panel 20, the threshold speed for determining the moving speed of the instruction member is the content of the displayed image Or the threshold value determination part 38 determined based on the content of operation, and the reception control part 40 which controls operation part I / F16 are included.

  The operation processing unit determines the type of the operation by the instruction member on the screen based on the operation content output from the operation unit I / F 16, the operation type determination unit 33, the moving speed and the movement distance of the instruction member in the operation It includes a speed detection unit 34 and a distance detection unit 35 to be detected, and a start detection unit 36 and an end detection unit 37 for detecting the start and end of movement of the pointing member on the screen at the time of operation.

<Detection of operation>
The operation panel 20 includes a display 21 and a touch panel mounted on the top or bottom of the screen of the display 21. The screen has, for example, a rectangular shape, and the touch panel has the same size (shape and area) as the screen. For the purpose of explanation, the screen (touch panel) corresponds to a two-dimensional coordinate plane defined by an X axis and a Y axis orthogonal to the X axis. Each position in the image displayed on the screen also corresponds to each coordinate value of this two-dimensional coordinate. The CPU 10 manages each position in the image displayed on the screen by the coordinate values of this two-dimensional coordinate. Therefore, when the coordinate position on the screen (touch panel) designated by the instruction member is acquired, the corresponding coordinate position in the image is uniquely identified based on the acquired coordinate position. Then, the CPU 10 can uniquely identify the component image displayed at the coordinate position by analyzing the image data based on the specified coordinate position in the image.

  When the user touches (contacts) an arbitrary position on the screen with the pointing member, the touch panel electrically detects the touched position based on a change in capacitance or the like.

  The operation panel 20 detects the position detected based on the current signal from the touch panel and the pressing force by the pointing member on the screen at the position. Here, the detection of the position is electrically detected, but may be detected magnetically.

  The operation unit I / F 16 periodically converts the operation content (position and pressure signal) detected by the operation panel 20 into digital data in synchronization with the timer 11, and outputs the converted data. The operation unit I / F 16 is an example of the “operation reception unit”.

  The coordinate acquisition unit 31 converts time-series position data output from the operation unit I / F 16 into coordinates. Each of the start detection unit 36 and the end detection unit 37 compares the value of pressing force at each position in the time series with a predetermined value. The start detection unit 36 detects that the touch operation by the pointing member is started at the position when it is determined that the pressing force becomes equal to or more than a predetermined value based on the result of the comparison. When the end detection unit 37 determines that the pressing force is smaller than a predetermined value based on the comparison result, the end detection unit 37 detects that the touch operation by the pointing member has ended at the position.

  Note that the method of detecting the start or the end of the touch operation is not limited to the method based on the pressing force, and it is necessary to detect whether or not the next order coordinate in the time series is detected or the next order coordinate is detected. Detection may be performed based on the length of time, or may be detected by a combination of these.

  The distance detection unit 35 detects (calculates) the distance and direction of movement of the pointing member between the detected different coordinate positions, for example, by calculation. For example, the distance is calculated based on continuous time-series coordinates between the start coordinates and the end coordinates detected as described above. After the start is detected by the start detection unit 36, the distance detection unit 35 determines whether the end of the operation is detected based on the output of the end detection unit 37. While the end of the operation is not detected, based on time-series coordinates formed by connecting the coordinates of the position data input immediately before with the operation unit I / F 16 and the coordinates of the position data to be input next to the position data. Detect the above distance.

  The speed detection unit 34 measures the time required for the movement of the distance, and detects (calculates) the movement speed of the pointing member on the screen from the movement distance and the measurement time, for example, by calculation.

  When the operation control unit 40 determines that the operation to be accepted is a drag operation by the operation type determination unit 33, the threshold velocity Vo determined by the threshold determination unit 38 and the end of the operation are detected. The moving speed Va measured in the above is compared, and the operation unit I / F 16 is controlled based on the comparison result. Specifically, when the comparison result indicates that the threshold velocity Vo is higher, the control of the operation unit I / F 16 is continued so that reception of the operation from the operation panel 20 is continued even if the end of the drag operation is detected. Conversely, when the result of the comparison indicates that the threshold velocity Vo is less than or equal to the measured moving velocity Va, the acceptance of the operation from the operation panel 20 is terminated when the end of the dragging operation is detected ( Control the operation unit I / F 16 so as to prohibit.

  These functions are stored in the ROM 12 as a program. The CPU 10 reads a program from the ROM 12 and executes the read program to realize the functions of the respective units.

<Processing flow>
FIG. 4 is a process flowchart according to the first embodiment. A program of processing for the drag operation of FIG. 4 is stored in the ROM 12. The processing is realized by the CPU 10 reading a program from the ROM 12 and executing the read program.

  When a touch operation is performed on the screen of the operation panel 20, the operation type determination unit 33 determines an operation pattern indicated by the operation content based on the operation content detected by the operation unit I / F 16 and various types of information stored in the storage unit. The operation pattern is collated, and based on the result of the pattern collation, it is determined whether the operation content is a drag operation. Here, the storage unit stores operation patterns in a plurality of types including a drag operation. When the operation type determination unit 33 determines that the operation content is a drag operation, the CPU 10 starts the process of FIG. 4 (step 1).

  First, the start detection unit 36 acquires coordinates of the start of the drag operation and time from the coordinate acquisition unit 31 and the time acquisition unit 32 (step S3). Subsequently, the CPU 10 determines whether the end of the drag operation is detected based on the received operation content (step S5). When it is determined that the end is not detected (NO in step S5), the process of step S5 is repeated while coordinate positions and pressing force are detected in time series in conjunction with the movement of the pointing member.

  When it is determined that the end has been detected (YES in step S5), the CPU 10 acquires position coordinates and time when the end is detected by the end detection unit 37 (step S7).

  The distance detection unit 35 acquires the movement distance of the pointing member from the start and end position coordinates acquired in steps S3 and S5, and the speed detection unit 34 determines the distance and the start and end acquired in steps S3 and S5. The movement speed Va of the pointing member is measured (calculated) from the time of (step S9).

  The threshold determination unit 38 determines the threshold velocity Vo based on the processing information on the operation panel 20 of the image forming apparatus 100 (step S11). The processing information includes the contents of the image displayed on the screen or the contents of operation on the screen. Details of a method of determining the threshold velocity Vo will be described later.

  The CPU 10 compares the above-mentioned threshold speed Vo with the moving speed Va measured when the end of the drag operation is detected (step S13), and based on the comparison result, the threshold speed Vo is the moving speed Va. If it is determined that the drag operation is higher (YES in step S13), the drag operation is held even if the end of the drag operation is detected (step S15). That is, the CPU 10 controls the operation unit I / F 16 so as to receive the operation content from the operation panel 20 (more preferably, to receive the constant time continuously). As described above, the operation type determination unit 33 determines whether the type of operation is a drag operation based on the operation content that is continuously received (step S17). If it is determined that the type of operation is a drag operation (YES in step 17), the process returns to step S3, and the subsequent processing is similarly repeated, but if it is determined that the operation is not a drag operation (NO in step 17) Then, the process proceeds to step S19, and the drag operation completion process is performed by the CPU 10 (step S19). Details of the drag operation completion process will be described later.

  When the CPU 10 determines that the threshold speed Vo is equal to or lower than the movement speed Va based on the above comparison between the threshold speed Vo and the movement speed Va (NO in step S13), the operation content from the operation panel 20 is The operation unit I / F 16 is controlled to end (or inhibit) the acceptance, and the drag operation completion process is performed by the CPU 10 (step S19).

  According to the process of FIG. 4, the threshold speed Vo for determining the moving speed Va of the drag operation is dynamically changed based on the above processing information, and the threshold speed Vo is compared with the measured moving speed Va. Based on the result of the above, it is determined whether or not the operation unit I / F 16 can hold the operation content of the drag operation for a certain period of time even if the end of the drag operation is detected.

  Therefore, when a drag operation is performed on a component image (such as an icon) displayed on the screen, it is possible to prevent the inconvenience that the drag operation is detected to end at an unintended place and position on the screen.

Second Embodiment
In the second embodiment, as a modification of the first embodiment, a method based on the type of an image displayed on the screen will be described as a specific determination method of the threshold speed of the drag operation. The CPU 10 reads data of a display image from the HDD 14 and displays the data on the display 21. The CPU 10 acquires the type of display image from the header information of the image data.

<Drag operation of box icon>
The contents of the above image include the type of image displayed on the screen. The type of image includes a box icon of a box group having a plurality of box icons (icons) representing storage areas for storing a document as a plurality of component images. FIG. 5 is a diagram for explaining a drag operation when a box group image is displayed on the screen of the operation panel 20.

  Referring to FIG. 5, a document icon 50 which is an icon corresponding to document data and one or more box icons which are box-shaped icons (images) are simultaneously displayed on the screen. The user performs a drag operation so as to move the document icon 50 at the lower right of the screen to the position of the box icon 51 at the upper left of the screen. The arrow 52 indicates the movement (distance and direction) of the pointing member by the drag operation. These icons are one example of the "part image" which constitutes each part of the image displayed on the screen.

  When the drag operation is started according to the arrow 52 in the screen of FIG. 5, the process is started in FIG. In step S11, the threshold value determination unit 38 determines the above-mentioned threshold speed Vo based on the type of the image displayed on the screen (that is, the box group image) as the above processing information. Specifically, the threshold velocity Vo is determined to be faster than the predetermined velocity 41 to determine the drag operation. The predetermined speed 41 is a standard speed for determining the drag operation, and is indicated by data stored in the storage unit when the image forming apparatus 100 is shipped from the factory.

  Further, as the drag operation completion process of step S19, the CPU 10 performs a process of “dropping” the document icon 50 on the box icon. Specifically, the CPU 10 updates the display image on the display 21 so that the document icon 50 is dropped on the box icon 51, and the document data of the document icon 50 is stored in a storage area corresponding to the box icon 51. Store in (for example, document folder). The other processes in FIG. 4 are the same as those described above, and therefore the description will not be repeated.

  When the image in FIG. 5 is displayed, the threshold velocity Vo is determined to be faster than the velocity 41, thereby preventing erroneous determination of the end of the drag operation in the middle of the drag operation regardless of the moving velocity. Is possible.

  As a result, as shown by the arrow 52 in FIG. 5, even if the pointing member crosses many box icons by the drag operation, the above-mentioned "dropping process" is mistakenly performed for the box icon in the middle. Can be prevented.

<Drag operation of document list image>
The above-described image types include a document list image having a list of a plurality of document images (icons) representing a document as a plurality of component images. FIG. 6 is a diagram for explaining the drag operation when the document list image is displayed on the screen of the operation panel 20.

  Referring to FIG. 6, on the screen, document icons 60 which are icons corresponding to each document data are displayed in a list. The user performs a drag operation to move the document icon 60 at the upper left of the screen to the position of the area 63 at the lower right of the screen. The arrow 62 indicates the movement (distance and direction) of the pointing member by the drag operation. These icons are one example of the above-mentioned "part image".

  When the drag operation is started according to the arrow 62 on the screen of FIG. 6, the process of FIG. 4 is started. In step S11, the threshold value determination unit 38 determines the above-mentioned threshold speed Vo based on the type of the image displayed on the screen (that is, the document list image) as the above processing information. Specifically, the threshold velocity Vo is determined to be a predetermined velocity 41 in order to determine the drag operation. As a drag operation completion process of step S19, the CPU 10 performs a movement display process. Specifically, the CPU 10 generates image data for moving the document icon 60 to the area 63 of the screen for display, and controls the display 21 based on the generated image data. The other processes in FIG. 4 are the same as those described above, and therefore the description will not be repeated.

  When the image of FIG. 6 is displayed, the threshold velocity Vo is determined not to be as high as that in FIG. 5 but to the velocity 41 because there is no possibility that the above “drop processing” is performed erroneously. .

<Drag operation of preview image>
FIG. 7 is a diagram for explaining the drag operation when the preview image is displayed on the screen of the operation panel 20. The types of images described above are, for example, a main image such as a document, figure, or photograph as a plurality of component images as in the preview image of FIG. 7 and a sub image 70 (signature, special mark superimposed on the main image). , An image with a stamp icon).

The main image includes a margin 73 and non-margins 71 and 74.
When the drag operation of the sub image 70 by the pointing member (finger 30) is started in accordance with the arrow 72 on the screen of FIG. 7, the processing of FIG. 4 is started. In step S11, the threshold value determination unit 38 determines the above-described threshold speed Vo based on the type of the image displayed on the screen (that is, the preview image) as the above-described processing information.

  Specifically, when the screen shown in FIG. 7 is displayed and the drag operation is performed, the threshold value determination unit 38 sets the threshold speed Vo for determining the moving speed of the finger 30 as the pointing member to the margin 73 And the non-margin portions 71 and 74 to be different speeds. Specifically, the non-margin portions 71 and 74 determine the threshold velocity Vo to be higher than the velocity 41, and the margin portion 73 determines the threshold velocity Vo as the velocity 41.

  When the drag operation is detected, and the end of the operation is detected in the margin 73, the CPU 10 detects the threshold speed Vo determined for the margin 73 and the end of the operation. The movement speed Va is compared. When the end of the operation is detected in the non-margin portions 71 and 74, the threshold velocity Vo determined for the non-margin portion is compared with the moving velocity Va when the end of the operation is detected. When the threshold speed Vo is higher than the moving speed Va based on the result of each comparison, the CPU 10 continues accepting the dragging operation even if the end of the dragging operation is detected, and the threshold speed Vo is less than the moving speed Va When it is, the operation unit I / F 16 is controlled to end (prohibit) the acceptance of the drag operation.

  In the screen of FIG. 7, the CPU 10 performs the movement display process as the drag operation completion process of step S19. Specifically, the CPU 10 generates image data for displaying the sub-image 70 in the margin 73 which is the position after the movement by the drag operation, and controls the display 21 based on the generated image data. The other processes in FIG. 4 are the same as those described above, and therefore the description will not be repeated.

  According to the method of determining the threshold speed in FIG. 7, when attempting to move and arrange the sub image 70 of the icon by the drag operation to the location (margin 73) intended by the user, the threshold speed Vo of the margin 73 is The speed is determined to be lower than the non-margin portions 71 and 74. Thereby, it becomes possible to easily move and arrange the sub-image 70 to an intended place other than the non-margin portions 71 and 74 by the drag operation.

Third Embodiment
In the third embodiment, as a modified example of the above embodiment, a method based on the content of a drag operation will be described as a specific determination method of the threshold speed of the drag operation.

<Determination of Threshold Speed Based on Movement Direction of Drag Operation>
The contents of the above-mentioned drag operation include the movement direction of the pointing member. FIGS. 8 and 9 are diagrams for explaining the direction of the drag operation when the box group image is displayed on the screen.

  FIG. 8 shows the box group image of FIG. For example, a drag operation is performed so that the document icon 50 is moved to the position of the box icon 81 at the upper left end of the screen by the finger 30 as an instruction member at the lower right end of the screen. An arrow 82 indicates the movement (the movement direction and the movement distance) of the finger 30 by the drag operation.

  Here, the user is often right-handed. Therefore, when a drag operation is performed to move the document icon 80 located at the lower right end toward the screen to the direction (direction of the box icon 81) above the left end of the screen, the finger 30 makes a constant It will be dragging while applying pressure. Therefore, the speed of the drag operation tends to be low.

  When the drag operation is started in accordance with the arrow 82 in the screen of FIG. 8, the process is started in FIG. In step S11, the CPU 10 detects the direction of movement of the pointing member based on the locus of time-series coordinates acquired by the coordinate acquisition unit 31 as the processing information described above. The threshold determination unit 38 determines the above-mentioned threshold velocity Vo to be faster than a predetermined velocity when the detected movement direction is in the upper left direction than the current position, and when the detected movement direction is any other direction. Decide on the speed 41. In addition, although illustrated to the upper left direction here, it is not limited to this.

  As described above, when the drag operation is performed in the direction in which the drag operation is difficult for the user, that is, in the direction in which the finger is pressed, the document icon 80 is displayed as an unintended box icon by setting the threshold speed Vo fast. It is possible to prevent the possibility of causing an erroneous operation such as falling.

  On the other hand, as shown in FIG. 9, when the drag operation is performed along the arrow 83 extending in the opposite direction to the arrow 82 of FIG. Become. Therefore, the pressure on the screen by the finger 30 may be small, and the speed of the drag operation tends to be higher than in the case of FIG.

  When the drag operation is started in accordance with the arrow 83 on the screen of FIG. 9, the CPU 10 detects the extending direction of the arrow 83 as the movement direction in step S11 of FIG. When the detected movement direction is in the upper right direction than the current position, the threshold determination unit 38 determines the above-mentioned threshold velocity Vo to be a predetermined velocity, and when it is any other direction, from the velocity 41 Also decide on fast speed. In addition, although the upper right direction is illustrated here, it is not limited to this.

  As described above, in the direction in which the user drags easily, that is, in the direction in which the finger is traced, the pressure on the fingertip is likely to be constant and the possibility of an erroneous operation such as a drop of the document decreases. By determining the slow speed, it is easy to detect the end of the drag operation at the intended location.

<Determination of Threshold Speed Based on Movement Speed of Drag Operation>
The contents of the above-mentioned drag operation include the moving speed of the pointing member. FIGS. 10 and 11 are diagrams for explaining the speed of the drag operation when the box group image is displayed on the screen.

  In FIG. 10, when the drag operation is performed by the finger 30 as in FIG. 8, when the moving speed of the finger 30 detected by the speed detection unit 34 indicated by the arrow 62 is faster than a predetermined speed, In S11, the threshold value determination unit 38 determines the above-mentioned threshold velocity Vo as a velocity faster than a predetermined velocity, and otherwise determines it as the velocity 41.

  As described above, when the speed of the finger 30 during the drag operation is high, a constant force is not applied to the fingertip, and the document icon 80 is accidentally dropped to an unintended box icon because the movement speed of the finger 30 can not be kept The possibility is high. In order to cope with this, in FIG. 10, by determining the threshold velocity Vo to be faster than the velocity 41, such a drag operation can be prevented.

  FIG. 11 shows the case where the moving speed of the finger 30 following the arrow 92 is slow, contrary to the case of FIG. When the moving speed of the finger 30 detected by the speed detecting unit 34 indicated by the arrow 62 is slower than the predetermined speed, the threshold setting unit 38 sets the above-mentioned threshold speed Vo in advance in step S11 of FIG. 4. The determined speed 41 is determined, and otherwise, the speed higher than the speed 41 is determined.

  As described above, when the speed of the finger 30 during the drag operation is slow, it is easy to apply a constant force to the fingertip, so the possibility of an erroneous operation such as the document icon 80 falling to an unintended box icon in the middle of the drag operation is reduced. . Therefore, the end of the drag operation can be detected at the intended position of the box icon 81 by determining the threshold speed as the speed 41 (low speed).

<Determination of Threshold Speed Based on Movement Distance of Drag Operation>
The contents of the above-mentioned drag operation include the movement distance of the pointing member. FIG. 12 is a diagram for explaining the distance of the drag operation when the box group image is displayed on the screen.

  FIG. 12 shows a case where the document icon 90 is dragged by the finger 30 to the target box icon 91 as the arrow 92 is moved when the drag operation is performed by the finger 30 as in FIG. In this case, the start detection unit 36 detects the start of the drag operation, and the end detection unit 37 detects the end of the drag operation. Based on these detections, when the end of the drag operation is detected, the distance detection unit 35 detects the movement distance of the finger 30 in the drag operation.

  When the drag operation of the arrow 96 in FIG. 12 is detected, the detected movement distance D is compared with each of the three threshold values TH1, TH2 and TH3 (where TH1> TH2> TH3) in step S11 of FIG. Then, based on the result of the comparison, the threshold velocity Vo is determined as one of the velocities V1, V2 and V3 (where V1> V2> V3, V3 is the velocity 41). Specifically, the threshold velocity Vo is determined to be V1 when D ≧ TH1, to V2 when TH2 ≧ D> TH1, and to V3 when TH3 ≧ D> TH2.

  According to FIG. 12, as the document icon 90 is moved to the box icon far from the start point of the drag operation, the threshold speed Vo is determined to be a high speed. For example, when the position of the operation end by the drag operation is detected by the box icon 91 or 93, the threshold velocity Vo is determined to be V1, and when detected by the box icon 94, it is determined to be V2, and detected by the box icon 95. When it is done, it is decided to V3. This makes it possible to reduce the possibility of the document icon 90 falling on an unintended box icon when moving to a far box icon.

  Also, when moving to a close box icon, the possibility of an erroneous operation such that the document icon 90 falls to a box icon in the middle is low, and the threshold speed Vo is decreased (determined as the speed 41). Operability is maintained.

  Note that the above-described method of determining the threshold velocity Vo is a method of combining and determining the type of the display image in the second embodiment and the content (speed, direction, distance) of the drag operation in the third embodiment. Good.

Fourth Embodiment
In the fourth embodiment, a program for causing the CPU 10 of the image forming apparatus 100 to execute the information processing of the above-described drag operation is provided. Such a program may be recorded on a computer-readable recording medium such as a flexible disk, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card attached to the computer of the image forming apparatus 100. It can also be provided as a program product. Alternatively, the program can be provided by being recorded in a recording medium such as a hard disk built in the computer. Also, the program can be provided by downloading via a network.

  The program may execute a process by calling a required module in a predetermined arrangement at a predetermined timing among program modules provided as part of an OS (Operating System) of a computer. In that case, the program itself does not include the above module, and the processing is executed in cooperation with the OS. A program not including such a module may also be included in the program of the second embodiment.

  Also, the program according to the fourth embodiment may be provided by being incorporated into a part of another program. Also in this case, the program itself does not include a module included in the other program, and the process is executed in cooperation with the other program. A program incorporated into such another program may also be included in the program according to the second embodiment.

  The provided program product is installed and executed in a program storage unit such as a hard disk. The program product includes the program itself and a recording medium in which the program is recorded.

<Effect of the embodiment>
According to each of the above embodiments, whether to emphasize the operability of the user according to the processing information (the type of display image, the content of the drag operation), to emphasize the prevention of the erroneous operation of the drag operation or the drag operation for a fixed time The threshold (threshold velocity Vo) for holding (step S15) is dynamically changed.

  Therefore, when the user performs a drag operation, the drag operation ends at an unintended place on the screen, and it is possible to prevent the dragged component image from being left at an unintended place on the screen. As a result, the operability of the user's drag operation is improved.

  It should be understood that the embodiments disclosed herein are illustrative and non-restrictive in every respect. The scope of the present invention is indicated not by the above description but by the claims, and is intended to include all the modifications within the meaning and scope equivalent to the claims.

  Reference Signs List 20 operation panel 21 display 30 finger 31 coordinate acquisition unit 32 time acquisition unit 33 operation type determination unit 34 speed detection unit 35 distance detection unit 36 start detection unit 37 end detection unit 38 threshold determination unit , 39 partial threshold determination unit, 40 reception control unit, 41 predetermined speed, 50, 60, 80, 90 document icon, 51, 81, 91 box icon, 52, 62, 72, 82, 83, 92, 96 Arrow line, 63 areas, 70 sub images, 71, 74 non-margin area, 73 margin area, 100 image forming apparatus, Va moving speed, Vo threshold speed.

Claims (14)

An image forming apparatus,
A screen capable of displaying an image including a plurality of component images,
An operation reception unit that receives an operation by an instruction member on the component image displayed on the screen;
A control unit for controlling the image forming apparatus;
The control unit
A speed detection unit that detects the moving speed of the pointing member on the screen;
A threshold value determining unit that determines a threshold velocity for determining the moving velocity of the pointing member based on the content of the displayed image when a drag operation is accepted by the operation accepting unit;
And an end detection unit that detects the end of the operation based on the operation content received by the operation reception unit;
When the drag operation is accepted by the operation accepting unit, the threshold velocity is compared with the movement velocity detected when the end of the drag operation is detected, and the threshold velocity is higher than the movement velocity. The image forming apparatus controls the operation receiving unit to end the acceptance of the drag operation while continuing the acceptance of the drag operation when the speed is high, and ending the acceptance of the drag operation when the threshold speed is equal to or less than the movement speed.   The image forming apparatus according to claim 1, wherein the content of the image includes a type of the image.   The image forming apparatus according to claim 2, wherein the type of the image includes a box group image having a plurality of box images representing a storage area for storing a document as the plurality of component images.   The image forming apparatus according to claim 2, wherein the type of the image includes a document list image having a list of a plurality of document images representing a document as the plurality of component images. The type of the image includes an image having a main image as the plurality of component images and a sub image to be superimposed on the main image,
The main image includes a margin portion and a non-margin portion,
The threshold determination unit may further
When the operation accepted by the operation receiving unit is the drag operation, a threshold speed for determining the moving speed of the pointing member is determined so as to be different speeds for the margin portion and the non-margin portion. Having a partial threshold determination unit,
The control unit is further configured to:
When the operation receiving unit receives the drag operation,
When the end of the drag operation is detected in the margin portion, the threshold velocity determined for the margin portion is compared with the moving velocity when the end of the operation is detected;
When the end of the operation is detected in the non-margin portion, the threshold speed determined for the non-margin portion is compared with the moving speed when the end of the operation is detected;
Based on the result of each comparison, when the threshold speed is faster than the movement speed, the reception of the drag operation is continued, and when the threshold speed is less than the movement speed, the reception of the drag operation is ended. The image forming apparatus according to any one of claims 1 to 4, which controls the operation receiving unit. The threshold determination unit
The threshold speed for determining the moving speed of the pointing member is determined to be a predetermined speed or a speed higher than the predetermined speed based on the contents of the displayed image. 5. An image forming apparatus according to any one of 5 to 5. An image forming apparatus,
A screen capable of displaying an image including a plurality of component images,
An operation reception unit that receives an operation by an instruction member on the component image displayed on the screen;
A control unit for controlling the image forming apparatus;
The control unit
A speed detection unit that detects the moving speed of the pointing member on the screen;
A threshold value determination unit configured to determine a threshold velocity for determining the moving velocity of the indication member when the drag operation is accepted by the operation accepting unit;
And an end detection unit that detects the end of the operation based on the operation content received by the operation reception unit;
When the drag operation is accepted by the operation accepting unit, the threshold velocity is compared with the movement velocity detected when the end of the drag operation is detected, and the threshold velocity is higher than the movement velocity. The image forming apparatus controls the operation receiving unit to end the acceptance of the drag operation while continuing the acceptance of the drag operation when the speed is high, and ending the acceptance of the drag operation when the threshold speed is equal to or less than the movement speed.   The image forming apparatus according to claim 7, wherein the content of the drag operation includes the moving direction of the pointing member detected during the drag operation.   The image forming apparatus according to claim 7, wherein the content of the drag operation includes the moving speed detected during the drag operation. The control unit
A start detection unit that detects the start of the operation based on the operation content received by the operation reception unit;
A distance detection unit that detects a movement distance of the indication member from the start to the end of the operation;
The image forming apparatus according to claim 7, wherein the content of the drag operation includes the moving distance of the drag operation. The threshold determination unit
The threshold speed for determining the moving speed of the pointing member is determined as a predetermined speed or a speed higher than the predetermined speed based on the content of the drag operation. The image forming apparatus according to any one of the items. A method implemented in an image forming apparatus, comprising:
The image forming apparatus is
A screen capable of displaying an image including a plurality of component images,
An operation reception unit that receives an operation by an instruction member on the component image displayed on the screen;
The method is
Detecting the moving speed of the indication member on the screen;
Determining a threshold speed for determining the moving speed of the pointing member based on the content of the displayed image when the operation accepted is a drag operation;
Detecting the end of the operation based on the received operation content;
Comparing the threshold speed with the movement speed when the end of the operation is detected, if the operation to be accepted is the drag operation;
Based on the result of the comparison, when the threshold speed is higher than the moving speed, the acceptance of the drag operation is continued, and when the threshold speed is less than the moving speed, the acceptance of the drag operation is ended. Controlling the operation accepting unit. A method implemented in an image forming apparatus, comprising:
The image forming apparatus is
A screen capable of displaying an image including a plurality of component images,
An operation reception unit that receives an operation by an instruction member on the component image displayed on the screen;
The method is
Detecting the moving speed of the indication member on the screen;
Determining a threshold speed for determining the moving speed of the pointing member based on the content of the drag operation when the received operation is a drag operation;
Detecting the end of the operation based on the received operation content;
Comparing the threshold speed with the movement speed when the end of the operation is detected, if the operation to be accepted is the drag operation;
Based on the result of the comparison, when the threshold speed is higher than the moving speed, the acceptance of the drag operation is continued, and when the threshold speed is less than the moving speed, the acceptance of the drag operation is ended. Controlling the operation accepting unit. A program for causing a computer of an image forming apparatus to execute the method according to claim 12 or 13.

Images