JP2017068624A - Image forming apparatus, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability of a drag operation.SOLUTION: An image forming apparatus variably determines a threshold speed for determining the speed of a drag operation to an image on the basis of the details of an image to be displayed or the details of a drag operation. When a drag operation is received by an operation receiving part, the image forming apparatus compares the threshold speed with a moving speed that is detected when the completion of the drag operation is detected, when the threshold speed is higher than the moving speed, controls the operation receiving part to continue the reception of the drag operation, and when the threshold speed is equal to or lower than the moving speed, to end the reception of the drag operation.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image forming apparatus, a method, and a program, and more particularly, to an image forming apparatus, a method, and a program for processing information on operation contents on a touch panel.

  Current image processing apparatuses (for example, copiers, printers, MFPs (Multi-Function Peripherals) such as MFPs) are equipped with a touch panel to accept user operations. The touch panel of the MFP can display a scanned document on the touch panel, and can select and move the document using flick or drag & drop technology.

  However, when you want to move the document using the drag operation as a touch panel task or edit the document using the stamp function, if the pressure on the fingertip temporarily decreases, There is a problem that a document or stamp is left behind and a drag operation is started on another document or stamp.

  In order to solve such a problem, for example, a method according to Japanese Patent Application Laid-Open No. 2007-80110 has been proposed. In Patent Document 1, when the drag operation is executed, the moving speed is calculated with respect to the moving distance and moving time of the drag operation, and even when the end of the drag operation is declared if the set speed threshold is exceeded. We propose a method to keep the drag state for a certain time.

JP 2007-80110 A

In patent document 1, since it sets with the uniform threshold value, there exists the following subjects.
The first problem is as follows. If the threshold value is uniformly set to be high for the screen type being displayed, a document dragged to an unintended box does not fall like a box screen, so that it can be prevented from being stored in the box.

  However, as a disadvantage, the operability of the drag operation becomes complicated. Specifically, since it is displayed in the same screen as the document list screen, the failure of the drag operation can be seen at a glance. For this reason, even if the failure occurs, the drag operation can be performed again, but the threshold value is high, and even if the document is dropped to the intended location, the drag state is maintained and the operability is poor.

  On the other hand, if the user's drag operation operability is prioritized by setting the threshold value uniformly low, the user can move the document as in the document list screen, and the user can place the document at the intended location without feeling uncomfortable. Can be dropped.

  However, as a disadvantage, the possibility of preventing an erroneous operation of the drag is reduced. Specifically, when a document is stored as in a box screen, there is a high possibility that the document is stored in a box that is not intended by the user due to an erroneous operation. Further, since the threshold value is low, the drag state cannot be maintained for a certain period of time, and it is not possible to know in which box the document is stored.

  The second problem is as follows. For the image information of the preview being displayed, if the threshold value is set uniformly high, the drag operation will be accidentally terminated in the text being previewed, and the drag operation will be retained even if the text and icon (stamp) overlap. Incorrect operation can be prevented.

  In this case, the disadvantage is that even if you try to drop the icon to the intended location (preview margin), the drag operation will continue to be held due to the high threshold, so it will be difficult to drop the icon, and the user's operability will be impaired Probability is high.

  On the other hand, by setting the threshold value uniformly low, the user can perform the drag operation and drop the icon at the intended location (the margin of the preview), and the original operability of the drag operation is maintained.

  As a demerit in this case, it is difficult to prevent an erroneous operation in which an icon is accidentally dropped in a sentence and the sentence and the icon are covered because the threshold is low.

  The third problem is as follows. If the threshold value is set uniformly high for the drag direction, it will be difficult for the user to perform the drag operation, that is, if the finger is pressed, it will be difficult to operate with a constant pressure on the fingertip, which is an unintended location. However, since the document is not dropped due to the high threshold, it is possible to prevent an erroneous operation of dragging.

  In this case, the disadvantage is that the drag operation is easy for the user, that is, the direction in which the finger is traced. Even if an attempt is made to drop the document at the place where the document is placed, the drag operation continues to be held, and the user's operability is likely to be impaired.

  On the other hand, by setting the threshold value uniformly low, the operability of the original drag operation such as moving the document and dropping the document at the intended location is maintained in the direction in which the user can easily perform the drag operation.

  As a demerit in this case, in the direction where it is difficult for the user to perform the drag operation, it becomes a drag operation that pushes the document, so the finger slips and the document falls to an unintended place, The possibility of preventing erroneous drag operations is reduced.

  The fourth problem is as follows. If the threshold value is uniformly set high for the drag operation speed, an erroneous drag operation can be prevented when the finger speed during the drag operation is high. Specifically, the moving document cannot keep up with the speed, and a certain force is not applied to the fingertip pressure, and there is a high possibility that the document will fall to an unintended place, but since the threshold is increased, Since the drag operation is held without dropping the document, an erroneous drag operation can be prevented.

  As a demerit in this case, when the finger speed during the drag operation is slow, it is easy to apply a certain force to the fingertip, so the possibility of an erroneous operation such as dropping the document is reduced, but the intended place by the high threshold Even if an attempt is made to drop a document, the drag operation continues to be held, and the user's operability is likely to be impaired.

  On the other hand, by setting the threshold value uniformly low, if the finger speed during the drag operation is slow, the original operability of the drag operation such as moving the document and dropping the document at the intended location is maintained.

  As a disadvantage of this, if the finger speed during the drag operation is high, the moving document can not keep up with the speed, a certain force is not applied to the pressure of the fingertip, and it may fall to an unintended place It becomes high and the possibility of preventing an erroneous operation of the drag becomes low.

  The fifth problem is as follows. If the threshold value is set uniformly high for the distance of the drag operation, an erroneous drag operation can be prevented. Specifically, when moving a document to a distance far from the starting point of the drag operation, it becomes difficult to apply a certain force to the fingertip pressure as the moving distance increases, and the document falls to an unintended location. Although the possibility increases, since the threshold value is increased, the drag operation is held without dropping the document. Thereby, it is possible to prevent an erroneous operation of the drag.

  As a demerit in this case, the user's operability is likely to be impaired. Specifically, when the document is moved to a distance close to the starting point of the drag operation, the possibility of an erroneous operation such as dropping the document is reduced because the movement distance is short. However, even if an attempt is made to drop a document to an intended place due to the high threshold value, the drag operation continues to be held, and the user's operability is likely to be impaired.

  On the other hand, by setting the threshold value uniformly low, when moving a document to a distance close to the starting point of the drag operation, the movement distance is short, so the possibility of an erroneous operation such as dropping the document is low, and The operability of the original drag operation such as dropping a document is maintained.

  As a demerit in this case, when moving the document far away from the starting point of the drag operation, it becomes difficult to keep applying a certain force to the fingertip pressure as the moving distance increases, and it will fall to an unintended place The possibility increases and the possibility of preventing an erroneous operation of the drag is reduced.

  SUMMARY An advantage of some aspects of the invention is that it provides an image forming apparatus, a method, and a program for improving the operability of a user's drag operation.

  An image forming apparatus according to an aspect of the present invention controls a screen capable of displaying an image including a plurality of component images, an operation receiving unit that receives an operation by a pointing member for a component image displayed on the screen, and the image forming apparatus A control unit for performing the operation.

  The control unit displays a speed detection unit that detects the moving speed of the pointing member on the screen and a threshold speed for determining the moving speed of the pointing member when a drag operation is received by the operation receiving unit. A threshold value determination unit that determines based on the content of the image; and an end detection unit that detects the end of the operation based on the operation content received by the operation reception unit.

  When a drag operation is received by the operation receiving unit, the control unit compares the threshold speed with the movement speed detected when the end of the drag operation is detected, and the threshold speed is faster than the movement speed Continues to accept the drag operation, and controls the operation accepting unit to end accepting the drag operation when the threshold speed is equal to or lower than the movement speed.

Preferably, the content of the image includes the type of the image.
Preferably, the type of image includes a box group image having a plurality of box images representing storage areas for storing a document as a plurality of component images.

  Preferably, the type of image includes a document list image having a list of a plurality of document images representing the document as a plurality of component images.

  Preferably, the type of image includes an image having a main image as a plurality of component images and a sub-image superimposed on the main image, the main image includes a blank portion and a non-blank portion, and a threshold value is determined. The part further determines a threshold speed for determining the moving speed of the pointing member so that the blank part and the non-blank part have different speeds when the operation received by the operation accepting part is a drag operation. A threshold determining unit, and when the operation accepting unit accepts the drag operation and the end of the drag operation is detected in the margin part, the control unit further determines the threshold speed determined for the margin part, The movement speed when the end of the operation is detected is compared. When the end of the operation is detected in the non-blank portion, the threshold speed determined for the non-blank portion and the end of the operation are detected. When moving speed Based on the result of each comparison, if the threshold speed is faster than the movement speed, continue to accept the drag operation, and if the threshold speed is less than the movement speed, end the acceptance of the drag operation. The operation receiving unit is controlled.

  Preferably, the threshold value determination unit determines the threshold speed for determining the moving speed of the pointing member to a predetermined speed or a speed higher than the predetermined speed based on the content of the displayed image. To do.

  An image forming apparatus according to another aspect of the present invention includes a screen capable of displaying an image including a plurality of component images, an operation receiving unit that receives an operation by an instruction member for a component image displayed on the screen, and an image forming apparatus. A control unit for controlling.

  The control unit detects a threshold speed for determining the moving speed of the pointing member when a drag operation is received by the operation detecting unit and a speed detecting unit that detects the moving speed of the pointing member on the screen. A threshold value determination unit that is determined based on the content, and an end detection unit that detects the end of the operation based on the operation content received by the operation reception unit, and when the drag operation is received by the operation reception unit, The movement speed detected when the end of the drag operation is detected is compared. When the threshold speed is higher than the movement speed, the drag operation is continuously accepted and the threshold speed is equal to or lower than the movement speed. In some cases, the operation accepting unit is controlled so as to finish accepting the drag operation.

  Preferably, the content of the drag operation includes the moving direction of the pointing member detected during the drag operation.

  Preferably, the content of the drag operation includes a moving speed detected during the drag operation.

  Preferably, the control unit includes a start detection unit that detects the start of the operation based on the operation content received by the operation reception unit, and a distance detection unit that detects a moving distance of the instruction member from the start to the end of the operation. The content of the drag operation includes the moving distance of the drag operation.

  Preferably, the threshold determining unit determines a threshold speed for determining the moving speed of the pointing member to a predetermined speed or a speed higher than the predetermined speed based on the content of the drag operation.

  According to one aspect of the present invention, a method implemented in an image forming apparatus is provided. The image forming apparatus includes a screen capable of displaying an image including a plurality of component images, and an operation accepting unit that accepts an operation by an instruction member for a component image displayed on the screen.

  The method includes a step of detecting the moving speed of the pointing member on the screen and a threshold speed for determining the moving speed of the pointing member based on the content of the displayed image when the accepted operation is a drag operation. Determining the end of the operation based on the contents of the received operation, and the threshold speed and the movement speed when the end of the operation is detected when the received operation is a drag operation. Based on the comparison step and the result of the comparison, if the threshold speed is faster than the moving speed, continue to accept the drag operation, and if the threshold speed is less than or equal to the moving speed, end accepting the drag operation Controlling the operation accepting unit.

  According to still another aspect of the present invention, a method implemented in an image forming apparatus is provided. The image forming apparatus includes a screen capable of displaying an image including a plurality of component images, and an operation accepting unit that accepts an operation by an instruction member for a component image displayed on the screen.

  The method includes a step of detecting a moving speed of the pointing member on the screen and, when an accepted operation is a drag operation, determines a threshold speed for determining the moving speed of the pointing member based on the content of the drag operation. The step of detecting the end of the operation based on the content of the received operation, and the threshold speed and the moving speed when the end of the operation is detected when the received operation is a drag operation. Based on the result of the step and comparison, accepting the drag operation is continued when the threshold speed is faster than the moving speed, and accepting the drag operation is finished when the threshold speed is equal to or lower than the moving speed. Controlling the unit.

  According to still another aspect of the present invention, a program for causing a computer of an image forming apparatus to execute the method described above is provided.

  According to the present invention, the operability of the user's drag operation is improved.

FIG. 2 is a diagram schematically illustrating a hardware configuration of an image forming apparatus 100 according to the first embodiment. 1 is a diagram schematically showing the appearance of an image forming apparatus 100. FIG. FIG. 2 is a diagram schematically illustrating a functional configuration of the image forming apparatus according to the first embodiment. 3 is a process flowchart according to the first exemplary embodiment; FIG. 10 is a diagram for explaining a drag operation when a box group image is displayed on the screen of the operation panel 20. FIG. 6 is a diagram for explaining a drag operation when a document list image is displayed on the screen of the operation panel 20. 7 is a diagram for explaining a drag operation when a preview image is displayed on the screen of the operation panel 20. FIG. It is a figure for demonstrating the direction of drag | drug operation in case the box group image is displayed on the screen. It is a figure for demonstrating the direction of drag | drug operation in case the box group image is displayed on the screen. It is a figure for demonstrating the speed of drag operation in case the box group image is displayed on the screen. It is a figure for demonstrating the speed of drag operation in case the box group image is displayed on the screen. It is a figure for demonstrating the distance of drag | drug operation in case the box group image is displayed on the screen.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same.

[Technology]
The technical idea disclosed is as follows. The image forming apparatus variably determines the threshold speed for determining the speed of the drag operation on the image based on the content of the displayed image or the content of the drag operation. When a drag operation is received by the operation receiving unit, the image forming apparatus compares the threshold speed with the movement speed detected when the end of the drag operation is detected, and the threshold speed is faster than the movement speed. When the drag operation is continued, the operation reception unit is controlled to end the drag operation reception when the threshold speed is equal to or lower than the moving speed.

  Accordingly, the image forming apparatus can dynamically change the threshold speed for determining whether to continue or end the drag operation in accordance with the content of the display image or the user's operation. It is possible to accept a drag operation in accordance with the operation content. As a result, the user operability in the drag operation can be improved.

  In each embodiment, the image displayed on the screen includes one or more “component images”. The component image includes an icon, a thumbnail image, a stamp image to be superimposed on the document image, and the like. The user performs various operations such as a touch operation and a drag operation on the component image displayed on the screen using the “instruction member”. In each embodiment, the “drag operation” means that the user selects a component image by touching the screen (touch panel), changes the contact position with the screen (touch panel), and moves the component image within the screen. This is the operation of moving with. The indicating member includes a finger or a dedicated pen.

[Embodiment 1]
FIG. 1 is a diagram schematically illustrating a hardware configuration of the image forming apparatus 100 according to the first embodiment. The image forming apparatus may be any apparatus having at least one or more image processing functions, and may be other apparatuses such as the above-described MFP, printer, facsimile transmitter / receiver, and copier. FIG. 2 is a diagram schematically showing the appearance of the image forming apparatus 100. Referring to FIG. 1, an image forming apparatus 100 includes a CPU (Central Processing Unit) 10 corresponding to a control unit for controlling the whole, a timer 11, a storage unit for storing programs and data, and information input. An output unit, a network I / F (abbreviation for interface) 17 for communicating via a LAN (Local Area Network), and various processing units are included.

  The storage unit includes a ROM (Read Only Memory) 12 for storing a program executed by the CPU 10 and data, a RAM (Random Access Memory) 13 for functioning as a work area when the CPU 10 executes the program, and an image. An HDD (Hard Disc Driver) 14 for storing data and the like is included.

  The input / output unit includes an operation unit I / F (abbreviation of interface) for connecting an operation panel 20 including a display 21 such as a liquid crystal display. The operation panel 20 displays an image by controlling the display 21 based on the image data from the operation unit I / F 16. Further, the operation unit I / F 16 acquires the operation content of the user with respect to the image forming apparatus 100 based on the output from the operation panel 20.

  The various processing units include a scanner 18 and a printer 19. Various processing units are controlled by a device I / F (abbreviation of interface) 15. Document data and image data read by the scanner 18 are stored in the storage unit.

<Functional configuration>
FIG. 3 is a diagram schematically illustrating a functional configuration of the image forming apparatus according to the first embodiment. The CPU 10 is a control unit for controlling the image forming apparatus 100, and a coordinate acquisition unit 31 that acquires the coordinates of the touch position on the display 21 based on the output from the operation unit I / F 16. 11 when a drag operation is accepted via the time acquisition unit 32, the operation processing unit, and the operation panel 20 that are acquired using the control unit 11, the threshold speed for determining the moving speed of the pointing member is the content of the displayed image Or the threshold value determination part 38 determined based on the content of operation, and the reception control part 40 which controls the operation part I / F16 are included.

  The operation processing unit includes an operation type determination unit 33 that determines the type of operation by the instruction member for the screen based on the operation content output from the operation unit I / F 16, and the movement speed and movement distance of the instruction member on the screen in the operation. It includes a speed detection unit 34 and a distance detection unit 35 for detecting, a start detection unit 36 and an end detection unit 37 for detecting the start and end of movement of the pointing member on the screen during operation.

<Operation detection>
The operation panel 20 includes a display 21 and a touch panel placed on or below the screen of the display 21. The screen has a rectangular shape, for example, and the touch panel has the same size (shape and area) as the screen. For the sake of explanation, the screen (touch panel) corresponds to a two-dimensional coordinate plane defined by the X axis and the Y axis orthogonal to the X axis. Each position in the image displayed on the screen also corresponds to each coordinate value of the two-dimensional coordinates. The CPU 10 manages each position in the image displayed on the screen based on the coordinate values of the two-dimensional coordinates. Therefore, when the coordinate position on the screen (touch panel) designated by the instruction member is acquired, the corresponding coordinate position in the image is uniquely specified based on the acquired coordinate position. Then, the CPU 10 can uniquely identify the component image displayed at the coordinate position by analyzing the image data based on the specified coordinate position in the image.

  When the user touches (contacts) an arbitrary position on the screen with the pointing member, the touch panel electrically detects the touched position based on a change in capacitance or the like.

  The operation panel 20 detects the position detected based on the current signal from the touch panel and the pressing force by the pointing member on the screen at the position. Here, the position is detected electrically, but may be detected magnetically.

  In synchronization with the timer 11, the operation unit I / F 16 periodically converts the operation content (position and pressing force signals) detected by the operation panel 20 into digital data, and outputs the converted data. The operation unit I / F 16 is an example of an “operation reception unit”.

  The coordinate acquisition unit 31 converts time-series position data output from the operation unit I / F 16 into coordinates. Each of the start detection unit 36 and the end detection unit 37 compares the value of the pressing force at each position in time series with a predetermined value. When the start detection unit 36 determines that the pressing force is equal to or greater than a predetermined value based on the comparison result, the start detection unit 36 detects that the touch operation by the pointing member is started at the position. When the end detection unit 37 determines that the pressing force has become smaller than a predetermined value based on the comparison result, the end detection unit 37 detects that the touch operation by the pointing member has ended at the position.

  Note that the detection method of the start or end of the touch operation is not limited to the method based on the pressing force, and whether or not the next coordinate in the time series is detected or required until the next coordinate is detected. Detection may be based on the length of time, or may be detected by a combination thereof.

  The distance detection unit 35 detects (calculates) the distance and direction of movement of the pointing member between the detected different coordinate positions, for example, by calculation. For example, the distance is calculated based on continuous time-series coordinates between the start coordinates and the end coordinates detected as described above. The distance detector 35 determines whether or not the end of the operation is detected based on the output of the end detector 37 after the start is detected by the start detector 36. While the end of the operation is not detected, based on the time-series coordinates connecting the coordinates of the position data input immediately before from the operation unit I / F 16 and the coordinates of the position data input next to the position data, The above distance is detected.

  The speed detection unit 34 measures the time required for the movement of the distance, and detects (calculates) the movement speed of the pointing member on the screen from the movement distance and the measurement time, for example.

  When the operation type determination unit 33 determines that the received operation is a drag operation, the reception control unit 40 detects the threshold speed Vo determined by the threshold determination unit 38 and the end of the operation. Are compared with the measured moving speed Va, and the operation unit I / F 16 is controlled based on the comparison result. Specifically, when the comparison result indicates that the threshold speed Vo is higher, the operation unit I / F 16 is controlled so as to continue accepting the operation from the operation panel 20 even if the end of the drag operation is detected. On the contrary, if the comparison result indicates that the threshold speed Vo is equal to or less than the measured moving speed Va, when the end of the drag operation is detected, the acceptance of the operation from the operation panel 20 is ended ( The operation unit I / F 16 is controlled so as to be prohibited.

  These functions are stored in the ROM 12 as a program. The function of each unit is realized by the CPU 10 reading the program from the ROM 12 and executing the read program.

<Processing flow>
FIG. 4 is a process flowchart according to the first embodiment. A processing program for the drag operation in FIG. 4 is stored in the ROM 12. The processing is realized by the CPU 10 reading the program from the ROM 12 and executing the read program.

  When a touch operation is performed on the screen of the operation panel 20, the operation type determination unit 33, based on the operation content detected by the operation unit I / F 16, the operation pattern indicated by the operation content, and various types of information stored in the storage unit. The operation pattern is collated, and based on the result of the pattern collation, it is determined whether or not the operation content is a drag operation. Here, the storage unit stores a plurality of operation patterns including a drag operation. When the operation type determination unit 33 determines that the operation content is a drag operation, the CPU 10 starts the process of FIG. 4 (step 1).

  First, the start detection unit 36 acquires the start coordinate and time of the drag operation from the coordinate acquisition unit 31 and the time acquisition unit 32 (step S3). Subsequently, the CPU 10 determines whether or not the end of the drag operation is detected based on the received operation content (step S5). When it is determined that the end is not detected (NO in step S5), the process of step S5 is repeated while the coordinate position and the pressing force are detected in time series in conjunction with the movement of the pointing member.

  When it is determined that the end has been detected (YES in step S5), the CPU 10 acquires the position coordinates and time when the end is detected by the end detection unit 37 (step S7).

  The distance detector 35 acquires the moving distance of the pointing member from the start and end position coordinates acquired in steps S3 and S5, and the speed detector 34 acquires the distance and the start and end acquired in steps S3 and S5. From this time, the moving speed Va of the indicating member is measured (calculated) (step S9).

  The threshold value determination unit 38 determines the threshold speed Vo as described above based on the processing information regarding the operation panel 20 of the image forming apparatus 100 (step S11). The processing information includes the content of the image displayed on the screen or the operation content on the screen. Details of the method of determining the threshold speed Vo will be described later.

  The CPU 10 compares the above threshold speed Vo with the moving speed Va measured when the end of the drag operation is detected (step S13). Based on the comparison result, the threshold speed Vo is the moving speed Va. If it is determined that the drag operation is higher (YES in step S13), the drag operation is held even if the end of the drag operation is detected (step S15). That is, the CPU 10 controls the operation unit I / F 16 so as to accept the operation content from the operation panel 20 (more preferably, continuously for a certain period of time). As described above, the operation type determination unit 33 determines whether or not the operation type is a drag operation based on the operation content continuously received (step S17). If it is determined that the type of operation is a drag operation (YES in step 17), the process returns to step S3, and the subsequent processing is repeated in the same manner, but if it is determined that the operation is not a drag operation (NO in step 17). Then, the process proceeds to step S19, and a drag operation completion process is performed by the CPU 10 (step S19). Details of the drag operation completion processing will be described later.

  When the CPU 10 determines that the threshold speed Vo is equal to or lower than the moving speed Va based on the above comparison between the threshold speed Vo and the moving speed Va (NO in step S13), the CPU 10 determines the operation content from the operation panel 20. The operation unit I / F 16 is controlled to end (or prohibit) the reception, and the drag operation completion process is performed by the CPU 10 (step S19).

  According to the processing of FIG. 4, based on the above processing information, the threshold speed Vo for determining the movement speed Va of the drag operation is dynamically changed, and the threshold speed Vo is compared with the measured movement speed Va. Based on the result, whether or not to hold the operation content of the drag operation for a certain period of time even if the end of the drag operation is detected is determined.

  Therefore, when a drag operation is performed on a component image (such as an icon) displayed on the screen, it is possible to prevent the inconvenience that it is detected that the drag operation has ended at an unintended location or position on the screen.

[Embodiment 2]
In the second embodiment, as a modification of the first embodiment, a method based on the type of image displayed on the screen will be described as a specific method for determining the threshold speed of the drag operation. The CPU 10 reads display image data from the HDD 14 and displays the data on the display 21. The CPU 10 acquires the type of display image from the header information of the image data.

<Drag operation of box icon>
The content of the image includes the type of image displayed on the screen. The type of image includes a box icon of a box group having a plurality of box icons (icons) representing storage areas for storing a document as a plurality of component images. FIG. 5 is a diagram for explaining a drag operation when a box group image is displayed on the screen of the operation panel 20.

  Referring to FIG. 5, a document icon 50 that is an icon corresponding to document data and one or more box icons that are box-shaped icons (images) are simultaneously displayed on the screen. The user performs a drag operation so as to move the document icon 50 at the lower right of the screen to the position of the box icon 51 at the upper left of the screen. An arrow 52 indicates the movement (distance and direction) of the pointing member by a drag operation. These icons are an example of a “component image” that forms each part of an image displayed on the screen.

  When the drag operation is started according to the arrow 52 in the screen of FIG. 5, the process is started in FIG. In step S11, the threshold value determination unit 38 determines the threshold speed Vo based on the type of image displayed on the screen (that is, the box group image) as the processing information. Specifically, the threshold speed Vo is determined to be a speed faster than a predetermined speed 41 for determining the drag operation. The predetermined speed 41 is a standard speed for determining a drag operation, and is indicated by data stored in the storage unit when the image forming apparatus 100 is shipped from the factory.

  Further, as the drag operation completion processing in step S19, the CPU 10 performs “processing to drop the document icon 50 on the box icon”. Specifically, the CPU 10 updates the display image of the display 21 so that the document icon 50 is dropped on the box icon 51 and stores the document data of the document icon 50 in a storage area corresponding to the box icon 51. (For example, a document folder). The other processes in FIG. 4 are the same as those described above, and therefore description thereof will not be repeated.

  When the image of FIG. 5 is displayed, the threshold speed Vo is determined to be faster than the speed 41, thereby preventing erroneously determining that the operation has ended during the drag operation regardless of the moving speed. Is possible.

  As a result, as shown by the arrow 52 in FIG. 5, even if the pointing member crosses many box icons by the drag operation, the above-described “dropping process” is erroneously performed on the intermediate box icons. Can be prevented.

<Drag operation for document list image>
The above image types include a document list image having a list of a plurality of document images (icons) representing documents as a plurality of component images. FIG. 6 is a diagram for explaining a drag operation when a document list image is displayed on the screen of the operation panel 20.

  Referring to FIG. 6, document icons 60, which are icons corresponding to each document data, are displayed in a list on the screen. The user performs a drag operation so as to move the document icon 60 at the upper left of the screen to the position of the region 63 at the lower right of the screen. An arrow line 62 indicates the movement (distance and direction) of the pointing member by the drag operation. These icons are examples of the above “component image”.

  When the drag operation is started according to the arrow 62 on the screen of FIG. 6, the process of FIG. 4 is started. In step S11, the threshold value determination unit 38 determines the threshold speed Vo based on the type of image displayed on the screen (that is, the document list image) as the processing information. Specifically, the threshold speed Vo is determined to be a predetermined speed 41 for determining a drag operation. As the drag operation completion process in step S19, the CPU 10 performs a movement display process. Specifically, the CPU 10 generates image data for displaying the document icon 60 by moving it to the area 63 on the screen, and controls the display 21 based on the generated image data. The other processes in FIG. 4 are the same as those described above, and therefore description thereof will not be repeated.

  When the image of FIG. 6 is displayed, the above-described “drop process” is not likely to be performed erroneously, so the threshold speed Vo is determined to be the speed 41 instead of the high speed as shown in FIG. .

<Drag operation of preview image>
FIG. 7 is a diagram for explaining a drag operation when a preview image is displayed on the screen of the operation panel 20. The types of images described above are, for example, a main image such as a document, a figure, and a photograph as a plurality of component images, and a sub image 70 (signature, special mark) superimposed on the main image, as in the preview image of FIG. , A stamp icon).

The main image includes a margin part 73 and non-margin parts 71 and 74.
When the drag operation of the sub image 70 by the pointing member (finger 30) is started according to the arrow 72 on the screen of FIG. 7, the process of FIG. 4 is started. In step S11, the threshold value determination unit 38 determines the threshold speed Vo based on the type of image displayed on the screen (that is, the preview image) as the processing information.

  Specifically, the threshold value determining unit 38 sets the threshold speed Vo for determining the moving speed of the finger 30 as the pointing member when the screen of FIG. And the non-margin portions 71 and 74 have a partial threshold value determination unit 39 that determines the speed to be different. Specifically, the non-blank portions 71 and 74 determine the threshold speed Vo so as to be higher than the speed 41, and the blank portion 73 determines the threshold speed Vo as the speed 41.

  When the drag operation is detected, when the end of the operation is detected in the margin portion 73, the CPU 10 detects the threshold speed Vo determined for the margin portion 73 and the end of the operation. The moving speed Va is compared. When the end of the operation is detected in the non-blank portions 71 and 74, the threshold speed Vo determined for the non-blank portion is compared with the moving speed Va when the end of the operation is detected. Based on the result of each comparison, when the threshold speed Vo is higher than the movement speed Va, the CPU 10 continues to accept the drag operation even if the end of the drag operation is detected, and the threshold speed Vo is equal to or less than the movement speed Va. If so, the operation unit I / F 16 is controlled to end (prohibit) the acceptance of the drag operation.

  In the screen of FIG. 7, the CPU 10 performs a movement display process as the drag operation completion process in step S <b> 19. Specifically, the CPU 10 generates image data for the sub image 70 to display on the blank portion 73 that is the position after the movement by the drag operation, and controls the display 21 based on the generated image data. The other processes in FIG. 4 are the same as those described above, and therefore description thereof will not be repeated.

  According to the threshold speed determination method of FIG. 7, when an icon sub-image 70 is moved and placed at a location intended by the user (margin portion 73), the threshold velocity Vo of the margin portion 73 is The speed is determined to be lower than that of the non-margin portions 71 and 74. Accordingly, it is possible to easily move and place the sub-image 70 at an intended place other than the non-margin portions 71 and 74 by a drag operation.

[Embodiment 3]
In the third embodiment, as a modification of the above-described embodiment, a method based on the content of the drag operation will be described as a specific method for determining the threshold speed of the drag operation.

<Determination of threshold speed based on moving direction of drag operation>
The content of the drag operation includes the moving direction of the pointing member. 8 and 9 are diagrams for explaining the direction of the drag operation when the box group image is displayed on the screen.

  FIG. 8 shows the box group image of FIG. For example, the user performs a drag operation to move the document icon 50 to the lower right corner of the screen to the position of the box icon 81 at the upper left corner of the screen with the finger 30 as an instruction member. An arrow line 82 indicates the movement (movement direction and movement distance) of the finger 30 by a drag operation.

  Here, the user is often right-handed. Therefore, when a drag operation is performed to move the document icon 80 located at the lower right end toward the screen in the direction toward the upper left end of the screen (the direction of the box icon 81), a certain amount of the finger 30 is applied to the screen. Drag operation while applying pressure. Therefore, the speed of the drag operation tends to be low.

  When the drag operation is started according to the arrow 82 in the screen of FIG. 8, the process is started in FIG. In step S <b> 11, the CPU 10 detects the direction of movement of the pointing member based on the time-series coordinate trajectory acquired by the coordinate acquisition unit 31 as the processing information. The threshold value determination unit 38 determines the threshold speed Vo to be higher than a predetermined speed when the detected moving direction is the upper left direction with respect to the current position, and when it is in the other direction. The speed 41 is determined. In addition, although illustrated to upper left direction here, it is not limited to this.

  As described above, when the drag operation is performed in a direction in which it is difficult for the user to perform the drag operation, that is, in the direction in which the finger is pressed, the threshold icon speed Vo is set to a high speed, so The possibility of causing an erroneous operation such as falling can be prevented.

  On the other hand, as shown in FIG. 9, when a drag operation is performed along an arrow line 83 extending in the direction opposite to the arrow line 82 in FIG. 8, the finger 30 moves in a direction that traces. Become. Therefore, the pressure on the screen by the finger 30 may be small, and the drag operation speed tends to be higher than that in the case of FIG.

  When a drag operation is started on the screen of FIG. 9 according to the arrow 83, in step S11 of FIG. 4, the CPU 10 detects the direction in which the arrow 83 extends as the direction of movement. The threshold value determining unit 38 determines the threshold speed Vo as a predetermined speed when the detected moving direction is in the upper right direction with respect to the current position, and from the speed 41 when the detected moving direction is in any other direction. Also decide on a fast speed. In addition, although the upper right direction is illustrated here, it is not limited to this.

  As described above, in the direction in which the user can easily perform the drag operation, that is, the direction in which the finger is traced, the possibility of erroneous operation such that the pressure on the fingertip is easily applied and the document falls is reduced, but the threshold speed Vo is lower than that in FIG. Therefore, the end of the drag operation is easily detected at the intended location.

<Determination of threshold speed based on moving speed of drag operation>
The content of the drag operation includes the moving speed of the pointing member. 10 and 11 are diagrams for explaining the speed of the drag operation when a box group image is displayed on the screen.

  FIG. 10 shows a step when the moving speed of the finger 30 detected by the speed detector 34 indicated by the arrow 62 is faster than a predetermined speed when the drag operation is performed with the finger 30 as in FIG. In S11, the threshold value determination unit 38 determines the threshold speed Vo to be a speed higher than a predetermined speed, and otherwise determines to the speed 41.

  As described above, when the speed of the finger 30 during the drag operation is high, a certain force cannot be applied to the fingertip, and the document icon 80 is accidentally dropped to an unintended box icon without being able to keep up with the moving speed of the finger 30. The possibility increases. In order to cope with this, in FIG. 10, the threshold speed Vo is determined to be a speed higher than the speed 41, whereby such an erroneous operation of the drag can be prevented.

  FIG. 11 shows a case where the moving speed of the finger 30 following the arrow 92 is slow, contrary to the case of FIG. When the moving speed of the finger 30 detected by the speed detecting unit 34 indicated by the arrow line 62 is slower than the predetermined speed, the threshold value determining unit 38 determines the threshold speed Vo in advance in step S11 of FIG. The determined speed 41 is determined. Otherwise, the speed is determined to be higher than the speed 41.

  As described above, when the speed of the finger 30 during the drag operation is low, it is easy to apply a certain force to the fingertip, so that the possibility of an erroneous operation such that the document icon 80 falls into an unintended box icon during the drag operation is reduced. . Therefore, by determining the threshold speed as speed 41 (low speed), it is possible to detect the end of the drag operation at the intended position of the box icon 81.

<Determination of threshold speed based on movement distance of drag operation>
The content of the drag operation includes the moving distance of the pointing member. FIG. 12 is a diagram for explaining the distance of the drag operation when the box group image is displayed on the screen.

  FIG. 12 shows a case where the document icon 90 is dragged to the target box icon 91 with the finger 30 according to the movement of the arrow 92 when the drag operation is performed with the finger 30 as in FIG. In this case, the start detection unit 36 detects the start of the drag operation, and the end detection unit 37 detects the end of the drag operation. Based on these detections, the distance detection unit 35 detects the movement distance of the finger 30 in the drag operation when the end of the drag operation is detected.

  When the drag operation indicated by the arrow 96 in FIG. 12 is detected, in step S11 in FIG. 4, the detected movement distance D is compared with each of the three threshold values TH1, TH2, and TH3 (where TH1> TH2> TH3). Then, based on the comparison result, the threshold speed Vo is determined as one of speeds V1, V2 and V3 (where V1> V2> V3 and V3 are speed 41). Specifically, the threshold speed Vo is determined as V1 when D ≧ TH1, as V2 when TH2 ≧ D> TH1, and as V3 when TH3 ≧ D> TH2.

  According to FIG. 12, the threshold speed Vo is determined to be higher as the document icon 90 is moved to a box icon farther from the starting point of the drag operation. For example, when the position of the end of the operation by the drag operation is detected by the box icon 91 or 93, the threshold speed Vo is determined as V1, and when it is detected by the box icon 94, it is determined as V2 and detected by the box icon 95. When it is done, it is determined as V3. Thereby, when moving to a distant box icon, it is possible to reduce the possibility that the document icon 90 will fall on an unintended box icon.

  Further, when moving to a close box icon, the possibility of an erroneous operation such as the document icon 90 falling to a box icon in the middle is low, and the original drag operation is performed by slowing down the threshold speed Vo (determining the speed 41). Operability is maintained.

  The method for determining the threshold speed Vo may be a method for determining the combination of the second embodiment, the type of display image, and the content (speed, direction, distance) of the drag operation of the third embodiment. Good.

[Embodiment 4]
In the fourth embodiment, a program for causing the CPU 10 of the image forming apparatus 100 to perform the information processing of the drag operation described above is provided. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer of the image forming apparatus 100, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card. It can also be provided as a program product. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program may be a program module that is provided as a part of the OS (operating system) of the computer and that calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program of the second embodiment.

  The program according to the fourth embodiment may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the second embodiment.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

<Effect of Embodiment>
According to each of the embodiments described above, whether the user's operability is to be emphasized according to the processing information (the type of display image, the content of the drag operation), or whether the importance is to prevent erroneous operation of the drag operation, or the drag operation is performed for a certain period of time. The threshold value (threshold speed Vo) for holding (step S15) is dynamically changed.

  Therefore, when the user performs a drag operation, it is possible to prevent the drag operation from being terminated at an unintended location on the screen and the dragged component image from being left at an unintended location on the screen. As a result, the operability of the user's drag operation is improved.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  20 operation panel, 21 display, 30 finger, 31 coordinate acquisition unit, 32 time acquisition unit, 33 operation type determination unit, 34 speed detection unit, 35 distance detection unit, 36 start detection unit, 37 end detection unit, 38 threshold determination unit 39, partial threshold value determination unit, 40 reception control unit, 41 predetermined speed, 50, 60, 80, 90 document icon, 51, 81, 91 box icon, 52, 62, 72, 82, 83, 92, 96 Arrow line, 63 area, 70 sub-image, 71, 74 non-blank area, 73 blank area, 100 image forming apparatus, Va moving speed, Vo threshold speed.

Claims (14)

An image forming apparatus,
A screen capable of displaying an image including a plurality of component images;
An operation accepting unit that accepts an operation by an instruction member for the component image displayed on the screen;
A control unit for controlling the image forming apparatus,
The controller is
A speed detector for detecting a moving speed of the pointing member on the screen;
A threshold determining unit that determines a threshold speed for determining the moving speed of the pointing member based on the content of the displayed image when a drag operation is received by the operation receiving unit;
An end detection unit that detects the end of the operation based on the operation content received by the operation receiving unit,
When the drag operation is received by the operation receiving unit, the threshold speed is compared with the moving speed detected when the end of the drag operation is detected, and the threshold speed is higher than the moving speed. An image forming apparatus that continues to accept a drag operation when fast, and controls the operation accepting unit to finish accepting a drag operation when the threshold speed is equal to or less than the movement speed.   The image forming apparatus according to claim 1, wherein the content of the image includes a type of the image.   The image forming apparatus according to claim 2, wherein the image type includes a box group image having a plurality of box images representing storage areas for storing documents as the plurality of component images.   The image forming apparatus according to claim 2, wherein the type of image includes a document list image having a list of a plurality of document images representing a document as the plurality of component images. The type of image includes an image having a main image as the plurality of component images and a sub-image superimposed on the main image,
The main image includes a margin part and a non-margin part,
The threshold determination unit further includes:
When the operation received by the operation receiving unit is the drag operation, a threshold speed for determining the moving speed of the pointing member is determined so as to be different between the blank part and the non-blank part. A partial threshold value determining unit;
The control unit further includes:
When the operation accepting unit accepts the drag operation,
When the end of the drag operation is detected in the margin part, the threshold speed determined for the margin part is compared with the moving speed when the end of the operation is detected,
When the end of the operation is detected in the non-blank portion, the threshold speed determined for the non-blank portion is compared with the moving speed when the end of the operation is detected,
Based on the result of each comparison, when the threshold speed is faster than the movement speed, the drag operation is continuously accepted, and when the threshold speed is equal to or less than the movement speed, the drag operation is terminated. The image forming apparatus according to claim 1, wherein the image receiving apparatus controls the operation receiving unit. The threshold determination unit
The threshold speed for determining the moving speed of the pointing member is determined based on the content of the displayed image to a predetermined speed or a speed higher than the predetermined speed. 6. The image forming apparatus according to any one of items 1 to 5. An image forming apparatus,
A screen capable of displaying an image including a plurality of component images;
An operation accepting unit that accepts an operation by an instruction member for the component image displayed on the screen;
A control unit for controlling the image forming apparatus,
The controller is
A speed detector for detecting a moving speed of the pointing member on the screen;
A threshold determining unit that determines a threshold speed for determining the moving speed of the pointing member based on the content of the drag operation when a drag operation is received by the operation receiving unit;
An end detection unit that detects the end of the operation based on the operation content received by the operation receiving unit,
When the drag operation is received by the operation receiving unit, the threshold speed is compared with the moving speed detected when the end of the drag operation is detected, and the threshold speed is higher than the moving speed. An image forming apparatus that continues to accept a drag operation when fast, and controls the operation accepting unit to finish accepting a drag operation when the threshold speed is equal to or less than the movement speed.   The image forming apparatus according to claim 7, wherein the content of the drag operation includes a moving direction of the pointing member detected during the drag operation.   The image forming apparatus according to claim 7, wherein the content of the drag operation includes the moving speed detected during the drag operation. The controller is
A start detection unit that detects the start of the operation based on the operation content received by the operation reception unit;
A distance detection unit that detects a movement distance of the pointing member from the start to the end of the operation,
The image forming apparatus according to claim 7, wherein the content of the drag operation includes the moving distance of the drag operation. The threshold determination unit
11. The threshold speed for determining the moving speed of the pointing member is determined to be a predetermined speed or a speed faster than the predetermined speed based on the content of the drag operation. The image forming apparatus according to claim 1. A method implemented in an image forming apparatus,
The image forming apparatus includes:
A screen capable of displaying an image including a plurality of component images;
An operation accepting unit that accepts an operation by an instruction member for the component image displayed on the screen;
The method
Detecting a moving speed of the pointing member on the screen;
Determining a threshold speed for determining the moving speed of the pointing member based on the content of the displayed image when the accepted operation is a drag operation;
Detecting the end of the operation based on the accepted operation content;
When the accepted operation is the drag operation, comparing the threshold speed with the moving speed when the end of the operation is detected;
Based on the result of the comparison, when the threshold speed is faster than the movement speed, the drag operation is continuously accepted, and when the threshold speed is equal to or less than the movement speed, the drag operation is terminated. Controlling the operation accepting unit. A method implemented in an image forming apparatus,
The image forming apparatus includes:
A screen capable of displaying an image including a plurality of component images;
An operation accepting unit that accepts an operation by an instruction member for the component image displayed on the screen;
The method
Detecting a moving speed of the pointing member on the screen;
Determining a threshold speed for determining the moving speed of the pointing member based on the content of the drag operation when the accepted operation is a drag operation;
Detecting the end of the operation based on the accepted operation content;
When the accepted operation is the drag operation, comparing the threshold speed with the moving speed when the end of the operation is detected;
Based on the result of the comparison, when the threshold speed is faster than the movement speed, the drag operation is continuously accepted, and when the threshold speed is equal to or less than the movement speed, the drag operation is terminated. Controlling the operation accepting unit. A program for causing a computer of an image forming apparatus to execute the method according to claim 12 or 13.

Images