JP2014241143A - Display input device, and image forming apparatus including the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a user to easily and intuitively perform designation and attachment of an object to be cut or copied by two-point touching, so as to achieve easy operation of a display input device.SOLUTION: A display input device comprises: a display unit that displays an object; and a touch panel unit that receives a first operation to narrow a distance between two points that are simultaneously touched, and a second operation to enlarge a distance between two points that are simultaneously touched. The touch panel unit receives an input that designates an object displayed at both or one of positions of the two points that are touched as a designation object, receives the first operation as an input to indicate cutting or attachment of the designation object, and receives the second operation as an indication to attach the designation object; and the display unit displays the designation object by attaching the designation object on a screen being displayed when the attachment is indicated.

Description

  The present invention relates to a display input device having a display unit and a touch panel unit, and an image forming apparatus including the same.

  Various electric devices and electronic devices may be provided with a display panel combined with a touch panel for performing setting input and device operation. For example, an image (for example, an icon or a character string) indicating data or a file is displayed on the display panel. Then, by cutting and pasting or copying and pasting an image showing data or the like, it may be possible to switch the storage location of the data or to duplicate the data or the like. For example, it is necessary to select an image showing the object to be moved or copied, display a menu, and select a desired process from the menu. However, a display panel with a touch panel usually has a mouse-like operation. Since there is no device with a button, operation using a menu is not suitable, and it may be difficult to perform cut and paste and copy and paste.

  An example of a technique for simplifying cut-and-paste of data, images, and the like in an information terminal device is described in Patent Document 1 for such a problem. Specifically, Patent Document 1 includes a pen-type pointing device and an information terminal device. The pen-type pointing device includes a mechanical switch, a first memory for storing data, and a first memory in accordance with a mechanical switch operation. Determining means for determining whether data is stored in the memory, and when the determining means determines that the data is stored, the data stored in the first memory is transmitted to the information terminal device, and the data is stored. A first transmission circuit for transmitting data indicating the reception mode to the information terminal device in response to the determination that the information terminal device is not, the information terminal device is stored in the first memory transmitted from the first transmission circuit. A second memory for receiving and storing the received data, and an information terminal device in response to reception of the reception mode data transmitted from the first transmission circuit A second transmission circuit for transmitting selected data among the stored data to the pen-type pointing device is provided, and the pen-type pointing device stores the data transmitted from the second transmission circuit in the first memory. An information terminal system provided with storage control means is described. With this configuration, it is possible to easily perform data transfer and data cut (copy) and paste processing using a pen-type pointing device (see Patent Document 1: Claim 1, paragraph [0006], etc.). ).

JP 2003-177864 A

  For example, image forming apparatuses such as copiers, multifunction machines, printers, and fax machines are also provided with an operation panel including a combination of a display panel and a touch panel. Even on a fixed display panel such as an image forming apparatus, an image such as an image indicating an electronic sticky note (an image including text data such as a note such as a sticky note) or an image indicating data or a file can be used as an operation target. The object may be cut, copied or pasted.

  At present, in many cases, the operation of moving the display position of an object is relatively easy on the same screen. For example, the display position of the object can be moved by an operation (drag and drop) of touching the object to be moved and moving the finger position to the position where the object is to be displayed while touching.

  However, when displaying an object on a screen different from the current display screen, it is necessary to perform a plurality of types of operations. For example, (1) Select an object you want to cut or copy → (2) Operation to display the menu in the selected state → (3) Select desired processing such as cut from the menu → (4) Display the cut or copied object Move to the desired screen → (5) Screen for pasting menus, operation for displaying images → (6) Select object to paste → (7) Paste object Is required. Alternatively, an object pasting or cutting operation may be required every time the screen display is switched.

  As described above, conventionally, in an operation panel including a combination of a display panel and a touch panel, there is a problem that an operation of pasting a cut or copied object on a screen different from the cut or copied screen is not easy. In other words, there is a problem that the operation of pasting an object on a screen different from the screen that has been cut or copied cannot be easily and intuitively (intuitively) (complex) and difficult to understand.

  Note that, when Patent Document 1 is viewed, the technique described in Patent Document 1 requires a pen-type pointing device. Therefore, it costs. Also, the copy target is specified and the copied content is pasted by a mechanical switch operation of the pen-type pointing device (an operation of pressing the push button switch 23 at the upper end of the pen-type pointing device). However, while holding a pen-type pointing device like a pen, it is necessary to press the upper end (head portion) of the pen-type pointing device, which is difficult to use. In addition, copying and pasting operations remain complicated even when a pen-type pointing device is used, and the operation cannot be intuitively (intuitively) and is difficult to understand. Therefore, the technique described in Patent Document 1 cannot solve the above problem.

  In view of the above problems, an object of the present invention is to make it possible to easily and intuitively specify and paste an object to be cut or copied by two-point touch, and to make the display input device easy to use.

  In order to solve the above problems, a display input device according to claim 1 is provided for a display unit that displays a screen and an image, displays an object that is an image to be cut, copied, and pasted, and the display unit. A touch panel unit that receives a user's input and detects a plurality of touched positions. The touch panel unit receives an input designating the object as a designated object and is touched simultaneously at two points. An operation to increase the interval of the designated object is accepted as an instruction to paste the designated object, and an operation to widen the interval between the two touched points at the same time is simultaneously touched on a screen assigned to an operation other than the pasting of the designated object. The display unit pastes the designated object when an operation to increase the interval between two points is performed. It was decided to display a dialog screen to confirm whether or not.

  According to this configuration, the touch panel unit accepts an input for designating an object as a designated object, accepts as an instruction for pasting the designated object (second operation) to increase the interval between two touched points simultaneously, and the display unit pastes. The specified object is pasted and displayed on the currently displayed screen when the attachment is instructed. Accordingly, the designated object can be pasted on the screen being displayed by an intuitive finger operation (second operation) for easily designating and expanding the object. Therefore, it is possible to easily and intuitively move, copy, and paste the designated object to the screen that needs to be switched. In addition, the display input device can be easily used. Further, when the second operation is assigned to an operation other than the pasting of the designated object, the display unit displays a dialog screen. Thereby, when the second operation is performed for a purpose other than the pasting of the designated object, it is possible to prevent the pasting of the designated object against the user's intention. Therefore, it is possible to facilitate the pasting of the designated object.

  According to a second aspect of the present invention, in the first aspect of the invention, the touch panel unit may be configured such that an interval between two points touched simultaneously is less than a predetermined threshold. For example, an input for instructing the copy of the designated object is accepted as an input for instructing the cutting of the designated object, and when the interval between the two narrowed points exceeds the threshold value by an operation for narrowing the interval between the two touched points simultaneously. Or as an input for instructing the copy of the designated object if the interval between the two points narrowed by the operation of reducing the interval between the two points touched simultaneously is equal to or less than a predetermined threshold, When the interval between the two points narrowed by the operation of simultaneously reducing the two points touched exceeds the threshold value, the cutting of the designated object is indicated. It was decided to accept as input.

  According to this configuration, the touch panel unit cuts the designated object if the interval between the two points narrowed by the operation (first operation) for reducing the interval between the two touched points simultaneously is equal to or less than a predetermined threshold. Is received as an input for instructing the copy of the designated object if the interval between the two points narrowed by the first operation exceeds the threshold, or 2 points are narrowed by the first operation. If the interval between the points is equal to or less than a predetermined threshold, it is accepted as an input for instructing copying of the designated object. If the interval between the two points narrowed by the first operation exceeds the threshold, an instruction to cut the designated object is given Accept as input. Thereby, it is possible to select whether to perform cutting or copying based on the degree of movement (movement amount) of the two fingers used for the touch in the first operation. Therefore, there is no need to display a menu for selecting whether to cut or copy, or to select whether to cut or copy from the displayed menu, and it is easy to select whether to cut or copy. Can be done intuitively.

  According to a third aspect of the present invention, in the first or second aspect of the present invention, the touch panel unit receives an input indicating that the designated object is to be pasted while the display unit displays the dialog screen. The designated object is pasted and displayed on the currently displayed screen, and when the touch panel unit receives an input indicating that the designated object is not pasted, the designated object is not displayed on the currently displayed screen.

  According to this configuration, when there is a second operation to increase the interval between two touched points at the same time, the display unit displays a dialog screen for confirming whether to paste the specified object, and the touch panel unit specifies When the input indicating that the object is pasted is accepted, the specified object is pasted and displayed on the currently displayed screen, and when the input indicating that the touch panel unit does not paste the designated object is accepted, the designated object is not displayed on the currently displayed screen. . Thereby, it can be confirmed in advance whether or not the designated object is to be pasted, and unnecessary pasting of the designated object can be eliminated.

  According to a fourth aspect of the present invention, in the first to third aspects of the invention, the display unit is a screen for displaying a preview image for displaying the dialog screen, and the operation for widening the interval between two touched points When the display unit displays a screen that is also assigned to an operation for instructing enlargement of a preview image and an operation is performed to increase the interval between two touched points simultaneously, the display unit displays the designated object. A dialog screen for confirming whether or not to paste is displayed.

  According to this configuration, the display unit displays a dialog screen when the second operation (an operation to increase the interval between two touched points) is assigned to an operation other than the pasting of the designated object. Thereby, when the second operation is performed for a purpose other than the pasting of the designated object, it is possible to prevent the pasting of the designated object against the user's intention. Therefore, it is possible to facilitate the pasting of the designated object.

  According to a fifth aspect of the present invention, in the first to fourth aspects of the present invention, when there is an operation of widening the interval between two touched points at the same time, within a predetermined time after the designated object is designated. If there is, the display unit pastes and displays the designated object on the currently displayed screen without displaying the dialog screen.

  According to this configuration, when there is a second operation (an operation to increase the interval between two touched points), the display unit displays a dialog screen within a predetermined time after the specified object is specified. The specified object is pasted and displayed on the currently displayed screen. As a result, it is possible to prioritize the pasting of the designated object immediately after the designated object is designated (within a predetermined time). Therefore, the specified object can be pasted quickly and smoothly in a time zone where the possibility of pasting is high.

  According to a sixth aspect of the present invention, in the first to fifth aspects of the invention, the plurality of designated objects to be cut or copied are designated, and the operation is performed by increasing the interval between two touched points simultaneously. When there is an instruction to paste the designated object, the display unit pastes and displays the designated object last designated on the currently displayed screen.

  According to this configuration, the display unit pastes and displays the designated object on the screen displaying the designated object designated last. Thereby, it is possible to prevent a plurality of objects including unnecessary ones from being pasted on the screen being displayed at once.

  According to a seventh aspect of the present invention, in the first to fifth aspects of the invention, the plurality of designated objects to be cut or copied are designated, and the operation is performed by increasing the interval between two touched points at the same time. When there is an instruction to paste a designated object, the display unit displays a selection screen for designating the designated object to be pasted among a plurality of the designated objects, and the touch panel unit is input to be pasted by the selection screen. The designated object that has received is pasted and displayed on the currently displayed screen.

  According to this configuration, the display unit displays a selection screen for designating a designated object to be pasted from among a plurality of designated objects, and a screen displaying the designated object for which the touch panel unit accepts input as pasted by the selection screen. Paste to display. Thereby, only the designated object desired by the user among a plurality of designated objects can be pasted on the screen being displayed.

  According to an eighth aspect of the present invention, in the first or second aspect of the invention, when the display of the designated object is performed based on an operation of widening the interval between two points where the display unit is simultaneously touched, The touch panel unit accepts that the touch of the two points touched by the operation of increasing the interval between the two touched points is no longer touched as a definite input for pasting the designated object, and the display unit is pasted. Each time the displayed screen is displayed, the designated object whose paste has been confirmed is displayed.

  According to this configuration, the touch panel unit accepts that the two touched points by the second operation are no longer touched as a confirmed input for pasting the designated object. As a result, simply pasting the finger from the touch panel unit makes it possible to intuitively and easily determine pasting the designated object on the displayed screen.

  According to a ninth aspect of the present invention, in the first to eighth aspects of the invention, when the display of the designated object is performed based on an operation of widening the interval between two points where the display unit is simultaneously touched, The display unit moves the display position of the designated object displayed by the pasting display according to the movement amount and movement direction of the two touched points by the operation of widening the interval between the two touched points at the same time.

  According to this configuration, the display unit moves the display position of the designated object displayed by the pasting display according to the moving amount and moving direction of the two points touched by the second operation. Thereby, the display position of the designated object can be adjusted before the pasting to the screen being displayed is confirmed.

  An image forming apparatus according to a tenth aspect includes the display input device according to any one of the first to ninth aspects.

  According to this configuration, the image forming apparatus includes a display input device that is intuitive and easy to use for specifying object cutting and copying and pasting a specified object. Therefore, it is possible to provide an image forming apparatus that is easy for the user to use.

  As described above, according to the present invention, it is possible to provide an easy-to-use display input device that can easily and intuitively specify and paste an object to be cut or copied by two-point touch.

1 is a front model cross-sectional view illustrating an example of a multifunction peripheral. 2 is a plan view showing an example of an operation panel 1. FIG. 2 is a block diagram illustrating an example of a hardware configuration of a multifunction peripheral or an operation panel. It is explanatory drawing which shows an example of the home screen displayed on an operation panel. It is explanatory drawing which shows an example of the initial setting screen of the copy function which affixed the electronic tag. It is explanatory drawing which shows an example of the initial setting screen of the scan transmission function which affixed the electronic tag. It is explanatory drawing which shows an example of a software keyboard screen. It is explanatory drawing which shows an example of the initial setting screen of a box function. It is explanatory drawing which shows an example of the box screen on which the image which shows data, and the image which shows a folder were displayed. It is explanatory drawing which shows the outline | summary of designation | designated of an object, and selection of cutting and a copy. It is a flowchart which shows an example of the flow of designation | designated of the object which cuts and copies. It is explanatory drawing which shows the outline | summary of designation | designated of pasting of a designated object. It is explanatory drawing which shows an example of the dialog screen for confirming whether a designated object is pasted. It is explanatory drawing which shows an example of the selection screen which selects the object to paste among several designated objects. It is a flowchart which shows an example of the flow of a paste process of a designated object.

  Hereinafter, embodiments will be described with reference to FIGS. In the following, a description will be given by taking as an example a multifunction peripheral 100 (corresponding to an image forming apparatus) including the operation panel 1 (corresponding to a display input apparatus). However, each element such as configuration and arrangement described in this embodiment does not limit the scope of the invention and is merely an illustrative example.

(Outline of image forming apparatus)
First, an outline of the multifunction peripheral 100 according to the embodiment will be described with reference to FIG. FIG. 1 is a front model cross-sectional view showing an example of the multifunction peripheral 100.

  As shown in FIG. 1, an operation panel 1 for making various settings for the multifunction device 100 is provided in front of the multifunction device 100 (details will be described later). As shown in FIG. 1, the multifunction peripheral 100 of the present embodiment is provided with an image reading unit 2a and a document conveying unit 2b at the top, and inside a paper feeding unit 3a, a conveying unit 3b, and an image forming unit 4. The intermediate transfer unit 5a, the fixing unit 5b, the discharge conveyance unit 3c, the double-side conveyance unit 3d, and the like.

  The document transport unit 2 b has a document tray 21. A document to be copied or scanned is placed on the document tray 21. Then, the document transport unit 2b automatically and continuously transports the documents one by one from the document tray 21 to the reading position (feed reading contact glass 22). The document conveying unit 2b is attached to the image reading unit 2a so as to be freely opened and closed in the vertical direction with the back side of the sheet of FIG. 1 as a fulcrum. The document transport unit 2b functions as a cover for pressing the contact glass (the feed reading contact glass 22 and the placement reading contact glass 23) of the image reading unit 2a from above.

  As shown in FIG. 1, on the upper surface of the image reading section 2a, a feed reading contact glass 22 and a placement reading contact glass 23 for placing a document when reading a document such as a book one by one are arranged. . In the image reading unit 2a, a lamp, a mirror, a lens, an image sensor, etc. (not shown) are arranged. The image sensor reads the document based on the reflected light of the document that the document transport unit 2 b passes through the feed reading contact glass 22 or the document placed on the placement reading contact glass 23. The image sensor then converts the reflected light into an analog electrical signal corresponding to the image density, and quantizes the electrical signal. Thereby, image data of the document is obtained. Note that the image reading unit 2a of the present embodiment can also read in color, and can also read in black and white.

  Each of the plurality of paper feeding units 3a in the main body of the multifunction peripheral 100 has a size (for example, A type such as A4, B4, B type standard paper, letter size, etc.), various papers (for example, copy paper, recycled paper, A plurality of sheets (cardboard, OHP sheets, etc.) are stored. Each paper feed unit 3a includes a paper feed roller 31 that is driven to rotate, and feeds paper to the transport unit 3b one by one during printing.

  The transport unit 3b is a path for transporting paper in the apparatus from the paper feed unit 3a to the image forming unit 4. Then, a guide plate for guiding the paper, a pair of transport rollers 32 that are rotationally driven during paper transport (a total of three from 32a, 32b, and 32c from the top in FIG. 2) are transported to the transport unit 3b. A registration roller pair 33 or the like is provided that waits for the sheet to be printed in front of the image forming unit 4 and sends the sheet in accordance with the transfer timing of the formed toner image.

  The image forming unit 4 includes a plurality of image forming units 40 (40 Bk for black, 40 Y for yellow, 40 C for cyan, and 40 M for magenta) and an exposure device 41. The image forming unit 40 includes a photosensitive drum that is rotatably supported, and a charging device, a developing device, and a cleaning device that are disposed around the photosensitive drum. The exposure device 41 outputs laser light while turning it on and off based on image data read by the image reading unit 2a, image data stored in a storage device 62 described later, and the like, and scans and exposes each photosensitive drum. Then, a toner image is formed on the peripheral surface of each photosensitive drum by each image forming unit 40 and exposure device 41.

  The intermediate transfer unit 5a receives the primary transfer of the toner image from each image forming unit 40 and performs the secondary transfer onto the sheet. The intermediate transfer unit 5a includes primary transfer rollers 51Bk to 51M, an intermediate transfer belt 52, a driving roller 53, a plurality of driven rollers 54 (54a to 54c), a secondary transfer roller 55, a belt cleaning device 56, and the like. The intermediate transfer belt 52 is stretched around a drive roller 53 and the like, and rotates around the drive roller 53 connected to a drive mechanism (not shown) such as a motor. Then, a transfer voltage is applied to each of the primary transfer rollers 51 </ b> Bk to 51 </ b> M, and the toner image on each photosensitive drum is transferred to the intermediate transfer belt 52. After the toner image is superimposed and transferred to the intermediate transfer belt 52 without being shifted, the toner image is transferred onto the sheet by the secondary transfer roller 55 to which a predetermined voltage is applied.

  The fixing unit 5b fixes the toner image transferred to the paper. The fixing unit 5b includes a heating roller 57 containing a heating element and a pressure roller 58 that presses against the heating roller 57. When the paper passes through the nip between the heating roller 57 and the pressure roller 58, the toner is melted and heated, and the toner image is fixed on the paper. The paper discharged from the fixing unit 5b is sent in the direction of the discharge tray 34.

  The discharge conveyance unit 3c sorts the printed paper in the paper conveyance direction in the direction of the discharge tray 34 or the double-sided conveyance unit 3d. The discharge conveyance unit 3c includes a discharge roller pair 35 that is driven to rotate in the forward rotation direction and is sent out in the direction of the discharge tray 34, or reversely rotated and switched back for double-sided printing. Further, the discharge conveyance unit 3c has a switching valve 36 for switching the paper conveyance direction. The switching valve 36 rotates. The switching valve 36 has a position at which the double-sided conveyance unit 3d is closed and the paper is guided in the direction of the discharge tray 34 as a basic position, and the single-sided printed paper rotated and switched back during double-sided printing is supplied to the double-sided conveyance unit 3d. Lead. The double-sided conveyance unit 3 d connects the downstream side of the fixing unit 5 b and the upstream side of the registration roller pair 33. The double-sided conveyance unit 3d is provided with a plurality of double-sided conveyance roller pairs 37 to 39 that are rotationally driven for double-sided printing, and conveys the single-sided printed paper.

(Operation panel 1)
Next, an example of the operation panel 1 according to the embodiment will be described with reference to FIG. FIG. 2 is a plan view showing an example of the operation panel 1.

  As shown in FIG. 1, the operation panel 1 is provided on the upper front side of the multifunction peripheral 100. The operation panel 1 includes a display unit 11, a touch panel unit 12, and hard keys (for example, a numeric keypad 13 for inputting numbers and a start key 14 for processing start instruction such as copying).

  For example, the display unit 11 is a liquid crystal display panel. The display unit 11 may be another type of display panel such as an organic EL panel. The display unit 11 displays menus and keys for setting the multifunction device 100. The user can input various settings of the multifunction peripheral 100 by designating the keys displayed on the display unit 11. The display unit 11 displays various images and screens such as status messages of the multifunction peripheral 100 and the like.

  A touch panel unit 12 is provided on the upper surface of the display unit 11. The touch panel unit 12 detects the position and coordinates touched by the user. By comparing the display position of the key with the touched position, the key specified by the user is specified, and the user's input is accepted.

  The touch panel unit 12 can recognize a plurality of positions touched simultaneously. Therefore, a projected capacitive touch panel can be used for the touch panel unit 12. Note that the touch panel unit 12 is not necessarily limited to the capacitive type as long as it can recognize a plurality of positions touched simultaneously.

  Then, the display unit 11 of the present embodiment displays the object 8 that is an image to be cut, copied, and pasted. By cutting, copying, and pasting using the touch panel unit 12, the object 8 instructed to cut or copy can be displayed on another screen. Examples of the object 8 include an electronic sticky note 81 (an image like a memo including a character string) and an image showing data and files (details will be described later).

(Hardware configuration of MFP 100 etc.)
Next, an example of the hardware configuration of the multifunction peripheral 100 and the operation panel 1 according to the embodiment will be described with reference to FIG. FIG. 3 is a block diagram illustrating an example of a hardware configuration of the multifunction peripheral 100 and the operation panel 1.

  First, the main control unit 6 is provided in the main body of the multifunction peripheral 100. For example, the main control unit 6 is connected to the operation panel 1, the document conveying unit 2b, the image reading unit 2a, the paper feeding unit 3a, the conveying unit 3b, the image forming unit 4, the fixing unit 5b, the discharge conveying unit 3c, etc. Take control.

  For example, the main control unit 6 includes elements that control the CPU 61 and the like. The CPU 61 performs calculations and the like based on a control program stored in the storage device 62 and developed, and controls each unit of the multifunction peripheral 100. The main control unit 6 is configured for each function, such as a main control unit that performs overall control and image processing, an engine control unit that controls printing by performing ON / OFF of a motor that rotates an image forming and various rotating bodies, and the like. Multiple types may be provided by dividing. In this description, a form in which these control units are combined as the main control unit 6 will be shown and described.

  The storage device 62 is connected to the main control unit 6. The storage device 62 is a combination of nonvolatile and volatile devices such as ROM, RAM, and HDD. The storage device 62 can store various data such as a control program, control data, setting data, and image data of the multifunction peripheral 100.

  The main control unit 6 is connected to an interface unit (hereinafter, communication unit 63) including various connectors, sockets, a FAX modem, and the like. The communication unit 63 is connected to a plurality of external computers 200 (for example, personal computers and servers) and a counterpart FAX apparatus 300 (only one is shown for convenience in FIG. 7) via a network, a public line, or the like. For example, the image data obtained by the image reading unit 2a can be stored in the storage device 62 (box function) or transmitted to the external computer 200 or the counterpart FAX device 300 (scanner function, FAX function). In addition, printing, FAX transmission, and the like can be performed based on image data transmitted from the external computer 200 or the partner FAX apparatus 300 and input to the MFP 100 (printer function, FAX function).

  Further, for example, the main control unit 6 performs image processing on image data obtained by reading a document by the image reading unit 2 a and image data input to the multi-function peripheral 100 via the communication unit 63. A portion 64 is provided. For example, the image data processed by the image processing unit 64 is transmitted to the exposure device 41 and used for scanning / exposure of the photosensitive drum, or stored in the storage device 62.

  The main control unit 6 recognizes an input made on the operation panel 1 and controls the multifunction peripheral 100 so that a job such as copying or scanning is performed in accordance with a user setting. The operation panel 1 of the present embodiment includes a panel control unit 10, a display unit 11, a touch panel unit 12, hard keys (for example, a numeric keypad unit 13 and a start key 14), a memory 15, a driver circuit 16, and the like. The panel control unit 10 is composed of a CPU, an IC, and the like. The panel control unit 10 controls the display of the display unit 11, receives the output of the touch panel unit 12, and specifies the touched position (coordinates). Data such as a table indicating the correspondence between the output of the touch panel unit 12 and the position (coordinates) is stored in the memory 15. The memory 15 includes a ROM and a RAM. The panel control unit 10 compares the touched position with the image data on the screen displayed on the display unit 11 when touched, and recognizes the key displayed at the touched position. Thereby, the panel control unit 10 recognizes the key designated by the user.

  In normal operation, select each function of the MFP 100, select setting items that can be set with the selected function (for example, in the case of a copy function, enlargement / reduction, density, aggregation, duplex, etc.), and the selected setting In order to set a setting value with an item, the designation (selection) of the key displayed on the display unit 11 is repeated from the display of the uppermost layer on the display unit 11 (see the home screen 7, FIG. 4). Then, the display screen of the display unit 11 is switched every time the key is designated (selected), and finally the setting value of the function to be set is set. The panel control unit 10 recognizes that this function has been selected and set, and transmits the contents to the main control unit 6 of the main body. Accordingly, the main control unit 6 causes each unit such as the image forming unit 4 to perform an operation reflecting the function selected and set on the operation panel 1 so that the user's intention is reflected in a job such as printing.

  The screen and image data displayed on the display unit 11 are stored in, for example, the memory 15 in the operation panel 1. Accordingly, the panel control unit 10 reads the image data of the screen or image to be displayed next from the memory 15 in accordance with the key displayed at the touched position. Note that the screen and image data displayed on the display unit 11 may be stored in the storage device 62 on the main body side. In this case, the operation panel 1 receives image data for display on the display unit 11 from the storage device 62 via the main control unit 6. In any case, the panel control unit 10 gives an instruction to a driver circuit 16 that actually controls the display of the display unit 11 (for example, a liquid crystal driver IC if the display unit 11 is a liquid crystal display panel), and based on the image data. Display is performed on the display unit 11. The operation panel 1 may not include the panel control unit 10 and the memory 15, and the configuration of the main control unit 6 (the CPU 61 and the storage device 62) may substitute the functions of the panel control unit 10 and the memory 15.

  The touch panel unit 12 is provided with a position detection unit 121 for detecting a touched position. For example, the position detection unit 121 is an IC for detecting a touch position (coordinates of a touched point). For example, if the touch panel unit 12 includes a projection-type panel in the capacitance method, the position detection unit 121 detects a change in capacitance by the touch panel unit 12 and indicates one or a plurality of simultaneously touched positions. Output a signal. The panel control unit 10 recognizes the touched position based on the output of the position detection unit 121.

(Home screen 7 and function selection)
Next, the home screen 7 displayed on the operation panel 1 of the present embodiment will be described with reference to FIG. FIG. 4 is an explanatory diagram showing an example of the home screen 7 displayed on the operation panel 1.

  The operation panel 1 of the present embodiment is provided with a home screen 7 for selecting a function to be used. The home screen 7 corresponds to the highest hierarchical level. For example, when the clear key 17 or the reset key 18 provided on the operation panel 1 is pressed (see FIG. 2), the panel control unit 10 displays the home screen 7 on the display unit 11. In addition, for example, the panel control unit 10 causes the current setting contents to be displayed when a predetermined time elapses after the input to the operation panel 1 (the touch on the touch panel unit 12 or the operation of pressing a hard key) is lost or the job is completed. And the home screen 7 may be displayed on the display unit 11 (auto clear).

  For example, on the home screen 7, a copy key K1, an application key K2, a box key K3, a program key K4, a scan transmission key K5, and a status confirmation key K6 are provided as function selection keys. The touch panel unit 12 outputs data (signal) indicating the touched position to the panel control unit 10. The panel control unit 10 recognizes that the function of the function selection key displayed at the touched position is designated based on the output mode of the touch panel unit 12. Then, an initial setting screen for the designated function is displayed. For example, when it is recognized that the copy function is designated, the panel control unit 10 displays an initial setting screen 71 for the copy function. In this way, the user can select a function to be used on the home screen 7.

(Electronic sticky note 81)
Next, the electronic sticky note 81 as the object 8 will be described with reference to FIGS. FIG. 5 is an explanatory diagram showing an example of an initial setting screen 71 for a copy function to which an electronic sticky note 81 is pasted. FIG. 6 is an explanatory diagram showing an example of the initial setting screen 72 of the scan transmission function with the electronic sticky note 81 pasted. FIG. 7 is an explanatory diagram showing an example of the software keyboard screen 73.

  As described above, the object 8 is an image or data to be cut, copied or pasted. By pasting by input to the touch panel unit 12, the object 8 instructed to be cut or copied can be newly displayed on a screen different from the screen on which the object 8 was originally displayed.

  And the electronic sticky note 81 as an example of the object 8 is demonstrated using FIGS. The electronic sticky note 81 is an image displayed on the display unit 11 and is an image that is pasted on a screen like a sticky note and includes text data such as a note.

  In describing the electronic sticky note 81, an example of the copy function setting screen shown in FIG. 5 will be described first. The copy function initial setting screen 71 shown in FIG. 5 is a screen that the panel control unit 10 first displays on the display unit 11 when the copy key K1 is pressed on the home screen 7.

  As shown in FIG. 5, for example, the copy function initial setting screen 71 is provided with a plurality of simple setting keys K7 to K12 for setting frequently used setting items. FIG. 5 shows an example in which a simple setting key K7 for the setting item “paper selection”, a simple setting key K8 for the setting item “enlarge / reduce”, and the like are displayed.

  In addition, in order to set setting items that are not displayed on the initial setting screen 71 (for example, a frame setting item, a margin setting item, a reading resolution setting item, and a document type setting item), the simple setting tab TB1 is used. Touch the position where the lined original / paper / finishing tab TB2, color / image quality tab TB3, layout editing tab TB4, application / others tab TB5 and program tab TB6 are displayed. Each setting item is associated with one of the tabs in advance. When the position where the tab is displayed is touched, the panel control unit 10 causes the display unit 11 to display a setting screen displaying a list of setting keys indicating setting items associated with the tab specified by the touch.

  For example, when the position where the document / paper / finishing tab TB2 is displayed is touched, the panel control unit 10 sets the setting items related to the document and paper, such as the document size, the paper size, the orientation of the document and paper, and the paper source. Is displayed on the display unit 11. When the position where the color / image quality tab TB3 is displayed is touched, the panel control unit 10 adjusts the print color (color or monochrome, etc.), resolution, and density adjustment of each color (black, cyan, magenta, yellow), etc. A screen for displaying setting keys indicating setting items relating to color and image quality is displayed on the display unit 11. When the position where the layout editing tab TB4 is displayed is touched, the panel control unit 10 displays a screen for displaying setting keys indicating setting items relating to image arrangement and image data editing such as aggregate printing and duplex printing. Display on the unit 11. When the position where the application / others tab TB5 is displayed is touched, the panel control unit 10 displays a screen for displaying setting keys indicating setting items relating to applied contents such as margin size and frame erasing processing. 11 is displayed.

  Then, the user touches the display position of the tab, touches the display position of the setting key of any setting item displayed thereafter, and designates the setting item. As a result, the panel control unit 10 displays a setting screen for the specified setting item. For example, when a setting item for consolidated printing is specified, a setting value such as 2 in 1 or 4 in 1 or a setting value such as a boundary line type can be set on the consolidated printing setting screen. In this way, the user can set a setting value for a desired setting item while switching the setting screen.

  Next, an example of the scan transmission function setting screen shown in FIG. 6 will be described. The scan transmission function initial setting screen 72 shown in FIG. 6 is a screen that the panel control unit 10 first displays on the display unit 11 when the scan transmission key K5 is pressed on the home screen 7.

  The scan transmission function causes the image reading unit 2a to read a document when the job is started, and transmits the image data of the document obtained by the reading as an e-mail, to a desired computer 200, or to the FAX apparatus 300. It is a function to do.

  For example, the panel control unit 10 causes the display unit 11 to display an address book as the scan transmission function initial setting screen 72. The address book data is stored in the memory 15 of the operation panel 1 or the storage device 62 of the main body. The panel control unit 10 reads the address book data from the memory 15 and the storage device 62 when displaying the address book.

  The scan transmission function initial setting screen 72 is provided with a destination list display area R1 for displaying destination names and destination information as a list. By touching the destination list display area R1, the destination to be transmitted can be designated. Then, after the destination is specified, the transmission method can be specified by touching the display position of the key of the method to be transmitted in the transmission method specification key group KG1. When the transmission method is specified, the panel control unit 10 displays a setting screen (for example, a screen for setting the size of image data to be transmitted) for setting details in performing transmission according to the transmission method. And let the user on the transmission make the settings.

  Next, creation of the electronic sticky note 81 will be described. When creating the electronic sticky note 81, the user performs a predetermined input on the operation panel 1 on a screen (setting screen) to which the electronic sticky note 81 is newly attached. For example, touching the touch panel unit 12 for creating and pasting the electronic sticky note 81, such as touching the same position multiple times (for example, twice or three times) or long pressing without moving the position of the two-point touch A touch method may be determined in advance. Further, a hard key for creating an electronic sticky note 81 on the operation panel 1 and calling a mode attached to the screen may be provided on the operation panel 1.

  When the panel control unit 10 recognizes an instruction input to create the electronic sticky note 81 based on the output of the touch panel unit 12 or the like, the panel control unit 10 displays a software keyboard screen 73 as shown in FIG. 11 is displayed. The touch panel unit 12 receives a touch on a key such as a displayed character or symbol. The panel control unit 10 recognizes the key displayed at the touched position based on the output of the touch panel unit 12 and recognizes the input content (input characters, numbers, and symbols). The touch panel unit 12 also accepts correction and deletion of input contents. Thus, the user can manually input kanji, kana characters, katakana, alphabets, numbers, and various symbols to be displayed in the electronic sticky note 81 using the software keyboard screen 72.

  When the electronic sticky note 81 is closed, the panel control unit 10 displays the electronic sticky note 81 including the input contents on the software keyboard screen 73 on the screen instructing the creation of the electronic sticky note 81. In FIG. 5, the display unit 11 includes an electronic sticky note 81 including a character string “confirm original, paper size, and magnification” at the upper right of the copy function initial setting screen 71, and the characters “use double sided and aggregated in principle”. An example in which an electronic sticky note 81 including a column is displayed is shown. Further, FIG. 6 shows an example in which the display unit 11 displays an electronic sticky note 81 including a character string “Destination must be reconfirmed and transmission error will be eliminated” on the upper right of the initial setting screen 72 of the scan transmission function. ing.

  The user can set the display position of the electronic sticky note 81 at a desired position by touching the electronic sticky note 81 and shifting the touched position. In other words, the panel control unit 10 recognizes an operation (drag and drag operation) in which the display position of the electronic sticky note 81 is touched and the touch position is moved while being touched based on the output of the touch panel unit 12. The display position of the electronic sticky note 81 touched on the display unit 11 is moved in accordance with the movement.

  For example, the memory 15 of the operation panel 1 stores the screen to be displayed, the display position (coordinates) on the screen, and the contents (character string or the like) included in the electronic tag 81 for each created electronic tag 81. When the display 11 is switched, the panel control unit 10 confirms the contents stored in the memory 15 and confirms the presence or absence of the electronic sticky note 81 to be displayed. If there is an electronic sticky note 81 to be displayed, the panel control unit 10 causes the display unit 11 to display it. Thus, the panel control unit 10 causes the display unit 11 to display a specific electronic sticky note 81 each time a specific screen is displayed.

  In each electronic sticky note 81 (in the image area of the electronic sticky note 81), a cross is displayed. When the touch panel unit 12 accepts that the display position of the x mark is touched, the panel control unit 10 causes the display unit 11 to stop displaying the electronic sticky note 81 touched with the x mark. Thereby, the user can erase the unnecessary electronic sticky note 81.

(Images showing data and images showing folders)
Next, referring to FIG. 8 and FIG. 9, an image indicating data as the object 8 (hereinafter referred to as “data image 82” for convenience) and an image indicating a folder (hereinafter referred to as “folder image 83” for convenience). explain. FIG. 8 is an explanatory diagram showing an example of the box function initial setting screen 74. FIG. 9 is an explanatory diagram showing an example of a box screen 75 on which an image showing data and an image showing a folder are displayed.

  In describing the data image 82 and the folder image 83, an example of various setting screens for the box function shown in FIGS. 8 and 9 will be described first. When the display position of the box key K3 is touched on the home screen 7 and the box function is designated, the panel control unit 10 displays the initial setting screen 74 shown in FIG. 8 on the display unit 11 as the first setting screen for the box function. Let A part of the storage area of the storage device 62 (HDD) is allocated for the box function. Then, the allocated storage area is virtually divided in units of boxes. For example, the user can store image data in the box or reuse (print, transmit, etc.) the image data stored in the box.

  In the initial setting screen 74, a box name list display area R2 is provided. A desired box can be designated by touching the box name list display area R2. Then, after designating the box, the display position of the document storage key K13 is touched to store the image data obtained by reading the document by the image reading unit 2a in the designated box (HDD of the storage device 62). Can be made. When the document storage key K13 is designated, the panel control unit 10 displays a scan content setting screen (for example, a screen for setting the resolution, the document size, and the size of image data obtained by reading). Allows the user to make settings relating to document reading and storage of image data in a box. Further, after designating the box, the display position of the key K14 to be opened can be touched to print or transmit the image data stored in the box.

  When the key K14 to be opened in a state where a box is designated is designated, as shown in FIG. 9, the panel control unit 10 displays a setting screen relating to the use (printing and transmission) of data stored in the designated box. A certain box screen 75 is displayed, and settings relating to reuse of data in the box are performed.

  The panel control unit 10 causes the display unit 11 to display a data image 82 indicating data stored in the box and a folder image 83 indicating a folder created in the box in the box screen 75. The data image 82 includes an icon indicating data, a document name, an image indicating the generation date and time, and an image indicating the size. The folder image 83 includes an icon and an image showing the folder name.

  The touch panel unit 12 receives an input for designating data or a folder to be used by touching the display position of the data image 82 or the folder image 83. For example, based on the output of the touch panel unit 12, the panel control unit 10 causes the display unit 11 to display the specified data image 82 in a black and white reversed state. When the panel control unit 10 recognizes that the display position of the folder image 83 is touched based on the output of the touch panel unit 12, the panel control unit 10 causes the display unit 11 to newly display a data image 82 indicating data included in the folder.

  In the box screen 75, a print key K15, a transmission key K16, a preview key K17, a folder creation key K18, and the like are arranged. When the touch panel unit 12 accepts that the display position of the print key K15 is touched in a state where the data to be used is specified, the main control unit 6 controls paper feeding, paper conveyance, and image formation to specify the specified data image. The printing based on the data corresponding to 82 is performed. When the touch panel unit 12 accepts that the display position of the transmission key K16 is touched with the data to be used specified, the main control unit 6 controls the image processing unit 64 and the communication unit 63 to specify the specified data image. Data corresponding to 82 is transmitted. When the touch panel unit 12 accepts that the display position of the preview key K17 is touched while the data to be used is specified, the panel control unit 10 displays a preview image indicating the content of the data corresponding to the specified data image 82. Display on the unit 11. When the touch panel unit 12 accepts that the display position of the folder creation key K18 is touched, the panel control unit 10 displays a software keyboard screen 73 as shown in FIG. 7, and the folder name set on the software keyboard screen 73 is displayed. A folder is created and a folder image 83 with the created folder name is displayed on the display unit 11.

  Since various setting screens are various, only a part of setting screens for the copy function, the scan transmission function, and the box function have been described for convenience. However, although not illustrated, when an application function is designated, the panel control unit 10 causes the display unit 11 to display an initial setting screen for calling and setting an application installed in the storage device 62. For example, the application is a program or data for improving the usability of the multifunction device 100. For example, there are various applications according to purposes, such as an application that converts image data obtained by scanning a document such as a business card into text data or a database, and an application that electronically documents data obtained by scanning a document.

  When the program function is designated, the panel control unit 10 causes the display unit 11 to display an initial setting screen for calling (starting) a predetermined program or creating a program. The program predefines setting values for one or more setting items on the operation panel 1. For example, the setting values of the setting items that are often used in combination are defined in advance as a program (registered in advance). By adding the program, the panel control unit 10 recognizes that the setting is made with the setting value of each setting item defined in the called program. Thereby, it can be set as the state which set the setting value of several setting items by one touch.

  When the status confirmation key K6 is designated, the panel control unit 10 causes the display unit 11 to display a status display screen for displaying the status of the multifunction peripheral 100. For example, the panel control unit 10 causes the display unit 11 to display the contents of a job being executed such as printing or reading a document on the status display screen. Further, the panel control unit 10 may cause the display unit 11 to display the total number of printed sheets, the remaining amount of paper in each paper feeding unit 3a, and the like in the status display screen. Alternatively, the panel control unit 10 may cause the display unit 11 to display a state relating to devices and parts in the multifunction peripheral 100 such as the usage amount and remaining capacity of the storage device 62.

(Specify object 8, select cut and copy)
Next, an example of specifying the object 8 to be cut or copied will be described with reference to FIGS. FIG. 10 is an explanatory diagram showing an outline of designation of the object 8, selection of cut and copy. FIG. 11 is a flowchart illustrating an example of a flow of specifying the object 8 to be cut or copied.

  As described above, in the operation panel 1 and the multifunction peripheral 100 according to the present embodiment, there are the electronic sticky note 81, the data image 82, and the folder image 83 as images (object 8) that can be cut, copied, and pasted. An image other than the electronic sticky note 81, the data image 82, and the folder image 83 may be handled as the object 8.

  In the operation panel 1 and the multifunction peripheral 100 of this embodiment, the object 8 to be cut or copied can be designated intuitively and simply, and the designated object 8 can be pasted on an arbitrary screen. First, the outline of the designation of the object 8, the cutting of the designated object 80, and the selection of the copy will be described with reference to FIG.

  First, when designating the object 8 to be cut or copied, the user touches the display position of the object 8 at two points. At this time, as shown on the left side of the uppermost stage in FIG. 10, the touch panel unit 12 accepts the two-point touch in which both of the two touch positions are included in the display range of the object 8 as the designation of the object 8. Also good. Further, like the data image 82 and the folder image 83, there are cases where the object 8 is small or it is difficult to touch two points at the same time. Therefore, as shown on the right side of the uppermost stage in FIG. 10, the touch panel unit 12 performs two-point touch such that at least one of the two touch positions is included in the range in which the object 8 is displayed as designation of the object 8. It may be accepted. Thus, when there are two touches at the same time, the touch panel unit 12 receives an input for designating the object 8 displayed at both or one of the two touched points. The designated object 8 is referred to as “designated object 80”.

  Then, as shown in the middle diagram of FIG. 10, the user instructs (selects) to cut or copy the designated object 80 by an operation (first operation) for narrowing the interval between the two touched points. The distance (distance) between the two touched points can be obtained based on the difference between the coordinates of the two touched points. For example, the square root of the sum of the square of the distance difference in the X-axis direction (left-right direction) and the square of the square of the distance difference in the Y-axis direction (vertical direction) can be taken to obtain the distance between the two points.

  And in description of this embodiment, if the space | interval (distance) of 2 points | pieces when the space | interval is narrowed by operation (1st operation) which narrows the space | interval of 2 points | pieces touched is less than a threshold value, The input is accepted as an input for cutting the designated object 80. If the interval (distance) between the two points exceeds the threshold, the designated object 80 is accepted as an input for copying. If the distance (distance) between the two points when the distance is narrowed by the first operation is equal to or smaller than the threshold, the touch panel unit 12 accepts the input of the designated object 80 as an input, and the distance (distance) between the two points is the threshold. May be accepted as an input for cutting out the designated object 80. In this way, the user can select whether to cut or copy the designated object 80 according to the amount by which the two touched points are narrowed.

  Since the interval (distance) between the two points touched by the first operation changes, the interval between the two points compared with the threshold value may be the interval (distance) between the two points when two fingers are released. Alternatively, the distance between the two touched points when the interval is narrowed may be compared with a threshold value. The threshold value is a value that can be arbitrarily determined. The threshold value may be a fixed value, but there are individual differences in the distance between the fingers when touching the touch panel unit 12 at the same time, so the threshold value is the distance (distance) between the two points touched first. The threshold value may be changed accordingly (for example, the threshold value is ½ of the interval between the two points touched first).

  Then, when both of the two touched points are separated from the touch panel unit 12, the specified object 80 and the cut or copy are confirmed. For example, as shown on the left side of the lowermost stage in FIG. 10, the touch panel indicates that two fingers are separated from the touch panel unit 12 by setting the interval between two touched points to be equal to or less than a threshold so as to pick up the designated object 80. The unit 12 accepts the cut input of the designated object 80. In this manner, the operation of cutting the designated object 80 can be performed by an operation of actually grasping an object. Also, for example, as shown on the right side of the lowermost stage in FIG. 10, the specified object 80 is lightly tipped with two fingers while keeping the distance between the two touched points to some extent so that the distance between the two points does not fall below the threshold value. The touch panel unit 12 receives that the specified object 80 is copied from the touch panel unit 12. In this way, the copy operation of the designated object 80 can be performed by an operation of actually moving the object while holding it.

  When the designated object 80 is cut, the display unit 11 does not display the designated object 80 that is instructed to be cut. When the designated object 80 is copied, the display unit 11 continues to display the designated object 80 for which copying has been instructed.

  When the designated object 80 is cut or copied, the memory 15 of the operation panel 1 stores information on the designated object 80 (the contents of the designated object 8, the screen on which the object 8 is designated, the time at which the object 8 is designated). And information indicating the type of cut or copy.

  Next, an example of the flow of processing for specifying the object 8, cutting the specified object 80, and selecting copy will be described with reference to FIG. In FIG. 11, the touch panel unit 12 accepts a two-point touch made on the display position of the object 8 while the display unit 11 is displaying after the main power of the multifunction peripheral 100 is turned on, and the panel control unit 10. Is the time when it is recognized that a two-point touch on the display position of the object 8 has been performed based on the output of the touch panel unit 12.

  First, panel control unit 10 recognizes object 8 designated by the two-point touch as designated object 80 (step # 11). Further, based on the output of the touch panel unit 12, the panel control unit 10 recognizes the position (coordinates) of the two points touched first, obtains the interval (distance) between the two points touched first, and from the obtained interval A threshold value is determined (step # 12). For example, the threshold value is set to a fraction of the interval between the two points touched first. When a fixed value is used for the threshold value, it is not necessary to obtain an interval (distance) between two points touched first.

  The panel control unit 10 recognizes the current positions of the two touched points based on the output of the touch panel unit 12 (step # 13). Further, the panel control unit 10 confirms whether or not any point on the touch panel unit 12 is touched based on the output of the touch panel unit 12 (whether or not the touched point disappears) (step # 14).

  If no finger is released from touch panel unit 12 (No in step # 14), the flow returns to step # 13. On the other hand, if any finger is released from the touch panel unit 12 and the touched point disappears (Yes in step # 14), the panel control unit 10 determines that the two fingers are released based on the output of the touch panel unit 12. The distance between the two touch positions is determined (step # 15). Note that the panel control unit 10 is not the time when two fingers are released, but after the two-point touch (after the object 8 is designated) until the two fingers are released. You may obtain | require the space | interval when the space | interval of two touched points becomes short.

  Then, the panel control unit 10 checks whether or not the interval between the two touch positions touched until the two fingers are released is equal to or smaller than the threshold value (step # 16). If it is equal to or less than the threshold (Yes in Step # 16), the panel control unit 10 recognizes that the designated object 80 is cut (Step # 17). Then, the panel control unit 10 turns off the display of the designated object 80 instructed to be cut (step # 18). Further, the panel control unit 10 stores information on the designated object 8 in the memory 15 (step # 19). The process of specifying the object 8 and selecting the cut or copy ends (end). On the other hand, if the threshold value is exceeded (No in step # 16), the panel control unit 10 recognizes the copy of the specified object 80 (step # 110). . Then, the process proceeds to step # 19.

(Flow of pasting object 8)
Next, an example of pasting of the designated object 80 will be described with reference to FIGS. FIG. 12 is an explanatory diagram showing an outline of designation of pasting of the designated object 80. FIG. 13 is an explanatory diagram showing an example of a dialog screen 91 for confirming whether or not the designated object 80 is to be pasted. FIG. 14 is an explanatory diagram showing an example of a selection screen 92 for selecting an object 8 to be pasted from among a plurality of designated objects 80. FIG. 15 is a flowchart showing an example of the flow of the process for pasting the designated object 80.

  As described above, in the operation panel 1 and the multifunction peripheral 100 of this embodiment, the object 8 to be cut or copied can be designated. In the operation panel 1 and the multifunction peripheral 100 of the present embodiment, the designated object 8 can be pasted on a desired (arbitrary) screen (setting screen) in an intuitive and simple manner. For example, the electronic sticky note 81 cut or copied on the copy function setting screen can be pasted on the setting screen for other functions such as scan transmission, program function, and box function. Further, by pasting the data image 82 or folder image 83 cut or copied on a certain box screen 75 on the screen of another box, the data corresponding to the pasted data image 82 or folder image 83 is transferred to another box. It can be stored.

  First, an outline of pasting of the designated object 80 will be described with reference to FIG. When starting the pasting of the designated object 80, the user touches the touch panel unit 12 at two points as shown in the uppermost diagram of FIG. As shown in the uppermost diagram of FIG. 12, when the designated object 80 is pasted, the user touches two positions on the touch panel unit 12 where the object 8 is not displayed.

  And a user performs operation (2nd operation) which expands the space | interval of two touched points. The touch panel unit 12 receives the second operation as an instruction to paste the designated object 80. As a result, as shown in the second drawing from the top in FIG. 12, the display unit 11 displays (pastes and displays) the object 8 for which cutting or copying is designated. As described above, the designated object 80 is developed on the display unit 11 by opening the finger, and the designated object 80 can be pasted intuitively.

  Then, as shown in the third drawing from the top in FIG. 12, the user can move the display position of the pasted designated object 80 by moving the finger touched by two points. In other words, the display unit 11 changes the display position of the designated object 80 pasted according to the movement amount and direction of the two points detected by the touch panel unit 12. For example, the display unit 11 changes the display position of the designated object 80 so that the center position of the designated object 80 is moved by the same amount as the movement of one of the two touched points.

  Then, as shown in the lowermost diagram of FIG. 12, when any of the two touched points is separated from the touch panel unit 12, the pasting of the designated object 80 is confirmed. In this manner, the designated object 80 can be pasted by an operation of releasing after opening.

  Next, the display of the dialog screen 91 for determining whether or not to paste the designated object 80 will be described with reference to FIG. In pasting the designated object 80, the touch panel unit 12 accepts a second operation for simultaneously touching two points and increasing the interval between the two points as a pasting instruction for the designated object 80. As a result, the display unit 11 displays (pastes and displays) the designated object 80 in an unconfirmed state.

  However, the user does not necessarily want to paste the designated object 80 just because the second operation is performed to increase the interval between the two touched points. For example, when the second operation is assigned to an operation other than the pasting of the designated object 80, the user does not always want to paste the designated object 80 even if the second operation is performed.

  FIG. 13 shows an example of the preview image display screen 76 displayed on the display unit 11 when the display position of the preview key K17 is touched on the box screen 75 or the like or when copying. When displaying a preview image, the image processing unit 64 reduces the data stored in the storage device 62 and the image data obtained by reading by the image reading unit 2a, and generates image data for displaying a preview image. The panel control unit 10 receives the image data for displaying the preview image and causes the display unit 11 to display the preview image.

  In the operation panel 1 of the present embodiment, the preview image can be enlarged so that detailed confirmation can be performed. Then, the touch panel unit 12 touches the displayed preview image at two points, and accepts an operation (second operation) for widening the interval between the two touched points as a preview image enlargement instruction.

  As described above, when the operation for expanding the interval between the two touched points (second operation) is assigned to an operation other than the pasting of the designated object 80 (enlarged display of the preview image), the second operation is performed. As shown in FIG. 13, the display unit 11 displays a dialog screen 91 for confirming whether or not to paste the designated object 80.

  On the dialog screen 91, a Yes key K19 and a No key K20 are displayed. The touch panel unit 12 accepts a touch at a position where the Yes key K19 is displayed as an instruction to execute the pasting of the designated object 80. Further, the touch panel unit 12 accepts a touch at a position where the No key K20 is displayed as an instruction not to paste the designated object 80, and an operation other than the pasting of the designated object 80 is executed.

  When the display position of the Yes key K19 or No key K20 is touched on the displayed dialog screen 91, the touched two points need to be once separated from the touch panel unit 12. When displaying the dialog screen 91, the touch panel unit 12 does not accept that the two points touched from the touch panel unit 12 are released as the pasting of the designated object 80.

  When the position displayed as the Yes key K19 on the dialog screen 91 is touched, the pasting of the designated object 80 is confirmed, and the display unit 11 displays the designated object 80. When the position displayed as No key K20 on the dialog screen 91 is touched, the designated object 80 is not pasted. When the operation for expanding the interval between the two touched points (second operation) is assigned to an operation other than the pasting of the designated object 80 (enlarged display of the preview image), the display unit 11 is other than the pasting of the designated object 80. Displays the result of the operation.

  Even if the operation (second operation) for expanding the interval between the two touched points is not assigned to an operation other than the pasting of the designated object 80, if the second operation is performed, this is displayed when the second operation is performed. The unit 11 may always display the dialog screen 91.

  Further, if the second operation is performed immediately after the designated object 80 is designated, it is highly possible that the designated object 80 is pasted. Therefore, if it is within a predetermined time after the designated object 80 is designated (for example, several tens of seconds to several minutes after the designation of the object 8 is made. For example, the time is counted by the panel control unit 10), the display unit 11 May not display the dialog screen 91, and the touch panel unit 12 may accept the second operation as an instruction to paste the designated object 80.

  In addition, after designating the object 8, the instruction for copying or cutting by the first operation can be repeatedly performed a plurality of times. For this reason, when an operation (second operation) for increasing the interval between two points touched by the touch panel unit 12 is received, which of the designated objects 8 is to be pasted becomes a problem. Therefore, when the touch panel unit 12 accepts the second operation, the display unit 11 can paste and display the object 8 (the last designated object 80) designated to be cut or copied immediately before the second operation. Good.

  Further, when the touch panel unit 12 receives the second operation in a state where there are a plurality of objects 8 to be cut or copied, the display unit 11 may display a selection screen 92 as shown in FIG. The display unit 11 displays the designated object 8 on the selection screen 92 after the MFP 100 is turned on, after returning from the power saving mode, or within a time that is a predetermined storage time from the current time. To do. For example, the display unit 11 displays information indicating the content of the designated object 80 on the selection screen 92, such as the designated time of each designated object 80 and the screen when designated. The display unit 11 may display the type of each designated object 80 (for example, the type of the electronic sticky note 81 or the data image 82).

  The user touches the display position of the designated object 80 to be pasted among the designated objects 80 displayed on the selection screen 92. When touched, the touch panel unit 12 accepts an instruction to execute pasting of the designated object 80 displayed at the touched position. Note that when the display position of the designated object 80 to be pasted is touched on the selection screen 92, it is necessary to once separate both of the touched points from the touch panel unit 12. For this reason, when the selection screen 92 is displayed, the touch panel unit 12 does not accept that the two points touched from the touch panel unit 12 are released as the pasting of the designated object 80.

  Next, an example of the flow of the pasting process of the designated object 80 will be described with reference to FIG. Note that FIG. 15 illustrates a case in which when a plurality of designated objects 80 are designated, the selection screen 92 is displayed instead of pasting the designated object 80 designated immediately before.

  First, in FIG. 15, after the main power is turned on, the designated object 80 has already been designated while the display unit 11 is displaying, and the two-point touch and the operation of expanding the two touched points (second) Operation) is received by the touch panel unit 12, and the panel control unit 10 recognizes that the second operation has been performed based on the output of the touch panel unit 12.

  Next, panel control unit 10 confirms whether or not dialog screen 91 should be displayed (step # 21). For example, if the second operation is assigned to an operation other than the pasting of the designated object 80 on the screen currently displayed on the display unit 11, the panel control unit 10 determines that the dialog screen 91 should be displayed. May be. Further, the panel control unit 10 may determine that the dialog screen 91 is not displayed within a predetermined time after the designated object 80 is designated.

  If the dialog screen 91 is to be displayed (Yes in step # 21), the panel control unit 10 causes the display unit 11 to display the dialog screen 91 (step # 22). Then, touch panel unit 12 accepts an instruction on dialog screen 91 (step # 23). Then, based on the output of the touch panel unit 12, the panel control unit 10 confirms whether or not the designated object 80 is pasted (step # 24).

  If pasting of the designated object 80 is not necessary (if the touch panel unit 12 accepts a touch at a position where “No” is displayed on the dialog screen 91, No in step # 24), this flow may be terminated. . On the other hand, when it is necessary to paste the designated object 80 (Yes in Step # 24) and when display of the dialog screen 91 is not necessary in Step # 21 (No in Step # 21), the panel control unit 10 stores the memory. 15 is checked to see if there are a plurality of designated objects 80 (step # 25).

  If there are a plurality of designated objects 80 (Yes in step # 25), panel control unit 10 causes selection screen 92 to be displayed on display unit 11 (step # 26). The touch panel unit 12 receives an input for selecting the designated object 80 to be pasted from the designated objects 80 displayed on the selection screen 92 (step # 27). Then, the panel control unit 10 definitely pastes and displays the selected designated object 80 on the screen (displays so as to paste, step # 28).

  The panel control unit 10 stores information on the pasted designated object 80 in the memory 15 (step # 29). Thus, until the pasted object 8 is cut off, the panel control unit 10 confirms the stored contents of the memory 15 so that the pasted object 8 is displayed each time the pasted screen is displayed. Is displayed. By step # 29, the pasting process of the designated object 80 ends (END).

  On the other hand, if there are not a plurality of designated objects 80 (No in step # 25), panel control unit 10 pastes designated object 80 on display unit 11 so as to overlap at least one of the two touched points. (Step # 210).

  Then, based on the amount and direction of movement of the touch position by the touch panel unit 12, the panel control unit 10 moves the display position of the pasted designated object 80 that has been pasted to the display unit 11 (step # 211). . For example, the panel control unit 10 obtains the movement amount and movement direction from the position (coordinates) of one point out of the two touched points immediately after the second operation, and is in an uncertain state as with the obtained movement amount and movement direction. The display position of the designated object 80 is moved to the display unit 11.

  The panel control unit 10 recognizes the confirmation of the pasted designated object 80 by accepting that the touched point on the touch panel unit 12 has disappeared (the finger has been released from the touch panel unit 12) (step S100). # 212). The panel control unit 10 stores information on the pasted designated object 80 in the memory 15 (step # 29).

  In this way, the display input device (operation panel 1) according to the present embodiment displays the screen and the image, and is the target of cutting, copying, and pasting. A display unit 11 that displays an object 8 that is an image, and is provided for the display unit 11, accepts user input, detects a plurality of touched positions, and narrows the interval between two touched points simultaneously. A touch panel unit 12 that receives the first operation and a second operation that widens the interval between two touched points at the same time, and the touch panel unit 12 is displayed at both or one of the two touched points. An input for designating the object 8 as the designated object 80 is accepted, a first operation is accepted as an input for instructing to cut or copy the designated object 80, and the second operation is designated. Accepted as paste instruction object 80, the screen being displayed when the display unit 11 is the pasting is instructed to display Paste specified object 80. As a result, it is possible to easily specify the object 8 and perform an intuitive finger operation (first operation) such as pinching to instruct cutting or copying. In addition, the specified object 80 can be pasted on the screen being displayed by an intuitive finger operation (second operation) such as unfolding. Therefore, it is possible to easily and intuitively move, copy and paste the designated object 80 to the screen that needs to be switched. In addition, the display input device can be easily used.

  The touch panel unit 12 accepts an input for instructing the cutting of the designated object 80 if the interval between the two points narrowed by the first operation is equal to or smaller than a predetermined threshold, and the two points narrowed by the first operation are two points narrowed. If the interval between the points exceeds the threshold, it is accepted as an input for instructing copying of the designated object 80, or if the interval between the two points narrowed by the first operation is equal to or smaller than a predetermined threshold, It is accepted as an input for instructing copying, and is accepted as an input for instructing cutting of the designated object 80 if the interval between the two points narrowed by the first operation exceeds a threshold value. Thereby, it is possible to select whether to perform cutting or copying based on the degree of movement (movement amount) of the two fingers used for the touch in the first operation. Therefore, there is no need to display a menu for selecting whether to cut or copy, or to select whether to cut or copy from the displayed menu, and it is easy to select whether to cut or copy. Can be done intuitively.

  When the second operation is performed, the display unit 11 displays a dialog screen 91 for confirming whether or not the designated object 80 is to be pasted, and accepts an input to the effect that the touch panel unit 12 pastes the designated object 80. When the touch panel unit 12 receives an input indicating that the designated object 80 is not pasted, the designated object 80 is not displayed on the displayed screen. Thereby, it can be confirmed in advance whether or not the designated object 80 is to be pasted, and unnecessary pasting of the designated object 80 can be eliminated.

  Further, when the second operation is assigned to an operation other than the pasting of the designated object 80, the display unit 11 displays a dialog screen 91. Thereby, when the second operation is performed for the purpose other than the pasting of the designated object 80, it is possible to prevent the pasting of the designated object 80 against the intention of the user. Therefore, it is possible to facilitate the pasting of the designated object 80 and the like.

  When the second operation is performed, the display unit 11 pastes the designated object 80 on the currently displayed screen without displaying the dialog screen 91 within a predetermined time after the designated object 80 is designated. Display. As a result, it is possible to prioritize the pasting of the designated object 80 within a short time after the designated object 80 is designated (within a predetermined time). Therefore, the designated object 80 can be pasted quickly and smoothly in a time zone where the possibility of pasting is high.

  In addition, when a plurality of designated objects 80 to be cut or copied are designated, when the instruction to paste the designated object 80 is given by the second operation, the display unit 11 is designated last on the screen being displayed. The designated object 80 is pasted and displayed. Thereby, it is possible to prevent a plurality of objects 8 including unnecessary objects from being pasted on the screen being displayed at once.

  In addition, when a plurality of designated objects 80 to be cut or copied are designated, when the designation operation 80 is instructed by the second operation, the display unit 11 designates the designation among the plurality of designated objects 80 to be pasted. A selection screen 92 for designating the object 80 is displayed, and the designation object 80 received as input by the touch panel unit 12 to be pasted on the selection screen 92 is pasted and displayed on the currently displayed screen. Thus, only the designated object 80 desired by the user among the plurality of designated objects 80 can be pasted on the screen being displayed.

  Further, when the display unit 11 performs pasting display of the designated object 80 based on the second operation, the touch panel unit 12 indicates that neither of the two points touched by the second operation is touched. The display unit 11 displays the designated object 80 for which the pasting has been confirmed each time the pasted screen is displayed. As a result, simply pasting the finger from the touch panel unit 12 makes it possible to intuitively and easily determine the pasting of the designated object 80 on the displayed screen.

  When the display unit 11 performs pasting display of the designated object 80 based on the second operation, the display unit 11 performs pasting display according to the movement amount and the movement direction of the two points touched by the second operation. The display position of the designated object 80 displayed by is moved. Thereby, the display position of the designated object 80 can be adjusted before the pasting to the screen being displayed is confirmed.

  Further, the image forming apparatus (multifunction device 100) includes the display input device (operation panel 1) according to the embodiment. The image forming apparatus (multifunction device 100) includes a display input device that is intuitive and easy to use for specifying the cut and copy of the object 8 and pasting the specified object 80. Therefore, it is possible to provide an image forming apparatus that is easy for the user to use.

  Next, another embodiment will be described. The panel control part 10 demonstrated the example which recognizes the one object 8 displayed in the position touched by 2 points | pieces as the designated object 80. FIG. However, the touch panel unit 12 may accept designation of a plurality of objects 8 by one two-point touch or one first operation. For example, by touching the two objects 8, the panel control unit 10 may recognize that the two objects 8 are designated based on the output of the touch panel unit 12. Alternatively, the panel control unit 10 may recognize that a plurality of objects 8 displayed on the locus of the touch position when the interval between the two touched points is narrowed are designated. At the time of pasting, the panel control unit 10 causes the display unit 11 to display all the objects 8 specified by the two-point touch and the first operation on the screen being displayed at a time. Also good.

  Although the embodiment of the present invention has been described, the scope of the present invention is not limited to this, and various modifications can be made without departing from the spirit of the invention.

  The present invention is applicable to a display input device having a display unit such as an operation panel and a touch panel unit, and an image forming apparatus.

100 MFP (image forming device) 1 Operation panel (display input device)
DESCRIPTION OF SYMBOLS 11 Display part 12 Touch panel part 8 Object 80 Designated object 81 Electronic sticky note 82 Data image 83 Folder image 91 Dialog screen 92 Selection screen

Claims (10)

A screen that displays an image, a display that displays an object that is the image to be cut, copied and pasted;
A touch panel unit that is provided for the display unit, receives a user's input, and detects a plurality of touched positions;
The touch panel unit accepts an input for designating the object as a designated object, and accepts an operation for widening the interval between two touched points as an instruction for pasting the designated object,
When the operation for expanding the interval between the two points touched at the same time is assigned to the operation other than the pasting of the designated object, and the operation for increasing the interval between the two points touched at the same time is performed, the display unit Displays a dialog screen for confirming whether or not to paste the specified object.   The touch panel unit accepts an input for instructing the cutting of the designated object if the interval between the two points narrowed by the operation of narrowing the interval between the two touched points is equal to or less than a predetermined threshold, and the two touched simultaneously. When the interval between two points that has been narrowed by the operation of narrowing the interval between two points exceeds the threshold, it is accepted as an input to instruct the copying of the designated object, or the operation to narrow the interval between two touched points simultaneously If the distance between the two narrowed points is equal to or less than a predetermined threshold, the input is accepted as an instruction to instruct the copying of the designated object, and the two points are narrowed by an operation for narrowing the distance between the two touched points simultaneously. 2. The method according to claim 1, wherein if the interval between the two points exceeds the threshold value, the input is accepted as an instruction to instruct to cut the designated object. Display and input device.   In a state where the display unit displays the dialog screen, when the touch panel unit receives an input indicating that the designated object is to be pasted, the designated object is pasted and displayed on the currently displayed screen, and the touch panel unit 3. The display input device according to claim 1, wherein when the input indicating that the designated object is not pasted is received, the designated object is not displayed on a screen being displayed.   The display unit is a screen for displaying a preview image for displaying the dialog screen, and the display unit displays a screen in which an operation for expanding the interval between two touched points is also assigned to an operation for enlarging the preview image. The display unit displays a dialog screen for confirming whether or not to paste the designated object when an operation of widening the interval between two points touched at the same time is performed in the displayed state. The display input device according to any one of claims 1 to 3.   When there is an operation to increase the interval between two touched points at the same time, the display unit displays the dialog screen without displaying the dialog screen within a predetermined time after the specified object is specified. The display input device according to claim 1, wherein the designated object is pasted and displayed on the screen. When a plurality of the designated objects to be cut or copied are designated, and there is an instruction to paste the designated object by an operation of widening the interval between two touched points at the same time,
The display input device according to claim 1, wherein the display unit pastes and displays the designated object last designated on a screen being displayed. When a plurality of the designated objects to be cut or copied are designated, and there is an instruction to paste the designated object by an operation of widening the interval between two touched points at the same time,
The display unit displays a selection screen for designating the designated object to be pasted among a plurality of the designated objects, and a screen on which the designated object that is input as the touch panel unit is pasted by the selection screen is displayed. The display input device according to claim 1, wherein the display input device is pasted and displayed on the display. When the display of the designated object is performed based on an operation of widening the interval between two points touched at the same time,
The touch panel unit accepts that the touch of the designated object is not touched on any of the two points touched by the operation of increasing the interval between the two touched points at the same time,
3. The display input device according to claim 1, wherein the display unit displays the designated object for which the pasting is confirmed every time the pasted screen is displayed. When the display of the designated object is performed based on an operation of widening the interval between two points touched at the same time,
The display unit moves a display position of the designated object displayed by pasting display according to a movement amount and a movement direction of two touched points by an operation of widening an interval between two touched points at the same time. The display input device according to any one of claims 1 to 8.   An image forming apparatus comprising the display input device according to claim 1.

Images