JP2014153773A - Information display apparatus, image forming apparatus, control method of information display apparatus, and control program of information display apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display apparatus with improved search operability, and an image forming apparatus, a control method of the information display apparatus, and a control program of the information display apparatus.SOLUTION: When a job list is displayed on a touch panel, an MFP (Multifunction Peripheral) detects first and second contact points where an operation unit touches the touch panel (Yes in S101), and acquires a search item on the basis of coordinates of the first contact point at least (S107). When detecting multi-touch operation (Yes in S111) after detecting the first and second contact points, the MFP 1 performs searching on the basis of the acquired search item (S113).

Description

  The present invention relates to an information display device, an image forming device, a control method for the information display device, and a control program for the information display device, and more specifically, an information display device for displaying information including a plurality of items on a touch panel, and image formation The present invention relates to a device, a control method for an information display device, and a control program for the information display device.

  2. Description of the Related Art Today, an MFP (Multifunction Peripheral) is usually provided with an input device that accepts user operations. As one of the input devices, there is a touch panel that detects an input as an input when a user touches (touches) an area where an image is displayed with an operation unit such as a finger. The touch panel is employed in the operation panel of the MFP.

  According to the touch panel, the user can perform an operation by directly touching the display screen displayed on the touch panel, so that an intuitive operation is possible and high operability is realized.

  In recent years, touch panel technology has evolved due to the widespread use of smartphones, tablet terminals, and the like, and multi-touch operation, which is an operation of bringing an operation unit into contact with a plurality of positions on the touch panel, is possible on the touch panel.

  The MFP stores various information such as e-mail and facsimile destinations, saved data, and jobs. When performing an operation using these pieces of information, the user displays a list including information to be used on the touch panel and selects information to be used from the list.

  However, when a large number of users use the MFP in an office environment or the like, a large amount of the above information may be stored in the MFP. In such a case, the user needs to search the list for information to be used. As a method for searching for information used by the user from the list, there is a method of causing the MFP to execute a search process in addition to a method of searching by visual check.

  For example, Patent Document 1 below discloses a technique for searching for a specific key object from among group objects including a plurality of item objects. Specifically, in Patent Document 1 below, the input detection unit detects an operation (drag) for moving a key object that abstracts a condition for narrowing down items to a search key box object that can include a plurality of key objects. If a search condition is created based on the moved key object, and the input detection unit detects a contact to the search key box object and a movement instruction (drag) toward the group object in the contact state A technique for obtaining a logical operation result for a key object included in a search key box object is disclosed.

  According to the technology disclosed in Patent Document 1 below, a search condition is set by dragging a specific key object serving as a search keyword to a search key box object on the display screen, and the search key box object is dragged toward the group object. As a result, a logical operation result is obtained. Further, by dragging a key object serving as an additional search keyword to a search key box object, a more detailed search is executed. Thereby, the user can operate intuitively by drag operation.

JP 2011-34151 A

  However, the technique of Patent Document 1 has a problem that many operations are required to perform a search, and operability when performing a search is poor.

  Specifically, in order to set the search keyword, it is necessary to drag the key object to the search key box object, not just to select the key object to be the search keyword. For this reason, when the key object is located away from the search key box object, the user has to drag the key object for a long distance. In addition, when performing a more detailed and advanced search, it is necessary to drag a plurality of key objects serving as search keywords to the search key box objects, which increases the number of operations. Further, after the search keyword is set, in order to execute the search, it is necessary to further drag the search key box object.

  The problem of poor operability when performing a search is not a problem specific to the touch panel of the MFP, but is a problem common to information display devices that display information including a plurality of items on the touch panel.

  SUMMARY An advantage of some aspects of the invention is that an information display apparatus, an image forming apparatus, a control method for the information display apparatus, and an information display capable of improving operability when performing a search are provided. It is to provide a device control program.

  An information display device according to one aspect of the present invention includes a touch panel, a display unit that displays a screen including a plurality of items on the touch panel, and the operation unit touches the touch panel when the display unit displays the screen. Contact point detection means for detecting first and second contact points that are points, search item acquisition means for acquiring a search item from a plurality of items based on at least the coordinates of the first contact point, and contact After the first and second contact points are detected by the point detection means, a multi-touch operation that is an operation for changing the coordinates of at least one of the contact points detected by the contact point detection means is detected. Multi-touch detection means and search means for performing a search based on the search item acquired by the search item acquisition means when a multi-touch operation is detected by the multi-touch detection means.

  Preferably, in the information display device, the multi-touch detection unit detects an operation for changing at least one of the coordinates of the first and second contact points as a multi-touch operation.

  Preferably, in the information display device, the first contact point is a contact point detected by the contact point detection unit before the second contact point, and the search item acquisition unit uses the coordinates of the first contact point. Get the displayed item as a search item.

  Preferably, in the above information display device, the search item acquisition means further acquires an item displayed at the coordinates of the second contact point as a search item.

  Preferably, in the information display device, the contact point detection unit further detects a third contact point that is a point where the operation unit has touched the touch panel in addition to the first and second contact points, and the search item acquisition unit includes: The item displayed at the coordinates of the third contact point is further acquired as a search item.

  Preferably, in the above information display device, when a table in which a plurality of items are arranged in a row direction and a column direction is displayed on the touch panel, the search item acquisition unit includes the coordinates of the first contact point and the second contact point. An item displayed on a straight line connecting the coordinates of the point, an item displayed between the row direction coordinate of the first contact point and the row direction coordinate of the second contact point, and the first At least one of the items displayed between the coordinate in the column direction of the contact point and the coordinate in the column direction of the second contact point is acquired as a search item.

  Preferably, in the information display device, the search item acquisition unit acquires at least one item as a search item when no item is displayed at any of the coordinates of the first and second contact points.

  Preferably, in the above information display device, the search means performs a search under a search condition corresponding to the type of multi-touch operation detected by the multi-touch detection means.

  Preferably, in the above information display device, when the multi-touch operation that reduces the distance between the first contact point and the second contact point is detected by the multi-touch detection unit, the search unit performs a search using the first search condition. When the multi-touch operation that increases the distance between the first contact point and the second contact point is detected by the multi-touch detection means, the search means performs a search with a second search condition that is different from the first search condition. Do.

  Preferably, the information display device further includes search condition setting means for setting first and second search conditions.

  An image forming apparatus according to another aspect of the present invention provides an image based on the above information display device, an instruction receiving unit that receives a print execution instruction through a touch panel of the information display device, and an execution instruction received by the instruction receiving unit. Image forming means for forming.

  A control method for an information display device according to still another aspect of the present invention is a control method for an information display device including a touch panel, and includes a display step for displaying a screen including a plurality of items on the touch panel, and a screen in the display step. Is displayed on the basis of the contact point detection step of detecting the first and second contact points that are points where the operation unit has touched the touch panel, and at least the coordinates of the first contact point. After detecting the first and second contact points in the search item acquisition step acquired from the plurality of items and the contact point detection step, at least one contact among the contact points detected in the contact point detection step When a multi-touch operation that detects a multi-touch operation, which is an operation that changes the coordinates of a point, And a search step of performing a search based on the search items acquired by search item retrieval step.

  A control program for an information display device according to still another aspect of the present invention is a control program for an information display device including a touch panel, and includes a display step for displaying a screen including a plurality of items on the touch panel, and a screen in the display step. Is displayed on the basis of the contact point detection step of detecting the first and second contact points that are points where the operation unit has touched the touch panel, and at least the coordinates of the first contact point. After detecting the first and second contact points in the search item acquisition step acquired from the plurality of items and the contact point detection step, at least one contact among the contact points detected in the contact point detection step A multi-touch detection step that detects a multi-touch operation that changes the coordinates of a point, and a multi-touch operation is detected in the multi-touch detection step If to execute a search step of performing a search based on the search items acquired by the search item retrieval step to the computer.

  According to the present invention, it is possible to provide an information display device, an image forming apparatus, an information display device control method, and an information display device control program capable of improving operability when performing a search.

1 is a diagram schematically showing an appearance of an MFP 1 according to an embodiment of the present invention. 2 is a block diagram showing an internal configuration of the MFP 1. FIG. 6 is a diagram schematically showing a screen of a job list displayed on touch panel 101. FIG. It is a figure which shows multi-touch operation exemplarily. FIG. 5 is a diagram schematically showing user operations and search results when the MFP 1 executes a first search method. 6 is a flowchart when the MFP 1 performs a search process using a first search method. FIG. 6 is a diagram schematically showing user operations and search results when the MFP 1 executes a second search method. FIG. 10 is a diagram schematically showing a user operation and a search result when accepting setting of a further search item when the MFP 1 executes the second search method. 6 is a flowchart when the MFP 1 performs a search process using a second search method. FIG. 10 is a diagram schematically illustrating a first example of user operations and search results when the MFP 1 executes a third search method. FIG. 10 is a diagram schematically illustrating a second example of user operations and search results when the MFP 1 executes a third search method. 10 is a flowchart when the MFP 1 performs a search process using a third search method. 6 is a diagram schematically showing a search condition setting screen displayed on the touch panel 101. FIG. FIG. 10 is a diagram schematically illustrating a first example of user operations and search results when the MFP 1 executes a fourth search method. FIG. 10 is a diagram schematically illustrating a second example of user operations and search results when the MFP 1 executes a fourth search method. 10 is a flowchart in a case where the MFP 1 performs a search process using a fourth search method. 4 is a diagram schematically showing a screen of a file list LD displayed on the touch panel 101. FIG.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  In the following embodiments, a case where the information display device is an MFP will be described. However, the information display device may be an image forming apparatus other than the MFP, such as a facsimile machine, a copier, or a printer. The information display device may be other than the image forming device, and may be a tablet, a PC (Personal Computer), a mobile phone, or the like.

  [Configuration of Image Forming Apparatus]

  First, the configuration of the image forming apparatus in the present embodiment will be described.

  FIG. 1 is a diagram schematically showing the appearance of the MFP 1 according to an embodiment of the present invention. In FIG. 1, an operation panel 100 of the MFP is shown enlarged.

  Referring to FIG. 1, MFP 1 as an information display device includes operation panel 100 on the front surface thereof. The operation panel 100 includes a touch panel 101 and a plurality of hardware keys 102. Based on the touch received from the user through the operation panel 100, the MFP 1 executes various processes.

  FIG. 2 is a block diagram showing the internal configuration of the MFP 1.

  Referring to FIG. 2, MFP 1 includes a main control unit 10, an LCD (Liquid Crystal Display) driving circuit 21, a touch panel controller 22, a contact point acquisition unit 23, a multi-touch determination unit 24, and an information acquisition unit 25. A search item setting unit 26, a search condition setting unit 27, a search processing unit 28, an image processing unit 29, an image forming unit 30, an LCD 41, and a touch panel detection unit 42.

  The main control unit 10 comprehensively controls the operation of each unit of the MFP 1. The main control unit 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, and a storage unit 14. The CPU 11 reads a necessary program from the ROM 12 and performs overall control of the MFP 1 according to the program. The ROM 12 stores various programs. The RAM 13 is a work area for the CPU 11. The storage unit 14 is an HDD (Hard Disk Drive), for example, and stores various information such as a job list.

  The touch panel 101 includes an LCD 41 and a touch panel detector 42. The LCD 41 is a display unit of the touch panel 101 and displays various information. The touch panel detection unit 42 is an input detection unit of the touch panel 101 and detects a touch (contact) of the operation unit on the touch panel 101.

  The LCD drive circuit 21 drives the LCD 41 and displays a screen based on the data created by the image processing unit 29 on the LCD 41. When the touch panel detection unit 42 detects a touch, the touch panel controller 22 sends touch information (touch detection and contact point coordinates) to the main control unit 10. The contact point acquisition unit 23 acquires touch information from the touch panel controller 22. The multi-touch determination unit 24 determines whether the touch detected by the touch panel detection unit 42 is a multi-touch operation based on the information acquired by the contact point acquisition unit 23. Details of the multi-touch operation will be described later with reference to FIG. The information acquisition unit 25 acquires items displayed at the coordinates of the contact points based on the information acquired by the contact point acquisition unit 23. The search item setting unit 26 sets the item acquired by the information acquisition unit 25 as a search item (search keyword). The search condition setting unit 27 sets search conditions (AND search and OR search) according to the type of multi-touch operation. The search processing unit 28 performs search processing based on the search items set by the search item setting unit 26 and the search conditions set by the search condition setting unit 27.

  When an image execution instruction is received through the touch panel 101, the image processing unit 29 creates print data of an image to be printed based on the execution instruction. Further, the image processing unit 29 creates screen data to be displayed on the LCD 41.

  The image forming unit 30 forms an image on recording paper based on the print data created by the image processing unit 29. The image forming unit 30 is roughly composed of a toner image forming unit, a fixing device, a paper transport unit, and the like. The image forming unit 30 forms an image on a sheet by, for example, electrophotography. The toner image forming unit combines four color images by a so-called tandem method, and forms a color image on a sheet (recording medium). The toner image forming unit includes a photoconductor provided for each color of C (cyan), M (magenta), Y (yellow), and K (black), and an intermediate in which a toner image is transferred (primary transfer) from the photoconductor. The image forming apparatus includes a transfer belt and a transfer unit that transfers an image from the intermediate transfer belt to a sheet (secondary transfer). The fixing device has a heating roller and a pressure roller. The fixing device conveys the sheet on which the toner image is formed between the heating roller and the pressure roller, and heats and presses the sheet. As a result, the fixing device melts the toner adhering to the paper and fixes it on the paper to form an image on the paper. The paper transport unit includes a paper feed roller, a transport roller, and a motor that drives them. The paper transport unit feeds paper from the paper feed cassette and transports it inside the housing of the MFP 1. The paper transport unit discharges the paper on which the image is formed from the housing of the MFP 1 to a paper discharge tray or the like.

  FIG. 3 is a diagram schematically illustrating a job list screen displayed on the touch panel 101.

  Referring to FIG. 3, job list screen including information on jobs executed in the past by MFP 1 is displayed on touch panel 101. The job list is a table in which a plurality of items are arranged in the row direction and the column direction, respectively. When the MFP 1 executes a job, it adds each item constituting the job information to the job list. At the top of the job list, there are arranged tabs (item tabs) 201 indicating item types such as “user”, “job type”, “destination”, “number of sheets”, and “acceptance time”. On the second and subsequent levels of the job list, the information 202 of each job is arranged from top to bottom in order of old reception time. For example, in the second row of the job list, information of “10 sheets” “copy jobs” executed by the person “A” at “12:00” is displayed. In other words, items “A”, “Copy”, “10”, and “12:00” are displayed in the second row of the job list.

  In this example, the job list includes item tabs of “User”, “Job Type”, “Destination”, “Number of Sheets”, and “Reception Time”, but the types of item tabs are limited to this. Is not to be done. Also, the screen shown in FIG. 3 is an example, and the screen displayed on the touch panel 101 only needs to include a plurality of items, and the arrangement state of each item is arbitrary.

  Subsequently, first to fourth search methods executed by the MFP 1 in the present embodiment will be described in order. In the first to fourth search methods, when the MFP 1 displays the screen shown in FIG. 3 on the touch panel 101, the MFP 1 detects the first and second contact points that are points where the operation unit touches the touch panel 101. Then, based on at least the coordinates of the first contact point, the search item is acquired from the plurality of items. When the MFP 1 detects a multi-touch operation after detecting the first and second contact points, the MFP 1 performs a search based on the acquired search item.

  In the following description, the user's index finger is assumed as the operation unit P1, the user's thumb is assumed as the operation unit P2, and the user's middle finger is assumed as the operation unit P3. Further, it is assumed that touch panel 101 detects contact with touch panel 101 in the order of operation unit P1, operation unit P2, and operation unit P3. The operation unit may be an operation bar or the like in addition to the user's finger as described above.

  Prior to describing the first to fourth search methods, the multi-touch operation will be described.

  FIG. 4 is a diagram illustrating a multi-touch operation as an example.

  Referring to FIG. 4, the multi-touch operation is detected by touch panel detection unit 42 when touch panel detection unit 42 detects at least contact points (first and second contact points) of operation units P1 and P2. This is an operation for changing the coordinates of at least one of the contact points. In the multi-touch operation, as shown in (a), after touching the touch panel 101 with each of the operation units P1 and P2, the operation is performed so as to shorten the distance between the contact point of the operation unit P1 and the contact point of the operation unit P2. It may be an operation of moving each of the parts P1 and P2 (that is, pinch-in by the operating parts P1 and P2), or after touching the touch panel 101 with each of the operating parts P1 and P2, as shown in FIG. Thus, an operation of moving each of the operation units P1 and P2 so as to increase the distance between the contact point of the operation unit P1 and the contact point of the operation unit P2 (that is, pinch out by the operation units P1 and P2) may be performed. . Further, as shown in (c), the multi-touch operation is performed by touching the touch panel 101 with each of the operation units P1 and P2, and then the contact point of one of the operation units P1 and P2 (here, the operation unit P1). The contact point of the other operation unit (here, the contact point of the operation unit P2) (ie, rotation by the operation units P1 and P2), or (d) As shown in FIG. 4, after touching the touch panel 101 with each of the operation units P1 and P2, only the contact point of one of the operation units P1 and P2 (here, the contact point of the operation unit P2) is set in an arbitrary direction. It may be an operation to move to (that is, a flick by the operation unit P2). Furthermore, the multi-touch operation is an operation in which at least one of the coordinates of the contact point of the operation unit P1 and the coordinate of the contact point of the operation unit P2 is changed as shown in (a) to (d). In addition, as shown in (e), after touching the touch panel 101 with each of the operation units P1, P2, and P3, the contact point of at least one operation unit among the operation units P1, P2, and P3 ( Here, an operation of moving the contact point of the operation unit P3) in an arbitrary direction (that is, a flick by the operation unit P3) may be used. In the case of (e), an operation unit that is not used for the multi-touch operation may be separated from the touch panel 101 during the multi-touch operation.

  In general, pinch-in and pinch-out are operations used for image reduction and enlargement, respectively. To prevent confusion with operations performed to reduce and enlarge images, pinch-in and pinch-out are detected as multi-touch operations only when an image that does not accept reduction and enlargement is displayed. It is preferable.

  [First search method]

  In the first search method, when a multi-touch operation is detected after detecting each contact point of the operation units P1 and P2, the item displayed at the coordinates of the contact point of the operation unit P1 is used as a search item. To get.

  FIG. 5 is a diagram schematically showing user operations and search results when the MFP 1 executes the first search method.

  Referring to FIG. 5A, assume that job information including an item “A” is searched from a job list. In this case, the user sets the item “A” as a search item by touching the item “A” in the job list with the operation unit P1. Next, the user touches an arbitrary position (the item “C” in this case) of the touch panel 101 with the operation unit P2 while touching the operation unit P1, for example, a contact point of the operation unit P1 and a contact point of the operation unit P2. The MFP 1 is caused to execute a search by performing a pinch-in (an example of a multi-touch operation) that changes both of the coordinates.

  When the MFP 1 detects the above-described operation, the item “A” displayed in the coordinates of the contact point of the operation unit P1 is set as a search item, and a search is performed based on the search item. As a result, as shown in FIG. 6B, information of four jobs related to “A” is extracted from the job list and displayed as a search result.

  In the subsequent first to fourth search methods, when the touch panel 101 is touched, the MFP 1 sets the touch panel 101 for a certain period of time instead of setting the item displayed at the coordinates of the touch point of the touch as the search item. When an operation to continue touching is detected, an item displayed at the coordinates of the touch point of the touch may be set as a search item.

  In the first search method, since the touch on the operation unit P2 is performed after the touch on the operation unit P1, the item “C” touched on the operation unit P2 is a search item. Not set to However, an item touched by the operation unit P2 may be set as a search item, and when an operation of continuing touching for a predetermined time or longer is detected by the operation unit P2, the item is displayed at the coordinates of the contact point. An item may be set as a search item.

  FIG. 6 is a flowchart when the MFP 1 performs a search process using the first search method.

  Referring to FIG. 6, when CPU 11 of MFP 1 displays a list including a plurality of items on touch panel 101 (S <b> 100), CPU 11 determines whether touch panel at least one touch on touch panel 101 has been detected by touch panel detection unit 42. (S101). The CPU 11 repeats the process of step S101 until it is determined that a touch has been detected.

  If it is determined in step S101 that a touch on at least one point has been detected (Yes in S101), the CPU 11 obtains touch information including touch point coordinates (touched coordinates) on the touch panel 101. It acquires using the part 23 (S103). Next, the CPU 11 detects the first contact point (the touch point detected first when the touch panel detection unit 42 detects a touch to two or more points, and the touch panel detection unit 42 detects a touch to one point. It is determined whether or not an item is displayed at the coordinates of the contact point (S105).

  If it is determined in step S105 that the item is displayed at the coordinates of the first contact point (Yes in S105), the CPU 11 acquires the displayed item using the information acquisition unit 25 (S107). The item is set as a search item using the search item setting unit 26 (S109), and the process proceeds to step S111. On the other hand, if it is determined in step S105 that no item is displayed at the coordinates of the first contact point (No in S105), the CPU 11 ends without executing the search process because there is no search item.

  In step S111, the CPU 11 determines whether or not a multi-touch operation has been detected by the touch panel detection unit 42 (S111). The CPU 11 repeats the process of step S111 until it is determined that a multi-touch operation has been detected.

  If it is determined in step S111 that a multi-touch operation has been detected (Yes in S111), the CPU 11 is based on the search item set by the search item setting unit 26 and the search condition set by the search condition setting unit 27. The search process is executed (S113). Thereafter, the CPU 11 displays the search result on the touch panel 101 (S115) and ends the process.

  [Second search method]

  In the second search method, when the multi-touch operation is detected after detecting the contact points of the operation units P1 and P2, the operation unit is displayed together with the items displayed at the coordinates of the contact points of the operation unit P1. The item displayed at the coordinates of the contact point P2 is acquired as a search item.

  FIG. 7 is a diagram schematically showing user operations and search results when the MFP 1 executes the second search method.

  With reference to FIG. 7A, a case is assumed in which job information including at least one item of “A” and “copy” is searched from the job list. In this case, the user touches the item “A” in the job list with one of the operation units P1 and P2, and touches the item “copy” with the other operation unit, thereby “A” and “ Set the “Copy” item as the search item. Next, the user causes the MFP 1 to execute a search by performing a flick (an example of a multi-touch operation) that changes the coordinates of the contact point of the operation unit P1.

  When the MFP 1 detects the above-described operation, it sets two items “A” and “copy” displayed at the coordinates of the contact points of the operation units P1 and P2 as search items. Perform an OR search. As a result, as shown in FIG. 7B, information of six jobs related to at least one of “A” and “copy” is extracted from the job list and displayed as a search result.

  In the following second to fourth search methods, as described below, settings of further search items (three or more search items) may be accepted.

  FIG. 8 is a diagram schematically showing user operations and search results when the MFP 1 executes the second search method and accepts further search item settings.

  Referring to FIG. 8A, a case is assumed in which job information including at least one item of “A”, “copy”, and “B” is searched from the job list. In this case, the user touches each item of “A”, “B”, and “copy” in the job list with each of the operation units P1, P2, and P3, thereby “A”, “B”, and Set “Copy” as the search item. Each of the operation units P1, P2, and P3 may touch any item among “A”, “B”, and “copy”. Next, the user causes the MFP 1 to execute a search by performing a pinch-in (an example of a multi-touch operation) that changes the coordinates of both the contact point of the operation unit P2 and the contact point of the operation unit P3. When performing a multi-touch operation, an operation unit (in this case, the operation unit P1) that does not perform the multi-touch operation may be separated from the touch panel 101 or may remain in contact with the touch panel 101.

  When MFP 1 detects the above-described operation, it sets three items “A”, “B”, and “copy” displayed at the coordinates of the contact points of operation units P1, P2, and P3 as search items. Then, an OR search is performed for these search items. As a result, as shown in FIG. 8B, information on seven jobs related to at least one of “A”, “B”, and “copy” is extracted from the job list as a search result. Displayed.

  Note that when the touch panel detection unit 42 detects that four or more operation units have touched the touch panel 101, the MFP 1 may set search items based on the coordinates of the respective contact units.

  FIG. 9 is a flowchart in the case where the MFP 1 performs a search process using the second search method.

  Referring to FIG. 9, when CPU 11 of MFP 1 displays a list including a plurality of items on touch panel 101 (S <b> 200), CPU 11 determines whether touch on two points on touch panel 101 has been detected by touch panel detection unit 42. (S201). The CPU 11 repeats the process of step S201 until it is determined that a touch has been detected.

  If it is determined in step S201 that a touch on two points has been detected (Yes in S201), the CPU 11 determines the touch information including the coordinates (touched coordinates) of the two touch points on the touch panel 101 as touch points. Obtained using the obtaining unit 23 (S203). Next, the CPU 11 determines whether or not an item is displayed at at least one of the acquired coordinates (S205).

  If it is determined in step S205 that an item is displayed at least at one coordinate (Yes in S205), the CPU 11 uses the information acquisition unit 25 to acquire the displayed item (S207) The item is set as a search item using the item setting unit 26 (S209), and the process proceeds to step S211. On the other hand, if it is determined in step S205 that no item is displayed at any coordinate (No in S205), the CPU 11 proceeds to the process of step S211.

  In step S211, the CPU 11 determines whether or not a new contact point (added touch) is detected by the touch panel detection unit 42 in addition to the contact point detected in step S201 (S211).

  If it is determined in step S211 that a new contact point is detected (No in S211), the CPU 11 proceeds to the process of step S203, acquires the coordinates of the new contact point, and displays the coordinates of the contact point. To get more items as search items.

  If it is determined in step S211 that a new contact point has not been detected (Yes in S211), the CPU 11 changes the coordinates of at least one of the contact points detected by the touch panel detection unit 42. It is determined whether or not a touch operation has been detected by the touch panel detector 42 (S213).

  If it is determined in step S213 that a multi-touch operation has been detected (Yes in S213), the CPU 11 is based on the search item set by the search item setting unit 26 and the search condition set by the search condition setting unit 27. The search process is executed (S215). In step S215, if no search item is set, the CPU 11 may display an error. Thereafter, the CPU 11 displays the search result on the touch panel 101 (S217) and ends the process.

  If it is determined in step S213 that the multi-touch operation is not detected (No in S213), the CPU 11 proceeds to the process in step S211 and determines whether or not a new touch point is detected by the touch panel detection unit 42. .

  Note that the MFP 1 may accept the addition of the search item after detecting the multi-touch operation instead of accepting the addition of the search item before detecting the multi-touch operation as described above. Specifically, when the MFP 1 detects a multi-touch operation, the MFP 1 displays a message such as “Please select a search item to add” on the touch panel 101 and then displays the detected touch at the coordinates of the touch point. Items may be added as search items.

  In the above description, when two or more search items are set in the MFP 1, an OR search is performed for those search items. However, in the MFP 1, two or more search items are set. AND search of those search items may be performed.

  [Third search method]

  In the third search method, when the multi-touch operation is detected after detecting the contact points of the operation units P1 and P2, items existing between the coordinates of the contact points of the operation units P1 and P2 are determined. It is acquired as a search item.

  “Items existing between the coordinates of the contact points of the operation units P1 and P2” are displayed on the touch panel 101 on a straight line connecting the coordinates of the contact point of the operation unit P1 and the coordinates of the contact point of the operation unit P2. Or an item displayed on the touch panel 101 between the coordinates in the row direction of the contact point of the operation unit P1 and the coordinates in the row direction of the contact point of the operation unit P2. The item displayed between the coordinate in the column direction of the contact point of the operation unit P1 and the coordinate in the column direction of the contact point of the operation unit P2 may be used. Or these items may be combined.

  FIG. 10 is a diagram schematically illustrating a first example of user operations and search results when the MFP 1 executes the third search method.

  Referring to FIG. 10, at least one of the items “A”, “Copy”, “10”, and “12:00” of the job information displayed in the second row of the job list. Assume that the job list including job information is searched from the job list. In this case, the user uses the operation unit P1 and the operation unit P2 to display the job list displayed at the second level of the job list at each point where items in the job list are not displayed (here, outside the frame of the job list). By touching each point that sandwiches this information, each item of job information displayed in the second row of the job list is set as a search item. Next, the user causes the MFP 1 to perform a search by performing a pinch-in (an example of a multi-touch operation) that changes the coordinates of both the contact point of the operation unit P1 and the contact point of the operation unit P2.

  When the MFP 1 detects the above-described operation, the job information displayed between the coordinate in the column direction (vertical direction in the figure) of the contact point of the operation unit P1 and the coordinate in the column direction of the contact point of the operation unit P2 is displayed. The four items “A”, “copy”, “10”, and “12:00”, which are items, are set as search items, and an OR search is performed on these search items. As a result, as shown in FIG. 10B, as the search result, information on six jobs related to at least one of “A”, “copy”, “10”, and “12:00”. Is extracted from the job list and displayed.

  FIG. 11 is a diagram schematically illustrating a second example of a user operation and a search result when the MFP 1 executes the third search method.

  Referring to FIG. 11, a case is assumed in which job information including at least one item of “B” and “D” is searched from the job list. In this case, the user uses the operation unit P1 and the operation unit P2 to display each point where no item is displayed (here, a point between the second and third levels of the job list and a fourth level of the job list). Between the item “B” displayed on the second level of the job list and the item “D” displayed on the third level of the job list. By touching each point, the items “B” and “D” are set as search items. Next, the user causes the MFP 1 to perform a search by performing a pinch-in (an example of a multi-touch operation) that changes the coordinates of both the contact point of the operation unit P1 and the contact point of the operation unit P2.

  When the MFP 1 detects the above-described operation, the MFP 1 detects two items “B” and “D” which are items displayed on the straight line L connecting the coordinates of the contact point of the operation unit P1 and the coordinates of the contact point of the operation unit P2. Items are set as search items, and an OR search is performed on these search items. As a result, as shown in FIG. 11B, information on four jobs related to at least one of “B” and “D” is extracted from the job list and displayed as a search result.

  In the third search method, as described above, the coordinates of the contact points of the operation parts P1 and P2 are only displayed when no item is displayed at any of the coordinates of the contact points of the operation parts P1 and P2. An item existing between them may be added to the search item, and when the item is displayed at the coordinates of at least one of the contact points of the operation units P1 and P2, the item is displayed as the operation unit P1 and You may set as a search item with the item which exists between the coordinates of the contact point of P2. In the third search method, an AND search of a plurality of items may be performed, or an OR search may be performed.

  The third search method may be executed when a multi-touch operation is detected in a state where a table in which a plurality of items are arranged in the row direction and the column direction is displayed on the touch panel 101, as shown in FIG. The present invention is not limited to the case where the job list screen is displayed.

  FIG. 12 is a flowchart when the MFP 1 performs a search process using the third search method.

  Referring to FIG. 12, when CPU 11 of MFP 1 displays a list including a plurality of items on touch panel 101 (S300), CPU 11 determines whether touch on touch panel 101 at two points has been detected by touch panel detector 42 or not. (S301). The CPU 11 repeats the process of step S301 until it is determined that a touch has been detected.

  If it is determined in step S301 that a touch on two points has been detected (Yes in S301), the CPU 11 determines the touch information including the coordinates (touched coordinates) of the two touch points on the touch panel 101 as touch points. Obtained using the obtaining unit 23 (S303). Next, the CPU 11 determines whether or not an item is displayed on any of the coordinates of the two contact points (first and second contact points) (S305).

  If it is determined in step S305 that no item is displayed on any of the coordinates of the two contact points (Yes in S305), the CPU 11 has an item displayed between the coordinates of the two contact points. Whether or not (S307).

  If it is determined in step S307 that there is an item displayed between the coordinates of the two contact points (Yes in S307), the CPU 11 uses the information acquisition unit 25 to locate the coordinates between the two contact points. The displayed item is acquired (S309), the search item setting unit 26 is used to set the item as a search item (S311), and the process proceeds to step S313. On the other hand, if it is determined in step S307 that there is no item displayed between the coordinates of the two contact points (No in S307), the CPU 11 ends without executing the search process because there is no search item. To do.

  If it is determined in step S305 that the item is displayed at least one of the coordinates of the two contact points (No in S305), the CPU 11 acquires the displayed item using the information acquisition unit 25. In step S321, the search item setting unit 26 is used to set the item as a search item. Subsequently, the CPU 11 determines whether or not a new contact point (added touch) other than the contact point detected in step S301 is detected by the touch panel detection unit 42 (S325).

  If it is determined in step S325 that a new contact point is detected (No in S325), the CPU 11 proceeds to the process of step S303, and acquires the coordinates of the new contact point. On the other hand, if it is determined in step S325 that a new contact point has not been detected (Yes in S325), the CPU 11 proceeds to the process of step S313.

  In step S <b> 313, the CPU 11 determines whether or not the touch panel detection unit 42 has detected a multi-touch operation that changes the coordinates of at least one of the two contact units detected by the touch panel detection unit 42. (S313). The CPU 11 repeats the process of step S313 until it is determined that a multi-touch operation has been detected.

  If it is determined in step S313 that a multi-touch operation has been detected (Yes in S313), the CPU 11 is based on the search item set by the search item setting unit 26 and the search condition set by the search condition setting unit 27. The search process is executed (S315). Thereafter, the CPU 11 displays the search result on the touch panel 101 (S317) and ends the process.

  [Fourth search method]

  In the fourth search method, when a multi-touch operation is detected after detecting each contact point of the operation units P1 and P2, a search is performed with a search condition corresponding to the type of the detected multi-touch operation. is there.

  Here, a case where one of AND search and OR search is performed when pinch-in is detected as a multi-touch operation, and the other of AND search and OR search is performed when pinch-out is detected as a multi-touch operation is described. To do.

  For example, the MFP 1 may accept input of search condition settings according to the type of multi-touch operation from the user through a search condition setting screen displayed on the touch panel 101, and may set the search conditions based on the received input. .

  FIG. 13 is a diagram schematically showing a search condition setting screen displayed on the touch panel 101.

  Referring to FIG. 13, the search condition setting screen is displayed when, for example, a specific operation (for example, a long press of a specific key) is performed on the operation panel. The search condition setting screen includes boxes 203 and 204, a “change” key 205, an “OK” key 206, and a “cancel” key 207. Each of the boxes 203 and 204 displays the type of multi-touch operation for performing AND search and OR search, respectively. In FIG. 13, characters “Pinch In” are displayed in the box 203, and characters “Pinch Out” are displayed in the box 204.

  When the touch panel detection unit 42 detects a touch on the “change” key 205, the MFP 1 switches the display of “pinch-in” and “pinch-out” displayed in each of the boxes 203 and 204. When the touch on the “OK” key 205 is detected by the touch panel detection unit 42, the MFP 1 sets the multi-touch operation displayed in the box 203 at that time as a multi-touch operation for performing an AND search, and at that time the box The multi-touch operation displayed in 204 is set as a multi-touch operation for performing an OR search. When the touch panel detection unit 42 detects a touch on the “cancel” key 207, the MFP 1 ends the search condition setting screen display without changing the search condition setting.

  In the following description of the fourth search method, a case where a pinch-in is set as a multi-touch operation for performing an AND search and a pinch-out is set as a multi-touch operation for performing an OR search. explain.

  FIG. 14 is a diagram schematically illustrating a first example of user operations and search results when the MFP 1 executes the fourth search method.

  Referring to FIG. 14A, assume a case where an AND search is performed on items “A” and “copy”. In this case, the user touches the item “A” in the job list with one of the operation units P1 and P2, and touches the item “copy” with the other operation unit, whereby “A” and Set “Copy” as the search item. Next, the user causes MFP 1 to execute a search by performing a pinch-in (an example of a multi-touch operation) starting from the contact point of operation unit P1 and the contact point of operation unit P2.

  When the MFP 1 detects the above-described operation, it sets two items “A” and “copy” displayed at the coordinates of the contact points of the operation units P1 and P2 as search items. Perform an AND search. As a result, as shown in FIG. 14B, information on one job related to both “A” and “copy” is extracted from the job list and displayed as a search result.

  FIG. 15 is a diagram schematically illustrating a second example of user operations and search results when the MFP 1 executes the fourth search method.

  Referring to FIG. 15A, assume a case where an OR search is performed on items “A” and “copy”. In this case, the user touches the item “A” on one of the operation units P1 and P2, and touches the “copy” item on the other operation unit, thereby allowing “A” and “copy” items to be displayed. Set the item as a search item. Next, the user causes MFP 1 to execute a search by performing a pinch out (an example of a multi-touch operation) starting from the contact point of operation unit P1 and the contact point of operation unit P2.

  When the MFP 1 detects the above-described operation, it sets two items “A” and “copy” displayed at the coordinates of the contact points of the operation units P1 and P2 as search items. Perform an OR search. As a result, as shown in FIG. 14B, information on six jobs related to at least one of “A” and “Copy” is extracted from the job list and displayed as a search result.

  Note that the type of search condition set according to the type of multi-touch operation is arbitrary, and in addition to AND search and OR search, it may be a NOT (NOT) search or the like. In addition to the pinch-in and pinch-out, the type of multi-touch operation may be flick, rotate, or the like. For example, when a right flick or counterclockwise rotation is detected as a multi-touch operation, one of AND search and OR search is performed, and when a left flick or clockwise rotation is detected as a multi-touch operation, AND search and The other of the OR searches may be performed.

  FIG. 16 is a flowchart in the case where the MFP 1 performs a search process using the fourth search method.

  Referring to FIG. 16, CPU 11 of MFP 1 first performs the processes of steps S400 to S413. Since each process of steps S400 to S413 is the same as each process of steps S200 to S213 in the flowchart shown in FIG. 9, the description thereof will not be repeated.

  If it is determined in step S413 that a multi-touch operation has been detected (Yes in S413), the CPU 11 determines whether or not the detected multi-touch operation is a pinch-in (S415).

  If it is determined in step S415 that it is a pinch-in (Yes in S415), the CPU 11 executes a search process under the first search condition (AND search here) (S417). Thereafter, the CPU 11 displays the search result on the touch panel 101 (S419), and ends the process.

  If it is determined in step S415 that it is not pinch-in (No in S415), the CPU 11 determines whether or not the detected multi-touch operation is a pinch-out (S431).

  If it is determined in step S431 that the pinch-out has occurred (Yes in S431), the CPU 11 executes a search process using the second search condition (OR search here) (S433). Thereafter, the CPU 11 displays the search result on the touch panel 101 (S419), and ends the process.

  If it is determined in step S431 that the pinch-out has not occurred (No in S431), the search condition corresponding to the detected multi-touch operation is not set. In this case, the CPU 11 displays a message such as “no search condition” on the touch panel 101 (S435), and ends without executing the search process.

  [Effect of the embodiment]

  According to the above-described embodiment, the user can set a search item by touching the touch panel, and can search for a target item by performing a multi-touch operation that moves a touch point on the touch panel ( Extraction), a drag operation when setting a search item becomes unnecessary, and the operability when performing a search can be improved.

  In addition, by detecting an operation that changes at least one of the coordinates of the two touch points of the touch performed for setting the item as a multi-touch operation and executing a search process, the user can An operation for setting a search item and an operation for executing a search can be performed by one action.

  [Others]

  The present invention is applicable not only when searching for job information from the job list shown in FIG. 3 but also when searching for a file from a file list as shown in FIG. 17, for example.

  FIG. 17 is a diagram schematically showing a screen of the file list LD displayed on the touch panel 101.

  Referring to FIG. 17, on touch panel 101, a screen of file list LD that is a list of files stored in MFP 1 is displayed. The file list includes a plurality of icons IC arranged in the row direction and the column direction, respectively. A “file search” key 208 is displayed at the lower right of the file list LD.

  When the touch on the “file search” key 208 is detected by the touch panel detection unit 42, the MFP 1 displays a pop-up screen PD at the bottom of the file list LD, for example. The pop-up screen PD includes a plurality of keys 209 describing file extensions.

  For example, it is assumed that a file having at least one extension of “.pdf” and “.exl” is searched from the file list LD. In this case, the user touches the “.pdf” key 209 on one of the operation portions P1 and P2, and touches the “.exl” key 209 on the other operation portion, thereby “.pdf”. And the extension of “.exl” is set in the search item. Next, the user causes MFP 1 to execute a search by performing a pinch-in (an example of a multi-touch operation) that changes the coordinates of the contact points of operation units P1 and P2.

  Upon detecting the above-described operation, the MFP 1 sets two extensions “.pdf” and “.exl” displayed at the coordinates of the contact points of the operation units P1 and P2 as search items, and searches for these extensions. Perform an OR search on the item. As a result, a file having an extension of “.pdf” or “.exl” is extracted from the file list LD and displayed as a search result.

  The above-described embodiments can be combined as appropriate. For example, by combining the first search method and the third search method, an item displayed at the coordinate of the contact point of the operation unit P1 is acquired, and the item displayed at the coordinate of the contact point of the operation unit P2 When not acquiring, the item currently displayed on the coordinate of the contact point of the operation part P3 may be further acquired. Further, in a case where three or more search items are acquired by combining the third search method and the fourth search method, the search may be performed using a search condition according to the type of the detected multi-touch operation.

  The processing in the above-described embodiment may be performed by software or by using a hardware circuit. It is also possible to provide a program for executing the processing in the above-described embodiment, and record the program on a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provide it to the user. You may decide to do it. The program is executed by a computer such as a CPU. The program may be downloaded to the apparatus via a communication line such as the Internet.

  The above-described embodiment is to be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 MFP
10 Main control unit 11 CPU
12 ROM
13 RAM
DESCRIPTION OF SYMBOLS 14 Memory | storage part 21 LCD drive circuit 22 Touch panel controller 23 Contact point acquisition part 24 Multi-touch determination part 25 Information acquisition part 26 Search item setting part 27 Search condition setting part 28 Search processing part 29 Image processing part 30 Image formation part 41 LCD
42 Touch Panel Detection Unit 100 Operation Panel 101 Touch Panel 102 Hardware Key 201 Tab 202 Job Information 203, 204 Box 205-209 Key IC Icon L Line LD File List P1, P2, P3 Operation Unit PD Pop-up Screen

Claims (13)

A touch panel;
Display means for displaying a screen including a plurality of items on the touch panel;
Contact point detection means for detecting first and second contact points that are points where the operation unit has touched the touch panel when the display means is displaying the screen;
Search item acquisition means for acquiring a search item from the plurality of items based on at least the coordinates of the first contact point;
Multi-touch, which is an operation of changing the coordinates of at least one of the contact points detected by the contact point detecting unit after the first and second contact points are detected by the contact point detecting unit. Multi-touch detection means for detecting operation;
An information display device comprising: a search unit that performs a search based on the search item acquired by the search item acquisition unit when the multi-touch operation is detected by the multi-touch detection unit.   The information display device according to claim 1, wherein the multi-touch detection unit detects an operation of changing at least one of the coordinates of the first and second contact points as the multi-touch operation. The first contact point is a contact point detected by the contact point detection means prior to the second contact point,
The information display device according to claim 1, wherein the search item acquisition unit acquires an item displayed at the coordinates of the first contact point as the search item.   The information display device according to claim 3, wherein the search item acquisition unit further acquires an item displayed at the coordinates of the second contact point as the search item. The contact point detection means further detects a third contact point that is a point where the operation unit contacts the touch panel in addition to the first and second contact points,
The information display device according to claim 3 or 4, wherein the search item acquisition unit further acquires an item displayed at the coordinates of the third contact point as the search item.   When the table in which the plurality of items are arranged in the row direction and the column direction is displayed on the touch panel, the search item acquisition unit is configured to determine the coordinates of the first contact point and the coordinates of the second contact point. Items displayed on a straight line connecting the first contact point, the item displayed between the row direction coordinate of the first contact point and the row direction coordinate of the second contact point, and the first 6. At least one item among the items displayed between the coordinate in the column direction of the contact point and the coordinate in the column direction of the second contact point is acquired as the search item. The information display apparatus in any one of.   The search item acquisition unit acquires the at least one item as the search item when no item is displayed at any of the coordinates of the first and second contact points. The information display device described.   The information display device according to claim 1, wherein the search unit performs a search under a search condition corresponding to a type of multi-touch operation detected by the multi-touch detection unit. When the multi-touch detection unit detects a multi-touch operation that reduces the distance between the first contact point and the second contact point, the search unit performs a search under a first search condition.
When the multi-touch operation that increases the distance between the first contact point and the second contact point is detected by the multi-touch detection unit, the search unit performs a second search different from the first search condition. The information display device according to claim 8, wherein a search is performed under conditions.   The information display device according to claim 8, further comprising search condition setting means for setting the first and second search conditions. An information display device according to any one of claims 1 to 10,
Instruction accepting means for accepting a print execution instruction through the touch panel of the information display device;
An image forming apparatus comprising: an image forming unit that forms an image based on an execution instruction received by the instruction receiving unit. A control method of an information display device provided with a touch panel,
A display step of displaying a screen including a plurality of items on the touch panel;
A contact point detection step of detecting first and second contact points, which are points where the operation unit touches the touch panel when the screen is displayed in the display step;
A search item acquisition step of acquiring a search item from the plurality of items based on at least the coordinates of the first contact point;
Multi-touch which is an operation of changing the coordinates of at least one of the contact points detected in the contact point detection step after detecting the first and second contact points in the contact point detection step. A multi-touch detection step for detecting an operation;
A control method for an information display device, comprising: a search step for performing a search based on the search item acquired in the search item acquisition step when the multi-touch operation is detected in the multi-touch detection step. A control program for an information display device having a touch panel,
A display step of displaying a screen including a plurality of items on the touch panel;
A contact point detection step of detecting first and second contact points, which are points where the operation unit touches the touch panel when the screen is displayed in the display step;
A search item acquisition step of acquiring a search item from the plurality of items based on at least the coordinates of the first contact point;
Multi-touch which is an operation of changing the coordinates of at least one of the contact points detected in the contact point detection step after detecting the first and second contact points in the contact point detection step. A multi-touch detection step for detecting an operation;
When the multi-touch operation is detected in the multi-touch detection step, the information display device control program causes the computer to execute a search step for performing a search based on the search item acquired in the search item acquisition step.

Images