JP2013084024A - Information apparatus, image processing device, display control method of operation screen, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enhance operability of multiple selection on an operation screen.SOLUTION: An information apparatus comprises: a display control unit for displaying a plurality of icons corresponding to respective options related to operations on an operation panel; and a history storage unit for storing a history of multiple selection of the plurality of icons. The display control unit changes disposition of the plurality of icons according to a mode of a touch operation in order to rearrange the plurality of specific icons which were plurally selected in the past indicated by the history, in predetermined positions easy for a user to select them by a single touch operation or a multiple touch operation.

Description

  The present invention relates to an information device that operates according to an operation on an operation panel, an image forming apparatus that is this type of information device, a display control method for an operation screen for operating the information device, and a computer program. The image forming apparatus includes a copying machine, a printer, a facsimile machine, and an MFP (Multi-functional Peripheral) having the functions of these devices.

  A multifunctional image forming apparatus such as an MFP includes a touch panel as an operation input unit. The touch panel here is an apparatus that combines a display capable of screen display and a touch-type pointing device. The translucent pointing device is in close contact with the front surface of the display, and the surface of the touch panel serves as both a display surface and a touch input surface.

  On the touch panel of the image forming apparatus, the contents of the screen display are changed according to the operation by the user. For example, when a first operation screen having a plurality of keys (also referred to as buttons) for selecting an operation setting item is displayed, when the user operates one of the keys, the key corresponds to the operated key. A second operation screen for detailed setting of the item to be displayed is displayed instead of the first operation screen or so as to partially overlap the first operation screen. The user can display various operation screens related to a desired operation in order by appropriately performing operations on the displayed operation screens.

  There is a technique for switching the layout of operation keys to be displayed when an operation is performed with a finger and when an operation is performed using a pen. In Patent Document 1, in a portable information processing apparatus having a pen storage unit, when the input pen is pulled out from the pen storage unit, a switch button is displayed in a small size at the bottom of the display surface, and the input pen is It is described that a switch button is displayed large on the left end or right end of the display surface when stored in the pen storage. In Patent Document 2, an operation screen for detecting the presence or absence of a touch pen in a touch pen storage unit provided on the operation panel and selecting a function when the touch pen is not stored in the operation panel of the image forming apparatus. In addition, it is disclosed that a key corresponding to the function is preferentially arranged so that a function accompanied by display of a key group that is difficult to operate with a finger and is preferably operated with a touch pen can be easily selected.

  On the other hand, in recent years, touch input methods have been diversified. For example, an information device having a multimedia function such as a tablet personal computer or a smartphone accepts a multi-touch operation in which a plurality of fingers are simultaneously brought into contact with the touch input surface. The multi-touch operation includes “pinch-in” in which two fingers are kept in contact with the touch input surface to reduce the interval between the fingers, and “pinch-out” in which the interval between the fingers is increased. Pinch-in and pinch-out are used when the displayed image is reduced or enlarged. In addition, for single touch operation using one finger or pen, in addition to the most common “tap” that touches one place in the input surface and releases it immediately, and “hold” that touches for a little longer There is an operation of moving a finger or a pen while touching (hereinafter referred to as a slide). The slide includes a “flick” that moves the finger to swing up quickly and a “drag” that moves the finger or pen to trace the touch input surface. Flicks are used to scroll the screen, and drag is used to move icons or select multiple icons at once.

JP 2007-179502 A JP 2009-175802 A

  In general, a large number of operation screens prepared for the operation of the image forming apparatus include a plurality of selection screens in which a plurality of icons respectively corresponding to a plurality of options are arranged. Further, the selection screen includes a selection screen (this is called a multi-selection screen) in which a large number of icons are arranged and a plurality of them can be selected (multiple selection). For example, as a multi-selection screen, a screen for selecting a processing target such as print or transfer from a large number of stored documents, a screen for selecting a processing target page from a multi-page document, and a large number of registered destinations There is a screen to select the destination from. On the multi-selection screen, a large number of icons are usually arranged in alphabetical order or alphabetical order based on the names of options. In an image forming apparatus shared by a plurality of users, an arrangement that is easy for anyone to understand is preferable if the arrangement of icons is not switched for each user.

  Assuming a situation where a user who frequently performs operations on a multi-selection screen always selects a plurality of the same icon group, an arrangement in which other icons exist between the icons to be selected is not preferable. This is because a finger or a pen has to be moved here and there, and it takes time to select multiple items. In particular, since the total number of icons is so large that they cannot be arranged even if the entire display surface is used, in a multi-operation screen in which icons are arranged in a plurality of pages, a plurality of icons are displayed over a plurality of pages displayed one by one. The choice is cumbersome.

  In view of such circumstances, an object of the present invention is to improve the operability of multiple selection on an operation screen.

  An information device that achieves the above object includes a display control unit that displays a plurality of icons respectively corresponding to a plurality of options on the operation panel, and a history storage unit that stores a history of a plurality of selections for the plurality of icons. . In the single touch operation mode, the display control unit includes a column along a virtual line in which a plurality of specific icons which are a plurality of icons selected in the past indicated by the history among the plurality of icons are continuous only with the specific icons. In the multi-touch operation mode, the plurality of icons are arranged so that each of the plurality of specific icons forms a row and a column with only the specific icon.

  According to the present invention, the arrangement of a plurality of icons displayed as operation options according to the operation status can be switched so as to be suitable for a single touch operation or suitable for a multi-touch operation. The operability of multiple selection to be selected is improved.

1 is a perspective view illustrating an appearance of an image forming apparatus as an information device. 2 is a block diagram illustrating a hardware configuration of the image forming apparatus. FIG. It is a figure which shows the function structure in connection with touch input operation in an image forming apparatus. It is a figure which shows the example of the designation | designated screen of a touch input format. It is a figure which shows an example of the operation screen which has multiple selection area | regions. It is a figure which shows the other example of the operation screen which has multiple selection area | regions. It is a figure which shows the operation screen which has the multi-touch area | region which is not a multiple selection area | region. It is a figure which shows the count table of touch input operation. It is a figure which shows the 1st example of the icon arrangement | sequence change for the single touch operation in a multiple selection area | region. It is a figure which shows the 1st example of the icon arrangement | sequence change for multi-touch operation in a multiple selection area | region. It is a figure which shows the 2nd example of the icon arrangement | sequence change for multi-touch operation in a multiple selection area | region. It is a figure which shows the example of the procedure of the multiple selection by multitouch operation. It is a figure which shows the 3rd example of the icon arrangement | sequence change for multi-touch operation in a multiple selection area | region. It is a figure which shows an example of the icon arrangement | sequence for multi-touch operation when there are many specific icons. It is a figure which shows the other example of the icon arrangement | sequence for multi-touch operation when there are many specific icons. It is a figure which shows the example of the icon arrangement | sequence which makes a part of specific icon overlap. It is a figure which shows the example of the icon arrangement | sequence which groups a specific icon. 5 is a flowchart illustrating an operation of the image forming apparatus that switches icon arrangements. It is a flowchart of the multi-touch arrangement | sequence process of FIG.

  An image forming apparatus 1 illustrated in FIG. 1 is an information device called an MFP having various uses including copying and network printing. The image forming apparatus 1 is connected to, for example, a LAN (Local Area Network) 8 constructed in a corporate office, and can perform data communication with an information processing apparatus such as a personal computer or a server and facsimile communication with an external communication apparatus. . The image forming apparatus 1 operates in accordance with an access from an external device and an operation by an operation panel 10 disposed on the front side of the upper part of the housing. A touch input pen 13 is attached to the operation panel 10 of the present embodiment.

  A user who wants the image forming apparatus 1 to execute a desired process needs to receive user authentication. In the illustrated image forming apparatus 1, a card reader that reads information from an IC card in a non-contact manner is provided as an authentication device 15 in the vicinity of the operation panel 10. To a plurality of users who share the image forming apparatus 1, an IC card that stores each identification information is distributed in advance as a user card. Each user can receive user authentication by bringing his / her own user card close to the authentication device 15.

  As shown in FIG. 2, the operation panel 10 includes a touch panel 12 and a pen holder 14. The touch panel 12 includes a display that displays an operation screen and a translucent touch input device that is in close contact with the display surface. A user interface that processes a signal from the touch input device accepts a single touch operation performed by a user using a finger or the touch input pen 13 and accepts a multi-touch operation in a state where a predetermined operation screen is displayed. The pen holder 14 detachably supports the touch input pen 13. The pen holder 14 has a sensor 141 that outputs a detection signal corresponding to the presence or absence of the touch input pen 13.

  A main controller 20 responsible for overall control of the image forming apparatus 1 includes a central processing unit (CPU) 21 as a computer for executing control programs and various applications, a read only memory (ROM) 22 for storing control programs, and a program execution work. It has an S-RAM (Static Random Access Memory) 23 as an area, and a battery-backed NV-RAM (nonvolatile memory) 24 for storing operation setting values.

  An ADF (Auto Document Feeder) 32 has a document table, and conveys a document sheet set on the document table to a reading position of the image scanner 33 in copying, image input, or facsimile transmission. The image scanner 33 optically reads image information recorded on the document sheet. The engine controller 34 controls the operation of the printer engine 35. The printer engine 35 prints a monochrome or color image by electrophotography on one or both sides of the paper supplied from the multistage paper stacker 36. The facsimile unit 37 is responsible for data processing for facsimile transmission / reception using a telephone line (not shown) or the LAN 8. The communication interface 38 connects the image forming apparatus 1 to the LAN 8. The storage 39 is a mass storage device such as a hard disk drive (HDD). The storage 39 is provided with a memory area as a medium for storing control data including screen data for displaying a control program and an operation screen. Data and programs stored in the storage 39 are loaded into the work area as necessary.

  FIG. 3 shows a functional configuration related to a touch input operation in the image forming apparatus 1 having such a hardware configuration. As shown in FIG. 3, the image forming apparatus 1 includes a user identification unit 201, a history storage unit 202, a display control unit 203, a touch format determination unit 204, a single touch arrangement designation unit 205, a multi-touch arrangement designation unit 206, and a pen state. A determination unit 207 is included. These components are realized by the CPU 21 as a computer mounted on the main controller 20 executing a program.

  The user identification unit 201 identifies an authenticated current user who intends to use the image forming apparatus 1 based on identification information input from the authentication device 15. The user identification unit 201 notifies the history storage unit 202 and the touch format determination unit 204 of the current user.

  The history storage unit 202 stores a history of user operations in cooperation with the display control unit 203. History information D1 indicating a history of multiple selections for each user is created by the history storage unit 202, and the history information D1 is stored in the NV-RAM 24 or the storage 39.

  The display control unit 203 displays an operation screen on the touch panel 12 using the screen image data D2, and switches display contents according to an operation performed by the user. Various operation screens displayed by the display control unit 203 include a multi-selection screen having a plurality of selection areas. The display control unit 203 configures an operation screen by combining drawing parts included in the screen image data D2. At that time, in the multiple selection area of the multi-selection screen, a plurality of icons respectively corresponding to a plurality of options related to operation are arranged in a standard order such as alphabetical order or alphabetical order, or a customized order for each user. The

  When the multi-selection screen is displayed, the touch format determination unit 204 determines whether the user identified by the user identification unit 201 performs a single-touch operation or a multi-touch operation when the multi-selection screen is displayed. The determination is made based on the determined information for determination. The determination information includes operation setting information D3 indicating an operation method (touch format) designated by the user, pen state information D4 indicating the presence / absence determination result of the touch input pen 13 input from the pen state determination unit 207, and history. This is information corresponding to the current user in the history information D1 indicating the user's operation history input from the storage unit 202. The operation mode related to the touch operation is determined by the determination by the touch type determination unit 204. When it is determined that a single touch operation is to be performed, the operation mode is a single touch operation mode, and when it is determined that a multitouch operation is to be performed, the operation mode is a multitouch operation mode. In other words, the touch format determination unit 204 functions as an operation mode setting unit that alternatively sets a single touch operation mode or a multi-touch operation mode.

  The determination by the touch format determination unit 204 follows the specified content when the specified content on the touch input format specified screen W10 illustrated in FIG. 4 is stored in the NV-RAM 24 or the storage 39. That is, in a state where the single touch operation is designated by the tap of the key 105, the touch type determination unit 204 determines that the user performs the single touch operation, and in a state where the multi-touch operation is designated by the tap of the key 106. The touch format determination unit 204 determines that the user performs a multi-touch operation. Note that the content specified on the specification screen W10 is stored for each user.

  On the other hand, when the designation content on the designation screen W10 is not stored (when the user does not designate), if the touch input pen 13 is removed after the user authentication and does not exist in the pen holder 14, the touch type determination unit 204 is the user. Is determined to perform a single touch operation. If the designation content on the designation screen W10 is not stored and the touch input pen 13 is in the pen holder 14, the touch type determination unit 204 performs single touch operation and multi-touch operation based on the history information D1. It is determined that the operation of which the user has performed more in the past is performed. In other words, when the operation screen to be displayed has been displayed in the past, if a single touch operation is frequently performed, it is determined that the user performs a single touch operation, and if a multi-touch operation is frequently performed, It is determined that the user performs a multi-touch operation.

  When the touch format determination unit 204 determines that a single touch operation is to be performed, the single touch array designating unit 205 performs a single touch operation with respect to the display control unit 203 for the icon arrangement in the multiple selection area of the multi-selection screen. Give instructions to make the sequence suitable for. The arrangement suitable for the single touch operation in the present embodiment means that a plurality of specific icons, which are icons selected in the past by the current user among a plurality of icons arranged in a plurality of selection areas, are continuous virtual lines. Are arranged in such a way that a row along the line is constituted by only the specific icon.

  When the touch format determination unit 204 determines that a multi-touch operation is to be performed, the multi-touch arrangement designating unit 206 displays the icon arrangement in the multiple selection area of the multi-selection screen with respect to the display control unit 203. Give instructions to make the sequence suitable for. An arrangement suitable for multi-touch operation is that a plurality of specific icons, which are icons selected in the past by the current user among a plurality of icons arranged in a plurality of selection areas, are arranged in rows and columns only with the specific icons. Are arranged at positions that constitute.

  Hereinafter, switching of the icon arrangement on the multi-selection screen will be described in more detail.

  FIG. 5 shows an example of the multi-selection screen. In FIG. 5, a destination selection screen W <b> 1 covering almost the entire display surface is displayed by the touch panel 12. Since the destination selection screen W1 displayed in response to the operation for designating the facsimile mode is a multi-selection screen, it naturally has a plurality of selection areas 40. In the multiple selection area 40, a square icon of a predetermined size indicating a communication destination registered in advance is displayed as a destination option. In the illustrated example, the number of icons that can be displayed at the same time is 15, and a total of 15 icons including four icons 41, 49, 53, and 55 are displayed in 3 rows and 5 columns in the multiple selection area 40. Yes. The icon arrangement order in the state of FIG. 5 is an alphabetical order based on the name of the communication destination corresponding to each icon. In the Japanese alphabetical order, which is one of the standard orders, and the alphabetical order, which is another standard order, the icons are arranged in descending order from the top icon from the first line to the left for each line. By tapping the icon displayed in this way, the user can select a destination. In the case of facsimile communication, since it is possible to perform broadcast communication that simultaneously transmits to a plurality of communication destinations, a plurality of selections for selecting a plurality of icons may be performed on the destination selection screen W1. In FIG. 5, a plurality of the above-mentioned four icons 41, 49, 53, and 55 are selected, and these icons 41, 49, 53, and 55 are distinguished from other icons by highlighting that thickens their outlines.

  FIG. 6 shows another example of the multi-selection screen. In FIG. 6, the target selection screen W3 is displayed so as to partially overlap the operation screen W2 displayed in gray out. The target selection screen W3 is a multi-selection screen that pops up when a predetermined operation is performed on the operation screen W2. In the multiple selection area 80 of the target selection screen W3, thumbnails of a plurality of pages included in the designated document are displayed as icons indicating page selection options. The arrangement order is ascending order of page numbers. In the figure, a total of 15 icons including six icons 81, 82, 86, 88, 91, and 95 are displayed side by side in 3 rows and 5 columns as options to be edited. The user can delete, rotate, or move the selected page by tapping any of the keys 96, 97, and 98 after tapping the icon and selecting a desired page. In addition, the user can display a preview screen by tapping the key 99 and check the image of the selected page. In this target selection screen W3, a plurality of pages are often selected as targets for batch processing.

  FIG. 7 shows an example of the preview screen W4. The preview screen W4 has a preview area 100 that is a multi-touch area that is not a multiple selection area. In the preview area 100, an image G1 indicating the contents of the page designated by the user is arranged. The user can enlarge or reduce the image G <b> 1 by performing pinch out and pinch in, which are multi-touch operations, in the preview area 100. The user can also enlarge or reduce the image G1 by a single touch operation (tap or hold) of the keys 101 and 102 arranged on the right side of the preview area 100. When the key 103 is tapped, the displayed screen returns from the preview screen W4 to the target selection screen W3 in FIG.

  FIG. 8 shows the data structure of the count table T1 stored as a part of the history information D1. In the count table T1, the number of single touch operations and the cumulative number of multitouch operations counted for each user and for each multi-selection screen are recorded. The touch format determination unit 204 refers to the count table T1 as necessary, and the user performs a single touch operation as described above according to the number of counts corresponding to the screen to be displayed by the display control unit 203. It is determined whether to perform a multi-touch operation.

  FIG. 9 shows a first example of icon arrangement change for a single touch operation. Specifically, FIG. 9A shows a state in which a plurality of icons are selected in the standard order arrangement, FIG. 9B shows an icon arrangement suitable for a single touch operation, and FIG. 9C shows a single touch. The procedure for multiple selection by operation is shown. The hatched rectangles in the figure are a plurality of selected icons (the same applies to the following figures).

  In FIG. 9A, the multiple selection area is composed of two or more pages displayed one page at a time, and each of the first page 401 and the second page 402 is arranged in 3 rows and 5 columns, each of 15 squares. Icons are arranged. The arrangement order is a standard order (for example, alphabetical order). On the first page 401, the first line icon 42, the second line icon 49, and the third line icon 52, 54 are selected, and on the second page 402, the second line icons 61, 64 are selected. ing. In such a multiple selection, the user must switch pages, which takes time. Therefore, in order to improve the operability of multiple selection, when an operation screen including the multiple selection area is displayed again thereafter, specific icons (here, icons 42 and 49) which are icons selected multiple times before that time are displayed. , 52, 54, 61, 64) are arranged as shown in FIG.

  In FIG. 9B, six specific icons 42, 49, 52, 54, 61, and 64 are arranged in all the first rows and the first row in the first page 401. Icons other than the specific icon are also arranged on the first page 401, and the icons are arranged in 3 rows and 5 columns in the entire page. Here, the feature of the arrangement is that the specific icons are arranged along an imaginary line L1 indicated by a one-dot chain line arrow. In this example, the specific icons are arranged in two rows and are bent, but the virtual line L1 is a single continuous line.

  The arrangement in which the specific icons are arranged along the virtual line L1 is suitable for selecting a plurality of specific icons 42, 49, 52, 54, 61, 64 again by a single touch operation. That is, as shown in FIG. 9C, for example, the specific icon 64 on the second line is touched with the finger F1, and the finger F1 while touching the input surface is moved to the specific icon 42 on the first line, and then touched. The finger F1 is moved along the row to the specific icon 61 in the last column. The user can quickly select a plurality of all the specific icons 42, 49, 52, 54, 61, 64 in the manner of this one-stroke writing.

  FIG. 10 shows a first example of icon arrangement change for multi-touch operation. Specifically, FIG. 10A shows the same state as FIG. 9A, and FIG. 10B shows an example of an icon arrangement suitable for multi-touch operation.

  The selected icons 42, 49, 52, 54, 61, and 64 as shown in FIG. 10A are displayed when the operation screen including the plurality of selection areas is displayed again thereafter. 54, 61 and 64 are arranged as shown in FIG. A feature of the arrangement in FIG. 10B is that the specific icon is arranged at a position that constitutes a row and a column only by the specific icon. The number of rows and the number of columns are selected so that these products are the same as the number of specific icons or larger than the number of specific icons and closest to the number of specific icons. When there are a plurality of selection candidates, a matrix having a small diagonal distance is selected.

  In FIG. 10B, the specific icons 42, 49, 52, 54, 61, and 64 are collected and arranged at the leftmost 3 rows and 2 columns of the 3 rows and 5 columns arrangement in the first page 401. Has been. Since the number of specific icons in this example is 6, the specific icons 42, 49, 52, 54, 61, and 64 fit in exactly 3 rows and 2 columns.

  FIG. 11 shows a second example of icon arrangement change for multi-touch operation. Specifically, FIG. 11A shows a state in which a plurality of icons are selected in the standard order arrangement, and FIG. 11B shows an example of an icon arrangement suitable for multi-touch operation corresponding to FIG. Show.

  In FIG. 11A, the icons 41, 43, and 44 on the first line of the first page 401, the icon 50 on the second line, and the icon 53 on the third line are selected. In such a multiple selection, the user does not need to switch pages. However, it is necessary to move the finger or the touch input pen from place to place in the page 401, and it takes time and effort to make the selection. Therefore, in order to improve the operability of multiple selection, when the operation screen including the multiple selection area is displayed again thereafter, the icons 41, 43, 44, 50, 53 are used as specific icons as shown in FIG. Arranged.

  In FIG. 11B, the specific icons 41, 43, 44, 50, and 53 are collected and arranged at the leftmost 3 rows and 2 columns position in the page 401 as in FIG. 10B. The number of specific icons in this example is 5, which is one less than the product of the number of rows and the number of columns in 3 rows and 2 columns. In this case, one of the six icon arrangement positions in the matrix is left blank in order to satisfy the constraint that “rows and columns are composed of only specific icons”. The blank is set at a position other than the four corners of the matrix. In the example, since the number of rows is 3, positions other than the four corners are positions of the second row. By setting the blank to be other than the four corners, the range of the collection of specific icons among all icons displayed in the page 401 can be easily understood by the user.

  FIG. 12 shows an example of a multiple selection procedure by multi-touch operation. Specifically, FIG. 12A shows the state of the plurality of operation areas before the start of the selection operation, FIGS. 12B and 12C show the user's operation during selection, and FIG. 12D shows the end of the selection operation. The state of the multiple operation area at the time is shown.

  When a plurality of six specific icons 42, 49, 52, 54, 61, 64 arranged in three rows and two columns as shown in FIG. 12A are selected, the user selects two rows as shown in FIG. 12B, for example. Touch around the eyes with two fingers F1 and F2. Subsequently, the user points his / her finger so that a virtual rectangle with two touch positions as diagonal vertices overlaps all six specific icons 42, 49, 52, 54, 61, and 64 as shown in FIG. Pinch out to widen the interval between F1 and F2. Thereby, a plurality of six specific icons 42, 49, 52, 54, 61, 64 are selected.

  FIG. 13 shows a third example of icon arrangement change for multi-touch operation. Specifically, FIG. 13A shows a state where a plurality of icons are selected in the standard order arrangement, and FIG. 13B shows an icon arrangement suitable for multi-touch operation.

  In FIG. 13A, 15 icons are arranged in 3 rows and 5 columns on each of the first page 401 and the second page 402 constituting the multiple selection region. Of the 30 icons, a plurality of icons 42, 49, 52, 53, 54 on the first page 401 and icons 57, 58, 61, 64, 65, 67 on the second page 402 are selected. ing. A total of 11 icons 42, 49, 52, 53, 54, 57, 58, 61, 64, 65, and 67 are arranged as specific icons as shown in FIG.

  In FIG. 13B, the specific icons 42, 49, 52, 53, 54, 57, 58, 61, 64, 65, 67 are gathered and arranged at the position of 3 rows and 4 columns on the left end in the page 401. Yes. The number of specific icons in this example is 11, which is one less than the product of the number of rows and the number of columns in 3 rows and 4 columns. Also in this case, one of the twelve icon arrangement positions in the matrix is left blank in order to satisfy the constraint that “rows and columns are configured only by specific icons”. The blank space is an icon arrangement position other than the positions corresponding to the four sides of a rectangle (rectangle) whose apexes are the diagonal icon arrangement positions, excluding both end rows and both end columns in the matrix. In the example, since the number of rows is 3 and the number of columns is 4, the positions that do not correspond to the four sides are the positions of the second and third columns of the second row. In the example, the position of the second column and the third column is blank. By surrounding the blank with specific icons in this way, the range of the collection of specific icons among all the icons displayed in the page 401 can be easily understood by the user.

  14 and 15 show examples of icon arrangements for multi-touch operations when the number of specific icons is large. If the number of rows or columns is too large, the diagonal distance of the matrix is long and multi-touch operation with one hand is difficult. Therefore, when arranging a large number of specific icons so as to be suitable for the multi-touch operation, the large number of specific icons are divided into a plurality of matrices. In the example of FIG. 14, 15 specific icons 41, 42,..., 54, 55 out of a total of 21 specific icons 41, 42,. Are arranged in 3 rows and 5 columns, and the remaining six specific icons 56, 57,..., 60, 61 are arranged in 3 rows and 2 columns that are separated from the matrix by 1 column. In the example of FIG. 15, 15 specific icons 41, 42,..., 54, 55 out of a total of 21 specific icons 41, 42,. .., 60, 61 are arranged in 3 rows and 2 columns at the left end portion of the second page 406. In the case of the example in FIG. 15, it is necessary to switch pages, but since specific icons are gathered in each page 405, 406, 21 pages are compared to those arranged in each page 405, 406. Multiple selection of specific icons can be performed quickly.

  FIG. 16 shows an example of an icon arrangement in which a part of a specific icon is overlapped. Specifically, FIG. 16A shows a selection state in the first multiple selection, and FIG. 16B shows a selection state in the second multiple selection. FIG. 16C shows an example of an icon arrangement suitable for the single touch operation corresponding to FIGS. 16A and 16B, and FIG. 16D corresponds to FIGS. 16A and 16B. The example of the icon arrangement | sequence suitable for multi-touch operation to perform is shown.

  There may be a case where a plurality of selections with different selection contents are performed for each time on the same multi-selection screen. In FIG. 16A, the icons 42, 49, 52, 54 of the first page 401 and the icons 61, 64 of the second page 402 are selected, and in FIG. 16B, the icons 42, 49 of the first page 401 are selected. 56 and icons 57 and 58 on the second page 402 are selected. As can be seen by comparing FIGS. 16A and 16B, one icon 42 is selected in common in the first selection and the second selection. As described above, when switching from the standard order arrangement to the arrangement for single touch operation or the arrangement for multi-touch operation, a set of specific icons selected for one job are gathered to be adjacent to each other. Arranged. As shown in the example of FIG. 16, there are specific icons selected in common among a plurality of jobs, and the number of specific icons is relatively small, or the number of specific icons selected in common with respect to the number of specific icons in a set. When the ratio is smaller than a predetermined value (for example, 1/4), as shown in FIGS. 16C and 16D, specific icons selected in common are overlapped and arranged at a plurality of positions.

  In FIG. 16C, the six specific icons 42, 49, 52, 54, 61, 64 corresponding to the first multiple selection are in the first line along the imaginary line L1 bent as in the example of FIG. And the first column in the second row. The four specific icons 42, 55, 57, and 58 corresponding to the second multiple selection are arranged in the second to fourth columns of the second row along the virtual line L2. The specific icons 42 selected in common are arranged overlapping the first column of the first row and the second column of the second row.

  In FIG. 16D, the six specific icons 42, 49, 52, 54, 61, 64 corresponding to the first multiple selection are arranged in 3 rows and 2 columns at the left end of the page 401 as in the example of FIG. Then, on the right side of the matrix, four specific icons 42, 55, 57, 58 corresponding to the second multiple selection are arranged in 2 rows and 2 columns. The common icon 42 selected in common is arranged so as to overlap the first column and the third column of the first row.

  FIG. 17 shows an example of an icon arrangement for grouping specific icons. Specifically, FIG. 17A shows a selection state in the first multiple selection, and FIG. 17B shows a selection state in the second multiple selection. FIG. 17C shows an example of an icon arrangement suitable for a single touch operation corresponding to FIGS. 17A and 17B, and FIG. 17D corresponds to FIGS. 17A and 17B. The example of the icon arrangement | sequence suitable for multi-touch operation to perform is shown.

  In FIG. 17A, the icons 42, 49, 52, and 54 of the first page 401 and the icons 61 and 64 of the second page 402 are selected. In FIG. 17B, the icons 42, 49 of the first page 401 are selected. 49, 52, 54 and icons 61, 65 of the second page 402 are selected. As can be seen by comparing FIGS. 17A and 17B, five iconons 42, 49, 52, 54, and 61 are selected in common in the first multiple selection and the second multiple selection. . Thus, when the number of icons selected in common is larger than a predetermined value (for example, three), or the ratio of the number of specific icons selected in common to the number of specific icons at each time is more than a predetermined value (for example, 1/4). If it is large, duplicating commonly selected icons may be too redundant and the user may be wondering where to choose. Therefore, in such a case, grouping of the specific icon selected in common and the specific icon that is not so is performed. That is, the specific icon selected by any one of the multiple selections is grouped into either a common group or an individual group that is subdivided every time.

  In FIG. 17C, the five specific icons 42, 49, 52, 54, 61 belonging to the common group are arranged in the first row. One specific icon 64 selected only by the first multiple selection belonging to the individual group is arranged in the top row of the second row, and one specific icon 65 selected only by the second multiple selection is two rows. Located in the last row of eyes. In the state shown in FIG. 17C, in order for the user to select again the same six icons 42, 49, 52, 54, 61, 64 as the first multiple selection, for example, from the specific icon 64 through the specific icon 42. A single touch operation for moving a finger along the virtual line L1 to reach the specific icon 61 may be performed. A route from the specific icon 61 to the specific icon 64 may be traced. Further, in order for the user to select again the same six icons 42, 49, 52, 54, 61, 65 as in the second multiple selection, for example, from the specific icon 42 to the specific icon 65 via the specific icon 61. A single touch operation for moving a finger along the virtual line L3 may be performed. The route from the specific icon 65 to the specific icon 42 may be traced.

  In FIG. 17D, the five specific icons 42, 49, 52, 54, 61 belonging to the common group are arranged in 3 rows and 2 columns including one blank at the left end of the page 401. One specific icon 64 selected only by the first multiple selection belonging to the individual group is arranged in the third column of the first row, and one specific icon 65 selected only by the second multiple selection is 1 Arranged in the fourth column of the row. In the state of FIG. 17 (D), in order to select again the same six icons 42, 49, 52, 54, 61, 64 that are the same as the first multiple selection, the user selects, for example, 3 rows and 2 columns by pinch-out. And the tap of the specific icon 64 may be performed. In addition, in order to select again the same six icons 42, 49, 52, 54, 61, 65 that are the same as the second multiple selection, the user selects, for example, three rows and two columns by pinching out and taps the specific icon 65. Should be done.

  FIG. 18 is a flowchart showing an outline of the operation of the image forming apparatus 1 for switching the icon arrangement.

  When the multi-selection screen, which is an operation screen having a plurality of selection areas, is displayed on the touch panel 12 (YES in S10), the display control unit 203 notifies the touch format determination unit 204 to that effect prior to displaying the multi-selection screen. . Upon receiving the notification, the touch format determination unit 204 acquires the operation setting information D3, the pen state information D4, and the history information D1 of the operation performed by the current user as information for determination (S11).

  Based on the history information D1, the display control unit 203 checks whether the number of specific icons belonging to the common group on the multi-selection screen to be displayed or the ratio to the number of multiple selections is greater than or equal to a predetermined value (S12). ). When the number or ratio of the specific icons selected in common is equal to or greater than a predetermined value corresponding thereto (YES in S12), the display control unit 203 performs display setting for grouping the specific icons as in the example of FIG. (S13). In addition, when the number or ratio of the specific icons selected in common is smaller than the predetermined value corresponding thereto (NO in S12), the display control unit 203 performs the multiple selection recorded each time the multiple selection is performed. A display setting for collecting and arranging a set of a plurality of specific icons corresponding to each set as shown in the example of FIG. 16 is performed (S14).

  If the result of determination by the touch format determination unit 204 is “the user performs a single touch operation”, the display control unit 202 executes a single touch arrangement process for displaying a specific icon in an arrangement suitable for the single touch operation ( S15, S16). If the result of determination by the touch format determination unit 204 is “the user performs a multi-touch operation”, the display control unit 202 executes multi-touch arrangement processing for displaying a specific icon in an arrangement suitable for the multi-touch operation ( S15, S17).

FIG. 19 is a flowchart of the multi-touch arrangement process of FIG. The display control unit 202
If the specific icon to be displayed is exactly within the matrix forming the rectangle, that is, if there is a matrix in which the number of specific icons matches the product of the number of rows and the number of columns (YES in S171), such a matrix is configured. The specific icons are arranged so as to do so (S172). If the specific icon does not fit in the matrix (NO in S171), the display control unit 202 determines that if the number of specific icons is sufficient to enclose a blank (YES in S173), the display control unit 202 has a blank inside the specific icon. Specific icons are arranged so as to form a matrix having (S174). If it is not possible to place a blank in the matrix (NO in S173), the specific icons are arranged in a matrix having blanks at the four corners (S175).

  In the above embodiment, the maximum number of rows of the matrix when the specific icons are arranged so as to be suitable for the multi-touch operation is not limited to 3 illustrated. The specific icons can be arranged in a matrix having four or more rows according to the sizes of the multiple selection areas 40 and 80 and the icon size. The matrix includes those having a plurality of rows and one column and those having a plurality of rows and one column. The matrix in the case of providing a blank is a matrix of 3 rows or more and 3 columns or more.

  When counting the number of times of each of the single touch operation and the multi touch operation, the multi selection screen such as the destination selection screen W1 in FIG. 5 and the target selection screen W3 in FIG. 6 is changed to the multi selection screen such as the preview screen W4 in FIG. However, weighting that is more important than a screen capable of multi-touch operation may be performed. As another example of the multi-selection screen, there is a document selection screen for printing and transmitting a plurality of documents collectively.

  A user card related to user authentication is not limited to an IC card, but may be a magnetic card or an optically readable card. Modifications that use authentication by user card and authentication by manual input of authentication information such as passwords, select either of these two types of authentication, or enable only authentication by manual input of authentication information There is also. A sensor that reads biological information such as a fingerprint or a vein may be used as the authentication device 11. The authentication method is arbitrary. Further, for example, in a usage situation where only a single user uses, the authentication device 15 and the user authentication process can be omitted.

  The image forming apparatus 1 is not limited to an MFP, and may be any apparatus that can perform a plurality of selections, and may be a copier, a printer, or a facsimile apparatus. In addition, the present invention can be applied to various types of stationary or portable information devices.

DESCRIPTION OF SYMBOLS 1 Image forming apparatus 10 Operation panel 41, 42, 43, 44, 45 Specific icon (icon)
46, 47, 48, 49, 50 Specific icon (icon)
51, 52, 53, 54, 55 Specific icon (icon)
56, 57, 58, 59, 60 Specific icon (icon)
61, 64, 65, 67, 81 Specific icon (icon)
82, 86, 88, 91, 95 Specific icon (icon)
DESCRIPTION OF SYMBOLS 201 User identification part 202 History memory | storage part 203 Display control part 204 Touch format determination part 205 Single touch arrangement | sequence designation | designated part 206 Multi-touch arrangement | positioning designation | designated part 207 Pen state discrimination | determination part D1 History information (information for determination)
D3 operation setting information (information for judgment)
D4 Pen state information (information for judgment)
L1, L2, L3 Virtual line 13 Touch input pen 14 Pen holder 141 Sensor

Claims (13)

An information device having an operation panel capable of touch input,
A display control unit for displaying a plurality of icons respectively corresponding to a plurality of options on the operation panel;
A history storage unit that stores a history of a plurality of selections for the plurality of icons,
The display control unit
In the single touch operation mode, a plurality of specific icons that are a plurality of icons selected in the past indicated by the history among the plurality of icons are configured only by the specific icons in a row along a continuous virtual line. An information device in which the plurality of icons are arranged, and in the multi-touch operation mode, the plurality of icons are arranged so that the plurality of specific icons form a row and a column only with the specific icon. . The information device according to claim 1, wherein when a user performs a mode designation operation, the single touch operation mode or the multi-touch operation mode is set according to the mode designation. A holder for detachably supporting the touch input pen;
A pen state determination unit for determining the presence or absence of the touch input pen in the holder,
The single touch operation mode is set when the pen state determining unit determines that the touch input pen is not in the holder, and the multi-touch operation mode is set when it is determined that the touch input pen is present. The information device according to claim 1. Based on the history, the single touch operation mode is set when the number of single touch operations is greater than the number of multi touch operations, and when the number of multi touch operations is greater than the number of single touch operations. The information device according to claim 1, wherein a multi-touch operation mode is set. When arranging the plurality of specific icons in rows and columns in the multi-touch operation mode, the display control unit determines that the number of the specific icons is greater than the product of the number of rows and the number of columns in the array. 5. The information device according to claim 1, wherein when there are few, the plurality of specific icons are arranged at positions excluding at least four corners in a row and a column. When arranging the plurality of specific icons in rows and columns in the multi-touch operation mode, the display control unit determines that the number of the specific icons is greater than the product of the number of rows and the number of columns in the array. The information device according to claim 5, wherein when there are few, the plurality of specific icons are arranged at positions excluding both end rows and both end columns in the rows and columns. In the multi-touch operation mode, the display control unit, when arranging the plurality of specific icons in rows and columns, if the number of the plurality of specific icons exceeds a set number, The information device according to claim 1, wherein the plurality of specific icons are arranged separately. The display control unit is common to the plurality of specific icons and the set when a set of a part of the plurality of specific icons and another icon of the plurality of icons has been selected in the past. The plurality of specific icons and the plurality of icons belonging to the set are configured in a row along the virtual line according to the operation mode that is the single touch operation mode or the multi-touch operation mode. The information device according to claim 1, wherein the information device is displayed on the operation panel in an arrangement that forms rows and columns without including any other icons. In the display control unit, a plurality of combinations of a part of the plurality of specific icons and other icons among the plurality of icons have been selected in the past, and the plurality of specifics with respect to the number of the plurality of specific icons is selected. If the ratio of the number of icons common to the set of icons exceeds a set value, or if the number of common icons exceeds a set value, the common icon is set to the single touch operation mode or the 8. The operation panel is displayed in an array that forms a column along the virtual line or includes a row and a column without including other icons according to an operation mode that is a multi-touch operation mode. An information device described in any of the above. An image forming apparatus having an operation panel capable of touch input,
A display control unit for displaying a plurality of icons respectively corresponding to a plurality of options on the operation panel;
A user identification unit for identifying a user based on the input identification information;
A history storage unit for storing a history of multiple selections for the plurality of icons by the user identified by the user identification unit;
Based on the history, when the number of single touch operations by the user is greater than the number of multi-touch operations, it is determined that a single touch operation is performed by the user in a state where the plurality of icons are displayed, A touch type determination unit that determines that a multi-touch operation is performed by the user when the plurality of icons are displayed when the number of multi-touch operations is greater than the number of single touch operations;
The display control unit
When it is determined that the single touch operation is performed by the touch type determination unit, a plurality of specific icons which are a plurality of icons selected in the past indicated by the history among the plurality of icons are continuous virtual lines. When the plurality of icons are arranged so that the column along the line is configured only by the specific icon and the multi-touch operation is determined by the touch format determination unit, the plurality of specific icons are The image forming apparatus, wherein the plurality of icons are arranged so as to form a row and a column with only specific icons. A display control method for an operation screen in an information device having an operation panel capable of touch input,
When displaying multiple icons corresponding to multiple options,
In the single touch operation mode, the plurality of specific icons, which are a plurality of icons selected in the past among the plurality of icons, form a row along a continuous virtual line with only the specific icons. Array of icons
In the multi-touch operation mode, the plurality of icons are arranged so that the plurality of specific icons constitute a row and a column only by the specific icons. A computer program executed in an information device having an operation panel capable of touch input,
When executed by a computer included in the information device,
A display control unit for displaying a plurality of icons respectively corresponding to a plurality of options on the operation panel;
A history storage unit that stores a history of multiple selections for the plurality of icons is realized in the computer,
The display control unit
In the single touch operation mode, a plurality of specific icons that are a plurality of icons selected in the past indicated by the history among the plurality of icons are configured only by the specific icons in a row along a continuous virtual line. The computer program, wherein the plurality of icons are arranged, and in the multi-touch operation mode, the plurality of icons are arranged so that the plurality of specific icons form a row and a column only by the specific icon. . A computer program executed in an information device having an operation panel capable of touch input,
When executed by a computer included in the information device,
A display control unit for displaying a plurality of icons respectively corresponding to a plurality of options on the operation panel;
A user identification unit for identifying a user based on the input identification information;
A history storage unit for storing a history of multiple selections for the plurality of icons by the user identified by the user identification unit;
Based on the history, when the number of single touch operations by the user is greater than the number of multi-touch operations, it is determined that a single touch operation is performed by the user in a state where the plurality of icons are displayed, A touch type determination unit that determines that a multi-touch operation is performed by the user in a state where the plurality of icons are displayed when the number of multi-touch operations is greater than the number of single touch operations;
When it is determined that the single touch operation is performed by the touch type determination unit, a plurality of specific icons which are a plurality of icons selected in the past indicated by the history among the plurality of icons are continuous virtual lines. A single touch arrangement designating unit that designates an arrangement of the plurality of icons to the display control unit, so as to configure a column along the specific icon only,
When it is determined that the multi-touch operation is performed by the touch type determination unit, the plurality of specific icons may be configured to form a row and a column with only the specific icon. A computer program for causing a computer to realize a multi-touch arrangement designating unit for designating an arrangement of icons.

Images