JP2019096055A - Information processing device, control method for information processing device, and program - Google Patents

Abstract

To provide a technique which can further improve operability pertaining to icons.SOLUTION: While only a portion (e.g., SL1) of a first screen (e.g., SC1) including a plurality of icons and capable of scroll display is displayed as a display target region, an information processing device detects a user operation (e.g., drag operation) for moving one icon (e.g., L21) in the display target region SL1. When it is determined, when the user operation is detected, that some region of the first screen that is not displayed (e.g., first non-display region SL22) should be displayed, a display change operation (e.g., automatic scroll operation or shrink display operation) is initiated in order to display a region including the first non-display region SL22 on a touch panel 45 before the one icon L21 reaches an end E1 of the display target region SL1 (the end E1 existing in a direction of a movement destination of the one icon L21) according to a movement operation of the one icon.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an information processing apparatus such as an MFP (Multi-Functional Peripheral) and related techniques.

  There is a technology for displaying a screen including a plurality of icons in a display unit of an information processing apparatus. In such a technique, when displaying a large number of icons on the one screen, it may not be possible to display all the icons at one time, and some icons may not be displayed at a certain point in time. In such a case, the partial icon (also referred to as a non-display icon) is displayed by scrolling the screen (in response to the user's scroll operation or the like).

  In other words, only a part of the area of the scrollable screen (specifically, the entire area thereof) is displayed as the display target area at a certain point in time, and the other area (non-display area) is at the certain point in time Is not displayed. And the icon (non-display icon) in the said non-display area is displayed by scrolling regarding a screen. For example, the icons in the other area (non-display area) virtually arranged on the right side of the partial area (display target area) are displayed on the screen by leftward scroll display.

  Further, in the technology of displaying a screen including a plurality of icons, file operations and / or application execution instruction operations using the icons are performed. Specifically, various instructions are given by an operation (drag and drop operation) of moving (dragging) one icon (operation target icon) on the screen and dropping it on the other icon (moving destination icon). It is given from the user to the information processing apparatus.

  For example, by moving and dropping an operation target icon (document file) onto a specific "folder" icon, a file (also referred to as operation target file) indicated by the operation target icon is moved to the specific folder. The information processing apparatus executes a process according to the instruction (see Patent Document 1 etc.). Similarly, by moving and dropping a certain operation target icon (document file) onto the "trash" icon, the file (also referred to as the operation target file) indicated by the operation target icon is deleted (moved to the trash folder) The information processing apparatus executes a process according to the instruction. Alternatively, a specific process related to the file to be operated (file open process and / or file) in the specific application by an operation of moving and dropping a certain operation target icon (document file) onto a specific “application” icon An instruction to execute conversion processing etc.) is given, and the information processing apparatus executes a process according to the instruction. Note that such an operation (drag and drop operation or the like) is performed using a mouse or a finger of the user.

  However, as described above, at a certain point in time on the screen capable of scroll display (screen having a non-display area), it is also possible that the icon of the movement destination of the operation target icon (movement destination icon) is not displayed. is there. In other words, when the destination icon is (virtually) disposed in the non-display area on the screen, the user can not visually recognize the destination icon. Under this condition, it is difficult to perform the drag and drop operation accompanied by the drop operation on the movement destination icon in the non-display area.

  Even in such a case, the following techniques can be easily performed as a technique capable of easily performing a drop operation (drag and drop operation) on a non-display icon (move destination icon) virtually arranged in the non-display area Exists.

  Specifically, the user performs a drag operation on one icon (operation target icon) in the window screen, and the one icon is displayed at the end of the display target area of the window screen (for example, the moving destination direction of the one icon) When moving to the right end portion (right direction), the information processing apparatus starts automatic scrolling of the screen. The end is also expressed as a boundary between the display target area (on the left) and the non-display area (on the right).

  When the automatic scrolling is performed, the destination icon (the destination icon virtually arranged in the non-display area) which has been hidden until then is displayed (visualized), and the user visually recognizes the destination icon become able to.

JP, 2008-090361, A

  However, in such an automatic scrolling technique, scrolling is not started unless the icon of the drag operation target (operation target icon) is moved to the end (the boundary between the display target area and the non-display area). The moving-destination icon is visually recognized (displayed) at a point further after the reaching point of the operation target icon at the boundary.

  Such techniques do not always have sufficient operability, and there is room for improvement.

  The above problem may also occur when two screens are simultaneously displayed on one display unit (two-screen simultaneous display). Specifically, in two-screen simultaneous display, one display unit is shared by two screens. Therefore, the size of each screen is smaller than when one screen is displayed on the entire display unit. When displaying each screen while maintaining the size of the icon in each screen, it may not be possible to display all the icons of each screen at one time. In particular, at the time of starting the drag operation on the operation target icon of one of the two screens, the move destination icon virtually arranged in the non-display area in the one screen is not displayed. is there. In such a case, even if the above-described automatic scroll technology is applied, a drag operation is performed on one icon (operation target icon) in the one screen to display the one icon in the display target area in the one screen. The automatic scrolling does not start unless the end portion (the boundary portion between the display target area and the non-display area) is reached.

  Then, this invention makes it a subject to provide the technique which can further improve the operativity regarding an icon.

  In order to solve the above-mentioned problems, the invention according to claim 1 is an information processing apparatus, and a display means capable of scroll-displaying a first screen including a plurality of icons in a predetermined direction; A detection unit that detects a user operation to move one icon in the display target area in a state where only a part of the first screen is displayed as the display target area; and the first screen Determining means for determining whether the first non-display area, which is an area different from the display target area, is to be displayed on the display means, and the first non-display area when the user operation is detected When it is determined that the area is to be displayed on the display means, the end portion of the display target area, which is in the direction of the movement destination of the one icon, in accordance with the moving operation of the one icon. Before The first display change operation for displaying on the display means an area including the first non-display area of the first screen by the time before the time when the one icon arrives And display control means.

  According to the invention of claim 2, in the information processing apparatus according to the invention of claim 1, the determination means determines whether or not the first non-display area exists in the first screen, and And determining that the first non-display area is to be displayed on the display means.

  According to the invention of claim 3, in the information processing apparatus according to the invention of claim 1, the determination means determines presence or absence of a first non-display icon which is an icon not displayed on the display means among the plurality of icons. In addition to the determination, it is determined that the first non-display area is to be displayed on the display unit on the condition that the first non-display icon is present.

  The invention according to claim 4 is the information processing apparatus according to the invention according to claim 3, wherein the determination means also satisfies that a predetermined relationship exists between the one icon and the first non-display icon. It is characterized in that it is determined that the first non-display area should be displayed on the display means.

  A fifth aspect of the present invention is the information processing apparatus according to any of the first to fourth aspects, wherein the determination means includes the first non-display area on the movement destination side of the one icon. It is characterized by judging that the said 1st non-display area should be displayed on the said display means on condition that.

  A sixth aspect of the invention is the information processing apparatus according to any one of the first to fifth aspects, wherein the display control means is configured to set the first non-display area when the user operation is detected. When it is determined that the display means should be displayed, the time before the one icon reaches the end of the display target area according to the moving operation of the one icon, An area including the display target area and the first non-display area in the first screen may be reduced and displayed on the display means.

  A seventh aspect of the present invention is the information processing apparatus according to any of the first to fifth aspects, wherein the display control means performs the first non-display area when the user operation is detected. When it is determined that the display means should be displayed, the time before the one icon reaches the end of the display target area according to the moving operation of the one icon, The scroll display related to the first screen is automatically started.

  The invention according to claim 8 is the information processing apparatus according to any one of claims 1 to 7, wherein the determination means displays the first non-display area when the user operation is detected. When it is determined that the first non-display area is to be displayed on the display means, the display control means determines whether the display operation means should display the first non-display area immediately after the user operation is detected. A first display change operation is started.

  The invention according to claim 9 is the information processing apparatus according to any one of claims 1 to 7, wherein the determination means displays the first non-display area when the user operation is detected. It is determined whether or not to display on the means, and when it is determined that the first non-display area is to be displayed on the display means, the display control means moves the one icon in the predetermined direction When the speed is larger than a predetermined value, the first display change operation is started earlier than when the moving speed is smaller than the predetermined value.

  According to the invention of claim 10, in the information processing apparatus according to the invention of claim 4, the display control means determines that the predetermined relationship exists between the first non-display icon and the one icon. A position of the first non-display icon in a virtual image for scroll display related to the first screen, which is at least a partial area including the first non-display icon in the first screen; The display means may display at least a partial area reduced at a reduction degree corresponding to a distance from the position of the one icon in the virtual image.

  The invention according to claim 11 relates to the information processing apparatus according to any one of claims 1 to 10, wherein the display control means is configured to set the first non-display area when the user operation is detected. When it is not determined to display on the display means, the display of the display target area in the display means is maintained, and the first non-display area is not displayed on the display means.

  According to the invention of claim 12, in the information processing apparatus according to any of claims 1 to 11, the display means has a first display area and a second display area adjacent to each other. , And the first screen can be scrolled in the first display area and a second screen different from the first screen can be scrolled in the second display area It is characterized in that it is possible.

  The invention of claim 13 is the information processing apparatus according to the invention of claim 12, wherein the display means is shared by a first device and a second device provided in the information processing apparatus. The screen is a screen for displaying the first device, and the second screen is a screen for displaying the second device.

  The invention of claim 14 is the information processing apparatus according to the invention of claim 12 or claim 13, wherein the determination means is a second non-displayed area of the second screen capable of scroll display. It is also determined whether a display area should be displayed on the display means, and the display control means determines that the second non-display area should be displayed on the display means when the user operation is detected. If it is selected, a second display change operation is performed to display an area including the second non-display area in the second screen on the display means.

  According to the invention of claim 15, in the information processing apparatus according to the invention of claim 14, the determination means determines whether or not the second non-display area exists in the second screen, and the second And determining that the second non-display area is to be displayed on the display means.

  According to the invention of claim 16, in the information processing apparatus according to the invention of claim 14, the determination means is a second non-display icon not displayed on the display means among a plurality of icons in the second screen. And determining that the second non-display area is to be displayed on the display means, on the condition that the second non-display icon is present.

  According to the invention of claim 17, in the information processing apparatus according to the invention of claim 16, the determination means also satisfies the condition that a predetermined relationship exists between the second non-display icon and the one icon. It is characterized in that it is determined that the second non-display area should be displayed on the display means.

  According to an eighteenth aspect of the present invention, in the information processing apparatus according to any one of the fourteenth to seventeenth aspects, the determination means determines that the second non-display area exists on the moving destination side of the one icon. It is characterized by judging that the said 2nd non-display area should be displayed on the said display means on condition that.

  The invention according to claim 19 is the information processing apparatus according to any one of claims 14 to 18, wherein the display control means performs the second non-display area when the user operation is detected. When it is determined that the display means should display, the area including the display target area of the second screen and the second non-display area is reduced in the second display area of the display means. It is characterized by displaying.

  The invention according to claim 20 is the information processing apparatus according to any one of claims 14 to 19, wherein the display control means performs the second non-display area when the user operation is detected. When it is determined that the display means should be displayed, it is an end portion of the display target area of the first screen according to the movement operation of the one icon, and the one icon exists in the movement destination direction The second display change operation is started by a time point before the time when the one icon reaches the end to be displayed.

  The invention of claim 21 is the information processing apparatus according to the invention of claim 20, wherein the display control means determines that the second non-display area is to be displayed on the display means, the user operation The second display change operation is started immediately after the detection of.

  The invention according to claim 22 is the information processing apparatus according to any one of claims 14 to 20, wherein the display control means determines that the second non-display area should be displayed on the display means. When the moving speed of the one icon in the predetermined direction by the user operation is larger than a predetermined value, the second display is performed earlier than when the moving speed is smaller than the predetermined value. It is characterized by starting change operation.

  The invention according to claim 23 is the information processing apparatus according to any one of claims 14 to 19, wherein the display control means performs the second non-display area when the user operation is detected. When it is determined that the display means should be displayed, after the time when the one icon reaches the boundary between the first screen and the second screen according to the moving operation of the one icon, and A point in time before the time when the one icon reaches the end far from the current position of the one of the two ends of the display target area of the second screen in the scroll direction of the second screen The second display change operation is started by then.

  The invention according to claim 24 is the information processing apparatus according to any one of claims 14 to 23, wherein the display control means performs the second non-display area when the user operation is detected. When it is not determined to display on the display means, the display of the display target area in the second screen in the display means is maintained, and the second non-display area is not displayed on the display means. Do.

  The invention according to claim 25 is a control method of an information processing apparatus, comprising: a) a first screen including a plurality of icons, wherein the first screen capable of scroll display in a predetermined direction is the information processing apparatus In the step of displaying on the display means of b) and b) in a state where only a partial area of the first screen capable of scroll display is displayed as the display target area, one icon in the display target area is displayed. Detecting a user operation to be moved; c) determining whether to display a first non-display area which is an area different from the display target area in the first screen; When it is determined that the first non-display area should be displayed when a user operation is detected, the first display area is an end portion of the display target area according to the movement operation of the one icon. Aiko Displaying the area including the first non-display area of the first screen on the display means by a time point before the time when the one icon reaches the end existing in the movement destination direction of Starting a first display change operation.

  According to the invention of claim 26, in the control method according to the invention of claim 25, the display means has a first display area and a second display area adjacent to each other, and the information processing apparatus is provided in the information processing apparatus. It is possible to scroll and display the first screen, which is shared by the provided first device and the second device and displays the first device, in the first display area, and It is possible to scroll and display a second screen which is different from the first screen and which performs a display relating to the second device in the second display area, and the control method E) determining whether or not a second non-display area, which is an area not displayed, of the second screen capable of scroll display should be displayed on the display means; f) the user operation Smell when detected When it is determined that the second non-display area should be displayed on the display means, a second for displaying the area including the second non-display area on the display means on the second screen Starting the display change operation of

  The invention according to claim 27 is the control method according to the invention according to claim 26, wherein the step f) displays the second non-display area on the display means when the user operation is detected. When it is determined that the operation is to be performed, at the end of the display target area of the first screen according to the moving operation of the one icon, the end existing in the direction of the movement destination of the one icon Starting the second display change operation by a point in time before the point of arrival of the one icon.

  The invention of claim 28 is the control method according to the invention of claim 26, wherein the step f) displays the second non-display area on the display means when the user operation is detected. And when it is determined that the first icon has reached the boundary between the first screen and the second screen in response to the moving operation of the first icon. The time before the time when the one icon reaches the end far from the current position of the one of the two ends of the display target area of the second screen in the scroll direction of the screen Starting a second display change operation.

  The invention of claim 29 is a program which causes a computer incorporated in the information processing apparatus to execute the control method according to any of the inventions of claims 25 to 28.

  According to the invention described in claims 1 to 29, when it is determined that the first non-display area should be displayed when the user operation is detected, in response to the moving operation of one icon, The display mode change operation is started by the time point before the time when the one icon reaches the end of the display target area that is in the movement destination direction of the one icon and reaches the one time. Therefore, the user can visually recognize the non-displayed icon relatively early, and it is possible to further improve the operability regarding the icon.

FIG. 2 is a diagram showing an appearance of an MFP (information processing apparatus). FIG. 2 is a block diagram showing a schematic configuration of an MFP. It is a figure which shows the functional block of an image forming device. It is a figure which shows the functional block of a server device. It is a figure which shows the detailed structure of a panel control part. 6 is a flowchart showing an operation of the MFP. It is a figure which shows the production | generation processing etc. of the first display image in 2 screen simultaneous display. It is a figure which shows the automatic scroll operation accompanying a drag operation. It is a figure which shows the automatic scroll operation accompanying a drag operation. It is a figure which shows the automatic scroll operation accompanying a drag operation. It is a figure which shows the state (2nd Embodiment) by which each screen was reduced and displayed. It is a figure which shows an example of the display content in the time of a drag | drug operation start time. It is a figure which shows the other example of the display content in the time of the drag operation start time. It is a figure which shows the other example of the display content in the time of the drag operation start time. It is a figure which shows the other example of the display content in the time of the drag operation start time. It is a figure which shows the synthesized image etc. which are displayed immediately after the start of 1st drag operation (3rd Embodiment). It is a figure which shows the synthesized image etc. which are displayed immediately after the start of 2nd drag operation. It is a figure which shows the synthesized image etc. which are displayed immediately after the start of 3rd drag operation. It is a figure which shows the synthesized image etc. which are displayed immediately after the start of 4th drag | drug operation. It is a figure which shows the production | generation process of the first display image etc. which are shown in FIG. It is a figure which shows the first display image different from FIG. It is a figure which shows the relationship between an icon moving speed and an automatic scroll start timing (4th Embodiment). It is a figure which shows a mode that the operation target icon is moved at low speed. It is a figure which shows a mode that the operation target icon is moved at high speed. It is a figure which shows the relationship between virtual arrangement | positioning distance and display magnification (5th Embodiment). It is a figure which shows the positional relationship of the operation target icon and the trash can icon. It is a figure which shows the positional relationship of the operation target icon and the trash can icon. It is a figure which shows the shrinking | reduction image which concerns on 5th Embodiment.

  Hereinafter, embodiments of the present invention will be described based on the drawings.

<1. First embodiment>
<1-1. Configuration Overview>
FIG. 1 is a view showing the appearance of an MFP (Multi-Functional Peripheral) 10. Here, the MFP 10 is illustrated as an information processing apparatus. The MFP 10 is also referred to as an image forming apparatus or an image processing apparatus.

  FIG. 2 is a block diagram showing a schematic configuration of the MFP 10.

  The MFP 10 includes a plurality of devices (here, two devices of a server device 20 and an image forming device 30) operating independently of each other. Here, the server device 20 and the image forming device 30 are housed in one case and integrally configured. A predetermined member and a member provided so as to be able to open and close with respect to the predetermined member (for example, provided rotatably about a rotation shaft provided on the document table of MFP 10) Document cover etc.).

  The MFP 10 also includes an operation display unit 40 (see also FIG. 1). The operation display unit 40 is shared by the plurality of devices 20 and 30 as described later.

<1-2. Configuration of Image Forming Device 30>
The image forming device 30 (see also FIG. 1) is a device capable of executing various jobs (copy job, scan job, etc.). The image forming device 30 is also referred to as an MFP device.

  FIG. 3 is a diagram showing functional blocks of the image forming device 30. As shown in FIG. The image forming device 30 manages functions to be managed (copy function, scan function, facsimile function, box print function, etc.). Specifically, as shown in FIG. 3, the image forming device 30 includes an image reading unit 32, a print output unit 33, a communication unit 34, a storage unit 35, a controller (control unit) 39, and the like. A variety of functions (managed functions) are realized by operating each unit in combination.

  The image reading unit 32 optically reads (that is, scans) a document placed on a predetermined position (such as an automatic document feeder (ADF) or a glass surface) of the image forming device 30. It is a processing unit that generates image data (also referred to as a document image or a scanned image) of the document. The image reading unit 32 is also referred to as a scan unit or the like. The image forming device 30 is a device capable of reading an original placed at a predetermined position, and is also referred to as an image reading device.

  The print output unit 33 is an output unit that prints out an image on various media such as paper based on data regarding a print target. The image forming device 30 is a device capable of printing out an image on various media, and is also referred to as a printout device.

  The communication unit 34 is a processing unit capable of performing facsimile communication via a public line or the like. Furthermore, the communication unit 34 can also perform network communication via a network. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the image forming device 30 can exchange various data with a desired destination.

  The storage unit 35 is configured by various storage devices (such as (volatile and / or non-volatile) semiconductor memory and / or hard disk drive (HDD)).

  The controller 39 is a control device that is built in the image forming device 30 and controls the image forming device 30 in a centralized manner. The controller 39 is configured as a computer system including a central processing unit (CPU) (also referred to as a microprocessor or computer processor) and various semiconductor memories (RAM and ROM). The controller 39 implements various processing units by executing predetermined software programs (hereinafter, also simply referred to as programs) stored in a ROM (for example, an EEPROM (registered trademark)) in the CPU. The program (specifically, program module group) may be recorded in a portable recording medium such as a USB memory, read from the recording medium, and installed in the image forming device 30. Alternatively, the program may be downloaded via a network and installed on the image forming device 30.

  Specifically, as shown in FIG. 3, the controller 39 implements various processing units including the communication control unit 39a, the operation control unit 39b, and the operation control unit 39c by executing the above program.

  The communication control unit 39a cooperates with the communication unit 34 and the like to form another device (the other device (the server device 20 and the like) in the same case (the same apparatus) and another device configured in the other case). ) Is a processing unit that controls communication operations with devices in the device.

  The operation control unit 39b cooperates with the operation display unit 40 (see FIG. 1) to control an input operation (operation of accepting an operation input) on the operation display unit 40 (particularly, the touch panel 45 (see FIG. 1)) It is a processing unit that controls the display operation (display output operation) in the operation display unit 40 (in particular, the touch panel 45). For example, the operation control unit 39b causes the operation display unit 40 (touch panel 45) to display information related to the management target function of the image forming device 30, etc., and also inputs operation input information (touch information etc.) related to user operation on the operation display unit 40. It is acquired from the operation display unit 40.

  The operation control unit 39 c is a processing unit that controls various operations (such as job operations) in the image forming device 30.

<1-3. Configuration of Server Device 20>
The server device 20 (see also FIG. 1) is a device capable of realizing a server function. Server device 20 is configured, for example, as a general-purpose computer device.

  FIG. 4 is a diagram showing functional blocks of the server device 20. As shown in FIG.

  As shown in the functional block diagram of FIG. 4, the server device 20 includes a communication unit 24, a storage unit 25, a controller (control unit) 29 and the like, and various units are operated by operating these units in combination. To realize the function.

  The communication unit 24 can perform network communication. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the server device 20 can exchange various data in cooperation with a desired destination.

  The storage unit 25 is configured of various storage devices (such as (volatile and / or non-volatile) semiconductor memory and / or hard disk drive (HDD)).

  The controller (control unit) 29 is a control device that is built in the server device 20 and controls the server device 20 in a centralized manner. The controller 29 is configured as a computer system including a CPU, various semiconductor memories (RAM and ROM), and the like. The controller 29 implements various processing units by executing predetermined programs stored in a storage unit (semiconductor memory or the like) in the CPU. The program (specifically, program module group) may be recorded on a portable recording medium such as a USB memory, read from the recording medium, and installed in the server device 20. Alternatively, the program may be downloaded via a network and installed on the server device 20.

  Specifically, the controller 29 realizes various processing units including the communication control unit 29a, the operation control unit 29b, and the operation control unit 29c by executing the program and the like.

  The communication control unit 29a cooperates with the communication unit 24 and the like to form another device (the other device (the image forming device 30 and the like in the same case (the same apparatus)) and other devices in another case. And a processing unit that controls communication operations with the device.

  The operation control unit 29 b cooperates with the operation display unit 40 to control an input operation to the operation display unit 40 (particularly the touch panel 45) and a processing unit to control a display operation in the operation display unit 40 (particularly the touch panel 45) It is. For example, the operation control unit 29b causes the operation display unit 40 (touch panel 45) to display information and the like related to the management target function of the server device 20, and the operation input information related to user operation on the operation display unit 40 (touch panel 45) Acquired from the display unit 40.

  The operation control unit 29 c is a processing unit that controls various operations in the server device 20.

  The server device 20 also manages management target functions (e-mail function, data storage function, file format conversion function, image editing function, etc.). Specifically, in the server device 20, applications (application software programs) for realizing various functions (management target functions) are installed in advance, and the server device 20 uses various applications to execute various types of applications. Implement functions (managed functions).

  Here, in the server device 20, an e-mail application, a data storage application, a file format conversion application, an image editing application and the like are installed in advance.

  The e-mail application is an application capable of performing transmission and reception of e-mails with other devices, and the server device 20 implements an e-mail function by executing the e-mail application.

  The data storage application is an application capable of storing various data in the server device 20, and the server device 20 implements a data storage function by executing the data storage application.

  The file format conversion application is an application capable of converting the file format of a designated file into another file format, and the server device 20 implements a file format conversion function by executing the format conversion application. .

  The image editing application is an application capable of executing editing processing of designated image data, and the server device 20 implements an image editing function by executing the image editing application.

<1-4. Configuration of operation display unit 40>
In the MFP 10, a substantially plate-like operation display unit 40 (see FIG. 1) is provided. The operation display unit 40 has a touch panel 45 (see FIG. 1) on the front side. The touch panel (also referred to as an operation panel) 45 is configured by embedding various sensors and the like in a liquid crystal display panel, and can display various information and receive various operation inputs from the operator. The touch panel 45 also functions as an operation input unit that receives a user's operation input to the touch panel 45, and also functions as a display unit that displays various types of information.

  For example, the touch panel 45 displays a screen (such as a setting screen) selected from among a plurality of screens at a certain point in time, and one or more software keys (keys realized by software) are displayed on the screen. (Button, etc.) is displayed. Then, a user's operation input is accepted by detecting a touch operation (a pressing operation of a key or the like) on the software key. The operation display unit 40 also includes a hardware key, and can receive user operation input using the hardware key.

  The operation display unit 40 is shared by a plurality of devices provided in the MFP 10 (here, two devices of the server device 20 and the image forming device 30).

  In addition to the touch panel 45, the operation display unit 40 also includes a panel control unit 41, as shown in FIG. The panel control unit 41 is a processing unit that controls an operation related to the touch panel 45.

  The panel control unit 41 is configured as a computer system including a CPU, various semiconductor memories (RAM and ROM), and the like. The panel control unit 41 is a controller that controls various operations related to the operation display unit 40 (such as the touch panel 45) by executing a predetermined program stored in a storage unit (such as a semiconductor memory) in the CPU. . The program (specifically, program module group) may be recorded in a portable recording medium such as a USB memory, read from the recording medium, and installed in the operation display unit 40. Alternatively, the program may be downloaded via the network and installed in the operation display unit 40.

  Specifically, the controller 29 realizes various processing units including the user operation detection unit 51 (see FIG. 5), the determination unit 52, and the display control unit 53 by executing the program and the like. FIG. 5 is a diagram showing a detailed configuration of the panel control unit 41 and the like.

  The user operation detection unit 51 is a processing unit that detects a user operation on the touch panel 45. User operation detection unit 51 moves one icon in each display target area, for example, in a state where only a partial area of each of scrollable scrollable screens SC1 and SC2 is displayed as the display target area. Detect user operation (drag operation etc.).

  Determination unit 52 determines an area different from the display target area (in other words, an area not displayed at this time) (non-display area) in each of the screens SC1 and SC2 (in other words, in each of the screens SC1 and SC2). It is a processing unit that determines whether or not to display on the touch panel 45.

  The display control unit 53 is a processing unit that controls the display content of the touch panel 45. When the determination unit 52 determines that the non-display area should be displayed on the touch panel 45 when a user operation (a drag operation or the like) is detected, the display control unit 53 sets the area including the non-display area as the touch panel 45. Control operations (display change operations) and the like for displaying on the screen. For example, as described later, the display control unit 53 performs the display change operation (automatic scrolling) in response to a movement operation (such as a drag operation) in the right direction (rightward) of one icon L21 (see FIGS. 7 and 8). Start operation etc.) More specifically, the right end of the display target area SL1 (see FIGS. 7 and 8) and in the moving destination direction (right direction) of the one icon is the right end of the display area 210 of the touch panel 45 The display change operation is started before the point in time when the one icon L21 reaches the part (right end E1 of the display target area SL1 of the screen SC1 (FIG. 8) or the like).

  Further, the display control unit 53 includes a combining unit 54 and a display switching unit 55. The combining unit 54 is a processing unit that generates a combined image based on the screen SC1 generated by the operation control unit 39b of the image forming device 30 and the screen SC2 generated by the operation control unit 29b of the server device 20. The display switching unit 55 is a processing unit that switches the display content on the touch panel 45 based on the composite image or the like.

  The panel control unit 41 (display control unit 53 or the like) transmits display data transmitted from some or all of the plurality of devices (here, the server device 20 and the image forming device 30). An image based on (screen data) is displayed on the touch panel 45. Further, the panel control unit 41 transmits information (operation input information) (touch information or the like) based on the user's operation input to the touch panel 45 toward the part or all of the devices.

<1-5.2 screen simultaneous display>
The touch panel 45 of the MFP 10 can simultaneously display the display images of both of the plurality of devices (here, the two devices 20 and 30). Briefly speaking, the touch panel 45 can perform two-screen display (two-screen simultaneous display) (see FIGS. 7 and 8 and the like). FIG. 7 is a diagram showing generation processing and the like of the first display image in two-screen simultaneous display, and FIG. 8 is a diagram showing the first display image (initial display image).

  Specifically, the touch panel 45 has two display areas (a left display area 210 and a right display area 220 (see FIGS. 7 and 8)) adjacent to each other. The two display areas 210 and 220 are areas obtained by logically dividing the entire display area of the touch panel 45. Each of the display areas 210 and 220 may always have the same size (1/2 of the size of the touch panel 45), but is not limited thereto. The size of may be changed. For example, the boundary is changed by the user such that one of the two regions 210 and 220 has a size of 1/3 of the entire touch panel 45 and the other has a size of 2/3 of the entire touch panel 45. The size of each of the areas 210 and 220 may be changed according to the operation.

  The screen SC1 for the image forming device 30 is displayed in the left side display area 210 of the touch panel 45, and the screen SC2 for the server device 20 is displayed in the right side display area 220 of the touch panel 45. In other words, the screen SC1 and the screen SC2 are arranged side by side in the horizontal direction (left and right direction). The screen SC1 is a screen for displaying the image forming device 30, and the screen SC2 is a screen for displaying the server device 20.

  In addition, each of the screens SC1 and SC2 includes a plurality of icons. For example, in FIG. 7, the screen SC1 includes eight icons L11 to L14 and L21 to L24, and the screen SC2 includes six icons R11 to R14, R21, and R24 (see FIG. 7). Left column). The icons L11 to L13 and L21 to L24 are file icons (icons indicating files), and L14 is a trash can icon (icon indicating trash can folders). Further, icons R11 to R13 and R21 are application icons (icons indicating applications), and icons R14 and R24 are folder icons (icons indicating folders). However, the present invention is not limited to this, and various icons may be appropriately arranged on each screen.

  In the MFP 10, when the display images (screens SC1 and SC2) of the two devices 20 and 30 are simultaneously displayed on the touch panel 45 (in the case of two-screen display), in the default setting, in the initial state of the two-screen display. The icons in the screens SC1 and SC2 have normal sizes. The normal size is the same size as the size of each icon in the case where each screen SC1, SC2 is displayed on the entire touch panel 45 one by one, and the size of “100%” (reference size of icon Also called).

  In the initial state in the two-screen display, a half size screen (here, the left half area SL1) of the full screen of the screen SC1 is displayed in the left display area 210, and the half size of the full screen of the screen SC2 Screen (here, the left half area SR3) is displayed in the right side display area 220 (see the rightmost column in FIG. 7 and FIG. 8). Each of the screens SC1 and SC2 is provided with a scroll bar (here, a horizontal scroll bar), and scroll display (scroll display in the horizontal direction (horizontal direction)) is performed according to a user operation or the like on the scroll bar. . Specifically, the screen SC1 can be scrolled in the display area 210, and the screen SC2 can be scrolled in the display area 220. The user can visually recognize all the icons (including an invisible icon in the initial state) in each of the screens SC1 and SC2 by such scroll display.

  Further, in the initial state in the two-screen display, the right half area SL2 of the screen SC1 is not displayed, and the right half area SR4 of the screen SC2 is not displayed (see the center column in FIG. 7). The respective areas SL2 and SR4 are also referred to as non-display areas (in the initial state). In the initial state, the user can not visually recognize the icons L13, L14, L23, L24 in the non-display area SL2 and the icons R13, R14, R24 in the non-display area SR4.

  Further, in the MFP 10, not only scroll display processing (manual change processing of the display state) corresponding to the user operation on the scroll bar but also automatic change processing (display state) corresponding to the drag operation (icon movement operation) Automatic change processing of) is also performed. Specifically, in accordance with the “drag operation” on the icon (operation target icon), the display target area in each of the screens SC1 and SC2 is automatically changed (see FIGS. 8 to 10). 8 to 10 illustrate an automatic scroll operation associated with a drag operation.

  In particular, in consideration of the above-mentioned problem, the MFP 10 starts the automatic change processing of the display state at an earlier timing according to the moving operation of the icon (L21 or the like). Specifically, an end portion of the icon in the moving destination direction (for example, the right direction), specifically, the right end portion of the left display area 210 (in other words, the display target area actually visible in the screen SC1 The automatic change processing of the display state is started by the time point before the time when the icon reaches the right end E1 (FIG. 8) of SL1. The automatic change process is started, for example, immediately after the detection of the movement operation of the icon.

  More specifically, the scroll display is started from the initial state of FIG. 8 immediately after the detection of the movement operation of the icon. The scroll display progresses gradually, and at a certain point thereafter, the display state changes as shown in FIG.

  In FIG. 9, a region including both partial region SL21 (see upper middle row in FIG. 7) of screen SC1 (see upper leftmost row in FIG. 7) and another partial region SL12 adjacent to the partial region SL21 is It is displayed in the left side display area 210 of the touch panel 45. The area SL21 is a partial area (left half area) of the area (non-display area) SL2 (see the upper center column in FIG. 7) which was not visible at the start of the two-screen display in the screen SC1. This is a partial area (right half area) of the area (display target area) SL1 that was visible at the start of the screen SC1.

  Further, in the right side display area 220 (FIG. 9) of the touch panel 45, a partial area SR41 (refer to the lower middle column in FIG. 7) of the screen SC2 (refer to lower leftmost column in FIG. 7) An area including both of the other partial area SR32 is displayed. The area SR41 is a partial area (left half area) of the area (non-display area) SR4 (see the lower center column in FIG. 7) which was not visible at the start of the two-screen display in the screen SC2. It is a partial area (right half area) of an area (display target area) SR3 which was visible at the start time of the screen SC2.

  In the display state of FIG. 9, the user visually recognizes the icons L13 and L23 in the area SL21 which were not seen at the start of the two-screen display, and the icon R13 in the area SR41 which was not seen at the start. It is possible to visually recognize.

  Furthermore, if the drag operation is continued, scrolling further progresses gradually. Then, the entire area (see FIG. 10) of the area (non-display area) SL2 that was not visible at the start time is displayed in the left display area 210 of the touch panel 45. Further, the entire area (see FIG. 10) of the area (non-display area) SR4 that was not visible at the start time is displayed in the right side display area 220 of the touch panel 45. In particular, as compared with FIG. 9, the area SL22 (right half area of the area SL2) and the area SR42 (right half area of the area SR4) are also displayed.

  In the display state of FIG. 10, the user can visually recognize the icons L13, L23, L14, and L24 in the area SL2 (SL21 and SL22) which were not visible at the start of the two-screen display. In addition, the user can also visually recognize the icons R13, R14, and R24 in the area SR4 (SR41 and SR42) that were not visible at the start of the two-screen display.

  In this manner, the scroll display in a predetermined scroll direction (here, also referred to as the arrangement direction of the two display areas 210 and 220) in the scroll direction (here, the horizontal direction) causes the non-display area (SL21 and / or Or SL 22 etc.) is visualized.

  Hereinafter, such an operation will be described in more detail.

<1-6. Operation>
FIG. 6 is a flowchart showing an operation (more specifically, a two-screen simultaneous display operation) in the MFP 10.

  As shown in FIG. 6, in step S11, the operation control unit 39b of the image forming device 30 generates a screen SC1 (specifically, the display image thereof), and the operation control unit 29b of the server device 20 generates the screen SC2 (details To generate the display image) (see also the leftmost column in FIG. 7). Then, the display control unit 53 (FIG. 5) of the operation display unit 40 generates a composite image 300 (refer to the rightmost column in FIG. 7) based on the screens SC1 and SC2 (step S12). 8) is displayed on the touch panel 45 (step S13). Here, the left half area SL1 of the screen SC1 (see also the upper center column in FIG. 7) is determined as the display target area of the screen SC1, and the left half area SL1 of the screen SC1 is the left half of the composite image 300 (for left side display Area 210). Further, the left half region SR3 (see also the lower center row in FIG. 7) of the screen SC2 is determined as the display target region of the screen SC2, and the left half region SR3 of the screen SC2 is the right half portion of the composite image 300 (the right display region 220). Then, such a composite image 300 is displayed on the touch panel 45 by the display control unit 53.

  When icon movement information (for example, a rightward drag operation of the icon L21 on the touch panel 45 (see FIG. 8)) is detected in the next step S14, the process proceeds to the next step S15.

  In step S15, should the non-display area in the screens SC1 and SC2 (an area different from the display target areas (SL1 and SR3) in the screens SC1 and SC2 and not displayed at this time) be displayed on the touch panel 45? It is determined whether or not.

  Specifically, it is determined whether or not there is a non-display area in each of the screens SC1 and SC2, and if there is a non-display area related to at least one of the two screens SC1 and SC2, the non-display area It is determined that it should be displayed on the More specifically, as shown in FIG. 7, when there is a non-display area (SL21 and / or SL22, etc.) (see the center column in FIG. 7) in screen SC1, the non-display area in screen SC1 is It is determined that it should be displayed on the When a non-display area (SR41 and / or SR42 or the like) in the screen SC2 exists, it is determined that the non-display area in the screen SC2 should be displayed on the touch panel 45.

  In this MFP 10, it is assumed that the initial state of each screen SC1, SC2 of the two-screen display is selected in advance from among two types of options. The first option is to display each icon in each screen in the initial state with a scaling factor of 100% (see FIG. 8), and the second option is to display each screen in the initial state in a reduced size It is. For example, when the first option is selected in advance, it is determined that the non-display area exists, and the process proceeds from step S15 to step S16. On the other hand, if the second option is selected in advance for both screens SC1 and SC2, it is determined that there is no non-display area, and the process from FIG. 6 is immediately ended without proceeding from step S15 to step S16.

  When it is determined that the non-display area does not exist because both the screens SC1 and SC2 are displayed in a reduced size from the beginning, the non-display area in the screen SC1 and SC2 should be displayed on the touch panel 45 It is not determined in S15. In this case, the process of FIG. 6 ends without proceeding to step S16. That is, the display of the display target area in each of the screens SC1 and SC2 on the touch panel 45 is maintained.

  On the other hand, when it is determined in step S15 that the non-display area should be displayed on the touch panel 45, the process proceeds to step S16.

  In step S16, the composite image 300 is updated by the combining unit 54 and the like, and the display content on the touch panel 45 is changed by the display switching unit 55 and the like. Specifically, as shown in FIG. 8 to FIG. 10, scroll display of the screens SC1 and SC2 is executed according to the movement of the operation target icon (L21 etc.).

  When it is determined in step S15 that the non-display area in the screen SC1 should be displayed on the touch panel 45, scroll display of the screen SC1 is executed in step S16. When it is determined in step S15 that the non-display area in the screen SC2 should be displayed on the touch panel 45, scroll display of the screen SC2 is executed in step S16.

  Here, the case where the automatic scroll display of both of the two screens SC1 and SC2 is executed will be described.

  First, with regard to the screen SC1, the display state of FIG. 9 (the areas SL12 and SL21 is displayed in the left side display area 210) from the display state of FIG. 8 (the state in which the areas SL11 and SL12 are displayed in the left side display area 210). Transition to state) gradually. Similarly, for the screen SC2, the display state of FIG. 9 (area SR32, SR41 is displayed in the right side display area 220) from the display state of FIG. 8 (state in which the areas SR31, SR32 are displayed in the right side display area 220). Transition to the

  Next, regarding the screen SC1, the display state of FIG. 9 gradually transitions to the display state of FIG. 10 (the state in which the areas SL21 and SL22 are displayed in the left side display area 210). Similarly, with regard to the screen SC2, the display state of FIG. 9 gradually transitions to the display state of FIG. 10 (the state in which the areas SR41 and SR42 are displayed in the right side display area 220).

  When it is determined in the end determination process of step S17 that the scroll display should be ended, the process of FIG. 6 ends. For example, when it is determined in the end determination processing that the display state of FIG. 10 has been reached, it is determined that the scroll display should be ended. Further, also when the drag operation is interrupted before reaching the display state of FIG. 10, it is determined that the scroll display should be ended. Furthermore, before reaching the display state of FIG. 10, a drag and drop operation on a desired icon (for example, an operation to drop the icon L21 moved in the upper right direction by the drag operation to the trash can icon L14) is completed. Also, it is determined that the scroll display should be ended.

  Thus, scroll display of the screens SC1 and SC2 is performed.

  When it is not determined in step S15 that the non-display area is to be displayed on touch panel 45 for only one of the two screens SC1 and SC2, the display state of the one screen is maintained. Ru. For example, when it is not determined in step S15 that the non-display area in the screen SC2 should be displayed on the touch panel 45, the display of the display target area in the screen SC2 on the touch panel 45 is maintained. In other words, of the screens SC1 and SC2, only the screen SC1 is subjected to the automatic scroll operation, and the screen SC2 is not subjected to the automatic scroll operation. Conversely, when it is not determined in step S15 that the non-display area in the screen SC1 is to be displayed on the touch panel 45, the display of the display target area in the screen SC1 on the touch panel 45 is maintained.

  As described above, when it is determined in step S15 that the non-display area in the screen SC1 should be displayed on the touch panel 45 when a specific user operation (such as a rightward drag operation) is detected in step S14, The automatic update operation of the display content on the touch panel 45 is started early. In other words, the display mode change operation for displaying the area including the non-display area in the screen SC1 on the touch panel 45 is started early.

  Specifically, the right end portion of the left display area 210 (in other words, the right end portion E1 of the display target area SL1) (FIG. 8) in accordance with the movement operation (rightward drag operation etc.) of one icon (L21 etc.). Automatic scroll display of screen SC1 is automatic by the time before the point when the icon of the 1st reaches the end E1 which exists in the moving destination direction (right direction) of the icon of the 1st). To be started. Thereby, the area including the non-display area in the screen SC1 can be automatically displayed on the touch panel 45. For example, immediately after a move operation (rightward drag operation) of one icon (L21 or the like) is detected, an area including the non-display area (SL21 and / or SL22) in the screen SC1 Automatically displayed on 210).

  Thus, the automatic scroll display of the screen SC1 is automatically started by the time point before one icon reaches the end E1. Therefore, in the case where the desired moving destination (icon L14 etc.) of the one icon is (virtually) in the non-display area (area SL22 etc.) in the screen SC1, the user can It is possible to visually recognize the non-display icon etc. relatively early (before the one icon reaches the end E1 existing in the moving destination direction of the one icon). Therefore, the user can obtain high operability.

  Similarly, the scroll display of the screen SC2 is automatically started in response to the moving operation (rightward dragging operation or the like) of one icon (L21 or the like). More specifically, the end of the left display area 210 is present at the movement destination direction (right direction) of the one icon (in other words, the right end E1 of the display target area SL1). The scroll display of the screen SC2 is automatically started by the time before the time when the one icon arrives. Thereby, the area including the non-display area in the screen SC2 can be automatically displayed on the touch panel 45. For example, immediately after a move operation (rightward drag operation) of one icon (L21 or the like) is detected, an area including the non-display area (SR41 and / or SR42) in the screen SC1 Displayed automatically at 220).

  Thus, the automatic scroll display of the screen SC2 is automatically started by the time before one icon reaches the end E1. Therefore, in the case where the desired moving destination (icon R13 etc.) of the one icon is present in the non-display area (area SR41 etc.) in the screen SC2, the user visually recognizes the desired moving destination relatively early. It is possible. Therefore, the user can obtain high operability.

<1-7. Modification of First Embodiment>
In the first embodiment, a display change operation for displaying an area including the non-display area in each screen SC1 and SC2 on the touch panel 45 immediately after the movement operation (rightward drag operation) of one icon (L21 etc.) Although the (automatic scroll display operation) is started here, the present invention is not limited to this. For example, one of the intermediate positions between the start position of the drag operation (the position of the icon L21) and the position of the right end of the left display area 210 (or a position closer to the front side than the intermediate position (the drag operation start side)) The display change operation may be started when the icon of. Alternatively, the position corresponding to the predetermined width (for example, the width of 1⁄4 of the left display area 210) in front of the position of the right end of the left display area 210 (or the position further front than the position) The display change operation may be started when the icon arrives.

  In the first embodiment and the like, when it is determined that the non-display area exists in each of the screens SC1 and SC2, it is always determined that the non-display area should be displayed on the touch panel 45. (Step S15) is not limited to this.

  For example, MFP 10 further determines the presence or absence of an icon (non-displayed icon) not displayed on touch panel 45 among the plurality of icons in screen SC1, and the non-display in screen SC1 is conditional on the presence of the non-displayed icon. It may be determined that the area should be displayed on the touch panel 45. In other words, even if the non-display area exists in the screen SC1, if there is no non-display icon in the screen SC1, it is not determined that the non-display area in the screen SC1 should be displayed on the touch panel 45 May be

  Further, MFP 10 also performs the non-display area on condition that a predetermined relation (predetermined relation) exists between the non-display icon in screen SC1 and the icon (L21 etc.) to be dragged. It may be determined that the touch panel 45 should be displayed. More specifically, when there is the possibility of performing related processing in response to the drag and drop operation to the first hidden icon of the one icon (in other words, the first hidden icon of the one icon) In the case where response processing can be executed in response to the operation dropped on the upper side), it may be determined that the predetermined relevance is present, and it may be determined that the non-display area should be displayed on the touch panel 45.

  In other words, even if the non-display icon exists in the screen SC1, if there is no predetermined relationship between the non-display icon and the drag target icon (L21 etc.), the screen SC1 is displayed. It may not be determined that the non-display area should be displayed on the touch panel 45.

  For example, when it is determined that there is a relationship between the two when the related process corresponding to the drag operation (drag and drop operation) for dropping the operation target icon onto the non-display icon can be executed. Good. More specifically, in the application indicated by the non-display icon, when file format conversion processing etc. (related processing) can be performed on the electronic file indicated by the icon of the operation target, there is a relationship between the two. Then, it may be determined. In addition, when deletion processing (related processing) of the electronic file indicated by the icon of the operation target is performed by the drop operation to the “trash box” folder indicated by the non-display icon, there is a relationship between the two. Then, it may be determined.

  Similarly, MFP 10 further determines the presence or absence of an icon (non-displayed icon) not displayed on touch panel 45 among the plurality of icons in screen SC2, and the non-displayed icon is not displayed in screen SC2. It may be determined that the display area should be displayed on the touch panel 45. Furthermore, the MFP 10 can touch the non-display area in the screen SC2 as a touch panel also on condition that a predetermined relationship exists between the non-display icon in the screen SC2 and the icon (L21 etc.) to be dragged. It may be determined that it should be displayed at 45.

  If the non-display area in screen SC1 is not determined to be displayed on touch panel 45 based on various determination methods, MFP 10 preferably maintains the display of the display target area on screen SC1 in touch panel 45. And the non-display area in the screen SC1 is not displayed on the touch panel 45. The same applies to the screen SC2. Specifically, when the non-display area in screen SC2 is not determined to be displayed on touch panel 45 based on various determination methods, MFP 10 preferably displays the display target area in screen SC2 in touch panel 45. The display is maintained, and the non-display area in the screen SC2 is not displayed on the touch panel 45.

<2. Second embodiment>
In the first embodiment, the automatic scroll operation (operation in which the screen is automatically scrolled gradually) is started according to the start of the drag operation (step S16), but the invention is not limited to this. The reduced image display operation may be started in response to the start. In other words, a reduced image display operation may be performed as a display change operation for displaying on the touch panel 45 an area including the non-display area of the screen SC1 (, SC2).

  For example, in step S16, each icon in each screen may be transitioned from the state (see FIG. 8) initially displayed with a scaling factor of 100% to the state shown in FIG. FIG. 11 is a diagram showing a state in which the screens SC1 and SC2 are displayed in a reduced size. In FIG. 11, in the left side display area 210 of the touch panel 45, an area (non-display area) SL2 (SL21, SL22) which was not displayed on the screen SC1 immediately before the start of the drag operation. An area (specifically, the entire area of the screen SC1) including both of the area (displayed area) SL1 (SL11, SL12) which is displayed (visible) is displayed in a reduced size. In the right side display area 220 of the touch panel 45, the entire area of the screen SC2 is displayed in a reduced size.

  In the second embodiment, such an aspect will be described. The second embodiment is a modification of the first embodiment, and in the following, differences from the first embodiment will be mainly described.

  Also in the second embodiment, the composite image 300 (see FIGS. 7 and 8) is generated and displayed in steps S11 to S13 (FIG. 6). Thereafter, when a drag operation is detected in step S14 (an icon movement operation of a minute distance is detected), the process proceeds to step S15. Furthermore, when it is determined in step S15 that each non-display area of both screens SC1 and SC2 should be displayed on touch panel 45, step S16 (Note that step S16 according to the second embodiment is also described as S16 b. Go to).

  In step S16b, the composite image 300 is updated, and the display content on the touch panel 45 is changed. Specifically, instead of the composite image of FIG. 8, a new composite image (reduced image) as shown in FIG. 11 is displayed on the touch panel 45. Thus, when the drag operation is detected in step S14, the display content of the touch panel 45 is immediately changed to the content as shown in FIG.

  In FIG. 11, the reduced image of the screen SC1 (specifically, the reduced image of the entire area of the screen SC1) is displayed in the left side display area 210, and the reduced image of the screen SC2 is displayed in the right side display area 220 (details , A reduced image of the entire area of the screen SC2 is displayed. Each reduced image is an image reduced to 50% only in the lateral direction. In other words, each of the screens SC1 and SC2 is reduced by the scaling factor of 50% only in the lateral direction (horizontal direction) (while maintaining the scaling factor of 100% in the vertical direction (vertical direction)) It is displayed. All information (all icons and the like) in the screen SC1 is displayed by the reduced image of the screen SC1, and all information (all the icons and the like) in the screen SC2 is displayed by the reduced image of the screen SC2.

  More specifically, the left display region 210 of the touch panel 45 includes a display target region SL1 (at the start of the drag operation) and a non-display region SL2 (at the start of the drag operation) of the screen SC1. The reduced image (here, the entire area of the screen SC1) is displayed. In the right side display area 220 of the touch panel 45, an area including the display target area SR3 (at the start of the drag operation) and the non-display area SR4 (at the start of the drag operation) of the screen SC2 (here, A reduced image of the entire area of the screen SC2 is displayed.

  The display content as shown in FIG. 11 is continuously displayed on the touch panel 45 until it is determined in step S17 that the drag operation is completed. Then, when it is determined that the drag operation is completed (for example, the target icon of the drag operation is dropped on the trash can icon L14 in the area SL22, etc.), the display content of the touch panel 45 is the display content of FIG. To the display contents of FIG. However, the present invention is not limited to this, and the display state of FIG. 11 may be continued even after completion of the drag operation. In that case, the display state of FIG. 8 may be restored in response to pressing of another button or pinch-out operation (enlargement operation) or the like in the left display area 210 (or right display area 220).

  In the second embodiment, when a drag operation is detected in step S14 (after step S15), the display content of the touch panel 45 is immediately changed (FIG. 8 → FIG. 11) (step S16). Not limited to this. For example, after the drag operation on one icon is detected in step S14, another time point before the point when the one icon reaches end E1 of display target area SL1 by the drag operation (for example, the time) The display content of the touch panel 45 may be changed (FIG. 8 → FIG. 11) by the time the one icon reaches the central position of the right half area SL12 of the display target area SL1).

<3. Third embodiment>
The third embodiment is a modification of each of the above-described embodiments (mainly the second embodiment). In the following, differences from the second embodiment will be mainly described.

  The third embodiment exemplifies a mode in which the composite image displayed immediately after the start of the drag operation is changed based on the start position and the direction of the drag operation. Specifically, in step S15 (see FIG. 6), the non-display area is displayed on the touch panel 45 on condition that the non-display area exists on the movement destination side (right or left etc.) of the drag operation target icon. It is judged that it should do. In detail, it is determined that the non-display area in the screen SC1 should be displayed on the touch panel 45 on condition that the non-display area in the screen SC1 exists on the movement destination side of the drag operation target icon. In addition, it is determined that the non-display area in the screen SC2 should be displayed on the touch panel 45 on condition that the non-display area in the screen SC2 exists on the movement destination side of the drag operation target icon.

  More specifically, in which of the screens SC1 and SC2 the drag operation target icon is present and whether the drag operation target icon is moved in the right direction (right side) or the left direction (left side) In response, it is determined whether or not each non-display area in each of the screens SC1 and SC2 should be displayed. Note that whether the icon of the drag operation target is moved in the right direction (right side) or the left direction (left side) may be determined based on the left and right direction component of the icon movement vector by the drag operation.

  12 to 15 are diagrams showing variations (combination examples) of display contents in the display areas 210 and 220 at the start of the drag operation. One of the four types of display contents in FIGS. 12 to 15 is displayed in advance on the touch panel 45 (see steps S11 to S13). In addition, in FIGS. 12-15, illustration of the icon in each area | region is abbreviate | omitted.

  FIG. 12 is a diagram showing the left half area SL1 of the screen SC1 displayed in the left side display area 210 of the touch panel 45 and the left half area SR3 of the screen SC2 displayed in the right side display area 220. . In FIG. 12, the right half area SL2 of the screen SC1 and the right half area SR4 of the screen SC2 are not displayed on the touch panel 45 at the start of the drag operation. That is, the regions SL2 and SR4 are non-display regions at the time of start of the drag operation. Also in FIG. 7, the display mode and the like similar to FIG. 12 are shown.

  FIG. 13 is a diagram showing the left half area SL1 of the screen SC1 displayed in the left side display area 210 and the right half area SR4 of the screen SC2 displayed in the right side display area 220 (FIG. 20). And see also Figure 21). In FIG. 13, the right half area SL2 of the screen SC1 and the left half area SR3 of the screen SC2 are not displayed on the touch panel 45 at the start of the drag operation. That is, the regions SL2 and SR3 are non-display regions at the time of start of the drag operation. Also in FIG. 20, the same display mode as that in FIG. 13 is shown. FIG. 21 is a diagram showing a specific display example (an example illustrated without omitting the icon) regarding the display mode of FIG.

  FIG. 14 is a diagram showing a state where the right half area SL2 of the screen SC1 is displayed in the left side display area 210 and the left half area SR3 of the screen SC2 is displayed in the right side display area 220. In FIG. 14, the left half region SL1 of the screen SC1 and the right half region SR4 of the screen SC2 are not displayed on the touch panel 45 at the start of the drag operation. That is, the areas SL1 and SR4 are non-display areas at the time of start of the drag operation.

  FIG. 15 is a diagram showing a state where the right half area SL2 of the screen SC1 is displayed in the left side display area 210 and the right half area SR4 of the screen SC2 is displayed in the right side display area 220. In FIG. 15, the left half region SL1 of the screen SC1 and the left half region SR3 of the screen SC2 are not displayed on the touch panel 45 at the start of the drag operation. That is, the regions SL1 and SR3 are non-display regions at the time of start of the drag operation.

  As described above, immediately before the start of the drag operation, one of the four types of display contents is displayed on the touch panel 45. In FIGS. 12 to 15, the respective icons in the display areas 210 and 220 at the time of two-screen display are displayed in the same size as the respective icons at the time of full-screen display (same size display (100% display)) It shall be. For example, each icon of the screen SC1 displayed in the left side display area 210 has the same size as each icon of the screen SC1 displayed on the entire touch panel 45. The same applies to the icons on the screen SC2.

  Thereafter, when the drag operation (icon movement) is detected (step S14), the display content of the touch panel 45 immediately after the start of the drag operation is determined based on the start position and the direction of the drag operation (step S14) 16 to 19). Then, when it is determined that the display mode of one of the screens SC1 and SC2 should be changed, the display content of the touch panel 45 is updated in step S16.

  FIG. 16 shows the case where the drag operation directed to the right is started from the position in the left display area 210 (screen SC1) (the start position of the drag operation = the inside of the left display area 210 and the direction of the drag operation = rightward). FIG. 9 is a view showing a composite image etc. displayed immediately after the start of the drag operation. In each row (the uppermost row to the fourth row from the top) of FIG. 16, when the drag operation is started from each of the four states of FIGS. 12 to 15, display is performed on the touch panel 45 immediately after the drag operation starts. The synthesized images (synthesized images after change) and the like are shown. The composite image of the touch panel 45 immediately before the start of the drag operation is shown in the left column of each row of FIG. 16, and the composite image of the touch panel 45 immediately after the start of the drag operation is shown in the right row of each row of FIG. Also in FIG. 16 (and FIGS. 17 to 19), the illustration of the icons in each area is omitted.

  In the right column at the top of FIG. 16, the icon (manipulation target icon) (for example, L21) of the drag operation (for example, in left side display area 210 (and in area SL1 (see FIG. 7)) from the state of FIG. A composite image (a composite image after change) which is displayed on the touch panel 45 immediately after the right-directed drag operation with respect to is performed is shown.

  When the drag operation is executed from the state shown in FIG. 12, the user can display an area (virtually or actually) on the movement destination side (right side) of the operation target icon (not displayed at the start of the drag operation). It is likely to want to move the operation target icon to the display area (including the display area). In particular, the user moves the operation target icon to an area virtually existing on the movement destination side (right side) of the operation target icon (the non-display areas SL2 and SR4 not displayed at the start of the drag operation). You may be hoping.

  Therefore, when the drag operation is started in the state of FIG. 12, the MFP 10 is (virtually or actually) located to the right of the start position of the drag operation among the four areas SL1, SL2, SR3, and SR4. The regions SL1, SL2, SR3, and SR4 (at least a part of which exist) are displayed on the touch panel 45 (see the top of FIG. 16). In other words, the non-display areas SL2 and SR4 are displayed on the touch panel 45 on the condition that the non-display area SL2 in the screen SC1 and the non-display area SR4 in the screen SC2 exist on the movement destination side of the operation target icon. It is determined that it should be done, and the regions SL1, SL2, SR3, SR4 including the non-display regions SL2, SR4 (immediately before the start of the drag operation) are displayed on the touch panel 45.

  More specifically, MFP 10 reduces the areas SL1 and SL2 to the left display area 210 (50% only in the horizontal direction (100% in the vertical direction)) and reduces the areas SR3 and SR4 to the right display area 220. (50% only in the horizontal direction (100% in the vertical direction)). According to this, even if the user desires a drag operation on any of the regions SL1, SL2, SR3 and SR4 displayed immediately after the drag operation detection, the user's desired destination icon is the touch panel 45 Is displayed on. In particular, the user can easily visually recognize the icon in the non-display area immediately before the start of the drag operation after the start of the drag operation, and high operability can be obtained. For example, in a case where a desired destination (icon L14 (or R14 or the like)) of the operation target icon L21 exists (virtually) in the non-display area SL2 (or SR4 or the like) in the screen SC1, the user It is possible to visually recognize a desired destination (non-display icon L14 (or R14 or the like)) very early.

  Further, in the second row from the top of FIG. 16, from the state of FIG. 13, the drag operation (for example, in the left display area 210 (and in the area SL1) is directed to the right with respect to the operation target icon (for example L21). A composite image (a composite image after change) displayed on the touch panel 45 immediately after the drag operation is performed is shown.

  When the drag operation is executed from the state of FIG. 13, the user places (virtually or actually) areas SL1, SL2, SR3, and SR4 (the drag operation starts) on the movement destination side (right side) of the operation target icon. There is a high possibility that the user wants to move the operation target icon to the non-display area SL2 and SR3 (which are not displayed at the time).

  Therefore, when the drag operation is started in the state of FIG. 13, it is determined that the non-display area SL2 in the screen SC1 and the non-display area SR3 in the screen SC2 should be displayed on the touch panel 45. The areas SL1, SL2, SR3 and SR4 including the non-display areas SL2 and SR3 in the above are displayed on the touch panel 45. Specifically, MFP 10 reduces the areas SL1 and SL2 to the left display area 210 (50% only in the horizontal direction (100% in the vertical direction)) and reduces the areas SR3 and SR4 to the right display area 220 ( 50% only in the horizontal direction (100% in the vertical direction)). According to this, it is possible to obtain the same effect as the effect by the display change operation at the top of FIG. For example, in the case where the desired moving destination (icon L14 (or R13 or the like)) of the operation target icon L21 exists (virtually) in the non-display area SL2 (or SR3 or the like) in the screen SC1, the user It is possible to visually recognize a desired destination (non-display icon L14 (or R13 or the like)) very early.

  In the third row from the top of FIG. 16, the drag operation (for example, the icon for the left display region 210 (and the region SL2) (operation target icon) (for example, L13 A composite image (a composite image after change) displayed on the touch panel 45 immediately after the right-directed drag operation (refer to FIG. 7)) is performed is shown.

  When the operation is executed from the state shown in FIG. 14, the user displays (when the drag operation is started, the region where the operation target icon exists (virtually or actually) on the movement destination side (right side) SL2, SR3, SR4 It is highly likely that the user wants to move the operation target icon to a non-displayed non-display area SR4). On the other hand, the operation is performed to an area virtually present on the opposite side (left side) to the movement destination side (right side) of the operation target icon (in particular, the non-display area SL1 etc. not displayed at the start of the drag operation) It is unlikely that the user would like to move the target icon.

  Therefore, when the drag operation is started in the state of FIG. 14, MFP 10 is configured to select all the areas SL2, SR3 and SR4 present on the right side of the start position of the drag operation (a non-display area SR4 immediately before the drag operation starts. Are displayed on the touch panel 45 (see the third row from the top of FIG. 16). In other words, it is determined that the non-display area SR4 should be displayed on the touch panel 45 on the condition that the non-display area SR4 in the screen SC2 is on the movement destination side of the operation target icon The areas SL2, SR3 and SR4 including the non-display area SR4 are displayed on the touch panel 45. More specifically, the MFP 10 displays the area SL1 in the same size (100% in the vertical direction and 100% in the horizontal direction) in the left display area 210, and reduces the areas SR3 and SR4 in the right display area 220 (horizontal direction). Only 50% (100% in the vertical direction)).

  According to this, even when the user desires a drag operation on any of the regions SL2, SR3 and SR4 displayed immediately after the drag operation detection, the user's desired destination icon is displayed. In particular, the user can easily visually recognize the icon in the non-display area immediately before the start of the drag operation, and high operability can be obtained. Further, in particular, in the left side display area 210, since the non-display state of the useless area SL1 is maintained and the same magnification display of the area SL2 is maintained, the area SL2 is displayed in a state in which it is easily visible.

  Further, in the lowermost row of FIG. 16, from the state of FIG. 15, the drag toward the right with respect to the operation target icon (for example, L13 (see FIG. 7)) in the drag operation (for example, in left side display area 210 (and in area SL2)) A composite image (a composite image after change) displayed on the touch panel 45 immediately after the operation is performed is shown.

  When the drag operation is executed from the state shown in FIG. 15, the user places (virtually or actually) areas SL2, SR3 and SR4 (at the start of the drag operation) at the movement destination side (right side) of the operation target icon. It is highly likely that the user wants to move the operation target icon to the non-displayed non-display area SR3).

  Therefore, when the drag operation is started in the state of FIG. 15, the non-display area SR3 is displayed on the touch panel 45 under the condition that the non-display area SR3 in the screen SC2 is on the movement destination side of the operation target icon. It is determined that it should be done, and the regions SL2, SR3 and SR4 including the non-display region SR3 immediately before the start of the drag operation are displayed on the touch panel 45. Specifically, the MFP 10 displays the area SL1 in the same size (100% in the vertical direction and 100% in the horizontal direction) in the left display area 210, and reduces the areas SR3 and SR4 in the right display area 220 (in the horizontal direction only). 50% (100% in the vertical direction)).

  According to this, it is possible to obtain the same effect as the effect by the display change operation in the third row from the top of FIG.

  FIG. 17 is a view similar to FIG. However, in FIG. 17, when the drag operation “left” is started from the position in the left display area 210 (the start position of the drag operation = the left display area 210 and the direction of the drag operation = left). 17 shows a composite image (see right column in FIG. 17) and the like displayed immediately after the start of the drag operation.

  When the drag operation is performed, a non-display area (non-display in the right-side display area 220) (virtually or actually) present on the opposite side (right side) to the movement destination side (left side) of the operation target icon It is unlikely that the user desires to move the operation target icon to the area). Therefore, in this case, the MFP 10 maintains the display content at that point in the right side display area 220 (without displaying the non-display area). For example, the display target area SR3 (or SR4) at the start of the drag operation is displayed continuously (as is) at the same magnification. According to this, in the right side display area 220, the non-display state of the useless area SR4 (or SR3) is maintained and the same magnification display of the area SR3 (or SR4) is maintained, so the area SR3 (or SR4) Is displayed in a state where it is easy to visually recognize (refer to each row right column in FIG. 17).

  On the other hand, when the drag operation is performed, an area (virtually or actually) existing on the movement destination side (left side) of the operation target icon (including a non-display area not displayed at the start of the drag operation)) It is highly likely that the user desires to move the operation target icon to and from.

  In particular, in the case where the drag operation directed to the left with respect to the icon in the area SL2 is started in a state where the area SL2 is displayed in the left display area 210 (see the third and lowermost rows from the top of FIG. 17), It may be desired to move the operation target icon to the non-display area SL1 which is not displayed at the start of the drag operation.

  Therefore, in this case, the MFP 10 displays on the left (specifically, the regions SL1 and SL2 including the non-display region SL1) that exist (virtually or actually) on the movement destination side (left) of the operation target icon. The display area is reduced in size in the area 210. In other words, it is determined that the non-display area SL1 should be displayed on the touch panel 45 on condition that the non-display area SL1 exists on the movement destination side (left side) of the operation target icon. Then, the regions SL1 and SL2 including the non-display region SL1 (immediately before the start of the drag operation) are displayed on the touch panel 45 (see the third right column and the lower right column from the top of FIG. 17). According to this, the user can easily visually recognize the icon in the non-display area SL1 immediately before the start of the drag operation, and high operability can be obtained.

  However, if the area SL1 (the left half area of the screen SC1) is displayed in the left side display area 210 and there is no non-display area on the movement destination side (left side) of the operation target icon in the area SL1. In the left display area 210, the current display target area SL1 is displayed continuously (as it is) at the same magnification (see the top right column and the second right column from the top in FIG. 17). . According to this, in the left side display area 210, since the non-display state of the useless area SL2 is maintained and the same magnification display of the area SL1 is maintained, the area SL2 is displayed in a state where it is easy to be visually recognized.

  When the above is summarized, the display operation as shown in FIG. 17 is performed.

  Specifically, when the drag operation “left” is started from the position in the left display area 210 in the state of FIG. 12, the area SL1 is continuously displayed at the same magnification in the left display area 210, and the right display is displayed. In the area 220, the area SR3 is continuously displayed at the same magnification (see the top right column in FIG. 17).

  When the drag operation is started in the state of FIG. 13, the area SL1 is continuously displayed at the same magnification in the left display area 210 and the area SR4 is continuously displayed at the same magnification in the right display area 220 (FIG. See the second row from the top of column 17)

  When the drag operation is started in the state of FIG. 14, the areas SL1 and SL2 are reduced in size (50% only in the horizontal direction (100% in the vertical direction)) in the left side display area 210, and in the right side display area 220. The area SR3 is displayed at the same magnification (see the third rightmost column from the top of FIG. 17).

  When the drag operation is started in the state of FIG. 15, the areas SL1 and SL2 are displayed in a reduced size (50% only in the horizontal direction (100% in the vertical direction)) in the left display area 210 and in the right display area 220. The area SR4 is displayed at the same magnification (see the bottom right column in FIG. 17).

  In FIG. 16 and FIG. 17, the case where the drag operation is started from the position in the “left display area 210” has been described. In detail, the case where the rightward drag operation is performed is described with reference to FIG. 16, and the case where the leftward drag operation is performed is described with reference to FIG.

  Conversely, even when the drag operation is started from the position in the “right side display area 220”, the operation based on the same idea (except for the point where the left and right are reversed) is performed.

  FIGS. 18 and 19 are diagrams showing a composite image and the like displayed immediately after the start of the drag operation when the drag operation is started from the position in the “right side display area 220”. FIG. 18 is a diagram for explaining the case where the left-directed drag operation is performed, and FIG. 19 is a diagram for explaining the case where the right-directed drag operation is performed.

  FIG. 18 shows a composite image and the like displayed immediately after the start of the drag operation when the drag operation “left” is started from the position in the “right side display region 220”.

  Specifically, as shown in the fourth row from the top of FIG. 18 (lower row), when the drag operation “left” is started from the position in the right display region 220 in the state of FIG. The areas SR3 and SR4 are reduced in size (50% only in the horizontal direction (100% in the vertical direction)) in the display area 220, and reduced in size (only 50% in the horizontal direction) in the areas SL1 and SL2 in the left display area 210. Direction 100%)).

  As shown in the second row from the top of FIG. 18, when the drag operation is started in the state of FIG. 13, the same display is performed. Specifically, the areas SR3 and SR4 are displayed in a reduced size (50% only in the horizontal direction (100% in the vertical direction) in the right side display area 220, and the areas SL1 and SL2 are displayed in a reduced size in the left display area 210 (horizontally Only the direction is 50% (100% in the vertical direction).

  As shown in the third row from the top of FIG. 18, when the drag operation (specifically, the drag operation “left” from the position in the area SR3) is started in the state of FIG. The area SR3 is displayed at the same size at 220, and the areas SL1 and SL2 are reduced at the left display area 210 (50% only in the horizontal direction (100% in the vertical direction)).

  As shown in the top row of FIG. 18, when the drag operation is started in the state of FIG. 12, the same operation is performed. Specifically, the area SR3 is displayed in the same size in the right side display area 220, and the areas SL1 and SL2 are reduced in size (only 50% in the horizontal direction (100% in the vertical direction)) in the left side display area 210.

  As described above, when the drag operation “left” is started from the position in the right side display area 220, the non-display area (SL1 or SL2) at the start of the drag operation is displayed in the left side display area 210. The user can easily visually recognize the icon in the non-display area immediately before the start of the drag operation, and high operability can be obtained.

  In particular, when the area SR4 is displayed in the right-side display area 220 at the start of the drag operation and the drag operation “left” is started from the position in the area SR4, the non-display area SR3 at the start of the drag operation Is displayed in the right side display area 220. Therefore, the user can easily visually recognize the icon in the non-display area SR3 immediately before the start of the drag operation, and high operability can be obtained.

  When the drag operation “left” is started from the position in the right side display area 220 (and the left half area SR3), the movement destination side (left side) of the operation target icon in the right side display area 220 It is determined that the non-display area at the start of the drag operation does not exist, and the display target area SR3 at the start of the drag operation is displayed in the right-side display area 220 as it is. In the right side display area 220, since the non-display state of the useless area SR4 is maintained and the same size display of the area SR3 is maintained, the area SR3 is displayed in a state where it is easily visible.

  Further, FIG. 19 shows a composite image or the like displayed immediately after the start of the drag operation when the drag operation “rightward” is started from the position in the “right side display region 220”.

  Specifically, as shown in the fourth row (bottom row) from the top of FIG. 19, in the state of FIG. 15, the drag operation “rightward” is started from the position in the right display region 220 (region SR4) In this case, the area SR4 is continuously displayed in the same size in the right side display area 220, and the area SL1 is continuously displayed in the same size in the left side display area 210.

  As shown in the second row from the top of FIG. 19, when the drag operation is started in the state of FIG. 13, the same display is performed. Specifically, the area SR4 is continuously displayed in the same size in the right side display area 220, and the area SL1 is continuously displayed in the same size in the left side display area 210.

  As shown in the third row from the top of FIG. 19, when the drag operation (specifically, the drag operation “rightward” from the position in the area SR3) is started in the state of FIG. At 220, the areas SR3 and SR4 are displayed in a reduced size (only 50% in the horizontal direction (100% in the vertical direction)), and the area SL2 is displayed at the same size in the left display area 210.

  As shown at the top of FIG. 19, when the drag operation is started in the state of FIG. 12, the same display is performed. Specifically, the areas SR3 and SR4 are reduced in size (50% only in the horizontal direction (100% in the vertical direction)) in the right side display area 220, and the area SL1 is displayed in the same size in the left side display area 210.

  As described above, when the “rightward” drag operation is performed from within the “right side display area 220”, the display content at that time is maintained in the left side display area 210 (each row in FIG. 19). See right column). According to this, in the left side display area 210, the non-display state of the useless area SL2 (or SL1) is maintained and the same magnification display of the area SL1 (or SL2) is maintained, so the area SL1 (or SL2) Is displayed in a state where it is easy to see.

  Further, in the case where the drag operation directed to the right with respect to the icon in the area SR4 is started in a state where the area SR4 is displayed in the right side display area 220 (see the second and lowermost rows from the top of FIG. 19), There is no non-display area on the movement destination side (right side) of the operation target icon in the area SR4. In this case, in the right side display area 220, the current display target area SR4 is displayed continuously (as it is) at the same magnification. According to this, in the right side display area 220, the non-display state of the useless area SR3 is maintained and the same magnification display of the area SR4 is maintained, so that the area SR4 is displayed in a state where it is easily visible.

  When the drag operation “rightward” is performed on the icons in the area SR3 in the state where the area SR3 is displayed in the right display area 220, the non-display area SR3 is displayed in the right display area 220. The regions SR3 and SR4 including the data are displayed in a reduced size (see the top right column and the third top right column in FIG. 19). According to this, the user can easily visually recognize the icon in the non-display area SR3 at the start of the drag operation, and high operability can be obtained.

<4. Fourth embodiment>
The fourth embodiment is a modification of each of the above-described embodiments and the like. In the following, differences from the first embodiment will be mainly described.

  In the above-described embodiments, the update of the display content of the touch panel 45 is started at a specific timing after the drag operation is detected, but the present invention is not limited to this. For example, the update start timing (automatic scroll start timing) of each of the display areas 210 and 220 may be changed according to the speed of the drag operation (in other words, the movement speed of the icon). In other words, the start timing of the display change operation for displaying the area including the non-display area at the start of the drag operation may be changed in accordance with the icon movement speed.

  In the fourth embodiment, such an aspect will be described. In the fourth embodiment, the following operation is performed in step S16 (FIG. 6).

  FIG. 22 is a diagram showing the relationship between the icon movement speed (more specifically, the icon movement speed in the left-right direction (X direction)) and the automatic scroll start timing.

  As shown in FIG. 22, when the icon movement speed in the left-right direction (X direction) is less than or equal to the value V1 (in the case of low speed movement) (see also FIG. 23) Automatic scrolling is started at the timing when the icon reaches a position P2 far away from the start position P0. The position P2 is a position on the icon movement destination side (the right side here) than the position P1 (described below). For example, position P2 is a predetermined width (for example, a width of 1⁄4 of the entire width of left display area 210) in front of the position of the right end (right end E1 of display target area SL1) of left display area 210. It is a position.

  On the other hand, if the icon movement speed in the X direction is the value V2 or more (in the case of high-speed movement) (see also FIG. 24), relatively early timing (specifically, position P1 relatively close to the drag start position P0) Automatic scrolling starts when the icon arrives. The position P1 is a position moved by a minute amount ΔP from the drag start position P0 in the direction of the drag operation (here, to the right). The distance from the icon movement start position P0 to the position P1 (X-direction distance) is smaller than the distance from the icon movement start position P0 to the position P2.

  Further, when the icon movement speed in the X direction has a value between V1 and V2, the start timing of the automatic scroll is determined according to the relationship defined by the curve in FIG. Specifically, as the icon movement speed increases, automatic scrolling is started relatively early. For example, when the icon moving speed in the X direction is the value V12, automatic scrolling is started at the timing when the operation target icon reaches the position P21 (see also FIG. 24). Here, the value V12 is an intermediate value between the values V1 and V2, and the position P21 is an intermediate position between the position P2 and the position P1.

  As described above, when the icon movement speed in the X direction is larger than a predetermined value (for example, V1 (or V12, V2 or the like)), the display change operation is performed earlier than when the icon movement speed is smaller than the predetermined value. (Auto scroll operation) is started. Thereby, the area including the non-display area can be displayed on the touch panel 45 relatively early.

  The above concept can be applied to both the automatic scroll operation for the left side display area 210 and the automatic scroll operation for the right side display area 220.

  When the user moves the operation target icon at a relatively high speed (in particular, faster than the value V2), the non-display area (the area not currently visible by the user) (for example, the area SL2 or the area SR4 (see FIG. 7)) It is highly likely that you have a request to move the operation target icon relative to the icon in the folder. In such a case, according to the operation according to the present embodiment, the automatic scroll is started at a relatively early timing, so the automatic scroll operation for visualizing the non-display area is started early, and the user is relatively early. It is possible to visually recognize a desired destination icon at timing.

  Conversely, when the user moves the operation target icon at a relatively low speed (particularly slower than the value V1), the possibility of moving the operation target icon over the currently displayed icon or the user may It is likely that you are not in a hurry to drag and drop operations. In such a case, according to the operation according to the present embodiment, since the start timing of the automatic scroll is relatively late, the update of the display content does not have to be changed quickly, and the user must perform his / her operation carefully Is possible.

  Although the above idea may be applied to both the automatic scroll operation for the left side display area 210 and the automatic scroll operation for the right side display area 220, the invention is not limited thereto, and the automatic scroll for the left side display area 210 It may be applied to only one of the operation and the automatic scroll operation on the right display area 220.

  In the fourth embodiment and the like, the aspect in which the start timing of the automatic scroll is changed according to the icon movement speed has been described, but the present invention is not limited thereto. The start timing of the embodiment and the third embodiment may be changed.

<5. Fifth embodiment>
The fifth embodiment is a modification of each of the above embodiments (mainly the third embodiment). Hereinafter, differences from the third embodiment will be mainly described.

  In the fifth embodiment, a non-display icon exists with respect to a screen (also referred to as a drag operation target screen) (for example, screen SC1) including a target icon (operation target icon) of a drag operation, and the non-display icon and the operation It is determined that the non-display area should be displayed on the touch panel 45 also on condition that a predetermined relationship exists with both of the target icon (L21 and the like) (step S15).

  Then, when a predetermined relationship exists between the non-display icon and the operation target icon related to the drag operation, a partial area (or the entire area) including the non-display icon in the drag operation target screen (for example, screen SC1) Are reduced and displayed with the reduction degree according to the virtual arrangement distance (described below) between the non-display icon and the operation target icon (step S16).

  Such a reduction display operation will be described with reference to FIGS. 26 and 27.

  FIG. 26 shows the same contents as FIG. 20, and FIG. 27 differs from FIG. 26 in the position etc. of the trash can icon in the screen SC1. In FIG. 26, the trash can icon L14 is virtually present in the rightmost column (the leftmost column to the fourth column) in the screen SC1 (see the display mode in the upper row and the second column from the left in FIG. 26). On the other hand, in FIG. 27, the trash can icon L51 is virtually present in the left column (the third column from the leftmost column) on the left side of the rightmost column in the screen SC1 (upper row in FIG. 27) See the display mode in the second column from the left). Note that the trash can icon (L14, L51) has a non-display state (not displayed) in any of the composite images (see the rightmost column) in FIG. 26 and FIG. 27 (see also the center column).

  For example, as shown in FIG. 26 (or FIG. 27), when the “trash” icon on the screen SC1 is not displayed on the touch panel 45, the operation target icon (for example, file icon L21) and the trash can icon L14 (or L51) A virtual distance (also referred to as a virtual arrangement distance) D (more specifically, a horizontal direction component Dx of the virtual arrangement distance) with respect to the virtual arrangement position is calculated. In other words, the position of the non-display icon (trash can icon L51) in the virtual image for scroll display on the screen SC1 (the image including the regions SL1 and SL2 (see the upper center row and the like in FIG. 26 (or FIG. 27)) A distance between the virtual image and the position of the operation target icon (L21) in the virtual image is calculated as a virtual arrangement distance D. Here, the distance D (Dx) is calculated after subtracting the distance in the display target area (for example, the area SL1). Thus, the distance from the boundary between the non-display area of the screen SC1 and the display target area to the virtual arrangement position of the non-display icon in the screen SC1 (specifically, the X-direction component thereof) is calculated as the distance D (Dx) It may be done. The distance D is also expressed as a required scroll amount for displaying a non-display area including the non-display icon in the screen SC1.

  Then, according to the curve of FIG. 25 (curve defining the relationship between the virtual arrangement distance D and the display magnification (magnification scaling factor)), the magnification ratio (reduction degree) according to the value of the value Dx is determined. For example, when the value Dx is a relatively large value D4, the scaling factor is determined to be 50% (a relatively large reduction degree), and when the value Dx is a relatively small value D3 (<D4), the scaling factor Is determined to be 66% (relatively small reduction).

  If the display content of FIG. 27 is displayed on the touch panel 45, the value Dx is a relatively small value D3 (<D4), and the scaling factor is determined to be 66%. On the other hand, when the display content of FIG. 26 is displayed on the touch panel 45, the value Dx is a relatively large value D4 (> D3), and the scaling factor is determined to be 50%.

  For example, the display content of FIG. 27 is displayed on the touch panel 45, and among the non-display icons in the screen SC1, only the trash can icon L51 (FIG. 27) is the icon having predetermined relevance with the operation target icon L21. I assume. In this case, the value Dx for the screen SC1 is determined to be the value D3, and the scaling factor for the screen SC1 is determined to be 66%.

  Then, as shown in FIG. 28, a reduced image of the screen SC1 with a scaling factor of 66% is displayed in the left display area 210 (step S16).

  In addition, among the non-displayed icons in the screen SC1, when there are a plurality of icons (related non-displayed icons) having a predetermined relationship with the operation target icon L21, a plurality of virtuals related to the plurality of related non-displayed icons The scaling factor may be determined based on the largest distance among the arrangement distances D. The plurality of virtual arrangement distances D are distances between each of the plurality of related non-display icons arranged in the screen SC1 and the operation target icon L21.

  As described above, the scaling factor of the screen SC1 is the non-display icon in the screen SC1 and all the non-display icons having a predetermined relationship with the operation target icon and the current display target area are displayed on the left display area 210. It is determined to a value (such as 66% or 50%) that can be displayed at one time.

  Note that if the display content as shown in FIG. 26 instead of FIG. 27 is displayed at the start of dragging, the scaling factor for the screen SC1 is determined to be 50% (and the scaling factor for the screen SC2 is also 50%). Is determined, and a screen as shown in FIG. 11 is displayed.

  Further, a separate operation (reduction operation) is performed on the screen SC2 (a screen different from the drag operation target screen). The scaling factor of the screen SC2 is determined separately from the scaling factor of the screen SC1. Here, when the non-display icon of the screen SC2 is present, the scaling factor of the screen SC2 is always determined to be 50%. Then, the screen SC2 is reduced at a reduction rate of 50% in the horizontal direction in the right side display area 220 (100% in the vertical direction) (see FIG. 28).

  These changed screens (reduced images and the like) may be displayed immediately after the start of the drag operation, as in the first embodiment and the like. However, the present invention is not limited to this, and the display timing of the changed screen (reduced image etc.) may be determined according to the speed of the drag operation as in the fourth embodiment and the like.

  According to the operation as described above, when there is a predetermined relationship (relevance) between the non-display icon in the screen SC1 and the operation target icon, the non-display icon is included in the entire area of the screen SC1. At least a part of the area, at least a part of the area reduced by the reduction degree according to the virtual arrangement distance D between the non-display icon and the operation target icon is reduced to the touch panel 45 (the left display area 210) Is displayed. More specifically, as the distance D is increased, the reduction is performed with a larger degree of reduction (a smaller value scaling factor). Since at least a part of the area is reduced at a reduction degree according to the distance D from the operation target icon to the non-display icon and the non-display icon is also displayed, the user can select the area including the non-display icon on the screen SC1. Can be viewed at an appropriate display magnification.

  Although the scaling factor of the screen SC2 and the scaling factor of the screen SC1 are determined individually in the above embodiment, the present invention is not limited to this. For example, the scaling factor of the screen SC2 is the same as the scaling factor of the screen SC1. The value may be determined. Alternatively, the scaling factor of the screen SC2 is a non-display icon in the screen SC2 and all of the non-display icons having a predetermined relationship with the operation target icon and the current display target area are displayed at one time in the right display area 220. It may be determined to a value (such as 66% or 50%) that can be displayed.

<6. Modified example etc>
As mentioned above, although embodiment of this invention was described, this invention is not limited to the thing of the content demonstrated above.

  For example, in the above embodiments, the scroll display in the horizontal direction (horizontal direction) is mainly performed in the screen. However, the present invention is not limited thereto, and the vertical direction (vertical direction) in the screen Even in the case where scroll display is performed, the above idea can be applied.

  In each of the above embodiments, the automatic scroll display operation is performed at the same timing as the first screen also with respect to the second screen (for example SC2) other than the first screen (for example SC1) to which the operation target icon belongs. Although (or an automatic reduction display operation) has been started, it is not limited to this. For example, after the point at which the operation target icon reaches the boundary between the first screen and the second screen, the scroll display operation (or reduction display operation) on the second screen may be started. More specifically, after both the point at which the operation target icon reaches the boundary between the first screen and the second screen and between the two ends of the display target area of the second screen in the scroll direction of the second screen The automatic scroll display operation or the like on the second screen is started by the time point before the operation target icon reaches the end E2 (see FIG. 8 etc.) far from the current position of the operation target icon. May be For example, immediately after the point at which the operation target icon reaches the boundary between the first screen and the second screen, an automatic scroll display operation or the like on the second screen may be started.

  Moreover, in the said each embodiment, although the aspect in which 2 screen display is performed in the touch panel 45 is illustrated, it is not limited to this. For example, the above concept can be applied to the case where only one screen is displayed on the touch panel 45 and the one screen is scrolled on a partial area (for example, the left display area 210) of the touch panel 45. More specifically, only a part of the one screen (for example, only the area SL1 of the screen SC1) is displayed on the left side display area 210 (see FIG. 7) of the touch panel 45 and on the right side display area 220. Even if nothing is displayed, it is possible to apply the above idea. In this case, the above idea may be applied only to the one screen. Alternatively, even when only a partial area of the screen SC1 is displayed in the entire area of the touch panel 45 (when the other area of the screen SC1 is not displayed), the above idea can be applied.

10 MFP (Information Processing Device)
20 Server Device 30 Image Forming Device 40 Operation Display 45 Touch Panel 210 Left Display Area 220 Right Display Area 300 Composite Image L21 Operation Target Icon L14, L51 Trash Can Icon L51 Trash Can Icon SC1 (for Image Forming Device) Screen SC2 (Server Device ) Left half area of screen SL1 screen SC1 Right half area of SL2 screen SC1 Left half area of SR3 screen SC2 SR4 Right half area of screen SC2

Claims (29)

An information processing apparatus,
Display means capable of scrolling the first screen including a plurality of icons in a predetermined direction;
A detection unit that detects a user operation to move one icon in the display target area in a state where only a partial area of the first screen capable of scroll display is displayed as the display target area;
A determination unit that determines whether or not a first non-display area, which is an area different from the display target area, of the first screen should be displayed on the display unit;
When it is determined that the first non-display area should be displayed on the display means when the user operation is detected, the end of the display target area is moved according to the moving operation of the one icon. An area including the first non-display area of the first screen by a time point before the time when the one icon reaches the end of the one icon in the movement destination direction. Display control means for starting a first display change operation for displaying on the display means;
An information processing apparatus comprising: In the information processing apparatus according to claim 1,
The determination means determines whether or not the first non-display area is present on the first screen, and when the first non-display area is present, the first non-display area is displayed An information processing apparatus characterized by determining that the information should be displayed on the means. In the information processing apparatus according to claim 1,
The determination means
While determining the presence or absence of a first non-display icon which is an icon not displayed on the display means among the plurality of icons,
An information processing apparatus characterized by determining that the first non-display area is to be displayed on the display means on condition that the first non-display icon is present. In the information processing apparatus according to claim 3,
The determination means indicates that the first non-display area should be displayed on the display means also on condition that a predetermined relationship exists between the one icon and the first non-display icon. An information processing apparatus characterized by determining. The information processing apparatus according to any one of claims 1 to 4.
The determination means determines that the first non-display area is to be displayed on the display means, on condition that the first non-display area exists on the destination side of the one icon. Information processing apparatus characterized by the above. In the information processing apparatus according to any one of claims 1 to 5,
When it is determined that the first non-display area is to be displayed on the display means when the user operation is detected, the display control means performs the display according to the moving operation of the one icon. In the first screen, the area including the display target area and the first non-display area is displayed before the time when the one icon reaches the end of the target area. An information processing apparatus characterized by reduced display on a means. In the information processing apparatus according to any one of claims 1 to 5,
When it is determined that the first non-display area is to be displayed on the display means when the user operation is detected, the display control means performs the display according to the moving operation of the one icon. An information processing apparatus characterized by automatically starting scroll display on the first screen by a time before the time when the one icon reaches the end of the target area. The information processing apparatus according to any one of claims 1 to 7.
The determination means determines whether the first non-display area is to be displayed on the display means when the user operation is detected.
When it is determined that the first non-display area should be displayed on the display means, the display control means starts the first display change operation immediately after the user operation is detected. Information processing apparatus characterized by the above. The information processing apparatus according to any one of claims 1 to 7.
The determination means determines whether the first non-display area is to be displayed on the display means when the user operation is detected.
When it is determined that the first non-display area should be displayed on the display means, the display control means moves the movement when the movement speed of the one icon in the predetermined direction is larger than a predetermined value. An information processing apparatus characterized in that the first display change operation is started earlier than when the speed is smaller than the predetermined value. In the information processing apparatus according to claim 4,
The display control means, when the predetermined relationship exists between the first non-display icon and the one icon, includes at least one of the first screen including the first non-display icon. A reduction area according to the distance between the position of the first non-display icon in the virtual image for scroll display on the first screen and the position of the one icon in the virtual image An information processing apparatus characterized by reducing and displaying at least a part of the reduced area on the display means. The information processing apparatus according to any one of claims 1 to 10.
The display control means maintains the display of the display target area on the display means when it is not determined that the first non-display area should be displayed on the display means when the user operation is detected. An information processing apparatus characterized in that the first non-display area is not displayed on the display means. The information processing apparatus according to any one of claims 1 to 11.
The display means has a first display area and a second display area adjacent to each other, and can scroll the first screen in the first display area, and An information processing apparatus characterized in that a second screen different from the first screen can be scrolled in the second display area. In the information processing apparatus according to claim 12,
The display means is shared by a first device and a second device provided in the information processing apparatus,
The first screen is a screen for performing display regarding the first device,
An information processing apparatus characterized in that the second screen is a screen on which display related to the second device is performed. In the information processing apparatus according to claim 12 or 13,
The determination means also determines whether or not a second non-display area, which is an area not displayed, of the second screen capable of scroll display should be displayed on the display means.
The display control means, when it is determined that the second non-display area should be displayed on the display means when the user operation is detected, the second non-display of the second screen An information processing apparatus characterized by executing a second display change operation for displaying an area including an area on the display means. In the information processing apparatus according to claim 14,
The determination means determines whether or not the second non-display area is present on the second screen, and when the second non-display area is present, the second non-display area is displayed An information processing apparatus characterized by determining that the information should be displayed on the means. In the information processing apparatus according to claim 14,
The determination means
Among the plurality of icons in the second screen, it is determined whether or not there is a second non-displayed icon not displayed on the display means.
An information processing apparatus characterized by determining that the second non-display area is to be displayed on the display means on condition that the second non-display icon is present. In the information processing apparatus according to claim 16,
The determination means indicates that the second non-display area should be displayed on the display means, also on condition that a predetermined relationship exists between the second non-display icon and the one icon. An information processing apparatus characterized by determining. The information processing apparatus according to any one of claims 14 to 17.
The determination means determines that the second non-display area is to be displayed on the display means, on condition that the second non-display area is present on the destination side of the one icon. Information processing apparatus characterized by the above. The information processing apparatus according to any one of claims 14 to 18.
The display control means, when it is determined that the second non-display area should be displayed on the display means when the user operation is detected, the display target area of the second screen and the second display area An area including the non-display area in the second display area of the display means. The information processing apparatus according to any one of claims 14 to 19.
When it is determined that the second non-display area is to be displayed on the display means when the user operation is detected, the display control means responds to the moving operation of the one icon. The second display change is performed before the time when the one icon reaches the end of the display target area of the one screen and the end of the one icon exists in the movement destination direction An information processing apparatus characterized by starting operation. In the information processing apparatus according to claim 20,
When it is determined that the second non-display area should be displayed on the display means, the display control means may start the second display change operation immediately after the user operation is detected. Information processing apparatus characterized by the above. The information processing apparatus according to any one of claims 14 to 20.
When it is determined that the second non-display area is to be displayed on the display means, the display control means has a moving speed of the one icon in the predetermined direction by the user operation larger than a predetermined value. At the same time, the second display change operation is started at a time earlier than the time when the moving speed is smaller than the predetermined value. The information processing apparatus according to any one of claims 14 to 19.
When it is determined that the second non-display area is to be displayed on the display means when the user operation is detected, the display control means responds to the moving operation of the one icon. After the time when the one icon reaches the boundary between the first screen and the second screen, the first one of both ends of the display target area of the second screen in the scroll direction of the second screen An information processing apparatus characterized in that the second display change operation is started by a time point before the time when the one icon reaches the end far from the current position of the icon. The information processing apparatus according to any one of claims 14 to 23.
The display control unit, when it is not determined that the second non-display area should be displayed on the display unit when the user operation is detected, the display target area in the second screen of the display unit An information processing apparatus characterized by maintaining the display of (1) and not displaying the second non-display area on the display means. A control method of the information processing apparatus,
a) displaying on the display means of the information processing apparatus a first screen including a plurality of icons and capable of being scrolled in a predetermined direction;
b) detecting a user operation to move one icon in the display target area in a state where only a partial area of the first screen capable of scroll display is displayed as the display target area; ,
c) determining whether to display a first non-display area, which is an area different from the display target area, of the first screen;
d) when it is determined that the first non-display area is to be displayed when the user operation is detected, the end portion of the display target area according to the moving operation of the one icon; The area including the first non-display area of the first screen is displayed by the time before the time when the one icon reaches the end of the one icon in the movement destination direction. Initiating a first display change operation for display on the means;
A control method comprising: In the control method according to claim 25,
The display means is
It has a first display area and a second display area adjacent to each other,
Shared by a first device and a second device provided in the information processing apparatus,
It is possible to scroll and display the first screen for displaying the first device in the first display area, and the second screen is different from the first screen, and the second screen is different from the first screen. It is possible to scroll and display a second screen for displaying the two devices in the second display area,
The control method is
e) determining whether or not a second non-display area which is an undisplayed area of the second screen capable of scroll display should be displayed on the display means;
f) When it is determined that the second non-display area should be displayed on the display means when the user operation is detected, an area including the second non-display area in the second screen Initiating a second display change operation for displaying on the display means;
A control method further comprising: In the control method according to claim 26,
Said step f) is
f-1) When it is determined that the second non-display area should be displayed on the display means when the user operation is detected, the first operation is performed according to the moving operation of the one icon. The second display change operation is performed by the time point before the time when the one icon reaches the end of the display target area of the screen, which is in the movement destination direction of the one icon. Step to start,
A control method characterized by comprising: In the control method according to claim 26,
Said step f) is
f-2) When it is determined that the second non-display area is to be displayed on the display means when the user operation is detected, the first operation is performed according to the movement operation of the one icon. After the time when the one icon reaches the boundary between the screen and the second screen, and in the both sides of the display target area of the second screen in the scroll direction of the second screen, the one icon Starting the second display change operation by a time point before the time when the one icon reaches the end far from the current position;
A control method characterized by comprising:   A program that causes a computer incorporated in the information processing apparatus to execute the control method according to any one of claims 25 to 28.

Images