JP2016071590A - Information processing apparatus, image forming apparatus, operation window creation program, and operation window creation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus that suppresses the occurrence of incorrect pressing of an operation button by a user due to reduced display of operation buttons and a situation where the operation buttons are difficult for the user to press, displays operation buttons that can easily pressed by the user without receiving a predetermined operation from the user, and can reduce an effect of the area (shape) of the displayed operation button on the shape of another operation button.SOLUTION: A window creation part 28, when the magnification variation ratio is smaller than a predetermined value, changes the type of the shape of an operation button satisfying predetermined conditions out of operation buttons included in a first operation window, instead of constantly changing the types of the shapes of all the operation buttons included in the first operation window.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an information processing apparatus, an image forming apparatus, an operation window generation program, and an operation window generation method.

In recent years, mobile terminals such as tablets and smartphones have been reduced in weight and size, and mobile terminals are used by many users.
However, as the weight and size of the mobile terminal are reduced, the area (display area) in which an image can be displayed on the operation display unit of the mobile terminal is also reduced, which may cause the following problems.
For example, when a database or application that was used on a mobile terminal that was miniaturized and was used on a mobile terminal before the miniaturization is used, the operation display unit is adapted to the display area of the miniaturized operation display unit. The displayed image and operation buttons are displayed in a reduced size as compared to the image and operation buttons displayed on the operation display unit before being downsized. If the operation buttons displayed in the operation display area are reduced and displayed, the user may make a mistake in pressing the operation buttons, or the operation buttons may be difficult for the user to press. .

  For such a problem, Patent Literature 1 discloses an operation display unit that displays a keyboard screen including a plurality of input keys for receiving a character input operation and a delete key for receiving an input character deletion operation; A storage unit for storing keyboard screen information for displaying the keyboard screen; reading the keyboard screen information to display the keyboard screen on the operation display unit; and controlling the display size of each of the plurality of input keys A control unit that, when the keyboard screen accepts an operation of deleting an erroneous character and an operation of inserting a corrected character at a previous input position of the erroneous character, And whether the correction character input keys are adjacent to each other, and the erroneous character input key and the correction character input key. Is determined to be adjacent to each other, the display size of the input key for the erroneous character is reduced and the display size of the input key for the corrected character is increased. .

JP 2013-025743 A

However, Patent Document 1 has the following problems.
The character input device of Patent Document 1 displays input keys (operation buttons) that can be easily pressed by the user by accepting predetermined operations such as erroneous character input, deletion operation, and correction character input from the user. Before accepting input of erroneous characters, deletion operations, and input of corrected characters, operation buttons that are easy for the user to press were not displayed.
In addition, since the size of the keyboard screen that can display a plurality of operation buttons is determined, when the display size (area) of a certain operation button is enlarged, the area of another operation button adjacent to the enlarged operation button Is smaller than the area that should have been displayed. Since the area of the operation button displayed in a reduced size as described above is smaller than the area of the other adjacent operation buttons, it is difficult for the user to determine the operation button to be pressed, and the user presses the reduced operation button accurately. It was difficult to do. In other words, the area of an operation button affects the area of another operation button adjacent to an operation button, and as a result, an operation button that is difficult for the user to press accurately is displayed. .
In addition, the above-described problems are not limited to light-weight and miniaturized portable terminals. For example, a plurality of information processing apparatuses (for example, MFPs (Multi Functional Peripherals)) having different sizes of operation display units have the same FW. When operating with (FirmWare), the size of the display area of the operation display section is smaller than that of the other information processing apparatus. The same problem occurs in the form of displaying an operation window including operation buttons and images displayed on the operation display section.

  The present invention has been made in view of the above-described problems, and the operation buttons are reduced and displayed, causing the user to make a mistake in pressing the operation buttons, or the operation buttons are difficult for the user to press. Display the operation buttons that are easy for the user to press without accepting a predetermined operation from the user, and also influence the shape (shape) of the displayed operation buttons on the shape of other operation buttons. An object is to provide an information processing apparatus, an image forming apparatus, an operation window generation program, and an operation window generation method.

  (1) An information processing apparatus including a memory and a processor, where the processor displays a second operation window corresponding to the first operation window including an operation button on the operation display unit. According to the size of the display area in the operation display unit for displaying the operation window, the operation window in which the shape type of the predetermined operation button among the operation buttons included in the first operation window is changed is Switching between generation of a second window and generation of an operation window whose shape type is not changed for a predetermined operation button among the operation buttons included in the first operation window. An information processing apparatus characterized by that.

  (2) The processor changes the shape type of the predetermined operation button based on the size of the first operation window and the size of the display area in the operation display unit for displaying the second operation window. 2. The method according to 1 above, wherein the operation window is switched between generating a second operation window as a second window and generating as a second window an operation window whose shape type for a predetermined operation button is not changed. Information processing device.

  (3) In the second window in which the shape type of the predetermined operation button is changed, the predetermined operation button has a shape so that a part of the predetermined operation button is extended outward. 3. The information processing apparatus according to 1 or 2, wherein the type is changed.

  (4) In the second window in which the shape type of the predetermined operation button is changed, the predetermined operation button has an expanded shape portion that does not overlap with other operation buttons adjacent to the predetermined operation button. As described above, the information processing apparatus according to 3 above, wherein the type of shape is changed.

  (5) In the second window in which the shape type of the predetermined operation button is changed, the shape type is changed using the long and thin button as the predetermined operation button. The information processing apparatus according to any one of the above.

  (6) When the first operation button included in the second operation window is pressed by the user, the processor generates an operation window in which the display form of the pressed first operation button is changed. The information processing apparatus according to any one of 1 to 5 above.

  (7) A state in which a second operation button other than the first operation button is pressed through a state in which any position of the second operation window is continuously pressed from a state in which the first operation button is pressed. 7. The information processing apparatus as described in 6 above, wherein the operation window is generated by changing the display form of the second operation button being pressed when the second operation button is pressed.

  (8) An operation display unit is further provided, and the processor determines a predetermined operation button of the operation buttons included in the first operation window according to the size of the display area in the operation display unit provided in the own device. An operation window whose shape type is changed is generated as a second window, or an operation window whose shape type is not changed for a predetermined operation button among the operation buttons included in the first operation window. The information processing apparatus according to any one of 1 to 7 above, wherein the second window is switched to be generated.

  (9) The information processing apparatus can communicate with another apparatus including the operation display unit, and the processor is included in the first operation window according to the size of the display area in the operation display unit included in the other apparatus. An operation window in which the shape type of the predetermined operation button among the operation buttons is changed is generated as the second window, or the predetermined operation button of the operation buttons included in the first operation window is 8. The information processing apparatus according to any one of the above 1 to 7, wherein an operation window whose shape type is not changed is generated as a second window.

  (10) An image forming apparatus comprising: the information processing apparatus according to any one of 1 to 9 above; and an image forming unit.

  (11) An operation window generation program executed by an information processing apparatus including a memory and a processor, wherein a second operation window corresponding to the first operation window including operation buttons is displayed on the operation display unit. In addition, depending on the size of the display area in the operation display unit for causing the processor to display the second operation window, the type of shape of the predetermined operation button among the operation buttons included in the first operation window is A modified operation window is generated as a second window, or an operation window whose shape type is not changed for a predetermined operation button among the operation buttons included in the first operation window is displayed as the second window. An operation window generation program characterized in that it is generated or switched as a window.

  (12) A method for generating an operation window in an information processing apparatus, wherein a second operation window is displayed when a second operation window corresponding to the first operation window including an operation button is displayed on the operation display unit. An operation window in which the shape type of a predetermined operation button among the operation buttons included in the first operation window is changed as a second window is generated according to the size of the display area in the operation display unit for Or switching between generation of an operation window whose shape type is not changed as a second window for a predetermined operation button among the operation buttons included in the first operation window. Operation window generation method.

An information processing apparatus, an image forming apparatus, an operation window generation program, and an operation window generation method according to the present invention, when displaying a second operation window corresponding to a first operation window including an operation button on an operation display unit, An operation window in which the shape type of a predetermined operation button among the operation buttons included in the first operation window is changed according to the size of the display area in the operation display unit for displaying the second operation window Is generated as a second window, or an operation window whose shape type is not changed is generated as a second window for a predetermined operation button among the operation buttons included in the first operation window. Switch between the buttons, so that the operation buttons may be pressed incorrectly and the operation buttons may be difficult for the user to press. Suppressed that become conditions, without accepting a predetermined operation from the user, and displays an operation button pressed for the user easily. Further, the influence of the displayed operation button shape on the shape of other operation buttons can be reduced.

1 shows a system configuration diagram of a display system 1 according to an embodiment of the present invention. FIG. 2 shows a hardware configuration diagram of the MFP 3. The hardware block diagram of the portable terminal 2 is shown. The functional block diagram of the function with which the portable terminal 2 is provided is shown. FIG. 2 shows a functional block diagram of functions provided in the MFP 3. (A) shows the screen which receives the instruction | indication of the remote connection of MFP3 from a user. (B) shows a screen including a list of connectable MFPs 3. (A) shows an example of the first operation window, (b) shows the second operation window when the scaling factor is 0.8, and (c) shows the scaling factor of 0.5. A second operation window when (A) shows an example of the operation button K81 included in the first operation window, (b) shows the operation button K81 shown in (a) with a magnification of 0.5, and (c ) Shows the shape of the operation button K81 shown in (a), which has been changed to an elliptical shape after changing the magnification by 0.5. (D) shows what changed operation type K81 shown in (a) by 0.5 times, and changed the shape type into the rectangle. (E) shows that the operation button K81 shown in (a) is scaled at a scaling factor of 0.5 and the shape type is changed to a rhombus. It is the figure which expanded the area | region containing the expansion part of the operation buttons K731 and K732 in FIG.7 (c). It is a flowchart explaining the process which the portable terminal 2 performs regarding the function which displays a 2nd operation window. It is a subroutine which shows the process which produces | generates a 2nd operation window. 10 is a flowchart for describing processing executed by MFP 3 with respect to a function of displaying a second operation window. The functional block diagram of the function with which the portable terminal 2 in the modification 1 is provided is shown. FIG. 9 shows a functional block diagram of functions provided in the MFP 3 in Modification 1; 10 is a flowchart for describing processing executed by the mobile terminal 2 with respect to a function of displaying a second operation window in Modification 1; 12 is a flowchart for describing processing executed by MFP 3 with respect to a function for displaying a second operation window in Modification 1; The functional block diagram of the function with which the portable terminal 2 in the modification 2 is provided is shown. FIG. 9 shows a functional block diagram of functions provided in the MFP 3 in Modification 2. 12 is a flowchart for describing processing executed by the mobile terminal 2 with respect to a function of displaying a second operation window in Modification 2. 12 is a flowchart for describing processing executed by MFP 3 with respect to a function of displaying a second operation window in Modification 2.

As described in the background art, when a conventional mobile terminal displays an operation window corresponding to the display area in the operation display unit, the operation buttons included in the operation window are difficult to be pressed by the user. There was a case.
Therefore, when the portable terminal 2 according to the present invention displays an operation window corresponding to the display area in the operation display unit 23, the shape type of the predetermined operation button included in the operation window is changed. It is made to display.

  Hereinafter, embodiments of the present invention will be described in detail.

(Embodiment)
The configuration and operation of the display system 1 according to the embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 shows a system configuration diagram of a display system 1 according to an embodiment of the present invention. In the display system 1, an operation window displayed on the operation display unit 14 of the MFP 3 (MFP: Multi Function Peripheral) is displayed on the operation display unit 23 of the mobile terminal 2 and displayed on the operation display unit 23 of the mobile terminal 2. Job settings and body settings, which will be described later, can be received from the user via the operation window.

  Referring to FIG. 1, a display system 1 is configured by connecting a plurality of MFPs 3 (MFPs 3A to 3C) and a portable terminal 2 as an information processing apparatus via a network 4 such as a LAN (Local Area Network). The Although FIG. 1 shows an example in which a plurality of MFPs 3 are connected by a wired LAN and the portable terminal 2 and the MFP 3 are connected by a wireless LAN, all devices may be connected by a wireless LAN. The network 4 is not limited to a LAN, but may be a WAN (Wide Area Network) or the Internet.

The MFP 3 can execute a copy job, a print job, a scan job, a fax job, and a box job, and an operation window for accepting settings related to the execution of these jobs (job settings) and settings of the MFP 3 main body (main body settings). Can be displayed on the operation display unit 14 of the MFP 3.
Further, the MFP 3 transmits information (operation window information) related to the operation window displayed on the operation display unit 14 of the own machine to the portable terminal 2 using, for example, a wireless LAN, and the operation display unit 23 of the portable terminal 2 transmits the information. A corresponding operation window can be displayed. Details of the operation window information will be described later.

  In the following description, the window displayed on the operation display unit 14 of the MFP 3 is referred to as a first operation window, and the first operation window is displayed in correspondence with the display area in the operation display unit 23 of the portable terminal 2. This operation window may be referred to as a second operation window.

  Job settings are settings related to job execution. For example, selection of paper size, selection of paper type, selection of paper tray, selection of print magnification, selection of fax transmission destination, stored in a box Data selection. The main body setting is a setting for the apparatus main body of the MFP 3, for example, setting of the size and type of paper loaded on the paper tray, and setting of color adjustment for the document reading unit 5 and the image forming unit 7. Etc.

  The print job includes a PC print for printing data transmitted from the portable terminal 2 and a media print for printing print data stored in a portable storage medium such as a USB (Universal Serial Bus) memory connected to the MFP 3. .

The scan job is a portable storage medium such as a USB memory in addition to scan transmission in which the scan data is transmitted to another device by a protocol such as Email, SMB (Server Message Block), or FTP (File Transfer Protocol). Scan-to-media to be stored in, and scan-to-box to store scan data in the box.

  The fax job is a job for fax-transmitting a scanned image read by the document reading unit 5 provided in the MFP 3. The box job is a job executed using data stored in a box (folder) included in the MFP 3. Specifically, a box print for printing the print data stored in the box (folder), a box transmission for transmitting the image data stored in the box to another device using a protocol such as Email, SMB, FTP, etc. Box-to-fax for fax transmission of stored image data is included.

The portable terminal 2 is a portable terminal such as a tablet terminal, and can display an operation window displayed on the operation display unit 14 of the MFP 3 in correspondence with a display area in the operation display unit 23 of the own device. it can.
When displaying the operation window of a certain MFP 3, the portable terminal 2 establishes a connection (remote connection) for displaying the operation window with the MFP 3. For example, the mobile terminal 2 transmits a connection request all at once to the devices on the network 4, displays a list of MFPs 3 that have responded to the connection request on the operation display unit 23, and remotely communicates with the MFP 3 selected by the user. Establish a connection.
When the portable terminal 2 acquires the operation window information from the MFP 3 and displays the operation window corresponding to the display area in the operation display unit 23, the shape of the predetermined operation button among the operation buttons included in the operation window is determined. Change the type to display.

  FIG. 2 shows a hardware configuration diagram of the MFP 3. The MFP 3 includes a control unit (processor) 8, a storage unit (memory) 9, a data IF (interface) unit 10, a document reading unit 5, an image processing unit 6, an image forming unit 7, and an operation display unit 14. 18 is connected.

  The control unit 8 mainly includes a CPU (Central Processing Unit), executes a program stored in the storage unit 9, and performs a data IF unit 10, a document reading unit 5, an image processing unit 6, an image forming unit 7, The function of the MFP 3 is realized by controlling the operation display unit 14.

  The storage unit 9 mainly includes a RAM (Random Access Memory), a ROM (Read Only Memory), a HDD (Hard Disc Drive), and the like. The storage unit 9 stores data necessary for realizing the functions of the MFP 3 including a program executed by the control unit 8. Data necessary for realizing the function of the MFP 3 includes, for example, information related to job settings and main body settings, and operation window information related to the first operation window. The HDD also realizes a function as a box.

  The data IF unit 10 transmits / receives data to / from the portable terminal 2, an external device (for example, a PC (Personal Computer)) or a storage medium. The LAN IF unit 11, the storage media IF unit 12, and the FAXIF unit 13 is included.

  The LANIF unit 11 transmits and receives data to and from the mobile terminal 2 connected to the LAN, the server, the PC, the mobile terminal, and other image forming apparatuses via a wired or wireless LAN. The storage media IF unit 12 acquires data from the portable storage medium or stores the data in the portable storage medium. The FAXIF unit 13 transmits and receives fax data via a fax line.

The document reading unit 5 optically reads a document conveyed to a reading position by an automatic document conveying device or an image of a document placed on a platen glass, generates read data, and stores the generated read data in a storage unit 9. Remember me.

  The image processing unit 6 performs rasterization processing on the print data acquired by the data IF unit 10 to generate raster data. Further, the image processing unit 6 generates raster data based on the fax data received by the FAXIF unit 13. In the following description, the read data generated by the document reading unit 5 and the raster data generated by the image processing unit 6 based on print data or fax data are collectively referred to simply as raster data. Furthermore, the image processing unit 6 performs image processing such as sharpness processing, smoothing processing, and color conversion processing on the raster data.

  The image forming unit 7 forms an image based on the raster data image-processed by the image processing unit 6. As an image forming method, for example, an electrophotographic method can be employed, and an ink jet method, a thermal transfer method, or the like can also be employed.

  The operation display unit 14 includes a display 15, a touch panel 16, and hard keys 17.

  The display 15 is a liquid crystal display (LCD (Liquid Crystal Display)), for example, and can display an operation window. The operation window includes, for example, a window that accepts job settings and body settings, and a window that displays job status.

  The touch panel 16 is provided on the liquid crystal display and detects a coordinate position pressed with a pen, a finger, or the like.

  The hard key 17 includes a numeric keypad and a start key. The numeric keypad is a key for accepting input of numbers and symbols, and the start key is a key for accepting start of job execution.

  FIG. 3 shows a hardware configuration diagram of the mobile terminal 2. The portable terminal 2 includes a control unit 19, a storage unit 20, a LANIF unit 21, and an operation display unit 23, which are connected via a bus 22.

  The control unit 19 is mainly composed of a CPU, and executes the program stored in the storage unit 20 to realize the function of the mobile terminal 2 by controlling the storage unit 20, the LANIF unit 21, and the operation display unit 23. .

  The storage unit 20 mainly includes a RAM, a ROM, an HDD, and the like. The storage unit 20 stores data necessary for realizing the functions of the mobile terminal 2 including the program executed by the control unit 19. Data necessary for realizing the function of the mobile terminal 2 includes information on the display area of the operation window.

  The LANIF unit 21 transmits / receives information to / from the MFP 3 via the network 4 such as a LAN. Specifically, the LANIF unit 21 acquires (receives) operation window information from the MFP 3, and transmits information (operation information) related to the operation received by the operation display unit 23 of the own machine to the MFP 3.

  The operation display unit 23 includes a display 24 and a touch panel 25.

The display 24 is a liquid crystal display (LCD (Liquid Crystal Display)), for example, and can display an operation window. The operation window includes, for example, a window that accepts job settings and body settings, and a window that displays job status.

  The touch panel 25 is provided on the liquid crystal display and detects a coordinate position pressed with a pen, a finger, or the like.

  FIG. 4 shows a functional block diagram of functions provided in the mobile terminal 2. The portable terminal 2 is shown in FIG. 4 by controlling the components shown in the hardware block diagram of FIG. 3 by the control unit 19 (processor) executing the program stored in the storage unit 20 (memory). Realize the function.

The remote connection unit 26 establishes a remote connection with one MFP 3 among the plurality of MFPs 3 included in the display system 1.
The remote connection unit 26 transmits a connection request all at once to the devices on the network 4 and identifies the MFP 3 that has returned the connection request as a connectable MFP 3.
For example, the remote connection unit 26 displays the screen illustrated in FIG. 6A on the operation display unit 23 and receives an instruction for remote connection of the MFP 3 from the user. The screen shown in FIG. 6A is displayed in response to, for example, the user pressing a predetermined key (icon or button) displayed by the operation display unit 23.
When the MFP 3 replies to a connection request related to remote connection, the remote connection unit 26 displays a screen including a list of connectable MFPs 3 as shown in FIG. The selection of the MFP 3 to be connected is received from the user.
The remote connection unit 26 establishes a connection with the selected MFP 3 when the user selects the MFP 3 by pressing the “connect” key corresponding to any MFP 3 on the screen shown in FIG. 6B.

  Returning to FIG. 4, the operation window information acquisition unit 27 acquires (receives) operation window information related to the first operation window from the MFP 3 that has established the remote connection. The operation window information regarding the first operation window is information for generating the second operation window displayed on the operation display unit 23. For example, the size of the first operation window (the number of pixels in the horizontal direction, the vertical) Information on the operation buttons included in the first operation window. The information regarding the operation button includes information regarding the size of the operation button, the position (coordinates) of the operation button in the operation window, the shape of the operation button, and the characters displayed corresponding to the operation button.

  The window generation unit 28 generates a second operation window to be displayed on the mobile terminal 2 based on the operation window information regarding the first operation window acquired by the operation window information acquisition unit 27. Details of a method for the window generation unit 28 to generate the second operation window will be described later.

  The window display unit 29 displays the second operation window generated by the window generation unit 28 in the display area of the operation display unit 23.

  The operation accepting unit 30 accepts operations related to job settings and main body settings from the user via the second operation window.

  The operation information transmitting unit 31 transmits information related to the operation received via the second operation window to the MFP 3 that has established the remote connection.

  A method for generating the second operation window by the window generator 28 will be described in detail below.

  The window generation unit 28 basically generates the second operation window by scaling the first operation window in accordance with the size of the display area of the operation display unit 23. Specifically, the window generation unit 28 determines the second operation window for the first operation window based on the size of the first operation window and the size of the display area for displaying the second operation window. Calculate the scaling factor. When the size of the display area is smaller than the size of the first operation window, the scaling factor is a value smaller than 1. When the size of the display area is larger than the size of the first operation window, the scaling factor is 1. It becomes a larger value.

  When the scaling factor is equal to or larger than a predetermined scaling factor (for example, 0.8 times or more), the window generating unit 28 simply scales the first operation window to generate a second window. On the other hand, when the magnification ratio is smaller than a predetermined magnification (for example, smaller than 0.8), the window generator 28 not only scales the first operation window but also includes the first operation window. The shape of the operation button is changed to generate a second window.

  Referring to FIG. 7, FIG. 7 (a) shows an example of the first operation window, and FIG. 7 (b) shows the second operation window when the scaling factor is 0.8. 7 (c) shows a second operation window when the zoom ratio is 0.5. When the scaling factor is 0.8, the window generation unit 28 generates the second window by simply multiplying the first operation window by 0.8, and when the scaling factor is 0.5. , After multiplying the first operation window by 0.5, the type of the operation button is changed to generate a second window. In FIG. 7C, the shape types of some of the operation buttons (K731 to K734) among the operation buttons (K731 to K737) included in the second operation window are changed. Of the operation buttons included in the operation window, which operation button shape type is to be changed will be described later.

  Referring to FIG. 8, FIG. 8A shows an example of the operation button K81 included in the first operation window, and FIG. 8B shows the operation button K81 shown in FIG. 8 (c) shows the shape of the operation button K81 shown in FIG. 8 (a) with the magnification changed by 0.5 and the shape type changed. .

As shown in FIG. 8C, the window generation unit 28 has a part of the operation buttons for the operation buttons before the change, in other words, the operation button K82 (FIG. 8B) that is simply scaled with the scaling factor. The shape type of the operation button is changed so that the shape is expanded outward. In FIG. 8C, the operation button before changing the type of the shape of the operation button (the operation button simply scaled with the scaling factor) is indicated by solid lines, and the expanded shape portion (extended portion) is indicated by hatching. Yes.
FIG. 8C shows an example in which the shape of the extended portion is an ellipse, but the shape of the extended portion is not limited to an ellipse, but a rectangle (FIG. 8D), a rhombus (FIG. 8E), An arbitrary shape such as a trapezoid (not shown) can be used.

  Here, when the scaling factor is smaller than the predetermined value, the window generation unit 28 does not always change the type of shape for all the operation buttons included in the first operation window, but the first operation. Of the operation buttons included in the window, the shape type of the operation button satisfying a predetermined condition is changed. Specifically, the window generation unit 28 changes the shape type of an elongated button among the operation buttons included in the first operation window. The long and narrow shape is defined as the value obtained by dividing the value of the long side by the value of the short side when the short side of the horizontal length and the vertical length of the operation button is the short side and the long side is the long side. This refers to the shape (for example, 5 or more).

Referring to FIG. 7, window generation unit 28 includes operation buttons K731 to K734 corresponding to K711 to K714 that are elongated operation buttons among the operation buttons (K711 to K717) included in the first operation window. The shape type of the operation buttons K735 to K737 corresponding to the other operation buttons (K715 to K717) is not changed.

  When changing the shape type of the operation button, the window generation unit 28 changes the shape type of the operation button so that the expanded portion does not overlap with another adjacent operation button.

  FIG. 9 is an enlarged view of the region including the extended portions of the operation buttons K731 and K732 in FIG. In FIG. 9, the shape before deformation of the operation button K731 is shown as K731-2, the extended part expanded to the upper side in the figure is shown as K731-1, and the extended part extended to the lower side in the figure is shown as K731-3. The same applies to the operation button K732, and repeated description will be omitted.

  When changing the type of the shape of the operation button K731, the window generation unit 28 sets the operation button K731-3 so that the lower extension K731-3 is provided in a range that does not overlap the shape K732-2 before the change of the operation button K732. Change the shape type. Further, when changing the type of the shape of the operation button K732, the window generation unit 28 operates the operation button so that the upper extended portion K732-1 is provided in a range that does not overlap the shape K731-2 before the change of the operation button K731. Change the shape type.

  Further, the window generation unit 28 changes the type of the shape of the operation button so that the extended portion K731-3 below the operation button K731 and the extended portion K732-1 above the operation button K732 do not overlap. In other words, the window generator 28 changes the shape type of the operation button so that the horizontal positions of the expanded portions of each other are shifted when the shape type of the operation button adjacent vertically is changed.

  In FIG. 7C, the type of the shape of the four operation buttons (K731 to 734) arranged in the vertical direction is changed, but the expanded portion of each operation button is the shape before the change of the adjacent operation button and The shape of the operation buttons has been changed so as not to overlap the extended part.

  FIG. 5 shows a functional block diagram of functions provided in the MFP 3. The MFP 3 implements the functions shown in FIG. 5 by controlling the components shown in the hardware block diagram of FIG. 2 by causing the control unit 8 to execute the program stored in the storage unit 9.

  The remote connection unit 32 establishes a remote connection with the mobile terminal 2. Specifically, when the remote connection unit 32 receives a connection request from the mobile terminal 2, if the own device is in a state where remote connection is possible, the remote connection unit 32 replies to the mobile terminal 2. Then, in response to being selected as the remote connection target device in the mobile terminal 2, the remote connection is established with the mobile terminal 2.

  The operation window information acquisition unit 33 performs an operation related to the operation window (first operation window) corresponding to the state of the MFP 3 from the operation window information corresponding to the state that the MFP 3 can take stored in the storage unit 9. Get window information.

  The operation window information includes, for example, information on the size of the first operation window (the number of pixels in the horizontal direction and the number of pixels in the vertical direction) and operation buttons included in the first operation window. The information regarding the operation button includes information regarding the size of the operation button, the position (coordinates) of the operation button in the operation window, the shape of the operation button, and the characters displayed corresponding to the operation button.

  The operation window information transmission unit 34 transmits operation window information related to the first operation window corresponding to the state of the MFP 3 to the mobile terminal 2 that has established the remote connection.

  The operation information acquisition unit 35 acquires (receives) operation information transmitted from the mobile terminal 2 that has established a remote connection.

  10 to 12 are flowcharts for explaining processing related to the function of displaying the second operation window in the display system 1. FIGS. 10 and 11 are flowcharts executed by the mobile terminal 2. The mobile terminal 2 executes the processes described in FIGS. 10 and 11 when the control unit 19 (CPU) executes a program stored in the storage unit 20. Realize. FIG. 12 is a flowchart executed by the MFP 3. The MFP 3 implements the processing described in FIG. 12 by the control unit 8 (CPU) executing a program stored in the storage unit 9.

  With reference to FIG. 10, the process which the portable terminal 2 performs regarding the function to display a 2nd operation window is demonstrated.

  The portable terminal 2 waits until a remote connection is established with one MFP 3 of the plurality of MFPs 3 included in the display system 1 (NO in step S101), and establishes a remote connection with one MFP (step S101). (YES in S101), the process proceeds to step S102.

  The portable terminal 2 waits until the operation window information related to the first operation window is acquired from the MFP 3 that has established the remote connection (NO in step S102). When the operation window information is acquired (YES in step S102), the portable terminal 2 proceeds to step S103. Proceed to processing.

  The portable terminal 2 generates a second operation window based on the acquired operation window information (step S103).

  FIG. 11 is a subroutine showing a process for generating the second operation window in step S103.

  The portable terminal 2 calculates the scaling factor based on the size of the first operation window included in the operation window information acquired in step S102 and the size of the display area in the operation display unit 23 (step S201).

  When the calculated scaling factor is not less than the predetermined value, that is, when the calculated scaling factor is greater than or equal to the predetermined value (NO in step S202), the mobile terminal 2 scales the first operation window with the calculated scaling factor and performs the second operation. An operation window is generated (step S207), and the subroutine processing of FIG. 11 is terminated (END). In other words, when the calculated scaling factor is not less than the predetermined value, the mobile terminal 2 ends the subroutine of FIG. 11 without changing the type of the shape of the operation button.

  On the other hand, when the calculated scaling factor is less than the predetermined value (YES in step 202), the process proceeds to step S203, and the portable terminal 2 scales the first operation window with the calculated scaling factor. Then, it is determined whether or not the operation button included in the first operation window satisfies a predetermined condition (step S204). Specifically, the mobile terminal 2 determines whether or not the operation button is an elongated button.

When the operation button satisfies a predetermined condition (YES in step S204), the portable terminal 2 changes the type of shape of the operation button (step S205). Specifically, as illustrated in FIGS. 8C to 8E, the mobile terminal 2 changes the type of the operation button shape so that a part of the operation button is expanded outward. . On the other hand, when the operation button does not satisfy the predetermined condition (NO in step S204), the process proceeds to step S206 without changing the shape type of the operation button.

  In step S206, the portable terminal 2 determines whether or not the processing for all the operation buttons included in the first operation window has ended, and when the processing for all the operation buttons has not ended (in step S206). NO), it returns to step S204, and repeats the process of step S204-step S206 until the process about all the operation buttons is complete | finished (it is YES at step S206).

  When the process for all the operation buttons is completed (YES in step S206), the mobile terminal 2 ends the process of the subroutine of FIG. 11 and returns to the flowchart of FIG. 10 (RETURN).

  Returning to the flowchart of FIG. 10, in step S104, the portable terminal 2 displays the generated second operation window in the display area of the operation display unit 23, and waits for an operation from the user (NO in step S105). . When an operation from the user is accepted (YES in step S105), it is determined whether the operation accepted from the user is an operation for canceling the remote connection with the MFP 3 (step S106). In step S106, YES), communication for canceling the remote connection is performed with the MFP 3, and the process of the flowchart of FIG. 10 is terminated (END).

  On the other hand, when the operation accepted from the user is not an operation for releasing the remote connection with the MFP 3 (NO in step S106), the portable terminal 2 transmits operation information corresponding to the accepted operation to the MFP 3 (step S107). Return to step S102. In step S102, the mobile terminal 2 waits until it acquires operation window information related to the new first operation window based on the operation information transmitted in step S107 (NO in step S102), and acquires the operation window information (step S102). Step S103 and subsequent steps are executed in the same manner as described above.

  The portable terminal 2 repeatedly executes the processes of steps S102 to S107 until receiving an operation for canceling the remote connection (YES in step S106).

  With reference to FIG. 12, processing executed by the MFP 3 regarding the function of the display system 1 displaying the second operation window will be described.

  The MFP 3 stands by until a remote connection is established with the mobile terminal 2 (NO in step S301), and when the remote connection is established with the mobile terminal 2 (YES in step S301), the process proceeds to step S302.

  The MFP 3 acquires operation window information related to the first operation window corresponding to the current state of the own device from the storage unit 9 (step S302), and transmits the acquired operation window information related to the first operation window to the portable terminal 2. (Step S303).

  The MFP 3 waits until operation information is acquired from the portable terminal 2 (NO in step S304). When the operation information is acquired from the portable terminal 2 (YES in step S304), the acquired operation information is remote from the portable terminal 2. It is determined whether the operation relates to the operation for releasing the connection (step S305), and when the acquired operation information relates to the operation for releasing the remote connection (YES in step S305), the remote connection with the portable terminal 2 is performed. Communication for canceling is performed, and the processing of the flowchart of FIG. 12 is terminated (END).

  On the other hand, when the received operation information is not related to the operation for releasing the remote connection (NO in step S305), the process returns to step S302, and operation window information related to a new first operation window is acquired based on the received operation information. (Step S302), the acquired operation window information is transmitted to the portable terminal 2 (Step S303), and the processing after Step S304 is executed in the same manner as described above.

  The MFP 3 repeatedly executes the processes of steps S302 to S305 until receiving operation information regarding the operation for releasing the remote connection (YES in step S305).

  In the display system 1 according to the embodiment of the present invention, the processor (control unit 8) included in the portable terminal 2 as the information processing apparatus corresponds to a first operation window that is displayed on the operation display unit 14 of the MFP 3. When the second operation window is displayed on the operation display unit 23 of the mobile terminal 2, the first operation is performed according to the size of the display area in the operation display unit 23 of the mobile terminal 2 for displaying the second operation window. An operation window in which the shape type of a predetermined operation button among the operation buttons included in the window is changed is generated as a second window, or a predetermined one of the operation buttons included in the first operation window With respect to the operation button, switching is made between generating an operation window whose shape type is not changed as the second window.

  When generating the second operation window to be displayed on the portable terminal 2 based on the operation window information regarding the first operation window acquired from the MFP 3 and the size of the display area of the own device, the second operation window for the first operation window is generated. When the scaling factor of the operation window is smaller than a predetermined value, the operation buttons included in the first operation window are not always changed instead of changing the shape type of all the operation buttons included in the first operation window. Since the type of the shape of the operation button that satisfies the predetermined condition is changed, the operation button that satisfies the predetermined condition is displayed in a scaled state, and the user may press the operation button incorrectly. Occurrence of a situation that is difficult to press can be suppressed, and the user can be prevented without accepting a predetermined operation from the user. It is possible to display the press easy to operate buttons.

  In addition, the display system 1 according to the embodiment of the present invention is configured so that when the mobile terminal 2 changes the shape type of the operation buttons adjacent to each other in the vertical direction, the horizontal positions of the extended portions are shifted from each other. Since the shape type is changed, the extended portions of the operation buttons adjacent in the vertical direction do not overlap, and the shape of the operation button can reduce the influence on the shape of the adjacent operation button.

  The ratio between the horizontal size of the display area of the first operation window and the horizontal size of the second operation window is equal to the vertical size of the display area of the first operation window and the second operation. Since the ratio may be different from the ratio of the vertical size to the window, the scaling factor of the second operation window relative to the first manipulation window may be set to an independent value for the scaling factor in the horizontal direction and the scaling factor in the vertical direction. good.

  Note that the shape of the expanded portion may be determined based on the shape of the operation button in the window after the first operation window is subjected to the scaling process.

The display area is not limited to a form that is uniquely determined based on the size of the display 15 of the operation display unit 14 of the MFP 3 or the display 24 of the operation display unit 23 of the portable terminal 2. For example, when the operation window is displayed on the entire surface of the display 24 of the mobile terminal 2, the display area is determined so as to correspond to the size of the display 24, and when the operation window is displayed with half the size of the display 24, The display area is determined so as to correspond to half the size of the display 24. This is because when the operation window is displayed in half the size of the display 24, the operation buttons included in the operation window may be difficult to be pressed by the user. The display area may be determined accordingly.

  The portable terminal 2 according to the embodiment of the present invention may be an MFP 3 including the hardware shown in FIGS. 1 and 2, that is, a certain MFP 3A (corresponding to the portable terminal 2 of the first embodiment) and another MFP 3B (implemented). In the display system 1 connected to the network 3 in the form 1), the size of the operation display unit 14 (operation display unit 14A) of one MFP 3A is the same as the operation display unit 14 (operation display unit) of another MFP 3B. 14B), and the MFP 3A displays a second operation window corresponding to the first operation window displayed on the operation display unit 14B by the other MFP 3B on the operation display unit 14A. Embodiments are applicable.

(Modification 1)
In the above-described embodiment, the mobile terminal 2 generates the second operation window to be displayed on the mobile terminal 2 based on the operation window information regarding the first operation window acquired from the MFP 3 and the size of the display area of the own device. However, in the first modification, the MFP 3 displays the information on the mobile terminal 2 based on the operation window information related to the first operation window stored in the own device and the information related to the display area acquired from the mobile terminal 2. A second operation window is generated, and operation window information related to the generated second operation window is transmitted to the mobile terminal 2.

  The configuration of the display system 1 and the hardware configurations of the portable terminal 2 and the MFP 3 are the same as those in FIGS.

  FIG. 13 shows a functional block diagram of functions provided in the mobile terminal 2. The portable terminal 2 implements the functions shown in FIG. 13 by controlling the components shown in the hardware block diagram of FIG. 3 by the control unit 19 executing the program stored in the storage unit 20.

  Compared with the functional block diagram (FIG. 4) of the portable terminal 2 in the above-described embodiment, the window generation unit 28 is eliminated and a display area information transmission unit 36 is added. Hereinafter, differences from the above-described embodiment will be mainly described.

  The operation window information acquisition unit 27 in the above-described embodiment acquires (receives) operation window information related to the first operation window from the MFP 3, but the operation window information acquisition unit 27 in the first modification example receives the second operation window information from the MFP 3. Acquires operation window information related to the operation window.

  Although the window display unit 29 in the above-described embodiment displays the second operation window generated by the window generation unit 28 included in the mobile terminal 2, the window display unit 29 in the first modification example is an operation window information acquisition unit. The second operation window is displayed on the basis of the operation window information regarding the second operation window acquired by 27.

  The display area information transmission unit 36 transmits information (display area information) related to the display area in the operation display unit 23 of the portable terminal 2 to the MFP 3. The display area information includes information regarding the size of the display area (the number of pixels in the horizontal direction and the number of pixels in the vertical direction) in the operation display unit 23.

  The functions of the remote connection unit 26, the operation reception unit 30, and the operation information transmission unit 31 are the same as those in the above-described embodiment, and repeated description is omitted.

FIG. 14 is a functional block diagram of functions provided in the MFP 3. The MFP 3 implements the functions shown in FIG. 14 by controlling the components shown in the hardware block diagram of FIG. 2 by the control unit 8 executing the program stored in the storage unit 9.

  Compared with the functional block diagram (FIG. 5) of the MFP 3 in the above-described embodiment, a window generation unit 28 and a display area information acquisition unit 37 are added. Hereinafter, differences from the above-described embodiment will be mainly described.

  The display area information acquisition unit 37 acquires display area information from the mobile terminal 2. As described above, the display area information includes information regarding the size of the display area (the number of pixels in the horizontal direction and the number of pixels in the vertical direction) in the operation display unit 23 of the mobile terminal 2.

  Window generation unit 28 generates a second operation window based on the operation window information relating to the first operation window corresponding to the state of MFP 3 at that time and the size of the display area in operation display unit 23 of portable terminal 2. To do. The operation window information related to the first operation window is stored in advance in the storage unit 9 in association with the states that the MFP 3 can take. Based on the operation window information relating to the first operation window and the size of the display area, the contents of the process for generating the second operation window are the same as those in the above-described embodiment, so that repeated description will be omitted.

  The operation window information transmission unit 34 transmits operation window information related to the second operation window generated by the window generation unit 28 to the mobile terminal 2 that has established the remote connection.

  The functions of the remote connection unit 32, the operation window information acquisition unit 33, and the operation information acquisition unit 35 are the same as those in the above-described embodiment, and repeated description is omitted.

  FIGS. 15 and 16 are flowcharts illustrating processing related to the function of the MFP 3 in the display system 1 transmitting operation window information related to the generated second operation window to the mobile terminal 2. FIG. 15 is a flowchart executed by the mobile terminal 2, and the mobile terminal 2 implements the processing described in FIG. 15 by the control unit 19 (CPU) executing the program stored in the storage unit 20. FIG. 16 is a flowchart executed by the MFP 3. The MFP 3 implements the processing described in FIG. 16 by the control unit 8 (CPU) executing the program stored in the storage unit 9.

  15, compared with the flowchart (FIG. 10) in the above-described embodiment, the display area information transmission process (step S402 in FIG. 15) is added before the operation window information acquisition process (step S102 in FIG. 10). Thus, the window generation process (step S103 in FIG. 10) is eliminated. Hereinafter, differences from the above-described embodiment will be mainly described.

  In the above-described embodiment, the portable terminal 2 waits until the operation window information related to the first operation window is acquired from the MFP 3 that has established the remote connection (NO in step S102), and acquires the operation window information (in step S102). YES), the process proceeds to step S103, but in the first modification, the portable terminal 2 transmits the display area information on the operation display unit 23 of the portable terminal 2 to the MFP 3 that has established the remote connection (step S402). The process waits until operation window information relating to the operation window is acquired (NO in step S403). When operation window information is acquired (YES in step S403), the process proceeds to step S404.

In the above-described embodiment, the mobile terminal 2 displays the generated second operation window in the display area of the operation display unit 23 and waits for an operation from the user (NO in step S105). In the first modification, the mobile terminal 2 displays the second operation window in the display area of the operation display unit 23 based on the acquired operation window information regarding the second operation window (step S404), and the operation from the user. (Step S405: NO).

  16, compared with the flowchart (FIG. 12) in the above-described embodiment, the display area information acquisition process (step S502 in FIG. 16) is performed before the operation window information acquisition process (step S302 in FIG. 12). In addition, a window generation process (step S504 in FIG. 16) is added before the operation window information transmission process (step S303 in FIG. 12). Hereinafter, differences from the above-described embodiment will be mainly described.

  In the above-described embodiment, the MFP 3 acquires operation window information related to the first operation window corresponding to the current state of the own device from the storage unit 9 (step S302), and acquires the acquired operation window information related to the first operation window. Is transmitted to the portable terminal 2 (step S303), but in the first modification, the MFP 3 acquires display area information from the portable terminal 2 with which the remote connection is established (step S502), and corresponds to the current state of the own device. The operation window information related to the first operation window obtained is acquired from the storage unit 9 (step S503), the operation window information related to the first operation window acquired in step S503, and the operation display unit of the mobile terminal 2 acquired in step S502 The second operation window is generated based on the size of the display area in FIG. Step S504), the generated operation window information for the second operating window, to the portable terminal 2 establishes a remote connection (step S505).

  The subroutine showing the processing for generating the second operation window by the MFP 3 is almost the same as that in FIG. 11, and the main subject of the operation has been changed from the portable terminal 2 to the MFP 3, and repeated description will be omitted.

  In the display system 1 according to the first modification, the processor (control unit 19) included in the MFP 3 as the information processing apparatus corresponds to the first operation window including the operation buttons to be displayed on the operation display unit 14 of the MFP 3. When the second operation window to be displayed is displayed on the operation display unit 23 of the portable terminal 2, the first operation window is displayed in accordance with the size of the display area in the operation display unit 23 of the portable terminal 2 for displaying the second operation window. An operation window in which a shape type of a predetermined operation button among the operation buttons included in the operation window is changed is generated as the second window, or among the operation buttons included in the first operation window Select whether to generate an operation window whose shape type is not changed as the second window for a given operation button. Obtain.

In the display system 1 according to the first modification, the MFP 3 displays the second on the portable terminal 2 based on the operation window information related to the first operation window stored in the MFP 3 and the display area information acquired from the portable terminal 2. And the operation window information related to the generated second operation window is transmitted to the mobile terminal 2, and the mobile terminal 2 performs the second operation based on the acquired operation window information related to the second operation window. The window is displayed in the display area of the operation display unit 23. When the MFP 3 generates the second operation window, if the scaling factor of the second operation window relative to the first operation window is smaller than a predetermined value, all of the first operation windows are always included in the first operation window. Instead of changing the shape type of the operation buttons, the shape type of the operation buttons satisfying a predetermined condition among the operation buttons included in the first operation window is changed, and this is changed to the second type of the mobile terminal 2. The operation window is displayed in the display area of the operation display unit 23. Therefore, when the operation button satisfying a predetermined condition is scaled and displayed, an error in pressing the user's operation button is generated, or the operation button is pressed. Occurrence of a difficult situation can be suppressed.

  Furthermore, since the MFP 3 generates the second operation window and the portable terminal 2 only displays the second operation window generated by the MFP 3, for example, a portable terminal having a CPU whose CPU processing performance is lower than that of the MFP 3. Even if 2 is used, a decrease in the processing speed of the mobile terminal 2 can be suppressed, so that it can be used without being limited to the performance of the mobile terminal 2.

  In the display system 1 according to the first modification, when the MFP 2 changes the shape type of the operation buttons adjacent to each other in the vertical direction, the shape type of the operation button is changed so that the horizontal positions of the extended portions are shifted from each other. Therefore, the operation buttons displayed in the display area of the operation display unit 23 of the portable terminal 2 do not overlap the extended portions of the operation buttons adjacent in the vertical direction, and the shape of the operation button affects the shape of the adjacent operation button. Never give.

  The portable terminal 2 according to the first modification may be an MFP 3 having the hardware shown in FIGS. 1 and 2, that is, a certain MFP 3A (corresponding to the MFP 3 according to the first modification) and another MFP 3B (this modification). In the display system 1 connected to the network 4 by the network 4, the size of the operation display unit 14 (operation display unit 14 B) of another MFP 3 B is the same as the operation display unit 14 (operation display of the MFP 3 A). A modification is also possible in which another MFP 3B displays a second operation window corresponding to a first operation window displayed on the operation display unit 14A by the MFP 3A on the operation display unit 14B. 1 is applicable.

(Modification 2)
In the above-described embodiment, the mobile terminal 2 generates the second operation window based on the operation window information regarding the first operation window acquired from the MFP 3 and the size of the display area of the own device. In the second modification, the mobile terminal 2 generates the second operation window based on the operation window information related to the first operation window stored in the own device and the size of the display area of the own device.

  The configuration of the display system 1 and the hardware configurations of the portable terminal 2 and the MFP 3 are the same as those in FIGS. In the mobile terminal 2 of the second modification, operation window information related to the first operation window is stored in advance in the storage unit 20 in association with the states that the MFP 3 can take.

  FIG. 17 shows a functional block diagram of functions provided in the mobile terminal 2. The portable terminal 2 implements the functions shown in FIG. 17 by controlling the components shown in the hardware block diagram of FIG. 3 by causing the control unit 19 to execute the program stored in the storage unit 20.

  Compared with the functional block diagram (FIG. 4) of the portable terminal 2 in the above-described embodiment, an MFP state information acquisition unit 38 is added. Hereinafter, differences from the above-described embodiment will be mainly described.

  The MFP state information acquisition unit 38 acquires information (MFP state information) indicating the state of the MFP 3 at that time from the MFP 3.

  Based on the MFP state information acquired by the MFP state information acquisition unit 38, the operation window information acquisition unit 27 selects from the operation window information related to the first operation window stored in advance in the storage unit 20 of the MFP at that time. First operation window information corresponding to the state is acquired.

The window generation unit 28 generates a second operation window based on the first operation window information corresponding to the state of the MFP 3 at that time acquired from the storage unit 20 and the size of the display area of the own device. .

  The functions of the remote connection unit 26, the window display unit 29, the operation reception unit 30, and the operation information transmission unit 31 are the same as those in the above-described embodiment, and repeated description will be omitted.

  FIG. 18 is a functional block diagram of functions provided in the MFP 3. The MFP 3 implements the functions shown in FIG. 18 by controlling the components shown in the hardware block diagram of FIG. 2 by the control unit 8 executing the program stored in the storage unit 9.

  Compared with the functional block diagram (FIG. 5) of the MFP 3 in the above-described embodiment, the operation window information acquisition unit 33 and the operation window information transmission unit 34 are eliminated, and an MFP state information transmission unit 39 is added. . The MFP state information transmission unit 39 transmits MFP state information indicating the state of the MFP 3 at that time to the portable terminal 2 that has established the remote connection. The functions of the remote connection unit 32 and the operation information acquisition unit 35 are the same as those in the above-described embodiment, and repeated description will be omitted.

  19 and 20, the portable terminal 2 in the display system 1 generates the second operation window based on the operation window information related to the first operation window stored in the own device and the size of the display area of the own device. It is a flowchart which shows the process regarding a function. FIG. 19 is a flowchart executed by the mobile terminal 2, and the mobile terminal 2 implements the processing described in FIG. 19 by the control unit 19 (CPU) executing a program stored in the storage unit 20. FIG. 20 is a flowchart executed by the MFP 3, and the MFP 3 implements the processing described in FIG. 20 by the control unit 8 (CPU) executing the program stored in the storage unit 9.

  19, compared with the flowchart (FIG. 10) in the above-described embodiment, the MFP status information acquisition determination process (step S602 in FIG. 19) is performed before the operation window information acquisition process (step S102 in FIG. 10). Is added, and the operation window information acquisition process (step S102 in FIG. 10) is not a determination process. Hereinafter, differences from the above-described embodiment will be mainly described.

  In the above-described embodiment, the portable terminal 2 waits until the operation window information related to the first operation window is acquired from the MFP 3 that has established the remote connection (NO in step S102), and acquires the operation window information (in step S102). YES), the process proceeds to step S103, but in the second modification, the MFP 3 that has established a remote connection waits until information indicating the state of the MFP 3 at that time is acquired (NO in step S602), and acquires MFP state information. Then (YES in step S602), based on the acquired MFP state information, the first corresponding to the state of the MFP at that time is selected from the operation window information related to the first operation window stored in advance in the storage unit 20. When the operation window information of 1 is acquired (step S603), the step Proceed to the 604 of the processing.

  20, compared with the flowchart (FIG. 12) in the above-described embodiment, an MFP status information transmission process (step S702 in FIG. 20) is added after the remote connection process (step S301 in FIG. 12). 12, the operation window information acquisition process (step S302) and the operation window information transmission process (step S303) are eliminated. Hereinafter, differences from the above-described embodiment will be mainly described.

In the above-described embodiment, the MFP 3 acquires operation window information related to the first operation window corresponding to the current state of the own device from the storage unit 9 (step S302), and acquires the acquired operation window information related to the first operation window. Is transmitted to the portable terminal 2 (step S303), but in the second modification, the MFP 3 transmits MFP state information indicating the state of the MFP 3 at that time to the portable terminal 2 that has established the remote connection (step S702). ).

  In the display system 1 according to the second modification, the processor (control unit 8) included in the mobile terminal 2 as the information processing apparatus includes a first operation button that is displayed on the operation display unit 23 of the mobile terminal 2. When the second operation window corresponding to the operation window is displayed on the operation display unit 23 of the portable terminal 2, the size of the display area in the operation display unit 23 of the portable terminal 2 for displaying the second operation window is set. Accordingly, an operation window in which the shape type of a predetermined operation button among the operation buttons included in the first operation window is changed is generated as the second window, or included in the first operation window. Whether to generate an operation window whose shape type is not changed as a second window for a predetermined operation button of the operation buttons Replace Ri.

  In the display system 1 according to the second modification, the mobile terminal 2 displays a second operation window to be displayed on the mobile terminal 2 based on the operation window information and display area information regarding the first operation window stored in the mobile terminal 2. If the scaling factor of the second operation window relative to the first operation window is smaller than a predetermined value, the type of shape is always changed for all the operation buttons included in the first operation window. Rather, among the operation buttons included in the first operation window, the shape of the operation button that satisfies the predetermined condition is changed and displayed in the display area of the operation display unit 23. It is possible to suppress the occurrence of incorrect pressing of the user's operation buttons due to the display of the buttons being scaled and the situation where it is difficult to press the operation buttons. Kill.

  The portable terminal 2 according to the second modification may be an MFP 3 including the hardware shown in FIGS. 1 and 2, that is, in the display system 1 including a certain MFP 3 </ b> A (corresponding to the MFP 3 according to the first modification). The modification 2 can also be applied to a mode in which the MFP 3A displays a second operation window corresponding to the first operation window displayed on the operation display unit 14A of a certain MFP 3A on the operation display unit 14A.

  Further, since the operation window information related to the first operation window of the MFP 3 is stored in advance in the storage unit 20 of the portable terminal 2, when displaying a predetermined operation window on the portable terminal 2 regardless of remote connection, The present invention can also be applied to the case where the first operation window stored in advance is displayed corresponding to the display area of the mobile terminal 2. In the form as described above, the operability can be improved with the same program in the portable terminal 2 having different display areas.

  The operation display unit 23 of the portable terminal 2 of the display system 1 according to the present embodiment and the first and second modifications 1 and 2 notifies that the operation button has received a press when the operation button has been received from the user. You may make it do. For example, the color of the pressed operation button is changed, or the pressed operation button is blinked.

  In the operation display unit 23 of the mobile terminal 2 of the display system 1 according to the present embodiment and the first and second modification examples, the portion that has been pressed by the user has been slid from a predetermined operation button to another operation button. When the operation button is received, the selected operation button may be changed from a predetermined operation button to another operation button.

Note that the mobile terminal 2 of the display system 1 according to the present embodiment and the first and second modifications 1 and 2 stores in advance a third operation window in which the type of the operation button is changed in association with the first operation window. In addition, an operation screen that allows the user to select the first operation window or the third operation window according to the magnification ratio is displayed on the operation display unit, and the operation window selected by the user (first or third operation window) ) May be changed to generate the second operation window.

1 Display system 2 Mobile terminal 3 MFP
4 Network 5 Document Reading Unit 6 Image Processing Unit 7 Image Forming Unit 8 Control Unit (Processor)
9 Memory (memory)
DESCRIPTION OF SYMBOLS 10 Data IF part 11 LNAIF part 12 Storage media IF part 13 FAXIF part 14 Operation display part 15 Display 16 Touch panel 17 Hard key 18 Bus 19 Control part (processor)
20 Memory unit (memory)
21 LNAIF unit 22 Bus 23 Operation display unit 24 Display 25 Touch panel 26 Remote connection unit 27 Operation window information acquisition unit 28 Window generation unit 29 Window display unit 30 Operation reception unit 31 Operation information transmission unit 32 Remote connection unit 33 Operation window information acquisition unit 34 Operation window information transmission unit 35 Operation information acquisition unit 36 Display region information transmission unit 37 Display region information acquisition unit 38 MFP state information acquisition unit 39 MFP state information transmission unit

Claims (12)

Memory,
An information processing apparatus comprising a processor,
The processor is
When a second operation window corresponding to the first operation window including the operation button is displayed on the operation display unit, according to the size of the display area in the operation display unit for displaying the second operation window. ,
Generating an operation window in which a shape type of a predetermined operation button among the operation buttons included in the first operation window is changed as the second window;
For a predetermined operation button of the operation buttons included in the first operation window, an operation window whose shape type is not changed is generated as the second window,
An information processing apparatus characterized by switching. The processor is
Based on the size of the first operation window and the size of the display area in the operation display unit for displaying the second operation window,
An operation window in which the shape type of the predetermined operation button is changed is generated as the second window, or an operation window in which the shape type of the predetermined operation button is not changed is the second window. The information processing apparatus according to claim 1, wherein the information processing device is switched as to whether or not to generate.   In the second window in which the shape type of the predetermined operation button is changed, the predetermined operation button has a shape such that a part of the predetermined operation button is expanded outward. The information processing apparatus according to claim 1, wherein the type is changed.   In the second window in which the shape type of the predetermined operation button is changed, the predetermined operation button includes a portion of the expanded shape and another operation button adjacent to the predetermined operation button. The information processing apparatus according to claim 3, wherein the shape type is changed so as not to overlap.   The shape type of the second window in which the shape type of the predetermined operation button is changed is changed using the long thin button as the predetermined operation button. 5. The information processing apparatus according to any one of 4. The processor is
When the first operation button included in the second operation window is pressed by a user, an operation window in which a display form of the pressed first operation button is changed is generated. Item 6. The information processing device according to any one of Items 1 to 5.   A state in which a second operation button other than the first operation button is pressed through a state in which any position of the second operation window is continuously pressed from a state in which the first operation button is pressed. The information processing apparatus according to claim 6, wherein an operation window in which a display form of the pressed second operation button is changed is generated when the second operation button is pressed. Further comprising the operation display unit,
The processor is
According to the size of the display area in the operation display unit provided in the own machine,
Generating an operation window in which a shape type of a predetermined operation button among the operation buttons included in the first operation window is changed as the second window;
For a predetermined operation button of the operation buttons included in the first operation window, an operation window whose shape type is not changed is generated as the second window,
The information processing apparatus according to claim 1, wherein the information processing apparatus is switched. The information processing apparatus can communicate with another apparatus including the operation display unit,
The processor is
According to the size of the display area in the operation display unit provided in the other device,
Generating an operation window in which a shape type of a predetermined operation button among the operation buttons included in the first operation window is changed as the second window;
For a predetermined operation button of the operation buttons included in the first operation window, an operation window whose shape type is not changed is generated as the second window,
The information processing apparatus according to claim 1, wherein the information processing apparatus is switched.   An image forming apparatus comprising: the information processing apparatus according to claim 1; and an image forming unit. An operation window generation program that is executed by an information processing apparatus including a memory and a processor,
When displaying the second operation window corresponding to the first operation window including the operation button on the operation display unit,
To the processor,
According to the size of the display area in the operation display unit for displaying the second operation window,
Generating an operation window in which a shape type of a predetermined operation button among the operation buttons included in the first operation window is changed as the second window;
For a predetermined operation button of the operation buttons included in the first operation window, an operation window whose shape type is not changed is generated as the second window,
An operation window generation program characterized in that the operation window is switched. An operation window generation method in an information processing apparatus,
When a second operation window corresponding to the first operation window including the operation button is displayed on the operation display unit, according to the size of the display area in the operation display unit for displaying the second operation window. ,
Generating an operation window in which a shape type of a predetermined operation button among the operation buttons included in the first operation window is changed as the second window;
For a predetermined operation button of the operation buttons included in the first operation window, an operation window whose shape type is not changed is generated as the second window,
An operation window generation method characterized by switching between the two.