JP6171650B2 - Image forming apparatus, control method, and control program - Google Patents

Description

  The present invention relates to an image forming apparatus, a control method, and a control program, and more particularly to an image forming apparatus that can be remotely operated by a remote panel, a control method, and a control program.

  A technique for displaying an operation screen of an image forming apparatus on another apparatus such as a terminal apparatus and remotely operating the image forming apparatus using the operation screen displayed on the other apparatus is known as a so-called remote panel. . In the remote panel, the image forming apparatus transmits image information for displaying an operation screen to another apparatus. The other apparatus transmits coordinate information representing the operation position to the image forming apparatus. The image forming apparatus specifies the operation content from the transmitted operation screen and the operation position obtained from the coordinate information, and executes processing according to the operation. Then, the image forming apparatus updates the operation screen according to the processing, and transmits image information for displaying the updated operation screen to the other apparatus.

Among the functions of the image forming apparatus, there is a function of performing an image forming process in which security is ensured. In this function, for example, an image forming process such as print output is performed after the following operation is performed:
Operation for authentication of whether or not you are a registered user,
Operation for password authentication for each print job,
Password input operation set for each file such as encrypted file,
File specification operation in a folder that supports multiple files.

Japanese Patent Laid-Open No. 2001-318779 JP2012-212330A

  The above operations are not compatible with operations performed remotely from the image forming apparatus. This is because these operations can be directly performed on the image forming apparatus by the user, so that the user can directly receive the result of the image forming process, such as a printed matter. This is because the purpose is to prevent this.

  To solve such a problem, for example, a printer that has issued a print job when outputting a print job with a password called so-called confidential print disclosed in Japanese Patent Laid-Open No. 2001-31879 (Patent Document 1). A technique in which a print job is executed only after the password is input and a remote panel disclosed in Japanese Patent Application Laid-Open No. 2012-212330 (Patent Document 2) displays a screen corresponding to the distance from the printer on the portable terminal. Combining with technology can be considered. In other words, screen control is performed on the operation screen such that when another device is away from the image forming device, the screen for confidential print operation is not displayed on the other device but is displayed in the vicinity. Can be considered.

  However, such screen control has to be performed on a large number of operation screens, and there is a problem that processing becomes complicated.

  SUMMARY An advantage of some aspects of the invention is that it provides an image forming apparatus, a control method, and a control program capable of ensuring both security and the convenience of remote operation. Yes.

In order to achieve the above object, according to one aspect of the present invention, an image forming apparatus can communicate with another apparatus and transmit image information for displaying an operation screen to the other apparatus. The image forming process and the image forming process are performed according to the operation content for the operation screen specified from the coordinate information and the receiving means for receiving the coordinate information representing the operation position on the operation screen from another device. And processing means for updating the operation screen according to the above. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The determination means further determines, as an invalidation condition, whether or not the coordinates represented by the coordinate information are included in a dead area that is an area to which invalid coordinates set for a predetermined operation screen belong. The determination means stores insensitive areas in advance for each of a plurality of types of predetermined operation screens, switches the insensitive area for each operation screen transmitted by the transmission means, and the coordinates represented by the coordinate information from other devices are insensitive. It is determined whether it is included in the area.

According to another aspect of the present invention, the image forming apparatus is communicable with another apparatus, and transmitting means for transmitting image information for displaying an operation screen to the other apparatus, and the other apparatus. Receiving means for receiving coordinate information representing an operation position with respect to the operation screen, and executing the image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process Processing means. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The determination means further determines, as an invalidation condition, whether or not the coordinates represented by the coordinate information are included in a dead area that is an area to which invalid coordinates set for a predetermined operation screen belong. The predetermined operation screen is a screen for performing an operation for instructing image forming processing after inputting security information requiring authentication, and the insensitive area is for inputting the security information on the predetermined operation screen. And / or an area including a position for instructing image forming processing.

  Preferably, the transmission means transmits image information for displaying a screen obtained by synthesizing an image representing a dead area on the operation screen to another device.

According to another aspect of the present invention, the image forming apparatus is communicable with another apparatus, and transmitting means for transmitting image information for displaying an operation screen to the other apparatus, and the other apparatus. Receiving means for receiving coordinate information representing an operation position with respect to the operation screen, and executing the image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process Processing means. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The determination means further determines whether or not the invalidation condition is greater than the predetermined distance by comparing the distance between the other apparatus and a predetermined distance stored in advance.

  More preferably, the invalidating means ends the invalidating process when it is determined by the determining means that the distance to the other apparatus is smaller than a predetermined distance.

  Preferably, the transmission unit synthesizes a message screen stored in advance on the operation screen when the determination unit determines that the invalidation condition is satisfied, and adds other image information for displaying the combined screen. To the other device.

According to another aspect of the present invention, the image forming apparatus is communicable with another apparatus, and transmitting means for transmitting image information for displaying an operation screen to the other apparatus, and the other apparatus. Receiving means for receiving coordinate information representing an operation position with respect to the operation screen, and executing the image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process Processing means. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The determination unit stores an image feature amount of a predetermined operation screen in advance, and determines whether or not the operation screen is a predetermined operation screen by comparing with an image feature amount of the operation screen.

According to another aspect of the present invention, the image forming apparatus is communicable with another apparatus, and transmitting means for transmitting image information for displaying an operation screen to the other apparatus, and the other apparatus. Receiving means for receiving coordinate information representing an operation position with respect to the operation screen, and executing the image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process Processing means. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The image forming apparatus further includes display means for performing a process of displaying an interface for instructing the end of the invalidation process together with the operation screen.

According to another aspect of the present invention, the image forming apparatus is communicable with another apparatus, and transmitting means for transmitting image information for displaying an operation screen to the other apparatus, and the other apparatus. Receiving means for receiving coordinate information representing an operation position with respect to the operation screen, and executing the image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process Processing means. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The processing unit stores the coordinate information invalidated by the invalidating unit, and executes image forming processing based on the invalidated coordinate information when the invalidation condition is not satisfied.

According to another aspect of the present invention, the image forming apparatus is communicable with another apparatus, and transmitting means for transmitting image information for displaying an operation screen to the other apparatus, and the other apparatus. Receiving means for receiving coordinate information representing an operation position with respect to the operation screen, and executing the image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process Processing means. The processing means includes a determination means for determining whether or not the invalidation condition is satisfied, and an invalidity for executing processing for invalidating the coordinate information when the determination means determines that the invalidation condition is satisfied. Means. The determination unit determines whether the operation screen is a predetermined operation screen as the invalidation condition. The predetermined operation screen is a screen including an input field for security information that requires authentication.

According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. In the determining step, as an invalidation condition, it is further determined whether or not the coordinates represented by the coordinate information are included in a dead area to which the invalid coordinates set for a predetermined operation screen belong. including. In the determining step, a dead area is stored in advance for each of a plurality of types of predetermined operation screens, the dead area is switched for each operation screen transmitted in the transmitting step, and coordinates represented by coordinate information from another device are displayed. Is included in the insensitive area.
According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. In the determining step, as an invalidation condition, it is further determined whether or not the coordinates represented by the coordinate information are included in a dead area to which the invalid coordinates set for a predetermined operation screen belong. including. The predetermined operation screen is a screen for performing an operation for instructing an image forming process after inputting security information requiring authentication. The insensitive area is an area including a field for inputting security information and / or a position for instructing image forming processing on a predetermined operation screen.
Preferably, the transmitting step includes transmitting image information for displaying a screen obtained by combining an image representing a dead area on the operation screen to another device.
According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. The determining step further includes determining whether or not the disabling condition is greater than the predetermined distance by comparing a distance between the other apparatus and a predetermined distance stored in advance.
Preferably, the step of executing the invalidating process includes ending the invalidating process when it is determined in the determining step that the distance to the other device is smaller than a predetermined distance. .
According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. The step of determining includes storing an image feature amount of a predetermined operation screen in advance and determining whether the operation screen is a predetermined operation screen by comparing with an image feature amount of the operation screen.
According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. The control method further includes a step of displaying an interface for instructing the end of the processing to be invalidated together with the operation screen.
According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. The step of updating the operation screen stores the coordinate information invalidated by the step of executing the invalidation process, and when the invalidation condition is not satisfied, the image forming process is performed based on the invalidated coordinate information. Including executing.
According to another aspect of the present invention, the control method is a control method for an image forming apparatus that can communicate with another apparatus, and transmits image information for displaying an operation screen to the other apparatus. A step of receiving coordinate information representing an operation position on the operation screen from another device, a step of executing an image forming process according to an operation content on the operation screen specified from the coordinate information, and a step of updating the operation screen according to the image forming process Including. The step of updating the operation screen includes a step of determining whether or not the invalidation condition is satisfied, and a step of executing processing for invalidating the coordinate information when the invalidation condition is satisfied. The step of determining includes determining whether or not the operation screen is a predetermined operation screen as the invalidation condition. The predetermined operation screen is a screen including an input field for security information that requires authentication.
Preferably, in the transmitting step, when it is determined in the determining step that the invalidation condition is satisfied, the message screen stored in advance on the operation screen is combined and image information for displaying the combined screen is displayed. To other devices.

According to still another aspect of the present invention, the control program causes the image forming apparatus to execute any one of the above control methods.

  According to the present invention, in remote control of an image forming apparatus called a so-called report panel, both security and convenience of remote operation can be achieved.

1 is a diagram illustrating a specific example of a configuration of an image processing system (hereinafter abbreviated as a system) according to an embodiment. It is a block diagram which shows the specific example of the apparatus structure of MFP (Multi-Functional Peripheral) and a terminal device contained in a system. It is a figure showing the flow of the remote panel. It is a figure which shows the specific example of the operation screen displayed on a terminal device. 6 is a diagram illustrating a specific example of an operation screen of an MFP. FIG. 6 is a diagram illustrating a specific example of an operation screen of an MFP. FIG. It is a figure showing the specific example of the setting information of a dead area. It is a figure which shows the specific example of the operation screen displayed on a terminal device. It is a block diagram which shows the specific example of a function structure of MFP and a terminal device. 3 is a flowchart illustrating an example of an operation flow in the MFP. FIG. 10 is a diagram illustrating a specific example of an operation screen displayed on an MFP according to a second modification.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of an image processing system (hereinafter abbreviated as a system) according to the present embodiment. Referring to FIG. 1, the system according to the present embodiment includes a plurality of MFPs (Multi-Functional Peripheral) 100A, 100B, 100C (representing these as MFP 100) as an example of an image forming apparatus. It includes a terminal device 300 as an example of another device that can communicate with the MFP 100. MFP 100 and terminal device 300 are connected to the Internet and communicate with each other via the Internet.

  The image forming apparatus included in this system is not limited to MFP 100. As long as the image forming apparatus has an operation panel including a touch panel, other apparatuses such as a printer, a copier, and a facsimile transceiver may be used. An MFP is an image forming apparatus having a combination of these functions.

  The terminal device 300 may be any device that can communicate with the MFP 100. As an example, it may be a portable information terminal or a mobile phone called a so-called handheld PC (personal computer), a small notebook personal computer (personal computer), or the like. Preferably, the terminal device 300 has a size that can be carried by a person.

  Communication between MFP 100 and terminal device 300 is not limited to the Internet. The communication may be wireless communication. For example, infrared communication such as Bluetooth (registered trademark), communication using a wireless local area network (LAN) such as WiFi communication, or short-range wireless communication such as NFC (Near Field Communication) may be used.

<Device configuration>
FIG. 2 is a block diagram showing a specific example of the device configuration of MFP 100 and terminal device 300 included in this system. Referring to FIG. 2, MFP 100 is a ROM that is a memory for storing a general control unit 10 including a CPU (Central Processing Unit) 10 </ b> A for controlling the entire apparatus and a program executed by the CPU 10 </ b> A. (Read Only Memory) 11, RAM (Random Access Memory) 12, which is a memory for storing various data and serving as a work area when the CPU 10A executes a program, a scanner unit 13, and a printer unit 14 A user interface unit 15, a panel control unit 16 for controlling the user interface unit 15 in accordance with control by the overall control unit 10, and an external interface (I / F) unit 17 that is an interface for connecting to the Internet The operation screen to be displayed on the user interface unit 15 is drawn And a VRAM (Video RAM) 18 is an eye of memory. The user interface unit 15 includes an operation panel 151, an operation touch panel 152, hard keys 153, and an external keyboard 154, which are connected to the panel control unit 16 and controlled.

  The terminal device 300 includes a control unit 30 including a CPU 30A for controlling the entire device, a ROM 31 which is a memory for storing a program executed by the CPU 30A, and various data or programs stored in the CPU 30A. RAM 32 that is a memory to be a work area for execution, touch panel 33 that is an input device including a touch panel, panel drawing unit 34 that is a display unit, and an external that is an interface for connecting to the Internet I / F unit 35.

<Overview of operation>
Terminal apparatus 300 can remotely operate MFP 100. This remote operation is also referred to as “remote panel”, and connection between the MFP 100 and the terminal device 300 for the remote panel is also referred to as “remote panel connection”. An application for a remote panel is installed in the terminal device 300, and the remote panel is started when the application is activated.

  FIG. 3 is a diagram showing the flow of the remote panel. Referring to FIG. 3, when terminal device 300 accepts a user operation and starts a remote panel application (step S1), terminal device 300 accesses designated MFP 100 and requests a remote panel connection (step S1). S2).

  In response to the request, MFP 100 generates image information for displaying the operation screen of MFP 100 according to its own remote panel program (step S3), and transmits the image information to terminal device 300 (step S4). ). The terminal device 300 displays an operation screen on the operation touch panel 152 based on the image information (step S5). Upon receiving a user operation (touch) on the displayed operation screen, terminal device 300 transmits coordinate information representing the touch position to MFP 100 (step S6).

  FIG. 4 is a diagram illustrating a specific example of the operation screen 500 displayed on the terminal device 300. Referring to FIG. 4, operation screen 500 displayed on terminal device 300 includes an operation screen 501 displayed on operation touch panel 152 of MFP 100 and an operation screen 502 representing hard keys 153 of MFP 100. The operation screen 502 is also referred to as an emulation area in the operation screen 500.

  When the coordinate information is received from the terminal device 300, the MFP 100 executes a process (invalidation determination process) for determining whether or not an invalid condition stored in advance is satisfied (step S7). If it is determined that the invalidation condition is not satisfied, the MFP 100 specifies the above-described operation content for the operation screen from the coordinate information, executes the image formation processing according to the operation, and updates the operation screen according to the image formation processing. (Step S8). If it is determined that the invalidation condition is satisfied, the MFP 100 executes a process of invalidating the coordinate information from the terminal device 300 (step S9). In this case, MFP 100 does not execute the image forming process according to the operation content specified based on the coordinate information.

  The “invalidation condition” refers to a condition that is a criterion for determining whether or not to invalidate the coordinate information from the terminal device 300. The first condition is that the target operation screen is a predetermined operation screen stored in advance. The predetermined operation screen is a screen including an area (password entry field, etc.) for inputting authentication information (security information requiring authentication), and image forming processing is performed after entering authentication information such as a password. This is a screen for performing an instruction operation. The authentication information corresponds to, for example, a user password or a password set for a job. Further, for example, it may be a data transmission destination selection button displayed after authentication. As an example, when the image information transmitted to the terminal device 300 displays the predetermined operation screen, the MFP 100 invalidates the coordinate information from the terminal device 300 as satisfying the invalidation condition.

  5 and 6 are diagrams showing specific examples of the operation screen of the MFP 100. FIGS. 5A and 5B show specific examples of the password input screen including the password input field. FIG. 6 shows a specific example of an operation screen that does not include an area for inputting authentication information such as a password input field.

  MFP 100 manages, for example, identification information (for example, screen ID) of “100”, “101”, and “102” associated with each screen. Then, as an invalidation condition (first condition) indicating whether or not the target operation screen is the predetermined operation screen, the MFP 100 determines that the target operation screen identification information is the password input screen identification information ( You may make it determine by whether it corresponds to "100" and "101"). As another example, MFP 100 stores in advance the feature amount (for example, luminance) of the region in which the authentication information is input, and the above authentication is performed when the feature amount stored in the operation screen is included. You may make it determine with it being the predetermined | prescribed operation screen containing the area | region which inputs information.

  As a second condition of the invalidation condition, the touch position represented by the coordinate information may be included in an area defined in advance for the operation screen. In other words, when the target operation screen is the predetermined operation screen, MFP 100 sets an area in which the operation is invalid as the “insensitive area” on the operation screen. In this case, when the image information transmitted to the terminal device 300 displays the predetermined operation screen and the touch position represented by the coordinate information from the terminal device 300 is included in the dead area, the MFP 100 The coordinate information from the apparatus 300 is invalidated as satisfying the invalidation condition. MFP 100 may store a dead area in advance for each operation screen, and switch and set the dead area according to the target operation screen. Alternatively, MFP 100 may specify an area to be a dead area for each operation screen.

  FIG. 7 is a diagram illustrating a specific example of the setting information of the insensitive area. Referring to FIG. 7, as an example, MFP 100 sets the coordinates of the area to be the insensitive area for each screen (screen ID: 100, 101, 102) in FIGS. 5A, 5B, and 6. Pre-set and memorize. In this example, since the screens (screen IDs: 100 and 101) in FIGS. 5A and 5B are password input screens, a dead area is set, and the screen in FIG. 6 (screen ID: 102). ) Is an operation screen that does not include an area for inputting authentication information, and no dead area is set.

  Alternatively, as another example, MFP 100 stores in advance a feature amount such as a luminance of a region to be a dead region in the operation screen. For example, when the screen of FIG. 5A and FIG. 5B is included in the operation screen and the area is set as the insensitive area, MFP 100 in FIG. 5A and FIG. 5B respectively. The feature amount such as the brightness of the region is stored, and the region indicating the feature amount in the target operation screen is specified as the insensitive region.

  Preferably, MFP 100 generates image information by synthesizing an image representing a dead area (for example, a mask image) on the operation screen when generating image information in step S3. FIG. 8 is a diagram illustrating a specific example of the operation screen displayed on the terminal device 300. The operation screen of FIG. 8 represents a specific example of the operation screen including the password input screen of FIG. In this case, the password input screen is displayed in a rectangular area whose diagonal is (X, Y) = (10, 10) and (X, Y) = (610, 410) on the operation screen. In this manner, since the rectangular area whose diagonal is (X, Y) = (10, 10) and (X, Y) = (610, 410) is set as the insensitive area, the MFP 100 in the operation screen 500 is displayed. The entire password input screen in FIG. 5B corresponding to the operation screen 501 displayed on the operation touch panel 152 is a dead area. MFP 100 generates the image information by synthesizing the mask image indicating that the password input screen of FIG. 5B is a dead area with the operation screen, so that terminal device 300 is shown in FIG. In this manner, the mask image is synthesized and displayed on the operation screen 501 (indicated by hatching in the example of FIG. 8). In this way, a dead area is displayed on the operation screen of the terminal device 300.

  Note that the dead area is set not only on the operation screen 501 displayed on the operation touch panel 152 of the MFP 100 on the operation screen 500 but also on the operation screen 502 representing the hard keys 153 of the MFP 100, that is, the emulation area. Also good. The dead area set as the emulation area corresponds to an area including an instruction position such as a button for instructing an image forming process such as a print instruction or a copy instruction. In this case as well, as in FIG. 7, MFP 100 may store the setting of the insensitive area for each operation screen at the position (coordinates) where it is displayed, or the name of hard key 153 to be set as the insensitive area (for example, “security”). Document button "etc.) may be stored. In this case, as shown in FIG. 4, a mask image 504 representing the insensitive area is combined with the button displayed in the emulation area and displayed.

  The third condition of the invalidation condition may be that the distance from the MFP 100 to the terminal device 300 is larger (distant) than a predetermined distance stored in advance. When the target operation screen is the above-described predetermined operation screen, or when the touch position on the terminal device 300 is included in the insensitive area, the MFP 100 determines whether the target operation screen is the above-described predetermined operation screen. Is larger than (or far from) the predetermined distance, the coordinate information from the terminal device 300 is invalidated as satisfying the invalidation condition.

  When the third condition is used as the invalidation condition, MFP 100 once determines that the invalidation condition is satisfied and performs the invalidation process. Thereafter, the distance from MFP 100 to terminal device 300 is the predetermined value. If it is determined that the distance is smaller (closer) than the distance, the invalidation process may be terminated.

  As an example, the MFP 100 measures the distance from the MFP 100 to the terminal device 300 by periodically collecting the values of the acceleration sensor (not shown) of the terminal device 300 as the moving direction and the moving amount of the terminal device 300 from a predetermined position. be able to. As another method, the MFP 100 may determine the distance to the terminal device based on whether or not the terminal device 300 exists within a communicable range with the terminal device 300, or the external I / F unit 17. The distance to the terminal device 300 may be measured (calculated) based on the strength of the communication with the terminal device 300 performed via the sensor, or the MFP 100 may detect a sensor (not In the case where (shown) is arranged, calculation may be performed based on a sensor signal from the sensor.

  If the MFP 100 determines that the distance to the terminal device 300 is longer than the predetermined distance, the MFP 100 may invalidate all coordinate information from the terminal device 300, or may combine the first to third conditions. When the operation target screen is a predetermined operation screen, or when the operation position belongs to the insensitive area, the coordinate information may be invalidated. Preferably, when the MFP 100 is invalidated based on the third condition, for example, as shown in FIG. 4, the reason is notified on the operation screen. That is, as an example, the MFP 100 may notify the user that the distance to the terminal device 300 is long, such as “Please approach the MFP” and display a message 503 prompting the user to approach the terminal device 300 on the operation screen.

<Functional configuration>
FIG. 9 is a block diagram showing a specific example of the functional configuration of MFP 100 and terminal device 300 for performing the above-described operation. Each function of FIG. 9 is realized mainly by the CPUs 10A and 30A by causing the CPUs 10A and 30A of the MFP 100 and the terminal device 300 to read out and execute the programs stored in the ROMs 11 and 31, respectively. Is. However, at least a part of the functions may be realized by a hardware configuration (not shown) such as an electric circuit.

  Referring to FIG. 9, CPU 10 </ b> A of MFP 100 includes an operation screen control unit 101 for performing a process of displaying operation screen 152 on operation touch panel 152 by changing operation screens in order and expanding the operation screen to be displayed on VRAM 18. Further, the CPU 10A displays a hard key image generation unit 106 for generating image information of the hard key 153 as a client function in the remote panel system, and an operation screen image displayed on the operation touch panel 152 developed in the VRAM 18. A hard key composition unit 107 for composing an image of the hard key 153, a message composition unit 110 for further composing a message representing the result of distance determination described later, and an image for displaying an operation screen A transmission unit 102 for transmitting information to the terminal device 300 via the Internet, and a screen determination unit 1031 for receiving coordinate information from the terminal device 300 and determining whether the invalidation condition described above is satisfied. Including the area determination unit 1032 and it is determined that the invalidation condition is satisfied. And a disabling processing unit 103 for executing a process of invalidating the coordinate information on the case. CPU 10A may further include a combining unit for further combining an image representing the insensitive area.

  The screen determination unit 1031 determines whether the operation screen that is the operation target of the terminal device 300 is the above-described predetermined operation screen when the transmission unit 102 transmits the image information. That is, the screen determination unit 1031 determines whether or not the first invalidation condition is satisfied. At this time, the screen determination unit 1031 obtains identification information (screen ID) of the operation screen that is the operation target in the terminal device 300 from the operation screen control unit 101 and compares it with the identification information stored in advance. It may be determined whether or not the operation screen is a predetermined operation screen. Alternatively, the screen determination unit 1031 stores in advance a feature amount such as the brightness of the password input field, and determines whether the operation screen that is the operation target of the terminal device 300 includes the feature amount. It may be determined whether or not is a predetermined operation screen.

  The CPU 10A of the MFP 100 further displays a dead area data storage unit 104 for storing information on a dead area set for each operation screen, as shown in FIG. For obtaining screen identification information (screen ID) from the operation screen control unit 101 and selecting a corresponding insensitive area from the insensitive areas stored in the insensitive area data storage unit 104 and inputting the insensitive area to the area determining unit 1032 A dead area selection unit 105. The area determination unit 1032 determines whether or not the operation position represented by the coordinate information from the terminal device 300 is included in the insensitive area set on the operation screen that is the operation target. That is, the region determination unit 1032 determines whether or not the second invalidation condition described above is satisfied.

  Preferably, CPU 10A of MFP 100 stores in advance a distance detection unit 108 for detecting the distance to terminal device 300 based on the communication strength with terminal device 300, and the distance to terminal device 300. A distance determination unit 109 for determining whether or not the distance is larger (far) than the predetermined distance and inputting the result to the invalidation processing unit 103. That is, the invalidation processing unit 103 determines whether or not the above-described third invalidation condition is satisfied.

  If the invalidation condition is satisfied, the invalidation processing unit 103 invalidates the coordinate information from the terminal device 300. That is, the operation position is not input to the operation screen control unit 101. Thereby, the operation screen control unit 101 does not perform screen transition in accordance with the operation on the terminal device 300.

  When the invalidation condition is not satisfied, the invalidation processing unit 103 inputs the operation position represented by the coordinate information to the operation screen control unit 101 without performing the invalidation processing. As a result, the operation screen control unit 101 changes the operation screen according to the operation on the terminal device 300. When the operation position belongs to the emulation area, the invalidation processing unit 103 inputs the operation target hard key to the hard key image generation unit 106. Accordingly, the hard key image generation unit 106 generates a hard key image obtained by changing the color of the operation target button. Further, the hard key image generation unit 106 inputs identification information (hard key ID, etc.) of the corresponding hard key to the operation screen control unit 101. As a result, the operation screen control unit 101 changes the operation screen according to the operation on the terminal device 300.

  Further, referring to FIG. 9, CPU 30 </ b> A of terminal device 300 provides a display unit 301 for displaying an operation screen on touch panel 33 based on image information from MFP 100 as a server function in the remote panel system, and touch panel 33. A coordinate input unit 302 for transmitting coordinate information representing the operation position to MFP 100 via the Internet.

<Overview of operation>
FIG. 10 is a flowchart illustrating an example of an operation flow in MFP 100. Here, as an example, the invalidation determination process is performed by combining all of the first invalidation condition to the third invalidation condition. Of course, only one invalidation condition may be used, or any two invalidation conditions may be used. In addition, as an example of the order in which the invalidation conditions are determined, the first invalidation condition → the third invalidation condition → the second invalidation condition is set, but the order is not limited to this.

  The operation shown in the flowchart of FIG. 10 is started when the terminal device 300 is remotely connected and image information for displaying an operation screen is requested from the terminal device 300. The operation of FIG. 10 is realized by the CPU 10A of the MFP 100 reading out the program stored in the ROM 11 on the RAM 12 and executing it, thereby exhibiting the functions of FIG.

  Referring to FIG. 10, when image information is requested from terminal device 300, CPU 10A transmits the image information on the operation screen to terminal device 300 via the Internet (step S101). When the input of coordinate information is received from the terminal device 300 (YES in step S103), the CPU 10A, as the first invalidation condition, security information that requires authentication that the operation screen to be operated is the predetermined operation screen. Is input, it is determined whether or not the screen is for performing an operation for instructing the image forming process.

  When the target operation screen is the predetermined screen (YES in step S105), that is, when the first invalidation condition is satisfied, the CPU 10A calculates the distance to the terminal device 300 (step S107), As a third invalidation condition, it is determined whether or not the distance is a predetermined distance or more.

  As a result, when the distance from the terminal device 300 is equal to or greater than the predetermined distance (YES in step S109), that is, when the first invalidation condition and the third invalidation condition are satisfied, the CPU 10A The operation position (touch position) is specified based on the coordinate information from the terminal device 300 (step S111). Further, the CPU 10A specifies a dead area set for the operation screen (step S113). Then, the CPU 10A determines whether the position is included in the dead area as the second invalidation condition (step S115).

  As a result, when the operation position is included in the insensitive area (YES in step S115), that is, when all of the first invalidation condition to the third invalidation condition are satisfied, the CPU 10A invalidates the coordinate information ( Step S117). At this time, CPU 10A preferably synthesizes message 503 such as “Please approach MFP” on the operation screen as shown in FIG. 4, and transmits the image information to terminal device 300 again (step S119). ). Then, the CPU 10A repeats the operation from step S107. As a result, even if it is determined that the distance to the terminal device 300 is greater than or equal to the predetermined distance and the coordinate information is invalidated, the terminal device 300 then approaches the MFP 100 and is closer than the predetermined distance. Then, the third invalidation condition is not satisfied, and the invalidation process is not performed. That is, the CPU 10A ends the invalidation process when the terminal device 300 is near.

  In the example of FIG. 10, when any one of the first to third invalidation conditions is not satisfied (NO in step S105, NO in step S109, or NO in step S115), The CPU 10A does not invalidate the coordinate information and executes a process according to the instruction specified by the coordinate information (step S121).

<Effect of Embodiment>
When the MFP 100 according to the present embodiment executes the above-described processing, a third party takes away or browses a result of image processing by a user directly operating the operation touch panel 152 of the MFP 100 main body. For a screen for performing, for example, a security printing operation called confidential printing or the like, which is intended to be prevented from being performed, the operation using the terminal device 300 is invalidated or a predetermined screen in the screen is displayed. It is possible to invalidate the operation or invalidate the remote operation from a position away from a certain distance. Thereby, in this system, when the MFP 100 is operated remotely using the remote panel system, both convenience and security can be ensured.

<Modification 1>
In the above example, the CPU 10A of the MFP 100 invalidates the coordinate information when the invalidation condition is satisfied. As another example, the coordinate information when the invalidation condition is satisfied may be temporarily stored, and when the invalidation condition is not satisfied, the process based on the coordinate information may be performed. In this way, user convenience can be increased.

<Modification 2>
As yet another example, when the invalidation condition is satisfied and the coordinate information is invalidated, the CPU 10A of the MFP 100 instructs the operation screen displayed on its own operation touch panel 152 to cancel the invalidation processing. Display a user interface (eg, buttons, etc.). FIG. 11 is a diagram illustrating a specific example of the operation screen 600 displayed on the MFP 100 according to the second modification. Referring to FIG. 11, as an example, CPU 10 </ b> A displays an “invalidation cancellation button” for instructing cancellation of invalidation processing on operation screen 600. When the CPU 10A accepts an operation (touch) on the button, the CPU 10A ends the invalidation process, and performs the process according to the coordinate information from the terminal device 300 thereafter. As a result, the operation for canceling the invalidation is always performed on the MFP 100 main body, so that the convenience of the user can be improved without sacrificing security.

<Modification 3>
Furthermore, a program for causing the CPU 10A of the MFP 100 to execute the above-described processing can be provided. Such a program can be recorded on a computer-readable recording medium such as a flexible disk, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program according to the present invention is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  10 overall control unit, 10A, 30A CPU, 11, 31 ROM, 12, 32 RAM, 13 scanner unit, 14 printer unit, 15 user interface unit, 16 panel control unit, 17, 35 external I / F unit, 18 VRAM, 30 control section, 33 touch panel, 34 panel drawing section, 100 MFP, 101 operation screen control section, 102 transmission section, 103 invalidation processing section, 104 dead area data storage section, 105 dead area selection section, 106 hard key image generation section , 107 Hard key composition unit, 108 Distance detection unit, 109 Distance determination unit, 110 Message composition unit, 151 Operation panel, 152 Operation touch panel, 153 Hard key, 154 External keyboard, 300 Terminal device, 301 Display unit, 302 Coordinate input Part, 500,501 502,600 operation screen 503 message, 504 mask images, 1031 screen determination unit 1032 area determination unit.

Claims (21)

An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
The determination means further determines, as the invalidation condition, whether or not the coordinates represented by the coordinate information are included in a dead area that is an area to which invalid coordinates set for the predetermined operation screen belong. Judgment,
The determination means stores the insensitive area in advance for each of a plurality of types of the predetermined operation screens, switches the insensitive area for each operation screen transmitted by the transmission means, and transmits the insensitive area from the other device. determines whether coordinates representative of the coordinate information is included in the dead region, images forming device. An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
The determination means further determines, as the invalidation condition, whether or not the coordinates represented by the coordinate information are included in a dead area that is an area to which invalid coordinates set for the predetermined operation screen belong. Judgment,
The predetermined operation screen is a screen for performing an operation for instructing an image forming process after inputting security information requiring authentication,
The dead region, the at predetermined operation screen, an area including a position indicating the column and / or the image forming processing for inputting the security information, images forming device. The transmission means transmits the image information for displaying a screen obtained by combining an image representing the dead space in the operation screen to the other device, an image forming apparatus according to claim 1 or 2. An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
Said determination means, as the revocation condition, further determines whether or not greater than the predetermined distance by comparing the predetermined distance is a distance with prestored between the other device, images Forming equipment. It said disabling means, said the distance between the other device is judged that becomes smaller than the predetermined distance in the determination means, and ends the processing of the revocation of claim 4 Image forming apparatus. An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
The determination unit stores an image feature amount of the predetermined operation screen in advance, and determines whether the operation screen is the predetermined operation screen by comparing with an image feature amount of the operation screen. , images forming device. An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
Further comprising a display means for performing a process of displaying an interface for instructing the end of processing of the revocation together with the operation screen, images forming device. An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
The processing means stores the coordinate information invalidated by the invalidation means, and executes an image forming process based on the invalidated coordinate information when the invalidation condition is not satisfied. , images forming device. An image forming apparatus capable of communicating with another apparatus,
Transmitting means for transmitting image information for displaying an operation screen to the other device;
Receiving means for receiving coordinate information representing an operation position with respect to the operation screen from the other device;
The image forming process is executed in accordance with the operation content for the operation screen specified from the coordinate information, and processing means for updating the operation screen according to the image forming process is provided.
The processing means includes
A determination means for determining whether or not the invalidation condition is satisfied;
Invalidating means for executing a process of invalidating the coordinate information when it is determined by the determination means that the invalidation condition is satisfied,
The determination means determines whether the operation screen is a predetermined operation screen as the invalidation condition,
The predetermined operation screen is a screen including an input field of the security information that requires authentication, images forming device. The transmission means synthesizes a message screen stored in advance on the operation screen when the determination means determines that the invalidation condition is satisfied, and displays image information for displaying the combined screen the transmitted to the other device, an image forming apparatus according to any one of claims 1-9. An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition,
In the determination step, as the invalidation condition, whether or not the coordinates represented by the coordinate information are included in a dead area that is an area to which invalid coordinates set for the predetermined operation screen belong. Determining
In the determining step, the insensitive area is stored in advance for each of a plurality of types of the predetermined operation screens, and the insensitive area is switched for each operation screen to be transmitted in the transmitting step. And determining whether or not the coordinates represented by the coordinate information are included in the dead area. An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition,
In the determination step, as the invalidation condition, whether or not the coordinates represented by the coordinate information are included in a dead area that is an area to which invalid coordinates set for the predetermined operation screen belong. Determining
The predetermined operation screen is a screen for performing an operation for instructing an image forming process after inputting security information requiring authentication,
The insensitive area is a control method including an area for inputting the security information and / or a position for instructing the image forming process on the predetermined operation screen. The control according to claim 11 or 12, wherein the transmitting step includes transmitting image information for displaying a screen obtained by combining an image representing the insensitive area to the operation screen to the other device. Method. An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition ,
In the determination step, as the invalidation condition, a distance between the other device and a predetermined distance stored in advance are compared to determine whether the distance is larger than the predetermined distance. Including a control method. The step of executing the invalidating process ends the invalidating process when it is determined in the determining step that the distance to the other device is smaller than the predetermined distance. The control method according to claim 14, comprising: An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition,
The determining step stores in advance an image feature amount of the predetermined operation screen, and determines whether or not the operation screen is the predetermined operation screen by comparing with an image feature amount of the operation screen. A control method comprising: An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition,
The control method is:
A control method further comprising a step of displaying an interface for instructing termination of the invalidation process together with the operation screen . An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition,
The step of updating the operation screen stores the coordinate information invalidated by the step of executing the invalidation process, and the invalidated coordinate information is not satisfied when the invalidation condition is not satisfied. A control method including executing an image forming process based on the method. An image forming apparatus control method capable of communicating with another apparatus,
Transmitting image information for displaying an operation screen to the other device;
Receiving coordinate information representing an operation position on the operation screen from the other device;
Performing an image forming process according to the operation content for the operation screen specified from the coordinate information, and updating the operation screen according to the image forming process,
The step of updating the operation screen includes a step of determining whether or not an invalidation condition is satisfied, and a step of executing a process of invalidating the coordinate information when the invalidation condition is satisfied. ,
The determining step includes determining whether the operation screen is a predetermined operation screen as the invalidation condition,
The control method, wherein the predetermined operation screen is a screen including an input field for security information requiring authentication. The transmitting step is for combining the message screen stored in advance in the operation screen and displaying the combined screen when it is determined in the determining step that the invalidation condition is satisfied. The control method according to claim 11, comprising transmitting image information to the other device. A control program for causing the image forming apparatus to execute the control method according to any one of claims 11 to 20.

Images