JP2018007098A - Information processing system, information processing terminal, image formation device, control method for information processing terminal, control method for image formation device, control program for information processing terminal, and control program for image formation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system having higher convenience.SOLUTION: An information processing system includes a first information processing terminal 401, a second information processing terminal 601, and an image formation device 101. In the case that the first information processing terminal 401 is capable of operating in cooperation with the image formation device 101 (S11) and the first information processing terminal 401 is performing telephone communication with the second information processing terminal 601 (S12), the first information processing terminal 401, when accepting relay start operation from a user, performs relay operation so that the second information processing terminal 601 is enabled to communicate with the image formation device 101. In the case that the second information processing terminal 601 is performing telephone communication with the first information processing terminal 401 and the relay operation by the first information processing terminal 401 is started, the second information processing terminal communicates with the image formation device 101 via the first information processing terminal 401 (S13 to S18).SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information processing system, an information processing terminal, an image forming apparatus, an information processing terminal control method, an image forming apparatus control method, an information processing terminal control program, and an image forming apparatus control program. Information processing system including information processing terminal operable in cooperation with apparatus, information processing terminal, image forming apparatus, information processing terminal control method, image forming apparatus control method, information processing terminal control program, and image forming apparatus Related to the control program.

  For example, in the field of office solutions and the like, various information processing systems using image forming apparatuses are used. The image forming apparatus used in such an information processing system includes an MFP (Multi Function Peripheral) having a scanner function, a facsimile function, a copying function, a printer function, a data communication function, and a server function, a facsimile machine, There are copiers and printers.

  Japanese Patent Application Laid-Open Publication No. 2004-228561 discloses a configuration of an operation input system using a portable terminal that can operate in cooperation with an image forming apparatus. This operation input system is configured such that a remote panel of an image forming apparatus can be displayed on a portable terminal linked with the image forming apparatus and the image forming apparatus can be operated remotely.

  Patent Document 2 below discloses a configuration of a proximity communication system using an audio device as a parent device, a charger as a slave device corresponding to the audio device, and a mobile phone. This system is configured to be able to control the audio device from the mobile phone when the authentication of the mobile phone and the charger is successful.

JP 2015-1212014 A JP 2014-057235 A

  By the way, in the operation input system as described in the above Patent Document 1, there is a case where the image forming apparatus may not be used from the portable terminal when the portable terminal is away from the image forming apparatus. was there.

  For example, when the image forming apparatus is on a local network where remote access from the outside is blocked, using a portable terminal in an office or the like that can be connected to such a local network, the user can Remote operation is possible. However, when the user is in an environment where the mobile terminal cannot be connected to the local network, such as when the user is away from home, the mobile terminal cannot be linked to the image forming apparatus, and the image forming apparatus cannot be operated remotely.

  When the portable terminal cannot be linked to the image forming apparatus, in order to use the image forming apparatus, the user in the vicinity of the image forming apparatus is instructed by telephone or the like to operate the image forming apparatus. It is necessary to have an agent. However, there is a problem that it is inefficient to have such work done. For example, in order to have a document output operation or a transmission operation using an image forming apparatus, it is necessary to accurately transmit information necessary for the operation through conversation through a telephone, resulting in a large work load. Specifically, for example, it is necessary to verbally and accurately transmit information for specifying a document to be output and information such as an e-mail address as a destination, which is a heavy work load.

  The present invention has been made to solve such problems, and an information processing system, an information processing terminal, an image forming apparatus, an information processing terminal control method, an image forming apparatus control method, which are more convenient, It is an object to provide a control program for an information processing terminal and a control program for an image forming apparatus.

  In order to achieve the above object, according to one aspect of the present invention, information including a first information processing terminal and a second information processing terminal that perform telephone communication so that users can talk to each other, and an image forming apparatus The processing system controls the first information processing terminal so that the first information processing terminal can operate in cooperation with the image forming apparatus when the first information processing terminal and the image forming apparatus can communicate with each other. When the first information processing terminal and the first information processing terminal are operable in cooperation with the image forming apparatus, the first information processing terminal performs the telephone communication with the second information processing terminal. Start operation accepting means for accepting a relay start operation from a user operating the information processing terminal, and relay operation so that the second information processing terminal can communicate with the image forming apparatus when the relay start operation is accepted The second information processing terminal is connected to the first information processing terminal via the first information processing terminal when the first information processing terminal starts a relay operation. Relay communication means for communicating with the image forming apparatus.

  Preferably, when the second information processing terminal can communicate with the image forming apparatus via the first information processing terminal, the second information processing terminal performs control so that the second information processing terminal can operate in cooperation with the image forming apparatus. Second cooperation control means is further provided.

  Preferably, the relay unit performs a relay operation by constructing a VPN (Virtual Private Network) so that the second information processing terminal and the image forming apparatus can communicate with each other.

  Preferably, the start operation accepting unit can accept a relay start operation when the first information processing terminal is controlled to operate in cooperation with the image forming apparatus by the first cooperation control unit.

  Preferably, the first information processing terminal further includes an operation screen transmission unit that transmits information related to the operation screen transmitted from the image forming apparatus to the second information processing terminal when performing the relay operation. The information processing terminal further includes operation screen display means for displaying the operation screen on the display screen of the second information processing terminal based on the information regarding the operation screen transmitted from the first information processing terminal.

  Preferably, the second information processing terminal receives a file or second information processing held by the second information processing terminal via the first information processing terminal when the relay operation is performed by the first information processing terminal. The image processing apparatus further includes file processing instruction means for transmitting a file that can be acquired by the terminal to the image forming apparatus and instructing the image forming apparatus to process the file by the image forming apparatus.

  Preferably, the file processing instruction means transmits the file and instructs the image forming apparatus so that the image forming apparatus outputs the file.

  Preferably, the image forming apparatus is configured to obtain an image forming unit when a relay operation is performed by the first information processing terminal and an acquisition unit that acquires information about the second information processing terminal transmitted via the first information processing terminal. Based on an instruction directly given by the user to the apparatus or an instruction given by the user to the second information processing terminal, and information related to the second information processing terminal, the first information processing terminal sends the first information processing terminal to the second information processing terminal. File transmitting means for transmitting a file via the information processing terminal.

  Preferably, the file transmission means gives an instruction from the user to designate the second information processing terminal as the transmission destination of the file obtained by scanning and reading the paper with the image forming apparatus based on the information about the second information processing terminal. Accept.

  Preferably, when the first information processing terminal is controlled so that the first information processing terminal can operate in cooperation with the image forming apparatus by the first cooperation control means, the relay means is the second information processing terminal. Depending on whether or not telephone communication is being performed, whether or not to perform the relay operation is switched.

  Preferably, the relay unit enables the first information processing terminal to operate in cooperation with the image forming apparatus by the first cooperation control unit when the first information processing terminal is performing telephone communication with the second information processing terminal. When the control is performed, the relay operation is performed regardless of whether or not the relay start operation is accepted.

  Preferably, when the first information processing terminal is not performing telephone communication with the second information processing terminal and the first information processing terminal is operable in cooperation with the image forming apparatus, When the first information processing terminal receives an incoming call or a call for performing telephone communication with the second information processing terminal, the relay operation is performed regardless of whether or not the relay start operation is performed.

  Preferably, when the first information processing terminal is not performing telephone communication with the second information processing terminal and the first information processing terminal is operable in cooperation with the image forming apparatus, When the first information processing terminal receives an incoming call or a call for performing telephone communication with the second information processing terminal, the user is asked whether or not to start the relay operation, and whether or not to start the relay operation. Based on the confirmation result, relay operation is performed.

  Preferably, when the first information processing terminal is controlled to be operable in cooperation with the image forming apparatus by the first cooperation control means, the remote operation authority of the image forming apparatus is that the relay operation is performed. When it is not, it is held by the first information processing terminal, and when the relay operation is being performed, it is held by the second information processing terminal.

  Preferably, the first information processing terminal displays a display indicating that the relay operation is being performed on the display screen of the first information processing terminal when the relay operation is being performed by the relay unit. Means are further provided.

  Preferably, the first information processing terminal terminates the relay operation when the first information processing terminal performs telephone communication with the second information processing terminal and the relay operation is performed by the relay unit. First end operation accepting means for accepting the user's operation, and the relay means finishes the relay operation while continuing the telephone communication when the user's operation is accepted by the first end operation accepting means.

  Preferably, the second information processing terminal terminates the relay operation when the first information processing terminal performs telephone communication with the second information processing terminal and the relay operation is performed by the relay unit. And a second end operation accepting unit that accepts the user's operation. The relay unit terminates the relay operation while continuing the telephone communication when the user's operation is accepted by the second end operation accepting unit.

  Preferably, the relay means is controlled by the first cooperation control means so that the first information processing terminal operates in cooperation with the image forming apparatus. When the control is finished, the relay operation is finished.

  According to another aspect of the present invention, an information processing terminal that is used together with an image forming apparatus and performs telephone communication so that users can talk to each other with another information processing terminal is When the image forming apparatus can communicate with the image forming apparatus, a cooperation control unit that controls the information processing terminal to operate in cooperation with the image forming apparatus, and the information processing terminal can operate in cooperation with the image forming apparatus. In this case, when the information processing terminal is performing telephone communication with another information processing terminal, start operation accepting means for accepting a relay start operation from a user operating the information processing terminal, and the relay start operation are accepted A relay unit that performs a relay operation so that the other information processing terminal and the image forming apparatus can communicate with each other.

  Preferably, the relay unit performs a relay operation by constructing a VPN (Virtual Private Network) so that another information processing terminal and the image forming apparatus can communicate with each other.

  Preferably, the start operation accepting unit can accept the relay start operation when the information processing terminal is controlled to operate in cooperation with the image forming apparatus by the cooperation control unit.

  Preferably, the relay unit performs telephone communication with another information processing terminal when the information processing terminal is controlled so that the information processing terminal can operate in cooperation with the image forming apparatus. Whether or not to perform the relay operation is switched depending on whether or not there is.

  Preferably, the relay unit enables the information processing terminal to operate in cooperation with the image forming apparatus by the cooperation control unit when the information processing terminal is performing telephone communication with the other information processing terminal. Thus, the relay operation is performed regardless of whether or not the relay start operation is accepted.

  Preferably, when the information processing terminal does not perform telephone communication with the other information processing terminal and the information processing terminal is operable in cooperation with the image forming apparatus, When the information processing terminal receives an incoming call or a call for performing telephone communication with the other information processing terminal, the relay operation is performed regardless of whether or not the relay start operation is performed.

  Preferably, when the information processing terminal does not perform telephone communication with the other information processing terminal and the information processing terminal is operable in cooperation with the image forming apparatus, Whether or not the relay operation is started when the incoming call or the outgoing call for the telephone communication with the other information processing terminal is received at the information processing terminal and the relay operation is started. The relay operation is performed based on the confirmation result.

  Preferably, when the relay operation is being performed by the relay unit, the relay unit further includes a relay state display unit that displays a display indicating that the relay operation is being performed on the display screen of the information processing terminal.

  Preferably, the information processing terminal terminates the relay operation when the information processing terminal is performing telephone communication with the other information processing terminal and the relay operation is performed by the relay unit. A first end operation accepting unit that accepts a user operation for causing the relay unit to continue the telephone communication when the user operation is accepted by the first end operation accepting unit. End the operation.

  Preferably, the relay unit is controlled so that the information processing terminal operates in cooperation with the image forming apparatus by the cooperation control unit, and when the relay operation is performed, the relay control unit performs control. When the operation is terminated, the relay operation is terminated.

  According to still another aspect of the present invention, an image forming apparatus operable in cooperation with an information processing terminal is different from the first information processing terminal due to a relay operation by the first information processing terminal capable of communicating with the image forming apparatus. A communication unit that communicates with the second information processing terminal; an acquisition unit that acquires information about the second information processing terminal transmitted through the first information processing terminal by performing communication by the communication unit; and a communication unit Based on the instruction directly given by the user to the image forming apparatus or the instruction given by the user to the second information processing terminal and the information related to the second information processing terminal. File transmitting means for transmitting a file from the forming apparatus to the second information processing terminal via the first information processing terminal.

  Preferably, the file transmission means gives an instruction from the user to designate the second information processing terminal as the transmission destination of the file obtained by scanning and reading the paper with the image forming apparatus based on the information about the second information processing terminal. Accept.

  According to still another aspect of the present invention, there is provided a method for controlling an information processing terminal that is used together with an image forming apparatus and performs telephone communication so that users can talk to each other with other information processing terminals. When the information processing terminal and the image forming apparatus can communicate with each other, a cooperation control step for controlling the information processing terminal so that it can operate in cooperation with the image forming apparatus, and the information processing terminal cooperates with the image forming apparatus When the information processing terminal is performing telephone communication with another information processing terminal, a start operation receiving step for receiving a relay start operation from a user operating the information processing terminal, and a relay start operation A relay step for performing a relay operation so that the other information processing terminal and the image forming apparatus can communicate with each other.

  According to still another aspect of the present invention, a method for controlling an image forming apparatus operable in cooperation with an information processing terminal includes: a first information processing terminal by a relay operation by the first information processing terminal capable of communicating with the image forming apparatus; A communication step for communicating with a second information processing terminal different from the above, and an acquisition step for acquiring information related to the second information processing terminal transmitted via the first information processing terminal by performing communication by the communication step; Based on the instruction directly given by the user to the image forming apparatus or the instruction given by the user to the second information processing terminal and the information related to the second information processing terminal when the communication in the communication step is performed. A file transmission step of transmitting a file from the image forming apparatus to the second information processing terminal via the first information processing terminal.

  According to still another aspect of the present invention, an information processing terminal control program that is used together with an image forming apparatus and performs telephone communication so that users can talk to each other with other information processing terminals. When the information processing terminal and the image forming apparatus can communicate with each other, a cooperation control step for controlling the information processing terminal so that it can operate in cooperation with the image forming apparatus, and the information processing terminal cooperates with the image forming apparatus When the information processing terminal is performing telephone communication with another information processing terminal, a start operation receiving step for receiving a relay start operation from a user operating the information processing terminal, and a relay start operation Is accepted, causes the computer to execute a relay step for performing a relay operation so that the other information processing terminal and the image forming apparatus can communicate with each other.

  According to still another aspect of the present invention, the control program for the image forming apparatus operable in cooperation with the information processing terminal causes the first information processing terminal to perform the relay operation by the first information processing terminal capable of communicating with the image forming apparatus. A communication step for communicating with a second information processing terminal different from the above, and an acquisition step for acquiring information related to the second information processing terminal transmitted via the first information processing terminal by performing communication by the communication step; Based on the instruction directly given by the user to the image forming apparatus or the instruction given by the user to the second information processing terminal and the information related to the second information processing terminal when the communication in the communication step is performed. Then, the computer is caused to execute a file transmission step of transmitting a file from the image forming apparatus to the second information processing terminal via the first information processing terminal.

  According to these inventions, a more convenient information processing system, information processing terminal, image forming apparatus, information processing terminal control method, image forming apparatus control method, information processing terminal control program, and image forming apparatus control A program can be provided.

1 is a block diagram showing an image forming system in one embodiment of the present invention. 2 is a block diagram illustrating a hardware configuration of the image forming apparatus. FIG. It is a block diagram which shows the structure of the portable terminal in this Embodiment. It is a figure explaining an example of relay operation. It is a figure which shows an example of the screen during a call of the 1st portable terminal when performing telephone communication with the 2nd portable terminal. 3 is a flowchart showing an operation of the image forming apparatus in the present embodiment. It is a flowchart which shows a cooperation process. It is a flowchart which shows a job execution process. It is a flowchart which shows an external apparatus registration process. It is a 1st flowchart which shows operation | movement of a 1st portable terminal. It is a 2nd flowchart which shows operation | movement of a 1st portable terminal. It is a 3rd flowchart which shows operation | movement of a 1st portable terminal. It is a flowchart which shows operation | movement of a scan-out reception process. It is a flowchart which shows operation | movement of the 2nd portable terminal in case relay is performed. It is a figure explaining a scan-out function. It is a figure explaining a remote printing function.

  Hereinafter, an image forming system (an example of an information processing system) according to an example of an embodiment of the present invention will be described.

  The image forming system includes an image forming apparatus and two portable terminals (portable information terminal; an example of an information processing terminal).

  The image forming apparatus is an MFP (Multi Function Peripheral) having a scanner function, a copying function, a printer function, a facsimile function, a data communication function, and a server function. The scanner function is a function for reading an image of a set original and storing it in an HDD (Hard Disk Drive) or the like. The copying function is a function of printing (printing) it on paper or the like. The function as a printer is a function for printing on a sheet based on an instruction received from an external terminal such as a PC. The facsimile function is a function for receiving facsimile data from an external facsimile machine or the like and storing it in an HDD or the like. The data communication function is a function for transmitting / receiving data to / from a connected external device. The server function is a function that allows a plurality of users to share data stored in the HDD or the like.

  The mobile terminal is a smartphone having various functions such as a function for performing telephone communication, a data communication function, and information storage, browsing, and output functions. The portable terminal may be a tablet terminal or other electronic computer (an example of an information processing terminal). The function of performing telephone communication is a function that enables a telephone call with another device via a public telephone network or a mobile telephone network, for example. The function of performing telephone communication may be a function that allows a user to make a call with another device by a so-called IP phone or Internet phone. The data communication function is a function for performing data communication with other devices via, for example, a mobile phone network or other networks. The data communication function can be performed by wireless communication, for example. Information storage, browsing, and output functions can store information sent from an external device or information input by a user, display the stored information on a display, or send it to an external device It is a function to make.

  The image forming apparatus is connected to a network such as a LAN (Local Area Network). The mobile terminal can be connected to a network such as a LAN. When the image forming apparatus and the portable terminal are connected to the same network such as a LAN, they can communicate with each other via the network. Both the image forming apparatus and the portable terminal have a display device such as a touch panel. In the present embodiment, in a situation where the image forming apparatus and the portable terminal can communicate with each other, when control for performing a predetermined cooperative operation is executed, an operation image of the image forming apparatus is displayed on the display unit of the portable terminal. And the like, and the image forming system can be used in cooperation with the image forming apparatus and the portable terminal.

  [Embodiment]

  FIG. 1 is a block diagram showing an image forming system in one embodiment of the present invention.

  In this embodiment, the image forming system 901 includes the image forming apparatus 101 and two portable terminals 401 and 601 (a first portable terminal 401 and a second portable terminal 601).

  As shown in FIG. 1, in the present embodiment, for example, the following case is assumed. User A holds the first portable terminal 401, and user B holds the second portable terminal 601. The image forming apparatus 101 and the first portable terminal 401 are both used in a relatively close place in the space 201 such as the same office. The second portable terminal 601 is used outdoors such as outdoors away from the space 201.

  The image forming apparatus 101 and the first portable terminal 401 are connected via a network 801 so that they can communicate with each other. The network 801 is, for example, a local information communication network (LAN). The image forming apparatus 101 is connected to a network 801 via a so-called wired LAN. On the other hand, the first portable terminal 401 is connected to the network 801 via a so-called wireless LAN. That is, a connection device 251 that is a wireless LAN access point is connected to the network 801. The first mobile terminal 401 is connected to the network 801 via the connection device 251 by wireless connection to the connection device 251.

  In addition, the connection aspect of each apparatus is not restricted to this. For example, the image forming apparatus 101 and the first portable terminal 401 may be connected so as to be able to communicate with each other using a short-range wireless communication technology.

  The network 801 is connected to the Internet 290 via a device (not shown) having a routing function that implements a firewall. In other words, the image forming apparatus 101 and the first mobile terminal 401 can access the Internet 290 via the network 801. Devices in the network 801 from the Internet 290 side are restricted by a firewall so that they can be accessed only by a predetermined communication protocol.

  The second mobile terminal 601 is located away from the space 201. The second portable terminal 601 can access the Internet 290 using, for example, mobile data communication.

  The first mobile terminal 401 and the second mobile terminal 601 can perform telephone communication so that the user A and the user B can talk to each other. Telephone communication is performed via a mobile phone network, but is not limited to this.

  In the present embodiment, the image forming apparatus 101 operates as a cooperation management apparatus that operates the image forming apparatus 101 and an apparatus that can communicate with the image forming apparatus 101 via the network 801 in cooperation with each other. That is, in the case illustrated in FIG. 1, the image forming apparatus 101 and the first portable terminal 401 can operate in cooperation based on the control of the cooperation management apparatus of the image forming apparatus 101. Such a cooperative operation is started, for example, when the first portable terminal 401 and the image forming apparatus 101 communicate with each other when a predetermined operation performed by the user A is received in the first portable terminal 401. The When it is determined in the image forming apparatus 101 that the first portable terminal 401 can be authenticated as a target to be linked, the image forming apparatus 101 and the first portable terminal 401 are paired so as to operate in cooperation. The

  When the image forming apparatus 101 and the first portable terminal 401 are paired and a cooperative operation is performed, for example, an operation image of the image forming apparatus 101 is displayed on the first portable terminal 401 based on the control of the image forming apparatus 101. Displayed on the display unit 431, an operation by the user A is received by the first portable terminal 401. When an operation by the user A is accepted at the first portable terminal 401, the information is transmitted to the image forming apparatus 101, and the image forming apparatus 101 operates accordingly (remote panel function).

  As shown in FIG. 1, the second portable terminal 601 is located away from the space 201 and is not connected to the network 801. Therefore, under such circumstances, the second portable terminal 601 cannot be directly linked to the image forming apparatus 101.

  Note that the pairing with the image forming apparatus 101 is not limited to that performed via the network 801, and may be performed mutually with the first portable terminal 401 using a predetermined communication profile such as Bluetooth (registered trademark). It may be configured to be performed by performing communication.

  [Configuration of Image Forming Apparatus 101]

  FIG. 2 is a block diagram illustrating a hardware configuration of the image forming apparatus 101.

  As shown in FIG. 2, the image forming apparatus 101 includes an operation unit 11, a control unit (CPU) 20, an image forming unit 30, an image reading unit 40, a ROM 23, a RAM 25, and a nonvolatile memory 27. doing.

  The control unit 20 controls the operation of the image forming apparatus 101.

  The operation unit 11 is disposed on the upper front side (front side in the drawing) of the image forming apparatus 101. The operation unit 11 is provided with a display panel 13 for displaying information to the user.

  The display panel 13 is a touch panel. The display panel 13 is, for example, an LCD (Liquid Crystal Display). The display panel 13 displays a guidance screen for the user, displays an operation image including operation buttons, and accepts a touch operation from the user. The display panel 13 performs display under the control of the control unit 20 and controlled by the screen control unit 17. The operation unit 11 receives an operation input made by the user to the display panel 13. When the display panel 13 is operated by the user, the operation unit 11 transmits an operation signal or a predetermined command corresponding to the operation to the control unit 20. That is, the user can cause the image forming apparatus 101 to perform various operations by operating the display panel 13.

  When the image forming apparatus 101 is linked to an external device such as the first portable terminal 401 as described above, the operation image displayed on the display panel 13 is transmitted to the first portable terminal 401 and the first portable terminal 401 It is displayed on the display unit 431 of the terminal 401. When the operation is performed on the first portable terminal 401 by the user A, the control unit 20 controls the image forming apparatus 101 in the same manner as when the operation is performed on the display panel 13.

  The image forming unit 30 roughly includes a toner image forming unit, a sheet conveying unit, a fixing device, and the like, and forms an image on a sheet by an electrophotographic method. The paper transport unit feeds the paper from the paper feed cassette and transports the paper to the toner image forming unit. The paper transport unit discharges the paper on which the image is formed by the toner image forming unit and the fixing device to a paper discharge tray or the like.

  The image reading unit 40 performs the above-described scanner function. The image reading unit 40 includes an ADF (Auto Document Feeder) 41. The image reading unit 40 scans a document placed on a transparent document table with a contact image sensor and reads it as image data. The image reading unit 40 reads a plurality of documents set on a document tray one by one using the ADF and sequentially reads the document with a contact image sensor to obtain image data.

  The image read by the image reading unit 40 is converted into a finished image by the control unit 20. The control unit 20 transmits the generated finished image as an image file of a predetermined data format to an external device or the like (scan-out function), or forms an image on a sheet by the image forming unit 30 based on the image file. (Copy function)

  The non-volatile memory 27 is, for example, a flash memory or an HDD (Hard Disk Drive). The nonvolatile memory 27 stores setting information of the image forming apparatus 101, a control program 27a for performing various operations of the image forming apparatus 101, and the like. The nonvolatile memory 27 also stores print job data sent from an external device connected to the image forming apparatus 101, an image file 27d generated by reading an original with the image reading unit 40, and the like. The control unit 20 can control the operation of the image forming apparatus 101 by reading the control program 27a from the nonvolatile memory 27 and executing the control program 27a.

  The non-volatile memory 27 stores a database management unit 27b. The database management unit 27b manages a user information database in which, for example, user information for performing user authentication is recorded under the control of the control unit 20. Further, the database management unit 27b manages a transmission destination database including, for example, destination information of a device that is a transmission destination of the scan-out function under the control of the control unit 20.

  The ROM 23 is, for example, a flash ROM (Flash Memory). The ROM 23 stores data used when the image forming apparatus 101 operates. Like the nonvolatile memory 27, the ROM 23 may store various control programs, function setting data of the image forming apparatus 101, and the like. The control unit 20 reads data from the ROM 23 and writes data to the ROM 23. The ROM 23 may be non-rewritable.

  The RAM 25 is a main memory of the control unit 20. The RAM 25 is used to store data necessary for the control unit 20 to execute the control program 27a.

  The control unit 20 is connected to each unit of the image forming apparatus 101 so that signals can be transmitted and received. The control unit 20 controls various operations of the image forming apparatus 101 by executing a control program 27a stored in the ROM 23, the RAM 25, the nonvolatile memory 27, or the like. When an operation signal is sent from the operation unit 11 or an operation command is transmitted from an external device or the like connected to the image forming apparatus 101, the control unit 20 executes a predetermined control program 27a in response thereto. Thus, a predetermined function of the image forming apparatus 101 is executed in accordance with the operation of the operation unit 11 by the user.

  As shown in FIG. 2, the image forming apparatus 101 further includes a screen control unit 17, a network communication unit 51, a wireless communication unit 52, an authentication management unit 80, and the like.

  The screen control unit 17 controls display on the display panel 13. The screen control unit 17 performs processing for acquiring an image to be displayed on the display panel 13. That is, the screen control unit 17 reads, for example, a display image prepared in advance and stored in the nonvolatile memory 27, the ROM 23, or the like and displays it on the display panel 13, or generates a display image and displays it on the display panel 13. To do.

  The network communication unit 51 connects the image forming apparatus 101 to the network 801. That is, the network communication unit 51 can communicate with other devices connected to the network 801 based on, for example, a communication standard used in a LAN. The network communication unit 51 is connected to the network 801 through a wired connection, but may be configured to connect to the network 801 through a wireless connection (such as a wireless LAN).

  For example, the wireless communication unit 52 communicates with an external device based on a standard such as Bluetooth (registered trademark). For example, when the first mobile terminal 401 is compatible with the same communication standard, the wireless communication unit 52 and the first mobile terminal 401 can be communicably connected. The above cooperative operation may be configured to be realized by communication using the wireless communication unit 52.

  The authentication management unit 80 performs user authentication for the image forming apparatus 101. The user authentication is a job for identifying and authenticating a user who uses the image forming apparatus 101. The user can log in to the image forming apparatus 101 and use the image forming apparatus 101 through authentication by user authentication.

  In user authentication, for example, a user information database managed by the database management unit 27b is used. In the user information database, user information capable of user authentication and authentication information necessary for the user authentication are recorded in association with each other. The authentication information is, for example, a password set for each user. In the user information database, information related to the function permitted to be executed for each user is recorded in association with the user. A publicly known method can be appropriately adopted as a user authentication method. By performing user authentication by a predetermined method, the image forming apparatus 101 can identify the user. The user information database may be managed by an external server or the like.

  By identifying the user by performing user authentication, the display of the display panel 13 and available functions are adapted to the authenticated user, and the convenience of the image forming apparatus 101 can be enhanced. Further, when the authenticated user is near the image forming apparatus 101, a high security effect can be obtained, for example, a printed matter can be output without touching the eyes of other users. In the image forming apparatus 101, the control unit 20 manages the user's authority to use the functions of the image forming apparatus 101 according to the user identified by the user authentication. By managing the use authority, use of a predetermined function can be restricted for each user, and a high security effect can be obtained.

  [Configuration of portable terminals 401 and 601]

  FIG. 3 is a block diagram showing a configuration of portable terminals 401 and 601 in the present embodiment.

  The mobile terminals 401 and 601 are, for example, so-called multifunctional mobile phones (smartphones). The first portable terminal 401 and the second portable terminal 601 have the same configuration. Note that the configuration of the first mobile terminal 401 and the configuration of the second mobile terminal 601 may be slightly different.

  As shown in FIG. 2, the mobile terminals 401 and 601 roughly include CPUs 421 and 621, storage units 423 and 623, display units 431 and 631, screen control units 441 and 641, and communication units 451 and 651. And have. The portable terminals 401 and 601 can be easily gripped by the user.

  The CPUs 421 and 621 control the operations of the portable terminals 401 and 601 using the storage units 423 and 623 and the units of the portable terminals 401 and 601.

  The storage units 423 and 623 are memories such as a ROM and a RAM, for example. Control programs 423a and 623a executed by the portable terminals 401 and 601 are stored in the storage units 423 and 623. The CPUs 421 and 621 execute various functions such as control of operations of the portable terminals 401 and 601 and communication with the MFP 101 using the communication units 451 and 651 by executing the control programs 423a and 623a. For example, various applications can be operated on the mobile terminals 401 and 601 to perform transmission / reception of e-mails and schedule management. The storage units 423 and 623 store document files 423b and 623b. The document files 423b and 623b can be printed on paper by the image forming apparatus 101 and output, and include characters, figures, photographs, and the like.

  Display units 431 and 631 are touch panels. The display units 431 and 631 are liquid crystal displays (LCD). The display units 431 and 631 detect that the user has touched the display units 431 and 631 and the contact positions (user operation positions). When the user touches the display units 431 and 631, the information is sent to the CPUs 421 and 621, and the CPUs 421 and 621 control the portable terminals 401 and 601 based on the information. That is, the user can operate the portable terminals 401 and 601 by touching the display units 431 and 631 and performing an operation.

  The screen control units 441 and 641 control the display of the display units 431 and 631. The screen control units 441 and 641 display, for example, various guide images and operation menu screens of the mobile terminals 401 and 601 on the display units 431 and 631.

  The communication units 451 and 651 can connect the mobile terminals 401 and 601 to, for example, a mobile phone network, connect to a wireless LAN, or connect to other devices using Bluetooth (registered trademark). It is configured. As a result, the mobile terminals 401 and 601 can perform telephone communication and connect to the network 801 and the Internet 290 as described above.

  [Description of relay operation]

  Here, in the present embodiment, as shown in FIG. 1, even when the second portable terminal 601 cannot directly cooperate with the image forming apparatus 101, the first portable terminal 401. And can operate in cooperation with the image forming apparatus 101. This is realized by the first mobile terminal 401 performing a relay operation as described below.

  That is, when the first mobile terminal 401 and the image forming apparatus 101 are performing a cooperative operation, and the first mobile terminal 401 and the second mobile terminal 601 are talking to each other, The relay operation is started when user A gives an instruction to permit predetermined relay. When the relay operation is started, for example, the image forming apparatus 101 can be remotely operated from the second portable terminal 601 that is a call destination.

  FIG. 4 is a diagram for explaining an example of the relay operation.

  When the relay operation is performed, for example, the following operation is performed in the image forming system 901.

  As shown in FIG. 4, when the first portable terminal 401 and the image forming apparatus 101 can communicate with each other in step S <b> 11, the first portable terminal 401 can operate in cooperation with the image forming apparatus 101. Control as follows. For example, when a predetermined operation is performed on the first mobile terminal 401, an authentication request is sent from the first mobile terminal 401 to the image forming apparatus 101. When the image forming apparatus 101 receives the authentication request and determines that the authentication is possible, the image forming apparatus 101 performs pairing between the first portable terminal 401 and the image forming apparatus 101. Thereby, the cooperation state of the 1st portable terminal 401 and the image forming apparatus 101 is established.

  In step S12, the first mobile terminal 401 performs telephone communication with the second mobile terminal 601 and enters a call state. When a call is made from the first portable terminal 401 to the second portable terminal 601 for telephone communication, if the second portable terminal 601 answers the call (incoming call), a call state is established. Also, when a call is made from the second portable terminal 601 to the first portable terminal 401 for making a telephone communication, if the first portable terminal 401 answers the call, a call state is established. It should be noted that the call state may be prior to the establishment of the cooperation state as in step S11.

  As described above, when the first mobile terminal 401 is operable in cooperation with the image forming apparatus 101, when the first mobile terminal 401 is performing telephone communication with the second mobile terminal 601, the first mobile terminal 401. Accepts a relay start operation from the user A who operates it. That is, when the first portable terminal 401 is controlled to operate in cooperation with the image forming apparatus 101, the first portable terminal 401 can accept a relay start operation. A call screen 435 is displayed on the call state display unit 431. The relay start operation is, for example, an operation of pressing a cooperation start button 437 included in the in-call screen 435. When the cooperation start button 437 is operated by the user A and the relay start operation is received by the first mobile terminal 401, the first mobile terminal 401 can communicate with the image forming apparatus 101 by the second mobile terminal 601. Perform relay operation.

  When the second mobile terminal 601 performs telephone communication with the first mobile terminal 401 and the first mobile terminal 401 starts a relay operation, the second mobile terminal 601 communicates with the image forming apparatus 101 via the first mobile terminal 401. To do. When the second portable terminal 601 can communicate with the image forming apparatus 101 via the first portable terminal 401 in this way, the second portable terminal 601 can operate in cooperation with the image forming apparatus 101. Take control.

  When the first mobile terminal 401 starts the relay operation, the first mobile terminal 401 performs the relay operation by constructing a VPN (Virtual Private Network) so that the second mobile terminal 601 and the image forming apparatus 101 can communicate with each other. The second portable terminal 601 is connected to the network 801 through the VPN constructed by the first portable terminal 401 so that the image forming apparatus 101 and the second portable terminal 601 can communicate with each other. Communication can be performed as if the second portable terminal 601 and the image forming apparatus 101 are connected to the same network 801. Thereby, even when the relay operation is performed, it is not necessary for the second portable terminal 601 and the image forming apparatus 101 to perform complicated control, and the manufacturing cost of the information processing system can be reduced. Specifically, for example, the second mobile terminal 601 can easily specify the image forming apparatus 101 as a transmission destination when performing transmission processing of a file or the like. The VPN does not have to be constructed.

  When the relay operation is started, for example, processing for registering information regarding the second portable terminal 601 in the image forming apparatus 101 is performed. In step S13, the second mobile terminal 601 uses, for example, identification information (an example of information related to the second mobile terminal 601) for receiving data such as a file from an external device to the second mobile terminal 601. Transmit to the mobile terminal 401. The identification information is information for identifying the second portable terminal 601 as another data transmission destination.

  In step S <b> 14, the first mobile terminal 401 receives the identification information transmitted from the second mobile terminal 601. Then, relay information indicating that the first mobile terminal 401 is relaying communication to the second mobile terminal 601 is added to the identification information, and the information is transmitted to the image forming apparatus 101.

  In step S <b> 15, the image forming apparatus 101 receives the identification information and relay information transmitted from the first mobile terminal 401. The image forming apparatus 101 executes external device registration processing based on the received information, and registers the second portable terminal 601 as one of data transmission destinations, for example. As a result, the image forming apparatus 101 and the second portable terminal 601 can operate in cooperation with each other in such a manner that data is transmitted from the image forming apparatus 101 to the second portable terminal 601.

  Further, for example, a remote panel function for displaying an operation image 635 for operating the image forming apparatus 101 on the display unit 631 of the second portable terminal 601 is performed. That is, in step S <b> 16, as in the case where the image forming apparatus 101 cooperates with the first portable terminal 401, information (remote panel image) regarding an operation screen (remote panel) to be displayed on the second portable terminal 601. ). The remote panel image is, for example, image data constituting the remote panel, but is not limited thereto. For example, the setting information transmitted in a predetermined format may be information that allows the second portable terminal 601 to display the operation screen based on the information.

  In step S <b> 17, when the first mobile terminal 401 receives the remote panel image, the first mobile terminal 401 transfers the remote panel image to the second mobile terminal 601. When receiving the remote panel image, the second portable terminal 601 displays the image on the display unit 631. When the remote panel image 635 is displayed on the display unit 631, the second portable terminal 601 receives an operation by the user B.

  The remote panel image 635 displays operation buttons for executing various functions of the image forming apparatus 101 and designating execution modes of those functions. The remote panel image 635 displays a remote panel end button 637 for ending the remote panel function and ending the relay operation. The second portable terminal 601 ends the remote panel function when the pressing operation of the remote panel end button 637 for ending the relay operation is accepted. The second portable terminal 601 communicates with the first portable terminal 401 and the image forming apparatus 101 and performs control to end the relay operation. As a result, the relay operation is terminated while the telephone communication is continued.

  When the remote panel end button 637 is operated, the second portable terminal 601 may end the display of the remote panel image 635 while continuing the relay operation. In this case, apart from the remote panel end button 637, a button for accepting the operation of the user B for ending the relay operation may be displayed on the remote panel image 635 or the like.

  In step S18, when the remote panel image 635 is operated by the user B, the second portable terminal 601 outputs a control command in accordance with the operation. The second portable terminal 601 transmits a command to the image forming apparatus 101 via the first portable terminal 401. User B can cause the image forming apparatus 101 to perform an operation corresponding to the operation by pressing an operation button, a remote panel end button 637, or the like. In the present embodiment, for example, a scan-out function or a remote print function can be executed. Such a function is realized by communication between the second portable terminal 601 and the image forming apparatus 101 via the first portable terminal 401 by the relay operation of the first portable terminal 401. However, the user B feels as if he / she is directly communicating with the image forming apparatus 101 and executing the function without being particularly conscious of the presence of the first portable terminal 401.

  Here, the image forming apparatus 101 gives a remote operation authority to the linked device (operates as if the linked device has the remote control authority). The image forming apparatus 101 receives information transmitted from a device to which a remote operation authority is granted and performs an operation based on the received information. When the first portable terminal 401 is controlled so as to be operable in cooperation with the image forming apparatus 101, when an operation image is displayed on the first portable terminal 401, the first portable terminal 401 is displayed. Will be granted remote control authority. In the present embodiment, when the first mobile terminal 401 is controlled to be operable in cooperation with the image forming apparatus 101 as described above, is the first mobile terminal 401 performing a relay operation? Depending on whether or not, the remote operation authority of the image forming apparatus 101 belongs to the first portable terminal 401 or the second portable terminal 601. That is, when the relay operation is not performed, the first portable terminal 401 holds the remote operation authority. On the other hand, when the relay operation is performed, the second portable terminal 601 holds the remote operation authority. Such switching of the remote operation authority may be performed when the image forming apparatus 101 receives relay information from the first portable terminal 401, for example.

  FIG. 5 is a diagram illustrating an example of a call screen 435 of the first mobile terminal 401 when performing telephone communication with the second mobile terminal 601.

  For example, when the first mobile terminal 401 is performing telephone communication with the second mobile terminal 601, the display content of the in-call screen 435 is switched depending on whether or not the relay operation is performed. That is, as shown in FIG. 5, when the relay operation is not performed, the cooperation start button 437 is displayed as described above (step S31).

  When the cooperation start button 437 is displayed, when it is operated, a relay operation is performed. Then, instead of the cooperation start button 437, a cooperation end button 438 is displayed on the call screen 435 (step S32). The cooperation end button 438 is a button operated to end the relay operation. That is, at this time, the operation of the user A for ending the relay operation is accepted with the cooperation end button 438 displayed. When the user A performs an operation of pressing the cooperation end button 438, the first mobile terminal 401 ends the relay operation between the second mobile terminal 601 and the image forming apparatus 101 while continuing the telephone communication. . When the operation of pressing the cooperation end button 438 is performed by the user A, the display of the in-call screen 435 returns to the state of step S31.

  Thus, the display of the cooperation start button 437 and the cooperation end button 438 is switched depending on whether or not the relay operation is being performed. Therefore, the user A can easily confirm whether or not the relay operation is being performed by looking at the display content of the call screen 435. In other words, when the relay operation is being performed, a display indicating that the relay operation is being performed is performed by displaying the cooperation end button 438. As shown in FIG. 5, a display 436 indicating that the relay operation is being performed is included in the in-call screen 435 separately from the cooperation end button 438, and the display is made by looking at the display. Also, it may be possible to know whether or not the relay operation is being performed.

  Note that a call end button 439 for ending telephone communication is displayed on the call screen 435. The call end button 439 is displayed whether the relay operation is performed or not. That is, the user A can always end the call by operating the call end button 439 regardless of whether or not the relay operation is being performed. When the call end button 439 is operated, the telephone communication between the first mobile terminal 401 and the second mobile terminal 601 ends (step S33). When the call end button 439 is operated while the first mobile terminal 401 is performing the relay operation, the first mobile terminal 401 ends the relay operation.

  [Operation of Image Forming Apparatus 101]

  FIG. 6 is a flowchart showing the operation of the image forming apparatus 101 in the present embodiment.

  As illustrated in FIG. 6, the image forming apparatus 101 performs the following processing based on control by the control unit 20 or the like.

  In step S101, the control unit 20 performs cooperation processing in a state where the power of the image forming apparatus 101 is on.

  In step S102, the control unit 20 performs job execution processing.

  In step S103, the control unit 20 performs external device registration processing.

  In step S104, the control unit 20 repeatedly performs the processing from step S101 to step S103 until the power is turned off. When the power is turned off, the operation of the image forming apparatus 101 ends.

  FIG. 7 is a flowchart showing the cooperation process.

  As shown in FIG. 7, in the cooperation process, it is determined in step S111 whether or not the image forming apparatus 101 is linked to another apparatus. That is, it is determined whether or not the image forming apparatus 101 has an apparatus that is authenticated and paired with the image forming apparatus 101. If linked, the linkage process ends.

  If not linked in step S111, it is determined in step S112 whether an authentication request has been accepted. The authentication request is a request for cooperation with the image forming apparatus 101 from an external device. If there is no authentication request, the cooperation process ends.

  If an authentication request is accepted in step S112, it is determined in step S113 whether authentication is possible (whether the device is capable of cooperation). If it is not determined that authentication is possible, the cooperation process ends.

  If it is determined in step S113 that authentication is possible, in step S114, pairing between the apparatus that has made the authentication request and the image forming apparatus 101 is established. That is, the image forming apparatus 101 is in a state of being linked with the apparatus that has issued the authentication request.

  In step S115, the remote panel image is transmitted from the image forming apparatus 101 to the apparatus for which pairing has been established. As a result, the device that has received the remote panel image displays the remote panel image and accepts an operation from the user. When the process of step S115 ends, the cooperation process ends.

  FIG. 8 is a flowchart showing job execution processing.

  As shown in FIG. 8, in the job execution process, it is determined whether or not there is a job registered in the image forming apparatus 101 in step S121. If there is no job, the job execution process ends.

  If there is a job in step S121, the registered job is executed in step S122.

  For example, the image forming apparatus 101 can execute a print job. In a print job, printing is performed based on PDL (page description language) data transmitted from an external device.

  Further, the image forming apparatus 101 can execute, for example, a scan-out job. In this job, the document is scanned, and the generated image file is transmitted to the destination designated at the time of job registration. Transmission is performed according to various communication protocols set in advance.

  When the job execution ends, the job execution process ends.

  FIG. 9 is a flowchart showing the external device registration process.

  As shown in FIG. 9, in the external device registration process, in step S131, it is determined whether or not the image forming apparatus 101 has received identification information about the external device. If received, in step S132, the external device is registered as a destination candidate (scan-out destination) for the scan-out function based on the identification information.

  In step S133, it is determined whether the image forming apparatus 101 has received the relay information of the external device together with the identification information of the other external device. The fact that the relay information and the identification information are received together in this way indicates that the relay operation is being performed by the external device. If received, in step S134, another external device relayed by the external device is registered as a scan-out destination based on the received relay information and identification information.

  The scan-out destination registered in this way can be designated by the user as a destination in a job to be scanned out. When the series of processing ends, the external device registration processing ends.

  [Operation of First Mobile Terminal 401]

  FIG. 10 is a first flowchart showing the operation of the first portable terminal 401. FIG. 11 is a second flowchart showing the operation of the first portable terminal 401. FIG. 12 is a third flowchart showing the operation of the first portable terminal 401.

  As illustrated in FIGS. 10 to 12, the first portable terminal 401 performs the following processing based on control by the CPU 421 or the like.

  In step S211, it is determined whether to cooperate with the image forming apparatus 101 (whether to perform an authentication request). When the cooperation is not performed, the process proceeds to step S214.

  When cooperation is performed in step S211, communication with the image forming apparatus 101 is performed by the communication unit 451 in step S212. At this time, an authentication request is made from the first portable terminal 401 to the image forming apparatus 101, and it is determined whether or not the image forming apparatus 101 can authenticate.

  In step S213, it is determined whether the image forming apparatus 101 determines that authentication is possible. If it is determined that authentication is possible, the process proceeds to step S216. Otherwise, the process proceeds to step S214.

  In step S214, it is determined whether there is an incoming call and user A has performed an operation to respond to it. If a response operation has been performed, in step S215, a normal call is performed by telephone communication, and the call ends. If there is no incoming call, no response operation is performed, or a call is made and the call ends, the process returns to step S211.

  In step S <b> 216, as a result of determining that authentication is possible, cooperation between the image forming apparatus 101 and the first portable terminal 401 is established. The remote panel image transmitted from the image forming apparatus 101 is received and displayed on the display unit 431. The first portable terminal 401 has a remote operation authority, and can operate the image forming apparatus 101 using the first portable terminal 401 (direct linkage control).

  When the image forming apparatus 101 and the first portable terminal 401 are linked, it is determined in step S221 whether there is an incoming call and whether the user A has responded. When there is an incoming call and the user A responds, a call is made by telephone communication, and the process proceeds to step S222. In the following, it is assumed that a call is being made with the second mobile terminal 601. When there is no incoming call or when the cooperation with the image forming apparatus 101 is canceled without being answered, the process may return to step S211.

  In step S222, it is determined whether or not an instruction by the user A for performing the relay operation has been performed. Specifically, it is determined whether or not the cooperation start button 437 has been operated by the user A. If no instruction is given, it is determined in step S223 whether or not the call has ended. If the call is finished, the process returns to step S221. On the other hand, if the call has not ended, the process returns to step S222.

  If it is determined in step S222 that an instruction has been issued, in step S224, a VPN connection is established between the second mobile terminal 601 that is making a call and the network 801.

  In step S225, the first portable terminal 401 transfers the remote panel image transmitted from the image forming apparatus 101 to the second portable terminal 601, and starts relay control. Thereby, the remote operation authority of the image forming apparatus 101 is transferred to the second portable terminal 601.

  In step S231, it is determined whether or not the cooperation between the first portable terminal 401 and the image forming apparatus 101 has ended. If not completed, the process proceeds to step S232. Since the relay control is performed on the assumption that the first mobile terminal 401 and the image forming apparatus 101 are in cooperation with each other, the relay control is also ended when the cooperation is ended. In this case, the process returns to step S215.

  In step S232, it is determined whether the end of relay is instructed by the user A. Specifically, it is determined whether or not the cooperation end button 438 has been operated. If not instructed, the process proceeds to step S233. If instructed, the relay control ends, and the process proceeds to step S222. At this time, the remote operation authority of the image forming apparatus 101 returns to the first portable terminal 401 under the control of the image forming apparatus 101. The first mobile terminal 401 displays the remote panel image on the display unit 431.

  In step S233, it is determined whether or not the user A has finished the call. If not completed, the process returns to step S231.

  If the call is terminated in step S233, the relay control is terminated in step S234, and the process returns to step S221. At this time, the remote operation authority of the image forming apparatus 101 returns to the first portable terminal 401 under the control of the image forming apparatus 101. The first mobile terminal 401 displays the remote panel image on the display unit 431.

  FIG. 13 is a flowchart showing the operation of the scan-out reception process.

  The scan-out reception process is performed in the first portable terminal 401 when the first portable terminal 401 and the image forming apparatus 101 are linked.

  As shown in FIG. 13, when the scan-out reception process is started, it is determined in step S251 whether or not a scanned-out document file (scan-out document) has been received. If not received, the scan-out reception process ends.

  If it is determined that it has been received in step S251, it is determined in step S252 whether identification information has been added. When transmitting the scan-out document to the second mobile terminal 601, the image forming apparatus 101 transmits the identification information of the second mobile terminal 601 and the scan-out document together with the first mobile terminal 401 using the relay information. To do. On the other hand, when transmitting the scan-out document to the first mobile terminal 401, the scan-out document is transmitted to the first mobile terminal 401 using the identification information of the first mobile terminal 401. Therefore, it can be determined whether or not the scan-out document has been transmitted to the own terminal depending on whether or not the identification information is added.

  When identification information is added in step S252, it can be determined that the scanned-out document has been transmitted from the image forming apparatus 101 toward the terminal corresponding to the identification information. Therefore, in step S253, the first mobile terminal 401 analyzes the added identification information and transfers the scan-out document to the detected terminal (for example, the second mobile terminal 601).

  On the other hand, when the identification information is not added in step S252, it can be determined that the scan-out document has been transmitted to the own terminal. Therefore, in step S254, the first portable terminal 401 stores the scan-out document in the storage unit 423 or the like as transmitted to itself.

  When the processes of steps S253 and S254 are performed, the scan-out reception process ends.

  By performing the processing in this way, even if the first mobile terminal 401 is performing a relay operation, one of the first mobile terminal 401 and the second mobile terminal 601 is set as the transmission destination of the scan-out document. You can use the scan-out function.

  [Operation of Second Portable Terminal 601 when Relay is Performed]

  FIG. 14 is a flowchart showing the operation of the second portable terminal 601 when relaying is performed.

  As illustrated in FIG. 14, the second portable terminal 601 performs the following processing based on control by the CPU 621 or the like.

  In step S311, a call is started with another device. Here, it is assumed that a call with the first mobile terminal 401 is performed.

  In step S312, it is determined whether or not there is a request for VPN connection from the first portable terminal 401. When the cooperation start button 437 is operated on the first portable terminal 401, there is a request for performing a VPN connection. If there is no request, the process proceeds to step S318.

  If there is a request, the second portable terminal 601 responds to the request in step S313. As a result, a VPN connection via the first portable terminal 401 is established. Accordingly, the second mobile terminal 601 can operate in cooperation with the image forming apparatus 101 by the relay operation of the first mobile terminal 401. Also, the identification information of the second portable terminal 601 is sent to the image forming apparatus 101 via the first portable terminal 401, and the second portable terminal 601 is registered as a scan-out destination.

  In step S <b> 314, the second mobile terminal 601 receives the remote panel image transferred from the first mobile terminal 401 and displays it on the display unit 631. At this time, the remote operation authority is transferred to the second portable terminal 601 under the control of the image forming apparatus 101. The user B of the second portable terminal 601 can operate the image forming apparatus 101 by operating the remote panel image.

  In step S315, it is determined whether a scan-out document has been received. If not received, the process proceeds to step S317.

  If it is determined in step S315 that it has been received, in step S316, the second portable terminal 601 stores the received scan-out document in the storage unit 623 or the like.

  In step S317, it is determined whether the call has ended. If the call has not ended, the process proceeds to step S318. When the call is finished, the relay control is also finished, and the series of processes is finished.

  In step S318, it is determined whether or not the relay operation by the first portable terminal 401 has ended. If it is determined that the process has not ended, the process returns to step S315. If it is determined that the relay operation has been completed, the process proceeds to step S319.

  In step S319, it is determined whether the call has ended. If the call has not ended, the process returns to step S312. When the call ends, a series of processing ends.

  [Explanation of scan-out function]

  FIG. 15 is a diagram for explaining the scan-out function.

  As shown in FIG. 15, when the second portable terminal 601 and the image forming apparatus 101 are operating in cooperation by the relay operation of the first portable terminal 401, the scan-out function to the second portable terminal 601 is performed. Can be executed. In such a case, as described above, the identification information related to the second portable terminal 601 is sent to the image forming apparatus 101 together with the relay operation of the first portable terminal 401, so that the second portable terminal 601 is registered as a scan-out destination. Has been. When the scan-out function is executed, the image forming system 901 performs the following operation.

  First, in step S <b> 21, a job for performing a scan-out function is registered in the image forming apparatus 101. At this time, a sheet (original) to be scanned is prepared and set in the image forming apparatus 101, and a transmission destination of a file obtained by reading is designated. An instruction for designating the transmission destination can be given directly to the image forming apparatus 101 by the user A or the like, and can be given to the second portable terminal 601 by using the remote panel function by the user B. . When the job is executed, the document is scanned and a scan generation file is generated.

  The image forming apparatus 101 transfers the scan generation file to the first mobile terminal based on the instruction for designating the transmission destination made by the user, the relay information about the first mobile terminal 401, and the identification information about the second mobile terminal 601. It transmits to the second portable terminal 601 via 401.

  That is, in step S22, the scan generation file and the identification information corresponding to the second portable terminal 601 are transmitted from the image forming apparatus 101 to the first portable terminal 401.

  In step S23, the first portable terminal 401 receives the identification information and the scan generation file. The first portable terminal 401 analyzes the received information and determines that the scan generation file is directed to the second portable terminal 601 based on the identification information.

  In step S24, the scan generation file is transmitted from the first portable terminal 401 to the second portable terminal 601 based on the identification information. Thereby, the scan generation file is received by the second portable terminal 601.

  Note that such transmission of the file from the image forming apparatus 101 to the second portable terminal 601 is performed for various files accessible by the image forming apparatus 101 in addition to the scan generation file obtained by scanning the document. Can do. For example, the transmission destination can be transmitted as the second portable terminal 601 with respect to the image file 27 d or the like that is generated by scanning in advance and stored in the image forming apparatus 101.

  [Description of remote print function]

  FIG. 16 is a diagram for explaining the remote printing function.

  As shown in FIG. 16, when the second mobile terminal 601 and the image forming apparatus 101 are operating in cooperation by the relay operation of the first mobile terminal 401, the second mobile terminal 601 is connected to the network 801 by VPN connection. , The image forming apparatus 101 can be designated as an output destination. In the present embodiment, it is possible to execute a remote print function for printing and outputting a document file accessible by the second portable terminal 601 by the image forming apparatus 101. In such a case, the remote print function is executed for the document file stored in the second portable terminal 601 or the document file stored in the external device that can be acquired by the second portable terminal 601 by communication. can do.

  As an example, a case is assumed in which the second portable terminal 601 is located in a remote location 701 away from the space 201 and can communicate with the file server 510 in the remote location 701. In this case, when the remote print function is executed for the document file 515 stored in the file server 510, the image forming system 901 performs the following operation.

  First, in step S41, the second portable terminal 601 communicates with the file server 510. For example, communication with the file server 510 is performed by wireless communication. Note that the second mobile terminal 601 and the file server 510 may be connected by wire, and the second mobile terminal 601 and the file server 510 may communicate with each other.

  Here, an operation by the user B is performed on the second portable terminal 601, and an instruction to output the document file 515 by the image forming apparatus 101 is performed by the remote print function. Then, in step S <b> 42, the second portable terminal 601 acquires the document file 515 from the file server 510.

  Upon obtaining the document file 515, the second portable terminal 601 converts the document file 515 into a PDL format for printing, and transmits the converted document file with an instruction to perform printing with the image forming apparatus 101 as a destination. To do. When the document file is transmitted from the second portable terminal 601, the document file is transmitted to the first portable terminal 401 (step S43). The first portable terminal 401 transfers the sent document file 515 to the image forming apparatus 101 (step S44).

  Upon receiving the document file 515 and an instruction to print it, the image forming apparatus 101 prints and outputs the document file 515 in step S45.

  Note that the second mobile terminal 601 transmits the document file 515 to the image forming apparatus 101 without conversion depending on the file format of the document file, the presence / absence of the file analysis function of the image forming apparatus 101, and the like. May be. In this case, the image forming apparatus 101 analyzes the document file 515 and outputs it.

  In addition to such a remote print function, a function of transmitting a document file to the image forming apparatus 101 and executing a predetermined process in the image forming apparatus 101 can be performed in the same manner as the remote print function. Good. For example, a function for storing a document file in the image forming apparatus 101, a function for performing facsimile transmission, or the like may be executed.

  [Effects of the embodiment]

  In the image forming system 901 configured as described above, even if the second portable terminal 601 is in a place where it cannot directly cooperate with the image forming apparatus 101, the first portable terminal 401 indirectly performs the relay operation. In addition, the second portable terminal 601 can be linked to the image forming apparatus 101 to execute various functions. Therefore, even when the second portable terminal 601 is in a remote place, there is no need to perform troublesome exchanges only by telephone communication or the like between the user A and the user B, and the convenience of the image forming system 901 is improved.

  [Others]

  In the above-described embodiment, control is performed so that the first mobile terminal 401 does not perform telephone communication with the second mobile terminal 601 and the first mobile terminal 401 operates in cooperation with the image forming apparatus 101. If a call is made and a relay start operation is performed, the relay operation is started. However, when control is performed so that the first mobile terminal 401 operates in cooperation with the image forming apparatus 101, when a call is made after that, that is, the first mobile terminal 401 and the second mobile terminal 601. When there is an incoming call or outgoing call for performing telephone communication, the relay operation may be started regardless of whether or not the relay start operation has been performed. In such a case, the user A does not need to perform a relay start operation, and the second portable terminal 601 and the image forming apparatus 101 can be easily linked.

  When the first mobile terminal 401 and the second mobile terminal 601 start a call in the case where the control is performed so that the first mobile terminal 401 operates in cooperation with the image forming apparatus 101 as described above, The relay operation may not be performed immediately, and the user A may confirm whether or not to start the relay operation. The confirmation can be performed by displaying a predetermined dialog on the display unit 431 of the first portable terminal 401 and accepting the operation of the user A, but is not limited thereto, and can be performed by various methods. If the intention to start the relay operation is confirmed, the first mobile terminal 401 starts the relay operation. Thus, by confirming the intention of the user A, it is possible to start or not execute the relay operation as the user A intends.

  Further, when control is performed so that the first portable terminal 401 can operate in cooperation with the image forming apparatus 101, it is determined whether the first portable terminal 401 is performing telephone communication with the second portable terminal 601. Thus, whether or not to perform the relay operation may be switched. That is, for example, when the cooperation between the first portable terminal 401 and the image forming apparatus 101 is started while the first portable terminal 401 is performing telephone communication with the second portable terminal 601, is the relay start operation performed? Regardless of whether or not, the relay operation is started. On the other hand, when the cooperation is started when telephone communication is not being performed, the relay operation is not started, and the first mobile terminal 401 is controlled to have the authority to remotely operate the image forming apparatus 101.

  The display unit of the portable terminal and the operation unit of the image forming apparatus may not be a touch panel. The operation unit of the portable terminal or the image forming apparatus may be provided with a hard key or the like for performing an operation, and may be configured to be accepted when the hard key is operated.

  The hardware configuration of the image forming apparatus and the portable terminal is not limited to the above.

  Further, the image processing apparatus according to the present invention is not limited to that used in the image forming apparatus. For example, the present invention can be applied to image processing apparatuses used in various apparatuses such as a scanner apparatus that reads image data, an imaging apparatus, and an image data transmission / reception apparatus.

  The processing in the above embodiment may be performed by software or by using a hardware circuit.

  A program for executing the processing in the above-described embodiment can be provided, or the program can be recorded on a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provided to the user. It may be. The program may be downloaded to the apparatus via a communication line such as the Internet. The processing described in the text in the above flowchart is executed by the CPU according to the program. Each process shown in the flowchart can be changed in order of execution as long as there is no problem.

  The above embodiment should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

DESCRIPTION OF SYMBOLS 11 Operation part 13 Display panel 20 Control part 27a Control program 30 Image formation part 101 Image formation apparatus 290 Internet 401 1st portable terminal (an example of 1st information processing terminal)
421 CPU
423 Storage unit 423a Control program 431 Display unit 435 In-call screen 437 Cooperation start button 438 Cooperation end button 439 Call end button 601 Second portable terminal (an example of second information processing terminal)
621 CPU
623 Storage unit 623a Control program 631 Display unit 635 Remote panel image 637 Remote panel end button 801 Network 901 Image forming system (an example of information processing system)

Claims (34)

An information processing system including a first information processing terminal and a second information processing terminal that perform telephone communication so that users can talk to each other, and an image forming apparatus,
The first information processing terminal
First cooperation control means for performing control so that the first information processing terminal can operate in cooperation with the image forming apparatus when the first information processing terminal and the image forming apparatus can communicate with each other; ,
When the first information processing terminal is operable in cooperation with the image forming apparatus, when the first information processing terminal is performing telephone communication with the second information processing terminal, the first information processing terminal Start operation accepting means for accepting a relay start operation from a user who operates
Relay means for performing a relay operation so that the second information processing terminal can communicate with the image forming apparatus when the relay start operation is received;
The second information processing terminal
When performing telephone communication with the first information processing terminal, relay communication that communicates with the image forming apparatus via the first information processing terminal when the relay operation by the first information processing terminal is started. An information processing system comprising means.   When the second information processing terminal can communicate with the image forming apparatus via the first information processing terminal, the second information processing terminal is controlled so that the second information processing terminal can operate in cooperation with the image forming apparatus. The information processing system according to claim 1, further comprising second cooperation control means for performing the following.   The information processing according to claim 1, wherein the relay unit constructs a VPN (Virtual Private Network) so that the second information processing terminal and the image forming apparatus can communicate with each other, and performs the relay operation. system.   The start operation accepting unit can accept the relay start operation when the first information processing terminal is controlled to operate in cooperation with the image forming apparatus by the first cooperation control unit. Item 4. The information processing system according to any one of Items 1 to 3. The first information processing terminal further includes an operation screen transmission unit that transmits information related to the operation screen transmitted from the image forming apparatus to the second information processing terminal when performing the relay operation.
The second information processing terminal includes operation screen display means for displaying the operation screen on the display screen of the second information processing terminal based on the information related to the operation screen transmitted from the first information processing terminal. The information processing system according to any one of claims 1 to 4, further comprising:   When the relay operation is performed by the first information processing terminal, the second information processing terminal receives the file held by the second information processing terminal or the first information via the first information processing terminal. 2. A file processing instructing unit that transmits a file that can be acquired by the information processing terminal to the image forming apparatus and instructs the image forming apparatus to process the file by the image forming apparatus. The information processing system according to any one of 1 to 5.   The information processing system according to claim 6, wherein the file processing instruction unit transmits the file and instructs the image forming apparatus to output the file by the image forming apparatus. The image forming apparatus includes:
Obtaining means for obtaining information on the second information processing terminal transmitted via the first information processing terminal;
When the relay operation is being performed by the first information processing terminal, an instruction directly made by the user to the image forming apparatus or an instruction made by the user to the second information processing terminal, and the second 8. The apparatus according to claim 1, further comprising: a file transmission unit configured to transmit a file from the image forming apparatus to the second information processing terminal via the first information processing terminal based on information regarding the information processing terminal. The information processing system according to item 1.   The file transmission means gives an instruction from the user to designate the second information processing terminal as the transmission destination of the file obtained by scanning and reading the paper with the image forming apparatus based on the information about the second information processing terminal. The information processing system according to claim 8, which is received.   When the first information processing terminal is controlled by the first cooperation control means so that the first information processing terminal can operate in cooperation with the image forming apparatus, the relay means controls the second information processing terminal. The information processing system according to any one of claims 1 to 9, wherein whether or not to perform the relay operation is switched according to whether or not telephone communication is performed with an information processing terminal.   In the case where the first information processing terminal is performing telephone communication with the second information processing terminal, the relay unit is configured so that the first information processing terminal cooperates with the image forming apparatus by the first cooperation control unit. The information processing system according to any one of claims 1 to 10, wherein when the control is performed so as to be operable, the relay operation is performed regardless of whether or not the relay start operation is accepted.   In the case where the first information processing terminal is not performing telephone communication with the second information processing terminal and the first information processing terminal is operable in cooperation with the image forming apparatus. Then, when there is an incoming call or outgoing call for performing telephone communication with the second information processing terminal at the first information processing terminal, the relay operation is performed regardless of whether the relay start operation is performed or not. The information processing system according to claim 1, wherein the information processing system is performed. The relay means is
In a case where the first information processing terminal is not performing telephone communication with the second information processing terminal and the first information processing terminal is operable in cooperation with the image forming apparatus, the When there is an incoming call or outgoing call for performing telephone communication with the second information processing terminal at one information processing terminal, the user is asked whether or not to start the relay operation,
The information processing system according to claim 1, wherein the relay operation is performed based on a confirmation result of whether or not to start the relay operation. In the case where the first information processing terminal is controlled to be operable in cooperation with the image forming apparatus by the first cooperation control unit, the remote operation authority of the image forming apparatus is:
Held by the first information processing terminal when the relay operation is not performed,
The information processing system according to claim 1, wherein the information processing system is held by the second information processing terminal when the relay operation is performed.   The first information processing terminal displays a display indicating that the relay operation is being performed on the display screen of the first information processing terminal when the relay operation is being performed by the relay unit. The information processing system according to claim 1, further comprising state display means. The first information processing terminal is a case where the first information processing terminal is performing telephone communication with the second information processing terminal, and the relay operation is performed by the relay means. Further comprising first end operation accepting means for accepting a user operation for terminating
16. The relay unit according to claim 1, wherein when the user operation is received by the first end operation reception unit, the relay unit ends the relay operation while continuing the telephone communication. Information processing system. When the first information processing terminal is performing telephone communication with the second information processing terminal and the relay operation is performed by the relay unit, the second information processing terminal A second ending operation receiving means for receiving a user operation for ending
17. The relay unit according to claim 1, wherein when the user operation is received by the second end operation reception unit, the relay unit ends the relay operation while continuing the telephone communication. Information processing system.   The relay means is controlled so that the first information processing terminal operates in cooperation with the image forming apparatus by the first cooperation control means, and the first cooperation is performed when the relay operation is performed. The information processing system according to any one of claims 1 to 16, wherein the relay operation is terminated when the control by the control unit is terminated. An information processing terminal that is used together with an image forming apparatus and performs telephone communication so that users can talk to each other with other information processing terminals,
When the information processing terminal and the image forming apparatus can communicate with each other, cooperative control means for performing control so that the information processing terminal can operate in cooperation with the image forming apparatus;
In a case where the information processing terminal is operable in cooperation with the image forming apparatus, when the information processing terminal is performing telephone communication with the other information processing terminal, from a user who operates the information processing terminal Start operation accepting means for accepting a relay start operation;
An information processing terminal comprising: a relay unit that performs a relay operation so that the other information processing terminal and the image forming apparatus can communicate with each other when the relay start operation is accepted.   The information processing terminal according to claim 19, wherein the relay unit constructs a VPN (Virtual Private Network) so that the other information processing terminal and the image forming apparatus can communicate with each other, and performs the relay operation.   21. The start operation accepting unit can accept the relay start operation when the information processing terminal is controlled to operate in cooperation with the image forming apparatus by the cooperation control unit. Information processing terminal described in 1.   The relay means controls the information processing terminal to perform telephone communication with the other information processing terminal when the cooperation control means controls the information processing terminal to be operable in cooperation with the image forming apparatus. The information processing terminal according to any one of claims 19 to 21, wherein whether to perform the relay operation is switched according to whether or not the relay operation is performed.   The relay means enables the information processing terminal to operate in cooperation with the image forming apparatus by the cooperation control means when the information processing terminal is performing telephone communication with the other information processing terminal. The information processing terminal according to any one of claims 19 to 22, wherein when the control is performed, the relay operation is performed regardless of whether or not the relay start operation is accepted.   In the case where the information processing terminal is not performing telephone communication with the other information processing terminal and the information processing terminal is operable in cooperation with the image forming apparatus, the relay unit thereafter The relay operation is performed regardless of whether or not the relay start operation is performed when there is an incoming call or outgoing call for performing telephone communication with the other information processing terminal at the information processing terminal. 24. The information processing terminal according to any one of 23. The relay means is
When the information processing terminal is not performing telephone communication with the other information processing terminal and the information processing terminal is operable in cooperation with the image forming apparatus, the information processing terminal thereafter When there is an incoming call or outgoing call for telephone communication with another information processing terminal, the user confirms whether or not to start the relay operation,
The information processing terminal according to any one of claims 19 to 24, wherein the relay operation is performed based on a confirmation result of whether or not to start the relay operation.   The relay status display means for displaying, on the display screen of the information processing terminal, a display indicating that the relay operation is being performed when the relay operation is being performed by the relay means. 26. The information processing terminal according to any one of 1 to 25. The information processing terminal is configured to terminate the relay operation when the information processing terminal performs telephone communication with the other information processing terminal and the relay operation is performed by the relay unit. A first ending operation receiving means for receiving the user's operation;
27. The relay unit according to claim 19, wherein the relay unit ends the relay operation while continuing the telephone communication when a user operation is received by the first end operation reception unit. Information processing terminal.   The relay means is controlled so that the information processing terminal operates in cooperation with the image forming apparatus by the cooperation control means, and when the relay operation is performed, the control by the cooperation control means ends. The information processing terminal according to any one of claims 19 to 27, wherein the relay operation is terminated when the relay operation is performed. An image forming apparatus operable in cooperation with an information processing terminal,
Communication means for communicating with a second information processing terminal different from the first information processing terminal by a relay operation by the first information processing terminal capable of communicating with the image forming apparatus;
Obtaining means for obtaining information relating to the second information processing terminal transmitted via the first information processing terminal by performing communication by the communication means;
When the communication by the communication unit is performed, an instruction directly given by the user to the image forming apparatus or an instruction given by the user to the second information processing terminal, and information related to the second information processing terminal An image forming apparatus comprising: a file transmission unit configured to transmit a file from the image forming apparatus to the second information processing terminal via the first information processing terminal.   The file transmission means gives an instruction from the user to designate the second information processing terminal as the transmission destination of the file obtained by scanning and reading the paper with the image forming apparatus based on the information about the second information processing terminal. 30. The image forming apparatus according to claim 29, which receives the image forming apparatus. A method of controlling an information processing terminal that is used together with an image forming apparatus and performs telephone communication so that users can talk to each other with other information processing terminals,
When the information processing terminal and the image forming apparatus can communicate with each other, a cooperative control step for performing control so that the information processing terminal can operate in cooperation with the image forming apparatus;
In a case where the information processing terminal is operable in cooperation with the image forming apparatus, when the information processing terminal is performing telephone communication with the other information processing terminal, from a user who operates the information processing terminal A start operation reception step for receiving a relay start operation;
A control method for an information processing terminal, comprising: a relay step of performing a relay operation so that the other information processing terminal and the image forming apparatus can communicate with each other when the relay start operation is accepted. An image forming apparatus control method operable in cooperation with an information processing terminal,
A communication step of communicating with a second information processing terminal different from the first information processing terminal by a relay operation by the first information processing terminal capable of communicating with the image forming apparatus;
An acquisition step of acquiring information on the second information processing terminal transmitted via the first information processing terminal by performing communication in the communication step;
When the communication in the communication step is performed, an instruction directly given by the user to the image forming apparatus or an instruction given by the user to the second information processing terminal, and information related to the second information processing terminal And a file transmission step of transmitting a file from the image forming apparatus to the second information processing terminal via the first information processing terminal. A control program for an information processing terminal that is used together with an image forming apparatus and performs telephone communication so that users can talk to each other with other information processing terminals,
When the information processing terminal and the image forming apparatus can communicate with each other, a cooperative control step for performing control so that the information processing terminal can operate in cooperation with the image forming apparatus;
In a case where the information processing terminal is operable in cooperation with the image forming apparatus, when the information processing terminal is performing telephone communication with the other information processing terminal, from a user who operates the information processing terminal A start operation reception step for receiving a relay start operation;
When the relay start operation is accepted, a control program for an information processing terminal that causes a computer to execute a relay step of performing a relay operation so that the other information processing terminal and the image forming apparatus can communicate with each other. An image forming apparatus control program operable in cooperation with an information processing terminal,
A communication step of communicating with a second information processing terminal different from the first information processing terminal by a relay operation by the first information processing terminal capable of communicating with the image forming apparatus;
An acquisition step of acquiring information on the second information processing terminal transmitted via the first information processing terminal by performing communication in the communication step;
When the communication in the communication step is performed, an instruction directly given by the user to the image forming apparatus or an instruction given by the user to the second information processing terminal, and information related to the second information processing terminal And a file transmission step of transmitting a file from the image forming apparatus to the second information processing terminal via the first information processing terminal.

Images