JP2014045418A - Information processing system, cooperation management device, information processing device, information processing system control method, and information processing system control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a highly convenient information processing system capable of utilizing respective display devices of an information processing device and a portable terminal.SOLUTION: An image formation device 101 and a portable terminal 201 perform operations by cooperation in an image formation system 901. In the system, switching is automatically performed concerning which one of the image formation device 101 and the portable terminal 201 is defined as a "master" device and which one of them is defined as a "slave" device. The image formation device 101 functions as a cooperation management device so as to detect at least one of an operation by a user performed with respect to the image formation device 101 and an operation by a user performed with respect to the portable terminal 201 and to define one of the image formation device 101 and the portable terminal 201 as a master device and the other one as a slave device in accordance with detected contents. The respective display contents of display panels 112, 212 are switched in response to whether the image formation device 101 is defined as a master device or the portable terminal 201 is defined as a master device.

Description

  The present invention relates to an information processing system, a cooperation management device, an information processing device, a control method for the information processing system, and a control program for the information processing system, and in particular, an information processing system, a cooperation management device, and an information processing capable of obtaining good operability. The present invention relates to an apparatus, an information processing system control method, and an information processing system control program.

  In recent years, mobile terminals (personal digital assistants) have become highly functional, and individuals own mobile terminals instead of PCs (personal computers). By using the mobile terminal, the user can freely view and edit an electronic document, for example, at an arbitrary place. Since the portable terminal is highly convenient, the portable terminal is used in various scenes of business and life.

  As mobile terminals become more sophisticated, information processing systems including information processing apparatuses and mobile terminals are used. An information processing system is known that executes various information processing operations in cooperation with an information processing device and a portable terminal. Examples of the information processing apparatus include an image forming apparatus equipped with an operation panel. The convenience of the information processing system is enhanced by linking the image forming apparatus and the portable terminal to perform auxiliary display related to the processing performed by the image forming apparatus on the portable terminal or sending / receiving information to / from each other. It has become.

  In the following Patent Document 1, the image forming apparatus main body is photographed with a portable communication terminal, and the help information according to the state of the target device can be obtained by linking the image forming apparatus and the portable communication terminal. A help information providing system is disclosed.

JP 2010-219879 A

  By the way, in the conventional information processing system, there is generally a problem that although the respective display panels on the information processing apparatus side and the portable terminal side can be used, they cannot be fully utilized. . For example, there is one in which display contents are fixed on each of the information processing apparatus side and the portable terminal side. Further, for example, some portable terminals are only displayed as an auxiliary to the information processing apparatus.

  The present invention has been made to solve such a problem, and can utilize the respective display devices on the information processing device side and the portable terminal side, and the information processing system, the cooperation management device, which are more convenient, An object of the present invention is to provide an information processing apparatus, an information processing system control method, and an information processing system control program.

  In order to achieve the above object, according to one aspect of the present invention, an information processing device, a portable terminal that can communicate with the information processing device, and a cooperation management device that can communicate with each of the information processing device and the portable terminal are provided. An information processing system in which an information processing apparatus and a mobile terminal can operate in cooperation with each other based on control of the management apparatus is configured such that the information processing apparatus and the mobile terminal respectively control display contents of the display device and the display apparatus. The cooperation management device includes a user operation performed on the information processing device and a user operation performed on the mobile terminal in a state where the information processing device and the mobile terminal are linked. According to the detection means for detecting at least one of the information processing device and the mobile terminal, the determination is made as one of the main device and the other as the sub device according to the detection content of the detection means. And a constant section, at least one of the display control means with the information processing apparatus and the mobile terminal, based on the determination content by the determination means switches the display contents of the display device.

  Preferably, when the operation by the user is detected by the detection unit, the determination unit determines, as the main device, the device that has performed the operation among the information processing device and the portable terminal.

  Preferably, after the determination of the main device is performed by the determination unit, when the operation by the user is detected by the detection unit, the determination unit selects the device that has performed the operation among the information processing device and the portable terminal. Re-determine as main device.

  Preferably, in the main device determined by the determination unit among the information processing device and the portable terminal when the operation by the user for executing the information transmission function is detected by the detection unit, the display control unit of the main device is The display device of the main device displays the transmission destination information registered in advance in the main device, and the slave device that has not been determined as the main device by the determination unit among the information processing device and the portable terminal The display control means of the device causes the display device of the slave device to display the destination information that is registered in advance in the slave device and is not registered in the master device. Accepts the selection operation by the user for the transmission destination information displayed on the display device of the main device and the transmission destination information displayed on the display device of the secondary device, and transmits corresponding to the received selection operation. Based on the information, to execute the information transmitting function.

  Preferably, when the main device receives a selection operation by the user for the transmission destination information displayed on the display device of the slave device, the master device acquires only the transmission destination information corresponding to the received selection operation from the slave device. Based on the acquired transmission destination information, the information transmission function is executed.

  Preferably, when the main device receives the selection operation by the user for the transmission destination information displayed on the display device of the slave device, the master device further registers the transmission destination information acquired from the slave device in the master device. To do.

  Preferably, in the case where the information processing apparatus is determined as the main apparatus by the determination unit when the information processing apparatus is determined as the main apparatus, the cooperation management apparatus uses the detection unit as the display control unit of the portable terminal. A display corresponding to the detected operation is displayed on the display device of the portable terminal.

  Preferably, in the case where the information processing apparatus is determined as the main apparatus by the determination unit, when the predetermined process is executed in the main apparatus, the cooperation management apparatus determines the priority of the predetermined process in the information processing apparatus or The display corresponding to the operation detected by the detecting means is displayed on the display device of the mobile terminal on the display control means of the mobile terminal in accordance with the magnitude of the load applied to the information processing apparatus by the predetermined processing.

  Preferably, in the case where the information processing apparatus is determined as the main device by the determination unit, the cooperation management device, when the display corresponding to the operation detected by the detection unit is performed on the display device of the mobile terminal, Based on the operation performed by the user, the display control means of each of the information processing apparatus and the portable terminal is switched to perform display corresponding to the operation detected by the detection means on the display apparatus of the information processing apparatus.

  Preferably, the predetermined process is at least one of a web browsing process performed using browser software and an image or moving image browsing process.

  Preferably, the portable terminal can execute the application program, the detection unit can detect an operation for executing the application program on the portable terminal, and the determination unit detects an operation for executing the application program by the detection unit. When the information processing apparatus and the portable terminal are linked, the portable terminal is determined as the main apparatus.

  Preferably, when the information processing apparatus and the mobile terminal are linked, when the mobile terminal is executing an application program, the mobile terminal outputs information about the information handled by the application program on the information processing apparatus. And the display control means of the information processing apparatus displays a sub-screen for setting information used for output on the display apparatus of the information processing apparatus based on the instruction from the portable terminal, In response to an instruction from the mobile terminal, the device performs output based on information set using the slave screen.

  Preferably, the information processing apparatus transmits information set using the follow screen to perform output to the mobile terminal, and the mobile terminal stores the information transmitted from the information processing apparatus.

  Preferably, the information processing apparatus is capable of printing out, the portable terminal gives an instruction to perform printing with the information processing apparatus, and the display control means of the information processing apparatus displays the print setting screen as a sub screen. The information processing apparatus performs printing based on the printing conditions set using the print setting screen.

  Preferably, the information processing apparatus is capable of printout, the portable terminal gives an instruction to print an image on the information processing apparatus, and the display control means of the information processing apparatus displays an image to be printed on the sub-screen. The information processing apparatus accepts an image editing operation performed while displaying the secondary screen, and prints the image edited by the editing operation in accordance with an instruction from the mobile terminal.

  Preferably, when information used when the information processing apparatus performs output is set in advance by an application program executed on the mobile terminal, the information competes with information set on the information processing apparatus side. In some cases, priority is given to information set on the information processing apparatus side.

  Preferably, the information processing system is capable of performing information transmission by a plurality of types of transmission methods, and the detection unit is configured to select a transmission method corresponding to an operation by the user performed on the information processing device or the mobile terminal. Based on the transmission method detected by the detecting means, the detecting means determines that one of the information processing apparatus and the portable terminal is the main apparatus and the other is the slave apparatus.

  Preferably, the information processing apparatus has a facsimile transmission function, the portable terminal has an e-mail transmission function, and the determination unit detects a user operation corresponding to a transmission method involving facsimile transmission by the detection unit. When the information processing apparatus is determined as the main apparatus, and the user's operation corresponding to the transmission method involving e-mail transmission is detected by the detection unit, the mobile terminal is determined as the main apparatus.

  Preferably, the determination unit determines, as the main device, a device in which a lot of transmission destination information corresponding to the transmission method detected by the detection unit is registered among the information processing device and the portable terminal.

  Preferably, the mobile terminal further includes an imaging unit, and the cooperation management device further includes a cooperation unit that links the imaged information processing device and the mobile terminal when the information processing device is imaged by the imaging unit.

  Preferably, the cooperation management device is built in either the information processing device or the portable terminal.

  Preferably, the information processing apparatus is an image forming apparatus having a printing function.

  The cooperation management apparatus contained in the information processing system in any one of the above-mentioned.

  An information processing apparatus included in any of the information processing systems described above.

  According to another aspect of the present invention, an information processing device, a portable terminal that can communicate with the information processing device, and a cooperation management device that can communicate with each of the information processing device and the portable terminal are provided. The information processing system control method that allows the information processing device and the portable terminal to operate in cooperation with each other includes a display device, and the information processing system control method includes information A detection step for detecting at least one of a user operation performed on the information processing apparatus and a user operation performed on the mobile terminal in a state where the processing device and the mobile terminal are linked together; A determination step for determining one of the information processing apparatus and the portable terminal as a main apparatus and the other as a subordinate apparatus according to the detected content of the step; At least one of the, based on the determination content of the determination step, and a display control step of switching the display content of the display device.

  According to still another aspect of the present invention, an information processing apparatus, a portable terminal that can communicate with the information processing apparatus, and a cooperation management device that can communicate with each of the information processing apparatus and the portable terminal are provided. The control program for causing the computer included in the information processing system that can operate in cooperation with the information processing device and the portable terminal based on the information processing device and the portable terminal each have a display device, The control program of the information processing system is at least one of an operation performed by the user performed on the information processing apparatus and an operation performed by the user performed on the mobile terminal in a state where the information processing apparatus and the mobile terminal are linked. One of the information processing device and the portable terminal is set as a main device and the other is set as a subordinate device according to the detection step for detecting one and the detection contents of the detection step. A determining step of determining that the location, at least one of the information processing apparatus and the mobile terminal, based on the determination content of the determination step, to execute a display control step of switching the display content of the display device to the computer.

  According to these inventions, it is determined whether each device is a primary device or a secondary device based on a user operation performed on either the information processing device or the portable terminal, and the determination is made. Based on the result, the display content of the display device is switched. Therefore, each display device on the information processing device side and the portable terminal side can be utilized, and the information processing system, the cooperation management device, the information processing device, the information processing system control method, and the information processing system control program that are more convenient Can be provided.

1 is a block diagram illustrating an image forming system according to a first embodiment of the present invention. 1 is a perspective view showing an image forming apparatus. FIG. 2 is a block diagram illustrating control blocks of each device of the image forming system. 4 is a flowchart for explaining the operation of the image forming system when a cooperative operation is performed in the first embodiment. It is a flowchart explaining operation | movement of a master-slave setting process and a destination display process. An example of the process performed when the process of FIG. 4 is completed is shown. It is a flowchart explaining the example of a change of the operation | movement of a master-slave setting process and a destination display process. 10 is a flowchart for explaining the operation of the image forming system when a cooperative operation is performed in the second embodiment. It is a flowchart explaining operation | movement of a web connection and a display process. It is a flowchart explaining an example of a master-slave setting. 10 is a flowchart illustrating an operation of the image forming system when a cooperative operation is performed in the third embodiment of the present invention. It is a flowchart explaining an example of operation | movement of the process at the time of cooperation. It is a flowchart explaining another example of operation | movement of the process at the time of cooperation.

  Hereinafter, an image forming system (an example of an information processing system) according to an example of an embodiment of the present invention will be described.

  The image forming system includes an image forming apparatus (an example of an information processing apparatus) and a portable terminal (portable information terminal).

  The image forming apparatus is an MFP (Multi Function Peripheral) having a scanner function, a copying function, a printer function, a facsimile function, a data communication function, and a server function. The scanner function is a function for reading an image of a set original and storing it in an HDD (Hard Disk Drive) or the like. The copying function is a function of printing (printing) it on paper or the like. The function as a printer is a function for printing on a sheet based on an instruction received from an external terminal such as a PC. The facsimile function is a function for receiving facsimile data from an external facsimile machine or the like and storing it in an HDD or the like. The data communication function is a function for transmitting / receiving data to / from a connected external device. The server function is a function that allows a plurality of users to share data stored in the HDD or the like.

  The portable terminal is a tablet-type terminal having various functions such as a data communication function and information storage, browsing, and output functions. The data communication function is a function for performing data communication with other devices via, for example, a mobile phone network or other networks. The data communication function can be performed by wireless communication, for example. Information storage, browsing, and output functions can store information sent from an external device or information input by a user, display the stored information on a display, or send it to an external device It is a function to make. The mobile terminal may be a multi-function mobile phone further provided with a telephone function for making a voice call with another telephone via a mobile phone network.

  The image forming apparatus and the portable terminal are both connected to a network and can communicate with each other via the network. Both the image forming apparatus and the portable terminal have a display device such as a touch panel. The image forming apparatus and the portable terminal communicate with each other, so that the operation images and the like related to each other can be displayed on the display device of each apparatus, and the image forming apparatus can be used in cooperation with the portable terminal. .

  In the present embodiment, it is determined whether each device is a main device or a slave device based on a user operation performed on either the image forming apparatus or the portable terminal. In each device, the display content of the display device is switched depending on whether the device is a main device or a slave device. Accordingly, the image forming apparatus and the portable terminal can be used in cooperation with each display device in a state where the display reflecting the relationship between the master and the slave is performed.

  [First Embodiment]

  FIG. 1 is a block diagram showing an image forming system according to the first embodiment of the present invention.

  In this embodiment, the image forming system 901 includes an image forming apparatus 101 and a mobile terminal 201. In the image forming system 901, the image forming apparatus 101 performs an operation as a cooperation management apparatus that operates the image forming apparatus 101 and the portable terminal 201 in cooperation with each other. In other words, the image forming apparatus 101 includes a cooperation management apparatus that controls the image forming apparatus 101 and the portable terminal 201 to operate in cooperation. In the image forming system 901, the image forming apparatus 101 and the portable terminal 201 can operate in cooperation based on the control of the cooperation management apparatus of the image forming apparatus 101.

  As shown in FIG. 1, in the image forming system 901, the image forming apparatus 101 and the mobile terminal 201 are connected to each other via a network 801 so as to communicate with each other. The network 801 is, for example, a local information communication network (LAN). The image forming apparatus 101 is connected to a network 801 via a so-called wired LAN. On the other hand, the mobile terminal 201 is connected to the network 801 via a so-called wireless LAN. That is, a connection device 401 that is a wireless LAN access point is connected to the network 801. The mobile terminal 201 is connected to the network 801 via the connection device 401 by wireless connection to the connection device 401.

  In addition, the connection aspect of each apparatus is not restricted to this. For example, the image forming apparatus 101 and the portable terminal 201 may be connected so as to be able to communicate with each other using a short-range wireless communication technology.

  [Configuration of Image Forming Apparatus 101]

  FIG. 2 is a perspective view showing the image forming apparatus 101.

  As shown in FIG. 2, the image forming apparatus 101 includes a paper feed cassette 103, a paper discharge tray 105, an operation panel (an example of a detection unit) 111, a control unit (an example of a determination unit) 121, and an image formation unit. 131 and a scanner unit 141. The control unit 121 controls the operation of the image forming apparatus 101. The control unit 121, the image forming unit 131, the scanner unit 141, and the like are arranged inside the housing of the image forming apparatus 101.

  The image forming apparatus 101 includes three paper feed cassettes 103 (paper feed cassettes 103a, 103b, and 103c). Each paper feed cassette 103 is loaded with, for example, different sizes of paper (B5 size, A4 size, A3 size, etc.). The paper feed cassette 103 is disposed in the lower part of the image forming apparatus 101 so as to be removable from the housing of the image forming apparatus 101. The paper loaded in each paper feed cassette 103 is fed one by one from the paper feed cassette 103 and sent to the image forming unit 131 at the time of printing. Note that the number of paper feed cassettes 103 is not limited to three and may be more or less.

  The paper discharge tray 105 is disposed above the portion of the housing of the image forming apparatus 101 where the image forming unit 131 is stored and below the portion where the scanner unit 141 is disposed. The paper on which the image is formed by the image forming unit 131 is discharged from the inside of the housing to the paper discharge tray 105.

  The image forming unit 131 roughly includes a toner image forming unit (not shown), a paper transport unit (not shown), and a fixing device (not shown). The image forming unit 131 forms an image on a sheet by, for example, electrophotography. That is, the image forming apparatus 101 can print out.

  The paper transport unit includes a paper feed roller, a transport solar, and a motor that drives them. The paper transport unit feeds paper from the paper feed cassette 103 and transports it inside the housing of the image forming apparatus 101. The paper transport unit discharges the paper on which the image is formed from the housing of the image forming apparatus 101 to the paper discharge tray 105 or the like.

  The fixing device has a heating roller and a pressure roller. The fixing device conveys the sheet on which the toner image is formed between the heating roller and the pressure roller, and heats and presses the sheet. As a result, the fixing device melts the toner adhering to the paper and fixes it on the paper to form an image on the paper.

  The scanner unit 141 is disposed on the upper part of the casing of the image forming apparatus 101. The scanner unit 141 includes an ADF (Auto Document Feeder) 143. The scanner unit 141 executes the above-described scanner function. The scanner unit 141 scans a document placed on a transparent document table with a contact image sensor and reads it as image data. The scanner unit 141 reads a plurality of documents set on the document tray one by one by the ADF 143 one by one and reads the document by a contact image sensor to obtain image data.

  The image read by the scanner unit 141 is converted into a finished image by the control unit 121. The control unit 121 can transmit the generated finished image to an external device or the like, or can form an image on a sheet by the image forming unit 131 based on the finished image. For example, the control unit 121 can send the read image to the mobile terminal 201 and cause the mobile terminal 201 to display the read image.

  The operation panel 111 is disposed on the upper front side (front side in FIG. 2) of the image forming apparatus 101. On the operation panel 111, operation buttons that can be pressed by the user are arranged. The operation panel 111 is provided with a display panel (an example of a display device) 112 that displays information to the user.

  The display panel 112 is a touch panel. The display panel 112 is, for example, an LCD (Liquid Crystal Display). The display panel 112 displays a guidance screen for the user or displays an operation button to accept a touch operation from the user. The display panel 112 is controlled by the display control unit 153 under the control of the control unit 121 and performs display. The operation panel 111 accepts operation inputs made by the user to the operation buttons and the display panel 112. When the operation button or the display panel 112 is operated by the user, the operation panel 111 transmits an operation signal or a predetermined command corresponding to the operation to the control unit 121. That is, the user can cause the image forming apparatus 101 to execute various operations by operating the operation buttons and the display panel 112.

  FIG. 3 is a block diagram illustrating a control block of each device of the image forming system 901.

  As shown in FIG. 3, the image forming apparatus 101 includes a control unit 121, a data management unit 151, a display control unit 153, a main / sub flag 155 (hereinafter simply referred to as a flag 155), and a storage area 161. Etc. Each of these units communicates with the control unit 121 and operates under the control of the control unit 121.

  The control unit 121 is configured by, for example, a CPU, a ROM, a RAM, and the like.

  The storage area 161 is, for example, an HDD. The storage area 161 is provided with a control program 165 that is executed by the control unit 121 or the like. In the present embodiment, the data management unit 151, the display control unit 153, and the like function when the control unit 121 executes the control program 165.

  The data management unit 151 manages various data used in the image forming apparatus 101. The data management unit 151 manages, for example, transmission destination information (facsimile number or the like) of facsimile transmission registered in advance by the user as a database. Data management may be performed while storing information in the storage area 161, for example.

  Such transmission destination information is used in an information transmission function such as a facsimile transmission function and a mail transmission function of the image forming apparatus 101, for example. The mail transmission function is used, for example, in a Scan to Email function that transmits an image read by the scanner unit 141 as an attachment to an electronic mail.

  The display control unit 153 controls the display content of the display panel 112 based on the control of the control unit 121.

  As will be described later, the flag 155 is used to set whether the image forming apparatus 101 operates as a main apparatus or a secondary apparatus in the image forming system 901.

  Note that the image forming apparatus 101 has a user authentication function. The user authentication is a job for identifying and authenticating a user who uses the image forming apparatus 101. The user can log in to the image forming apparatus 101 and use the image forming apparatus 101 through authentication by user authentication.

  In user authentication, for example, an authentication database (not shown) stored in the storage area 161 is used. In the authentication database, user information that can be authenticated and authentication information necessary for the user authentication are recorded in association with each other. The authentication information is, for example, a password set for each user. In the authentication database, information related to the function permitted to be executed for each user is recorded in association with the user.

  User authentication is performed as follows, for example. That is, first, a user authentication screen is presented to the user. The user authentication screen is displayed on the display panel 112. The user operates the operation panel 111 to input information about the user (for example, an account name) and a password to the image forming apparatus 101. When such information is input to the operation panel 111, the control unit 121 refers to the authentication database and determines whether or not the user can be authenticated based on the input data. If the authentication is possible, the control unit 121 determines that the user is authenticated, and enables the function that is permitted to be executed for the authenticated user who is authenticated. At this time, the authenticated user is logged in to the image forming apparatus 101. Thereby, the image forming apparatus 101 can identify a user who uses the image forming apparatus 101.

  By identifying the user by performing user authentication, the display of the display panel 112 and usable functions are adapted to the authenticated user, and the convenience of the image forming apparatus 101 can be enhanced. Further, when the authenticated user is near the image forming apparatus 101, a high security effect can be obtained, for example, a printed matter can be output without touching the eyes of other users.

  In the image forming apparatus 101, the control unit 121 manages the user's authority to use the functions of the image forming apparatus 101 according to the user identified by the user authentication. By managing the use authority, use of a predetermined function can be restricted for each user, and a high security effect can be obtained.

  Note that the user authentication method is not limited to the above, and a known method can be adopted as appropriate. The reference destination of authentication information, the subject performing authentication, and the like may be different from those described above. For example, the image forming apparatus 101 itself has authentication information for performing user authentication, and the image forming apparatus 101 may accept an authentication request from the user and authenticate the user based on the authentication information. . Further, the user may not be prompted to input information such as an account name or a password. That is, for example, a card authentication method using a contact / non-contact ID card, a biometric authentication method using user fingerprint information, vein information, or the like can be employed. The authentication database may be managed by a server (not shown) constituting the image forming system 901 or the like.

  Here, in the present embodiment, the image forming apparatus 101 has a web browsing function. In the web browsing function, the control unit 121 executes a predetermined control program 165 to operate the web browser. The web browser acquires web page information from the designated web server, and causes the display panel 112 to display the web page. Thereby, the user can browse the web page displayed on the display panel 112.

  [Configuration of portable terminal 201]

  The mobile terminal 201 is, for example, a so-called tablet terminal. The mobile terminal 201 may be a smartphone (multifunctional mobile phone). As illustrated in FIG. 1, the mobile terminal 201 includes a display panel (an example of a display device, an example of a detection unit) 212. The display panel 212 is a touch panel, for example. The user can execute various functions by touching the display panel 112 based on the display displayed on the display panel 212.

  For example, the mobile terminal 201 has an e-mail transmission function (an example of an information transmission function) and a telephone function. The mobile terminal 201 can execute an application program set to be executable in advance (sometimes simply referred to as an application). By executing applications that perform various operations, the mobile terminal 201 can be used for various purposes.

  Referring to FIG. 3, the mobile terminal 201 includes a file control unit 221, a photographing unit (an example of an imaging unit) 251, a display control unit 253, and a main / sub flag 255 (hereinafter may be referred to as a flag 255). And a storage area 261.

  The file control unit 221 is connected to each unit of the imaging unit 251, the display control unit 253, the flag 255, and the storage area 261. Similar to the control unit 121, the file control unit 221 includes a CPU, a ROM, a RAM, and the like, and controls the operation of the mobile terminal 201.

  The storage area 261 is, for example, a so-called flash memory. An address book is stored in the storage area 261. That is, in the storage area 261, information such as an e-mail address and a telephone number used as the information transmission destination in the portable terminal 201 is organized and stored.

  The storage area 261 is provided with a control program 265 that is executed by the file control unit 221 or the like. In the present embodiment, when the control program 265 is executed by the file control unit 221, the display control unit 253 and the like function.

  The display control unit 253 controls the display content of the display panel 212 based on the control of the file control unit 221. The flag 255 is used to set whether the portable terminal 201 operates as a main device or a slave device in the image forming system 901, as will be described later.

  The imaging unit 251 has an image sensor. That is, the portable terminal 201 is equipped with a camera and can capture the surrounding situation. Note that the photographing unit 251 may be capable of capturing only a still image, or may be capable of capturing a moving image in addition to the still image. The imaging unit 251 operates according to a user operation or the like based on control by the file control unit 221.

  In the present embodiment, the mobile terminal 201 has various functions such as a web browsing function and a moving image playback function. For example, in the web browsing function, the file control unit 221 executes a predetermined control program 265 to operate the web browser. The web browser acquires web page information from the designated web server, and causes the display panel 212 to display the web page. Thereby, the user can browse the web page displayed on the display panel 212.

  [Description of linkage operation]

  In the image forming system 901, the image forming apparatus 101 and the portable terminal 201 can perform a cooperative operation based on control by the image forming apparatus 101. Hereinafter, the cooperative operation will be described.

  In the cooperative operation, the image forming apparatus 101 and the mobile terminal 201 communicate with each other, so that operation images related to each other are displayed on the display panels 112 and 212 of each apparatus. As a result, the user can conveniently use a desired function using both the display panel 112 of the image forming apparatus 101 and the display panel 212 of the portable terminal 201. For example, when using a function of the image forming apparatus 101, the user can display information related to the function on the display panel 212 of the portable terminal 201 and use the display panel 212 as a remote panel.

  Note that the cooperation between the image forming apparatus 101 and the portable terminal 201 can be started, for example, by imaging the image forming apparatus 101 with the photographing unit 251 of the portable terminal 201. That is, the image forming apparatus 101 is provided with an identification mark that has been adjusted in advance so that the portable terminal 201 can recognize the image by the imaging unit 251. When the portable terminal 201 images the identification mark, the portable terminal 201 can recognize the image forming apparatus 101 as a cooperation partner. Thereby, the portable terminal 201 and the image forming apparatus 101 can cooperate with each other via the network 801. Note that the identification mark may be a specific character such as a model name or a graphic such as a barcode. Using an AR (Argented Reality) technology, a captured image captured by the mobile terminal 201 and an image displayed based on the captured image are combined and displayed on the mobile terminal 201, and the user performs an appropriate operation based on the display result. By performing the above, it is possible to easily combine the specific portable terminal 201 and the image forming apparatus 101 so that they can communicate with each other.

  [Description of operation related to master-slave settings]

  In this embodiment, when the cooperative operation is performed in this way, which of the display panel 112 of the image forming apparatus 101 and the display panel 212 of the portable terminal 201 is the main display and which is the sub display. Is automatically switched. In other words, which of the image forming apparatus 101 and the portable terminal 201 is the “main” apparatus and which is the “subordinate” apparatus is automatically switched. The side on which the user mainly inputs and handles operations is set as the main device. For example, when printing is performed, the direction in which a print instruction is input is “main”.

  The display contents of the display panels 112 and 212 are switched depending on whether the image forming apparatus 101 is the main apparatus or the portable terminal 201 is the main apparatus. Accordingly, the image forming apparatus 101 and the portable terminal 201 can be used in a convenient manner in a state where the display reflecting the relationship between the master and the slave is performed on each of the display panels 112 and 212. That is, the operability of the user can be improved by dynamically switching the master / slave of the display panels 112 and 212 of the image forming apparatus 101 and the portable terminal 201.

  FIG. 4 is a flowchart for explaining the operation of the image forming system 901 when the cooperative operation is performed in the first embodiment. FIG. 5 is a flowchart for explaining the operations of the master / slave setting process and the destination display process.

  In the operation of the image forming system 901 as shown in FIGS. 4 and 5, the image forming apparatus 101 as the cooperation management apparatus operates based on control by causing the control unit 121 to execute the control program 165, for example. The following processing is performed when an operation by the user for executing the information transmission function is performed.

  As shown in FIG. 4, in step S <b> 101, the control unit 121 determines whether or not the portable terminal 201 is linked with an image forming apparatus (MFP) as a remote panel. If so, the process proceeds to step S102.

  In step S <b> 102, the control unit 121 detects that a facsimile transmission operation or a scanning operation has been performed on the image forming apparatus 101. Such an operation is performed via the operation panel 111, for example.

  In step S103, the control unit 121 performs master-slave setting processing and destination display processing. This process will be described with reference to FIG.

  As shown in FIG. 5, in step S131, the control unit 121 determines whether or not the display panel 112 on the image forming apparatus 101 side has been operated after the processing in step S102 is performed.

  When the display panel 112 is operated in step S131, processing in steps S132 to S134 is performed.

  That is, in step S132, the control unit 121 sets the flag 155 by setting the image forming apparatus 101 as the main apparatus (sets the main flag). On the other hand, the control unit 121 requests the mobile terminal 201 to set the flag 255, assuming that the mobile terminal 201 is a slave device. Thereby, in the portable terminal 201, the file control unit 221 sets the flag 255 by setting the portable terminal 201 as a slave device (sets a sub flag). As a result, the flag 155 indicates that the apparatus is a main apparatus, and the flag 255 indicates that the apparatus is a subordinate apparatus. The image forming apparatus 101 and the portable terminal 201 can determine that the image forming apparatus 101 is the main apparatus and the portable terminal 201 is the slave apparatus by looking at the flag 155 and the flag 255.

  In step S133, the control unit 121 displays a screen for accepting selection of a transmission destination registered in the image forming apparatus 101 on the display panel 112 of the image forming apparatus 101 which is the main apparatus. The display is performed by the control unit 121 controlling the display control unit 153.

  In step S <b> 134, the control unit 121 causes display as a device according to the mobile terminal 201 to be executed. At this time, the file control unit 221 displays a transmission destination registered in the portable terminal 201 and not registered in the image forming apparatus 101. The display is performed by the file control unit 221 controlling the display control unit 253.

  On the other hand, when the operation panel 111 is not operated in step S131, processing in steps S135 to S137 is performed.

  That is, in step S135, the control unit 121 determines that the mobile terminal 201 is the main device and sets the flag 255 to the mobile terminal 201. Thereby, in the portable terminal 201, the file control unit 221 sets the flag 255 by setting the portable terminal 201 as the main device (sets the main flag). On the other hand, the control unit 121 sets the flag 155 by setting the image forming apparatus 101 as a slave apparatus (sets a sub flag). As a result, the flag 155 indicates that the apparatus is a main apparatus, and the flag 255 indicates that the apparatus is a subordinate apparatus. The image forming apparatus 101 and the portable terminal 201 can determine that the image forming apparatus 101 is a slave apparatus and the portable terminal 201 is a main apparatus by looking at the flag 155 and the flag 255.

  In step S136, the control unit 121 causes the mobile terminal 201 to perform display as the main device. The file control unit 221 displays the transmission destination registered in the mobile terminal 201 on the display panel 212. The display is performed by the file control unit 221 controlling the display control unit 253.

  In step S137, the control unit 121 executes display as the main device. At this time, the control unit 121 displays a transmission destination registered in the image forming apparatus 101 and not registered in the portable terminal 201. The display is performed by the control unit 121 controlling the display control unit 153.

  When the process of step S134 or the process of step S137 ends, the master-slave setting process and the destination display process end, and the process returns to the flowchart of FIG.

  When the master / slave setting process and the destination display process are completed, in step S104, the master apparatus determines whether a transmission destination is selected by the slave apparatus. When the transmission destination is not selected by the slave device, that is, when the transmission destination is selected by the main device, the process proceeds to step S106. When the transmission destination is selected by the slave device, the process proceeds to step S106 through the process of step S105.

  When the transmission destination is determined by the slave device, in step S105, the main device copies only the transmission destination information related to the selected transmission destination from the slave device to the master device. The information transmitted at this time is, for example, a facsimile number or an e-mail address. Note that the main device may copy all the transmission destination information of the slave device to the main device.

  In step S <b> 106, the main apparatus sets a transmission destination according to the selection operation by the user. Then, information is transmitted to the set transmission destination in accordance with the operation performed in step S102. At this time, settings regarding processing to be performed may be displayed on the main device side. For example, when the image forming apparatus 101 performs a facsimile transmission function or a Scan to Email function that transmits a scanned image by e-mail, the resolution, size, magnification, and the like may be set using the display panel 112.

  When the transmission of information is completed, a series of operations is completed.

  As described above, in this exemplary embodiment, an operation performed by the user is detected, and the apparatus that has performed the operation among the image forming apparatus 101 and the portable terminal 201 is set as a main apparatus according to the content of the operation. By using the other device as a slave device, the user can intuitively and easily operate the device that is mainly operated as the main device. For example, when executing a mail transmission function (such as a Scan to Email function) in the image forming apparatus 101, the transmission destination can be determined using the electronic mail address information stored in the portable terminal 201. Further, when the facsimile transmission function is executed in the image forming apparatus 101, an operation or the like can be performed using the display panel of the image forming apparatus 101 and the display panel of the portable terminal 201 as an auxiliary. Since the display contents can be dynamically switched between the main device and the slave device, the operability for the user is improved, and the user can use the image forming system 901 comfortably.

  By transferring only the destination information selected from the slave device to the master device, the load on the network 801 and the storage at the master device are compared with the case where all the information is transmitted and held by the master device. It is possible to reduce the area usage (memory usage).

  Here, when the transmission destination is selected in the slave device in step S107, the main device may register the information related to the transmission destination selected in the slave device in the master device. .

  FIG. 6 shows an example of processing performed when the processing of FIG. 4 is completed.

  The process shown in FIG. 6 may be performed only when the transmission destination is selected by the slave apparatus in step S107 of FIG.

  That is, as shown in FIG. 6, in step S <b> 111, the main device determines whether or not to register information related to the transmission destination selected by the slave device in the main device. This determination is based on, for example, the selection operation by the user received after displaying a selection screen for allowing the user to select whether or not to register on the main device of the display panels 112 and 212. Done.

  When it is determined in step S111 that registration is to be performed, in step S112, the main device registers the transmission destination copied from the slave device in the main device.

  On the other hand, when it is determined not to register in step S111, in step S113, the main device discards the transmission destination copied from the slave device.

  By registering the destination information selected by the following device in the main device in this way, when information is subsequently transmitted to the same destination, only the information stored in the main device is used. Can do this. In other words, information can be transmitted to the transmission destination of the main device alone without linking the devices according to the main device.

  In addition, since it is possible to select whether or not information is registered in the main device, it is possible to maintain a state in which only desired information is registered in the main device, which is convenient.

  Note that, in the master-slave setting process and the destination display process in step S103 in FIG. 4, depending on whether an operation for executing a function provided only in one of the image forming apparatus 101 and the portable terminal 201 is performed. Thus, the master-slave determination may be made.

  FIG. 7 is a flowchart for explaining a modified example of the operations of the master-slave setting process and the destination display process.

  In FIG. 7, for example, a processing example in which master-slave setting is performed based on whether or not an operation for performing a facsimile transmission function that can be performed only by the image forming apparatus 101 and not by the portable terminal 201 is performed. It is shown.

  That is, in step S151, the control unit 121 determines whether or not an operation for performing facsimile transmission is accepted by the operation panel 111.

  When an operation corresponding to facsimile transmission is performed in step S151, processing in steps S152 to S154 is performed with the image forming apparatus 101 as the main apparatus. The processes in steps S152 to S154 are the same as the processes in steps S132 to S134 in FIG.

  On the other hand, when an operation corresponding to facsimile transmission is not performed in step S151, the processes in steps S155 to S157 are performed with the mobile terminal 201 as the main device. The processes in steps S155 to S157 are the same as the processes in steps S135 to S137 in FIG.

  Thus, the same effect as described above can be obtained by setting the master-slave according to the function to be executed. That is, the user can intuitively and easily operate the apparatus that is mainly operated as the main apparatus, and can use the image forming system 901 comfortably.

  [Second Embodiment]

  Since the basic configuration of the image forming system in the second embodiment is the same as that in the first embodiment, description thereof will not be repeated here. In the second embodiment, when the image forming apparatus 101 is a main apparatus and the image forming apparatus 101 is executing a function based on a user's operation, a predetermined job having a high priority in the main apparatus. Is turned on, the function being executed is performed using the portable terminal 201, which is a slave device, as necessary. Thereby, a plurality of operations can be efficiently executed in the image forming system 901.

  FIG. 8 is a flowchart for explaining the operation of the image forming system 901 when the cooperative operation is performed in the second embodiment. FIG. 9 is a flowchart for explaining the operation of the web connection / display process.

  In the operation of the image forming system 901 as illustrated in FIGS. 8 and 9, the image forming apparatus 101 as the cooperation management apparatus operates based on control by causing the control unit 121 to execute the control program 165, for example.

  As shown in FIG. 9, in step S <b> 201, the control unit 121 determines whether the portable terminal 201 is linked to the image forming apparatus as a remote panel. If so, the process proceeds to step S202.

  In step S <b> 202, the control unit 121 detects that a web access operation has been performed on the image forming apparatus 101. The web access operation is an operation for causing the image forming apparatus 101 to execute a web browsing function.

  In step S203, the control unit 121 performs control so that the image forming apparatus 101 becomes a main apparatus and the portable terminal 201 becomes a subordinate apparatus. As a result, the main flag is set in the image forming apparatus 101 and the sub flag is set in the portable terminal 201.

  In step S204, web connection / display processing is performed. The web connection / display process is performed as shown in FIG.

  In step S221, in the main apparatus, that is, the image forming apparatus 101, the control unit 121 determines whether a job having a higher priority than the job being executed is input from another user. If no such job has been input, the process proceeds to step S226. Here, the control unit 121 may determine whether or not a job from a different user is input after recognizing the user who executed the web browsing function by the above-described user authentication function. Further, when a job is input from an external personal computer or the like, for example, it is determined that a job is input from another user by a method different from that in which the image forming apparatus 101 is directly operated. Also good. Also, the job priority may be set in advance for each job type, for example. For example, a job using a facsimile transmission function or a print function may be set to have a higher priority than a job using a web browsing function.

  If there is a job with high priority in step S221, in step S222, the control unit 121 causes the slave device, that is, the display panel 212 of the portable terminal 201 to display a job related to the job with low priority. For example, when a web connection process is performed in the main device or a moving image reproduction process associated with the web connection process is performed, these jobs are executed by the portable terminal 201 and displayed on the display panel 212. This process is performed by the control unit 121 communicating with the file control unit 221 and controlling the file control unit 221 to execute the continuation of the process performed on the image forming apparatus 101 side. It should be noted that even if a job with a relatively low priority of another type, such as an image or moving image browsing process that does not involve a web connection process, is performed in the main device, the same may be applied. .

  Accordingly, the control unit 121 causes the image forming apparatus 101 to execute a job with high priority.

  In step S223, the control unit 121 stands by until a job with a high priority is completed.

  When the job with high priority is completed in step S223, in step S224, the control unit 121 determines whether or not the image forming apparatus 101 is to execute the process being executed on the portable terminal 201 as in the original. This determination is performed, for example, by displaying a selection screen on the mobile terminal 201 or the image forming apparatus 101 and accepting a user's selection operation.

  If it is determined in step S224 that the processing is to be restored, in step S225, the control unit 121 switches the display so that the display executed by the portable terminal 201 is performed by the image forming apparatus 101.

  In step S226, the control unit 121 determines whether processing such as web connection that is being executed in the main device has ended. If it is not determined that the process has been completed, the process returns to step S221. If it is determined that the process has been completed, the web connection / display process is terminated.

  On the other hand, if it is determined in step S224 that the process is not restored, in step S227, the control unit 121 causes the mobile terminal 201 to continue the process such as web connection. In this case, the control unit 121 ends the web connection / display process.

  As described above, in the second embodiment, when a low priority job is being executed in the image forming apparatus 101 that is the main apparatus, a high priority job is input to the image forming apparatus 101. Then, a job having a low priority is automatically executed on the portable terminal 201 which is a subordinate apparatus. As a result, in the state where the low priority job being executed is continuously executed, the image forming apparatus 101 reliably secures a resource for performing the high priority job, and the image forming apparatus 101 executes the job. Can be executed.

  Whether or not the processing being executed on the main device is executed on the subordinate device depends on the processing being executed (web connection processing, etc.) or the image of the submitted job is executed instead of the job priority. You may make it judge according to the magnitude | size (for example, CPU occupation rate etc.) given to the apparatus 101. FIG. That is, when a web browsing function using a web browser or a moving image reproduction process is performed with a relatively large load, the slave apparatus is caused to execute it, thereby reducing the processing load performed in the image forming apparatus 101. Can be light. As a result, it is possible to prevent the system performance of the image forming apparatus 101 from being lowered and to ensure that the input job is executed by the image forming apparatus 101.

  In the case where the display is performed by the apparatus according to the above, an input operation by the user may be received on the image forming apparatus 101 side which is the main apparatus. For example, when the web browsing function performed in the main device is switched to be performed in the slave device, the operation panel 111 of the image forming apparatus 101 can accept key input such as URL input operation. May be. In this case, information on the accepted operation may be sent from the image forming apparatus 101 to the mobile terminal 201 so that browser display or moving image display is performed on the mobile terminal 201.

  Here, in the first embodiment and the second embodiment, the master-slave setting may be repeatedly performed even after the master-slave setting is performed once as described above.

  That is, the control unit 121 performs the operation on the image forming apparatus 101 and the portable terminal 201 when an operation by the user is detected by the operation panel 111 or the display panel 212 after determining the main apparatus. Re-determine the new device as the main device.

  FIG. 10 is a flowchart for explaining an example of the master-slave setting.

  The process shown in FIG. 10 may be repeated continuously.

  In step S171, the control unit 121 determines whether or not the image forming apparatus 101 has been operated. If not, the process proceeds to step S173.

  If the image forming apparatus 101 is operated in step S171, in step S172, the control unit 121 sets the flags 155 and 255 so that the image forming apparatus 101 becomes a main apparatus and the portable terminal 201 becomes a subordinate apparatus. I do. Thereafter, the process proceeds to step S173.

  In step S173, the control unit 121 determines whether or not the mobile terminal 201 has been operated. If not operated, the process returns to step S171.

  If the portable terminal 201 is operated in step S173, in step S174, the control unit 121 sets the flags 155 and 255 so that the portable terminal 201 becomes the main device and the image forming apparatus 101 becomes the slave device. Do. Thereafter, the process returns to step S171.

  By performing the master-slave setting in this way, it is possible to appropriately set the master device and the slave device as needed. By switching the display of the display panels 112 and 212 that are linked in response to this, the convenience of the user can be further improved.

  [Third Embodiment]

  Since the basic configuration of the image forming system in the third embodiment is the same as that in the first embodiment, description thereof will not be repeated here. In the third embodiment, when the portable terminal 201 is the main device, when the image forming apparatus 101 which is the slave apparatus executes (outputs) the printing process, the setting contents set by the image forming apparatus 101 are used. Based on the output.

  That is, in general, since an app that can be executed on the mobile terminal 201 is a small-sized program, it is often impossible to perform detailed settings at the time of output. Here, the detailed settings at the time of output are, for example, settings such as whether to perform single-sided printing or double-sided printing, and the toner density. In the third embodiment, even when the portable terminal 201 is operated and output using the image forming apparatus 101 is performed, such a detailed operation is performed using the display panel on the image forming apparatus 101 side. Setting items can be set.

  FIG. 11 is a flowchart for explaining the operation of the image forming system 901 when the cooperative operation is performed in the third embodiment of the present invention. FIG. 12 is a flowchart illustrating an example of the operation at the time of cooperation.

  As shown in FIG. 11, in step S301, the application of the portable terminal 201 is opened (start-up is started). Various applications are used, for example, an application for displaying a document on the display panel 212 so that the document can be browsed, an application for displaying a photograph on the display panel 212, and the like.

  In step S302, the control unit 121 confirms whether the image forming apparatus 101 and the portable terminal 201 are linked. The portable terminal 201 can know the confirmed result.

  If not linked in step S302, in step S303, the portable terminal 201 causes the application that has been started to execute a normal operation. That is, in this case, the portable terminal 201 cannot use the image forming apparatus 101 for outputting information.

  On the other hand, if linked in step S302, linked-time processing is performed in step S304. The process at the time of cooperation is shown in FIG.

  Referring to FIG. 12, the process at the time of cooperation is started. For example, in step S321, an operation (printing operation) for performing output using the image forming apparatus 101 is performed on the main apparatus, that is, the portable terminal 201. As a result, an instruction to output is sent from the portable terminal 201 to the image forming apparatus 101.

  In step S322, in the slave apparatus, that is, the image forming apparatus 101, the display panel 112 has a screen (an example of a print setting screen and a slave screen) for setting detailed print settings (printing conditions) for output. Is displayed. The screen displayed at this time can be said to be a sub-screen for setting auxiliary items for processing performed based on an instruction from the mobile terminal 201. The secondary screen is a screen on which printing conditions corresponding to the output device of the data selected by the application, that is, the image forming apparatus 101 can be set. The user can make settings such as image quality and finishing through the sub-screen.

  In step S <b> 323, the control unit 121 detects whether or not the print setting using the slave screen displayed on the image forming apparatus 101 has been completed. When the print setting is completed, the process proceeds to step S324.

  In step S324, an operation for executing printing on the portable terminal 201 is performed. Thereby, information (for example, image data) to be printed and transmitted by the application is transmitted to the image forming apparatus 101 from the portable terminal 201 together with an instruction to output.

  In step S <b> 325, the image forming apparatus 101 receives information transmitted from the mobile terminal 201. In executing printing, the control unit 121 starts printing after reflecting the print settings (printing conditions) set in step S323. As a result, the image forming unit 131 executes printing.

  Here, when the printing conditions are set on the image forming apparatus 101 side in this way, the printing conditions may also be set in advance on the application side of the mobile terminal 201. In such a case, when some or all of the printing conditions of both compete with each other, the printing conditions set on the side of the image forming apparatus 101 that actually outputs are preferentially applied. For example, when the mobile terminal 201 has set printing conditions for printing on A2 size paper, and the image forming apparatus 101 has set printing conditions for printing on A4 size paper, Printing is performed on A4 size paper. By performing such control, it is possible to appropriately output based on the printing conditions suitable for the actual situation of the image forming apparatus 101.

  In the third embodiment, the printing conditions set in the image forming apparatus 101 can be stored in the portable terminal 201, and can be easily set when printing is performed under the same conditions from the next time. . In other words, a workflow linked with the image forming apparatus 101 can be set on the application side, and printing conditions can be stored in the workflow. By selecting a workflow, it is possible to easily set printing conditions and the like during subsequent output.

  That is, when printing is performed in step S325, in step S326, the control unit 121 determines whether or not to save the printing conditions set in the image forming apparatus 101. This determination may be made according to the user's intention, for example. For example, a screen to be selected by the user is displayed on at least one of the display panels 112 and 212 of the image forming apparatus 101 and the portable terminal 201. And it can determine whether it preserve | saves by accepting a user's selection.

  When it is determined in step S326 that the printing conditions are to be saved, in step S327, the control unit 121 performs control so that the printing conditions at that time are saved in the portable terminal 201. For example, the control unit 121 transmits the contents of the printing conditions to the mobile terminal 201. In the portable terminal 201, the file control unit 221 stores the transmitted printing conditions so that they can be read out at another opportunity.

  When it is determined in step S326 that the printing conditions are not to be saved, or when the process of step S327 is finished, a series of operations in the cooperation process is finished.

  As described above, the third embodiment cannot be applied when the portable terminal 201 is used alone using the slave apparatus, that is, the image forming apparatus 101 that operates in cooperation with the portable terminal 201 that is the main apparatus. The output can be performed by applying such printing conditions. For example, even when the portable terminal 201 alone cannot give instructions for performing double-sided printing or so-called “N in 1” printing, it can be set on the image forming apparatus 101 side and reflected in the output mode. Therefore, it is possible to output information handled by the application in a manner more desired by the user.

  In general, the image forming apparatus 101 may have different print conditions that can be set depending on the model. Even in such a case, the secondary screen for setting the printing conditions can be displayed on the image forming apparatus 101 and the setting can be performed there, so that various image forming apparatuses 101 are always appropriately output. Can be set as follows. The setting of the portable terminal 201 is not changed, and various image forming apparatuses 101 can be supported.

  Note that, in the third embodiment, the cooperation processing in step S304 of FIG. 11 is not limited to setting printing conditions. For example, when an image (for example, a photograph, a document, or a web page) of the mobile terminal 201 is output using the image forming apparatus 101, the image is displayed on the display panel 112 while the image is being displayed on the image forming apparatus 101 side. In response to an instruction from the mobile terminal 201, the edited image may be output.

  FIG. 13 is a flowchart for explaining another example of the operation at the time of cooperation.

  In FIG. 13, each process roughly corresponds to the process included in FIG.

  As shown in FIG. 13, when the cooperation processing is performed, an image preview display is performed on the main device, that is, the portable terminal 201 in step S341.

  In step S342, when preview display is performed on the portable terminal 201, an image preview display is also performed on the slave apparatus, that is, the image forming apparatus 101. As a result, the user can perform image editing work using the display panel 112 of the image forming apparatus 101. Examples of the editing work include enlargement / reduction / trimming of an image. In addition, it may be configured such that color, brightness, etc. can be edited. The user can perform further editing operations until the image is in a desired state while confirming the preview image of the sub-screen displayed on the display panel 112. The preview image reflects the editing operation in real time.

  In step S <b> 343, the control unit 121 detects whether the editing work using the slave screen displayed on the image forming apparatus 101 has been completed. When the editing operation is completed, the process proceeds to step S344.

  In step S344, an operation for executing printing on the portable terminal 201 is performed. Thereby, information (for example, image data) to be printed and transmitted by the application is transmitted to the image forming apparatus 101 from the portable terminal 201 together with an instruction to output.

  In step S <b> 345, the image forming apparatus 101 receives information transmitted from the mobile terminal 201. In executing printing, the control unit 121 reflects printing conditions set in the image forming apparatus 101 and starts printing. As a result, the image forming unit 131 executes printing. At this time, printing is performed on an image reflecting the editing operation performed on the image forming apparatus 101 side in step S343.

  Here, in this modified example, data of an image edited by the image forming apparatus 101 may be stored in the portable terminal 201, and the image may be used for subsequent printing or used for purposes other than printing. it can. By storing the edited image data in the portable terminal 201, it is possible to easily print the same image or the like during subsequent output.

  That is, when printing is performed in step S345, in step S346, the control unit 121 determines whether to save an image edited by the image forming apparatus 101. This determination may be made according to the user's intention, for example. For example, a screen to be selected by the user is displayed on at least one of the display panels 112 and 212 of the image forming apparatus 101 and the portable terminal 201. And it can determine whether it preserve | saves by accepting a user's selection.

  If it is determined in step S346 to save the image, in step S347, the control unit 121 performs control so that the edited image is saved in the mobile terminal 201. For example, the control unit 121 transmits the edited image data to the mobile terminal 201. In the portable terminal 201, the file control unit 221 stores the transmitted image data.

  When it is determined not to save the image in step S346, or when the process of step S347 is finished, a series of operations in the cooperation process is finished.

  As described above, the user can easily edit the image by displaying the preview on the display panel 112 of the image forming apparatus 101 as the slave apparatus. In particular, when the display panel 212 of the portable terminal 201 is smaller than the display panel 112, the image can be displayed reliably on the large display panel 112 so that editing can be performed reliably.

  Further, if necessary, by storing the image edited by the image forming apparatus 101, it can be widely used such as printing the edited image on another occasion or using it for another application. become. By saving the edited image on the portable terminal 201 side, the same output result can be obtained with various devices without depending on the output device.

  [Others]

  As described above, in the image forming system 901, information transmission is performed by a plurality of types of transmission methods such as e-mail transmission and facsimile transmission, and further, for example, transmission based on FTP (file transfer protocol) and other communication protocols. If it is feasible, the master / slave may be set as follows, for example.

  In other words, in this case, the image forming apparatus 101 functioning as the cooperation management apparatus detects another transmission method corresponding to an operation by the user performed on the image forming apparatus 101 or the portable terminal 201. Then, based on the detected transmission method, the image forming apparatus 101 sets master / slave with one of the image forming apparatus 101 and the portable terminal 201 serving as a master device and the other serving as a slave device. For example, when a user operation corresponding to a transmission method involving facsimile transmission is detected, the image forming apparatus 101 having a facsimile transmission function is set as a main apparatus. On the other hand, when a user operation corresponding to a transmission method involving e-mail transmission is detected, the portable terminal 201, which is a device that has a relatively large number of registered e-mail addresses and that facilitates e-mail transmission, Equipment.

  By performing the master-slave setting in this way, an apparatus that is considered appropriate in accordance with the function to be performed can be set as the main apparatus, and the image forming system 901 can be used conveniently.

  Note that at this time, the image forming apparatus 101 may perform master-slave setting using a device in which more transmission destination information related to a transmission method corresponding to an operation by the user is registered as a main device. As a result, it is possible to increase the probability that information to be transmitted can be acquired from those registered in the main device, and communication regarding transmission destination information between the slave device and the master device is required. Can be reduced.

  The mobile terminal may be configured to function as a cooperation management device. The image forming apparatus and the portable terminal may function in cooperation as a cooperation management apparatus. That is, the cooperation management device may be incorporated in at least one of the image forming apparatus and the mobile terminal. In either case, the same function and effect as described above can be obtained by appropriately controlling the other device by the device functioning as the cooperation management device.

  In addition, in the image forming system, a device that functions as a cooperation management device that controls the cooperative operation between the image forming apparatus and the portable terminal may be provided. Even in such a case, the image forming apparatus and the mobile terminal are controlled by the cooperation management apparatus, and one of them becomes a main apparatus and the other becomes a subordinate apparatus, and the display contents of both display panels are changed. The same effects as described above can be obtained.

  The image forming apparatus may be a monochrome / color copying machine, a printer, a facsimile machine, or a multifunction machine (MFP) thereof. The image forming apparatus is not limited to an apparatus that forms an image by an electrophotographic method, and may be an apparatus that forms an image by a so-called inkjet method, for example.

  The hardware configuration of the image forming apparatus is not limited to the above, and image processing may be performed by various control circuits.

  Further, the image forming system is not limited to the one in which the image forming apparatus and the mobile terminal cooperate with each other, and may be any one in which two or more apparatuses each having a display device cooperate with each other. For example, the image forming apparatus and the image forming apparatus may be configured to cooperate with each other as described above.

  The processing in the above embodiment may be performed by software or by using a hardware circuit.

  A program for executing the processing in the above-described embodiment can be provided, or the program can be recorded on a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provided to the user. It may be. The program may be downloaded to the apparatus via a communication line such as the Internet. The processing described in the text in the above flowchart is executed by the CPU according to the program.

  The above embodiment should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

101 Image forming apparatus (an example of an information processing apparatus)
111 Operation Panel 112 Display Panel (Example of Display Device)
121 Control Unit 131 Image Forming Unit 153 Display Control Unit 155 Main / Sub Flag 161 Storage Area 165 Control Program 201 Mobile Terminal 212 Display Panel (Example of Display Device)
251 Imaging unit (an example of imaging means)
253 Display control unit 255 Main / sub flag 261 Storage area 265 Control program 801 Network 901 Image forming system (an example of information processing system)

Claims (26)

An information processing device; a portable terminal capable of communicating with the information processing device; and a cooperation management device capable of communicating with each of the information processing device and the portable terminal, and the information processing based on control of the cooperation management device An information processing system in which an apparatus and the portable terminal can operate in cooperation with each other,
The information processing device and the mobile terminal each have a display device and display control means for controlling the display content of the display device,
The cooperation management device
In a state where the information processing apparatus and the portable terminal are linked, at least one of an operation performed by the user performed on the information processing apparatus and an operation performed by the user performed on the portable terminal is detected. Detection means;
In accordance with the detection content of the detection means, the information processing apparatus and the portable terminal comprises a determination means for determining that one is a main device and the other is a slave device,
The information processing system, wherein the display control unit of at least one of the information processing device and the portable terminal switches display content of the display device based on a determination content by the determination unit.   The information according to claim 1, wherein when the operation by the user is detected by the detection unit, the determination unit determines, as the main device, the apparatus that has performed the operation among the information processing apparatus and the mobile terminal. Processing system.   After the determination on the main device is performed by the determination unit, when an operation by a user is detected by the detection unit, the determination unit performs the operation of the information processing apparatus and the portable terminal. The information processing system according to claim 1 or 2, wherein the determined device is re-determined as a main device. When an operation by the user for executing the information transmission function is detected by the detection means,
In the main device determined by the determination unit among the information processing device and the portable terminal, the display control unit of the main device is registered in advance in the main device in the display device of the main device. Display destination information,
Of the information processing device and the portable terminal, the slave device that has not been determined as the primary device by the determination unit is configured such that the display control unit of the slave device is connected to the display device of the slave device. Display destination information that has been registered in advance and is not registered in the main device,
The main device is:
Accepting a selection operation by the user for the destination information displayed on the display device of the master device and the destination information displayed on the display device of the slave device;
The information processing system according to claim 1, wherein the information transmission function is executed based on transmission destination information corresponding to the received selection operation. The main device is:
When a selection operation by the user for the transmission destination information displayed on the display device of the slave device is received, only the transmission destination information corresponding to the received selection operation is acquired from the slave device,
The information processing system according to claim 4, wherein the information transmission function is executed based on the acquired transmission destination information.   When the main device receives a selection operation by the user for the transmission destination information displayed on the display device of the slave device, the master device further transmits the transmission destination information acquired from the slave device to the master device. The information processing system according to claim 5, which is registered.   In the case where the information processing apparatus is determined as the main apparatus by the determination unit, when the predetermined process is executed in the main apparatus, the cooperation management apparatus, the display control unit of the portable terminal, The information processing system according to claim 1, wherein a display corresponding to the operation detected by the detection unit is displayed on the display device of the portable terminal.   In the case where the information processing apparatus is determined as the main apparatus by the determination unit, the cooperation management apparatus performs the predetermined process in the information processing apparatus when the predetermined process is executed in the main apparatus. The display device of the mobile terminal displays a display corresponding to the operation detected by the detection means on the display control means of the mobile terminal according to the priority or the load applied to the information processing device by the predetermined processing. The information processing system according to any one of claims 1 to 7, wherein the information processing system is displayed.   In the cooperation management apparatus, when the information processing apparatus is determined as a main apparatus by the determination unit, the display corresponding to the operation detected by the detection unit is performed on the display device of the portable terminal Then, based on the operation performed by the user, a display corresponding to the operation detected by the detection unit is displayed on the display control unit of the information processing apparatus and the portable terminal on the display device of the information processing apparatus. The information processing system according to claim 7, wherein the information processing system is switched to perform.   The information processing system according to claim 7, wherein the predetermined process is at least one of a web browsing process performed using browser software and an image or moving image browsing process. The portable terminal can execute an application program,
The detection means is capable of detecting an operation for executing the application program on the portable terminal,
The determination unit determines the portable terminal as a main device when an operation for executing the application program is detected by the detection unit and the information processing apparatus and the portable terminal are linked. Item 11. The information processing system according to any one of Items 1 to 10. When the information processing apparatus and the mobile terminal are linked, when the mobile terminal is executing the application program,
The portable terminal gives an instruction to output information handled by the application program in the information processing apparatus,
The display control means of the information processing apparatus causes the display device of the information processing apparatus to display a sub-screen for setting information used when performing output based on an instruction from the portable terminal,
The information processing system according to claim 11, wherein the information processing apparatus performs output based on information set using the sub-screen in response to an instruction from the mobile terminal. The information processing device transmits information set using the sub-screen to perform the output to the mobile terminal,
The information processing system according to claim 12, wherein the portable terminal stores information transmitted from the information processing apparatus. The information processing apparatus is capable of printing output,
The portable terminal gives an instruction to print on the information processing apparatus,
The display control means of the information processing apparatus displays a print setting screen as the secondary screen on the display apparatus of the information processing apparatus,
The information processing system according to claim 12, wherein the information processing apparatus performs printing based on a printing condition set using the print setting screen. The information processing apparatus is capable of printing output,
The portable terminal gives an instruction to print an image on the information processing apparatus,
The display control means of the information processing apparatus performs a preview display of an image to be printed on the secondary screen,
The information processing apparatus includes:
Accepting the image editing operation performed while displaying the secondary screen;
The information processing system according to claim 12, wherein an image that has been edited by the editing operation is printed in response to an instruction from the mobile terminal.   When information used when the information processing apparatus performs the output is set in advance by the application program executed on the mobile terminal, the information is set on the information processing apparatus side. The information processing system according to any one of claims 12 to 15, wherein priority is given to information set on the information processing apparatus side when there is a conflict. The information processing system can execute information transmission by a plurality of types of transmission methods,
The detection means detects another transmission method corresponding to an operation by the user performed on the information processing apparatus or the mobile terminal,
The determination unit performs determination based on the transmission method detected by the detection unit, wherein one of the information processing apparatus and the portable terminal is a main apparatus and the other is a subordinate apparatus. The information processing system described. The information processing apparatus has a facsimile transmission function,
The portable terminal has an e-mail transmission function,
The determination means includes
When an operation of a user corresponding to a transmission method involving facsimile transmission is detected by the detection means, the information processing apparatus is determined as a main apparatus,
The information processing system according to claim 17, wherein the mobile terminal is determined as a main device when a user operation corresponding to a transmission method involving electronic mail transmission is detected by the detection unit.   The determination unit determines, as the main device, a device in which a lot of transmission destination information corresponding to the transmission method detected by the detection unit is registered among the information processing device and the portable terminal. The information processing system described. The portable terminal further includes an imaging unit,
20. The cooperation management device according to claim 1, further comprising a cooperation unit configured to link the imaged information processing apparatus and the portable terminal when the information processing apparatus is imaged by the imaging unit. Information processing system.   The information processing system according to any one of claims 1 to 20, wherein the cooperation management device is built in either the information processing device or the mobile terminal.   The information processing system according to claim 1, wherein the information processing apparatus is an image forming apparatus having a printing function.   The cooperation management apparatus contained in the information processing system in any one of Claim 1 to 22.   An information processing apparatus included in the information processing system according to any one of claims 1 to 22. An information processing device; a portable terminal capable of communicating with the information processing device; and a cooperation management device capable of communicating with each of the information processing device and the portable terminal, and the information processing based on control of the cooperation management device An information processing system control method capable of operating in cooperation with a device and the mobile terminal,
Each of the information processing device and the mobile terminal has a display device,
The control method of the information processing system includes:
In a state where the information processing apparatus and the portable terminal are linked, at least one of an operation performed by the user performed on the information processing apparatus and an operation performed by the user performed on the portable terminal is detected. A detection step;
In accordance with the detection content of the detection step, a determination step of determining one of the information processing apparatus and the mobile terminal as a main apparatus and the other as a subordinate apparatus;
A control method for an information processing system, comprising: a display control step for switching display content of the display device based on the determination content in the determination step in at least one of the information processing device and the portable terminal. An information processing device; a portable terminal capable of communicating with the information processing device; and a cooperation management device capable of communicating with each of the information processing device and the portable terminal, and the information processing based on control of the cooperation management device A control program for causing a computer included in an information processing system capable of operating in cooperation with an apparatus and the mobile terminal,
Each of the information processing device and the mobile terminal has a display device,
The control program for the information processing system includes:
In a state where the information processing apparatus and the portable terminal are linked, at least one of an operation performed by the user performed on the information processing apparatus and an operation performed by the user performed on the portable terminal is detected. A detection step;
In accordance with the detection content of the detection step, a determination step of determining one of the information processing apparatus and the mobile terminal as a main apparatus and the other as a subordinate apparatus;
A control program for an information processing system that causes a computer to execute a display control step of switching display contents of the display device based on the determination contents of the determination step in at least one of the information processing apparatus and the portable terminal.

Images