JP5765186B2 - Connection control apparatus, information processing apparatus, image forming apparatus, portable mobile terminal, information processing system, connection control apparatus control method, and connection control apparatus control program - Google Patents

Description

  The present invention relates to a connection control apparatus, an information processing apparatus, an image forming apparatus, a portable mobile terminal, an information processing system, a control method for the connection control apparatus, and a control program for the connection control apparatus. CONNECTION CONTROL DEVICE, INFORMATION PROCESSING DEVICE, IMAGE FORMING DEVICE, PORTABLE MOBILE TERMINAL, INFORMATION PROCESSING SYSTEM, CONNECTION CONTROL DEVICE CONTROL METHOD, AND CONNECTION CONTROL DEVICE CONTROL PROGRAM USED IN INFORMATION PROCESSING SYSTEM FOR WIRELESS COMMUNICATION WITH DEVICE About.

  An information processing system having an information processing apparatus that inputs and outputs information and a portable mobile terminal (sometimes referred to as a portable information terminal) such as a mobile phone, the information processing apparatus and the portable mobile terminal In some cases, a wireless connection is established so that data can be transferred. Examples of the information processing apparatus include an image forming apparatus (scanner function, facsimile function, copying function, printer function, data communication function, and server function with MFP (Multi Function Peripheral), facsimile apparatus, copying machine, and printer. Etc.).

  As an example of a function performed by establishing a connection by wireless communication in such an information processing system, for example, there is one that performs printing based on data transferred from a portable mobile terminal in an image forming apparatus. With this function, a file (for example, a document file in a PDF (Portable Document Format) format) in the portable mobile terminal is transferred to the image forming apparatus. The transfer is performed after establishing a connection between the two via a wireless interface such as Bluetooth (registered trademark).

  In the following Patent Document 1, communication between the portable information terminal and the image processing apparatus is started by automatically causing the portable information terminal and the image processing apparatus to be executed by allowing the portable information terminal to exist within a range in which short-distance wireless communication with the image processing apparatus is possible. An image processing system is disclosed.

  Patent Document 2 below discloses an image forming apparatus that performs human body communication with a portable terminal held by a user. The image forming apparatus and the mobile terminal perform user authentication for the mobile terminal and user authentication for the image forming apparatus by performing the human body communication.

  Patent Document 3 listed below discloses a printing system that includes a client PC, a portable terminal, and a printer, and is capable of airtight printing. The client PC transmits data to be printed and an authentication code to the printer, and converts the authentication code into a two-dimensional code for display. The user obtains an authentication code by reading the two-dimensional code with the mobile terminal, and transmits the authentication code from the mobile terminal to the printer via the wireless interface. The printer executes printing when the authentication code sent from the client PC matches the authentication code sent from the portable terminal.

JP 2008-193265 A JP 2010-183306 A JP 2008-311895 A

  By the way, conventionally, in order to establish a connection between the portable mobile terminal and the information processing apparatus so that wireless communication can be performed and to perform a coordinated operation, a troublesome operation by the user is required. It was. For example, as in the above example, in order to establish a connection (also referred to as pairing) between the image forming apparatus and the mobile phone terminal so that file transfer is possible using Bluetooth (registered trademark) or the like, a passkey is set in advance between the mutual devices. An operation to input (PIN (Personal Identification Number) code) is required.

  The reason why the operation by the user is required in order to link both devices is as follows. In other words, the connection by wireless communication is characterized in that both devices cannot determine the correlation with the device to be connected by themselves. This does not change even in situations where it is clear that the same worker actually operates both devices. In other words, each device cannot determine whether or not both devices can be connected even if both devices are within the reach of radio waves that can attempt to communicate with each other. For example, to distinguish whether both devices are held by the same worker and can be linked to each other, or are operated by different workers and should not be linked. I can't.

  Here, the image forming system described in Patent Literature 1 acquires information necessary for wireless communication by performing short-range wireless communication of a standard different from wireless communication between connected devices, and between both devices. Perform wireless communication. However, in order to use such short-range wireless communication, there is a problem that both devices must have a communication interface corresponding to the two devices. In addition, it is necessary to perform short-range wireless communication, and the procedure for establishing authentication between the wireless terminal and the MFP for performing short-range wireless communication is omitted, which causes a security problem. There are things to do.

  The image forming apparatus described in Patent Document 2 performs human body communication with a portable terminal held by a user. Thus, if human body communication is performed instead of wireless communication, the operation can be easily performed. However, in order to perform such human body communication, there is a problem that both devices must have communication interfaces corresponding to the devices.

  Note that Patent Document 3 does not disclose any matter relating to associating a plurality of devices as described above. That is, Patent Document 3 does not disclose any effective solution for the above problem.

  The present invention has been made to solve such problems, and a connection control device, an information processing device, and an information processing device capable of establishing a connection between two devices so that wireless communication can be performed with an easy operation. It is an object of the present invention to provide an image forming apparatus, a portable mobile terminal, an information processing system, a connection control apparatus control method, and a connection control apparatus control program.

In order to achieve the above object, according to one aspect of the present invention, connection control for establishing a wireless connection between an information processing device and a portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal The apparatus includes a first acquisition unit that acquires first operation information related to a position where an operation input by the user is performed on the touch panel of the information processing apparatus, and an operation input by the user on the touch panel of the portable mobile terminal. Second acquisition means for acquiring second operation information relating to the performed position, first operation information acquired by the first acquisition means, and second operation information acquired by the second acquisition means, The determination means for determining whether the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal correspond to each other, Depending on the cross-sectional results, and connection means for establishing a wireless connection between the information processing apparatus and the portable mobile terminal, the first operation information, the operation input by the user on the touch panel of the information processing apparatus is performed The movement trajectory information obtained by sampling the position information at a constant cycle is included, and the second operation information includes the information on the position where the operation input by the user on the touch panel of the portable mobile terminal is performed. Movement trajectory information obtained by sampling in a cycle is included, and at least one of the first acquisition unit and the second acquisition unit has not established a wireless connection between the information processing apparatus and the portable mobile terminal. In the state, the first operation information or the second operation information is acquired by wireless communication with at least one of the information processing apparatus and the portable mobile terminal.
According to another aspect of the present invention, a connection control device that establishes wireless connection between an information processing device and a portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal. First acquisition means for acquiring first operation information related to a position where an operation input by a user is performed on the touch panel of the apparatus, and a position regarding an operation input by the user on the touch panel of the portable mobile terminal Based on the second acquisition means for acquiring the second operation information, the first operation information acquired by the first acquisition means, and the second operation information acquired by the second acquisition means, the user Determining means for determining whether or not the operation input to the information processing apparatus and the operation input to the portable mobile terminal correspond to each other, and depending on the determination result of the determination means, information Detected by a connection means for establishing a wireless connection between the physical device and the portable mobile terminal, a posture detection means for detecting a posture of the portable mobile terminal based on at least the second operation information, and a posture detection means And changing means for changing processing to be performed when wireless connection is established by the connection means according to the attitude of the portable mobile terminal, and at least one of the first acquisition means and the second acquisition means is information The first operation information or the second operation information is acquired by wireless communication with at least one of the information processing device and the portable mobile terminal in a state where the wireless connection between the processing device and the portable mobile terminal is not established. .
Preferably, the posture detection means detects the posture of the portable mobile terminal based on the result of recognizing the second operation information as character information.

  Preferably, the first operation information includes movement trajectory information obtained by sampling information on a position where an operation input by the user on the touch panel of the information processing apparatus is performed at a certain period. The information includes movement trajectory information obtained by sampling information of a position where an operation input by the user on the touch panel of the portable mobile terminal is performed at a constant period.

  Preferably, the connection control device includes information relating to a first time when an operation input is performed by a user on the touch panel of the information processing device and information relating to a second time when the operation input is performed by the user on a touch panel of the portable mobile terminal. A third acquisition unit is further provided, and the determination unit makes a determination based on the first operation information and the second operation information, and the information acquired by the third acquisition unit.

  Preferably, the determination means corresponds to the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal on condition that at least the time difference between the first time and the second time is within a predetermined time. Judge that it is.

  Preferably, the connection control device further includes a fourth acquisition unit that acquires information regarding the resolution of each touch panel of the information processing device and the portable mobile terminal, and the determination unit includes the information acquired by the fourth acquisition unit. Based on this, the first operation information is compared with the second operation information to make a determination.

  Preferably, the connection control device further includes character recognition means for recognizing each of the first operation information and the second operation information as character information based on each of the first operation information and the second operation information. The determination means makes a determination according to whether or not the character information corresponding to the first operation information recognized by the character recognition means matches the character information corresponding to the second operation information.

  Preferably, the determination means determines whether the character information corresponding to the first operation information and the character information corresponding to the second operation information recognized by the character recognition means match the preset authentication password for the user. Judgment is made according to whether or not.

  Preferably, the connection control device matches the character information corresponding to the first operation information and the character information corresponding to the second operation information recognized by the character recognition unit, and the authentication password for the preset user. It is further provided with an authentication means for authenticating the user depending on whether or not.

  Preferably, the connection control device executes a preset cooperative operation in at least one of the information processing device and the portable mobile terminal when the wireless connection between the information processing device and the portable mobile terminal is established by the connection unit. Execution means is further provided.

  Preferably, when the wireless connection between the information processing device and the portable mobile terminal is established by the connection means, the connection control device can be executed before connection establishment in at least one of the information processing device and the portable mobile terminal. The system further comprises permission means for permitting execution of the prohibited function.

  Preferably, the first operation information relates to a gravity center position of an area touched by the user on the touch panel of the information processing device, and the second operation information is touched by the user on the touch panel of the portable mobile terminal. It relates to the position of the center of gravity of the area.

  Preferably, at least one of the first acquisition unit and the second acquisition unit acquires the first operation information or the second operation information via an external server.

According to still another aspect of the present invention, an information processing device communicates with a portable mobile terminal when a wireless connection between the connection control device according to any of the above and a portable mobile terminal is established by a connection unit. A communication unit that performs wireless communication.

  According to still another aspect of the present invention, an image forming apparatus includes the information processing apparatus described above and an image forming unit that forms an image on a sheet.

  According to still another aspect of the present invention, the portable mobile terminal is wireless with the information processing device when a wireless connection between the connection control device according to any of the above and the information processing device is established by the connecting means. A communication unit that performs communication.

  According to still another aspect of the present invention, an information processing system includes an information processing device and a portable mobile terminal, and any one of the information processing device and the portable mobile terminal is described above. The connection control device establishes a wireless connection between the information processing device and the portable mobile terminal.

  According to still another aspect of the present invention, an information processing system includes an information processing device, a portable mobile terminal, and a server capable of communicating with each of the information processing device and the portable mobile terminal. And the connection means establishes a wireless connection between the information processing apparatus and the portable mobile terminal.

According to still another aspect of the present invention, a control method for a connection control device for establishing a wireless connection between an information processing device and a portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal The first acquisition step of acquiring first operation information related to the position where the operation input by the user is performed on the touch panel of the information processing apparatus, and the operation input by the user on the touch panel of the portable mobile terminal are performed. A second acquisition step of acquiring the second operation information related to the broken position, the first operation information acquired by the first acquisition step, and the second operation information acquired by the second acquisition step. A determination step for determining whether or not the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal correspond to each other , According to a determination result of the determination step, and a connection step of establishing a wireless connection between the information processing apparatus and the portable mobile terminal, the first operation information, the operation input by the user on the touch panel of the information processing apparatus The movement trajectory information obtained by sampling the information on the position where the operation is performed at a constant period is included, and the second operation information includes the position where the operation input by the user on the touch panel of the portable mobile terminal is performed The movement trajectory information obtained by sampling the information at a constant cycle is included, and at least one of the first acquisition step and the second acquisition step is performed by a wireless connection between the information processing device and the portable mobile terminal. The first operation information or the second operation information is acquired by wireless communication with at least one of the information processing apparatus and the portable mobile terminal without being established. .
According to still another aspect of the present invention, a control method for a connection control device for establishing a wireless connection between an information processing device and a portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal The first acquisition step of acquiring first operation information related to the position where the operation input by the user is performed on the touch panel of the information processing apparatus, and the operation input by the user on the touch panel of the portable mobile terminal are performed. A second acquisition step of acquiring the second operation information related to the broken position, the first operation information acquired by the first acquisition step, and the second operation information acquired by the second acquisition step. A determination step for determining whether or not the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal correspond to each other A connection step for establishing a wireless connection between the information processing device and the portable mobile terminal according to a determination result of the determination step, and a posture detection for detecting the posture of the portable mobile terminal based on at least the second operation information And a change step for changing a process to be performed when a wireless connection is established by the connection step according to the posture of the portable mobile terminal detected by the posture detection step, the first acquisition step and the second step At least one of the acquisition steps of the first operation by wireless communication with at least one of the information processing device and the portable mobile terminal in a state where the wireless connection between the information processing device and the portable mobile terminal is not established. Information or second operation information is acquired.

According to still another aspect of the present invention, a control program for a connection control device for establishing a wireless connection between an information processing device and a portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal The first acquisition step of acquiring first operation information related to the position where the operation input by the user is performed on the touch panel of the information processing apparatus, and the operation input by the user on the touch panel of the portable mobile terminal are performed. A second acquisition step of acquiring the second operation information related to the broken position, the first operation information acquired by the first acquisition step, and the second operation information acquired by the second acquisition step. Based on this, a determination process for determining whether the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal correspond to each other. And-up, according to a determination result of the determination step, and a connection step of establishing a wireless connection between the information processing apparatus and the portable mobile terminal cause the computer to execute, in the first operation information, the touch panel of the information processing apparatus The movement trajectory information obtained by sampling the information on the position where the operation input by the user is performed at a certain period is included, and the second operation information includes the operation by the user on the touch panel of the portable mobile terminal. Movement trajectory information obtained by sampling the information of the position where the input has been made at a constant cycle is included, and at least one of the first acquisition step and the second acquisition step includes the information processing device and the portable movement In a state where the wireless connection with the terminal is not established, the first operation information or the first operation information or the wireless communication is established with at least one of the information processing apparatus and the portable mobile terminal. Acquiring second operation information.
According to still another aspect of the present invention, a control program for a connection control device for establishing a wireless connection between an information processing device and a portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal The first acquisition step of acquiring first operation information related to the position where the operation input by the user is performed on the touch panel of the information processing apparatus, and the operation input by the user on the touch panel of the portable mobile terminal are performed. A second acquisition step of acquiring the second operation information related to the broken position, the first operation information acquired by the first acquisition step, and the second operation information acquired by the second acquisition step. Based on this, a determination process for determining whether the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal correspond to each other. And detecting the attitude of the portable mobile terminal based on the connection step for establishing a wireless connection between the information processing apparatus and the portable mobile terminal and at least the second operation information according to the determination result of the determination step. A first step of causing the computer to execute a posture detection step for performing the change and a step for changing processing performed when wireless connection is established by the connection step according to the posture of the portable mobile terminal detected by the posture detection step. At least one of the acquisition step and the second acquisition step is wireless communication with at least one of the information processing device and the portable mobile terminal in a state where the wireless connection between the information processing device and the portable mobile terminal is not established. Thus, the first operation information or the second operation information is acquired.

  According to these inventions, the information processing apparatus and the portable mobile terminal can determine whether the operation input to the information processing apparatus by the user and the operation input to the portable mobile terminal correspond to each other. A wireless connection is established. Accordingly, a connection control device, an information processing device, an image forming device, a portable mobile terminal, an information processing system, and a connection control device that can establish a connection between two devices so that wireless communication can be performed with an easy operation. A control method and a control program for a connection control device can be provided.

1 is a block diagram illustrating an image forming system according to a first embodiment of the present invention. 1 is a perspective view showing an image forming apparatus. 2 is a block diagram illustrating a hardware configuration of the image forming apparatus. FIG. It is the 1st figure explaining an example of operation performed when performing connection establishment operation. It is the 2nd figure explaining an example of operation performed when performing connection establishment operation. It is a 3rd figure explaining an example of operation performed when performing connection establishment operation | movement. It is a sequence diagram which shows the rough flow of a touch and print function and the connection establishment operation | movement performed at that time. 6 is a first flowchart illustrating processing performed in the image forming system when a connection establishment operation is executed. 12 is a second flowchart illustrating processing performed in the image forming system when a connection establishment operation is executed. 10 is a third flowchart illustrating processing performed in the image forming system when a connection establishment operation is executed. 6 is a flowchart illustrating print data reception processing. 6 is a flowchart showing an operation of the image forming system according to one of the modifications of the first embodiment. 6 is a flowchart showing an operation of the image forming system according to one of the modifications of the first embodiment different from the above. It is a figure which compares and shows the display part of an operation panel, and the display part of a portable terminal. 6 is a flowchart illustrating an operation of the image forming system according to the second embodiment. It is a figure which shows an example of a locus | trajectory information correction process. 10 is a flowchart illustrating an operation of an image forming system according to a third embodiment. It is a 1st figure explaining an example of operation performed when performing the connection establishment operation | movement in 3rd Embodiment. It is the 2nd figure explaining an example of operation performed when performing connection establishment operation in a 3rd embodiment. 10 is a flowchart illustrating an operation of an image forming system according to a fourth embodiment. It is a figure which shows the flow of operation | movement when the attitude | position of a portable terminal is a vertical direction in a MFP screen display function. It is a figure which shows the flow of operation | movement when the attitude | position of a portable terminal is a horizontal direction in a MFP screen display function. It is a block diagram which shows the structure of the image forming system which concerns on an example of another embodiment of this invention. It is a block diagram which shows the structure of the image forming system which concerns on another example of another embodiment of this invention.

  Hereinafter, an image forming system (an example of an information processing system) according to an example of an embodiment of the present invention will be described.

  The image forming system includes an image forming apparatus (an example of an information processing apparatus) and a portable terminal (an example of a portable mobile terminal).

  The image forming apparatus is an MFP (Multi Function Peripheral) having a scanner function, a copying function, a printer function, a facsimile function, a data communication function, and a server function. The scanner function is a function for reading an image of a set original and storing it in an HDD (Hard Disk Drive) or the like. The copying function is a function for printing it on paper or the like. The function as a printer is a function for printing on a sheet based on an instruction received from an external terminal such as a PC. The facsimile function is a function for receiving facsimile data from an external facsimile machine and storing it in an HDD or the like. The data communication function is a function for transmitting / receiving data to / from a connected external device. The server function is a function that allows a plurality of users to share data stored in the HDD or the like.

  The mobile terminal is a multi-function mobile phone having various functions such as a telephone function, a data communication function, and information storage, browsing, and output functions. The telephone function is a function for performing a voice call with another telephone via a mobile phone network. The data communication function is a function for performing data communication with other devices via, for example, a mobile phone network or other networks. The data communication function can be performed by wireless communication, for example. Information storage, browsing, and output functions can store information sent from an external device or information input by a user, display the stored information on a display, or send it to an external device It is a function to make.

  The image forming apparatus and the portable terminal can communicate with each other using a predetermined wireless communication protocol. When the user performs a predetermined operation on the image forming apparatus and the mobile terminal in a state in which the image forming apparatus and the mobile terminal can communicate with each other so that the existence of each other can be recognized, the image forming apparatus and the mobile terminal Is established, and the image forming apparatus and the portable terminal cooperate with each other so that data communication is possible. The operation of establishing the connection between the image forming apparatus and the portable terminal is performed by, for example, a connection control device provided in any of the image forming apparatus, the portable terminal, and a server that can communicate with them.

  For example, when the mobile terminal is placed next to the image forming apparatus panel and the user performs the same sign (handwriting input) on the display panel of the mobile terminal and the display panel of the image forming apparatus with two fingers, The signatures made on both display panels are verified. When the two signatures match, the portable terminal and the image forming apparatus are automatically linked so that they can communicate with each other using a predetermined wireless communication protocol. Thereby, the user can connect the portable terminal and the image forming apparatus so that they can communicate with each other by performing an easy operation.

  [First Embodiment]

  FIG. 1 is a block diagram showing an image forming system according to the first embodiment of the present invention.

  As illustrated in FIG. 1, the image forming system 501 includes an image forming apparatus 101 and a portable terminal 401. In the image forming system 501, the image forming apparatus 101 performs an operation as a connection control apparatus that establishes a connection between the image forming apparatus 101 and the portable terminal 401. In other words, the image forming apparatus 101 includes a connection control device that establishes a connection between the image forming apparatus 101 and the portable terminal 401.

  [Configuration of portable terminal 401]

  The mobile terminal 401 is, for example, a so-called smartphone (multifunctional mobile phone). As shown in FIG. 1, the mobile terminal 401 roughly includes a CPU 421, a storage unit 423, a display unit 431, a screen control unit 441, and a communication unit 451. The portable terminal 401 can be easily gripped by the user.

  The CPU 421 controls the operation of the mobile terminal 401 using the storage unit 423, each unit of the mobile terminal 401, and the like. The storage unit 423 is a memory such as a ROM or a RAM. The storage unit 423 stores a control program 423a executed by the mobile terminal 401. The CPU 421 executes the control program 423a, thereby controlling the operation of the portable terminal 401 and performing wireless communication with the image forming apparatus 101 using the communication unit 451.

  The display unit 431 is a touch panel. The display unit 431 is a liquid crystal display (LCD). The display unit 431 includes an operation position detection unit 433. The operation position detection unit 433 detects that the user has touched the display unit 431 and the contact position (user operation position). For example, the operation position detection unit 433 detects the position of the center of gravity of the area touched by the user on the display unit 431 as the operation position of the user. When the user touches the display unit 431, the information is sent to the CPU 421, and the CPU 421 controls the portable terminal 401 based on the information. That is, the user can operate the portable terminal 401 by touching the display unit 431 and performing an operation.

  The screen control unit 441 controls display on the display unit 431. The screen control unit 441 displays, for example, various guide images and an operation menu screen of the mobile terminal 401 on the display unit 431.

  The communication unit 451 is configured to perform wireless communication with the image forming apparatus 101 using, for example, a predetermined method (for example, Bluetooth (registered trademark)). The communication unit 451 can perform wireless communication in a state where a connection is established between the image forming apparatus 101 and the portable terminal 401 as described later. When the connection is not established, user data such as various documents cannot be communicated between the two.

  The mobile terminal 401 may be provided with a position information detection unit in addition to the above-described units. The position information detection unit uses, for example, a GPS receiving chip set that uses GPS (Global Positioning System). In this case, the portable terminal 401 can measure the position of itself by the position information detection unit and obtain the position data of the portable terminal 401.

  [Configuration of Image Forming Apparatus 101]

  FIG. 2 is a perspective view showing the image forming apparatus 101. FIG. 3 is a block diagram illustrating a hardware configuration of the image forming apparatus 101.

  As shown in FIG. 2, the image forming apparatus 101 includes a paper feed cassette 13, a paper discharge tray 15, a CPU 21, an image forming unit 30, an image reading unit 40, and an operation panel 111. The CPU 21 controls the operation of the image forming apparatus 101. The CPU 21, the image forming unit 30, the image reading unit 40, and the like are disposed inside the housing of the image forming apparatus 101.

  The image forming apparatus 101 has three paper feed cassettes 13 (paper feed cassettes 13a, 13b, and 13c). Each paper feed cassette 13 is loaded with, for example, different sizes of paper (B5 size, A4 size, A3 size, etc.). The paper feed cassette 13 is disposed in the lower part of the image forming apparatus 101 so as to be removable from the housing of the image forming apparatus 101. The paper loaded in each paper feed cassette 13 is fed one by one from the paper feed cassette 13 and sent to the image forming unit 30 at the time of printing. Note that the number of paper feed cassettes 13 is not limited to three, and may be more or less.

  The paper discharge tray 15 is disposed above the portion of the housing of the image forming apparatus 101 where the image forming unit 30 is stored and below the portion where the image reading unit 40 is disposed. The paper on which the image is formed by the image forming unit 30 is discharged from the inside of the housing to the paper discharge tray 5.

  The image forming unit 30 roughly includes a toner image forming unit (not shown), a paper transport unit (not shown), and a fixing device (not shown). The image forming unit 30 forms an image on a sheet by, for example, electrophotography.

  The paper transport unit includes a paper feed roller, a transport solar, and a motor that drives them. The paper transport unit feeds paper from the paper feed cassette 13 and transports it inside the housing of the image forming apparatus 101. The paper transport unit discharges the paper on which the image is formed from the housing of the image forming apparatus 101 to the paper discharge tray 15 or the like.

  The fixing device has a heating roller and a pressure roller. The fixing device conveys the sheet on which the toner image is formed between the heating roller and the pressure roller, and heats and presses the sheet. As a result, the fixing device melts the toner adhering to the paper and fixes it on the paper to form an image on the paper.

  The image reading unit 40 is disposed on the upper part of the casing of the image forming apparatus 101. The image reading unit 40 includes an ADF (Auto Document Feeder) 41. The image reading unit 40 performs the above-described scanner function. The image reading unit 40 scans a document placed on a transparent document table with a contact image sensor and reads it as image data. The image reading unit 40 reads a plurality of documents set on the document tray one by one by the ADF 41 and reads the document by the contact image sensor to obtain image data.

  The image read by the image reading unit 40 is converted into a finished image by the CPU 21. The CPU 21 can transmit the generated finished image to an external device or the like, or can form an image on a sheet by the image forming unit 30 based on the finished image.

  The operation panel 111 is disposed on the upper front side (front side in FIG. 2) of the image forming apparatus 101. On the operation panel 111, operation buttons that can be pressed by the user are arranged. The operation panel 111 is provided with a display unit 131 for displaying information to the user.

  As shown in FIG. 3, in the present embodiment, the image forming apparatus 101 is roughly divided into an image forming apparatus main body (hereinafter also referred to as a main body) 11 and an operation panel 111. The operation panel 111 is configured to be detached from the main body 11 and carried separately from the main body 11.

  As shown in FIG. 1, the main body 11 includes a storage unit 23, a communication unit 51, a connection determination unit (information comparison / analysis unit) 71, and an authentication management unit 81 in addition to the above-described units. Yes.

  The CPU 21 is connected to each part of the image forming apparatus 101 so that signals can be transmitted and received. The CPU 21 controls various operations of the image forming apparatus 101 by executing a control program 23a and the like stored in the storage unit 23 and the like.

  In the main body 11, the storage unit 23 is, for example, a ROM, a RAM, a flash memory, an HDD, or the like. The storage unit 23 stores print job data sent from an external device connected to the image forming apparatus 101, image data read by the image reading unit 40, and the like. The storage unit 23 stores setting information of the image forming apparatus 101 and a control program 23a of the image forming apparatus 101. The CPU 21 can execute various control operations of the image forming apparatus 101 by reading the control program 23a and executing the control program 23a.

  The communication unit 51 is configured to be able to perform wireless communication with a portable terminal 401 using, for example, a predetermined method. The communication unit 51 can perform wireless communication with the communication unit 451 of the mobile terminal 401 based on a short-range wireless communication standard such as Bluetooth (registered trademark). At this time, the communication unit 51 can perform communication of data (document data, image data, etc.) in a state where a connection is established between the portable terminal 401 and the image forming apparatus 101 as will be described later. When the connection is not established, data communication cannot be performed between the two.

  Further, as described later, the communication unit 51 can wirelessly communicate with the communication unit 151 of the operation panel 111. As a result, the image forming apparatus 101 can be operated through the operation panel 111.

  The connection determination unit 71 determines whether or not to establish a connection between the image forming apparatus 101 and the portable terminal 401 as will be described later. The CPU 21 and the communication unit 51 establish a connection between the image forming apparatus 101 and the portable terminal 401 according to the determination of the connection determination unit 71.

  The connection determination unit 71 stores and manages MFP operation information (an example of first operation information) 73 and terminal operation information (an example of second operation information) 75. Information of these pieces of operation information 73 and 75 may be stored in the storage unit 23. As will be described later, these pieces of information are acquired and stored by the connection determination unit 71 when the image forming apparatus 101 and the portable terminal 401 are performing a connection establishing operation.

  Note that the MFP operation information 73 is information regarding a position on the touch panel of the operation panel 111 (on the display unit 131) where the user has performed an operation input. Further, the terminal operation information 75 is information on a position where an operation input by the user is performed on the touch panel (on the display unit 431) of the mobile terminal 401.

  The authentication management unit 81 performs user authentication for the image forming apparatus 101. The user authentication is a job for identifying and authenticating a user who uses the image forming apparatus 101. The user can log in to the image forming apparatus 101 and use the image forming apparatus 101 through authentication by user authentication. Details of user authentication will be described later.

  In addition to the display unit 131, the operation panel 111 includes a control unit (CPU) 121, a storage unit 123, a data input / output unit 127, and a communication unit 151.

  The display unit 131 is a touch panel. The display unit 131 is, for example, a liquid crystal display (LCD). The display unit 131 displays a guidance screen for the user or displays an operation button to accept a touch operation from the user. The display unit 131 includes an operation position detection unit 133. The operation position detection unit 133 detects that the user has touched the display unit 131 and the contact position (user operation position). For example, the operation position detection unit 133 detects the position of the center of gravity of the area touched by the user on the display unit 131 as the operation position of the user. When the user touches the display unit 131, the information is sent to the control unit 121, and the control unit 121 controls the operation panel 111 based on the information. That is, the user can operate the operation panel 111 by touching the display unit 131 and performing an operation.

  The control unit 121 is configured using, for example, a CPU. The control unit 121 controls the operation panel 111 and also controls display on the display unit 131. The control unit 121 performs processing for acquiring an image to be displayed on the display unit 131. That is, the control unit 121 reads, for example, a display image prepared in advance and stored in the storage unit 123 or the like, and displays the display image on the display unit 131 or generates a display image and displays the display image on the display unit 131.

  The storage unit 123 is, for example, a ROM, a RAM, a flash memory, or the like. The storage unit 123 stores, for example, a control program 123a used for controlling the operation panel 111 and various setting values. The control unit 121 reads the control program 123 a from the storage unit 123 and controls the operation panel 111.

  The data input / output unit 127 is, for example, an interface of a storage medium such as a USB (Universal Serial Bus) interface or a memory card of various standards. An external device, an external storage medium, or the like can be connected to the operation panel 111 via the data input / output unit 127, and data from the external device can be read by the operation panel 111. It may be configured to be connectable to the main body 11 via the data input / output unit 127.

  The communication unit 151 is configured to be able to perform, for example, wireless communication with a predetermined method with the communication unit 51 of the main body 11. The communication unit 151 can wirelessly communicate with the communication unit 51 based on a short-range wireless communication standard such as Bluetooth (registered trademark).

  In the present embodiment, the main body 11 and the operation panel 111 are connected so as to be able to send and receive signals to each other because the communication units 51 and 151 can communicate with each other wirelessly.

  When the display unit 131 or the like is operated by the user, the operation panel 111 transmits an operation signal or a predetermined command corresponding to the operation to the CPU 21 of the main body 11 via the communication units 51 and 151. When an operation signal is transmitted from the operation panel 111 or an operation command is transmitted from an external device connected to the image forming apparatus 101, the CPU 21 executes a predetermined control program 23a in response thereto. In response to a user operation applied to the operation panel 111, a signal is sent from the operation panel 111 to the main body 11, whereby the image forming apparatus 101 performs an operation based on the user operation. That is, the user can cause the image forming apparatus 101 to execute various operations by operating the display unit 131 and the like.

  The display unit 131 is also used as an information display. For example, when information about the status of the image forming apparatus 101 is sent from the main body 11 to the operation panel 111, the operation panel 111 displays on the display unit 131 based on the information. As a result, the user can be notified of information related to the image forming apparatus 101.

  Here, the authentication management unit 81 performs user authentication for the image forming apparatus 101 as follows, for example.

  In user authentication, for example, an authentication database (not shown) stored in the storage unit 23 is used. In the authentication database, user information that can be authenticated and authentication information necessary for the user authentication are recorded in association with each other. The authentication information is, for example, an authentication password set for each user. In the authentication database, information related to the function permitted to be executed for each user is recorded in association with the user.

  User authentication is performed as follows, for example. That is, first, a user authentication screen is presented to the user. The user authentication screen is displayed on the display unit 131. The user operates the operation panel 111 to input information about the user (for example, an account name) and a password to the image forming apparatus 101. When such information is input to the operation panel 111, the CPU 21 refers to the authentication database and determines whether or not the user can be authenticated based on the input data. If authentication is possible, the CPU 21 establishes authentication for the user, and enables execution of a function that is permitted to be executed for an authenticated user who has been authenticated. At this time, the authenticated user is logged in to the image forming apparatus 101. Thereby, the image forming apparatus 101 can identify a user who uses the image forming apparatus 101.

  By identifying the user by performing user authentication, the display of the display unit 131 and the usable functions are adapted to the authenticated user, and the convenience of the image forming apparatus 101 can be improved. Further, when the authenticated user is near the image forming apparatus 101, a high security effect can be obtained, for example, a printed matter can be output without touching the eyes of other users.

  In the image forming apparatus 101, the CPU 21 manages the user's authority to use the functions of the image forming apparatus 101 according to the user identified by the user authentication. By managing the use authority, use of a predetermined function can be restricted for each user, and a high security effect can be obtained.

  Note that the user authentication method is not limited to the above, and a known method can be adopted as appropriate. The reference destination of authentication information, the subject performing authentication, and the like may be different from those described above. For example, the image forming apparatus 101 itself has authentication information for performing user authentication, and the image forming apparatus 101 may accept an authentication request from the user and authenticate the user based on the authentication information. . In addition, for example, a card authentication method using a contact / non-contact ID card or a biometric authentication method using user's fingerprint information or vein information, etc. is used to input information such as account name and password to the user. May not be required. The authentication database may be managed by a server (not shown) constituting the image forming system 501.

  [Connection Establishing Operation Between Image Forming Apparatus 101 and Communication Terminal 401]

  In the present embodiment, the image forming apparatus 101 establishes a connection with the portable terminal 401 when a user performs a predetermined operation on the image forming apparatus 101 and the portable terminal 401. When the connection between the image forming apparatus 101 and the portable terminal 401 is established in this way, various data are transmitted and received between the two by wireless communication, the partner apparatus is controlled from one apparatus, and various conveniences are provided. High functions can be executed. In other words, the connection establishment operation is performed prior to the wireless communication, so that the connection is established between the portable terminal 401 and the image forming apparatus 101. This operation is realized by, for example, the CPU 21 controlling on the image forming apparatus 101 side and the CPU 421 controlling on the portable terminal 401 side.

  Hereinafter, among the operations performed through the above-described connection establishment operation, data stored in the portable terminal 401 is transmitted to the image forming apparatus 101, and the image forming apparatus 101 performs a function of printing the data. An example will be described. Such a function may be referred to as a touch and print function using the mobile terminal 401.

  FIG. 4 is a first diagram illustrating an example of an operation performed when a connection establishment operation is being performed. FIG. 5 is a second diagram illustrating an example of an operation performed when a connection establishment operation is being performed. FIG. 6 is a third diagram illustrating an example of an operation performed when a connection establishment operation is being performed.

  In step S <b> 11, the user who wants to execute the above function operates the portable terminal 401 and selects data (such as a document) to be printed by the image forming apparatus 101. At this time, as shown in FIG. 4, the display unit 431 of the portable terminal 401 displays a display indicating that the connection with the information device such as the image forming apparatus 101 has not yet been established (“waiting for information device connection”). ”) Is displayed in the portable terminal 401 for allowing the user to specify data to be printed.

  When an operation for selecting data to be printed is performed, in step S12, the portable terminal 401 displays on the display unit 431 a message for instructing the user to place the image forming apparatus 101 in a connection waiting state. . The portable terminal 401 communicates with the image forming apparatus 101 and waits until it detects that the image forming apparatus 101 is in a connection waiting state. Note that when the image forming apparatus 101 is in the connection waiting state first and the portable terminal 401 can detect this, step S12 is not performed, and the process may go directly to step S13.

  When it is detected that the image forming apparatus 101 is in the connection waiting state, in step S13, a display that prompts the user to prepare for a predetermined operation to be performed later is displayed on the display unit 431 of the portable terminal 401. For example, an operation button “OK” (which is pressed by a touch operation) is displayed on the display unit 431. When the user is ready, the user can press the operation button to input an actual predetermined operation in the next step S14. In addition, you may make it move to following step S14 when predetermined period passed after performing the display of step S13.

  When “OK” is operated in step S13, the process proceeds to step S14.

  In step S <b> 14, the mobile terminal 401 and the image forming apparatus 101 receive user operation input. The user performs the same operation on each of the portable terminal 401 and the operation panel 111 of the image forming apparatus 101. When the contents of the operations on the portable terminal 401 and the image forming apparatus 101 are the same, the image forming apparatus 101 establishes a connection with the portable terminal 401. Here, the operation input performed by the user is, for example, input of characters or figures performed by so-called handwriting input (to the touch panel).

  At the stage of step S14, the display unit 431 of the portable terminal 401 displays an input area 435 for accepting a user's handwritten input, in addition to a display indicating a state of waiting for connection of an information device to be connected. (Connection screen). On the other hand, the display unit 131 of the operation panel 111 of the image forming apparatus 101 displays an input area 135 for receiving a user's handwritten input, in addition to information indicating a state of waiting for connection of a portable terminal to be connected. (Connection screen). The input area 435 is displayed over the entire width of the display unit 431 of the portable terminal 401, whereas the input area 135 is a position relatively close to the outer edge of the operation panel 111 in the display unit 111 of the operation panel 111, that is, the book. In the embodiment, it is displayed above the display unit 111.

  When a connection screen including input areas 435 and 135 is displayed on portable terminal 401 and operation panel 111, the user brings portable terminal 401 closer to operation panel 111. At this time, the user lays the portable terminal 401 close to the upper edge of the operation panel 111 (in the horizontal direction) and makes the portable terminal 401 adjacent to the operation panel 111. As a result, the input area 135 and the input area 435 are arranged close to each other.

  In a state where the portable terminal 401 and the operation panel 111 are arranged, the user inputs substantially the same content into both the input areas 135 and 435 of the connection screen substantially simultaneously. Here, for example, a case is assumed where the handwritten input of the characters “OK” is performed. At this time, the user inputs a character 951 of “OK” in the input area 135 with the thumb 901 of the hand 900. Further, the user inputs the character “OK” 952 in the input area 435 with the index finger 902.

  When input is performed in this way, user operation information is sent from the portable terminal 401 to the image forming apparatus 101, and this is compared with user operation information on the operation panel 111 in the image forming apparatus 101. That is, the connection determination unit 71 stores user operation information about the operation panel 111 as MFP operation information 73 and stores user operation information about the mobile terminal 401 as terminal operation information 75. Then, the connection determination unit 71 compares the MFP operation information 73 with the terminal operation information 75 and determines whether or not they match.

  Here, the operation information includes, for example, trajectory information indicating a transition of a position (position indicated by coordinates or the like) touched by the user in the display units 131 and 431, time information, and the like. The CPUs 21, 421, etc. can interpret what characters and figures have been input by handwriting on the display units 131, 431 based on the operation information.

  Note that even if the two pieces of information 73 and 75 are slightly different from each other, if it is determined that they are consistent to some extent (both have a certain degree of similarity), the connection determination unit 71 determines that both are identical. You may judge that you are doing. If it is determined that the two match, processing for establishing a connection between the image forming apparatus 101 and the portable terminal 401 is performed.

  The operation in step S14 can be performed with the operation panel 111 removed from the main body 11 and placed on, for example, a flat desk. Accordingly, the operation can be easily performed while the operation panel 111 and the portable terminal 401 are adjacent to each other.

  If operation of step S14 is performed, it will progress to step S15.

  In step S15, the display unit 431 of the portable terminal 401 displays a display indicating that the connection with the image forming apparatus 101 is successful (connection is established) and that the image forming apparatus 101 (information device) is being connected. Display.

  When the connection is established in this way, the data stored in the portable terminal 401 is transferred to the image forming apparatus 101 thereafter. That is, as step S16, transfer of the print document is started. Here, the print document refers to data designated as a print target in step S11. For example, a display indicating that the print document is being transferred and a progress bar indicating the progress of the transfer are displayed on the display unit 431. Note that the same display may be performed on the display unit 131 of the operation panel 111 or the like.

  When the transfer of the print document is completed in step S17, the display unit 431 displays that effect. When the transfer of the print document is completed, the image forming apparatus 101 performs an image forming operation (printing operation) on the transferred print document. Thereby, a series of operations until the connection of the image forming apparatus 101 and the portable terminal 401 is established and the transferred data is printed is completed.

  FIG. 7 is a sequence diagram showing a rough flow of the touch and print function and the connection establishment operation performed at that time.

  The touch and print function is performed between the image forming apparatus 101 and the portable terminal 401 in accordance with a user operation. Among these, in the connection establishment operation, MFP operation information 73 obtained on the image forming apparatus 101 side and terminal operation information 75 obtained on the portable terminal 401 side are sent to the connection determination unit 71 of the image forming apparatus 101. The connection determination unit 71 determines whether the image forming apparatus 101 and the portable terminal 401 correspond to each other. In FIG. 7, the image forming apparatus 101 and the connection determination unit 71 are shown separately. In this case, the MFP operation information 73 obtained on the image forming apparatus 101 side is processed by the connection determination unit 71. It is for explaining.

  As shown in FIG. 7, in the touch and print function, a user operation is performed in the following order. That is, in step S21, the user sets the operation mode of the image forming apparatus 101 to a print instruction connection waiting mode (hereinafter, sometimes referred to as a connection waiting state). The user can change the operation mode by performing a predetermined operation.

  In step S <b> 22, the user operates the portable terminal 401 to set the operation mode of the portable terminal 401 to the image forming apparatus connection waiting mode (hereinafter sometimes referred to as a connection waiting state). At this time, the user operates the portable terminal 401 to designate a print target document (transmission file). As the print target document, a document that the user wants to output from the image forming apparatus 101 is designated.

  When the touch and print function is prepared in steps S21 and S22, a connection establishment operation is started.

  In step S <b> 23, the user arranges the portable terminal 401 and the operation panel 111 to prepare for input.

  In step S <b> 24, the user performs an operation input on the portable terminal 401 and the operation panel 111.

  When an operation input is performed, as will be described later, a connection between the image forming apparatus 101 and the portable terminal 401 is established, and a file that cannot be transferred before the connection is established can be transferred. A print target document designated in preparation for the touch and print operation is transmitted from the portable terminal 401 to the image forming apparatus 101. Then, the image forming apparatus 101 prints the received print target document.

  By performing printing in this way, in step S25, the user can receive a printed matter for the document to be printed.

  The touch and print function is realized by each of the image forming apparatus 101, the portable terminal 401, and the connection determination unit 71 inside the image forming apparatus 101 performing the following process according to a user operation. Has been. These processes are performed by the operation of each unit of the image forming apparatus 101 and each unit of the portable terminal 401 under the control of the CPU 21 of the image forming apparatus 101 and the CPU 421 of the portable terminal 401.

  That is, as shown in FIG. 7, in step S31, the CPU 21 of the image forming apparatus 101 sets the operation mode of the image forming apparatus 101 to a connection waiting state in accordance with the operation shown in step S21 by the user. At this time, the CPU 21 transmits a predetermined type of information regarding the image forming apparatus 101 to the connection determination unit 71. For example, a terminal ID uniquely assigned to the image forming apparatus 101 and information indicating that the image forming apparatus 101 is in a connection waiting state are transmitted.

  In step S <b> 33, the CPU 21 of the image forming apparatus 101 displays a connection screen on the display unit 131. Note that the connection screen may be displayed after it is detected that the mobile terminal 401 is also in a connection waiting state.

  In step S <b> 35, the connection determination unit 71 acquires and stores information transmitted from the image forming apparatus 101 under the control of the CPU 21. These pieces of information are used for recording MFP operation information 73, for example.

  On the other hand, in step S37, the CPU 421 of the portable terminal 401 sets the operation mode of the portable terminal 401 to a connection waiting state in accordance with the operation shown in step S22 by the user. At this time, the CPU 421 transmits a predetermined type of information regarding the portable terminal 401 to the connection determination unit 71 of the image forming apparatus 101. For example, a terminal ID uniquely assigned to the mobile terminal 401, information indicating that the mobile terminal 401 is in a connection waiting state, and position information are transmitted.

  In step S <b> 38, the CPU 421 of the mobile terminal 401 displays a connection screen on the display unit 131. The connection screen may be displayed after it is detected that the image forming apparatus 101 is also in a connection waiting state.

  In step S39, the connection determination unit 71 acquires and stores information transmitted from the portable terminal 401 under the control of the CPU 21.

  Note that the order of the processing from step S31 to step S35 and the processing from step S37 to step S39 depends on which of the image forming apparatus 101 and the portable terminal 401 is put into a connection waiting state by the user first. You may go back and forth.

  When the image forming apparatus 101 and the mobile terminal 401 are in a connection waiting state, an operation input is executed by the user (steps S23 and S24).

  In step S <b> 41, on the image forming apparatus 101 side, MFP operation information 73 corresponding to the user operation is obtained on the operation panel 111, and this is transmitted to the connection determination unit 71.

  In step S <b> 43, terminal operation information 75 corresponding to the user operation is obtained on the mobile terminal 40 side, and this is transmitted to the connection determination unit 71.

  In step S <b> 45, the connection determination unit 71 stores MFP operation information 73 and terminal operation information 75.

  In step S <b> 50, the connection determination unit 71 starts searching for a portable terminal (connection target terminal) that is a target for establishing a connection with the image forming apparatus 101. The search for the portable terminal may be performed after a predetermined time since one or both of the MFP operation information 73 and the terminal operation information 75 is stored last, or may be performed at an arbitrary timing. Good. Further, it may be performed when an instruction for search transmitted from the image forming apparatus 101 or the portable terminal 401 is received by the connection determination unit 71.

  In step S61, the connection determination unit 71 searches for a terminal. The CPU 21 searches the operation information 73 and 75 to identify the portable terminal 401 that is considered to have performed the same operation as that performed in the image forming apparatus 101. In other words, the connection determination unit 71 compares the operation information 73 and 75 with each other, and determines whether or not the operation input by the user to the operation panel 111 and the mobile terminal corresponds to each other.

  When the portable terminal 401 is specified, in step S63, connection permission information is notified from the connection determination unit 71 to each or one of the image forming apparatus 101 and the portable terminal 401.

  In step S <b> 65, the terminal ID of the portable terminal 401 is transmitted from the connection determination unit 71 to the image forming apparatus 101 side as information indicating that the connection is permitted and the ID of the partner terminal that is permitted to connect. As a result, the image forming apparatus 101 establishes a connection with the portable terminal 401. That is, the portable terminal 401 is registered in the image forming apparatus 101 as being communicable and can communicate with each other wirelessly.

  In step S <b> 67, the CPU 21 of the image forming apparatus 101 notifies the portable terminal 401 that the connection has been established.

  In step S <b> 69, the CPU 421 of the portable terminal 401 transmits the print target document data to the image forming apparatus 101. The data of the print target document can be transmitted by wireless communication when the connection between the image forming apparatus 101 and the portable terminal 401 is established. Until the connection between the image forming apparatus 101 and the portable terminal 401 is established, the authority of the user is controlled so that document data cannot be transmitted / received. In other words, document data transmission / reception operations are prohibited until a connection is established. When the connection is established, wireless communication becomes possible, and the authority necessary for transmitting and receiving document data is given to the user. This control is performed, for example, by the CPU 21 or the like.

  In step S71, the CPU 21 of the image forming apparatus 101 performs printing based on the received print target document data. As a result, the touch and print operation ends, and the user can receive the printed matter.

  Note that the user's operation for specifying a document to be printed may be performed after the connection establishment operation is performed, that is, after the connection between the image forming apparatus 101 and the portable terminal 401 is established. The portable terminal 401 may be placed in a connection waiting state earlier than the image forming apparatus 1.

  Here, along with the series of connection establishment operations as described above, user authentication in the image forming apparatus 101 may be performed based on a terminal ID related to the portable terminal 401 or the like. This can be done by the following configuration. In other words, in the authentication database, the terminal ID of the mobile terminal 401 used by the user is recorded in advance in association with the user who can be authenticated by the image forming apparatus 101. When a connection establishment operation is performed between the image forming apparatus 101 and the portable terminal 401 and the terminal ID of the portable terminal 401 with which the connection has been established is sent, the CPU 21 performs user authentication for the user corresponding to the terminal ID. I do. Thereby, the user can perform user authentication only by performing an easy operation without registering a password or the like separately. Note that when authentication is established, the image forming apparatus 101 may determine a user who performs user authentication based on the terminal ID of the portable terminal 401 and ask the user only to input a corresponding password. In addition to whether or not the connection between the image forming apparatus 101 and the portable terminal 401 is established, the authority relating to transmission and reception of document data may be controlled depending on whether or not user authentication is performed. .

  [Description of specific operation of each device when connection establishment operation is performed]

  FIG. 8 is a first flowchart showing processing performed in the image forming system 501 when the connection establishment operation is executed.

  When the connection establishment operation is executed, operation information is acquired on each of the mobile terminal 401 side and the image forming apparatus 101 side. FIG. 8 mainly shows processing on the portable terminal 401 side until the terminal operation information 75 is acquired.

  That is, in step S <b> 111, the CPU 421 of the mobile terminal 401 confirms whether the mobile terminal 401 is in a connection waiting state with an information device such as the image forming apparatus 101. If the connection is waited, the process proceeds to the next step S112.

  In step S <b> 112, the CPU 421 confirms whether a transmission file to be transmitted to the image forming apparatus 101 is specified when the connection with the image forming apparatus 101 is established. The CPU 421 is performed by, for example, presenting a predetermined screen to the user as described above, prompting the user to select a transmission file, and accepting the selection of the transmission file by the user.

  When the transmission file is designated in step S112, the user sets the portable terminal 401 next to the operation panel 111 in step S113. That is, the portable terminal 401 is arranged so as to be adjacent to the display unit 131 of the operation panel 111 so that the user can easily perform input operations to the portable terminal 401 and the operation panel 111 thereafter. At this time, one or both of the mobile terminal 401 and the operation panel 111 are configured to detect whether or not the mobile terminal 401 and the operation panel 111 are arranged in positions close to each other in a predetermined manner. May be. This can be performed, for example, by providing various types of sensors on one or both of the portable terminal 401 and the operation panel 111.

  When the portable terminal 401 is set next to the operation panel 111, a predetermined input operation by the user is performed. In step S <b> 114, the CPU 421 determines whether the user's operation input performed on the display unit 431 of the mobile terminal 401 is completed. When the operation input is completed, the process proceeds to the next process.

  When it is determined in step S114 that the operation input has been completed, in step S115, the CPU 421 transmits terminal operation information 75 regarding the operation input to the image forming apparatus 101. The terminal operation information 75 is transmitted to the main body 11 of the image forming apparatus 101.

  FIG. 9 is a second flowchart showing processing performed in the image forming system 501 when the connection establishment operation is executed.

  FIG. 9 mainly shows processing until the MFP operation information 73 is acquired and the operation information 73 and 75 are acquired by the connection determination unit 71 on the image forming apparatus 101 side. The acquisition of the MFP operation information 73 is described as being performed by the function of each unit mainly based on the control of the CPU 21 of the image forming apparatus 101, but is not limited thereto. For example, the operation until the MFP operation information 73 is transmitted to the main body 11 may be performed mainly based on the control of the control unit 121 of the operation panel 111.

  That is, in step S <b> 121, the CPU 21 of the image forming apparatus 101 confirms whether the image forming apparatus 101 is in a connection waiting state with a portable terminal such as the portable terminal 401. If the connection is waited, the process proceeds to the next step S122.

  When in the connection waiting state, the portable terminal 401 is arranged next to the operation panel 111 as described above, and an operation input by the user is performed. In step S122, the CPU 21 determines whether or not the user's operation input performed on the display unit 131 of the operation panel 111 is completed. When the operation input is completed, the process proceeds to the next process.

  When it is determined in step S122 that the operation input has been completed, in step S123, the control unit 121 of the operation panel 111 transmits MFP operation information 73 regarding the operation input to the main body 11 of the image forming apparatus 101. As described above, the operation input to the portable terminal 401 and the operation input to the operation panel 111 are performed substantially simultaneously, and the transmission of the operation information 73 and 75 to the main body 11 is also performed at substantially the same time.

  When the operation information 73, 75 (data) is transmitted to the main body 11, in step S124, the CPU 21 receives the data. The received operation information 73 and 75 is stored in the connection determination unit 71.

  In step S125, the CPU 21 detects whether or not the data reception of the operation information 73 and 75 has been completed. When the data reception is completed, the process proceeds to the process shown in the next figure.

  FIG. 10 is a third flowchart illustrating processing performed in the image forming system 501 when the connection establishment operation is executed.

  FIG. 10 shows processing until the connection between the portable terminal 401 and the image forming apparatus 101 is established based on the operation information 73 and 75 and the data (print data) of the transmission file is printed (printed). Yes.

  In step S <b> 131, the connection determination unit 71 starts comparison of received data, that is, comparison of operation information 73 and 75 under the control of the CPU 21. In the present embodiment, the operation information 73 and 75 includes information indicating the locus of movement of the user's operation position (position touched by the user) on the display units 131 and 431, respectively. That is, the MFP operation information 73 includes movement trajectory information obtained by sampling information on a position where an operation input by the user on the touch panel of the display unit 131 of the operation panel 111 is performed at a constant cycle. Further, the terminal operation information 75 includes movement trajectory information obtained by sampling information on a position where an operation input by the user on the touch panel of the display unit 431 of the portable terminal 401 is performed at a constant period. The connection determination unit 71 compares the movement locus of the operation position with respect to the operation input made on each of the operation panel 111 and the portable terminal 401.

  In step S132, the connection determination unit 71 determines whether or not the operation information 73 and 75 match each other under the control of the CPU 21. That is, the connection determination unit 71 determines whether or not the operation input to the image forming apparatus 101 by the user and the operation input to the portable terminal 401 correspond to each other. Here, “matching the operation information 73 and 75” includes not only the case where the two match completely but also the case where the similarity between the two is higher than a predetermined level. In other words, even if the operation information 73 and 75 are slightly different from each other, it may be determined that the different points are simply due to errors such as operation fluctuations and indicate the same information. In such a case, it can be determined that the operation information 73 and 75 match each other, that is, the user's operation is the same corresponding to each other.

  If they do not match in step S132, in step S133, the CPU 21 determines whether or not to re-input data. When re-inputting data, the process returns to step S132. On the other hand, when the data is not re-input, the series of processes is terminated. In this case, the connection between the image forming apparatus 101 and the portable terminal 401 is not established, so that the touch and print function is also interrupted, and the transmission file is not printed.

  If they match in step S132, the connection determination unit 71 determines that the image forming apparatus 101 and the portable terminal 401 can establish a wireless connection with each other. In step S <b> 134, the CPU 21 establishes a wireless connection between the image forming apparatus 101 and the portable terminal 401.

  When the connection between the image forming apparatus 101 and the portable terminal 401 is established, print data reception processing is performed in step S135. The print data reception process is a process performed when the touch-and-print function is executed, which is set prior to the connection establishment operation. The print data reception process is a function that is prohibited from being executed before the connection between the image forming apparatus 101 and the portable terminal 401 is established, so that the connection can be established and data can be transmitted and received. As a result, it becomes executable. In other words, when the connection is established, the CPU 21 permits the execution of the print data reception process that is prohibited from being executed before the connection is established.

  FIG. 11 is a flowchart showing print data reception processing.

  In step S <b> 141, on the image forming apparatus 101 side, the CPU 21 transmits a communication completion report to the portable terminal 401.

  In step S <b> 142, on the mobile terminal 401 side, the CPU 421 receives the communication completion report transmitted from the image forming apparatus 101.

  When the communication completion report is received, the CPU 421 transmits print data to the image forming apparatus 101 in step S143. Data of a transmission file designated in advance is transmitted from the portable terminal 401 to the image forming apparatus 101 as print data.

  On the image forming apparatus 101 side, the CPU 21 receives print data transmitted from the portable terminal 401. In step S144, the CPU 21 confirms that the reception of print data has been completed. When the reception of the print data is completed, the process returns to the process of FIG.

  Returning to FIG. 10, in step S136, the CPU 21 causes the data to be printed (printed) based on the received print data. As a result, a printed matter is output for the data specified by the portable terminal 401 stored in the portable terminal 401.

  As described above, in the present embodiment, the connection determination unit 71 causes the MFP operation information 73 relating to the position where the operation input by the user on the display unit 131 of the operation panel 111 is performed, and the display unit 131 of the portable terminal 401. The terminal operation information 75 relating to the position where the operation input by the user is performed is compared. Thereby, the connection determining unit 71 determines whether or not the operation input by the user to both the image forming apparatus 101 and the portable terminal 401 corresponds to each other. Then, depending on the determination result, the CPU 21 establishes a wireless connection between the image forming apparatus 101 and the portable terminal 401. That is, according to the present embodiment, a cooperation state in which both devices can communicate with each other by a simple operation between the image forming apparatus 101 and the portable terminal 401 without performing a complicated operation such as inputting a PIN code. It can be established (connection is established). When the connection is established, a file (PDF format file or other document format file) in the portable terminal 401 can be transferred to the image forming apparatus 101 via the wireless interface of the communication units 51 and 451. The user can easily establish a connection between the image forming apparatus 101 and the portable terminal 401 without having to perform complicated operations such as an authentication code input operation.

  [Description of Modification Example (Modification Example 1) of First Embodiment]

  In the first embodiment, the connection determination unit 71 determines whether the operation information 73 and 75 match each other based on not only the movement trajectory information but also the operation time information regarding the user's operation input. You may make it judge.

  FIG. 12 is a flowchart illustrating the operation of the image forming system 501 according to one of the modified examples of the first embodiment.

  FIG. 12 shows a part of processing at the time of execution of the connection establishment operation, and this processing corresponds to what is performed in the first embodiment (the portion shown in FIG. 10). . Of the processes shown in FIG. 12, the processes in steps S232 to S236 are the same as the processes in steps S132 to S136 shown in FIG. That is, when the connection establishment operation is performed in this modification, the same operation as that of the first embodiment is performed except for the processing of step S231.

  In this variation, the MFP operation information 73 includes operation time information related to the first operation time when the user inputs an operation on the display unit 131 of the operation panel 111. Further, the terminal operation information 75 includes operation time information related to the second operation time when an operation input is performed by the user on the display unit 431 of the mobile terminal 401.

  When the operation information 73 and 75 are stored in the connection determination unit 71, the connection determination unit 71 compares the operation information 73 and 75 in step S231. At this time, each of the movement trajectory information and the operation time information included in the operation information 73 and 75 is compared. When the connection determination unit 71 can determine that the movement trajectory information of the operation information 73 and 75 matches each other and can determine that the operation time information of the operation information 73 and 75 matches each other, the connection information 73 and 75 It is determined that 75 matches. If it is determined that the operation information matches, the CPU 21 connects the image forming apparatus 101 and the portable terminal 401 (steps S132 and S234).

  Here, “the operation time information of both coincides with each other” includes not only the case where the both coincide completely but also the case where the operation time indicated by both falls within a predetermined time range. That is, even if the operation time is slightly different between the image forming apparatus 101 side and the portable terminal 401 side, if the time difference is within a predetermined time, the operation time when the user performed the operation is the same, and the user's operation time is the same. It can be determined that the operations are likely to correspond to each other.

  As described above, in this modified example, the operation information 73 and 75 are compared based on not only the movement trajectory but also the viewpoint of the operation time. Since the connection determination unit 71 can more accurately determine whether or not the operation input performed on the image forming apparatus 101 and the operation input performed on the portable terminal 401 correspond to each other, the CPU 21 can reliably A connection between the image forming apparatus 101 and the portable terminal 401 can be established.

  [Description of Modified Example (Modified Example 2) of First Embodiment]

  In the first embodiment, the connection determination unit 71 may recognize each of the MFP operation information 73 and the terminal operation information 75 as character information based on each of the MFP operation information 73 and the terminal operation information 75. Then, the connection determining unit 71 determines whether or not the user operation inputs correspond to each other depending on whether or not the character information corresponding to the MFP operation information 73 matches the character information corresponding to the terminal operation information 75. You may make it judge.

  FIG. 13 is a flowchart showing the operation of the image forming system 501 according to one of the modifications of the first embodiment different from the above.

  FIG. 13 shows a part of processing at the time of execution of the connection establishment operation, and this processing corresponds to what is performed in the first embodiment (portion shown in FIG. 10). is there. Of the processes shown in FIG. 13, the processes in steps S332 to S336 are the same as the processes in steps S132 to S136 shown in FIG. That is, when the connection establishment operation is performed in this modification, operations similar to those in the first embodiment are performed except for the processes in steps S321, S322, and S331.

  In this modified example, when the operation information 73, 75 is stored in the connection determination unit 71, in step S321, the connection determination unit 71 confirms whether the operation information 73, 75 can be converted into character information. .

  For example, when it can be confirmed that the operation information 73, 75 indicates a character based on the operation information 73, 75, the process of step S322 is performed. That is, the connection determination unit 71 generates character information based on the operation information 73 and 75 (performs conversion processing to character information).

  On the other hand, when it is confirmed that the operation information 73, 75 does not indicate a character, for example, indicates a graphic or the like, the conversion process to character information is not performed.

  In step S331, the connection determination unit 71 compares information based on the operation information 73 and 75. At this time, if there is information converted into character information in step S322, the information is compared with each other. That is, in this modified example, it is determined whether or not the operation information 73 and 75 match each other by comparing the converted character information for the operation information 73 and 75. Here, when comparing the character information based on the MFP operation information 73 and the character information based on the terminal operation information 75, not only when both character information completely match each other but also when there is a certain degree of similarity to each other. Alternatively, it may be determined that the two match. If the character information matches as a result of the comparison, it can be determined that the operation input on the image forming apparatus 101 side corresponds to the operation input on the portable terminal 401 side.

  As described above, in this modified example, it is possible to determine whether or not the user's operation inputs correspond to each other after converting the operation information 73 and 75 into character information, so that the determination can be easily performed. If it is determined that conversion to character information is impossible or in other cases, conversion to character information is not performed, and data comparison is performed by comparing, for example, movement trajectory information included in the operation information 73 and 75. You may do it.

  [Second Embodiment]

  Since the basic configuration of image forming system 501 in the second embodiment is the same as that in the first embodiment, description thereof will not be repeated here. In the second embodiment, when the operation information 73 and 75 are compared, the difference in resolution between the display units 131 and 431 is considered on the image forming apparatus 101 side and the portable terminal 401 side. It is different from the form.

  FIG. 14 is a diagram showing a comparison between the display unit 131 of the operation panel 111 and the display unit 431 of the mobile terminal 401.

  For example, a display panel such as a liquid crystal display has various resolutions, and the resolution of the display unit 131 of the operation panel 111 may be different from the resolution of the display unit 431 of the mobile terminal 401.

  As shown in FIG. 14, in the second embodiment, for example, in the operation panel 111, the display unit 131 has a diagonal size of 8.5 inches and a pixel count of 800 × 480 pixels. It is a panel. That is, the resolution of the display unit 131 is about 110 ppi (pixels per inch). On the other hand, in the portable terminal 401, the display unit 431 is a panel having a diagonal size of 3.5 inches and a number of pixels of 960 × 640 pixels. That is, the resolution of the display unit 431 is about 330 ppi. The display unit 431 has a resolution about three times higher than that of the display unit 131.

  In the second embodiment, the connection determination unit 71 acquires the resolution information of the display units 131 and 431. Then, the operation information 73 and 75 are compared according to the resolution information.

  FIG. 15 is a flowchart showing the operation of the image forming system 501 according to the second embodiment.

  FIG. 15 shows a part of processing at the time of execution of the connection establishment operation, and this processing corresponds to what is performed in the first embodiment (portion shown in FIG. 10). is there. Of the processes shown in FIG. 15, the processes in steps S431 to S436 are the same as the processes in steps S131 to S136 shown in FIG. That is, when the connection establishment operation is performed in this modified example, the same operation as that of the first embodiment is performed except for the processing of Step S421 and Step S422.

  In this modified example, when the operation information 73, 75 is stored in the connection determination unit 71, in step S421, the connection determination unit 71 determines the resolution of the display unit 131 of the operation panel 111 and the resolution of the display unit 431 of the portable terminal 401. To see if they are different.

  If the resolutions of the display units 131 and 431 are the same as each other, the connection determination unit 71 performs a comparison based on the obtained operation information 73 and 75 without performing any particular correction process (step S431).

  On the other hand, if the resolutions of the display units 131 and 431 are different in step S421, the process proceeds to step S422. That is, the connection determination unit 71 performs a trajectory information correction process. The trajectory information correction process can be obtained when one of the MFP operation information 73 and the terminal operation information 75 is operated on the other panel based on the resolution ratio of the display units 131 and 431. This is a process of converting so as to obtain operation information.

  FIG. 16 is a diagram illustrating an example of the trajectory information correction process.

  In step S401, for example, a case where an operation is performed as follows is assumed. That is, this is a case where a straight line having a length of about 3 cm is drawn in the horizontal direction by the user on each of the display unit 431 of the portable terminal 401 and the display unit 131 of the operation panel 111.

  When such an operation is performed, the operation information 73 and 75 and resolution information obtained by the connection determination unit 71 are, for example, as follows (step S402). Here, it is assumed that the operation information 73 and 75 are indicated by, for example, the coordinates of the movement start point and the coordinates of the movement end point.

That is, the terminal operation information 75 and the resolution information of the display unit 431 are as follows.
Resolution = 330 [ppi (pixel / inch)]
Starting coordinate = (Xa, Ya)
End coordinate = (Xa + 390, Ya)

On the other hand, the MFP operation information 73 and the resolution information of the display unit 131 are as follows.
Resolution = 110 [ppi (pixel / inch)]
Starting coordinate = (Xa, Ya)
End coordinate = (Xa + 130, Ya)

  The connection determination unit 71 corrects the operation information 73 and 75 because the resolutions of the display units 131 and 431 are different from each other. Here, for example, the terminal operation information 75 of the portable terminal 401 is corrected based on the resolution ratio of the display units 131 and 431 (step S403).

  That is, the connection determination unit 71 corrects the end coordinates (Xa + 390, Ya) of the mobile terminal 401 as follows, and obtains corrected end coordinates.

  (End coordinates after correction) = Xa + 390 / (110/330) = Xa + 130

  When the corrected end coordinates are obtained, in step S404, the MFP operation information 73 and the corrected terminal operation information 75 are compared to determine whether or not they match each other. In this example, the corrected end coordinates on the portable terminal 401 side are (Xa + 130, Ya) as described above, and the movement locus is (130, 0). This coincides with the movement locus (130, 0) on the operation panel 111 side. Therefore, in this example, it is determined that the movement trajectory is the same between the portable terminal 401 and the operation panel 111.

  In the second embodiment, the operation information 73 and 75 are compared in consideration of the difference in resolution as described above. Therefore, it is possible to more accurately determine whether the operation input by the user is the same on the operation panel 111 side and the portable terminal 401 side.

  [Third Embodiment]

  Since the basic configuration of the image forming system 501 in the third embodiment is the same as that in the first embodiment, description thereof will not be repeated here. In the third embodiment, as a user's operation input, an input of an authentication password for the user set in advance is required, and the user is authenticated as the connection between the image forming apparatus 101 and the portable terminal 401 is established. This is different from the first embodiment.

  In the third embodiment, the connection determination unit 71 basically determines whether or not the user's operation inputs correspond to each other in the same manner as in the second modification of the first embodiment. Do. That is, the connection determination unit 71 recognizes each of the MFP operation information 73 and the terminal operation information 75 as character information, and whether the character information corresponding to the MFP operation information 73 matches the character information corresponding to the terminal operation information 75. Depending on whether or not, it is determined whether or not the user's operation inputs correspond to each other. Further, together with this process, the connection determining unit 71 determines whether or not both character information, that is, the character input by the user matches the preset authentication password for the user. When the connection determination unit 71 determines that the user's operation inputs correspond to each other and the characters input by the user match the authentication password, the CPU 21 connects the image forming apparatus 101 and the portable terminal 401. Establish.

  FIG. 17 is a flowchart showing the operation of the image forming system 501 according to the third embodiment.

  FIG. 17 shows a part of processing at the time of execution of the connection establishment operation, and this processing is performed in the second modification of the first embodiment (the portion shown in FIG. 13). Corresponding. Of the processes shown in FIG. 17, the processes in steps S521 and S522 are the same as the processes in steps S321 and S322 shown in FIG. Moreover, the process of step S532-step S536 is the same as the process of step S332-step S336 shown by FIG. That is, when the connection establishment operation is performed in the third embodiment, the same operation as that of the modified example 2 of the first embodiment is performed except for the processing in step S531.

  In the third embodiment, when the operation information 73, 75 is stored in the connection determination unit 71, if it can be confirmed that the operation information 73, 75 indicates a character, in step S322, it is determined. It is converted into character information (step S521, step S522).

  In step S531, the connection determination unit 71 compares information based on the operation information 73 and 75. At this time, if there is information converted into character information in step S522, the information is compared with each other. That is, in the third embodiment, it is determined whether or not the operation information 73 and 75 match each other by comparing the converted character information for the operation information 73 and 75. Here, when comparing the character information based on the MFP operation information 73 and the character information based on the terminal operation information 75, not only when both character information completely match each other but also when there is a certain degree of similarity to each other. Alternatively, it may be determined that the two match. If the character information matches as a result of the comparison, it can be determined that the operation input on the image forming apparatus 101 side corresponds to the operation input on the portable terminal 401 side.

  At this time, the connection determination unit 71 determines whether or not both character information matches an authentication password that is set as necessary for the user to be authenticated for the image forming apparatus 101.

  When the connection determination unit 71 determines in step S532 that the user's operation input matches the image forming apparatus 101 side and the portable terminal 401 side, the character input by the user matches the authentication password. It is determined that the connection between the forming apparatus 101 and the portable terminal 401 can be established.

  The determination as to whether or not the authentication password matches may be made by the CPU 21 controlling the authentication management unit 81 and the like. If the connection determination unit 71 determines that the image forming apparatus 101 side and the portable terminal 401 side match each other, the connection determination unit 71 establishes a connection between the image forming apparatus 101 and the portable terminal 401 even if the match to the authentication password cannot be confirmed. It may be determined that it can be established. In this case, user authentication as described later may be prevented from being performed at this time.

  In the third embodiment, user authentication is performed when the character information based on the user's operation input converted as described above matches the preset authentication password for the user. Thereby, the user can perform user authentication simultaneously with the establishment of the connection. Even when the operation executed by establishing a connection requires user authentication, user authentication can be performed easily and reliably, and the user's labor can be considerably reduced.

  FIG. 18 is a first diagram illustrating an example of an operation performed when a connection establishment operation is being executed in the third embodiment. FIG. 19 is a second diagram illustrating an example of an operation performed when a connection establishment operation is being executed in the third embodiment.

  An example of a connection establishment operation according to the third embodiment will be described. As shown in FIG. 18, when the connection establishment operation is started, in step S510, the portable terminal 401 enters a connection waiting state. At this time, on the display unit 431 of the portable terminal 401, a display requesting input of a user name is performed together with a display indicating that the connection is waiting. The user inputs his / her user name in the user name input area (the input may be performed by an appropriate publicly known method), and an instruction for confirming the input of the user name (for example, displayed) ("OK" button operation).

  When the user name is input, a transmission file is specified in step S511. In step S512, the portable terminal 401 enters a standby state until the image forming apparatus 101 enters a connection waiting state.

  When it is detected that the transmission file is designated by the portable terminal 401 and the portable terminal 401 detects that the image forming apparatus 101 is in the connection waiting state, in step S513, the user is confirmed to prepare for operation input. Display is performed. Here, for example, an instruction to input an authentication password is displayed as an operation input.

  If “OK” is operated in step S513, the process proceeds to step S514.

  Moving to FIG. 19, in step S <b> 514, the mobile terminal 401 and the image forming apparatus 101 accept user operation input. The user performs the same operation on each of the portable terminal 401 and the operation panel 111 of the image forming apparatus 101.

  In a state where the portable terminal 401 and the operation panel 111 are arranged, the user inputs substantially the same content into both the input areas 135 and 435 of the connection screen substantially simultaneously. In the third embodiment, at this time, the user inputs an authentication password.

  Here, for example, a case is assumed where the handwritten input of the characters “abcd” is performed as the authentication password. At this time, the user performs handwritten input of the characters “abcd” 961 in the input area 135 with the thumb 901 of the hand 900. In addition, the user performs handwritten input of the characters “abcd” 962 in the input area 435 with the index finger 902.

  When the input is performed in this way, the connection determination unit 71 performs character recognition on the MFP operation information 73 and the terminal operation information 75 based on the input content. As a result of the character recognition, a character “abcd” is obtained from each of the MFP operation information 73 and the terminal operation information 75. The connection determination unit 71 determines whether or not this character matches both and whether or not it matches the authentication password to be input. It should be noted that as the authentication password, it may be determined whether or not it matches the password set in advance for the user to be authenticated input in step S510.

  When the character recognition results of the operation information 73 and 75 match each other and the authentication password also matches, the connection between the image forming apparatus 101 and the portable terminal 401 can be established, and at the same time, user authentication is performed. Done. By performing the user authentication, a predetermined range of execution authority is given to the authenticated user, and the user can execute a function corresponding thereto.

  [Fourth Embodiment]

  Since the basic configuration of the image forming system 501 in the fourth embodiment is the same as that in the first embodiment, description thereof will not be repeated here. In the fourth embodiment, for example, an MFP screen display function for displaying an operation screen for operating the image forming apparatus 101 is performed as a cooperative operation performed by establishing a connection between the image forming apparatus 101 and the portable terminal. Is called.

  In the fourth embodiment, when the MFP screen display function is performed, the same screen as the operation screen of the image forming apparatus 101 displayed on the operation panel 111 is displayed on the display panel of the portable terminal 401. The user can check the operation state of the image forming apparatus 101 by looking at the operation screen displayed on the mobile terminal 401 side. Similarly to the operation panel 111, the user performs an operation input on the mobile terminal 401 in accordance with an operation screen displayed on the mobile terminal 401, thereby operating the image forming apparatus 101. It can be carried out. When the user operates the mobile terminal 401, the operation information is sent to the image forming apparatus 101, and the image forming apparatus 101 operates accordingly.

  When the MFP screen display function is executed, if the connection between the image forming apparatus 101 and the portable terminal 401 is not established, first, a connection establishment operation for establishing this connection is performed. In the fourth embodiment, the connection establishment operation may be performed in the same manner as that in the first embodiment described above. When the connection is established, information regarding the operation screen is transmitted from the image forming apparatus 101 to the portable terminal 401, and the operation screen is displayed on the portable terminal 401 based on the information.

  FIG. 20 is a flowchart showing the operation of the image forming system 501 according to the fourth embodiment.

  FIG. 20 shows a part of processing at the time of execution of the connection establishment operation associated with the MFP screen display function. This processing is performed in the first embodiment (the portion shown in FIG. 10). ). Of the processes shown in FIG. 20, the processes in steps S631 to S634 are the same as the processes in steps S131 to S134 shown in FIG. Although not shown in the figure, in the fourth embodiment, the process of specifying a transmission file (step S112) as shown in FIG. 8 may not be performed.

  As shown in FIG. 20, when the connection between the image forming apparatus 101 and the portable terminal 401 is established (step S634), the CPU 21 detects the attitude of the portable terminal 401 in step S635. This process may be performed when it is determined that the operation information 73 and 75 match each other (for example, it may be performed immediately after YES in step S632).

  Here, for example, the orientation of the mobile terminal 401 relative to the operation panel 111 is detected based on the content of the operation input on the mobile terminal 401 side, that is, based on the terminal operation information 75. CPU21 performs the character recognition process about the terminal operation information 75, and recognizes the terminal operation information 75 as character information. Based on the result, the orientation of the portable terminal 401 with respect to the operation panel 111 is estimated. For example, the CPU 21 looks at the direction of the input character with respect to the display unit 431. The direction of the character is always consistent with the direction of the operation panel 111, and the direction of the display unit 431, that is, the orientation of the mobile terminal 401 is detected.

  Note that the posture of the mobile terminal 401 may be detected from the direction of the movement locus of the operation position without performing character recognition. Further, the mobile terminal 401 side performs character recognition or considers the movement trajectory, detects the attitude of the mobile terminal 401 itself, and sends the detection result to the image forming apparatus 101 side. The posture of the terminal 401 may be detected.

  In step S <b> 636, the CPU 21 transmits a communication completion report to the mobile terminal 401.

  In step S <b> 637, the CPU 21 corrects the orientation of the operation screen relative to the mobile terminal 401 with respect to the orientation result of the mobile terminal 401 for the screen data of the operation screen sent to the mobile terminal 401 after the connection is established.

  In step S <b> 638, the CPU 21 transmits screen data to the mobile terminal 401.

  In step S639, the portable terminal 401 receives the communication completion report sent from the image forming apparatus 101 in step S636.

  In step S640, the CPU 421 receives the screen data sent from the image forming apparatus 101 in step S638. The CPU 421 waits until reception of screen data is completed.

  When the reception of the screen data from the portable terminal 401 is completed in step S640, the CPU 421 performs screen display according to the received screen data in step S641.

  FIG. 21 is a diagram showing an operation flow when the orientation of the mobile terminal is in the vertical direction in the MFP screen display function.

  Hereinafter, the MFP screen display function will be described in the case where a tablet-type tablet terminal 601 is used as an example of the mobile terminal 401. Note that the tablet terminal 601 has a relatively large display unit 631, but the other parts have the same hardware configuration as the portable terminal 401. The display unit 631 of the tablet terminal 601 is configured to be vertically long with a long vertical direction and a short horizontal direction.

  As shown in FIG. 21, step S610 shows an example of the display unit 131 of the operation panel 111. An operation screen 940 for operating the image forming apparatus 101 is displayed on the display unit 131. The operation screen 940 is a horizontally long image that is long in the horizontal direction.

  When the MFP screen display function is started, first, a connection establishment operation between the image forming apparatus 101 and the tablet terminal 601 is performed. That is, in step S611, the input area 635 is displayed on the display unit 631 of the tablet terminal 601, and the input area 135 is displayed on the display unit 131 of the operation panel 111. And the tablet terminal 601 is arrange | positioned so that the operation panel 111 may be adjoined. In this example, it is assumed that the tablet terminal 601 is arranged above the operation panel 111 in a posture that is in the vertical direction with respect to the operation panel 111.

  When the tablet terminal 601 is arranged, an operation input is performed by the user. Here, “OK” characters 951 and 952 are input by handwriting into the input areas 135 and 635, respectively. The connection determining unit 71 determines that an operation input corresponding to both has been performed, and the connection between the image forming apparatus 101 and the tablet terminal 601 is established.

  When the connection is established, screen data related to the operation screen 940 is transmitted from the image forming apparatus 101 to the tablet terminal 601. Accordingly, in step S612, the tablet terminal 601 displays an operation screen 940a corresponding to the operation screen 940.

  At this time, the image forming apparatus 101 corrects the screen data of the operation screen 940 so that the direction corresponds to the orientation (vertical direction) of the tablet terminal 601, and sends the corrected screen data to the tablet terminal 601. Therefore, in the state where the tablet terminal 601 is in the vertical direction, the operation screen 940a is displayed such that the operation screen 940a is in the same landscape orientation as the operation screen 940.

  FIG. 22 is a diagram showing an operation flow when the orientation of the mobile terminal is in the horizontal direction in the MFP screen display function.

  As shown in FIG. 22, Step S620 shows an example of the display unit 131 of the operation panel 111. A horizontally long operation screen 940 is displayed on the display unit 131.

  Assume that when the MFP screen display function is started and the connection establishment operation between the image forming apparatus 101 and the tablet terminal 601 is performed, the tablet terminal 601 is arranged in a posture in a horizontal direction with respect to the operation panel 111. . That is, in step S621, the tablet terminal 601 is arranged in the horizontal direction (for example, the direction rotated 90 degrees counterclockwise with respect to the posture of the tablet terminal 601 in FIG. 21) so as to be adjacent to the operation panel 111. When the tablet terminal 601 is placed and it is determined that a corresponding operation input has been made by the user to both the operation panel 111 and the tablet terminal 601, the connection between the image forming apparatus 101 and the tablet terminal 601 is established.

  When the connection is established, screen data related to the operation screen 940 is transmitted from the image forming apparatus 101 to the tablet terminal 601. Thereby, in step S622, the operation screen 940b corresponding to the operation screen is displayed on the display unit 631.

  At this time, the image forming apparatus 101 corrects the screen data of the operation screen 940 so that the direction corresponds to the direction (lateral direction) of the tablet terminal 601, and sends the corrected screen data to the tablet terminal 601. Therefore, in the state where the tablet terminal 601 is in the horizontal direction, the operation screen 940b is displayed such that the operation screen 940b is in the same landscape orientation as the operation screen 940.

  As described above, in the fourth embodiment, the orientation of the mobile terminal 401 (tablet terminal 601) is grasped on the image forming apparatus 101 side, and subsequent cooperation processing is performed accordingly. Therefore, in the MFP screen display function, various excellent effects can be obtained such that the operation screens 940a and 940b can be appropriately displayed on the portable terminal 401. The orientation of the mobile terminal 401 can be detected even when a sensor for detecting the posture is not provided on the mobile terminal 401 side, or even if it is provided and cannot be used. Therefore, it is possible to display an image transmitted from the image forming apparatus 101 in an appropriate orientation, or to accept an input in an orientation corresponding to the display screen of the operation panel 111, thereby further enhancing the convenience of the image forming system 501. be able to.

  [Explanation of variants for the subject that performs connection determination processing]

  In each of the embodiments described above, the connection establishment process is performed using the connection determination unit 71 provided in the image forming apparatus 101, but is not limited thereto. For example, a connection determination unit may be provided on the mobile terminal side or on a server provided separately from the image forming apparatus and the mobile terminal, and the connection determination unit may perform the connection determination process.

  FIG. 23 is a block diagram showing a configuration of an image forming system according to another example of the present invention.

  As illustrated in FIG. 23, the image forming system 701 includes an image forming apparatus (an example of an information processing apparatus) 710 and a mobile terminal (an example of a portable mobile terminal) 720. In the image forming system 701, the mobile terminal 720 functions as a connection control device that determines whether or not the connection between the image forming apparatus 710 and the mobile terminal 720 can be established. That is, the image forming system 701 is different from the image forming system 501 in that connection determination processing and the like are performed on the mobile terminal 720 side.

  The mobile terminal 720 includes a connection determination unit 771 in addition to the units included in the mobile terminal 401 according to the above-described embodiment. The connection determination unit 771 has the same configuration as the connection determination unit 71 included in the image forming apparatus 101 according to the above-described embodiment. Connection determination unit 771 acquires and stores MFP operation information 73 and terminal operation information 75.

  The image forming apparatus 710 is different from the image forming apparatus 101 in that it includes a main body 711 that does not include the connection determination unit 71. Other configurations of the operation panel 111 and the like are the same as those of the image forming apparatus 101.

  In the image forming system 701, a connection establishment operation for establishing a connection between the image forming apparatus 710 and the portable terminal 720 is performed as follows. At this time, the operation performed by the user is the same as the operation performed when the connection establishment operation is performed in the image forming system 501.

  That is, when the connection establishment operation is performed, MFP operation information 73 related to the user operation performed on the image forming apparatus 710 is sent to the portable terminal 720. In the mobile terminal 720, terminal operation information 75 is obtained. The connection determination unit 771 acquires and records both pieces of operation information 73 and 75. When the operation ends, the connection determination unit 771 determines that the operation input to the image forming apparatus 710 corresponds to the operation input to the portable terminal 720. When the determination is made, a notification to that effect is sent to the image forming apparatus 710, for example, and the CPU 21 establishes a connection between the image forming apparatus 710 and the portable terminal 720. Alternatively, if it can be determined, the CPU 421 establishes a connection between the image forming apparatus 710 and the portable terminal 720. Once the connection is established, predetermined cooperative operations such as file transfer and MFP screen display function can be executed thereafter.

  FIG. 24 is a block diagram showing a configuration of an image forming system according to another example of another embodiment of the present invention.

  As illustrated in FIG. 24, the image forming system 801 includes an image forming apparatus 710, a mobile terminal 401, and a network server 850. Image forming apparatus 710, portable terminal 401, and network server 850 are connected to network 800. The network 800 is, for example, a LAN (Local Area Network).

  In the image forming system 801, for example, in order to perform a touch-and-print operation between the image forming apparatus 710 and the portable terminal 401, a communication protocol (for example, Bluetooth) that is different from the communication protocol for connecting each to the network 800 is used. (Registered trademark, etc.) and the two need to be connected so as to be capable of wireless communication. At this time, a connection establishment operation is performed.

  In the image forming system 801, the network server 850 functions as a connection control device that determines whether a connection between the image forming device 710 and the portable terminal 401 can be established. That is, the image forming system 801 is different from the image forming system 501 in that connection determination processing and the like are performed by the network server 850.

  The image forming apparatus 710 is configured in the same manner as that included in the image forming system 701. The mobile terminal 401 is configured in the same manner as that included in the image forming system 501.

  The network server 850 includes a storage unit 827, a communication control unit 851, and a connection determination unit 871.

  The storage unit 827 is, for example, an HDD. The storage unit 827 stores a control program 827a executed by, for example, a CPU (not shown).

  The communication control unit 851 is a communication interface for connecting to the network 800. The network server 850 is communicably connected to each of the image forming apparatus 710 and the portable terminal 401 via the communication control unit 851.

  The connection determination unit 871 has the same configuration as the connection determination unit 71 included in the image forming apparatus 101 according to the above-described embodiment. The connection determination unit 871 stores MFP operation information 73 and terminal operation information 75.

  In the image forming system 801, a connection establishment operation for establishing a connection between the image forming apparatus 710 and the portable terminal 401 is performed as follows. At this time, the operation performed by the user is the same as the operation performed when the connection establishment operation is performed in the image forming system 501.

  That is, when a connection establishment operation is performed, MFP operation information 73 relating to a user operation performed on the image forming apparatus 710 is sent to the network server 850. In addition, terminal operation information 75 regarding user operations performed on the mobile terminal 401 is also sent to the network server 850. In the network server 850, the connection determination unit 871 acquires and records these pieces of operation information 73 and 75.

  When the operation ends, the connection determination unit 871 determines that the operation input to the image forming apparatus 710 corresponds to the operation input to the portable terminal 401. If it can be determined, a notification to that effect is sent to at least one of the image forming apparatus 710 and the portable terminal 401. Thereby, the connection between the image forming apparatus 710 and the portable terminal 401 can be established. That is, the connection determination unit 871 of the network server 850 establishes a connection between the image forming apparatus 710 and the portable terminal 401.

  [Others]

  The image forming system may be realized by appropriately combining a part of the characteristic portions of the above-described embodiments.

  The operation panel may be integrally attached to the main body of the image forming apparatus.

  The image forming apparatus and the mobile terminal may be provided with a position information detection unit. The mobile terminal may be able to acquire the position information by, for example, a satellite-based positioning system (GPS). At this time, it may be determined whether the connection can be established in view of the position information of the portable terminal and the position information obtained by setting in advance by GPS or another method in the image forming apparatus. . For example, the position of the mobile terminal and the position of the image forming apparatus are separated from each other even if the user's operation input performed on each of the image forming apparatus and the mobile terminal corresponds as described above. In the event that is detected, the connection may not be established. Thereby, it is possible to reliably prevent devices that should not be connected from each other from being accidentally connected by mistake.

  When the connection between the image forming apparatus and the portable terminal is established, the CPU of the image forming apparatus or the CPU of the portable terminal determines the user who performed the operation input and automatically performs a specific function corresponding to the determined user. It may be called and executed. In this case, a function to be called is associated with each user in advance. For example, when the user authentication is performed, the user can be determined by the user authentication. Further, even when user authentication is not performed, the user may be determined simply by determining, for example, a user name recorded on the mobile terminal. For example, transmission destination information corresponding to each user is registered in the image forming apparatus in advance, and when a connection establishment operation is performed by the user, the specified information is automatically added to the transmission destination information corresponding to the user. Various functions such as transmission can be executed.

  At least one of the MFP operation information of the image forming apparatus and the terminal operation information of the mobile terminal may be once sent to an external server, for example. At this time, the connection determination unit may acquire the information via the server. Thereby, it is possible to determine whether or not the connection can be established without accessing the device that is the connection establishment target before the connection is established.

  The image forming apparatus may be a monochrome / color copying machine, a printer, a facsimile machine, or a multifunction machine (MFP) thereof.

  The portable mobile terminal is not limited to a smartphone, and may be any other mobile phone or portable computer.

  The connection control device according to the present invention is also applicable to an image reading device (an example of an information processing device) that does not have an image forming unit, an image forming device that does not have a document reading unit, and the like. In addition to these, the connection control device establishes a connection between various information processing devices and portable mobile terminals, and includes devices included in a wireless communication system including these information control devices and portable mobile terminals. Widely applicable.

  The processing in the above embodiment may be performed by software or by using a hardware circuit.

  A program for executing the processing in the above-described embodiment can be provided, or the program can be recorded on a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provided to the user. It may be. The program may be downloaded to the apparatus via a communication line such as the Internet. The processing described in the text in the above flowchart is executed by the CPU according to the program.

  The above embodiment should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

11,711 Image forming apparatus main body 21 CPU
23 storage unit 23a control program 51 communication unit 71, 771, 871 connection determination unit 73 MFP operation information (an example of first operation information)
75 Terminal operation information (an example of second operation information)
81 Authentication management unit 101,710 Image forming apparatus (an example of information processing apparatus)
111 Operation Panel 131 Display Unit (Example of Touch Panel)
133 Operation position detection unit 121 Screen control unit 151 Communication unit 401, 720 Mobile terminal (an example of a mobile mobile terminal)
421 CPU
423 Storage unit 423a Control program 431 Display unit (an example of a touch panel)
433 Operation position detection unit 441 Screen control unit 451 Communication unit 501, 701, 801 Image forming system 601 Tablet terminal (an example of a portable mobile terminal)
800 network 850 network server

Claims (23)

A connection control device that establishes a wireless connection between the information processing device and the portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal,
First acquisition means for acquiring first operation information relating to a position where an operation input by a user is performed on the touch panel of the information processing apparatus;
Second acquisition means for acquiring second operation information related to a position where an operation input by a user is performed on the touch panel of the portable mobile terminal;
Based on the first operation information acquired by the first acquisition unit and the second operation information acquired by the second acquisition unit, an operation input by the user to the information processing apparatus and the portable Determining means for determining whether or not the operation input to the mobile terminal corresponds to each other;
Connection means for establishing a wireless connection between the information processing apparatus and the portable mobile terminal according to the determination result of the determination means;
The first operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the information processing apparatus is performed at a certain period,
The second operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the portable mobile terminal is performed at a certain period,
At least one of the first acquisition unit and the second acquisition unit is configured so that the information processing apparatus and the portable movement are in a state where a wireless connection between the information processing apparatus and the portable mobile terminal is not established. A connection control device that acquires the first operation information or the second operation information by wireless communication with at least one of the terminals. A connection control device that establishes a wireless connection between the information processing device and the portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal,
First acquisition means for acquiring first operation information relating to a position where an operation input by a user is performed on the touch panel of the information processing apparatus;
Second acquisition means for acquiring second operation information related to a position where an operation input by a user is performed on the touch panel of the portable mobile terminal;
Based on the first operation information acquired by the first acquisition unit and the second operation information acquired by the second acquisition unit, an operation input by the user to the information processing apparatus and the portable Determining means for determining whether or not the operation input to the mobile terminal corresponds to each other;
Connection means for establishing a wireless connection between the information processing apparatus and the portable mobile terminal according to a determination result of the determination means;
Attitude detection means for detecting the attitude of the portable mobile terminal based on at least the second operation information;
Change means for changing processing to be performed when the wireless connection is established by the connection means according to the attitude of the portable mobile terminal detected by the attitude detection means ;
At least one of the first acquisition unit and the second acquisition unit is configured so that the information processing apparatus and the portable movement are in a state where a wireless connection between the information processing apparatus and the portable mobile terminal is not established. A connection control device that acquires the first operation information or the second operation information by wireless communication with at least one of the terminals . The connection control apparatus according to claim 2 , wherein the attitude detection unit detects an attitude of the portable mobile terminal based on a result of recognizing the second operation information as character information. The first operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the information processing apparatus is performed at a certain period,
Wherein the second operation information includes movement trajectory information obtained by sampling the information on the position where the input operation is performed by the user on the touch panel of the portable mobile terminal at a constant cycle, claim 2 Or the connection control apparatus of 3 . Third information for obtaining information on a first time when an operation input is performed by a user on the touch panel of the information processing apparatus and information on a second time when an operation input is performed by the user on the touch panel of the portable mobile terminal. Further comprising an acquisition means,
It said determining means, said first operation information and second operation information, the third on the basis of the acquired information by the acquiring unit, performs the judgment, to any one of claims 1 to 4 The connection control device described. The determination means includes an operation input to the information processing apparatus by a user and an operation input to the portable mobile terminal on condition that at least a time difference between the first time and the second time is within a predetermined time. The connection control device according to claim 5 , wherein the connection control devices determine that they correspond to each other. A fourth acquisition means for acquiring information relating to the resolution of each touch panel of the information processing apparatus and the portable mobile terminal;
The determining means, based on the fourth information acquired by the acquisition means, comparing the first operation information and the second operation information, performs the judgment, any of claims 1 to 6 A connection control device according to claim 1. Further comprising character recognition means for recognizing each of the first operation information and the second operation information as character information based on each of the first operation information and the second operation information,
The determination means performs the determination according to whether character information corresponding to the first operation information recognized by the character recognition means matches character information corresponding to the second operation information. performed, the connection control apparatus according to any one of claims 1 to 7. The determination means is configured such that character information corresponding to the first operation information and character information corresponding to the second operation information recognized by the character recognition means and an authentication password for the user set in advance are mutually connected. The connection control apparatus according to claim 8 , wherein the determination is performed according to whether or not they match. Whether or not the character information corresponding to the first operation information and the character information corresponding to the second operation information recognized by the character recognition unit and the preset authentication password for the user match. depending on, further comprising authentication means for authenticating the user, the connection control device according to claim 8 or 9.   When a wireless connection between the information processing apparatus and the portable mobile terminal is established by the connection means, execution to execute a preset cooperative operation in at least one of the information processing apparatus and the portable mobile terminal The connection control apparatus according to claim 1, further comprising means.   When a wireless connection between the information processing apparatus and the portable mobile terminal is established by the connection means, at least one of the information processing apparatus and the portable mobile terminal is prohibited to execute before connection establishment. The connection control apparatus according to claim 1, further comprising permission means for permitting execution of the function that has been performed. The first operation information relates to a barycentric position of an area touched by a user on the touch panel of the information processing apparatus,
The connection control device according to any one of claims 1 to 12, wherein the second operation information relates to a center of gravity position of an area touched by a user on a touch panel of the portable mobile terminal.   14. The device according to claim 1, wherein at least one of the first acquisition unit and the second acquisition unit acquires the first operation information or the second operation information via an external server. The connection control device described in 1. The connection control device according to any one of claims 1 to 14,
An information processing apparatus comprising: a communication unit configured to perform wireless communication with the portable mobile terminal when wireless connection with the portable mobile terminal is established by the connection unit. An image forming apparatus comprising: the information processing apparatus according to claim 15; and an image forming unit that forms an image on a sheet. The connection control device according to any one of claims 1 to 14,
A portable mobile terminal comprising: a communication unit that performs wireless communication with the information processing device when wireless connection with the information processing device is established by the connection unit. An information processing device and a portable mobile terminal;
Either one of the information processing device and the portable mobile terminal includes the connection control device according to any one of claims 1 to 14,
The information processing system, wherein the connection means establishes a wireless connection between the information processing apparatus and the portable mobile terminal. An information processing device, a portable mobile terminal, and a server capable of communicating with each of the information processing device and the portable mobile terminal,
The server includes the connection control device according to any one of claims 1 to 14,
The information processing system, wherein the connection means establishes a wireless connection between the information processing apparatus and the portable mobile terminal. A control method of a connection control device for establishing a wireless connection between the information processing device and the portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal,
A first acquisition step of acquiring first operation information on a position where an operation input by a user is performed on the touch panel of the information processing apparatus;
A second acquisition step of acquiring second operation information related to a position where an operation input by a user is performed on the touch panel of the portable mobile terminal;
Based on the first operation information acquired in the first acquisition step and the second operation information acquired in the second acquisition step, an operation input by the user to the information processing apparatus and the portable A determination step of determining whether or not the operation input to the mobile terminal corresponds to each other;
A connection step for establishing a wireless connection between the information processing apparatus and the portable mobile terminal according to the determination result of the determination step;
The first operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the information processing apparatus is performed at a certain period,
The second operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the portable mobile terminal is performed at a certain period,
At least one of the first acquisition step and the second acquisition step is performed when the wireless connection between the information processing device and the portable mobile terminal is not established. A control method for a connection control apparatus, wherein the first operation information or the second operation information is acquired by wireless communication with at least one of terminals.   A control method of a connection control device for establishing a wireless connection between the information processing device and the portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal,
  A first acquisition step of acquiring first operation information on a position where an operation input by a user is performed on the touch panel of the information processing apparatus;
  A second acquisition step of acquiring second operation information related to a position where an operation input by a user is performed on the touch panel of the portable mobile terminal;
  Based on the first operation information acquired in the first acquisition step and the second operation information acquired in the second acquisition step, an operation input by the user to the information processing apparatus and the portable A determination step of determining whether or not the operation input to the mobile terminal corresponds to each other;
  A connection step for establishing a wireless connection between the information processing apparatus and the portable mobile terminal according to a determination result of the determination step;
  An attitude detection step for detecting an attitude of the portable mobile terminal based on at least the second operation information;
  A change step for changing processing to be performed when the wireless connection is established by the connection step according to the posture of the portable mobile terminal detected by the posture detection step;
  At least one of the first acquisition step and the second acquisition step is performed when the wireless connection between the information processing device and the portable mobile terminal is not established. A control method for a connection control apparatus, wherein the first operation information or the second operation information is acquired by wireless communication with at least one of terminals. A control program for a connection control device for establishing a wireless connection between the information processing device and the portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal,
A first acquisition step of acquiring first operation information on a position where an operation input by a user is performed on the touch panel of the information processing apparatus;
A second acquisition step of acquiring second operation information related to a position where an operation input by a user is performed on the touch panel of the portable mobile terminal;
Based on the first operation information acquired in the first acquisition step and the second operation information acquired in the second acquisition step, an operation input by the user to the information processing apparatus and the portable A determination step of determining whether or not the operation input to the mobile terminal corresponds to each other;
According to the determination result of the determination step, causing the computer to execute a connection step of establishing a wireless connection between the information processing apparatus and the portable mobile terminal,
The first operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the information processing apparatus is performed at a certain period,
The second operation information includes movement trajectory information obtained by sampling information on a position where an operation input by a user on the touch panel of the portable mobile terminal is performed at a certain period,
At least one of the first acquisition step and the second acquisition step is performed when the wireless connection between the information processing device and the portable mobile terminal is not established. A control program for a connection control device, which acquires the first operation information or the second operation information by wireless communication with at least one of terminals.   A control program for a connection control device for establishing a wireless connection between the information processing device and the portable mobile terminal by performing wireless communication with at least one of the information processing device and the portable mobile terminal,
  A first acquisition step of acquiring first operation information on a position where an operation input by a user is performed on the touch panel of the information processing apparatus;
  A second acquisition step of acquiring second operation information related to a position where an operation input by a user is performed on the touch panel of the portable mobile terminal;
  Based on the first operation information acquired in the first acquisition step and the second operation information acquired in the second acquisition step, an operation input by the user to the information processing apparatus and the portable A determination step of determining whether or not the operation input to the mobile terminal corresponds to each other;
  A connection step for establishing a wireless connection between the information processing apparatus and the portable mobile terminal according to a determination result of the determination step;
  An attitude detection step for detecting an attitude of the portable mobile terminal based on at least the second operation information;
  According to the attitude of the portable mobile terminal detected by the attitude detection step, causing the computer to execute a change step for changing processing performed when the wireless connection is established by the connection step,
  At least one of the first acquisition step and the second acquisition step is performed when the wireless connection between the information processing device and the portable mobile terminal is not established. A control program for a connection control device, which acquires the first operation information or the second operation information by wireless communication with at least one of terminals.

Images