JP2017016529A - Information processing device and information transmission device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the convenience of apparatus operation by a user who cannot operate a capacitive touch panel used as the operation unit of various apparatuses.SOLUTION: An information processing device for executing a process corresponding to a position instructed on an operation screen includes: a screen size acquisition unit that acquires a screen size displayed on a display unit of another device capable of communicating with the information processing device; a positional information conversion unit that converts positional information instructed on a screen displayed on the display unit of the other device on the basis of a ratio of the acquired screen size to the size of the operation screen; and an operation control unit that controls operation to the information processing device corresponding to the position on the operation screen indicated by the positional information after conversion.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an information processing apparatus and an information transmission apparatus.

  In recent years, touch panels have been used for operation units of various devices. There are various operation methods for the touch panel, but the capacitance method is often adopted because the required performance such as reaction speed and resolution is realized in a balanced manner. A capacitive touch panel reacts to a human body such as a fingertip, but does not react to a finger with a plastic touch pen or gloves. Therefore, a user who operates an apparatus using a person other than a human body such as a prosthetic hand cannot operate using a capacitive touch panel.

  For the purpose of remotely operating such a touch panel, it has been proposed to perform remote operation by operating the position corresponding to the operation screen visible from the dedicated remote control that can be viewed from the operation screen of the device touch panel with the dedicated remote control. (For example, refer to Patent Document 1).

  When the resistive film method is adopted for the touch panel of the specialized remote controller disclosed in Patent Document 1, even the user who operates the device using a device other than the human body can remotely control the device touch panel. However, since the dedicated remote controller disclosed in Patent Document 1 is required for each device, it is not convenient.

  The present invention has been made to solve such problems, and aims to improve the convenience of device operation by a user who cannot operate a capacitive touch panel that is an operation unit of various devices. To do.

  In order to solve the above-described problem, an aspect of the present invention is an information processing device that executes processing according to a position designated on an operation screen, and is a display unit of another device that can communicate with the information processing device The screen size acquisition unit that acquires the screen size displayed on the screen and the screen displayed on the display unit of the other device based on the ratio between the acquired screen size and the size of the operation screen It includes a position information conversion unit that converts position information, and an operation control unit that controls an operation on the information processing apparatus according to the position on the operation screen indicated by the converted position information.

  ADVANTAGE OF THE INVENTION According to this invention, the convenience of the apparatus operation by the user who cannot operate the capacitive touch panel which is an operation part of various apparatuses can be improved.

It is a figure which illustrates the operation | use form of the information processing system which concerns on embodiment of this invention. 1 is a block diagram illustrating a hardware configuration of an image processing apparatus according to an embodiment of the present invention. 1 is a block diagram illustrating a functional configuration of an image processing apparatus according to an embodiment of the present invention. It is a block diagram which illustrates the functional composition of the main control part concerning the embodiment of the present invention. It is a figure which illustrates the content of the user information stored in the user information storage part which concerns on embodiment of this invention. It is a flowchart which illustrates the operation | movement of the operation control by the main control part which concerns on embodiment of this invention. It is a figure which illustrates the conversion mode of the positional information which concerns on embodiment of this invention. It is a block diagram which illustrates the functional structure of the client terminal which concerns on embodiment of this invention. It is a block diagram which illustrates the functional composition of the client application concerning the embodiment of the present invention. It is a block diagram which illustrates the functional composition of the main control part concerning the embodiment of the present invention. It is a figure which illustrates the display part of the client terminal which concerns on embodiment of this invention. It is a figure which illustrates the display panel of the image processing apparatus which concerns on embodiment of this invention. It is a figure which illustrates the display panel of the image processing apparatus which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, a system in which an information processing apparatus is operated by a client terminal used by a user who is authenticated by an IC (Integrated Circuit) card or the like will be described as an example. The information processing apparatus according to the present embodiment executes processing according to the position designated on the operation screen. In such a system, an information processing apparatus that employs a capacitive touch panel as an operation unit is operated using a client terminal used by a prosthetic user who cannot operate the capacitive touch panel. This is one of the features according to the present embodiment. In this embodiment, an image processing apparatus configured as an MFP (Multi Function Peripheral) will be described as an example of an information processing apparatus.

  FIG. 1 is a diagram illustrating an operation mode of the information processing system according to the present embodiment. As shown in FIG. 1, the information processing system according to the present embodiment is configured by connecting an image processing apparatus 1 and a client terminal 2 through a network so that they can communicate with each other. Further, when the image processing apparatus 1 and the client terminal 2 are connected for communication, user authentication using the IC card 3 is performed.

  The image processing apparatus 1 is an MFP (Multi Function Peripheral) that can be used as a printer, a facsimile, a scanner, and a copying machine by including an imaging function, an imaging function, an image forming function, a communication function, and the like. In addition, the image processing apparatus 1 performs user authentication by reading information on the IC card 3 by near field communication (NFC).

  The client terminal 2 is another device that is controlled independently of the information processing device, and is a portable information processing terminal that employs a touch panel such as a tablet terminal as an operation unit. The client terminal 2 is an information transmission device that is communicably connected to an information processing device such as the image processing device 1 and transmits information.

  In the client terminal 2 according to the present embodiment, a resistive touch panel that can be used by a user who cannot operate a capacitive touch panel, such as a user of an artificial hand, is employed as an operation unit. In addition, the client terminal 2 according to the present embodiment performs processing in cooperation with the image processing apparatus 1 by installing an application program provided by a manufacturer or a third party that provides the image processing apparatus 1. Functions as a device.

  Next, the hardware configuration of the image processing apparatus 1 and the client terminal 2 according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a hardware configuration of the image processing apparatus 1 according to this embodiment. FIG. 2 shows the hardware configuration of the image processing apparatus 1, but the same applies to the client terminal 2. As shown in FIG. 2, the image processing apparatus 1 according to the present embodiment includes the same configuration as a general server, a PC (Personal Computer), or the like.

  That is, the image processing apparatus 1 according to this embodiment includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, an HDD (Hard Disk Drive) 40, and an I / F 50. 80 is connected through 80. Further, an LCD (Liquid Crystal Display) 60 and an operation unit 70 are connected to the I / F 50. In addition, the image processing apparatus 1 includes a dedicated device that executes image formation output and scanning.

  The CPU 10 is a calculation unit and controls the operation of the entire image processing apparatus 1. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The HDD 40 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like. In addition to the HDD, a semiconductor storage device such as an SSD (Solid State Drive) may be used.

  The I / F 50 connects and controls the bus 80 and various hardware and networks. The LCD 60 is a visual user interface for the user to check the state of the image processing apparatus 1. The operation unit 70 is a user interface for a user to input information to the image processing apparatus 1 such as a keyboard, a mouse, various hard buttons, and a touch panel.

  In such a hardware configuration, a program stored in a storage medium such as the ROM 30, the HDD 40, or an optical disk (not shown) is read into the RAM 20, and the software control unit is configured by the CPU 10 performing calculations according to those programs. . A functional block that realizes the functions of the image processing apparatus 1 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

  Next, functions of the image processing apparatus 1 according to the present embodiment will be described. FIG. 3 is a block diagram illustrating a functional configuration of the image processing apparatus 1 according to this embodiment. As shown in FIG. 3, the image processing apparatus 1 according to the present embodiment includes a controller 100, an ADF (Auto Document Feeder) 110, a scanner unit 111, a paper discharge tray 112, a display panel 113, and a paper feed table. 114, a print engine 115, a paper discharge tray 116, and a network I / F 117.

  The controller 100 includes a main control unit 130, an engine control unit 101, a communication control unit 102, an image processing unit 103, and an operation display control unit 104. As shown in FIG. 3, the image processing apparatus 1 according to the present embodiment is configured as a multifunction machine having a scanner unit 111 and a print engine 115. In FIG. 3, the electrical connection is indicated by solid arrows, and the flow of paper is indicated by broken arrows.

  The display panel 113 is an output interface that visually displays the state of the image processing apparatus 1, and an input when the user directly operates the image processing apparatus 1 or inputs information to the image processing apparatus 1 as a touch panel. It is also an interface (operation unit).

  The network I / F 117 is an interface for the image processing apparatus 1 to communicate with other devices via the network, and an interface such as Ethernet (registered trademark) is used. The near field communication I / F 118 is an interface for the image processing apparatus 1 to communicate with other devices by near field wireless communication. For the short-range communication I / F 118, for example, an interface such as Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity), or FeliCa (registered trademark) is used. The network I / F 117 and the short-range communication I / F 118 are realized by the I / F 50 shown in FIG.

  The controller 100 is configured by a combination of software and hardware. Specifically, a control program such as firmware or an image processing program stored in a nonvolatile storage medium such as the ROM 30 or the HDD 40 is loaded into the RAM 20. And the controller 100 is comprised by hardware, such as a software control part comprised by CPU10 calculating according to those programs, and an integrated circuit. The controller 100 functions as a control unit that controls the entire image processing apparatus 1.

  The main control unit 130 plays a role of controlling each unit included in the controller 100 and gives a command to each unit of the controller 100. Further, the main control unit 130 according to the present embodiment includes an operation control function for realizing an operation on the image processing apparatus 1 by the client terminal 2. Details of the operation control function by the main control unit 130 will be described later.

  The engine control unit 101 serves as a driving unit that controls or drives the print engine 115, the scanner unit 111, and the like. The communication control unit 102 inputs a signal or a command input from an information processing device or the like connected to the image processing apparatus 1 via the network I / F 117 to the main control unit 130. Further, the main control unit 130 controls the communication control unit 102 and accesses other devices via the network I / F 117 and the short-range communication I / F 118.

  The image processing unit 103 generates drawing information based on image information to be imaged and output under the control of the main control unit 130. The drawing information is information for drawing an image to be formed in the image forming operation by the print engine 115 as an image forming unit. The image processing unit 103 processes image data input from the scanner unit 111 and generates image data. The image data is information stored in the image processing apparatus 1 as a result of the scanner operation or transmitted to another device via the network I / F 117. The operation display control unit 104 displays information on the display panel 113 or notifies the main control unit 130 of information input via the display panel 113.

  In the case of an image processing apparatus having only a printer function, the ADF 110, the scanner unit 111, and the paper discharge tray 112 shown in FIG. 2 are omitted. At the same time, functions for controlling the ADF 110, the scanner unit 111, and the paper discharge tray 112 are omitted from the functions of the engine control unit 101.

  When the image processing apparatus 1 operates as a printer, first, the communication control unit 102 receives a print job from the client terminal 2 or the like via the network I / F 117. The communication control unit 102 transfers the received print job to the main control unit 130. When receiving the print job, the main control unit 130 controls the image processing unit 103 to generate drawing information based on document information or image information included in the print job.

  When drawing information is generated by the image processing unit 103, the engine control unit 101 executes image formation on a sheet that is a recording medium conveyed from the paper feed table 114 based on the generated drawing information. As the recording medium, in addition to the above-described paper, a sheet-like material such as a film or plastic can be used as long as it is an object for image formation output. As a specific mode of the print engine 115, an image forming mechanism using an ink jet method, an image forming mechanism using an electrophotographic method, or the like can be used. A document on which an image is formed by the print engine 115 is discharged to a discharge tray 116.

  When the image processing apparatus 1 operates as a scanner, the operation display control unit 104 or the communication control unit 102 transfers a scan execution signal to the main control unit 130 in accordance with a scan execution instruction. The scan execution instruction is input from an external device via an operation of the display panel 113 by the user or the network I / F 117. The main control unit 130 controls the engine control unit 101 based on the received scan execution signal.

  The engine control unit 101 drives the ADF 110 and conveys the document to be imaged set on the ADF 110 to the scanner unit 111. Further, the engine control unit 101 drives the scanner unit 111 and images a document conveyed from the ADF 110. If no original is set on the ADF 110 and the original is directly set on the scanner unit 111, the scanner unit 111 captures the set original under the control of the engine control unit 101. That is, the scanner unit 111 operates as an imaging unit.

  In the imaging operation, an imaging element such as a CCD included in the scanner unit 111 optically scans the document, and imaging information based on the optical information is generated. The engine control unit 101 transfers the imaging information generated by the scanner unit 111 to the image processing unit 103.

  The image processing unit 103 generates image information based on the imaging information received from the engine control unit 101 under the control of the main control unit 130. Image information generated by the image processing unit 103 is stored in a storage medium attached to the image processing apparatus 1 such as the HDD 40. The image information generated by the image processing unit 103 is stored in the HDD 40 or the like as it is according to a user instruction, or is transmitted to an external device such as the client terminal 2 by the communication control unit 102 via the network I / F 117. .

  Further, when the image processing apparatus 1 operates as a copying machine, the image processing unit 103 generates drawing information based on imaging information received from the scanner unit 111 by the engine control unit 101 or image information generated by the image processing unit 103. To do. Based on the drawing information, the engine control unit 101 drives the print engine 115 as in the case of the printer operation.

  Next, among the functions of the main control unit 130 according to the present embodiment, functions for realizing the operation of the image processing apparatus 1 by the client terminal 2 described above will be described. FIG. 4 is a block diagram illustrating a functional configuration of the main control unit 130 according to the present embodiment. FIG. 6 is a flowchart illustrating the operation control operation by the main control unit 130 according to this embodiment. As shown in FIG. 4, the main control unit 130 according to the present embodiment includes an authentication processing unit 131, a user information storage unit 132, a connection determination unit 133, a connection processing unit 134, a screen size acquisition unit 135, and a position information conversion unit 136. And an operation control unit 137. Hereinafter, the operation of the operation control by the main control unit 130 according to the present embodiment will be described with reference to FIG.

  In the main control unit 130 according to the present embodiment, as shown in FIG. 6, first, the authentication processing unit 131 stores the information on the IC card 3 read via the short-range communication I / F 118 and the user information storage unit 132. User authentication processing is performed based on the stored user information (S601). FIG. 5 is a diagram illustrating the content of user information stored in the user information storage unit 132.

  As shown in FIG. 5, the user information is user information that is predetermined information of the user (user), and includes information such as “user ID”, “necessity of remote operation”, “registered terminal ID”, and the like. including. “User ID” is an identifier for identifying a user. “Necessity of remote operation” is information indicating whether or not the operation of the image processing apparatus 1 by the client terminal 2 is required. For example, if the user is a prosthetic user and cannot operate a touch panel that employs a capacitance method, “remote operation necessity” indicates that the operation of the image processing apparatus 1 by the client terminal 2 is required. “Registered terminal ID” is an identifier for identifying the client terminal 2 that has been registered for pairing for communication with the image processing apparatus 1 by Bluetooth or the like.

  Specifically, in the processing of S601, the authentication processing unit 131, for example, does the user ID included in the information of the IC card 3 match the “user ID” of the user information stored in the user information storage unit 132? An authentication process is performed to determine whether or not. The authentication processing unit 131 determines that the authentication is successful when the two user IDs match. Then, the authentication processing unit 131 outputs the authentication processing result to the connection determination unit 133.

  The connection determination unit 133 to which the authentication process result is input determines whether the authentication process result indicates successful authentication (S602). When the authentication processing result indicates successful authentication (S602 / YES), the connection determination unit 133 determines whether or not the client terminal 2 is required to be connected (S603). Specifically, for example, the connection determination unit 133 determines that the remote control of the image processing apparatus 1 by the client terminal 2 is based on whether or not the user information of the user whose authentication is successful stored in the user information storage unit 132 is “remote operation necessity”. It is determined whether or not it indicates that it is necessary. If remote operation is required, the connection determination unit 133 determines that connection of the client terminal 2 is necessary.

  When the determination result indicates that the client terminal 2 needs to be connected (S604 / YES), the connection processing unit 134 performs a connection process with the client terminal 2 based on the notification from the connection determination unit 133 (S605). Specifically, the connection processing unit 134 determines whether or not the client terminal 2 identified by the “registered terminal ID” of the user information of the user who has been successfully authenticated and stored in the user information storage unit 132 exists in the communicable range. Search for. When the connection processing unit 134 detects the client terminal 2 identified by the “registered terminal ID”, the connection processing unit 134 establishes a communication connection by Bluetooth or the like with the detected client terminal 2.

  When the connection processing unit 134 does not detect the client terminal 2 identified by the “registered terminal ID”, the connection processing unit 134 indicates that the client terminal 2 is not detected on the display panel 113 via the operation display control unit 104. Display a confirmation screen. When the user who refers to the confirmation screen makes the client terminal 2 detectable, the connection processing unit 134 performs a connection process with the detected client terminal 2.

  When the user information does not include “registered terminal ID”, the connection processing unit 134 needs to perform pairing registration of the client terminal 2 on the display panel 113 in order to perform remote operation of the image processing apparatus 1. A confirmation screen indicating the above is displayed. When the user who refers to the confirmation screen performs pairing registration of the client terminal 2, the connection processing unit 134 adds an identifier for identifying the client terminal 2 as the “registered terminal ID” of the user information. Then, the connection processing unit 134 performs a connection process with the client terminal 2 registered for pairing.

  On the other hand, when the authentication processing result indicates authentication failure (S602 / NO) or the determination result indicates that connection of the client terminal 2 is not required (S604 / NO), the main control unit 130 performs the following processing. The process ends without

  When the connection processing by the connection processing unit 134 is performed, the screen size acquisition unit 135 acquires the screen size displayed on the display unit such as the LCD 60 of the connected client terminal 2 (S606), and the position information conversion unit 136. Output for. The position information conversion unit 136, to which the screen size is input from the screen size acquisition unit 135, acquires the position information designated by the user on the display unit such as the LCD 60 of the client terminal 2 (S607).

  The position information conversion unit 136 that has acquired the position information converts the acquired position information based on the screen size displayed on the display panel 113 of the image processing apparatus 1 and the screen size acquired in the process of S606 (S608), Output to the operation control unit 137. 7 is a diagram illustrating a conversion mode of position information, FIG. 7A is a display unit of the client terminal 2, and FIG. 7B is a display panel 113 (display unit) of the image processing apparatus 1. ).

  When the screen is displayed on the entire surface of each display unit illustrated in FIG. 7, the screen size is the size of the display unit. That is, for example, as shown in FIG. 7A, the screen size displayed on the display unit of the client terminal 2 is vertical “a1” and horizontal “b1”, and as shown in FIG. The screen size displayed on the display unit of the image processing apparatus 1 is vertical “a2” and horizontal “b2”. In this case, the screen size acquisition unit 135 acquires vertical “a1” and horizontal “b1” values from the client terminal 2 as the screen size.

  Assume that the user indicates the position of the circles hatched with diagonal lines shown in FIG. The position information conversion unit 136 acquires the coordinates (for example, (x, y)) of the instructed position as position information. Then, the position information conversion unit 136 displays the acquired position information on the display unit of the image processing device 1 based on the ratio to the screen size displayed on each of the client terminal 2 and the display unit of the image processing device 1. Convert to position information on the screen. That is, the converted position information is (x * b2 / b1, y * a2 / a1) as shown in FIG. 7B.

  The operation control unit 137 to which the converted position information is input from the position information conversion unit 136 regards the position indicated by the input converted position information on the operation screen displayed on the display panel 113 as being pressed. The operation is controlled (S609). For example, when there is a button for starting the copy application at the position indicated by the converted position information on the operation screen, the operation control unit 137 controls the start of the copy application.

  Next, functions of the client terminal 2 according to the present embodiment will be described. FIG. 8 is a block diagram illustrating a functional configuration of the client terminal 2 according to this embodiment. As shown in FIG. 8, the client terminal 2 according to the present embodiment includes a controller 200, a network I / F 210, and a near field communication I / F 211 in addition to the LCD 60 and the operation unit 70 described in FIG. The controller 200 includes a communication control unit 201, an operation control unit 202, a display control unit 203, and a client application 230.

  The network I / F 210 is an interface for the client terminal 2 to communicate with other devices via the network, and an interface such as Ethernet (registered trademark) is used. The near field communication I / F 211 is an interface for the client terminal 2 to communicate with other devices by near field wireless communication. For the short-range communication I / F 211, for example, an interface such as Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity), or FeliCa (registered trademark) is used. The network I / F 210 and the near field communication I / F 211 are realized by the I / F 50 shown in FIG.

  The controller 200 is configured by a combination of software and hardware. The controller 200 is a control unit that controls the entire client terminal 2. The communication control unit 201 acquires information input via the network I / F 210 and the short-range communication I / F 211 and transmits information to other devices via the network I / F 210 and the short-range communication I / F 211. To do.

  The operation control unit 202 acquires a signal of the operation content by the user with respect to the operation unit 70 and inputs it to a module operating in the client terminal 2 such as the client application 230. The display control unit 203 causes the LCD 60 to display the state of the client terminal 2 such as a GUI (Graphical User Interface) of the client application 230.

  The client application 230 is configured by a software program that is installed and operated on the client terminal 2 in order to perform a remote operation on the image processing apparatus 1 according to the present embodiment. FIG. 9 is a block diagram illustrating a functional configuration of the client application 230 according to this embodiment. As illustrated in FIG. 9, the client application 230 according to the present embodiment includes a connection processing unit 231, a screen size output unit 232, and a position information output unit 233.

  The connection processing unit 231 establishes a communication connection by Bluetooth or the like with the image processing apparatus 1 in accordance with the connection processing by the connection processing unit 134 described above. The screen size output unit 232 outputs the screen size displayed on the display unit of the client terminal 2 to the image processing apparatus 1 with which communication connection has been established. Thereby, the screen size acquisition unit 135 described above acquires the screen size.

  The position information output unit 233 outputs, to the image processing apparatus 1, position information instructed by the user touching with a fingertip or the like on the screen displayed on the display unit of the client terminal 2. Thereby, the position information conversion unit 136 described above acquires the position information.

  That is, in the information processing system according to the present embodiment, the position corresponding to the position of the button that the user wants to press on the operation screen is displayed on the client terminal 2 while referring to the operation screen displayed on the image processing apparatus 1. Touch on the display screen (operation unit). As a result, the image processing apparatus 1 controls the operation on the assumption that the position on the operation screen corresponding to the position touched on the display screen of the client terminal 2 has been pressed.

  As described above, the image processing apparatus 1 according to the present embodiment has the screen sizes displayed on the display units of the image processing apparatus 1 and the client terminal 2 based on the position information acquired from the client terminal 2 connected for communication. Convert based on ratio. Then, the image processing apparatus 1 according to the present embodiment controls the operation with the converted position information as the position indicated on the operation screen displayed on the display unit of the image processing apparatus 1.

  As a result, even when the image processing apparatus 1 employs a capacitive touch panel as an operation unit, it is possible to operate the image processing apparatus 1 with the client terminal 2 that is normally used by a user of a prosthetic hand. become. In addition, since the position information is converted based on the ratio of each screen size, it is possible to operate a plurality of devices by the client terminal 2 that the user normally uses without preparing a dedicated remote controller for each device. Therefore, according to the present embodiment, it is possible to improve convenience of device operation by a user who cannot operate a capacitive touch panel that is an operation unit of various devices such as the image processing apparatus 1.

  In the present embodiment, the image data of the operation screen is not transmitted from the image processing apparatus 1 to the client terminal 2, but the remote operation is performed by transmitting the screen size and position information from the client terminal 2 to the image processing apparatus 1. Done. With such a configuration, the amount of data communication between the image processing apparatus 1 and the client terminal 2 can be reduced, so that the processing load in the information processing system can be reduced. Further, with such a configuration, a simple method such as Bluetooth can be used as a communication method for remote operation, so that convenience can be improved.

  However, such a configuration is not essential, as long as the image processing apparatus 1 and the client terminal 2 are communicatively connected by some communication method and the position information transmitted from the client terminal 2 can be converted. Therefore, even if there is no such configuration, it is possible to improve the convenience of device operation by a user who cannot operate the capacitive touch panel.

  Further, the image processing apparatus 1 according to the present embodiment determines whether or not a remote operation for the image processing apparatus 1 is necessary by the client terminal 2 based on user information of a user who has been successfully authenticated. Therefore, according to the present embodiment, it is not necessary for the user himself / herself to instruct remote operation, and the burden on the user can be reduced. The image processing apparatus 1 according to the present embodiment performs user authentication using the IC card 3. Therefore, according to this embodiment, it is not necessary for the user to input an ID or password, and the burden on the user can be reduced.

  However, the determination of the presence or absence of remote operation and the configuration of user authentication are not essential, and it is only necessary that the image processing apparatus 1 is connected to the client terminal 2 and can convert the position information from the client terminal 2. Therefore, even when these configurations are not provided, it is possible to improve the convenience of device operation by a user who cannot operate the capacitive touch panel.

  In the above embodiment, the enlargement / reduction operation of the operation screen displayed on the display panel 113 of the image processing apparatus 1 may be remotely operated by the client terminal 2. FIG. 10 is a diagram illustrating a functional configuration of the main control unit 130 according to the embodiment for remotely controlling the enlargement / reduction of the operation screen. As shown in FIG. 10, the main control unit 130 according to this embodiment has a configuration in which an operation information acquisition unit 138 is added to the configuration of the main control unit 130 shown in FIG.

  The operation information acquisition unit 138 acquires operation information indicating operation content on the display screen of the client terminal 2 from the client terminal 2 (hereinafter referred to as “terminal operation information”) and outputs the operation information to the operation control unit 137. . When the client terminal 2 supports a pinch-out / pinch-in operation on the display screen, the operation information acquisition unit 138 acquires a pinch-out or a pinch-in operated on the display screen of the client terminal 2 as terminal operation information.

  On the other hand, when the client terminal 2 does not support the pinch-in / pinch-out operation on the display screen, the client terminal 2 displays a button for designating the pinch-in / pinch-out operation on the display unit. FIG. 11 is a diagram illustrating a display unit of the client terminal 2 that displays a button for designating a pinch-in / pinch-out operation. As shown in FIG. 11, in the display unit of the client terminal 2, an area indicated by hatching is an area (screen) corresponding to the operation screen of the image processing apparatus 1, and in addition to the area indicated by hatching, “pinch-in”, “Pinch out” and “operation key non-display” buttons (software keys) are arranged.

  That is, the “pinch-in” and “pinch-out” buttons are software keys displayed on the display unit of the client terminal 2 and are operation command reception units that receive operation commands. Specifically, the “pinch-in” button is a reduction operation command reception unit that receives a command to reduce the display size on the operation screen of the image processing apparatus 1. The “pinch out” button is an enlargement operation command reception unit that receives an instruction to enlarge the display size on the operation screen of the image processing apparatus 1.

  For example, it is assumed that the user touches and indicates the position of the black circle shown in FIG. 11 with a fingertip or the like, and touches the “pinch out” button. In this case, the operation information acquisition unit 138 acquires a pinch out operation as terminal operation information. The operation control unit 137 controls the operation of the display panel 113 based on the position information converted by the position information conversion unit 136 and the terminal operation information input by the operation information acquisition unit 138.

  FIG. 12 is a diagram illustrating the display panel 113 of the image processing apparatus 1. The position of the black circle shown in FIG. 12 corresponds to the position of the black circle shown in FIG. Based on the terminal operation information, the operation control unit 137 reflects the operation when pinching out from the position of the black circle on the operation screen, as shown in FIG. In other words, the operation control unit 137 controls the enlargement / reduction operation of the display size based on the terminal operation information around the position indicated by the converted position information on the operation screen of the image processing apparatus 1.

  On the other hand, when the user touches the “operation key non-display” button shown in FIG. 11, the various buttons shown in FIG. 11 are hidden, and the entire display unit corresponds to the operation screen of the image processing apparatus 1 ( Screen).

  With such a configuration, even when the client terminal 2 does not support the pinch-in / pinch-out operation, it is possible to remotely control the enlargement / reduction of the operation screen of the image processing apparatus 1. Further, when the operation key is hidden by the “operation key non-display” button, the area corresponding to the operation screen is widened, so that the operability can be improved. However, the “operation key non-display” button is not essential, and even if there is no “operation key non-display” button, the enlargement / reduction of the image processing apparatus 1 can be remotely operated by the client terminal 2. .

  In the above-described embodiment, the case where the image processing apparatus 1 and the client terminal 2 are connected for communication by Bluetooth has been described as an example. In addition, the image processing apparatus 1 and the client terminal 2 may be connected for communication by Wi-Fi or Ethernet (remote desktop). In the case of communication connection by Wi-Fi or remote desktop, image data of an operation screen displayed on the image processing apparatus 1 can be transmitted to the client terminal 2. With this configuration, the user can check the operation screen displayed on the image processing apparatus 1 on the display screen of the client terminal 2.

  Further, when the client terminal 2 does not have a Bluetooth communication function, it is possible to establish a communication connection with the image processing apparatus 1 using another communication function. Note that the user information includes information indicating the communication method designated for the client terminal 2, and the communication connection process between the image processing apparatus 1 and the client terminal 2 is performed using the communication method indicated by the information. It may be broken.

  In the above embodiment, when the client terminal 2 is newly paired and registered with the image processing apparatus 1, the hard key of the image processing apparatus 1 may be used. FIG. 13 is a diagram illustrating the display panel 113 of the image processing apparatus 1. In the display panel 113 shown in FIG. 13, hard keys are arranged in addition to a touch panel (an hatched area) indicating an operation screen. For example, the connection processing unit 134 receives a predetermined operation (for example, pressing all the hard keys simultaneously for 3 seconds or more) by the user with respect to the hard keys arranged on the display panel 113 shown in FIG. In this case, the connection processing unit 134 registers (pairing registration) the detected client terminal 2 as a device capable of communication connection.

  With such a configuration, even when the touch panel of the image processing apparatus 1 is of the electrostatic capacity type and the user of the prosthetic hand cannot operate, the pairing registration with the client terminal 2 can be performed by himself.

  In the above-described embodiment, the operation control unit 137 enables the acceptance of the operation on the operation screen displayed on the image processing apparatus 1 when the image processing apparatus 1 is remotely operated by the client terminal 2. Or invalidation may be controlled. That is, the operation control unit 137 controls whether or not to accept an operation by directly instructing an operation screen displayed on the image processing apparatus 1. With such a configuration, it is possible to simultaneously perform an operation on an operation screen displayed on the image processing apparatus 1 as well as a remote operation by the client terminal 2 according to a user's desire.

  In these embodiments, the case where the user information storage unit 132 is included in the main control unit 130 has been described as an example. However, this is an example, and is included in an external server connected via a network. May be. In this case, each component included in the main control unit 130 accesses the user information storage unit 132 included in the external server or the like via the network, and acquires user information.

  In these embodiments, the image processing apparatus 1 has been described as an example of the information processing apparatus. However, this is only an example, and in addition to the image processing apparatus 1, any apparatus that employs a touch panel as an operation unit, such as an ATM (Automated Teller Machine) or a vending machine, can be used as the information processing apparatus according to the present embodiment. Applicable.

1 Image processing device 2 Client terminal 3 IC card 10 CPU
20 RAM
30 ROM
40 HDD
50 I / F
60 LCD
70 Operation Unit 80 Bus 100 Controller 101 Engine Control Unit 102 Communication Control Unit 103 Image Processing Unit 104 Operation Display Control Unit 110 ADF
111 Scanner Unit 112 Paper Discharge Tray 113 Display Panel 114 Paper Feed Table 115 Print Engine 116 Paper Discharge Tray 117 Network I / F
118 Short range communication I / F
DESCRIPTION OF SYMBOLS 130 Main control part 131 Authentication process part 132 User information storage part 133 Connection determination part 134 Connection process part 135 Screen size acquisition part 136 Position information conversion part 137 Operation control part 138 Operation information acquisition part 200 Controller 201 Communication control part 202 Operation control part 203 Display control unit 210 Network I / F
211 Near field communication I / F
230 Client Application 231 Connection Processing Unit 232 Screen Size Output Unit 233 Position Information Output Unit

JP 2011-41057 A

Claims (7)

An information processing apparatus that executes processing according to a position designated on an operation screen,
A screen size acquisition unit for acquiring a screen size displayed on a display unit of another device capable of communicating with the information processing device;
A position information conversion unit that converts position information instructed on the screen displayed on the display unit of the other device based on the ratio between the acquired screen size and the size of the operation screen;
An information processing apparatus comprising: an operation control unit that controls an operation on the information processing apparatus according to a position on the operation screen indicated by the converted position information. An operation information acquisition unit that acquires operation information indicating the operation content of the operation command receiving unit that is instructed among operation command receiving units that are software keys that are displayed on the display unit of the other device and receives an operation command;
The operation command accepting unit is an enlargement operation command accepting unit that accepts a command for enlarging the display size on the operation screen and a reduction operation command accepting unit that accepts a command for reducing the display size on the operation screen,
The operation control unit controls an enlargement / reduction operation of a display size on the operation screen based on the acquired operation information with the position on the operation screen indicated by the converted position information as a center. Item 4. The information processing apparatus according to Item 1. An authentication processing unit for performing authentication processing of a user of the information processing apparatus;
A connection determination unit that determines whether to establish a communication connection with the other device used by the authenticated user based on user information that is predetermined information of the authenticated user. When,
The information processing apparatus according to claim 1, further comprising: a connection processing unit that establishes a communication connection with the other apparatus used by the user based on the determination result. The connection processing unit establishes a communication connection with the other device using a communication method specified for the other device used by the user. Information processing device. With hard keys,
The information processing apparatus according to claim 3, wherein the connection processing unit registers the other apparatus as an apparatus capable of communication connection when a predetermined operation on the hard key is received. The operation control unit performs an operation by directly instructing the operation screen when controlling an operation on the information processing device based on the position information instructed on the screen displayed on the display unit of the other device. The information processing apparatus according to claim 1, wherein presence / absence of acceptance is controlled. An information transmission device that is communicably connected to an information processing device that executes processing according to a position instructed on an operation screen and transmits information,
A screen size output unit that outputs a screen size displayed on the display unit of the information transmission device to the information processing device;
A position information output unit that outputs position information indicated on a screen displayed on a display unit of the information transmission device to the information processing device;