JP6229517B2 - Image forming system, image forming apparatus, and program - Google Patents

Description

  The present invention relates to an image forming system including an image forming apparatus such as an MFP (Multi-Functional Peripheral), and a related technology.

  There is a technique for operating an image forming apparatus with an external terminal (remote operation apparatus).

  For example, in Patent Document 1, the operation screen data itself (bitmap image data or the like) is transmitted as it is from the image forming apparatus to the external terminal, and the operation screen is displayed on the display unit of the external terminal. A technique for receiving operation input in an operation screen by transmitting / receiving operation position information (pressed position information, etc.) is shown. This is a remote operation technology by so-called remote connection.

  In addition, there is a technology for inputting characters using a preinstalled input method editor (IME) (hereinafter also simply referred to as IME) in a portable terminal.

Japanese Patent Laid-Open No. 05-122424

  For example, when a character input operation is performed when an image forming apparatus is operated by an external terminal using the technique described in Patent Document 1, it is conceivable to use an IME installed in the external terminal.

  Incidentally, usable characters may be different between the image forming apparatus and the external terminal. More specifically, characters output as conversion results by the IME installed in the external terminal may include characters that cannot be used by the image forming apparatus (for example, kanji variants). .

  However, in the technique described in Patent Document 1, when such a conversion result by IME is transmitted to the image forming apparatus as it is and determined, the image forming apparatus appropriately displays a character string including the conversion result. I can't.

  Accordingly, an object of the present invention is to provide a technique capable of appropriately inputting characters that can be used in an image forming apparatus when inputting characters to the image forming apparatus using a remote control device.

  In order to solve the above-mentioned problems, the invention of claim 1 is an image forming system comprising an image forming apparatus and a remote operation device for remotely operating the image forming apparatus, and the remote operation device is controlled by a user. Character input means for accepting character input, and input character string information that is information of the input character string input by the character input means and includes character codes of the characters of the input character string to the image forming apparatus A communication means for transmitting, the image forming apparatus recognizes the input character string based on the input character string information, a receiving means for receiving the input character string information from the remote control device, and Acquisition means for acquiring information on conversion candidates that are conversion candidates related to an input character string and that can be used in the image forming apparatus; and information on the conversion candidates Transmitting means for transmitting conversion candidate information to the remote operation device, and the remote operation device further comprises display means for displaying the conversion candidate information transmitted from the image forming apparatus. And

  According to a second aspect of the present invention, in the image forming system according to the first aspect of the invention, the receiving unit also receives a conversion result related to the input character string by the IME installed in the remote control device, and the acquiring unit Determining whether or not a character that cannot be used in the image forming apparatus is included in the conversion result, and the transmission unit includes a character that cannot be used in the image forming apparatus in the conversion result. In addition, the conversion candidate information regarding the input character string is transmitted to the remote control device.

  According to a third aspect of the present invention, in the image forming system according to the second aspect, in addition to the input character string information, the receiving means converts the input character string by the IME installed in the remote control device. And the acquisition means acquires the conversion candidate information regarding the input character string received in advance when a character that cannot be used in the image forming apparatus is included in the conversion result, The transmission means transmits the conversion candidate information acquired by the acquisition means to the remote control device.

  According to a fourth aspect of the present invention, in the image forming system according to the second aspect of the present invention, the receiving unit converts a conversion result related to the input character string by the IME installed in the remote control device prior to the input character string information. And when the conversion result includes characters that cannot be used by the image forming apparatus, the transmission means transmits a transmission request for the input character string to the remote operation apparatus, and the acquisition means The conversion candidate information is acquired with respect to the input character string transmitted from the remote operation device in response to the transmission request, and the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote operation device. It is characterized by transmitting to.

  According to a fifth aspect of the present invention, in the image forming system according to any one of the second to fourth aspects, the transmission unit includes a case where characters that cannot be used in the image forming apparatus are included in the conversion result. In addition, a character that cannot be used by the image forming apparatus is specified from the conversion result, and information on the specified character is transmitted to the remote control device.

  According to a sixth aspect of the present invention, in the image forming system according to the fifth aspect of the present invention, the acquisition unit includes the conversion unit that includes a character that cannot be used in the image forming apparatus. A part of the pre-conversion character string corresponding to the unusable character is identified from the input character string, and is a conversion candidate related to the specified part of the pre-conversion character string, and is stored in the image forming apparatus. Information regarding conversion candidates composed of usable characters is acquired as the conversion candidate information regarding the input character string, and the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote control device. It is characterized by doing.

  According to a seventh aspect of the present invention, in the image forming system according to any one of the first to sixth aspects of the present invention, the transmission means converts the image data on the screen indicating the conversion candidate related to the input character string into the conversion candidate information. To the remote control device, and the remote control device displays a screen based on the image data.

  According to an eighth aspect of the present invention, in the image forming system according to any one of the first to sixth aspects, the transmission unit uses the list information indicating the conversion candidate related to the input character string as the conversion candidate information. Transmitting to a remote operation device, the remote operation device generates image data based on the list information, and displays a screen based on the image data.

  According to a ninth aspect of the present invention, in the image forming system according to any one of the first to eighth aspects, the acquisition unit determines the conversion candidate using an IME built in the image forming apparatus, The conversion candidate information regarding the conversion candidate is acquired.

  According to a tenth aspect of the present invention, in the image forming system according to any one of the first to ninth aspects, the acquisition unit includes the input character string based on registration information registered in the image forming apparatus. A registered word is determined as a conversion candidate for complementing the input character string, and the conversion candidate information regarding the conversion candidate is acquired.

  According to an eleventh aspect of the present invention, in the image forming system according to any one of the first to eighth aspects, the image forming system further includes an external device separate from the image forming device and the remote control device. The external device has information on characters that can be used in the image forming apparatus, and is a conversion candidate related to the input character string and is composed only of characters that can be used in the image forming apparatus. And the conversion candidate information regarding the conversion candidate is transmitted to the image forming apparatus, and the acquisition unit of the image forming apparatus acquires the conversion candidate information transmitted from the external apparatus. An image forming system.

  According to a twelfth aspect of the present invention, there is provided an image forming apparatus that can be remotely operated by a remote operation device, which is information of an input character string input by a user at the remote operation device, and each character of the input character string A receiving unit that receives input character string information that is information including a character code; recognizes the input character string based on the input character string information; and is a conversion candidate related to the input character string and is converted by the image forming apparatus It comprises an acquisition means for acquiring information relating to conversion candidates composed of usable characters, and a transmission means for transmitting conversion candidate information, which is information relating to the conversion candidates, to the remote control device.

  According to a thirteenth aspect of the present invention, in the image forming apparatus according to the twelfth aspect of the invention, the receiving unit also receives a conversion result related to the input character string by the IME installed in the remote control device, and the acquiring unit includes Determining whether or not a character that cannot be used in the image forming apparatus is included in the conversion result, and the transmission unit includes a character that cannot be used in the image forming apparatus in the conversion result. In addition, the conversion candidate information regarding the input character string is transmitted to the remote control device.

  According to a fourteenth aspect of the present invention, in the image forming apparatus according to the thirteenth aspect, in addition to the input character string information, the receiving unit converts the input character string by the IME installed in the remote control device. And the acquisition means acquires the conversion candidate information regarding the input character string received in advance when a character that cannot be used in the image forming apparatus is included in the conversion result, The transmission means transmits the conversion candidate information acquired by the acquisition means to the remote control device.

  According to a fifteenth aspect of the present invention, in the image forming apparatus according to the thirteenth aspect of the invention, the receiving unit converts a conversion result related to the input character string by the IME installed in the remote control device prior to the input character string information. And when the conversion result includes characters that cannot be used by the image forming apparatus, the transmission means transmits a transmission request for the input character string to the remote operation apparatus, and the acquisition means The conversion candidate information is acquired with respect to the input character string transmitted from the remote operation device in response to the transmission request, and the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote operation device. It is characterized by transmitting to.

  According to a sixteenth aspect of the present invention, in the image forming apparatus according to any one of the thirteenth to fifteenth aspects, the transmission unit includes a character that cannot be used in the image forming apparatus in the conversion result. In addition, a character that cannot be used by the image forming apparatus is specified from the conversion result, and information on the specified character is transmitted to the remote control device.

  According to a seventeenth aspect of the present invention, in the image forming apparatus according to the sixteenth aspect of the present invention, the acquisition unit includes the conversion result when a character that cannot be used in the image forming apparatus is included in the conversion result. A part of the pre-conversion character string corresponding to the unusable character is identified from the input character string, and is a conversion candidate related to the specified part of the pre-conversion character string, and is stored in the image forming apparatus. Information regarding conversion candidates composed of usable characters is acquired as the conversion candidate information regarding the input character string, and the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote control device. It is characterized by doing.

  According to an eighteenth aspect of the present invention, in the image forming apparatus according to any one of the twelfth to seventeenth aspects, the transmission unit converts the image data of the screen indicating the conversion candidate related to the input character string into the conversion candidate information. Is transmitted to the remote control device.

  According to a nineteenth aspect of the present invention, in the image forming apparatus according to any one of the twelfth to seventeenth aspects, the transmission unit uses the list information indicating the conversion candidates related to the input character string as the conversion candidate information. It transmits to a remote control device, It is characterized by the above-mentioned.

  According to a twentieth aspect of the present invention, in the image forming apparatus according to any one of the twelfth to nineteenth aspects, the acquisition unit determines the conversion candidate using an IME built in the image forming apparatus, The conversion candidate information regarding the conversion candidate is acquired.

  According to a twenty-first aspect of the present invention, in the image forming apparatus according to any one of the twelfth to twentieth aspects, the acquisition unit includes the input character string based on registration information registered in the image forming apparatus. A registered word is determined as a conversion candidate for complementing the input character string, and the conversion candidate information regarding the conversion candidate is acquired.

  According to a twenty-second aspect of the present invention, there is provided a computer built in an image forming apparatus that can be remotely operated by a remote operation device. A) Information on an input character string input by a user using the remote operation device, Receiving input character string information that is information including a character code of each character of the string; b) recognizing the input character string based on the input character string information and being a conversion candidate for the input character string; Obtaining information related to conversion candidates composed of characters usable in the image forming apparatus; and c) transmitting conversion candidate information that is information related to the conversion candidates to the remote operation device. It is the program for this.

  According to the invention described in claims 1 to 22, when the image forming apparatus is remotely operated using the remote operation device, it is possible to appropriately input characters using the remote operation device.

1 is a diagram illustrating an image forming system. It is a figure which shows the functional block of an image forming apparatus. It is a functional block diagram which shows schematic structure of an external terminal. 6 is a flowchart illustrating an operation of the MFP according to the first embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 1st Embodiment. 6 is a timing chart illustrating an operation example in the image forming system according to the first embodiment. It is a figure which shows the operation screen of an external terminal. It is a figure which shows the operation screen of an external terminal. It is a figure which shows the example of a display of a conversion candidate. It is a figure which shows the example of a display of a conversion result. It is a figure which shows another example of a display of a conversion candidate. 10 is a flowchart showing an operation of the MFP according to the second embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 2nd Embodiment. 12 is a timing chart illustrating an operation example in the image forming system according to the second embodiment. 10 is a flowchart illustrating an operation of an MFP according to a third embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 3rd Embodiment. 12 is a timing chart illustrating an operation example in the image forming system according to the third embodiment. 14 is a flowchart illustrating an operation of an MFP according to a fourth embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 4th Embodiment. 14 is a timing chart illustrating an operation example in the image forming system according to the fourth embodiment. It is a figure which shows the example of a display of the conversion candidate which concerns on 4th Embodiment. It is a figure which shows the operation screen which concerns on a modification.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<1. First Embodiment>
<1-1. Outline of configuration>
FIG. 1 is a diagram showing an image forming system 1 according to the present invention. As shown in FIG. 1, the image forming system 1 includes an image forming apparatus 10 and an external terminal 50.

  The image forming apparatus 10 and the external terminal 50 are connected to each other via a network (communication network) 108. The network 108 is configured by a LAN (Local Area Network), the Internet, and the like. Further, the connection mode to the network 108 may be wired connection or wireless connection. For example, the image forming apparatus 10 is wired to the network 108, and the external terminal 50 is wirelessly connected to the network 108.

  In the image forming system 1, various operations on the image forming apparatus 10 can be performed using the external terminal 50. That is, the external terminal 50 can remotely operate the image forming apparatus 10. The image forming system 1 is also expressed as a remote operation system that performs remote operation of the image forming apparatus 10.

<1-2. Configuration of image forming apparatus>
FIG. 2 is a diagram illustrating functional blocks of the image forming apparatus 10. Here, an MFP (Multi-Functional Peripheral) is exemplified as the image forming apparatus 10. In FIG. 2, functional blocks of the MFP 10 are shown.

  The MFP 10 is a device (also referred to as a multi-function device) having a scan function, a copy function, a facsimile function, a box storage function, and the like. Specifically, as shown in the functional block diagram of FIG. 2, the MFP 10 includes an image reading unit 2, a print output unit 3, a communication unit 4, a storage unit 5, an operation unit 6, a controller 9, and the like. Various functions are realized by operating each part of the above in a complex manner.

  The image reading unit 2 is a processing unit that optically reads (that is, scans) a document placed at a predetermined position of the MFP 10 and generates image data of the document (also referred to as a document image or a scanned image). is there. The image reading unit 2 is also referred to as a scanning unit.

  The print output unit 3 is an output unit that prints out an image on various media such as paper based on data related to a print target.

  The communication unit 4 is a processing unit capable of performing facsimile communication via a public line or the like. Further, the communication unit 4 can perform network communication via the network 108. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the MFP 10 can exchange various data with a desired partner (for example, the external terminal 50). The communication unit 4 includes a transmission unit 4a that transmits various data and a reception unit 4b that receives various data.

  The storage unit 5 includes a storage device such as a hard disk drive (HDD). The storage unit 5 stores image data of each operation screen. The storage unit 5 is provided with a plurality of boxes (folders) for each user, and each box stores electronic document data (document file) and the like. The storage unit 5 also stores information (specifically, a character code list of all “available characters”) regarding characters (also referred to as “available characters”) that can be used in the MFP 10. .

  The operation unit 6 includes an operation input unit 6a that receives an operation input to the MFP 10 and a display unit 6b that displays and outputs various types of information.

  The MFP 10 is provided with a substantially plate-like operation panel unit 6c (see FIG. 1). Further, the operation panel unit 6c has a touch panel 25 (see FIG. 1) on the front side thereof. The touch panel 25 functions as a part of the operation input unit 6a and also functions as a part of the display unit 6b. The touch panel 25 is configured by embedding various sensors and the like in a liquid crystal display panel, and can display various information and accept various operation inputs from an operator.

  For example, on the touch panel 25, menu images (including button images and the like) are displayed. The operator can set various operation contents of the MFP 10 by pressing a button (button represented by a button image) virtually arranged in the touch panel 25.

  As described later, on the touch panel 75 (see FIG. 1) of the external terminal 50, a screen similar to the operation screen displayed on the touch panel 25 of the MFP 10 is displayed. By using the operation screen displayed on the touch panel 75 of the external terminal 50, an operation similar to the operation using the operation screen displayed on the touch panel 25 of the MFP 10 is realized.

  The controller 9 is a control device that is built in the MFP 10 and controls the MFP 10 in an integrated manner. The controller 9 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 9 implements various processing units by executing predetermined software programs (hereinafter also simply referred to as programs) stored in a ROM (for example, EEPROM) in the CPU. Note that the program (specifically, a program module group) may be installed in the MFP 10 via a portable recording medium such as a USB memory or the network 108.

  Specifically, as shown in FIG. 2, the controller 9 performs the communication control unit 11, the input control unit 12, the display control unit 13, the screen transition control unit 14, and the conversion candidate acquisition unit 15 by executing the above program. Various processing units including the above are realized.

  The input control unit 12 is a control unit that controls an operation input operation to the operation input unit 6a (the touch panel 25 or the like). For example, the input control unit 12 controls an operation for receiving an operation input on the operation screen displayed on the touch panel 25.

  The display control unit 13 is a processing unit that controls a display operation in the display unit 6b (the touch panel 25 or the like). The display control unit 13 causes the touch panel 25 to display an operation screen (remote operation screen) 200 for operating the MFP 10.

  The communication control unit 11 is a processing unit that controls communication operations with other devices (such as the external terminal 50) in cooperation with the communication unit 4 and the like. The communication control unit 11 includes a transmission control unit that controls a transmission operation of various data and a reception control unit that controls a reception operation of various data.

  The communication control unit 11 displays an image for display (details of the data) of the operation screen (also referred to as a remote operation screen) 200 (referred to as 210 in detail) (see FIG. 8 and the like) and the like on the external terminal 50 to the external terminal 50. Send. In addition, the communication control unit 11 receives, from the external terminal 50, operation input information that is information related to an operation input from the operator for the operation screen 200 displayed on the external terminal 50. Further, the communication control unit 11 receives a character string input by an IME (also referred to as a character input unit) in the external terminal 50, and transmits information (conversion candidate information (described later)) regarding conversion candidates related to the character string. It transmits to the external terminal 50. In the external terminal 50, conversion candidates related to the character string are displayed based on the conversion candidate information, and the final conversion result is selected by the user from the conversion candidates.

  The screen transition control unit 14 is a control unit that determines and controls screen transition contents related to the operation screen, and is also referred to as a screen transition control unit. For example, the screen transition control unit 14 determines the content of the operation input in the external terminal 50 based on the operation input information (such as the coordinate value of the operation input position) transmitted from the external terminal 50, and the content of the operation input The transition destination screen or the like based on is determined. Further, the screen transition control unit 14 determines whether or not the operation input is a display instruction for a character input screen, and also determines whether or not an IME activation command should be transmitted to the external terminal 50.

  The conversion candidate acquisition unit 15 is a processing unit that acquires conversion candidate information regarding an input character string input by the IME of the external terminal 50. In the first embodiment, the conversion candidate acquisition unit 15 uses the input character string conversion candidates input by the IME of the external terminal 50 as usable character information (information on characters usable in the MFP 10) built in the MFP 10. Determine based on. The conversion candidate acquisition unit 15 also generates a list display screen of character string conversion candidates.

<1-3. Configuration of external terminal>
Next, the configuration of the external terminal (also referred to as a remote control device) 50 will be described.

  The external terminal 50 is an information input / output terminal device (information terminal) capable of network communication with the MFP 10. Here, a personal computer is exemplified as the external terminal 50. However, the present invention is not limited to this, and the external terminal 50 may be a tablet terminal or a smartphone. The external terminal may be a portable device (such as a portable information terminal) or may be a stationary device.

  FIG. 3 is a functional block diagram illustrating a schematic configuration of the external terminal 50.

  As shown in the functional block diagram of FIG. 3, the external terminal 50 includes a communication unit 54, a storage unit 55, an operation unit 56, a controller 59, and the like. Realize the function.

  The communication unit 54 can perform network communication via the network 108. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the external terminal 50 can exchange various data with a desired partner (MFP 10 or the like). The communication unit 54 includes a transmission unit 54a that transmits various data and a reception unit 54b that receives various data. For example, the receiving unit 54 b receives a display image (specifically, image data thereof) of the operation screen (remote operation screen) from the MFP 10, and the transmission unit 54 a responds to the operation screen displayed on the touch panel 75. Operation input information (touch coordinate information and the like) is transmitted to the MFP 10. In addition, the transmission unit 54 a transmits character information (text information) or the like input using IME (described later) of the external terminal 50 to the MFP 10.

  The storage unit 55 includes a storage device such as a nonvolatile semiconductor memory. The storage unit 55 temporarily stores various image data transmitted from the MFP 10. For example, image data of a display image on the operation screen is temporarily stored.

  The operation unit 56 includes an operation input unit 56a that receives an operation input to the external terminal 50, and a display unit 56b that displays and outputs various types of information. In the external terminal 50, a touch panel 75 (see FIG. 1) configured by embedding various sensors or the like in a liquid crystal display panel is provided. The touch panel 75 functions as a part of the operation input unit 56a and also functions as a part of the display unit 56b.

  On the touch panel 75, an operation screen 200 including a screen 210 (see FIG. 8 and the like) similar to the operation screen of the touch panel 25 is displayed as a remote operation screen (screen for remotely operating the MFP 10). In addition, the touch panel 75 receives a touch gesture operation (also referred to as a touch operation) on the remote operation screen or the like.

  The controller 59 in FIG. 3 is a control device that is built in the external terminal 50 and controls the external terminal 50 in an integrated manner. The controller 59 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 59 implements various processing units by executing predetermined software programs (hereinafter also simply referred to as programs) stored in a storage unit (semiconductor memory or the like) in the CPU. The program (specifically, a program module group) may be installed in the external terminal 50 via a portable recording medium such as a USB memory or the network 108.

  Specifically, an input method editor (IME) is preinstalled in the external terminal 50. IME is software that performs processing for accepting character input by an operating user, and is also expressed as character input assistance software. IME is one of character input means.

  The external terminal 50 is also installed with a remote operation program. The program is an application software program for remotely operating the MFP 10 and implements various functions related to the remote operation.

  Specifically, the controller 59 implements various processing units including a communication control unit 61, an input control unit 62, a display control unit 63, and a coordinate conversion unit 65 by executing a remote operation program or the like.

  The communication control unit 61 is a processing unit that controls a communication operation with the MFP 10 or the like in cooperation with the communication unit 54 or the like. For example, the communication control unit 61 transmits operation input information (information regarding an operation input from the operator to the operation screen displayed on the touch panel 75) to the MFP 10. Further, the communication control unit 61 receives a display image of the operation screen 200 (210, etc.) on the external terminal 50. Further, the communication control unit 61 transmits a character string (specifically, information related to the character string) input by the IME or the like of the external terminal 50 to the MFP 10, and a conversion candidate (specifically, the conversion related to the character string). Information on candidates) is received from the MFP 10.

  The input control unit 62 is a control unit that controls an operation input operation to the operation input unit 56a (the touch panel 75 or the like). For example, the input control unit 62 controls an operation for receiving a touch operation input (including character input and the like) on the remote operation screen 200 and the like. The input control unit 62 also controls an operation of accepting touch operation input (including character input) for the IME operation area (221, 222) (see FIG. 8 and the like) in the remote operation screen 200.

  The coordinate conversion unit 65 is a processing unit that converts the coordinate value of the operation input position on the touch panel 75 from the coordinate system value on the touch panel 75 of the external terminal 50 to the coordinate system value on the touch panel 25 of the MFP 10. The converted coordinate value is transmitted to the MFP 10 by the communication control unit 61 or the like as position information (operation position information) indicating the operation position of the operation input.

  The display control unit 63 is a processing unit that controls a display operation in the display unit 56b (touch panel 75 or the like). The display control unit 63 causes the touch panel 75 to display an operation screen 200 (210, 220) for remotely operating the MFP 10. In a character input process (character conversion process) using IME or the like, the display control unit 63 performs a process of displaying a character string input by the user, a process of displaying a conversion candidate transmitted from the MFP 10, and the like. Do.

  The display control unit 63 has an IME control unit 64. The IME control unit 64 controls the operation of the IME installed in the external terminal 50.

<1-4. Operation screen>
In the image forming system 1, an operation screen (not shown) is displayed on the touch panel 25 of the MFP 10, and image data of the operation screen is transmitted from the MFP 10 to the external terminal 50, and the operation is performed on the touch panel 75 of the external terminal 50. An operation screen (remote operation screen) 200 including a screen similar to the screen is displayed. The operation screen displayed on touch panel 75 includes a screen similar to the operation screen displayed on touch panel 25 in appearance.

  The operation screen 200 of the external terminal 50 is basically displayed based on image data (also referred to as simulated image data) of a simulated image that simulates the operation screen on the touch panel 25 of the MFP 10. The simulated image data is configured as a bitmap image, for example.

  The operation screen 200 has a panel image display area R1 (area surrounded by a thick frame in FIG. 8). The panel image display area R1 is an area for displaying an image similar to the display image on the touch panel 25 of the MFP 10. The panel image display region R1 occupies a relatively large area in the operation screen 200. The operation screen 200 is a key image (“Start”, “Stop”,..., “Menu”, “Guide”) imitating the hardware keys of the operation panel unit 6c of the MFP 10 outside the panel image display area R1. ,...), A character input field 221 (described later), and the like.

  In the following, it is assumed that a screen 202 (FIG. 8) including a character input screen 212 (210) is first displayed as the operation screen 200.

  The operation screen 202 has a keyboard screen (character input screen) 212 for inputting characters in the panel image display area R1. When the user presses each button (key) in the keyboard screen 212, the position information in the keyboard screen is transmitted from the external terminal 50 to the MFP 10, and the MFP 10 determines which button has been pressed based on the position information. recognize.

  The operation screen 200 (202) also includes a character input field (also referred to as an input character display field) 221 by the IME of the external terminal 50. By using the character input field 221 or the like, the user can perform character input without using the keyboard screen 212, specifically, character input using the IME installed in the external terminal 50.

  The character input field 221 is provided outside the panel image display region R1 at a location near the lower right in the operation screen 200. When character input using the keyboard (hardware keyboard or the like) of the external terminal 50 is performed with the input cursor placed on the character input field 221, the input character string is displayed in the character input field 221. Also, below the character input field 221, a transmission button 222 for transmitting a character string or the like input in the character input field 221 to the MFP 10 is provided.

  The operation screen 202 is displayed in response to, for example, pressing of the registered name column 322 in the operation screen 201 (see FIG. 7). The operation screen 201 is different from the operation screen 202 in that the image in the panel image display region R1 is different, but has the same configuration as the operation screen 202 in other points.

  As shown in FIG. 7, on the operation screen 201, a setting screen for new registration of “box” (also referred to as a setting screen for new box registration) 211 is displayed in the panel image display region R <b> 1.

  The setting screen 211 includes a registration number field 321, a registration name field 322, a registered name phonetic field 323, and a search character field 324. The setting screen 211 also includes various buttons 311 to 314, 331, 332, and the like.

  The user can input various character information by pressing various setting buttons 311 to 314 or various character string display fields 321 to 324. For example, by pressing the button 311 or the registration number column 321, it is possible to input the registration number of a new box (new registration target box). Similarly, the user can input the registered name of the new box by pressing the button 312 or the registered name field 322.

  Here, as described above, it is assumed that the button 312 (or the registered name field 322) is pressed and the keyboard screen 212 is displayed. Specifically, when coordinate information of the pressed position of the button 312 (or the registered name field 322) is transmitted from the external terminal 50 to the MFP 10, the MFP 10 determines an operation position on the external terminal 50 based on the coordinate information. Then, the MFP 10 determines the character input screen (keyboard screen 212) corresponding to the operation position as the next transition destination screen. The MFP 10 transmits the image data of the transition destination screen 212 to the external terminal 50, and the external terminal 50 displays the operation screen 202 (FIG. 8) including the transition destination screen 212 based on the received image data. Note that image data other than the panel image display area R1 in the operation screen 200 (202) may be transmitted together with the image data of the panel image display area R1 (for example, image data of the transition destination screen 212). It is not limited to. For example, image data stored in advance in the external terminal 50 may be used as image data other than the panel image display region R1 in the operation screen 200.

<1-5. Operation>
Next, the operation of the image forming system 1 will be described with reference to FIGS. FIG. 4 is a flowchart showing the operation of the MFP 10, and FIG. 5 is a flowchart showing the operation of the external terminal 50. FIG. 6 is a timing chart showing an operation example in the image forming system 1.

  Here, as described above, screen data (image data of the screen 212) from the MFP 10 to the external terminal 50 has already been transmitted (step S1 (see FIG. 6)), and the character input screen is displayed on the touch panel 75 of the external terminal 50. Assume that a screen 202 including 212 (see FIG. 8) is already displayed as an operation screen (step S2) (see also the beginning of FIG. 6).

  Thereafter, the user of the external terminal 50 inputs a character string into the character input field 221 on the IME input screen of the external terminal 50 using the keyboard (hardware keyboard or the like) of the external terminal 50. The external terminal 50 Then, the input of the character string is accepted (step S31 (see FIGS. 5 and 6)). Here, it is assumed that a four-character string “Koichi” has been input.

  Next, the input character string (specifically, information related to the input character string (also referred to as “input character string information”) input in step S31 is transmitted from the external terminal 50 to the MFP 10 (step S33 (S33a)). . For example, when the transmission button 222 (FIG. 8) is pressed, in response to the pressing operation, information on the input character string “Kouichi” (specifically, each character (“ko”, “u”, “i”) , “Ch”) information (in other words, text information of the input character string) is transmitted from the external terminal 50 to the MFP 10. Note that the input character string input at the external terminal 50 may be composed of a plurality of characters or a single character.

  Here, in the first embodiment, it is assumed that the kana-kanji conversion function of the IME built in the external terminal 50 is disabled, and only the input kana (for example, hiragana) characters are transmitted. Note that the character input function of the IME built in the external terminal 50 is not invalidated, and the character input operation in step S31 described above is performed using the character input function.

  On the other hand, when the MFP 10 receives the input character string information (input character string information) input by the IME of the external terminal 50 from the external terminal 50 (step S11 (see FIG. 4 and FIG. 6)), the input character string is received. The input character string is recognized based on the information, and conversion candidates (also referred to as new conversion candidates or alternative conversion candidates) relating to the input character string are acquired (step S13). Specifically, the conversion candidate acquisition unit 15 (see FIG. 2) of the MFP 10 determines a conversion candidate related to the input character string based on a conversion dictionary built in the MFP 10, and information about the conversion candidate (conversion candidate information). Generate and get. Each of the plurality of words (conversion candidates) included in the conversion candidate information includes only characters that can be used by the MFP 10 (also referred to as “available characters”).

  For example, for "Koichi", there are multiple words ("Koichi", "Koichi", "Kouichi", "Koichi", "Kouichi", "Koichi", "Kouichi", ..., "Koichi" Etc.) are extracted from the conversion dictionary (dictionary database) in the MFP and determined as conversion candidates. Each character that constitutes each conversion candidate ("Yuki", "Ichi", "Ko", "Yasu", "Hou", "Kou", "Hikari", "Hiro", ..., "Ko", " “U”, “i”, “chi”, etc.) are characters that can be used by both the MFP 10 and the external terminal 50.

  In the next step S <b> 14, the conversion candidate determined in step S <b> 13 (specifically, information related to the conversion candidate (also referred to as “conversion candidate information”)) is transmitted to the external terminal 50. In the first embodiment, display data (image data) for a screen (213 or the like (described later)) showing conversion candidates is generated as “conversion candidate information” by the conversion candidate acquisition unit 15 of the MFP 10, and the image data Is transmitted to the external terminal 50.

  When the external terminal 50 receives a conversion candidate (specifically, screen data indicating the conversion candidate) in step S34, the process proceeds to step S36.

  In step S36, the external terminal 50 displays the conversion candidate. FIG. 9 is a diagram showing a display example of such a conversion candidate (an example of a screen showing the conversion candidate). FIG. 9 shows a state in which the screen 213 is displayed (in place of the screen 212) in the panel image display region R1 in the operation screen 200 (203). The screen 213 is a display screen showing a plurality of conversion candidates (“Koichi”, “Koichi”, “Kouichi”, “Koichi”, “Kouichi”, “Koichi”, “Kouichi”, “Koichi”, etc.).

  The user selects a desired option (for example, “Korichi”) from among a plurality of conversion candidates (conversion candidate group) displayed on the screen 213 (step S37). Specifically, when a touch operation (pressing operation) is performed on a portion corresponding to a desired option displayed on the touch panel 75, the option is selected. Alternatively, the option may be selected by a mouse click operation or the like.

  The external terminal 50 transmits the option (selection result) selected by the user (for example, “Korichi”) to the MFP 10 (step S38). More specifically, the external terminal 50 transmits the coordinate information of the touch position in the option by the user to the MFP 10. The MFP 10 can recognize the option selected by the user (for example, “Korichi”) based on the coordinate position.

  When the MFP 10 receives a selection result (specifically, information (coordinate information) indicating the selection result) from the external terminal 50 and recognizes the selection result (step S15), the MFP 10 uses the selection result as a conversion result of the input character string. Confirm (step S16). In other words, the conversion result (for example, “Korichi”) corresponding to the input character string input by the user is determined by the MFP 10.

  In addition, the MFP 10 transmits a screen (specifically, screen image data (display data)) including the confirmed input character to the external terminal 50 (step S17).

  On the other hand, based on the received image data, the external terminal 50 displays a screen based on the image data on the touch panel 75 (step S39). For example, as shown in a screen 215 in FIG. 10, two characters “Korichi” are displayed in the character input field 219 in the panel image display region R1.

  Immediately after the input of such a character string (“Kouichi”) (or after a similar operation is performed as necessary and a desired further character string is input), an OK button in the operation screen 210 is displayed. When pressed, all of the input character strings are accepted as registration target character strings (here, “box registration names”).

  According to the operation as described above, the MFP 10 receives the character string (input character string) input by the IME of the external terminal 50 (step S11), and is a conversion candidate related to the input character string and is used by the MFP 10. Information (conversion candidate information) regarding conversion candidates composed only of possible characters is acquired (step S13), and the conversion candidate information is transmitted to the external terminal 50 (step S14). Then, the conversion candidates included in the conversion candidate information are displayed on the external terminal 50 (step S36), and the selection result selected from the conversion candidates is finally determined as the conversion result regarding the input character string. (Step S16). Accordingly, a candidate selected from conversion candidates composed only of characters that can be used in the MFP 10 (available characters) can be determined as a final conversion result, and therefore, characters that cannot be used in the MFP 10 ( It is possible to avoid including “unusable characters”) in the conversion result of the input character string. In other words, when characters are input to the MFP 10 using the external terminal 50, it is possible to appropriately input characters usable in the MFP 10 to the MFP 10.

  In the above embodiment, the mode in which image data indicating conversion candidates is transmitted and received as “conversion candidate information” is exemplified, but the present invention is not limited to this, and “conversion candidate information” lists conversion candidates. List information (information in which character code groups related to conversion candidates are listed) or the like may be used.

  FIG. 11 is a diagram showing such a modification. In FIG. 11, a selection candidate display field 224 is displayed immediately below the character input field 221. In the selection candidate display field 224, conversion candidates included in the conversion candidate information are displayed in a list format. Specifically, the MFP 10 transmits list information indicating conversion candidates related to the input character string (text information (character information) listing conversion candidates) to the external terminal 50 as “conversion candidate information” (step S14 (step S14)). (See FIG. 6 etc.)). On the other hand, the external terminal 50 generates display data for the selection candidate display column 224 based on the received list information, and displays a screen including the selection candidate display column 224 (step S36 and the like). More specifically, the display control unit 63 of the external terminal 50 generates image data related to the selection candidate display field 224 based on the list information, and combines the image data with the image data of the original screen. 11 is generated, and the screen 200 based on the image data is displayed on the touch panel 75.

  Such modifications can also be applied to other embodiments described later.

<2. Second Embodiment>
In the said 1st Embodiment, the kana-kanji conversion function (function to convert kana to kanji) of IME built in the external terminal 50 illustrated the aspect invalidated.

  In this 2nd Embodiment, the aspect in which the kana-kanji conversion function of IME built in the external terminal 50 is validated is illustrated. Specifically, in the second embodiment, first, kana-kanji conversion is executed using the IME of the external terminal 50, and then characters that cannot be used by the MFP 10 (“unusable characters”) are displayed in the external terminal 50. Are included in the conversion result by the IME, the conversion candidate regarding the input character string is transmitted to the external terminal 50 using the IME on the MFP 10 side.

  Hereinafter, such an aspect will be described with reference to FIGS. FIG. 12 is a flowchart showing the operation of the MFP 10 according to the second embodiment, and FIG. 13 is a flowchart showing the operation of the external terminal 50 according to the second embodiment. FIG. 14 is a timing chart showing an operation example in the image forming system 1 according to the second embodiment.

  As in the first embodiment, in the state where the operation screen of FIG. 8 is displayed on the external terminal 50, a character string (for example, a character string of four characters “Kouichi”) is input using the IME of the external terminal 50. Then, the external terminal 50 receives the input of the character string (step S31 (see FIG. 13)). Thereafter, the user gives a conversion instruction for the input character string (input character string) to the IME of the external terminal 50 by pressing the “space bar (space key)” on the keyboard once or a plurality of times. . In other words, the IME conversion operation using the keyboard is performed. The IME of the external terminal 50 determines the character string after conversion of the input character string in accordance with this conversion instruction (IME conversion operation). For example, using the IME of the external terminal 50, “Kyoichi” is determined as the character string after conversion for “Koichi”. Thereafter, the transmission button 222 is pressed by the user.

  If it is determined that the input character string conversion instruction is given (the space key or the like is pressed) and the transmission button 222 is pressed, the process proceeds from step S32 to step S33 (S33b). Also, when it is determined that the transmission button 222 is pressed without performing the conversion operation using the keyboard (that is, a confirmation instruction is given with the kana (such as hiragana)), the process proceeds to the next step S33. . In this embodiment, it is assumed that the instruction to confirm the input character string as a kana character is also a conversion instruction by IME.

  In step S33 (S33b) (FIG. 13), both the input character string and the character string converted by the IME of the input character string (also referred to as “character string after conversion”) are transmitted to the MFP 10. For example, both the input character string “Kouichi” and the converted character string “Kyoichi” are transmitted (see FIG. 14).

  When information regarding the input character string and the converted character string is received from the external terminal 50 (step S11b), the MFP 10 (conversion candidate acquisition unit 15 (see FIG. 2)) cannot use characters (" It is determined whether or not “unusable characters” are included in the converted character string (conversion result) (step S12). Specifically, a determination process is performed based on the character code of each character in the character string after conversion by the IME of the external terminal 50 and the character code of “available character” stored in the MFP 10 (storage unit 5). If the character code of any character in the character string after conversion by the IME of the external terminal 50 does not correspond to any of the character codes of “available characters” stored in the MFP 10, the MFP 10 includes the character code after conversion. It is determined that “unusable characters” are included.

  If the “unusable character” of the MFP 10 is not included in the converted character string, it is determined that the converted character string can be registered, and the process proceeds to step S19. In step S19, “available notification” (“registerable notification”) indicating that all characters included in the converted character string are usable in the MFP 10 (in other words, can be registered in the MFP 10), It is transmitted from the MFP 10 to the external terminal 50. Further, the MFP 10 determines the converted character string as it is as the conversion result for the input character string (step S16), and transmits the image data of the screen (FIG. 10) including the determined character string to the external terminal 50 (step S17). To do. Further, based on the received image data, the external terminal 50 displays a screen based on the image data on the touch panel 75 (step S39).

  On the other hand, if the “unusable character” of the MFP 10 is included in the converted character string, it is determined that the converted character string cannot be registered, and the process proceeds to step S13b.

  For example, assuming that “廣” in the converted character string “廣 一” is an “unusable character” of the MFP 10, the converted character string “廣 一” includes characters that cannot be used in the MFP 10. The process proceeds from step S12 to step S13b.

  In step S13b, the MFP 10 recognizes the input character string based on the information (text information) related to the input character string (in other words, the character string before conversion) acquired in step S11b, and converts the input character string. To get. Specifically, conversion candidates are acquired in the same manner as in the first embodiment. For example, for “Kouichi”, multiple words (“Koichi”, “Koichi”, “Koichi”, “Koichi”, “Koichi”, “Koichi”, “Kouichi”, ...) Are extracted based on the conversion dictionary and determined as “conversion candidates”. Here, “廣” is a character that can be used in the external terminal 50, but cannot be used in the MFP 10. Therefore, the MFP 10 does not extract “廣” as a conversion candidate.

  As described above, when the “unusable character” of the MFP 10 is included in the conversion result (converted character string) of the input character string on the external terminal 50 side, the conversion candidate information regarding the input character string is acquired by the MFP 10. And transmitted to the external terminal 50 (steps S13b and S14).

  Thereafter, the MFP 10 performs the same operation as that in the first embodiment (specifically, the operations in steps S14 to S17).

  On the other hand, the external terminal 50 executes a branch process in accordance with the determination process in steps S34b and S35.

  Specifically, when the external terminal 50 receives a registration enable notification from the MFP 10, the conversion result by the IME of the external terminal 50 is directly approved by the MFP 10 (that is, each character included in the conversion result is displayed in the MFP 10. Is available). In this case, the process of steps S36 to S38 is not performed, and the process proceeds from step S35 to step S39. Note that the present invention is not limited to this, and it is determined in step S35 that information (for example, image data) regarding character string conversion candidates (substitution candidates) is not received even after a predetermined waiting period (for example, 2 seconds) has elapsed. In such a case, it may be determined that the conversion result is directly approved by the MFP 10.

  Further, when the external terminal 50 receives the information regarding the conversion candidate (information transmitted by the transmission processing in step S14 in the MFP 10), the fact that “unusable character” is included in the conversion result by the IME of the external terminal 50. Recognize In this case, the process proceeds from step S34b to step S36.

  After step S36, the same operation as that of the first embodiment is performed by the external terminal 50. For example, in step S36, the external terminal 50 displays conversion candidates using a screen as shown in FIG. In step S37, the user selects a desired option (for example, “Korichi”) from the conversion candidates, and in step S38, the option selected by the user (for example, “Korichi”) is the external terminal. 50 to the MFP 10. Further, after the processes of steps S15, S16, and S17 by the MFP 10, the process of step S39 is performed on the external terminal 50.

  The effects as described in the first embodiment can also be obtained by the operation as described above.

  When the conversion result by the IME of the external terminal 50 can be used as it is in the MFP 10 (when the “unusable character” of the MFP 10 is not included in the conversion result by the IME on the external terminal 50 side), the conversion result is used as it is. The Therefore, when there is no problem in the conversion result by the IME of the external terminal 50, the character conversion operation can be performed by effectively using the IME of the external terminal 50.

<3. Third Embodiment>
The third embodiment is a modification of the second embodiment. Hereinafter, the difference from the second embodiment will be mainly described.

  In the second embodiment, both the input character string and the converted character string are transmitted from the external terminal 50 to the MFP 10 almost simultaneously, and it is determined whether the converted character string includes unusable characters of the MFP 10. Is done. Then, when the unusable characters of the MFP 10 are included in the converted character string, a mode in which the MFP 10 extracts conversion candidates related to the input character string received in advance is illustrated.

  On the other hand, in the third embodiment, as shown in FIG. 17, first of all, an input character string (also referred to as a pre-conversion character string) and a post-conversion character string (for example, “Kouichi”) ) Is transmitted from the external terminal 50 to the MFP 10 (step S33). Thereafter, the input character string is transmitted from the external terminal 50 to the MFP 10 only when it is determined that the unusable characters of the MFP 10 are included in the conversion result (step S42). In other words, the conversion result (converted character string) related to the input character string by the IME installed in the external terminal 50 is transmitted prior to the input character string information.

  More specifically, the MFP 10 determines whether or not “unusable characters” are included in the converted character string (step S12). If the converted character string includes characters that cannot be used by the MFP 10, a registration failure notification (also expressed as a request for transmitting the input character string) is transmitted from the MFP 10 to the external terminal 50 (step S 21). The external terminal 50 transmits the input character string (character string before conversion) to the MFP 10 in response to receiving the transmission request (registration impossible notification) (step S41) (step S42). When the MFP 10 receives the input character string from the external terminal 50 (step S22), the MFP 10 acquires a conversion candidate (conversion candidate information) regarding the input character string (step S13), and externally converts the conversion candidate (conversion candidate information). It transmits to the terminal 50 (step S14).

  Hereinafter, such an aspect will be described with reference to FIGS. FIG. 15 is a flowchart showing the operation of the MFP 10 according to the third embodiment, and FIG. 16 is a flowchart showing the operation of the external terminal 50 according to the third embodiment. FIG. 17 is a timing chart showing an operation example in the image forming system 1 according to the third embodiment.

  Steps S31 and S32 (see FIG. 16) in the external terminal 50 are the same as in the second embodiment. Thereafter, in step S33c, only the post-conversion character string (specifically, information on the post-conversion character string (character code, etc.)) of the input character string (also referred to as the pre-conversion character string) and the post-conversion character string. Is transmitted from the external terminal 50 to the MFP 10.

  Upon receiving the converted character string transmitted from the external terminal 50 in step S11c, the MFP 10 proceeds to step S12.

  In step S12, the MFP 10 determines whether or not “unusable characters” are included in the converted character string. When it is determined that “unusable characters” are not included in the converted character string, the process proceeds from step S12 to step S19. The operations after step S19 are the same as in the second embodiment.

  On the other hand, when it is determined that “unusable characters” (for example, “廣”) are included in the converted character string (for example, “廣 ichi”), the process proceeds from step S12 to step S21.

  In step S <b> 21, a “registration impossible notification” (also expressed as an input character string transmission request) is transmitted from the MFP 10 to the external terminal 50.

  The external terminal 50 executes a branch process along with the determination process in steps S41 and S35.

  Specifically, when receiving a registration enable notification from the MFP 10, the external terminal 50 proceeds from step S35 to step S39 without performing the processes of steps S42, S34, S36 to S38.

  Further, when the external terminal 50 receives the “registration impossible notification” (“transmission request”) from the MFP 10 (step S41), the process proceeds from step S41 to step S42. In step S42, the external terminal 50 receives the input character string (for example, “Kouichi”) (specifically, information related to the input character string (character string before conversion)) in response to the registration impossible notification (transmission request). To send).

  When the MFP 10 receives the input character string transmitted from the external terminal 50 (specifically, information relating to the input character string (character code of each character of the input character string)) in step S22, the process proceeds to step S13c. .

  In steps S13c to S17, the MFP 10 performs the same operation as in the second embodiment. For example, the MFP 10 acquires information about the conversion candidate (conversion candidate information) for the input character string received in step S22 (step 13c), and transmits the conversion candidate (conversion candidate information) to the external terminal 50 (step). S14).

  On the other hand, when the external terminal 50 receives the information regarding the conversion candidate (information transmitted by the transmission process of step S14 in the MFP 10), the process proceeds from step S34c to step S36.

  After step S36, the same operation as in the second embodiment is performed by the external terminal 50. For example, in step S36, the external terminal 50 displays conversion candidates using a screen as shown in FIG. In step S37, the user selects a desired option (for example, “Korichi”) from the conversion candidates, and in step S38, the option selected by the user (for example, “Korichi”) is the external terminal. 50 to the MFP 10. Further, after the processes of steps S15, S16, and S17 by the MFP 10, the process of step S39 is performed on the external terminal 50.

  The effects as described in the second embodiment can also be obtained by the operation as described above.

<4. Fourth Embodiment>
The fourth embodiment is a modification of the second embodiment. Hereinafter, the difference from the second embodiment will be mainly described.

  The second embodiment exemplifies a mode in which conversion candidates relating to the entire input character string (for example, “Koichi”) are determined by the MFP 10 and the conversion candidates are transmitted from the MFP 10 to the external terminal 50. In the second embodiment, even when “unusable character” of the MFP 10 is included in the conversion result by the IME of the external terminal 50, which character in the conversion result is “unusable character”. The information shown is not notified to the external terminal 50.

  On the other hand, in the fourth embodiment, when “unusable characters” (unregistrable characters) of the MFP 10 are included in the conversion result by the IME of the external terminal 50, “unusable characters” are identified from the conversion results. Then, information on the specified character is transmitted from the MFP 10 to the external terminal 50. Then, a part of the input character string (a part corresponding to the unusable character) instead of the entire input character string by the IME of the external terminal 50 (for example, a part of the input character string corresponding to the unusable character “廣” ") Is specified by the MFP 10. Then, conversion candidates regarding the partial character string (which may be a single character) are determined by the MFP 10, and the conversion candidates are transmitted from the MFP 10 to the external terminal 50.

  Hereinafter, such an aspect will be described with reference to FIGS. FIG. 18 is a flowchart showing the operation of the MFP 10 according to the fourth embodiment, and FIG. 19 is a flowchart showing the operation of the external terminal 50 according to the fourth embodiment. FIG. 20 is a timing chart showing an operation example in the image forming system 1 according to the fourth embodiment.

  Steps S31, S32, S33b (FIG. 19) in the external terminal 50 are the same as those in the second embodiment (see FIG. 13), and steps S11b, S12, S19 (FIG. 18) in the MFP 10 are the same as those in the second embodiment (FIG. 18). 12). In FIG. 20, the illustration of the operation prior to step S33 is omitted.

  However, in the fourth embodiment, when it is determined in step S12 that the character string after conversion (for example, “廣 1”) includes “unusable characters” (for example, “廣”), The process proceeds from step S12 to step S21.

  In step S 21, “registration impossible notification” (input character string transmission request) is transmitted from the MFP 10 to the external terminal 50.

  In the next step S24, “unusable character” (for example, “）”) is specified from the converted character string (for example, “廣 ichi”) acquired in step S11.

  Specifically, the character code of each character (for example, “廣”, “one”) in the character string after conversion by the IME of the external terminal 50 is “usable character” (available in the MFP 10) stored in the MFP 10. Character) is included in the character code group. In the converted character string, a character (for example, “廣”) whose character code is not included in the character code group (character code list, etc.) of “available character” is determined to be “unusable character”. . Note that a character (for example, “one”) included in the character code group whose character code is “available character” is determined to be “available character”.

  In step S <b> 25, the unusable characters (specifically, information on unusable characters) are notified (transmitted) from the MFP 10 to the external terminal 50. For example, the character code of the character (such as “廣”) transmitted from the external terminal 50 in step S33 may be returned as it is as information on the unusable character.

  In step S26, a conversion candidate (also referred to as a new conversion candidate or an alternative conversion candidate) is acquired for the pre-conversion character string corresponding to the unusable character in the post-conversion character string. Specifically, first, a part (part of pre-conversion character string) corresponding to the unusable character (unusable character in the post-conversion character string) identified in step S24 is an input character string (pre-conversion character string). ). For example, the part “Kou” (part of the pre-conversion character string) corresponding to the unusable character (“廣”) is specified from the pre-conversion character string “Kouichi”. Next, a conversion candidate (and a conversion candidate composed of characters that can be used in the MFP 10) related to the portion of the pre-conversion character string is determined and acquired by the MFP 10 (the conversion candidate acquisition unit 15 or the like). For example, `` Kou '', which is a part of the pre-conversion character string, has multiple words (`` Kou '', `` Yuki '', `` Hiro '', `` High '', `` Section '', `` School '', `` Port '' ..) are extracted based on the conversion dictionary in the MFP and are determined as “conversion candidates”.

  Further, in the next step S27, the conversion candidate (specifically, information indicating the conversion candidate (conversion candidate information)) is notified (transmitted) from the MFP 10 to the external terminal 50. Here, a screen 215 (see FIG. 21) including each character of the conversion candidate is generated, and the screen 215 (specifically, the image data) is transmitted from the MFP 10 to the external terminal 50 as conversion candidate information. In FIG. 21, a screen 215 showing conversion candidates related to “Kou” (“Kou”, “Yuki”, “Hiro”, “High”, “Section”, “School”, “Port”,...) Is illustrated. Has been.

  In addition, although the aspect in which two characters “Kou” are specified as a part of the pre-conversion character string is mainly illustrated here, even if one character is specified as a part of the pre-conversion character string Good.

  Each information transmitted in the above steps S21, S25, S27 is received by the external terminal 50 in steps S41, S43, S45, respectively.

  When the “registration impossible notification” (“transmission request”) is received by the external terminal 50, the process proceeds from step S41 to step S43.

  In step S43, the external terminal 50 further receives the unusable character identification result. For example, the external terminal 50 receives a notification that “廣” is an unusable character. Then, in the next step S44, a process of clearly indicating an unusable character (for example, “廣”) is executed (see FIG. 21). In FIG. 21, the unusable character (unusable character) is clearly indicated by highlighting the unusable character “廣” in the converted character string “列 一” displayed in the character input field 221. Yes.

  In step S45, information on the conversion candidate regarding the input character string corresponding to the unusable character is received from the MFP 10, and in step S46, the conversion candidate is displayed based on the received information. For example, with respect to an input character string (“Kou”) corresponding to an unusable character (“廣”), image data indicating the conversion candidate is received from the MFP 10 (step S45), and an image based on the image data (a conversion candidate is selected). An image 200 including a screen 215 to be displayed (see FIG. 21) is displayed on the external terminal 50.

  The user selects a desired option (for example, “broad”) from among a plurality of conversion candidates (conversion candidate group) displayed on the screen 215. Specifically, the selection operation is performed by a user operation such as a touch operation. If it is determined in step S47 that a desired character string has been selected from the conversion candidate group, the process proceeds to step S48. In step S <b> 48, information regarding the option (selection result) (for example, “broad”) selected by the user is transmitted from the external terminal 50 to the MFP 10. More specifically, coordinate information of the touch position within the option by the user is transmitted to the MFP 10. The MFP 10 recognizes the option (selection result) selected by the user based on the coordinate position.

  When the transmitted selection result (information indicating the selection result in detail) is received and recognized in step S28 by the MFP 10, the process proceeds to step S16 (S16d). In step S16d, the selection result is determined as a conversion result (eg, “broad”) of the input character string (eg, “kou”) corresponding to the unavailable character (eg, “廣”). Also, the conversion result of the input character string corresponding to the unusable character (for example, “broad”) and the conversion result of the input character string corresponding to the portion other than the unusable character (for example, “one”) are synthesized. Thus, the final conversion result (for example, “Korichi”) regarding the entire input character string (“Kouichi”) is determined. Further, in step S17, a screen including the final conversion result (specifically, screen image data) is transmitted to the external terminal 50 (step S17).

  On the other hand, based on the received image data, the external terminal 50 displays a screen based on the image data on the touch panel 75 (step S39). For example, as shown in FIG. 10 described above, a screen in which two characters “Korichi” are input in the character input field 219 is displayed.

  When the external terminal 50 receives a registration enable notification (see step S19) from the MFP 10, the external terminal 50 does not perform the processes of steps S43 to S48, and the process proceeds from step S35 to step S39. In step S39, the same processing as described above is performed.

  The effects as described in the second embodiment can also be obtained by the operation as described above. In particular, when “unusable character” is included in the conversion result, the unusable character is identified by the MFP 10 and notified to the external terminal 50, so that the external terminal 50 and its user are inconvenient for any character. It is possible to easily grasp whether this occurs. Furthermore, a part of the pre-conversion character string (such as “Kou”) corresponding to the character is identified from the input character string, and conversion candidates (and “usable characters” regarding the identified part of the pre-conversion character string are identified. Is obtained as conversion candidate information regarding the input character string. Then, the conversion candidate information is notified to the external terminal 50. Therefore, the external terminal 50 and the user can efficiently perform an appropriate conversion process related to “unusable characters” after grasping “unusable characters”.

  The idea according to the fourth embodiment can be combined with the third embodiment. Specifically, first, only the converted character string (for example, “Keiichi”) out of the input character string (character string before conversion) and the character string after conversion is transmitted from the external terminal 50 to the MFP 10, and then the MFP 10. The input character string (for example, “Kouichi”) may be transmitted from the external terminal 50 to the MFP 10 only when the unusable characters are included in the converted character string. More specifically, as in the third embodiment, the input character string is transmitted from the external terminal 50 to the MFP 10 in response to a registration impossible notification (input character string transmission request) from the MFP 10 to the external terminal 50. That's fine. Thereafter, the operation for specifying and transmitting the unusable characters (characters that cannot be registered) (steps S24 and S25), the operation for acquiring and transmitting the conversion candidate corresponding to the unusable characters (steps S26 and S27), etc. What is necessary is just to carry out similarly to 4 embodiment.

<5. Other>
Although the embodiments of the present invention have been described above, the present invention is not limited to the contents described above.

  For example, in each of the above-described embodiments, a mode in which the conversion process (character conversion process) of the MFP 10 is performed mainly using the IME conversion dictionary built in the MFP 10 is illustrated, but the present invention is not limited to this. Specifically, the conversion process (conversion candidate determination process) is performed based on various registration information (address book information (name, address, telephone number, e-mail address, etc. of the destination person) registered in the MFP 10. It may be performed. For example, when two characters “ko” input in the character input field 221 of the external terminal 50 are transmitted from the external terminal 50 to the MFP 10 in response to the pressing operation of the transmission button 222, the MFP 10 is registered in itself. A registered word (an already registered word / phrase) including the two characters (for example, “konicaminolta.co.jp”) may be extracted from the registered information as conversion candidates. In other words, a phrase obtained by adding a plurality of subsequent character strings to the input of the first few characters (here, two characters “ko”) is acquired as a conversion candidate that complements the first few characters. May be.

  Further, in each of the above embodiments, a mode in which character string conversion processing (conversion candidate determination processing) is mainly executed by the MFP 10 is exemplified, but the present invention is not limited to this. For example, in each of the above embodiments, The conversion process executed by the MFP 10 may be executed using the server 80. The server 80 is a device (external device) different from the MFP 10 and the external terminal 50, and is connected to the MFP 10 and the like via the network 108 (see FIG. 1). Further, it is assumed that the server 80 stores information on characters that can be used in the MFP 10 in a storage unit (storage unit) of the server 80.

  Specifically, after the pre-conversion character string information is acquired in step S11 (, S22) or the like, the conversion candidate extraction process (determination process) as described above in steps S13 and S26 is executed by the server 80. It only has to be done. The processing result of the extraction process (that is, the conversion candidate (conversion candidate information) regarding the pre-conversion character string) is transmitted from the server 80 to the MFP 10 and acquired by the conversion candidate acquisition unit 15 of the MFP 10 or the like.

  More specifically, first, data including a pre-conversion character string and a conversion candidate extraction instruction related to the pre-conversion character string is transmitted from the MFP 10 (conversion candidate acquisition unit 15 or the like) to the server 80. In response to this transmission operation, the server 80 executes conversion candidate extraction processing (decision processing) regarding the pre-conversion character string based on the extraction instruction and the like, and sends information about the extraction result (that is, conversion candidate) to the MFP 10. Send. The MFP 10 appropriately processes the information regarding the conversion candidate and transmits the information to the external terminal 50. For example, when text data indicating a conversion candidate is transmitted from the server 80 to the MFP 10, the MFP 10 generates image data (screen data) based on the text data and transmits the image data to the external terminal 50.

  As described above, the conversion processing that has been executed by the MFP 10 in each of the above embodiments may be executed by using the server 80.

  In each of the above embodiments, a personal computer is mainly exemplified as the external terminal 50. However, the present invention is not limited to this, and a tablet terminal or the like may be used as the external terminal 50 as described above.

  Moreover, in each said embodiment, although the aspect in which a character string is input using the operation screen as shown in FIG. 8 is illustrated, it is not limited to this.

  For example, a character string may be input using an operation screen 208 as shown in FIG. FIG. 22 illustrates a mode in which the operation screen 208 is displayed on the tablet terminal (50b) as the external terminal 50. In the operation screen 208 of FIG. 22, an input screen (also referred to as an IME screen) 500 by the IME of the external terminal 50 is superimposed on the operation screen 210 similar to the operation screen of the touch panel 25 of the MFP 10. On the IME screen 500, a software keyboard 510 having a plurality of keys, an input character display field 521 (corresponding to the above-described character display field 221), and the like are arranged.

  In this case, for example, the “return” key (or “conversion” key, etc.) of the software keyboard 510 in the IME screen 500 is used as a key having the same function as the transmission button 222 in the above-described embodiment. The transmission operation and the like similar to the embodiment may be executed. Further, the space key of the software keyboard 510 in the IME screen 500 is used as a key having the same function as the space key of the hardware keyboard in the above embodiment, and the conversion operation and the like similar to those in the above embodiments are executed. Just do it.

1 image forming system 10 MFP (image forming apparatus)
25 (MFP) touch panel 50 External terminal (remote control device)
75 (touch panel of external terminal) 80 server 213 (indicating input character string conversion candidates) screen 221 (IME) character input field 222 (IME) send button 224 selection candidate display field R1 panel image display area

Claims (22)

An image forming system,
An image forming apparatus;
A remote operation device for remotely operating the image forming apparatus;
With
The remote control device is:
A character input means for receiving character input by the user;
Communication means for transmitting to the image forming apparatus input character string information which is information of an input character string input by the character input means and is information including a character code of each character of the input character string;
Have
The image forming apparatus includes:
Receiving means for receiving the input character string information from the remote control device;
An acquisition means for recognizing the input character string based on the input character string information and acquiring information on a conversion candidate related to the input character string and composed of characters usable in the image forming apparatus; ,
Transmitting means for transmitting conversion candidate information, which is information relating to the conversion candidate, to the remote control device;
Have
The remote control device is:
Display means for displaying the conversion candidate information transmitted from the image forming apparatus;
And an image forming system. The image forming system according to claim 1,
The receiving means also receives a conversion result related to the input character string by the IME installed in the remote control device;
The acquisition unit determines whether or not characters that cannot be used in the image forming apparatus are included in the conversion result,
The transmission unit transmits the conversion candidate information regarding the input character string to the remote control device when a character that cannot be used in the image forming device is included in the conversion result. system. The image forming system according to claim 2.
The receiving means receives, in addition to the input character string information, a conversion result related to the input character string by the IME installed in the remote control device,
The acquisition unit acquires the conversion candidate information regarding the input character string received in advance when a character that cannot be used in the image forming apparatus is included in the conversion result,
The image forming system, wherein the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote control device. The image forming system according to claim 2.
The receiving means receives a conversion result related to the input character string by the IME installed in the remote control device prior to the input character string information,
The transmission means transmits a request for transmission of the input character string to the remote control device when a character that cannot be used in the image forming apparatus is included in the conversion result,
The acquisition means acquires the conversion candidate information regarding the input character string transmitted from the remote control device in response to the transmission request,
The image forming system, wherein the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote control device. The image forming system according to any one of claims 2 to 4,
The transmission unit identifies a character that cannot be used by the image forming apparatus from the conversion result when a character that cannot be used by the image forming apparatus is included in the conversion result. An image forming system for transmitting information on the characters to the remote control device. The image forming system according to claim 5.
When the conversion result includes characters that cannot be used in the image forming apparatus, the obtaining unit inputs a part of the pre-conversion character string corresponding to the characters that cannot be used in the image forming apparatus. Information on conversion candidates that are specified from among character strings and that are conversion candidates related to the specified part of the pre-conversion character strings and that can be used in the image forming apparatus are related to the input character string Obtained as the conversion candidate information,
The image forming system, wherein the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote control device. The image forming system according to any one of claims 1 to 6,
The transmission means transmits image data of a screen indicating the conversion candidate related to the input character string to the remote operation device as the conversion candidate information,
The image forming system, wherein the remote operation device displays a screen based on the image data. The image forming system according to any one of claims 1 to 6,
The transmitting means transmits list information indicating the conversion candidates related to the input character string to the remote operation device as the conversion candidate information,
The image forming system, wherein the remote operation device generates image data based on the list information and displays a screen based on the image data. The image forming system according to any one of claims 1 to 8,
The acquisition unit determines the conversion candidate using an IME built in the image forming apparatus, and acquires the conversion candidate information related to the conversion candidate. The image forming system according to any one of claims 1 to 9,
The acquisition unit determines a registered word including the input character string as a conversion candidate that complements the input character string based on registration information registered in the image forming apparatus, and determines the conversion candidate information related to the conversion candidate. An image forming system that acquires the image. The image forming system according to any one of claims 1 to 8,
The image forming system includes:
An external device separate from the image forming device and the remote control device;
Further comprising
The external device has information related to characters that can be used in the image forming apparatus, and determines conversion candidates that are only conversion candidates related to the input character string and that can be used in the image forming apparatus. Then, the conversion candidate information regarding the conversion candidate is transmitted to the image forming apparatus,
The image forming system according to claim 1, wherein the acquisition unit of the image forming apparatus acquires the conversion candidate information transmitted from the external apparatus. An image forming apparatus capable of remote operation by a remote operation device,
Receiving means for receiving input character string information which is information of an input character string input by a user at the remote operation device and includes character code of each character of the input character string;
An acquisition means for recognizing the input character string based on the input character string information and acquiring information on a conversion candidate related to the input character string and composed of characters usable in the image forming apparatus; ,
Transmitting means for transmitting conversion candidate information, which is information relating to the conversion candidate, to the remote control device;
An image forming apparatus comprising: The image forming apparatus according to claim 12.
The receiving means also receives a conversion result related to the input character string by the IME installed in the remote control device;
The acquisition unit determines whether or not characters that cannot be used in the image forming apparatus are included in the conversion result,
The transmission unit transmits the conversion candidate information regarding the input character string to the remote control device when a character that cannot be used in the image forming device is included in the conversion result. apparatus. The image forming apparatus according to claim 13.
The receiving means receives, in addition to the input character string information, a conversion result related to the input character string by the IME installed in the remote control device,
The acquisition unit acquires the conversion candidate information regarding the input character string received in advance when a character that cannot be used in the image forming apparatus is included in the conversion result,
The image forming apparatus, wherein the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote operation device. The image forming apparatus according to claim 13.
The receiving means receives a conversion result related to the input character string by the IME installed in the remote control device prior to the input character string information,
The transmission means transmits a request for transmission of the input character string to the remote control device when a character that cannot be used in the image forming apparatus is included in the conversion result,
The acquisition means acquires the conversion candidate information regarding the input character string transmitted from the remote control device in response to the transmission request,
The image forming apparatus, wherein the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote operation device. The image forming apparatus according to any one of claims 13 to 15,
The transmission unit identifies a character that cannot be used by the image forming apparatus from the conversion result when a character that cannot be used by the image forming apparatus is included in the conversion result. An image forming apparatus that transmits information on a character to the remote control device. The image forming apparatus according to claim 16.
When the conversion result includes characters that cannot be used in the image forming apparatus, the obtaining unit inputs a part of the pre-conversion character string corresponding to the characters that cannot be used in the image forming apparatus. Information on conversion candidates that are specified from among character strings and that are conversion candidates related to the specified part of the pre-conversion character strings and that can be used in the image forming apparatus are related to the input character string Obtained as the conversion candidate information,
The image forming apparatus, wherein the transmission unit transmits the conversion candidate information acquired by the acquisition unit to the remote operation device. The image forming apparatus according to any one of claims 12 to 17,
The image forming apparatus, wherein the transmission unit transmits image data of a screen indicating the conversion candidate relating to the input character string to the remote operation device as the conversion candidate information. The image forming apparatus according to any one of claims 12 to 17,
The transmission unit transmits list information indicating the conversion candidates related to the input character string to the remote operation device as the conversion candidate information. 20. The image forming apparatus according to claim 12, wherein:
The image forming apparatus, wherein the acquisition unit determines the conversion candidate using an IME built in the image forming apparatus, and acquires the conversion candidate information regarding the conversion candidate. 21. The image forming apparatus according to claim 12, wherein:
The acquisition unit determines a registered word including the input character string as a conversion candidate that complements the input character string based on registration information registered in the image forming apparatus, and determines the conversion candidate information related to the conversion candidate. An image forming apparatus that acquires the image forming apparatus. In a computer built in an image forming apparatus that can be remotely operated by a remote control device,
a) receiving input character string information that is information of an input character string input by a user at the remote operation device and includes information on a character code of each character of the input character string;
b) A step of recognizing the input character string based on the input character string information and acquiring information on a conversion candidate related to the input character string and composed of characters usable in the image forming apparatus. When,
c) transmitting conversion candidate information that is information relating to the conversion candidate to the remote control device;
A program for running